WO2021139666A1 - Posture detection method, apparatus and system, electronic device and storage medium - Google Patents

Posture detection method, apparatus and system, electronic device and storage medium Download PDF

Info

Publication number
WO2021139666A1
WO2021139666A1 PCT/CN2021/070407 CN2021070407W WO2021139666A1 WO 2021139666 A1 WO2021139666 A1 WO 2021139666A1 CN 2021070407 W CN2021070407 W CN 2021070407W WO 2021139666 A1 WO2021139666 A1 WO 2021139666A1
Authority
WO
WIPO (PCT)
Prior art keywords
thigh
envelope signal
motion data
sampling
acceleration
Prior art date
Application number
PCT/CN2021/070407
Other languages
French (fr)
Chinese (zh)
Inventor
李红红
崔丽华
韩久琦
Original Assignee
京东数科海益信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东数科海益信息科技有限公司 filed Critical 京东数科海益信息科技有限公司
Publication of WO2021139666A1 publication Critical patent/WO2021139666A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing
    • G06F2218/12Classification; Matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing
    • G06F2218/08Feature extraction

Definitions

  • This application relates to the field of data processing, and in particular to a posture detection method, device, system, electronic equipment, and storage medium.
  • Human posture recognition is generally divided into two types: (1) Human body motion posture method based on image recognition. (2) Human motion posture detection method based on electromagnetic wave positioning Human motion posture monitoring based on electromagnetic wave positioning.
  • the present application provides a posture detection method, device, system, electronic device, and storage medium.
  • this application provides a posture detection method, including:
  • the envelope signal is analyzed to determine the posture information at the first sampling moment.
  • the motion data includes: motion data corresponding to at least one key part, wherein each key part corresponds to at least one motion data.
  • the determining the envelope signal corresponding to the motion data includes:
  • the method further includes:
  • the posture identifier corresponding to the first sampling moment is updated.
  • the motion data includes: acceleration in the direction of the gravitational acceleration of the thigh, the angular velocity in the sagittal plane of the thigh, and the three-axis combined angular velocity of the lower leg.
  • the method further includes:
  • the analyzing the envelope signal to determine the posture information at the first sampling moment includes:
  • the posture information at the first sampling moment is determined based on the motion state of the thigh and the motion state of the calf.
  • the determining the state of the thigh according to the envelope signal of the acceleration in the gravitational acceleration direction of the thigh and the envelope signal of the angular velocity in the sagittal plane direction of the thigh at consecutive N sampling moments includes:
  • the thigh movement state is determined based on the first change trend and the second change trend.
  • the present application provides a posture detection device, including:
  • the receiving module is used to receive the motion data at the first sampling moment
  • the determining module is used to determine the envelope signal corresponding to the motion data
  • the analysis module is used to analyze the envelope signal to determine the posture information at the first sampling moment.
  • the motion data includes: motion data corresponding to at least one key part, wherein each key part corresponds to at least one motion data.
  • the determining module includes:
  • the kernel function acquisition sub-module is used to acquire the initialized kernel function
  • the integration sub-module is used to integrate the kernel function after the motion data is input to obtain the envelope signal corresponding to the motion data.
  • the device further includes an update module, and the update module is configured to:
  • a posture information acquisition sub-module configured to acquire posture information of an adjacent second sampling time, the second sampling time being before the first sampling time
  • a time difference acquisition submodule configured to acquire the time difference between the first sampling time and the second sampling time when the posture information at the first sampling time is different from the posture information at the second sampling time;
  • the update sub-module is configured to update the posture identifier corresponding to the first sampling moment when the time difference is greater than the preset time difference.
  • the motion data includes: acceleration in the direction of the gravitational acceleration of the thigh, the angular velocity in the sagittal plane of the thigh, and the three-axis combined angular velocity of the lower leg.
  • the device further includes a data acquisition module, and the data acquisition module is configured to:
  • the analysis module includes:
  • the thigh motion state sub-module is used to determine the thigh motion state according to the envelope signal of the acceleration in the direction of the gravitational acceleration of the thigh and the envelope signal of the angular velocity in the sagittal plane of the thigh at consecutive N sampling moments;
  • the calf motion state sub-module is used to determine the calf motion state according to the envelope signal of the three-axis combined angular velocity of the calf;
  • the posture information sub-module is configured to determine the posture information at the first sampling moment based on the motion state of the thigh and the motion state of the calf.
  • the thigh motion state sub-module includes:
  • a calculating unit configured to calculate the differential average value of the envelope signals of the acceleration in the direction of acceleration due to gravity acceleration of the N thighs;
  • the first change trend unit is configured to obtain the first change trend of the thigh in the vertical direction through the difference average value
  • the second change trend unit is configured to obtain the second change trend of the thigh in the sagittal direction according to the envelope signal of the angular velocity in the sagittal direction of the thigh;
  • the thigh movement state unit is configured to determine the thigh movement state based on the first change trend and the second change trend.
  • the present application provides a posture detection system, including: a motion sensor and a processor, and the motion sensor is in communication connection with the processor;
  • the motion sensor is configured to collect motion data at the first sampling moment, and send the motion data to the processor;
  • the processor is configured to receive motion data at a first sampling time, determine an envelope signal corresponding to the motion data, and analyze the envelope signal to determine posture information at the first sampling time.
  • the present application provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;
  • the memory is used to store computer programs
  • the processor is used to implement the steps of the above method when the computer program is executed.
  • the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the above method steps are implemented.
  • the envelope signal corresponding to the motion data is obtained by processing the motion data, and the posture at the current moment is determined by analyzing the envelope signal, thereby achieving In order to quickly detect the instantaneous posture of the daily human body such as sitting or standing up, so as to provide timely feedback from smart wearable devices.
  • This method can be widely used in medical rehabilitation, human-computer interaction, virtual realization and other fields.
  • FIG. 1 is a schematic diagram of a posture detection system provided by an embodiment of the application
  • FIG. 2 is a flowchart of a posture detection method provided by an embodiment of the application
  • FIG. 3 is a flowchart of a posture detection method provided by another embodiment of this application.
  • FIG. 4 is a flowchart of a posture detection method provided by another embodiment of this application.
  • FIG. 5 is a block diagram of a posture detection device provided by an embodiment of the application.
  • FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the application.
  • This application provides a posture detection method, device, system, electronic equipment, and storage medium.
  • the method provided in the embodiments of the present invention can be applied to any required electronic equipment.
  • it can be a server, a terminal, and other electronic equipment.
  • electronic device There is no specific limitation, and for the convenience of description, it is referred to as electronic device in the following.
  • FIG. 1 is a schematic diagram of a posture detection system provided by an embodiment of this application. As shown in FIG. 1, the system includes: at least one motion sensor 100 and a processor 101, and the motion sensor 100 is in communication connection with the processor 101.
  • the motion sensor 100 is used to collect the motion data at the first sampling moment, and send the motion data to the processor;
  • the processor 101 is configured to receive the motion data at the first sampling time, determine the envelope signal corresponding to the motion data, and analyze the envelope signal to determine the posture information at the first sampling time.
  • the motion sensor can be worn on the side of the human thigh and the human calf respectively.
  • the motion data collected by the motion sensor includes: gyroscope data, acceleration data, angle data, etc.
  • the communication method between the motion sensor and the processor can be Is it wired or wireless.
  • Fig. 2 is a flowchart of a posture detection method provided by an embodiment of the application. As shown in Figure 2, the method includes the following steps:
  • Step S11 receiving the motion data at the first sampling moment
  • Step S12 determining the envelope signal corresponding to the motion data
  • Step S13 Analyze the envelope signal to determine the posture information at the first sampling moment.
  • the envelope signal corresponding to the motion data is obtained by processing the motion data, and the current posture is determined by analyzing the envelope signal, thereby realizing the rapid instantaneous posture of the daily human body such as sitting or standing up. Detection in order to provide timely feedback from smart wearable devices.
  • This method can be widely used in medical rehabilitation, human-computer interaction, virtual realization and other fields.
  • the received motion data at the first sampling moment includes: motion data corresponding to at least one key part, wherein each key part corresponds to at least one motion data, for example, the key parts may be: thigh, calf, shoulder, Elbows, etc., motion data includes: gyroscope data, acceleration data, angular velocity data, etc. of key parts.
  • the envelope signal corresponding to the motion data is determined by the following methods: obtaining the initialized kernel function, passing the motion data into the kernel function, and integrating the kernel function after the motion data is transferred to obtain the motion data Corresponding envelope signal.
  • the kernel function used in this embodiment may be: Gaussian kernel function, Marton kernel function, etc.
  • the motion data that conforms to the changes in the human sitting and standing posture characteristics are extracted from the motion data.
  • the extracted motion data includes the acceleration in the direction of gravitational acceleration of the thigh, the angular velocity of the thigh in the sagittal plane direction and The three-axis combined angular velocity of the calf.
  • the three-axis combined angular velocity of the calf is calculated by the following formula:
  • w 1 x, w 2 y, and w 3 z are the angular velocities of the x, y, and z axes, respectively.
  • the acceleration in the direction of the gravitational acceleration of the thigh, the angular velocity in the sagittal plane direction of the thigh and the three-axis combined angular velocity of the lower leg are smoothly filtered.
  • the sagittal angular velocity of the thigh and the triaxial combined angular velocity of the lower leg are used to extract the envelope signal.
  • analyzing the envelope signal to determine the posture information at the first sampling moment is specifically implemented in the following manner: obtaining the acceleration in the gravitational acceleration direction of the thigh and the angular velocity in the sagittal plane direction of the thigh for N consecutive sampling moments, where N is greater than 1. Integer.
  • the thigh state is determined according to the envelope signal of the acceleration in the direction of the gravitational acceleration of the thigh and the envelope signal of the angular velocity in the sagittal direction of the thigh at consecutive N sampling moments.
  • the difference average value of the network signal is used to obtain the first change trend of the thigh in the vertical direction through the difference average value, and the second change trend of the thigh in the sagittal direction is obtained according to the envelope signal of the angular velocity of the thigh in the sagittal plane.
  • the differential average value of the envelope signals of acceleration in the direction of gravity acceleration of the N thighs calculate the differential average value of the envelope signals of acceleration in the direction of gravity acceleration of the N thighs, and obtain the first change trend of the thigh in the vertical direction through the differential average value, which is obtained by taking the envelope signals of acceleration in the direction of gravity acceleration of the thighs
  • the difference average value is compared with the first threshold value. If the difference average value is greater than the first threshold value, the first change trend of the thigh in the vertical direction is an upward trend. It is confirmed that the thigh is currently changed from a bent state to an upright state; if the difference average value is less than The first threshold, the first change trend of the thigh in the vertical direction is a downward trend, and it is confirmed that the thigh is currently changed from an upright state to a bent state.
  • obtaining the second change trend of the thigh in the sagittal direction according to the envelope signal of the thigh sagittal angular velocity is by comparing the envelope signal of the thigh sagittal angular velocity with the second threshold, if The envelope signal of the angular velocity in the sagittal plane of the thigh is greater than the threshold, and the thigh movement is confirmed.
  • the thigh movement state is determined based on the first change trend and the second change trend. For example, if the first change trend is an upward trend, and the thigh movement is confirmed according to the second change trend, it is confirmed that the thigh movement state changes from bent to upright. Or, if the second change trend is a downward trend, and the thigh movement is confirmed based on the second change trend, it is confirmed that the thigh movement state changes from erect to bent.
  • the movement state of the calf is determined according to the envelope signal of the three-axis combined angular velocity of the calf, by comparing the three-axis combined angular velocity of the calf with a third threshold. When it is less than the third threshold, it is confirmed that the calf is in a static state. ; When it is greater than the third threshold, it is confirmed that the calf is in motion.
  • the posture information at the first sampling moment is determined based on the motion state of the thigh and the motion state of the calf. For example: when the thigh movement state changes from upright to bent, and the calf is in a static state, it is confirmed that the posture information of the human body is a sitting posture. The movement state of the thigh changes from bending to upright, and the calf is in a static state, and the posture information of the human body is confirmed to be a standing posture.
  • FIG. 3 is a flowchart of a posture detection method provided by another embodiment of this application. As shown in Figure 3, the method also includes the following steps:
  • Step S21 Obtain the posture information of the adjacent second sampling time, the second sampling time is before the first sampling time;
  • Step S22 when the posture information at the first sampling time is different from the posture information at the second sampling time, acquiring the time difference between the first sampling time and the second sampling time;
  • Step S23 When the time difference is greater than the preset time difference, update the posture identifier corresponding to the first sampling moment.
  • acquiring the posture information of the adjacent second sampling time is before the first sampling time
  • acquiring the posture information of the adjacent second sampling time includes: acquiring the posture of the second sampling time Identification, the gesture information at the second sampling moment is determined according to the gesture identification.
  • the posture information at the first sampling time is different from the posture information at the second sampling time
  • the time difference between the first sampling time and the second sampling time is acquired, and when the time difference is greater than the preset time difference, the posture identifier corresponding to the first sampling time is updated.
  • the posture information at the second sampling time is a sitting posture
  • the posture information obtained at the first sampling time is a standing posture.
  • the posture information of is the standing posture, and the posture identifier corresponding to the first sampling moment is updated.
  • a method for confirming posture information is also provided, and the maximum value and minimum value of the envelope signal of the acceleration in the direction of the gravitational acceleration of the thigh at the previous sampling time are obtained.
  • the maximum value is updated according to the envelope signal of the acceleration in the direction of the thigh's gravitational acceleration at the first sampling time;
  • the maximum value at the previous sampling time is still used.
  • the ratio can represent the change between the current moment and the instantaneous characteristics of the experience. The larger the ratio, the closer to the sitting posture, and the smaller the ratio, the closer to the standing posture.
  • another embodiment of the present application provides a flow chart of a posture detection method.
  • the method embodiment is specifically used to determine the instantaneous change of the sitting posture and the standing posture.
  • the method includes:
  • Step S31 receiving the motion data at the current sampling moment
  • the motion data at the current sampling time includes: each key part corresponds to at least one motion data.
  • the key parts can be: thigh, calf, shoulder, elbow, etc.
  • the motion data includes: the gyroscope of the key part Data, acceleration data, angular velocity data, etc.
  • the sitting posture and the standing posture are judged as an example, so the extracted motion data are: the acceleration in the gravitational acceleration direction of the thigh, the angular velocity in the sagittal plane of the thigh, and the three-axis combined angular velocity of the lower leg.
  • Step S32 determining the envelope signal corresponding to the motion data
  • the initialized kernel function is obtained, the motion data is transferred to the kernel function, and the kernel function after the motion data is transferred is integrated to obtain the envelope signal corresponding to the motion data.
  • Step S33 analyzing the envelope signal to determine the posture information at the current sampling moment
  • the thigh motion state is determined according to the envelope signal of the acceleration in the gravitational acceleration direction of the thigh and the envelope signal of the thigh sagittal angular velocity at consecutive N sampling moments
  • the calf motion state is determined according to the envelope signal of the three-axis combined angular velocity of the lower leg , Determine the posture information at the current sampling moment based on the motion state of the thigh and the motion state of the calf.
  • Step S34 when the posture information conforms to the sitting posture characteristics, or the posture information conforms to the standing posture characteristics, confirm that the current sampling time has a posture change compared to the previous sampling time, and perform step S35;
  • step S36 is executed.
  • the gesture detection method Compared with recognition methods such as image recognition, the gesture detection method provided by the embodiments of the present application shows the advantages of low power consumption, good portability, and low cost based on motion sensor behavior recognition. It can also be used in medical rehabilitation, human-computer interaction, and virtual realization. And other fields for a wide range of applications.
  • the detection method disclosed in this application is based on the transient judgment of human lower limb behavior based on wearable sensor motion information fusion, and can realize rapid response to daily human sitting or standing transients, so as to provide timely feedback from smart wearable devices.
  • Fig. 5 is a block diagram of a posture detection device provided by an embodiment of the application.
  • the device can be implemented as part or all of an electronic device through software, hardware, or a combination of both. As shown in Figure 5, the device includes:
  • the receiving module 401 is configured to receive the motion data at the first sampling moment
  • the determining module 402 is used to determine the envelope signal corresponding to the motion data
  • the analysis module 403 is used to analyze the envelope signal to determine the posture information at the first sampling moment.
  • the electronic device may include: a processor 1501, a communication interface 1502, a memory 1503, and a communication bus 1504.
  • the processor 1501, the communication interface 1502, and the memory 1503 pass through The communication bus 1504 completes mutual communication.
  • the memory 1503 is used to store computer programs
  • the processor 1501 is configured to implement the steps of the foregoing embodiment when executing the computer program stored in the memory 1503.
  • the communication bus mentioned in the above electronic device may be a Peripheral Component Interconnect (P C I) bus or an Extended Industry Standard Architecture (EISA) bus, etc.
  • P C I Peripheral Component Interconnect
  • EISA Extended Industry Standard Architecture
  • the communication bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.
  • the communication interface is used for communication between the above-mentioned electronic device and other devices.
  • the memory may include random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage.
  • NVM non-Volatile Memory
  • the memory may also be at least one storage device located far away from the foregoing processor.
  • the above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (Digital Signal Processing, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • CPU central processing unit
  • NP Network Processor
  • DSP Digital Signal Processing
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • FPGA Field-Programmable Gate Array
  • the present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned embodiments are implemented.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The present application relates to a posture detection method, apparatus and system, an electronic device and a storage medium. Said method comprises: receiving motion data at a first sampling time; determining an envelope signal corresponding to the motion data; and analyzing the envelope signal to determine posture information at the first sampling time. According to the technical solution, the motion data is processed to obtain an envelope signal corresponding to the motion data, and a posture at a current time is determined by analyzing the envelope signal, thereby achieving quick detection of daily instantaneous posture of a person, such as sitting down or standing up, so as to facilitate the prompt feedback of a smart wearable device. This method can be widely applied in fields such as medical rehabilitation, man-machine interaction and virtual reality.

Description

一种姿势检测方法、装置、系统、电子设备及存储介质Posture detection method, device, system, electronic equipment and storage medium
本申请要求于2020年1月7日提交中国专利局、申请号为202010014951.X、发明名称为“一种姿势检测方法、装置、系统、电子设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application requires the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 202010014951.X, and the invention title is "a posture detection method, device, system, electronic equipment and storage medium" on January 7, 2020. The entire content is incorporated into this application by reference.
技术领域Technical field
本申请涉及数据处理领域,尤其涉及一种姿势检测方法、装置、系统、电子设备及存储介质。This application relates to the field of data processing, and in particular to a posture detection method, device, system, electronic equipment, and storage medium.
背景技术Background technique
现有技术中,常见的人体姿态识别一般分为两种:(一)基于图像识别的人体运动姿态方法。(二)基于电磁波定位的人体运动姿态检测方法基于电磁波定位的人体运动姿态监测。In the prior art, common human posture recognition is generally divided into two types: (1) Human body motion posture method based on image recognition. (2) Human motion posture detection method based on electromagnetic wave positioning Human motion posture monitoring based on electromagnetic wave positioning.
但是上述两种方式在实现过程中仍存在缺陷,对于图像识别的方法:视频监测智能布置在固定的场所进行实时监控,如果目标不出现在经常活动的区域,视频监控就不能起到作用,并且可能会造成被监测者的个人隐私暴露。对于电磁波定位的人体运动姿态检测方法:受外界环境(如电子产品)电磁波的干扰较大,得到的数据不准确。However, the above two methods still have shortcomings in the implementation process. For the method of image recognition: video monitoring is intelligently arranged in a fixed place for real-time monitoring. If the target does not appear in frequently active areas, video monitoring will not work, and May cause the personal privacy of the monitored person to be exposed. The human body motion posture detection method for electromagnetic wave positioning: the electromagnetic wave of the external environment (such as electronic products) is greatly interfered, and the data obtained is inaccurate.
发明内容Summary of the invention
为了解决上述技术问题或者至少部分地解决上述技术问题,本申请提供了一种姿势检测方法、装置、系统、电子设备及存储介质。In order to solve the above technical problems or at least partially solve the above technical problems, the present application provides a posture detection method, device, system, electronic device, and storage medium.
第一方面,本申请提供了一种姿势检测方法,包括:In the first aspect, this application provides a posture detection method, including:
接收第一采样时刻的运动数据;Receiving the motion data at the first sampling moment;
确定所述运动数据对应的包络信号;Determine the envelope signal corresponding to the motion data;
分析所述包络信号确定所述第一采样时刻的姿势信息。The envelope signal is analyzed to determine the posture information at the first sampling moment.
可选的,所述运动数据包括:至少一个关键部位对应的运动数据,其中每个关键部位对应至少一个运动数据。Optionally, the motion data includes: motion data corresponding to at least one key part, wherein each key part corresponds to at least one motion data.
可选的,所述确定所述运动数据对应的包络信号,包括:Optionally, the determining the envelope signal corresponding to the motion data includes:
获取初始化后的核函数;Get the initialized kernel function;
将所述运动数据传入所述核函数;Pass the motion data into the kernel function;
对传入所述运动数据后的核函数进行积分,得到所述运动数据对应的包络信号。Integrating the kernel function after inputting the motion data to obtain the envelope signal corresponding to the motion data.
可选的,所述方法还包括:Optionally, the method further includes:
获取相邻的第二采样时刻的姿势信息,所述第二采样时刻在所述第一采样时刻之前;Acquiring posture information of an adjacent second sampling time, where the second sampling time is before the first sampling time;
当所述第一采样时刻的姿势信息与所述第二采样时刻的姿势信息不同时,获取所述第一采样时刻与所述第二采样时刻的时间差;When the posture information at the first sampling time is different from the posture information at the second sampling time, acquiring the time difference between the first sampling time and the second sampling time;
当所述时间差大于预设时间差时,更新所述第一采样时刻对应的姿势标识。When the time difference is greater than the preset time difference, the posture identifier corresponding to the first sampling moment is updated.
可选的,所述运动数据包括:大腿重力加速度方向加速度,大腿矢状面方向角速度以及小腿三轴合角速度。Optionally, the motion data includes: acceleration in the direction of the gravitational acceleration of the thigh, the angular velocity in the sagittal plane of the thigh, and the three-axis combined angular velocity of the lower leg.
可选的,所述方法还包括:Optionally, the method further includes:
获取连续N个采样时刻的大腿重力加速度方向加速度和大腿矢状面方向角速度,其中N为大于1的整数;Obtain the acceleration in the gravitational acceleration direction of the thigh and the angular velocity in the sagittal plane direction of the thigh for N consecutive sampling moments, where N is an integer greater than 1;
所述分析所述包络信号确定第一采样时刻的姿势信息,包括:The analyzing the envelope signal to determine the posture information at the first sampling moment includes:
根据连续N个采样时刻的所述大腿重力加速度方向加速度的包络信号以及所述大腿矢状面方向角速度的包络信号确定大腿运动状态;Determining the motion state of the thigh according to the envelope signal of the acceleration in the gravitational acceleration direction of the thigh and the envelope signal of the angular velocity in the sagittal plane direction of the thigh at consecutive N sampling moments;
根据所述小腿的三轴合角速度的包络信号确定小腿运动状态;Determining the movement state of the calf according to the envelope signal of the three-axis combined angular velocity of the calf;
基于所述大腿运动状态以及所述小腿运动状态确定所述第一采样时刻的姿势信息。The posture information at the first sampling moment is determined based on the motion state of the thigh and the motion state of the calf.
可选的,所述根据连续N个采样时刻的所述大腿重力加速度方向加速度的包络信号以及所述大腿矢状面方向角速度的包络信号确定大腿状态,包括:Optionally, the determining the state of the thigh according to the envelope signal of the acceleration in the gravitational acceleration direction of the thigh and the envelope signal of the angular velocity in the sagittal plane direction of the thigh at consecutive N sampling moments includes:
计算N个所述大腿重力加速度方向加速度的包络信号的差分平均值;Calculating the differential average value of the N envelope signals of the acceleration in the direction of the gravitational acceleration of the thigh;
通过所述差分平均值得到大腿在垂直方向上的第一变化趋势;Obtaining the first change trend of the thigh in the vertical direction through the difference average value;
根据所述大腿矢状面方向角速度的包络信号得到大腿在矢状面方向上的第二变化趋势;Obtaining the second changing trend of the thigh in the sagittal direction according to the envelope signal of the angular velocity in the sagittal direction of the thigh;
基于所述第一变化趋势与所述第二变化趋势确定所述大腿运动状态。The thigh movement state is determined based on the first change trend and the second change trend.
第二方面,本申请提供了一种姿势检测装置,包括:In the second aspect, the present application provides a posture detection device, including:
接收模块,用于接收第一采样时刻的运动数据;The receiving module is used to receive the motion data at the first sampling moment;
确定模块,用于确定所述运动数据对应的包络信号;The determining module is used to determine the envelope signal corresponding to the motion data;
分析模块,用于分析所述包络信号确定所述第一采样时刻的姿势信息。The analysis module is used to analyze the envelope signal to determine the posture information at the first sampling moment.
可选的,所述运动数据包括:至少一个关键部位对应的运动数据,其中每个关键部位对应至少一个运动数据。Optionally, the motion data includes: motion data corresponding to at least one key part, wherein each key part corresponds to at least one motion data.
可选的,所述确定模块包括:Optionally, the determining module includes:
核函数获取子模块,用于获取初始化后的核函数;The kernel function acquisition sub-module is used to acquire the initialized kernel function;
数据传入子模块,用于将所述运动数据传入所述核函数;Data transfer sub-module for transferring the motion data into the kernel function;
积分子模块,用于对传入所述运动数据后的核函数进行积分,得到所述运动数据对应的包络信号。The integration sub-module is used to integrate the kernel function after the motion data is input to obtain the envelope signal corresponding to the motion data.
可选的,所述装置还包括更新模块,所述更新模块,用于:Optionally, the device further includes an update module, and the update module is configured to:
姿势信息获取子模块,用于获取相邻的第二采样时刻的姿势信息,所述第二采样时刻在所述第一采样时刻之前;A posture information acquisition sub-module, configured to acquire posture information of an adjacent second sampling time, the second sampling time being before the first sampling time;
时间差获取子模块,用于当所述第一采样时刻的姿势信息与所述第二采样时刻的姿势信息不同时,获取所述第一采样时刻与所述第二采样时刻的时间差;A time difference acquisition submodule, configured to acquire the time difference between the first sampling time and the second sampling time when the posture information at the first sampling time is different from the posture information at the second sampling time;
更新子模块,用于当所述时间差大于预设时间差时,更新所述第一采样时刻对应的姿势标识。The update sub-module is configured to update the posture identifier corresponding to the first sampling moment when the time difference is greater than the preset time difference.
可选的,所述运动数据包括:大腿重力加速度方向加速度,大腿矢状面方向角速度以及小腿三轴合角速度。Optionally, the motion data includes: acceleration in the direction of the gravitational acceleration of the thigh, the angular velocity in the sagittal plane of the thigh, and the three-axis combined angular velocity of the lower leg.
可选的,所述装置还包括数据获取模块,所述数据获取模块用于:Optionally, the device further includes a data acquisition module, and the data acquisition module is configured to:
获取连续N个采样时刻的大腿重力加速度方向加速度和大腿矢状面方向角速度,其中N为大于1的整数;Obtain the acceleration in the gravitational acceleration direction of the thigh and the angular velocity in the sagittal plane direction of the thigh for N consecutive sampling moments, where N is an integer greater than 1;
所述分析模块,包括:The analysis module includes:
大腿运动状态子模块,用于根据连续N个采样时刻的所述大腿重力加速度方向加速度的包络信号以及所述大腿矢状面方向角速度的包络信号确定大腿运动状态;The thigh motion state sub-module is used to determine the thigh motion state according to the envelope signal of the acceleration in the direction of the gravitational acceleration of the thigh and the envelope signal of the angular velocity in the sagittal plane of the thigh at consecutive N sampling moments;
小腿运动状态子模块,用于根据所述小腿的三轴合角速度的包络信号确定小腿运动状态;The calf motion state sub-module is used to determine the calf motion state according to the envelope signal of the three-axis combined angular velocity of the calf;
姿势信息子模块,用于基于所述大腿运动状态以及所述小腿运动状态确定所述第一采样时刻的姿势信息。The posture information sub-module is configured to determine the posture information at the first sampling moment based on the motion state of the thigh and the motion state of the calf.
可选的,所述大腿运动状态子模块,包括:Optionally, the thigh motion state sub-module includes:
计算单元,用于计算N个所述大腿重力加速度方向加速度的包络信号的差分平均值;A calculating unit, configured to calculate the differential average value of the envelope signals of the acceleration in the direction of acceleration due to gravity acceleration of the N thighs;
第一变化趋势单元,用于通过所述差分平均值得到大腿在垂直方向上的第一变化趋势;The first change trend unit is configured to obtain the first change trend of the thigh in the vertical direction through the difference average value;
第二变化趋势单元,用于根据所述大腿矢状面方向角速度的包络信号得到大腿在矢状面方向上的第二变化趋势;The second change trend unit is configured to obtain the second change trend of the thigh in the sagittal direction according to the envelope signal of the angular velocity in the sagittal direction of the thigh;
大腿运动状态单元,用于基于所述第一变化趋势与所述第二变化趋势确定所述大腿运动状态。The thigh movement state unit is configured to determine the thigh movement state based on the first change trend and the second change trend.
第三方面,本申请提供了一种姿势检测系统,包括:运动传感器和处理器,所述运动传感器与所述处理器通信连接;In a third aspect, the present application provides a posture detection system, including: a motion sensor and a processor, and the motion sensor is in communication connection with the processor;
所述运动传感器,用于采集第一采样时刻的运动数据,将所述运动数据发送至所述处理器;The motion sensor is configured to collect motion data at the first sampling moment, and send the motion data to the processor;
所述处理器,用于接收第一采样时刻的运动数据,确定所述运动数据对应的包络信号,分析所述包络信号确定所述第一采样时刻的姿势信息。The processor is configured to receive motion data at a first sampling time, determine an envelope signal corresponding to the motion data, and analyze the envelope signal to determine posture information at the first sampling time.
第四方面,本申请提供了一种电子设备,包括:处理器、通信接口、存储器和通信总线,其中,处理器,通信接口,存储器通过通信总线完成相互间的通信;In a fourth aspect, the present application provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;
所述存储器,用于存放计算机程序;The memory is used to store computer programs;
所述处理器,用于执行计算机程序时,实现上述方法步骤。The processor is used to implement the steps of the above method when the computer program is executed.
第五方面,本申请提供了一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现上述方法步骤。In a fifth aspect, the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the above method steps are implemented.
本申请实施例提供的上述技术方案与现有技术相比具有如下优点:通过对运动数据进行处理得到运动数据对应的包络信号,通过对 包络信号进行分析确定当前时刻的姿势,由此实现了对日常人体坐下或者站起等瞬时姿态的快速检测,以便智能可穿戴设备的及时反馈。该方法可以广泛应用在医疗康复、人机交互、虚拟实现等领域。Compared with the prior art, the above-mentioned technical solutions provided by the embodiments of the present application have the following advantages: the envelope signal corresponding to the motion data is obtained by processing the motion data, and the posture at the current moment is determined by analyzing the envelope signal, thereby achieving In order to quickly detect the instantaneous posture of the daily human body such as sitting or standing up, so as to provide timely feedback from smart wearable devices. This method can be widely used in medical rehabilitation, human-computer interaction, virtual realization and other fields.
附图说明Description of the drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本发明的实施例,并与说明书一起用于解释本发明的原理。The drawings here are incorporated into the specification and constitute a part of the specification, show embodiments consistent with the present invention, and together with the specification are used to explain the principle of the present invention.
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, In other words, other drawings can be obtained based on these drawings without creative labor.
图1为本申请实施例提供的一种姿势检测系统的示意图;FIG. 1 is a schematic diagram of a posture detection system provided by an embodiment of the application;
图2为本申请实施例提供的一种姿势检测方法的流程图;FIG. 2 is a flowchart of a posture detection method provided by an embodiment of the application;
图3为本申请另一实施例提供的一种姿势检测方法的流程图;FIG. 3 is a flowchart of a posture detection method provided by another embodiment of this application;
图4为本申请另一实施例提供的一种姿势检测方法的流程图;FIG. 4 is a flowchart of a posture detection method provided by another embodiment of this application;
图5为本申请实施例提供的一种姿势检测装置的框图;FIG. 5 is a block diagram of a posture detection device provided by an embodiment of the application;
图6为本申请实施例提供的一种电子设备的结构示意图。FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the application.
具体实施方式Detailed ways
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请的一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments These are a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.
本申请提供了一种姿势检测方法,装置,系统,电子设备以及存 储介质,本发明实施例所提供的方法可以应用于任意需要的电子设备,例如,可以为服务器、终端等电子设备,在此不做具体限定,为描述方便,后续简称为电子设备。This application provides a posture detection method, device, system, electronic equipment, and storage medium. The method provided in the embodiments of the present invention can be applied to any required electronic equipment. For example, it can be a server, a terminal, and other electronic equipment. There is no specific limitation, and for the convenience of description, it is referred to as electronic device in the following.
下面首先对本发明实施例所提供的一种姿势检测方法进行介绍。The following first introduces a posture detection method provided by an embodiment of the present invention.
图1为本申请实施例提供的一种姿势检测系统的示意图,如图1所示,该系统包括:至少一个运动传感器100和处理器101,运动传感器100与处理器101通信连接。FIG. 1 is a schematic diagram of a posture detection system provided by an embodiment of this application. As shown in FIG. 1, the system includes: at least one motion sensor 100 and a processor 101, and the motion sensor 100 is in communication connection with the processor 101.
运动传感器100,用于采集第一采样时刻的运动数据,将运动数据发送至处理器;The motion sensor 100 is used to collect the motion data at the first sampling moment, and send the motion data to the processor;
处理器101,用于接收第一采样时刻的运动数据,确定运动数据对应的包络信号,分析包络信号确定第一采样时刻的姿势信息。The processor 101 is configured to receive the motion data at the first sampling time, determine the envelope signal corresponding to the motion data, and analyze the envelope signal to determine the posture information at the first sampling time.
本实施例以人体作为一个示例,运动传感器可以分别佩戴在人体大腿和人体小腿侧面,运动传感器采集的运动数据包括:陀螺仪数据,加速度数据,角度数据等,运动传感器与处理器的通信方式可以是有线或无线。This embodiment takes the human body as an example. The motion sensor can be worn on the side of the human thigh and the human calf respectively. The motion data collected by the motion sensor includes: gyroscope data, acceleration data, angle data, etc. The communication method between the motion sensor and the processor can be Is it wired or wireless.
图2为本申请实施例提供的一种姿势检测方法的流程图。如图2所示,该方法包括以下步骤:Fig. 2 is a flowchart of a posture detection method provided by an embodiment of the application. As shown in Figure 2, the method includes the following steps:
步骤S11,接收第一采样时刻的运动数据;Step S11, receiving the motion data at the first sampling moment;
步骤S12,确定运动数据对应的包络信号;Step S12, determining the envelope signal corresponding to the motion data;
步骤S13,分析包络信号确定第一采样时刻的姿势信息。Step S13: Analyze the envelope signal to determine the posture information at the first sampling moment.
本实施例中,通过对运动数据进行处理得到运动数据对应的包络信号,通过对包络信号进行分析确定当前时刻的姿势,由此实现了对日常人体坐下或者站起等瞬时姿态的快速检测,以便智能可穿戴设备的及时反馈。该方法可以广泛应用在医疗康复、人机交互、虚拟实现 等领域。In this embodiment, the envelope signal corresponding to the motion data is obtained by processing the motion data, and the current posture is determined by analyzing the envelope signal, thereby realizing the rapid instantaneous posture of the daily human body such as sitting or standing up. Detection in order to provide timely feedback from smart wearable devices. This method can be widely used in medical rehabilitation, human-computer interaction, virtual realization and other fields.
本实施例中,接收的第一采样时刻的运动数据包括:至少一个关键部位对应的运动数据,其中每个关键部位对应至少一个运动数据,例如:关键部位可以是:大腿,小腿,肩部,肘部等,运动数据包括:关键部位的陀螺仪数据,加速度数据,角速度数据等。In this embodiment, the received motion data at the first sampling moment includes: motion data corresponding to at least one key part, wherein each key part corresponds to at least one motion data, for example, the key parts may be: thigh, calf, shoulder, Elbows, etc., motion data includes: gyroscope data, acceleration data, angular velocity data, etc. of key parts.
可选的,确定运动数据对应的包络信号,通过以下方式实现:获取初始化后的核函数,将运动数据传入核函数,对传入所述运动数据后的核函数进行积分,得到运动数据对应的包络信号。本实施例所采用的核函数可以是:高斯核函数,马顿核函数等。Optionally, the envelope signal corresponding to the motion data is determined by the following methods: obtaining the initialized kernel function, passing the motion data into the kernel function, and integrating the kernel function after the motion data is transferred to obtain the motion data Corresponding envelope signal. The kernel function used in this embodiment may be: Gaussian kernel function, Marton kernel function, etc.
本实施例以判断人体坐姿和站姿为例,所以从运动数据中提取符合人体坐姿以及站姿特征变化的运动数据,提取的运动数据包括;大腿重力加速度方向加速度,大腿矢状面方向角速度以及小腿的三轴合角速度。其中,小腿的三轴合角速度通过下式计算得到:In this embodiment, judging the sitting and standing posture of the human body as an example, so the motion data that conforms to the changes in the human sitting and standing posture characteristics are extracted from the motion data. The extracted motion data includes the acceleration in the direction of gravitational acceleration of the thigh, the angular velocity of the thigh in the sagittal plane direction and The three-axis combined angular velocity of the calf. Among them, the three-axis combined angular velocity of the calf is calculated by the following formula:
Figure PCTCN2021070407-appb-000001
式中,w 1x、w 2y、w 3z分别为x、y、z轴的角速度。
Figure PCTCN2021070407-appb-000001
In the formula, w 1 x, w 2 y, and w 3 z are the angular velocities of the x, y, and z axes, respectively.
然后将大腿重力加速度方向加速度,大腿矢状面方向角速度以及小腿的三轴合角速度进行平滑滤波处理。基于处理后的大腿重力加速度方向加速度,大腿矢状面方向角速度以及小腿的三轴合角速度提取包络信号。Then, the acceleration in the direction of the gravitational acceleration of the thigh, the angular velocity in the sagittal plane direction of the thigh and the three-axis combined angular velocity of the lower leg are smoothly filtered. Based on the processed gravitational acceleration of the thigh, the sagittal angular velocity of the thigh and the triaxial combined angular velocity of the lower leg are used to extract the envelope signal.
包络信号的提取过程如下:获取初始化后的第一核函数,kernel(jk)={j 1,j 2,j 3...j n},其中,j 1,j 2,j 3...j n=0。 The extraction process of the envelope signal is as follows: Obtain the initialized first kernel function, kernel(jk)={j 1 ,j 2 ,j 3 ...j n }, where j 1 ,j 2 ,j 3 .. .j n = 0.
将大腿重力加速度方向加速度s i传入第一核函数,得到第二核函数kernel(jk)={j 2,j 3...j n,s i},j 2,j 3...j n=0,基于梯形算法对第二核函数进行积分envelope-Signal=sum{j 2,...j n,s i}÷2,即得到大腿重力加速度方向加速度的包络信号y i=envelope-Signal,其中,第二核函数为传入大腿重力加速 度方向加速度后的第一核函数。 Pass the acceleration s i in the direction of the gravitational acceleration of the thigh into the first kernel function, and obtain the second kernel function kernel(jk)={j 2 ,j 3 ...j n ,s i },j 2 ,j 3 ...j n = 0, the second kernel function is integrated based on the trapezoidal algorithm envelope-Signal = sum{j 2 ,...j n ,s i } ÷ 2, that is, the envelope signal y i = envelope of the acceleration in the direction of the thigh's gravitational acceleration is obtained -Signal, where the second kernel function is the first kernel function after passing acceleration in the direction of the gravitational acceleration of the thigh.
将大腿矢状面方向角速度s i+1传入第二核函数,得到第三核函数kernel(jk)={j 3...j n,s i,s i+1},j 3...j n=0,基于梯形算法对第三核函数进行积分envelope-Signal=sum{j 3,...j n,s i,s i+1}÷2,即得到大腿矢状面方向角速度的包络信号y i+1=envelope-Signal,其中,第三核函数为传入大腿矢状面方向角速度后的第二核函数。 Pass the angular velocity s i+1 in the sagittal plane of the thigh into the second kernel function to obtain the third kernel function kernel(jk)={j 3 ...j n ,s i ,s i+1 },j 3 .. .j n =0, integrate the third kernel function based on the trapezoidal algorithm envelope-Signal=sum{j 3 ,...j n ,s i ,s i+1 }÷2, that is, the angular velocity of the thigh sagittal plane is obtained The envelope signal y i+1 =envelope-Signal, where the third kernel function is the second kernel function after passing the angular velocity in the sagittal direction of the thigh.
将小腿的三轴合角速度s i+2传入第三核函数,得到第四核函数kernel(jk)={j 4...j n,s i,s i+1,s i+2},j 4...j n=0,基于梯形算法对第四核函数进行积分,即envelope-Signal=sum{j 3,...j n,s i,s i+1,s i+2}÷2得到小腿的三轴合角速度的包络信号y i+2=envelope-Signal,其中,第四核函数为传入小腿的三轴合角速度后的第三核函数。 Pass the three-axis combined angular velocity s i+2 of the calf into the third kernel function to obtain the fourth kernel function kernel(jk)={j 4 ...j n ,s i ,s i+1 ,s i+2 } ,j 4 ...j n =0, integrate the fourth kernel function based on the trapezoidal algorithm, that is, envelope-Signal=sum{j 3 ,...j n ,s i ,s i+1 ,s i+2 }÷2 obtains the envelope signal y i+2 =envelope-Signal of the three-axis combined angular velocity of the calf, where the fourth kernel function is the third kernel function after the three-axis combined angular velocity of the calf is passed in.
本实施例中,分析包络信号确定第一采样时刻的姿势信息,具体通过以下方式实现:获取连续N个采样时刻的大腿重力加速度方向加速度和大腿矢状面方向角速度,其中N为大于1的整数。In this embodiment, analyzing the envelope signal to determine the posture information at the first sampling moment is specifically implemented in the following manner: obtaining the acceleration in the gravitational acceleration direction of the thigh and the angular velocity in the sagittal plane direction of the thigh for N consecutive sampling moments, where N is greater than 1. Integer.
根据连续N个采样时刻的大腿重力加速度方向加速度的包络信号以及大腿矢状面方向角速度的包络信号确定大腿运动状态,根据小腿的三轴合角速度的包络信号确定小腿运动状态,基于大腿运动状态以及小腿运动状态确定第一采样时刻的姿势信息。Determine the motion state of the thigh according to the envelope signal of the acceleration in the direction of the gravitational acceleration of the thigh and the envelope signal of the angular velocity in the sagittal plane of the thigh at consecutive N sampling moments, and determine the motion state of the calf according to the envelope signal of the three-axis angular velocity of the lower leg, The motion state and the calf motion state determine the posture information at the first sampling moment.
具体的,根据连续N个采样时刻的大腿重力加速度方向加速度的包络信号以及大腿矢状面方向角速度的包络信号确定大腿状态,具体通过以下方式实现:计算N个大腿重力加速度方向加速度的包络信号的差分平均值,通过差分平均值得到大腿在垂直方向上的第一变化趋势,根据大腿矢状面方向角速度的包络信号得到大腿在矢状面方向上的第二变化趋势。Specifically, the thigh state is determined according to the envelope signal of the acceleration in the direction of the gravitational acceleration of the thigh and the envelope signal of the angular velocity in the sagittal direction of the thigh at consecutive N sampling moments. The difference average value of the network signal is used to obtain the first change trend of the thigh in the vertical direction through the difference average value, and the second change trend of the thigh in the sagittal direction is obtained according to the envelope signal of the angular velocity of the thigh in the sagittal plane.
可选的,计算N个大腿重力加速度方向加速度的包络信号的差分平均值,通过差分平均值得到大腿在垂直方向上的第一变化趋势,是 通过将大腿重力加速度方向加速度的包络信号的差分平均值与第一阈值进行比较,如果差分平均值大于第一阈值,则大腿在垂直方向上的第一变化趋势为上升趋势,确认大腿当前由弯曲状态变为直立状态;如果差分平均值小于第一阈值,则大腿在垂直方向上的第一变化趋势为下降趋势,确认大腿当前由直立状态变为弯曲状态。Optionally, calculate the differential average value of the envelope signals of acceleration in the direction of gravity acceleration of the N thighs, and obtain the first change trend of the thigh in the vertical direction through the differential average value, which is obtained by taking the envelope signals of acceleration in the direction of gravity acceleration of the thighs The difference average value is compared with the first threshold value. If the difference average value is greater than the first threshold value, the first change trend of the thigh in the vertical direction is an upward trend. It is confirmed that the thigh is currently changed from a bent state to an upright state; if the difference average value is less than The first threshold, the first change trend of the thigh in the vertical direction is a downward trend, and it is confirmed that the thigh is currently changed from an upright state to a bent state.
可选的,根据大腿矢状面方向角速度的包络信号得到大腿在矢状面方向上的第二变化趋势,是通过将大腿矢状面方向角速度的包络信号与第二阈值进行比较,如果大腿矢状面方向角速度的包络信号大于阈值,则确认大腿的发生动作。Optionally, obtaining the second change trend of the thigh in the sagittal direction according to the envelope signal of the thigh sagittal angular velocity is by comparing the envelope signal of the thigh sagittal angular velocity with the second threshold, if The envelope signal of the angular velocity in the sagittal plane of the thigh is greater than the threshold, and the thigh movement is confirmed.
然后基于第一变化趋势与第二变化趋势确定大腿运动状态,例如:第一变化趋势为上升趋势,且根据第二变化趋势确认大腿的发生动作,则确认大腿运动状态由弯曲变为直立。或者,第二变化趋势为下降趋势,且根据第二变化趋势确认大腿的发生动作,则确认大腿运动状态由直立变为弯曲。Then, the thigh movement state is determined based on the first change trend and the second change trend. For example, if the first change trend is an upward trend, and the thigh movement is confirmed according to the second change trend, it is confirmed that the thigh movement state changes from bent to upright. Or, if the second change trend is a downward trend, and the thigh movement is confirmed based on the second change trend, it is confirmed that the thigh movement state changes from erect to bent.
本实施例中,根据小腿的三轴合角速度的包络信号确定小腿运动状态,是通过将小腿的三轴合角速度与第三阈值进行比较,当小于第三阈值时,则确认小腿处于静止状态;当大于第三阈值时,则确认小腿处于运动状态。In this embodiment, the movement state of the calf is determined according to the envelope signal of the three-axis combined angular velocity of the calf, by comparing the three-axis combined angular velocity of the calf with a third threshold. When it is less than the third threshold, it is confirmed that the calf is in a static state. ; When it is greater than the third threshold, it is confirmed that the calf is in motion.
最后基于大腿运动状态以及小腿运动状态确定第一采样时刻的姿势信息。例如:大腿运动状态由直立变为弯曲时,小腿处于静止状态,则确认人体的姿势信息为坐姿。大腿运动状态由弯曲变为直立,小腿处于静止状态,则确认人体的姿势信息为站姿。Finally, the posture information at the first sampling moment is determined based on the motion state of the thigh and the motion state of the calf. For example: when the thigh movement state changes from upright to bent, and the calf is in a static state, it is confirmed that the posture information of the human body is a sitting posture. The movement state of the thigh changes from bending to upright, and the calf is in a static state, and the posture information of the human body is confirmed to be a standing posture.
图3为本申请另一实施例提供的一种姿势检测方法的流程图。如图3所示,该方法还包括以下步骤:FIG. 3 is a flowchart of a posture detection method provided by another embodiment of this application. As shown in Figure 3, the method also includes the following steps:
步骤S21,获取相邻的第二采样时刻的姿势信息,第二采样时刻在第一采样时刻之前;Step S21: Obtain the posture information of the adjacent second sampling time, the second sampling time is before the first sampling time;
步骤S22,当第一采样时刻的姿势信息与第二采样时刻的姿势信息不同时,获取第一采样时刻与第二采样时刻的时间差;Step S22: when the posture information at the first sampling time is different from the posture information at the second sampling time, acquiring the time difference between the first sampling time and the second sampling time;
步骤S23,当时间差大于预设时间差时,更新第一采样时刻对应的姿势标识。Step S23: When the time difference is greater than the preset time difference, update the posture identifier corresponding to the first sampling moment.
本实施例中,获取相邻的第二采样时刻的姿势信息,第二采样时刻在第一采样时刻之前,其中获取相邻的第二采样时刻的姿势信息,包括:获取第二采样时刻的姿势标识,根据姿势标识确定第二采样时刻的姿势信息。In this embodiment, acquiring the posture information of the adjacent second sampling time, the second sampling time is before the first sampling time, wherein acquiring the posture information of the adjacent second sampling time includes: acquiring the posture of the second sampling time Identification, the gesture information at the second sampling moment is determined according to the gesture identification.
当第一采样时刻的姿势信息与第二采样时刻的姿势信息不同时,获取第一采样时刻与第二采样时刻的时间差,当时间差大于预设时间差时,更新第一采样时刻对应的姿势标识。When the posture information at the first sampling time is different from the posture information at the second sampling time, the time difference between the first sampling time and the second sampling time is acquired, and when the time difference is greater than the preset time difference, the posture identifier corresponding to the first sampling time is updated.
例如:第二采样时刻的姿势信息为坐姿,第一采样时刻得到的姿势信息为站姿,判断第一采样时刻与第二采样时刻的时间差是否大于预设时间差,如果大于则确认第一采样时刻的姿势信息为站姿,并更新第一采样时刻对应的姿势标识。For example: the posture information at the second sampling time is a sitting posture, and the posture information obtained at the first sampling time is a standing posture. Determine whether the time difference between the first sampling time and the second sampling time is greater than the preset time difference, and if it is greater, confirm the first sampling time The posture information of is the standing posture, and the posture identifier corresponding to the first sampling moment is updated.
在另一个实施例中,还提供了一种确认姿势信息的方式,获取之前采样时刻的大腿重力加速度方向加速度的包络信号的最大值和最小值。In another embodiment, a method for confirming posture information is also provided, and the maximum value and minimum value of the envelope signal of the acceleration in the direction of the gravitational acceleration of the thigh at the previous sampling time are obtained.
其中,如果第一采样时刻的大腿重力加速度方向加速度的包络信号大于最大值时,则根据第一采样时刻的大腿重力加速度方向加速度的包络信号更新最大值;如果第一采样时刻的大腿重力加速度方向加速度的包络信号小于或等于最大值时,则仍采用之前采样时刻的最大值。Among them, if the envelope signal of the acceleration in the direction of the thigh's gravitational acceleration at the first sampling time is greater than the maximum value, the maximum value is updated according to the envelope signal of the acceleration in the direction of the thigh's gravitational acceleration at the first sampling time; When the envelope signal of the acceleration in the acceleration direction is less than or equal to the maximum value, the maximum value at the previous sampling time is still used.
然后根据最大值和最小值确定最大值与最小值之间的最值差。计算第一采样时刻的大腿重力加速度方向加速度的包络信号与第二采样 时刻中最小值之差,并与最值差作比,得到比值。该比值能够表现当前时刻与经验瞬时特征的变化,比值越大,说明越接近坐姿,比值越小,说明越接近站姿。Then determine the maximum difference between the maximum value and the minimum value based on the maximum value and the minimum value. Calculate the difference between the envelope signal of the acceleration in the direction of gravitational acceleration of the thigh at the first sampling time and the minimum value at the second sampling time, and compare it with the minimum difference to obtain the ratio. The ratio can represent the change between the current moment and the instantaneous characteristics of the experience. The larger the ratio, the closer to the sitting posture, and the smaller the ratio, the closer to the standing posture.
如图4所示,本申请另一实施例提供了一种姿势检测方法的流程图,该方法实施例具体用于判断坐姿与站姿的瞬时变化。该方法包括:As shown in FIG. 4, another embodiment of the present application provides a flow chart of a posture detection method. The method embodiment is specifically used to determine the instantaneous change of the sitting posture and the standing posture. The method includes:
步骤S31,接收当前采样时刻的运动数据;Step S31, receiving the motion data at the current sampling moment;
本实施例中,当前采样时刻的运动数据包括:每个关键部位对应至少一个运动数据,例如:关键部位可以是:大腿,小腿,肩部,肘部等,运动数据包括:关键部位的陀螺仪数据,加速度数据,角速度数据等。In this embodiment, the motion data at the current sampling time includes: each key part corresponds to at least one motion data. For example, the key parts can be: thigh, calf, shoulder, elbow, etc., and the motion data includes: the gyroscope of the key part Data, acceleration data, angular velocity data, etc.
本实施例以判断坐姿与站姿为例,所以提取的运动数据为:大腿重力加速度方向加速度,大腿矢状面方向角速度以及小腿的三轴合角速度。In this embodiment, the sitting posture and the standing posture are judged as an example, so the extracted motion data are: the acceleration in the gravitational acceleration direction of the thigh, the angular velocity in the sagittal plane of the thigh, and the three-axis combined angular velocity of the lower leg.
步骤S32,确定运动数据对应的包络信号;Step S32, determining the envelope signal corresponding to the motion data;
具体的,获取初始化后的核函数,将运动数据传入核函数,对传入所述运动数据后的核函数进行积分,得到运动数据对应的包络信号。Specifically, the initialized kernel function is obtained, the motion data is transferred to the kernel function, and the kernel function after the motion data is transferred is integrated to obtain the envelope signal corresponding to the motion data.
步骤S33,分析包络信号确定当前采样时刻的姿势信息;Step S33, analyzing the envelope signal to determine the posture information at the current sampling moment;
具体的,根据连续N个采样时刻的大腿重力加速度方向加速度的包络信号以及大腿矢状面方向角速度的包络信号确定大腿运动状态,根据小腿的三轴合角速度的包络信号确定小腿运动状态,基于大腿运动状态以及小腿运动状态确定当前采样时刻的姿势信息。Specifically, the thigh motion state is determined according to the envelope signal of the acceleration in the gravitational acceleration direction of the thigh and the envelope signal of the thigh sagittal angular velocity at consecutive N sampling moments, and the calf motion state is determined according to the envelope signal of the three-axis combined angular velocity of the lower leg , Determine the posture information at the current sampling moment based on the motion state of the thigh and the motion state of the calf.
步骤S34,当姿势信息符合坐姿特征,或姿势信息符合站姿特征时,则确认当前采样时刻相比前一采样时刻发生姿势变化,并执行步骤S35;Step S34, when the posture information conforms to the sitting posture characteristics, or the posture information conforms to the standing posture characteristics, confirm that the current sampling time has a posture change compared to the previous sampling time, and perform step S35;
当姿势信息不符合坐姿特征,或姿势信息不符合站姿特征时,则确认当前采样时刻相比前一采样时刻未发生过姿势变化,并执行步骤S36。When the posture information does not conform to the sitting posture characteristics, or the posture information does not conform to the standing posture characteristics, it is confirmed that the current sampling time has not changed from the previous sampling time, and step S36 is executed.
本申请实施例提供的姿势检测方法相比图像识别等识别方法,基于运动传感器行为识别显示出了功耗低、便携性好、成本低等优势,还可以在医疗康复、人机交互、虚拟实现等领域进行广泛的应用。Compared with recognition methods such as image recognition, the gesture detection method provided by the embodiments of the present application shows the advantages of low power consumption, good portability, and low cost based on motion sensor behavior recognition. It can also be used in medical rehabilitation, human-computer interaction, and virtual realization. And other fields for a wide range of applications.
本申请公开的检测方法,是基于可穿戴式传感器运动信息融合的人体下肢行为瞬态的判断,能够实现对日常人体坐姿或者站姿等瞬态的快速响应,以便智能可穿戴设备的及时反馈。The detection method disclosed in this application is based on the transient judgment of human lower limb behavior based on wearable sensor motion information fusion, and can realize rapid response to daily human sitting or standing transients, so as to provide timely feedback from smart wearable devices.
图5为本申请实施例提供的一种姿势检测装置的框图,该装置可以通过软件、硬件或者两者的结合实现成为电子设备的部分或者全部。如图5所示,该装置包括:Fig. 5 is a block diagram of a posture detection device provided by an embodiment of the application. The device can be implemented as part or all of an electronic device through software, hardware, or a combination of both. As shown in Figure 5, the device includes:
接收模块401,用于接收第一采样时刻的运动数据;The receiving module 401 is configured to receive the motion data at the first sampling moment;
确定模块402,用于确定运动数据对应的包络信号;The determining module 402 is used to determine the envelope signal corresponding to the motion data;
分析模块403,用于分析包络信号确定第一采样时刻的姿势信息。The analysis module 403 is used to analyze the envelope signal to determine the posture information at the first sampling moment.
本申请实施例还提供一种电子设备,如图6所示,电子设备可以包括:处理器1501、通信接口1502、存储器1503和通信总线1504,其中,处理器1501,通信接口1502,存储器1503通过通信总线1504完成相互间的通信。An embodiment of the present application also provides an electronic device. As shown in FIG. 6, the electronic device may include: a processor 1501, a communication interface 1502, a memory 1503, and a communication bus 1504. The processor 1501, the communication interface 1502, and the memory 1503 pass through The communication bus 1504 completes mutual communication.
存储器1503,用于存放计算机程序;The memory 1503 is used to store computer programs;
处理器1501,用于执行存储器1503上所存放的计算机程序时,实现上述实施例的步骤。The processor 1501 is configured to implement the steps of the foregoing embodiment when executing the computer program stored in the memory 1503.
上述电子设备提到的通信总线可以是外设部件互连标准(Peripheral Component Interconnect,P C I)总线或扩展工业标准结构 (Extended Industry Standard Architecture,EISA)总线等。该通信总线可以分为地址总线、数据总线、控制总线等。为便于表示,图中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。The communication bus mentioned in the above electronic device may be a Peripheral Component Interconnect (P C I) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.
通信接口用于上述电子设备与其他设备之间的通信。The communication interface is used for communication between the above-mentioned electronic device and other devices.
存储器可以包括随机存取存储器(Random Access Memory,RAM),也可以包括非易失性存储器(Non-Volatile Memory,NVM),例如至少一个磁盘存储器。可选的,存储器还可以是至少一个位于远离前述处理器的存储装置。The memory may include random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage. Optionally, the memory may also be at least one storage device located far away from the foregoing processor.
上述的处理器可以是通用处理器,包括中央处理器(Central Processing Unit,CPU)、网络处理器(Network Processor,NP)等;还可以是数字信号处理器(Digital SignalProcessing,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (Digital Signal Processing, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
本申请还提供一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现上述实施例的步骤。The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned embodiments are implemented.
需要说明的是,对于上述装置、电子设备及计算机可读存储介质实施例而言,由于其基本相似于方法实施例,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。It should be noted that, for the foregoing device, electronic device, and computer-readable storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for related parts, please refer to the part of the description of the method embodiments.
进一步需要说明的是,在本文中,诸如“第一”和“第二”等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多 限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be further noted that in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply There is any such actual relationship or sequence between these entities or operations. Moreover, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes those that are not explicitly listed Other elements of, or also include elements inherent to this process, method, article or equipment. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or equipment that includes the element.
以上所述仅是本发明的具体实施方式,使本领域技术人员能够理解或实现本发明。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所申请的原理和新颖特点相一致的最宽的范围。The above are only specific embodiments of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown in this document, but should conform to the widest scope consistent with the principles and novel features applied for in this document.

Claims (17)

  1. 一种姿势检测方法,包括:A posture detection method, including:
    接收第一采样时刻的运动数据;Receiving the motion data at the first sampling moment;
    确定所述运动数据对应的包络信号;Determine the envelope signal corresponding to the motion data;
    分析所述包络信号确定所述第一采样时刻的姿势信息。The envelope signal is analyzed to determine the posture information at the first sampling moment.
  2. 根据权利要求1所述的方法,所述运动数据包括:至少一个关键部位对应的运动数据,其中每个关键部位对应至少一个运动数据。The method according to claim 1, wherein the motion data comprises: motion data corresponding to at least one key part, wherein each key part corresponds to at least one motion data.
  3. 根据权利要求1所述的方法,所述确定所述运动数据对应的包络信号,包括:The method according to claim 1, wherein the determining the envelope signal corresponding to the motion data comprises:
    获取初始化后的核函数;Get the initialized kernel function;
    将所述运动数据传入所述核函数;Pass the motion data into the kernel function;
    对传入所述运动数据后的核函数进行积分,得到所述运动数据对应的包络信号。Integrating the kernel function after inputting the motion data to obtain the envelope signal corresponding to the motion data.
  4. 根据权利要求1所述的方法,所述方法还包括:The method according to claim 1, further comprising:
    获取相邻的第二采样时刻的姿势信息,所述第二采样时刻在所述第一采样时刻之前;Acquiring posture information of an adjacent second sampling time, where the second sampling time is before the first sampling time;
    当所述第一采样时刻的姿势信息与所述第二采样时刻的姿势信息不同时,获取所述第一采样时刻与所述第二采样时刻的时间差;When the posture information at the first sampling time is different from the posture information at the second sampling time, acquiring the time difference between the first sampling time and the second sampling time;
    当所述时间差大于预设时间差时,更新所述第一采样时刻对应的姿势标识。When the time difference is greater than the preset time difference, the posture identifier corresponding to the first sampling moment is updated.
  5. 根据权利要求1-4任一项所述的方法,所述运动数据包括:大腿重力加速度方向加速度,大腿矢状面方向角速度以及小腿三轴合角速度。The method according to any one of claims 1 to 4, wherein the motion data includes: acceleration in the direction of gravitational acceleration of the thigh, angular velocity in the sagittal plane of the thigh, and triaxial combined angular velocity of the lower leg.
  6. 根据权利要求5所述的方法,所述方法还包括:The method according to claim 5, further comprising:
    获取连续N个采样时刻的大腿重力加速度方向加速度和大腿矢状面方向角速度,其中N为大于1的整数;Obtain the acceleration in the gravitational acceleration direction of the thigh and the angular velocity in the sagittal plane direction of the thigh for N consecutive sampling moments, where N is an integer greater than 1;
    所述分析所述包络信号确定第一采样时刻的姿势信息,包括:The analyzing the envelope signal to determine the posture information at the first sampling moment includes:
    根据连续N个采样时刻的所述大腿重力加速度方向加速度的包络信号以及所述大腿矢状面方向角速度的包络信号确定大腿运动状态;Determining the motion state of the thigh according to the envelope signal of the acceleration in the gravitational acceleration direction of the thigh and the envelope signal of the angular velocity in the sagittal plane direction of the thigh at consecutive N sampling moments;
    根据所述小腿的三轴合角速度的包络信号确定小腿运动状态;Determining the movement state of the calf according to the envelope signal of the three-axis combined angular velocity of the calf;
    基于所述大腿运动状态以及所述小腿运动状态确定所述第一采样时刻的姿势信息。The posture information at the first sampling moment is determined based on the motion state of the thigh and the motion state of the calf.
  7. 根据权利要求6所述的方法,所述根据连续N个采样时刻的所述大腿重力加速度方向加速度的包络信号以及所述大腿矢状面方向角速度的包络信号确定大腿状态,包括:The method according to claim 6, wherein the determining the state of the thigh according to the envelope signal of the acceleration in the gravitational acceleration direction of the thigh and the envelope signal of the angular velocity in the sagittal plane direction of the thigh at consecutive N sampling moments comprises:
    计算N个所述大腿重力加速度方向加速度的包络信号的差分平均值;Calculating the differential average value of the N envelope signals of the acceleration in the direction of the gravitational acceleration of the thigh;
    通过所述差分平均值得到大腿在垂直方向上的第一变化趋势;Obtaining the first change trend of the thigh in the vertical direction through the difference average value;
    根据所述大腿矢状面方向角速度的包络信号得到大腿在矢状面方向上的第二变化趋势;Obtaining the second changing trend of the thigh in the sagittal direction according to the envelope signal of the angular velocity in the sagittal direction of the thigh;
    基于所述第一变化趋势与所述第二变化趋势确定所述大腿运动状态。The thigh movement state is determined based on the first change trend and the second change trend.
  8. 一种姿势检测装置,包括:A posture detection device includes:
    接收模块,用于接收第一采样时刻的运动数据;The receiving module is used to receive the motion data at the first sampling moment;
    确定模块,用于确定所述运动数据对应的包络信号;The determining module is used to determine the envelope signal corresponding to the motion data;
    分析模块,用于分析所述包络信号确定所述第一采样时刻的姿势 信息。The analysis module is used to analyze the envelope signal to determine the posture information at the first sampling moment.
  9. 根据权利要求8所述的装置,所述运动数据包括:至少一个关键部位对应的运动数据,其中每个关键部位对应至少一个运动数据。The device according to claim 8, wherein the motion data comprises: motion data corresponding to at least one key part, wherein each key part corresponds to at least one motion data.
  10. 根据权利要求8所述的装置,所述确定模块包括:The apparatus according to claim 8, wherein the determining module comprises:
    核函数获取子模块,用于获取初始化后的核函数;The kernel function acquisition sub-module is used to acquire the initialized kernel function;
    数据传入子模块,用于将所述运动数据传入所述核函数;Data transfer sub-module for transferring the motion data into the kernel function;
    积分子模块,用于对传入所述运动数据后的核函数进行积分,得到所述运动数据对应的包络信号。The integration sub-module is used to integrate the kernel function after the motion data is input to obtain the envelope signal corresponding to the motion data.
  11. 根据权利要求8所述的装置,所述装置还包括更新模块,所述更新模块,用于:The device according to claim 8, the device further comprising an update module, the update module configured to:
    姿势信息获取子模块,用于获取相邻的第二采样时刻的姿势信息,所述第二采样时刻在所述第一采样时刻之前;A posture information acquisition sub-module, configured to acquire posture information of an adjacent second sampling time, the second sampling time being before the first sampling time;
    时间差获取子模块,用于当所述第一采样时刻的姿势信息与所述第二采样时刻的姿势信息不同时,获取所述第一采样时刻与所述第二采样时刻的时间差;A time difference acquisition submodule, configured to acquire the time difference between the first sampling time and the second sampling time when the posture information at the first sampling time is different from the posture information at the second sampling time;
    更新子模块,用于当所述时间差大于预设时间差时,更新所述第一采样时刻对应的姿势标识。The update sub-module is configured to update the posture identifier corresponding to the first sampling moment when the time difference is greater than the preset time difference.
  12. 根据权利要求8-11任一项所述的装置,所述运动数据包括:大腿重力加速度方向加速度,大腿矢状面方向角速度以及小腿三轴合角速度。The device according to any one of claims 8-11, wherein the motion data comprises: acceleration in the direction of the gravitational acceleration of the thigh, the angular velocity in the sagittal plane of the thigh, and the triaxial combined angular velocity of the lower leg.
  13. 根据权利要求12所述的装置,所述装置还包括数据获取模块,所述数据获取模块用于:The device according to claim 12, the device further comprising a data acquisition module, the data acquisition module being configured to:
    获取连续N个采样时刻的大腿重力加速度方向加速度和大腿矢状面方向角速度,其中N为大于1的整数;Obtain the acceleration in the gravitational acceleration direction of the thigh and the angular velocity in the sagittal plane direction of the thigh for N consecutive sampling moments, where N is an integer greater than 1;
    所述分析模块,包括:The analysis module includes:
    大腿运动状态子模块,用于根据连续N个采样时刻的所述大腿重力加速度方向加速度的包络信号以及所述大腿矢状面方向角速度的包络信号确定大腿运动状态;The thigh motion state sub-module is used to determine the thigh motion state according to the envelope signal of the acceleration in the direction of the gravitational acceleration of the thigh and the envelope signal of the angular velocity in the sagittal plane of the thigh at consecutive N sampling moments;
    小腿运动状态子模块,用于根据所述小腿的三轴合角速度的包络信号确定小腿运动状态;The calf motion state sub-module is used to determine the calf motion state according to the envelope signal of the three-axis combined angular velocity of the calf;
    姿势信息子模块,用于基于所述大腿运动状态以及所述小腿运动状态确定所述第一采样时刻的姿势信息。The posture information sub-module is configured to determine the posture information at the first sampling moment based on the motion state of the thigh and the motion state of the calf.
  14. 根据权利要求13所述的装置,所述大腿运动状态子模块,包括:The device according to claim 13, wherein the thigh motion state sub-module comprises:
    计算单元,用于计算N个所述大腿重力加速度方向加速度的包络信号的差分平均值;A calculating unit, configured to calculate the differential average value of the envelope signals of the acceleration in the direction of acceleration due to gravity acceleration of the N thighs;
    第一变化趋势单元,用于通过所述差分平均值得到大腿在垂直方向上的第一变化趋势;The first change trend unit is configured to obtain the first change trend of the thigh in the vertical direction through the difference average value;
    第二变化趋势单元,用于根据所述大腿矢状面方向角速度的包络信号得到大腿在矢状面方向上的第二变化趋势;The second change trend unit is configured to obtain the second change trend of the thigh in the sagittal direction according to the envelope signal of the angular velocity in the sagittal direction of the thigh;
    大腿运动状态单元,用于基于所述第一变化趋势与所述第二变化趋势确定所述大腿运动状态。The thigh movement state unit is configured to determine the thigh movement state based on the first change trend and the second change trend.
  15. 一种姿势检测系统,包括:运动传感器和处理器,所述运动传感器与所述处理器通信连接;A posture detection system, comprising: a motion sensor and a processor, the motion sensor is in communication connection with the processor;
    所述运动传感器,用于采集第一采样时刻的运动数据,将所述运动数据发送至所述处理器;The motion sensor is configured to collect motion data at the first sampling moment, and send the motion data to the processor;
    所述处理器,用于接收第一采样时刻的运动数据,确定所述运动数据对应的包络信号,分析所述包络信号确定所述第一采样时刻的姿 势信息。The processor is configured to receive the motion data at the first sampling time, determine the envelope signal corresponding to the motion data, and analyze the envelope signal to determine the posture information at the first sampling time.
  16. 一种电子设备,包括:处理器、通信接口、存储器和通信总线,其中,处理器,通信接口,存储器通过通信总线完成相互间的通信;An electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory complete mutual communication through the communication bus;
    所述存储器,用于存放计算机程序;The memory is used to store computer programs;
    所述处理器,用于执行所述计算机程序时,实现权利要求1-7任一项所述的方法步骤。The processor is configured to implement the method steps of any one of claims 1-7 when executing the computer program.
  17. 一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现权利要求1-7任一项所述的方法步骤。A computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method steps described in any one of claims 1-7 are realized.
PCT/CN2021/070407 2020-01-07 2021-01-06 Posture detection method, apparatus and system, electronic device and storage medium WO2021139666A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010014951.X 2020-01-07
CN202010014951.XA CN111241983B (en) 2020-01-07 2020-01-07 Gesture detection method, device and system, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2021139666A1 true WO2021139666A1 (en) 2021-07-15

Family

ID=70872926

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/070407 WO2021139666A1 (en) 2020-01-07 2021-01-06 Posture detection method, apparatus and system, electronic device and storage medium

Country Status (2)

Country Link
CN (1) CN111241983B (en)
WO (1) WO2021139666A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115999138A (en) * 2022-12-27 2023-04-25 乐歌人体工学科技股份有限公司 Leg pressing frequency detection system and method applied to yoga table

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111241983B (en) * 2020-01-07 2023-09-26 京东科技信息技术有限公司 Gesture detection method, device and system, electronic equipment and storage medium
CN112433135B (en) * 2020-12-09 2021-11-30 四川大学 Partial discharge signal positioning method based on Manton kernel integral least square

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102192740A (en) * 2010-03-05 2011-09-21 精工爱普生株式会社 Posture information calculation device, posture information calculation system, posture information calculation method, and information storage medium
US20160232683A1 (en) * 2015-02-09 2016-08-11 Electronics And Telecommunications Research Institute Apparatus and method for analyzing motion
CN106821391A (en) * 2017-03-23 2017-06-13 北京精密机电控制设备研究所 Body gait acquisition analysis system and method based on inertial sensor information fusion
CN107290741A (en) * 2017-06-02 2017-10-24 南京理工大学 Combine the indoor human body gesture recognition method apart from time-frequency conversion based on weighting
CN109738887A (en) * 2018-12-17 2019-05-10 武汉理工大学 A kind of target body moving state identification method suitable for fine motion interference scene
CN111241983A (en) * 2020-01-07 2020-06-05 北京海益同展信息科技有限公司 Posture detection method, device and system, electronic equipment and storage medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010019567A (en) * 2008-07-08 2010-01-28 Raytex Corp Angle calculation method and angle calculation system
US11074495B2 (en) * 2013-02-28 2021-07-27 Z Advanced Computing, Inc. (Zac) System and method for extremely efficient image and pattern recognition and artificial intelligence platform
CN103632133B (en) * 2012-10-25 2017-05-24 上海理工大学 Human gesture recognition method
CN103961109B (en) * 2014-05-05 2016-02-24 北京航空航天大学 Based on the human body attitude checkout gear of acceleration signal and angular velocity signal
CN107220617A (en) * 2017-05-25 2017-09-29 哈尔滨工业大学 Human body attitude identifying system and method
CN110207692B (en) * 2019-05-13 2021-03-30 南京航空航天大学 Map-assisted inertial pre-integration pedestrian navigation method
CN110420025B (en) * 2019-09-03 2022-02-01 京东科技信息技术有限公司 Surface electromyogram signal processing method and device and wearable device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102192740A (en) * 2010-03-05 2011-09-21 精工爱普生株式会社 Posture information calculation device, posture information calculation system, posture information calculation method, and information storage medium
US20160232683A1 (en) * 2015-02-09 2016-08-11 Electronics And Telecommunications Research Institute Apparatus and method for analyzing motion
CN106821391A (en) * 2017-03-23 2017-06-13 北京精密机电控制设备研究所 Body gait acquisition analysis system and method based on inertial sensor information fusion
CN107290741A (en) * 2017-06-02 2017-10-24 南京理工大学 Combine the indoor human body gesture recognition method apart from time-frequency conversion based on weighting
CN109738887A (en) * 2018-12-17 2019-05-10 武汉理工大学 A kind of target body moving state identification method suitable for fine motion interference scene
CN111241983A (en) * 2020-01-07 2020-06-05 北京海益同展信息科技有限公司 Posture detection method, device and system, electronic equipment and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115999138A (en) * 2022-12-27 2023-04-25 乐歌人体工学科技股份有限公司 Leg pressing frequency detection system and method applied to yoga table

Also Published As

Publication number Publication date
CN111241983A (en) 2020-06-05
CN111241983B (en) 2023-09-26

Similar Documents

Publication Publication Date Title
WO2021139666A1 (en) Posture detection method, apparatus and system, electronic device and storage medium
US10296102B1 (en) Gesture and motion recognition using skeleton tracking
CN104662558B (en) Finger tip for gesture input positions
Wang et al. Wearmask: Fast in-browser face mask detection with serverless edge computing for covid-19
WO2021143103A1 (en) Video data processing method, apparatus and device, and computer-readable storage medium
JP6815707B2 (en) Face posture detection method, device and storage medium
WO2022166243A1 (en) Method, apparatus and system for detecting and identifying pinching gesture
EP2646948B1 (en) User interface system and method of operation thereof
US9268987B2 (en) Method of recognizing QR code in image data and apparatus and method for converting QR code in content data into touchable object
Ahmed et al. Real-time sign language framework based on wearable device: analysis of MSL, DataGlove, and gesture recognition
EP3667564A1 (en) Gesture acquisition system
JP2021064367A (en) Motion recognition method, motion recognition device, and electronic device
CN111079536B (en) Behavior analysis method, storage medium and device based on human body key point time sequence
US20170353986A1 (en) Method for matching multiple devices, device for enabling matching thereof and server system
JP6260241B2 (en) System, program and method for accepting user input
CN112633059B (en) Fall remote monitoring system based on LabVIEW and MATLAB
CN116453221B (en) Target object posture determining method, training device and storage medium
CN112528957A (en) Human motion basic information detection method and system and electronic equipment
WO2024036825A1 (en) Attitude processing method, apparatus and system, and storage medium
CN113989855A (en) Human body posture recognition method, device, equipment and storage medium
CN111240469A (en) Calibration method and device for hand motion capture, electronic device and storage medium
CN109871116B (en) Apparatus and method for recognizing gesture
WO2020048213A1 (en) Fingertip detection method, fingertip detection means, fingertip detection device, and medium
WO2020224127A1 (en) Video stream capturing method and apparatus, and storage medium
CN116778222A (en) Human body posture-based scoliosis detection method, system, storage medium and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21738078

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21738078

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 21738078

Country of ref document: EP

Kind code of ref document: A1