WO2013159282A1 - Customized self-learning identification system and method - Google Patents

Customized self-learning identification system and method Download PDF

Info

Publication number
WO2013159282A1
WO2013159282A1 PCT/CN2012/074584 CN2012074584W WO2013159282A1 WO 2013159282 A1 WO2013159282 A1 WO 2013159282A1 CN 2012074584 W CN2012074584 W CN 2012074584W WO 2013159282 A1 WO2013159282 A1 WO 2013159282A1
Authority
WO
WIPO (PCT)
Prior art keywords
model
sample
input
processing unit
detected object
Prior art date
Application number
PCT/CN2012/074584
Other languages
French (fr)
Chinese (zh)
Inventor
陈澎
Original Assignee
北京英福生科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京英福生科技有限公司 filed Critical 北京英福生科技有限公司
Priority to PCT/CN2012/074584 priority Critical patent/WO2013159282A1/en
Publication of WO2013159282A1 publication Critical patent/WO2013159282A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217Validation; Performance evaluation; Active pattern learning techniques
    • G06F18/2178Validation; Performance evaluation; Active pattern learning techniques based on feedback of a supervisor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing

Definitions

  • the invention belongs to the field of pattern recognition, and in particular relates to a personalized self-learning recognition system and method.
  • pattern recognition technology has been used to identify various types of physiological state information of the human body for health monitoring and medical diagnosis.
  • various types of sensors can be used to detect physiological parameters of the human body and the like; for example, motion sensors, electrocardiogram sensors, electromyogram sensors, electroencephalogram sensors, blood oxygen sensors, and the like can be used for various actions and electrocardiograms of the human body.
  • EMG, EEG, blood oxygen signal, etc. are detected; then the detected signal is preprocessed, and feature extraction and selection are performed, and then the recognition algorithm is used to classify and recognize according to the previously trained model.
  • this technique to record the types of physiological states of various human bodies, it is possible to analyze the physiological health status of the human body.
  • a large number of documents document the technical principles of pattern recognition.
  • the existing pattern recognition technology is based on the classification and recognition of models established by collecting and training physiological state signals of various people, and the models are not collected and trained according to the physiological state signals of the individual users. . Due to individual differences, many existing health monitoring systems and tools do not accurately identify the physiological health status of a particular user.
  • the object of the present invention is to provide a personalized self-learning recognition system and method, which can collect and perform self-learning training on personalized data of a specific object, thereby greatly improving the recognition rate of the state of a specific object.
  • the technical solution of the present invention is specifically a personalized self-learning recognition system, including
  • One or more sensors for detecting a signal of the detected object are provided.
  • a storage unit for storing a sample/model library, including a model and a training sample set
  • a processing unit configured to receive a signal of the detected object detected by the one or more sensors, and identify a state type of the detected object according to a corresponding model in the sample/model library;
  • Input/output means for outputting a recognition result and receiving feedback information input based on the recognition result
  • the processing unit also trains the model using the corresponding training sample set and updates the sample/model library based on the feedback information.
  • the set of training samples includes characteristics of signals and/or signals of the detected object.
  • the sample/model library includes corresponding models in one or more scenarios.
  • the feedback information includes an identification of a model to be established.
  • the feedback information includes a scene identifier of a model to be established and a corresponding model identifier.
  • the processing unit When the input identifier of the model to be established is the same as the identifier of the model in the sample/model library, the processing unit adds the corresponding training sample to the training sample set of the corresponding model for training to establish a corresponding to the identifier. model.
  • the processing unit is further configured to select to communicate with the one or more sensors according to a selection instruction received by the input/output device.
  • the input/output device is also operative to receive an input selected mode of operation.
  • the operation mode includes one of a training model mode, a monitoring mode, a recording mode, or a combination thereof;
  • the processing unit separately performs model training, state recognition, and stores the recognition result and/or the corresponding detection signal into the storage unit according to the input operation mode.
  • the present invention further provides a personalized self-learning recognition method, including
  • the input feedback information is received, and the model is trained based on the feedback information and the sample/model library is updated.
  • the feedback information includes an identification of a model to be established.
  • the corresponding training sample is added to the training sample set of the corresponding model for training to establish a model corresponding to the identifier.
  • the invention also provides a personalized self-learning recognition system, comprising
  • a server for storing a sample/model library, including a training sample set and a model
  • the client the network connection with the server, and further includes,
  • One or more sensors for detecting a signal of the detected object are provided.
  • a processing unit configured to receive a signal of the detected object detected by the sensor, and identify a state type of the detected object according to the sample/model library stored by the server;
  • Input/output means for outputting a recognition result and receiving feedback information input based on the recognition result
  • the processing unit also trains the model using the corresponding training sample set and updates the sample/model library based on the feedback information.
  • the server is further configured to instruct the processing unit of the client to select to communicate with the one or more sensors.
  • the invention further provides a personalized self-learning recognition system, including a client and a server:
  • the server includes a memory for storing a sample/model library
  • the client further includes
  • One or more sensors for detecting a signal of the detected object are provided.
  • a processing unit configured to receive a signal of the detected object detected by the sensor, and identify a state type of the detected object according to the sample/model library stored by the server;
  • Input/output means for outputting a recognition result and receiving feedback information input based on the recognition result
  • the processing unit further transmits the feedback information and training samples of the model to be established to the server through a network;
  • the server is further configured to receive the feedback information sent by the client and the training samples of the model to be established, and use the corresponding training sample set to train the model and update the model library.
  • FIG. 1 is a structural diagram of a personalized learning recognition system according to an embodiment of the present invention.
  • FIG. 2 is a structural diagram of a processing unit in the system of Figure 1;
  • FIG. 3 is a flowchart of a personalized learning and recognition method according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a personalized learning recognition system according to another embodiment of the present invention.
  • the personalized self-learning recognition system 100 shown in FIG. 1 includes one or more sensors 1021-102n, a processing unit 101, a storage unit 103, and an input/output device 104.
  • the sensors 1021-102n may be signals for detecting the state of the detected object.
  • the signal indicating the state of the detected object may include a physiological state signal.
  • it may include a motion sensor (eg, an acceleration sensor, a gyroscope, an angular velocity sensor, etc.), a pulse sensor, an electrocardiogram sensor (ECG) Sensor), EMG sensor, EEG sensor, blood oxygen sensor (SPO2)
  • ECG electrocardiogram sensor
  • EMG electrocardiogram sensor
  • EEG EEG sensor
  • SPO2 blood oxygen sensor
  • the sensors 1021-102n may further include an environmental sensor for detecting a state affecting the detected object, for example, one of a temperature sensor, a humidity sensor, or the like combination.
  • the type of the sensor it can be placed on the hand of the object to be detected, for detecting blood oxygen, myoelectricity and pulse of the object to be detected; placing it on the leg of the object to be detected, for Detecting a motion signal of the detected object; placing it on the chest of the detected object for detecting the electrocardiographic signal; placing it on the head of the detected object, for detecting the EEG signal of the detected object, etc.; or placing
  • the position close to the object to be detected and the surroundings of the object to be detected are, for example, used to detect the sound of the object to be detected, the temperature of the video signal and its surroundings, humidity, and the like.
  • the object to be detected may be the user himself or other person who needs to monitor the user, such as an elderly person, a patient, a child, an athlete in training, or the like.
  • the storage unit 103 is configured to store a model, such as a physiological state model library, and may further include an action model library, an electrocardiogram model library, a pulse model library, an electromyography model library, an electroencephalogram model library, a blood oxygen model library, and a sound model. Library, video model library, temperature model library, humidity model library, etc.
  • the storage unit 103 may be integrated inside the processing unit 101 or may be disposed outside the processing unit 101.
  • the storage unit 103 may store an initial reference model, wherein the reference model may be a model trained according to a large sample set, for example, the motion model library may include a walking model, running and jumping Model, sleep behavior model, etc.; myocardial infarction model, arrhythmia model, etc.
  • the ECG model library may include a normal model, an epilepsy model, a sleep disorder model, etc.; the pulse model library may include a normal model An abnormal model, etc.; the muscle electrical model library may include a muscle fatigue model and a muscle excitation model; the blood oxygen model library may include a hypoxemia model and a normal oxygen carrying model; the sound model library may include a quiet model, a sleep model, and a working model.
  • the hybrid model; the video model library may include a normal behavior model and an abnormal behavior model; the temperature model library and the humidity model library may include a normal model and a prone disease model.
  • the initialization time storage unit 103 may not store any reference model, and may continuously establish new various types of models and update the storage unit 103 by training according to the input detected signal of the detected object. Model library.
  • the processing unit 101 can be connected to the sensors 1021-102n in various manners, for example, through an I2C bus, a UART, an SPI bus, or the like, or can be connected by a wired method such as a USB, a network interface, or the like. Modes such as Bluetooth, Zigbee, Wifi, infrared, etc. are wirelessly connected to communicate with sensors 1021-102n.
  • the processing unit 101 may further include an identification module 101a for identifying a state type of the detected object represented by the detection signal input by the sensors 1021-102n; and a training module 101b for training using the training sample model.
  • the storage unit 103 is further configured to store training samples.
  • the training sample may be a detection signal input by the sensors 1021-102n, or may be a feature after the feature extraction by the identification module 101a.
  • the processing unit 101 receives the detection signals of the sensors 1021-102n;
  • the identification module 101a in the processing unit 101 performs recognition processing in accordance with the corresponding model.
  • the identification processing process further includes a pre-processing step 200, a feature extraction step 201, a classification identification step 202, and the like.
  • step 200 the identification module 101a in the processing unit 101 performs corresponding pre-processing on the detection signals from the sensors 1021-102n, which may include removing noise in the signal by using an algorithm such as filtering;
  • the identification module 101a in the processing unit 101 extracts the pre-processed signal according to the feature.
  • the features extracted from the motion signals transmitted by the acceleration sensor may include time domain and frequency domain features, wherein the time domain features include, for example, mean, variance, short-term energy, autocorrelation coefficient, and cross-correlation of the amplitude of the motion signal, Signal period, etc.; frequency domain features include cross-correlation coefficients in the frequency domain obtained by FFT (Fast Fourier Transform) of motion signals, MFCC (Meier Cepstral Coefficient), and the like.
  • FFT Fast Fourier Transform
  • the feature extracted from the electrocardiographic signal transmitted from the electrocardiographic sensor may include a QT period of the QRS wave, a QRS slope, a ST segment slope, etc.; the feature extracted from the myoelectric signal according to the electromyogram sensor may include, for example, a time domain feature
  • the average absolute value, the absolute value of the average slope, the zero-crossing rate, etc., such as the average power frequency, the median frequency, the peak frequency, etc. in the frequency domain characteristics; the temperature change rate and the like can be extracted according to the temperature signal transmitted from the temperature sensor. Then, the feature is selected by assigning weight values to the extracted features.
  • the identification module 101a of the processing unit 101 classifies and extracts the extracted features according to corresponding models in the storage unit 103, wherein the classification recognition algorithm may adopt k-nearest neighbor, Gaussian, Bayesian, artificial neural network, etc. .
  • the processing unit 101 outputs the recognition result to the user via the input/output device 104.
  • the output device may be an audio output device, a liquid crystal display or the like for providing an audio output or a user interface.
  • the input device may include a button, a keyboard, a touch screen, an audio or video sensor, and the like.
  • the output recognition result is a rejection type, that is, a model that does not belong to the stored sample/model library. Type; or, when the recognition result output by the processing unit is wrong, for example, the electrocardiographic recognition module outputs the recognition result "normal" through the input/output device 104, but the detected object is abnormal, or the motion recognition module 101a passes through the input/output device 104.
  • the output recognition result is “running”, but when the actual action of the user is “walking”, the processing unit 101 can receive feedback information input by the user through the input/output device 104, for example, the indication system recognizes an error instruction, and judges according to the feedback information. Whether to establish a new model; if yes, proceed to step 204 to receive feedback information of the model identification to be established input by the user through the input/output device 104; if not, receive the next one or more detection signals and proceed to the step 200.
  • the feedback information may further include an identifier of a scene corresponding to each model.
  • the user input model is identified as a "golf scene” and “Swing action.”
  • the user can enter the model identification as "angina.”
  • the model identifier library may be pre-stored in the storage unit 103, and the user may select, by using the input/output device 104, the model identifier to be established from the model identifier library, if the model identifier to be established is not stored in the existing model identifier. When the library is available, the user can enter the model ID.
  • the processing unit 101 takes the corresponding signal/feature as a training sample and trains the model through the training module 101b.
  • the training module 101c in the processing unit 101 can be trained by a machine learning algorithm well known in the art, such as hybrid Gaussian, support vector machine, Bayesian or other well-known algorithms.
  • the processing unit 101 determines, according to the existing sample/model library, whether the model identifier is identical to a certain model identifier in the sample/model library;
  • the training module 101b in the processing unit 101 adds the extracted and selected features of the current input signal to the existing sample set having the same model identification for training; for example, if the processing unit 101 receives
  • the signal is an electrocardiogram signal and an action signal, and the identifier of the model to be established input by the user is “abnormal”, and the ECG signal and the motion signal can be respectively added to the existing sample/model library and identified as “abnormal”.
  • the corresponding signal training of the model is focused on training and a new "abnormal" model is established.
  • step 206 the existing identically identified model is updated to update the existing sample/model library.
  • the processing unit 101 may also select a detection signal that only communicates with one or more of the sensors or processes only its input, according to an instruction input by the user via the input/output device 104.
  • a detection signal that only communicates with one or more of the sensors or processes only its input, according to an instruction input by the user via the input/output device 104.
  • an instruction can be input to instruct the processing unit 101 to communicate only with the EEG and motion sensors, or only the detection signals input by the two sensors.
  • the storage unit 103 can also store a corresponding sample/model library based on various different scenarios, such as a fitness scene, an office scene, a home scene, and the like. Each scene may also include multiple sub-scenes.
  • the fitness scene may also include a yoga scene, a tennis court view, and the like.
  • Each scene or sub-scene may include a sample/model library corresponding to each detection signal.
  • the yoga sub-scenario may include a sample/model library corresponding to the motion signal, such as a leg lift, a bent-up sample/model, etc.
  • the tennis sub-scenario may include a tennis action sample/model library, such as a serve, a swipe sample/model, etc.
  • the action sample/model library corresponding to the scene may include work, rest, and other action samples/models
  • the stored action sample/model library of the family scene may include action samples/models such as housework, watching TV, and eating;
  • the myoelectric sample/model library corresponding to the myoelectric signal may include a muscle fatigue model and a muscle excitation model;
  • the EEG sample/model library corresponding to the EEG signal may include a mental stress model, Mental relaxation samples/models;
  • ECG samples/model libraries corresponding to ECG signals may include samples/models such as “normal” and “abnormal”, where abnormal samples/model libraries may also include “arrhythmia” and “myocardial infarction” "Sequence samples/models.
  • the input/output device 104 can output a scene identifier for the user to select, and the user can select a scene or a sub-scene thereof through the input/output 104 device; the processing unit 101 can identify the status type of the detected object according to the model corresponding to each scene. For example, the type of action performed, the type of brain electrical power, the type of electrocardiogram, etc., and the recognition results are respectively output.
  • the user can also input the scene identifier corresponding to the model to be established through the input/output device 104.
  • the model to be trained by the detected object is a "swing" action model in a golf scene and a corresponding blood oxygen model, an electroencephalogram model, an electrocardiogram model, a humidity model, a temperature model, etc.
  • the user can input according to the input.
  • the prompt input scene of the output device 104 is identified as "golf scene”, and then the input model is identified as "swing”; the processing unit 101 receives the corresponding scene identifier and model identifier input by the user, and marks the current model of the new training as "Swing" and then update the corresponding sample/model library.
  • the processing unit 101 may further perform the training model on the extracted features according to the signals detected by the plurality of sensors 1021-102n.
  • the classification algorithm of the identification module 101a in the processing unit 101 can perform feature extraction according to the maximum feature dimension preset by different sensors, and perform feature selection according to the actually connected sensor; similarly, the training module 101b can be set to be the largest according to the preset.
  • Feature dimension is used to extract features and select features for training.
  • the sensors that the system 100 can connect are motion sensors, ECG sensors, and EEG sensors, wherein the 3-D feature vector of the mean, variance, and short-time energy of the amplitude is extracted from the motion signal detected by the motion sensor;
  • the signal extracted by the sensor is characterized by the QT period of the QRS wave, the QRS slope, and the ST-segment slope.
  • the two-dimensional vector extracted from the myoelectric sensor is the average absolute value and the average absolute value of the slope.
  • the corresponding classification/training algorithm is to classify/train according to the 8-dimensional feature vector.
  • the weight value of the feature of the electrocardiographic signal in the 8-dimensional feature vector corresponding to the recognition module 101a is set to (0, 0) and classified/trained.
  • the detected signals can be separately extracted according to the motion sensor, electrocardiogram, electroencephalogram, blood oxygen, temperature, humidity sensor, etc., and the model can be trained. In this way, the user can monitor the status type of the detected object in different environments.
  • the sensors 1021-102n continue to collect motion signals for the detected object. Based on the updated state model in the storage unit 103, the processing unit 101 continues to identify the state type of the detected object and trains to continuously update and refine the state samples/models.
  • the recognition rate of the initial model may be Not high.
  • the number of training samples also increases, and the training samples of the same state are combined for training, and adaptive learning is performed on the basis of the existing model, thereby possibly making the training
  • the recognition rate of the model is improved.
  • the storage unit 103 is further configured to store a detection signal and/or a recognition result of the detected object.
  • the input/output device 104 of the system 100 can also provide a user interface for the user to select different modes of operation, for example, a training mode, a monitoring mode, a recording mode, and the like can be provided.
  • the user can select different modes through the input/output device 104 as needed, for example, the training mode, the user can actively perform model training and build a model; in the monitoring mode, the processing unit 101 can be compared according to the recognition algorithm and the sample/model library. The state of the detected object is monitored and identified; in the recording mode, the processing unit 101 can record the signal and/or the recognition result of the detected object.
  • FIG. 4 shows a personalized self-learning recognition system 300 of the present invention.
  • the client 301 and the server 302 are included.
  • Client 301 and server 302 perform data transmission over network 303, such as Wi-Fi, GSM, LAN, USB, Bluetooth, WLAN, etc., as is known in the art.
  • the server 302 includes a storage unit 3023 for storing a sample/model library
  • the components of the client 301 that have the same or similar functions as the system 100 shown in FIG. 1 are not described again.
  • the sensors 30121-3012n are used to detect a signal of the detected object
  • the processing unit 3011 is configured to receive the signal of the detected object detected by the sensors 30121-3012n, and identify the current state type of the user according to the sample/model library downloaded from the server 302 and output the recognition result through the input/output device 3013;
  • the user may input a feedback information through the input/output device 3013, for example, indicating the recognition result error information, and the processing unit 3011 transmits the feedback information to the processing unit 3011 according to the feedback information. ;
  • the processing unit 3011 uses the corresponding training sample training model, and then sends the trained completed model and the corresponding training samples to the server 302;
  • the server 302 then updates the sample/model library.
  • the server 302 is further configured to store the detected signal library and/or the recognition result.
  • the input/output device 3013 may also prompt the user to input the model identifier to be trained, and if the model identifier input by the user is the same as the model identifier in the existing sample/model library, then the corresponding model is added.
  • the training samples are focused on training and updating the sample/model library.
  • the server 302 may further include a processing unit 3021 and an input/output device 3022.
  • the user may send various detected detection signals of the detected object to other remote monitoring terminals through the processing unit 3021 in the server 302. For example, Sending to the remote monitoring center for health analysis; the user can also use the input/output device 3022 in the server 302 to set the signal type of the sensor to be processed by the processing unit 3011 of the client according to the personalized condition of the detected object and its status.
  • the configuration information may be set as the ECG signal and the motion signal to be detected, and sent to the processing unit 3011 of the client, and the processing unit 3011 processes only according to the configuration information.
  • the ECG signal and motion signal of the detected object may be set as the ECG signal and the motion signal to be detected, and sent to the processing unit 3011 of the client, and the processing unit 3011 processes only according to the configuration information.
  • the ECG signal and motion signal of the detected object may be set as the ECG signal and the motion signal to be detected, and sent to the
  • the system 300 may be further configured to: the processing unit 3011 of the client 301 is configured to receive the signal of the detected object detected by the sensors 30121-3012n, and according to the sample/model library downloaded from the server 302. Identify the user's status type;
  • the user can input feedback information including model identification information through the input/output device 3013; the processing unit 3011 receives the feedback information and passes the corresponding training sample through the network. 303 is sent to the server 302;
  • the processing unit 3021 in the server 302 is configured to receive the feedback information sent by the client 301 and the training samples of the model to be established, and use the corresponding training sample set to train the model and identify the established new model, and then update the storage unit 3023.
  • Sample/model library
  • the system of the present invention can also be used to monitor the condition of an object. For example, whether the instrument in operation is normal, etc., different types of sensors such as an audio sensor, a vibration sensor, a pressure sensor, etc. can be placed at corresponding positions for detecting sound, vibration, pressure signals, and identifying instruments according to normal or abnormal models.
  • Working condition the user trains and builds a new model based on the identified results and continuously updates the sample/model library to more accurately monitor the working state of the instrument.

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

Provided are a customized self-learning identification system and method, the system comprising: one or more sensors, used to detect the signal of an object to be detected; a storage unit, used to store a sample/model library comprising a model and a training sample set; a processing unit, used to receive the signal of the detected object detected by the one or more sensors and identify the status type of the detected object according to a corresponding model in the sample/model library; an input/output device, used to output an identification result and receive feedback information inputted on the basis of the identification result; the processing unit also uses a corresponding training sample set to train a model and update the sample/model library according to the feedback information. The customized self-learning identification method of the present invention enables a user to establish a customized model, thus greatly improving the identification rate for customized status type.

Description

个性化自学习识别系统及方法  Personalized self-learning recognition system and method
技术领域Technical field
本发明属于模式识别领域,具体涉及一种个性化自学习识别系统及方法。The invention belongs to the field of pattern recognition, and in particular relates to a personalized self-learning recognition system and method.
背景技术Background technique
目前,模式识别技术已经用于识别人体日常的多种类型的生理状态信息用于健康监测和医学诊断。Currently, pattern recognition technology has been used to identify various types of physiological state information of the human body for health monitoring and medical diagnosis.
具体地,可以利用各种类型的传感器对人体的生理参数等进行检测;例如,利用运动传感器、心电图传感器、肌电图传感器、脑电图传感器、血氧传感器等对人体各种动作、心电、肌电、脑电、血氧信号等进行检测;然后对检测到的信号进行预处理,并进行特征提取和选取,然后通过识别算法根据事先训练出的模型进行分类识别。利用这种技术将识别出各种人体的生理状态类型进行记录,就可以分析人体的生理健康状态。大量文献记载了模式识别的技术原理。中国专利(CN200710118156.X)说明书背景技术部分详细介绍了模式识别技术原理及应用;非专利文献“Leo Breina (1996), Bagging Predictor, Marchine Learning, 24(2):123-140”中记载了机器学习(训练)原理及算法;非专利文献“基于三维加速度传感器的上肢动作识别系统”,《传感技术学报》 2010年第6期,提出了基于加速度传感器的上肢动作识别系统通过对加速度数据的处理、建模的处理过程。 Specifically, various types of sensors can be used to detect physiological parameters of the human body and the like; for example, motion sensors, electrocardiogram sensors, electromyogram sensors, electroencephalogram sensors, blood oxygen sensors, and the like can be used for various actions and electrocardiograms of the human body. , EMG, EEG, blood oxygen signal, etc. are detected; then the detected signal is preprocessed, and feature extraction and selection are performed, and then the recognition algorithm is used to classify and recognize according to the previously trained model. By using this technique to record the types of physiological states of various human bodies, it is possible to analyze the physiological health status of the human body. A large number of documents document the technical principles of pattern recognition. The background technology part of the Chinese patent (CN200710118156.X) specification details the principle and application of pattern recognition technology; the non-patent literature "Leo" Breina (1996), Bagging Predictor, Marchine Learning, Machine learning (training) principles and algorithms are described in 24(2): 123-140"; Non-patent literature "Upper Limb Motion Recognition System Based on 3D Accelerometer", Journal of Transducer Technology In the sixth issue of 2010, the process of processing and modeling the acceleration data by the acceleration sensor-based upper limb motion recognition system was proposed.
但是,现有的模式识别技术是基于对多种人群的生理状态信号进行采集和训练而建立的模型进行分类识别,并没有针对性地根据使用者个体的生理状态信号进行采集和训练而建立模型。由于个体差异,现有的许多健康监测系统和工具对某个特定使用者的生理健康状态的识别精确度不高。However, the existing pattern recognition technology is based on the classification and recognition of models established by collecting and training physiological state signals of various people, and the models are not collected and trained according to the physiological state signals of the individual users. . Due to individual differences, many existing health monitoring systems and tools do not accurately identify the physiological health status of a particular user.
发明内容Summary of the invention
本发明的目的就是提供一种个性化自学习识别系统及方法,能够针对特定对象的个性化数据进行采集并进行自学习训练,从而大大提高了对于特定对象的状态的识别率。 The object of the present invention is to provide a personalized self-learning recognition system and method, which can collect and perform self-learning training on personalized data of a specific object, thereby greatly improving the recognition rate of the state of a specific object.
本发明的技术方案具体为一种个性化自学习识别系统,包括,The technical solution of the present invention is specifically a personalized self-learning recognition system, including
一个或多个传感器,用于检测被检测对象的信号;One or more sensors for detecting a signal of the detected object;
存储单元,用于存储样本/模型库,包括模型及训练样本集;a storage unit for storing a sample/model library, including a model and a training sample set;
处理单元,用于接收所述一个或多个传感器检测到的所述被检测对象的信号,并根据所述样本/模型库中的相应模型识别所述被检测对象的状态类型;a processing unit, configured to receive a signal of the detected object detected by the one or more sensors, and identify a state type of the detected object according to a corresponding model in the sample/model library;
输入/输出装置,用于输出识别结果以及接收基于所述识别结果输入的反馈信息; Input/output means for outputting a recognition result and receiving feedback information input based on the recognition result;
所述处理单元还根据所述反馈信息使用相应的训练样本集训练模型并更新所述样本/模型库。The processing unit also trains the model using the corresponding training sample set and updates the sample/model library based on the feedback information.
其中,among them,
所述训练样本集包括所述被检测对象的信号和/或信号的特征。 The set of training samples includes characteristics of signals and/or signals of the detected object.
其中,among them,
所述样本/模型库包括一个或多个场景下对应的模型。 The sample/model library includes corresponding models in one or more scenarios.
其中,among them,
所述反馈信息包括要建立的模型的标识。 The feedback information includes an identification of a model to be established.
其中,among them,
所述反馈信息包括要建立的模型的场景标识及其对应的模型标识。 The feedback information includes a scene identifier of a model to be established and a corresponding model identifier.
其中,among them,
当输入的要建立的模型的标识与所述样本/模型库中的模型的标识相同时,所述处理单元将对应训练样本加入到对应模型的训练样本集中进行训练以建立与所述标识相应的模型。 When the input identifier of the model to be established is the same as the identifier of the model in the sample/model library, the processing unit adds the corresponding training sample to the training sample set of the corresponding model for training to establish a corresponding to the identifier. model.
其中,among them,
所述处理单元还用于根据所述输入/输出装置接收到的选择指令选择与所述一个或多个传感器进行通信。The processing unit is further configured to select to communicate with the one or more sensors according to a selection instruction received by the input/output device.
其中,among them,
所述输入/输出装置还用于接收输入选择的操作模式。The input/output device is also operative to receive an input selected mode of operation.
其中,among them,
所述操作模式包括训练模型模式、监测模式、记录模式之一或其组合;The operation mode includes one of a training model mode, a monitoring mode, a recording mode, or a combination thereof;
所述处理单元根据所述输入的操作模式分别进行模型训练、状态识别、将所述识别结果和/或相应的检测信号存储到所述存储单元中。The processing unit separately performs model training, state recognition, and stores the recognition result and/or the corresponding detection signal into the storage unit according to the input operation mode.
本发明进一步提供了一种个性化自学习识别方法,包括,The present invention further provides a personalized self-learning recognition method, including
使用一个或多个传感器检测被检测对象的信号;Using one or more sensors to detect the signal of the detected object;
接收检测到的所述被检测对象的信号,根据样本/模型库中存储的对应模型识别所述被检测对象的状态类型并输出识别结果;Receiving the detected signal of the detected object, identifying a state type of the detected object according to a corresponding model stored in the sample/model library, and outputting the recognition result;
接收输入的反馈信息,并根据所述反馈信息训练模型并更新所述样本/模型库。The input feedback information is received, and the model is trained based on the feedback information and the sample/model library is updated.
其中,among them,
所述反馈信息包括要建立的模型的标识。The feedback information includes an identification of a model to be established.
其中,among them,
当输入的要建立的模型的标识与所述样本/模型库中的模型的标识相同时,将对应训练样本加入到对应模型的训练样本集中进行训练以建立与所述标识相应的模型。When the input identifier of the model to be established is the same as the identifier of the model in the sample/model library, the corresponding training sample is added to the training sample set of the corresponding model for training to establish a model corresponding to the identifier.
本发明还提供了一种个性化自学习识别系统,包括,The invention also provides a personalized self-learning recognition system, comprising
服务器,用于存储样本/模型库,包括训练样本集及模型; a server for storing a sample/model library, including a training sample set and a model;
客户端,与服务器进行网络连接,并进一步包括,The client, the network connection with the server, and further includes,
一个或多个传感器,用于检测被检测对象的信号; One or more sensors for detecting a signal of the detected object;
处理单元,用于接收所述传感器检测到的所述被检测对象的信号,并根据所述服务器存储的所述样本/模型库识别所述被检测对象的状态类型;a processing unit, configured to receive a signal of the detected object detected by the sensor, and identify a state type of the detected object according to the sample/model library stored by the server;
输入/输出装置,用于输出识别结果以及接收基于所述识别结果输入的反馈信息; Input/output means for outputting a recognition result and receiving feedback information input based on the recognition result;
所述处理单元还根据所述反馈信息使用相应的训练样本集训练模型并更新所述样本/模型库。The processing unit also trains the model using the corresponding training sample set and updates the sample/model library based on the feedback information.
其中,among them,
所述服务器还用于指示所述客户端的处理单元选择与所述一个或多个传感器进行通信。The server is further configured to instruct the processing unit of the client to select to communicate with the one or more sensors.
本发明进一步提供了一种个性化自学习识别系统,包括客户端和服务器:The invention further provides a personalized self-learning recognition system, including a client and a server:
所述服务器包括存储器,用于存储样本/模型库;The server includes a memory for storing a sample/model library;
所述客户端,进一步包括,The client further includes
一个或多个传感器,用于检测被检测对象的信号; One or more sensors for detecting a signal of the detected object;
处理单元,用于接收所述传感器检测到的所述被检测对象的信号,并根据所述服务器存储的所述样本/模型库识别所述被检测对象的状态类型;a processing unit, configured to receive a signal of the detected object detected by the sensor, and identify a state type of the detected object according to the sample/model library stored by the server;
输入/输出装置,用于输出识别结果以及接收基于所述识别结果输入的反馈信息;Input/output means for outputting a recognition result and receiving feedback information input based on the recognition result;
所述处理单元还将所述反馈信息及要建立的模型的训练样本通过网络发送给所述服务器;以及The processing unit further transmits the feedback information and training samples of the model to be established to the server through a network;
所述服务器,还用于接收所述客户端传来的反馈信息及要建立的模型的训练样本,并使用相应的训练样本集训练模型并更新所述模型库。The server is further configured to receive the feedback information sent by the client and the training samples of the model to be established, and use the corresponding training sample set to train the model and update the model library.
通过以下结合附图对本发明优选实施方式的描述,本发明的其他特点、目的和效果将变得更加清楚和易于理解。Other features, objects, and effects of the present invention will become more apparent and understood from
附图说明DRAWINGS
图1为本发明的实施例的个性化学习识别系统结构图;1 is a structural diagram of a personalized learning recognition system according to an embodiment of the present invention;
图2为图1所示系统中的处理单元的结构图;Figure 2 is a structural diagram of a processing unit in the system of Figure 1;
图3为本发明的一个实施例的个性化学习识别方法流程图;FIG. 3 is a flowchart of a personalized learning and recognition method according to an embodiment of the present invention; FIG.
图4为本发明的另一实施例的个性化学习识别系统结构示意图。4 is a schematic structural diagram of a personalized learning recognition system according to another embodiment of the present invention.
在所有的上述附图中,相同的标号表示具有相同、相似或相应的特征或功能。In all of the above figures, the same reference numerals are used to indicate the same or similar features or functions.
具体实施方式detailed description
下面参考图1,并结合图2和图3详细说明本发明的个性化自学习识别系统100的结构及工作原理。The structure and working principle of the personalized self-learning recognition system 100 of the present invention will be described in detail below with reference to FIG. 1 in conjunction with FIGS. 2 and 3.
图1所示的个性化自学习识别系统100包括一个或多个传感器1021-102n,处理单元101、存储单元103、输入/输出装置104。The personalized self-learning recognition system 100 shown in FIG. 1 includes one or more sensors 1021-102n, a processing unit 101, a storage unit 103, and an input/output device 104.
其中,传感器1021-102n可以是用于检测表示被检测对象状态的信号。其中,表示被检测对象状态的信号可以包括生理状态信号。例如,可以包括运动传感器(例如加速度传感器、陀螺仪、角速度传感器等)、脉搏传感器、心电图传感器(ECG sensor)、肌电图传感器(EMG sensor)、脑电图传感器(EEG sensor)、血氧传感器(SPO2 sensor)、音频传感器、视频传感器等之一或其组合;进一步地,传感器1021-102n还可以包括用于检测影响被检测对象的状态的环境传感器,例如,温度传感器、湿度传感器等之一或其组合。根据传感器的类型所对应的使用方式,可以将其放置在被检测对象的手部,用于检测被检测对象的血氧、肌电、脉搏;将其放置在被检测对象的腿部,用于检测被检测对象的运动信号;将其放置在被检测对象的胸部,用于检测心电信号;将其放置在被检测对象的头部,用于检测被检测对象的脑电信号等;或者放置在接近于被检测对象的位置及被检测对象周围,例如用于检测被检测对象的声音、视频信号及其周围环境的温度、湿度等。The sensors 1021-102n may be signals for detecting the state of the detected object. Wherein, the signal indicating the state of the detected object may include a physiological state signal. For example, it may include a motion sensor (eg, an acceleration sensor, a gyroscope, an angular velocity sensor, etc.), a pulse sensor, an electrocardiogram sensor (ECG) Sensor), EMG sensor, EEG sensor, blood oxygen sensor (SPO2) One or a combination of sensors, audio sensors, video sensors, etc. Further, the sensors 1021-102n may further include an environmental sensor for detecting a state affecting the detected object, for example, one of a temperature sensor, a humidity sensor, or the like combination. According to the usage mode of the type of the sensor, it can be placed on the hand of the object to be detected, for detecting blood oxygen, myoelectricity and pulse of the object to be detected; placing it on the leg of the object to be detected, for Detecting a motion signal of the detected object; placing it on the chest of the detected object for detecting the electrocardiographic signal; placing it on the head of the detected object, for detecting the EEG signal of the detected object, etc.; or placing The position close to the object to be detected and the surroundings of the object to be detected are, for example, used to detect the sound of the object to be detected, the temperature of the video signal and its surroundings, humidity, and the like.
其中,被检测对象既可以是使用者本人,也可以是需要使用者进行监测的其他人,例如老人、病人、小孩、在训练中的运动员等。The object to be detected may be the user himself or other person who needs to monitor the user, such as an elderly person, a patient, a child, an athlete in training, or the like.
其中,存储单元103用于存储模型,例如生理状态模型库,并且可以进一步包括动作模型库、心电模型库、脉搏模型库、肌电模型库、脑电模型库、血氧模型库、声音模型库、视频模型库、温度模型库、湿度模型库等。其中,存储单元103可以是集成在处理单元101的内部,也可以设置在处理单元101的外部。The storage unit 103 is configured to store a model, such as a physiological state model library, and may further include an action model library, an electrocardiogram model library, a pulse model library, an electromyography model library, an electroencephalogram model library, a blood oxygen model library, and a sound model. Library, video model library, temperature model library, humidity model library, etc. The storage unit 103 may be integrated inside the processing unit 101 or may be disposed outside the processing unit 101.
根据本发明的实施例,系统100在初始化状态时,存储单元103可以存储初始的参考模型,其中参考模型可以是根据大量样本集训练完成的模型,例如运动模型库中可以包括行走模型、跑跳模型、睡眠行为模型等;心电模型库中可以包括心肌梗塞模型、心率不齐模型等;脑电模型库中可以包括正常模型、癫痫模型、睡眠障碍模型等;脉搏模型库中可以包括正常模型、异常模型等;肌电模型库中可以包括肌肉疲劳模型、肌肉兴奋模型;血氧模型库可以包括低氧血症模型、正常携氧模型;声音模型库可以包括安静模型、睡眠模型、工作模型、混合模型;视频模型库可以包括正常行为模型、异常行为模型;温度模型库与湿度模型库可以包括正常模型和易发疾病模型。According to an embodiment of the present invention, when the system 100 is in an initialization state, the storage unit 103 may store an initial reference model, wherein the reference model may be a model trained according to a large sample set, for example, the motion model library may include a walking model, running and jumping Model, sleep behavior model, etc.; myocardial infarction model, arrhythmia model, etc. may be included in the ECG model library; the EEG model library may include a normal model, an epilepsy model, a sleep disorder model, etc.; the pulse model library may include a normal model An abnormal model, etc.; the muscle electrical model library may include a muscle fatigue model and a muscle excitation model; the blood oxygen model library may include a hypoxemia model and a normal oxygen carrying model; the sound model library may include a quiet model, a sleep model, and a working model. The hybrid model; the video model library may include a normal behavior model and an abnormal behavior model; the temperature model library and the humidity model library may include a normal model and a prone disease model.
可以理解的是,初始化时存储单元103也可以不存储任何参考模型,可以通过根据输入的检测到的被检测对象的信号进行训练,不断建立新的各种类型的模型并更新存储单元103中的模型库。It can be understood that the initialization time storage unit 103 may not store any reference model, and may continuously establish new various types of models and update the storage unit 103 by training according to the input detected signal of the detected object. Model library.
其中,处理单元101可以与传感器1021-102n通过多种方式进行连接,例如通过I2C总线、UART、SPI总线等进行连接,也可以通过有线的方式例如USB、网络接口等进行连接,还可以通过无线方式,例如蓝牙、Zigbee、Wifi、红外方式等进行无线连接,从而与传感器1021-102n进行通信。The processing unit 101 can be connected to the sensors 1021-102n in various manners, for example, through an I2C bus, a UART, an SPI bus, or the like, or can be connected by a wired method such as a USB, a network interface, or the like. Modes such as Bluetooth, Zigbee, Wifi, infrared, etc. are wirelessly connected to communicate with sensors 1021-102n.
如图2所示,处理单元101可以进一步包括识别模块101a,用于根据由传感器1021-102n输入的检测信号识别其所表示的被检测对象的状态类型;训练模块101b,用于使用训练样本训练模型。进一步,存储单元103还用于存储训练样本。其中,训练样本可以是传感器1021-102n输入的检测信号,也可以是经过识别模块101a进行特征提取后的特征。As shown in FIG. 2, the processing unit 101 may further include an identification module 101a for identifying a state type of the detected object represented by the detection signal input by the sensors 1021-102n; and a training module 101b for training using the training sample model. Further, the storage unit 103 is further configured to store training samples. The training sample may be a detection signal input by the sensors 1021-102n, or may be a feature after the feature extraction by the identification module 101a.
参照图3,首先,处理单元101接收传感器1021-102n的检测信号;Referring to FIG. 3, first, the processing unit 101 receives the detection signals of the sensors 1021-102n;
然后,处理单元101中的识别模块101a根据相应的模型进行识别处理。其中,识别处理过程进一步包括预处理步骤200、特征提取步骤201、分类识别步骤202等。Then, the identification module 101a in the processing unit 101 performs recognition processing in accordance with the corresponding model. The identification processing process further includes a pre-processing step 200, a feature extraction step 201, a classification identification step 202, and the like.
在步骤200,处理单元101中的识别模块101a将来自传感器1021-102n的检测信号进行相应的预处理,其中可包括采用滤波等算法去除信号中的噪声;In step 200, the identification module 101a in the processing unit 101 performs corresponding pre-processing on the detection signals from the sensors 1021-102n, which may include removing noise in the signal by using an algorithm such as filtering;
然后,进入步骤201,处理单元101中的识别模块101a将预处理后的信号根据进行特征提取。其中,根据传感器的类型及分类所需的不同特征进行特征提取与选取。例如,根据加速度传感器传来的运动信号提取的特征可以包括时域和频域特征,其中时域特征包括例如,动作信号幅值的均值、方差、短时能量、自相关系数及互相关系数、信号周期等;频域特征包括通过动作信号的FFT(快速傅里叶变换)获得的频域内的互相关系数、MFCC(美尔倒谱系数)等。根据心电图传感器传来的心电信号提取的特征可以包括QRS波的QT期间、QRS斜率、ST段斜率等;根据肌电图传感器传来的肌电信号提取的特征可以包括时域特征中的例如平均绝对值、平均斜率绝对值、过零率等,频域特征中例如平均功率频率、中值频率、峰值频率等;根据温度传感器传来的温度信号可以提取温度变化率等特征。然后,通过在所提取的特征赋予权重值进行特征的选取。Then, proceeding to step 201, the identification module 101a in the processing unit 101 extracts the pre-processed signal according to the feature. Among them, feature extraction and selection are performed according to different types of sensors and different characteristics required for classification. For example, the features extracted from the motion signals transmitted by the acceleration sensor may include time domain and frequency domain features, wherein the time domain features include, for example, mean, variance, short-term energy, autocorrelation coefficient, and cross-correlation of the amplitude of the motion signal, Signal period, etc.; frequency domain features include cross-correlation coefficients in the frequency domain obtained by FFT (Fast Fourier Transform) of motion signals, MFCC (Meier Cepstral Coefficient), and the like. The feature extracted from the electrocardiographic signal transmitted from the electrocardiographic sensor may include a QT period of the QRS wave, a QRS slope, a ST segment slope, etc.; the feature extracted from the myoelectric signal according to the electromyogram sensor may include, for example, a time domain feature The average absolute value, the absolute value of the average slope, the zero-crossing rate, etc., such as the average power frequency, the median frequency, the peak frequency, etc. in the frequency domain characteristics; the temperature change rate and the like can be extracted according to the temperature signal transmitted from the temperature sensor. Then, the feature is selected by assigning weight values to the extracted features.
接着,进入步骤202,处理单元101的识别模块101a将提取出的特征根据存储单元103中的相应的模型进行分类识别,其中分类识别算法可以采用k近邻、高斯、贝叶斯、人工神经网络等。Next, proceeding to step 202, the identification module 101a of the processing unit 101 classifies and extracts the extracted features according to corresponding models in the storage unit 103, wherein the classification recognition algorithm may adopt k-nearest neighbor, Gaussian, Bayesian, artificial neural network, etc. .
然后,进入步骤203,处理单元101将识别结果通过输入/输出装置104输出给使用者。其中,输出装置可以是音频输出装置、液晶显示屏等,用于提供音频输出或用户界面。其中,输入装置可以包括按钮、键盘、触摸屏、音频或视频传感器等。Then, proceeding to step 203, the processing unit 101 outputs the recognition result to the user via the input/output device 104. The output device may be an audio output device, a liquid crystal display or the like for providing an audio output or a user interface. Wherein, the input device may include a button, a keyboard, a touch screen, an audio or video sensor, and the like.
当处理单元101中的识别模块101a基于存储单元103中的样本/模型库无法识别被检测对象的状态类型,例如输出的识别结果为拒识类型,即不属于存储的样本/模型库中的模型类型;或者,当处理单元输出的识别结果错误时,例如心电识别模块通过输入/输出装置104输出识别结果“正常”,但被检测对象心脏异常,或者运动识别模块101a通过输入/输出装置104输出识别结果为“跑”,但使用者实际的动作为“走”时,处理单元101可以接收使用者通过输入/输出装置104输入的反馈信息,例如指示系统识别错误指令,并根据反馈信息判断是否建立新的模型;如果是,则进入步骤204,接收使用者通过输入/输出装置104输入的要建立的模型标识的反馈信息;如果否,则接收下一个或多个检测信号并继续进入步骤200。When the identification module 101a in the processing unit 101 cannot identify the state type of the detected object based on the sample/model library in the storage unit 103, for example, the output recognition result is a rejection type, that is, a model that does not belong to the stored sample/model library. Type; or, when the recognition result output by the processing unit is wrong, for example, the electrocardiographic recognition module outputs the recognition result "normal" through the input/output device 104, but the detected object is abnormal, or the motion recognition module 101a passes through the input/output device 104. The output recognition result is “running”, but when the actual action of the user is “walking”, the processing unit 101 can receive feedback information input by the user through the input/output device 104, for example, the indication system recognizes an error instruction, and judges according to the feedback information. Whether to establish a new model; if yes, proceed to step 204 to receive feedback information of the model identification to be established input by the user through the input/output device 104; if not, receive the next one or more detection signals and proceed to the step 200.
优选地,反馈信息还可以包括各模型对应的场景的标识。例如,如果被检测对象所做的动作类型为高尔夫运动中的挥杆动作且需要建立该模型,则使用者输入模型标识为“高尔夫场景”和 “挥杆动作”。或者,如果检测的是被检测对象的心电信号,并且被检测对象当前的状态为 “心绞痛”且需要建立该模型,则使用者可以输入模型标识为“心绞痛”。其中,可以在存储单元103中预先存储模型标识库,使用者可以通过输入/输出装置104从模型标识库中选择输入要建立的模型标识,如果要建立的模型标识未存储在现有的模型标识库时,则使用者可以输入模型标识。Preferably, the feedback information may further include an identifier of a scene corresponding to each model. For example, if the type of action performed by the detected object is a swing motion in golf and the model needs to be established, the user input model is identified as a "golf scene" and "Swing action." Or, if the detected ECG signal of the detected object, and the current state of the detected object is "angina" and the need to establish the model, the user can enter the model identification as "angina." The model identifier library may be pre-stored in the storage unit 103, and the user may select, by using the input/output device 104, the model identifier to be established from the model identifier library, if the model identifier to be established is not stored in the existing model identifier. When the library is available, the user can enter the model ID.
在使用者输入模型标识后,处理单元101将对应的信号/特征作为训练样本,并通过训练模块101b训练模型。其中,处理单元101中的训练模块101c可以通过本领域公知的机器学习算法进行训练,例如混合高斯、支持向量机、贝叶斯或其他公知的算法等。After the user inputs the model identification, the processing unit 101 takes the corresponding signal/feature as a training sample and trains the model through the training module 101b. The training module 101c in the processing unit 101 can be trained by a machine learning algorithm well known in the art, such as hybrid Gaussian, support vector machine, Bayesian or other well-known algorithms.
接下来,处理单元101根据已有样本/模型库判断该模型标识与样本/模型库中的某一模型标识是否相同;Next, the processing unit 101 determines, according to the existing sample/model library, whether the model identifier is identical to a certain model identifier in the sample/model library;
如果相同,则进入步骤205,处理单元101中的训练模块101b将当前输入信号的所提取并选择的特征加入到已有的具有相同模型标识的样本集中进行训练;例如,如果处理单元101接收到的信号为心电信号和动作信号,而使用者输入的要建立的模型的标识为“异常”,则可以将心电信号和动作信号分别加入到已有样本/模型库中标识为“异常”的模型的对应信号训练集中进行训练,并建立新的“异常”模型。If they are the same, proceed to step 205, the training module 101b in the processing unit 101 adds the extracted and selected features of the current input signal to the existing sample set having the same model identification for training; for example, if the processing unit 101 receives The signal is an electrocardiogram signal and an action signal, and the identifier of the model to be established input by the user is “abnormal”, and the ECG signal and the motion signal can be respectively added to the existing sample/model library and identified as “abnormal”. The corresponding signal training of the model is focused on training and a new "abnormal" model is established.
然后进入步骤206,更新已有的相同标识的模型从而更新已有样本/模型库。Then, proceeding to step 206, the existing identically identified model is updated to update the existing sample/model library.
优选地,处理单元101还可以根据使用者通过输入/输出装置104输入的指令选择仅与其中的一个或多个传感器进行通信或仅处理其输入的检测信号。例如,当使用者仅需要监测其脑电和运动信号时,可以输入指令指示处理单元101仅与脑电和运动传感器进行通信,或仅处理这两种传感器输入的检测信号。Preferably, the processing unit 101 may also select a detection signal that only communicates with one or more of the sensors or processes only its input, according to an instruction input by the user via the input/output device 104. For example, when the user only needs to monitor their EEG and motion signals, an instruction can be input to instruct the processing unit 101 to communicate only with the EEG and motion sensors, or only the detection signals input by the two sensors.
进一步,存储单元103还可以存储基于各种不同的场景下相应的样本/模型库,例如健身场景、办公室场景、家庭场景等。其中,各场景还可以分别包括多个子场景。例如,健身场景还可以包括瑜伽场景、网球场景等。Further, the storage unit 103 can also store a corresponding sample/model library based on various different scenarios, such as a fitness scene, an office scene, a home scene, and the like. Each scene may also include multiple sub-scenes. For example, the fitness scene may also include a yoga scene, a tennis court view, and the like.
其中,各场景或子场景可以分别包括各检测信号对应的样本/模型库。例如,瑜伽子场景可以包括动作信号对应的样本/模型库,例如抬腿、弯腰样本/模型等;网球子场景可以包括网球动作样本/模型库,例如发球、挥拍样本/模型等;办公室场景对应的动作样本/模型库可以包括工作、休息、其他等动作样本/模型;家庭场景对应存储的动作样本/模型库可以包括家务劳动、看电视、吃饭等动作样本/模型;Each scene or sub-scene may include a sample/model library corresponding to each detection signal. For example, the yoga sub-scenario may include a sample/model library corresponding to the motion signal, such as a leg lift, a bent-up sample/model, etc.; the tennis sub-scenario may include a tennis action sample/model library, such as a serve, a swipe sample/model, etc.; The action sample/model library corresponding to the scene may include work, rest, and other action samples/models; the stored action sample/model library of the family scene may include action samples/models such as housework, watching TV, and eating;
在健身场景、办公室场景、家庭场景下,肌电信号对应的肌电样本/模型库中可以包括肌肉疲劳模型和肌肉兴奋模型;脑电信号对应的脑电样本/模型库可以包括精神紧张模型、精神放松样本/模型等;心电信号对应的心电样本/模型库可以包括“正常”和“异常”等样本/模型,其中异常样本/模型库还可以包括“心率不齐”、“心肌梗死”等样本/模型。In the fitness scene, the office scene, and the family scene, the myoelectric sample/model library corresponding to the myoelectric signal may include a muscle fatigue model and a muscle excitation model; the EEG sample/model library corresponding to the EEG signal may include a mental stress model, Mental relaxation samples/models; ECG samples/model libraries corresponding to ECG signals may include samples/models such as “normal” and “abnormal”, where abnormal samples/model libraries may also include “arrhythmia” and “myocardial infarction” "Sequence samples/models.
输入/输出装置104可以输出供使用者选择的场景标识,使用者可以通过输入/输出104装置选择其中的场景或子场景;处理单元101可以根据各场景对应存储的模型识别被检测对象的状态类型,例如所做的动作类型、脑电类型、心电类型等并分别输出识别结果。The input/output device 104 can output a scene identifier for the user to select, and the user can select a scene or a sub-scene thereof through the input/output 104 device; the processing unit 101 can identify the status type of the detected object according to the model corresponding to each scene. For example, the type of action performed, the type of brain electrical power, the type of electrocardiogram, etc., and the recognition results are respectively output.
进一步,使用者还可以通过输入/输出装置104输入要建立的模型对应的场景标识。例如,如果被检测对象要训练的模型为高尔夫运动场景中的“挥杆”动作模型以及对应的血氧模型、脑电模型、心电模型、湿度模型、温度模型等,则使用者可以根据输入/输出装置104的提示输入场景标识为“高尔夫场景”,然后输入模型标识为“挥杆”;处理单元101接收到使用者输入的对应的场景标识和模型标识,将新训练的当前模型标注为“挥杆”,然后更新相应的各样本/模型库。 Further, the user can also input the scene identifier corresponding to the model to be established through the input/output device 104. For example, if the model to be trained by the detected object is a "swing" action model in a golf scene and a corresponding blood oxygen model, an electroencephalogram model, an electrocardiogram model, a humidity model, a temperature model, etc., the user can input according to the input. The prompt input scene of the output device 104 is identified as "golf scene", and then the input model is identified as "swing"; the processing unit 101 receives the corresponding scene identifier and model identifier input by the user, and marks the current model of the new training as "Swing" and then update the corresponding sample/model library.
优选地,处理单元101还可以根据多个传感器1021-102n检测到的信号将提取出的特征进行训练模型。处理单元101中的识别模块101a的分类算法可以根据不同传感器预设的最大特征维数进行特征提取,并根据实际连接的传感器进行特征选取;同理,训练模块101b可以设置为按照预设的最大特征维数进行特征提取并选取特征进行训练。Preferably, the processing unit 101 may further perform the training model on the extracted features according to the signals detected by the plurality of sensors 1021-102n. The classification algorithm of the identification module 101a in the processing unit 101 can perform feature extraction according to the maximum feature dimension preset by different sensors, and perform feature selection according to the actually connected sensor; similarly, the training module 101b can be set to be the largest according to the preset. Feature dimension is used to extract features and select features for training.
例如,假设系统100可以连接的传感器为运动传感器、心电传感器和脑电传感器,其中,从运动传感器检测的动作信号提取幅值的均值、方差、短时能量这3维特征向量;从心电传感器检测的信号提取的特征为QRS波的QT期间、QRS斜率、ST段斜率这3维特征向量,从肌电传感器提取的特征为平均绝对值、平均斜率绝对值这2维向量,则可以设置相应的分类/训练算法为根据8维特征向量进行分类/训练。当使用者选择了仅肌电和运动信号,则识别模块101a对应的8维特征向量中的心电信号的特征的权重值设置为(0,0)并进行分类/训练。以此类推,可以根据运动传感器、心电、脑电、血氧、温度、湿度传感器等结合检测到的信号分别进行特征提取,并训练出模型。这样,使用者可以监测被检测对象在不同环境下的状态类型。 For example, assume that the sensors that the system 100 can connect are motion sensors, ECG sensors, and EEG sensors, wherein the 3-D feature vector of the mean, variance, and short-time energy of the amplitude is extracted from the motion signal detected by the motion sensor; The signal extracted by the sensor is characterized by the QT period of the QRS wave, the QRS slope, and the ST-segment slope. The two-dimensional vector extracted from the myoelectric sensor is the average absolute value and the average absolute value of the slope. The corresponding classification/training algorithm is to classify/train according to the 8-dimensional feature vector. When the user selects only the myoelectric and motion signals, the weight value of the feature of the electrocardiographic signal in the 8-dimensional feature vector corresponding to the recognition module 101a is set to (0, 0) and classified/trained. By analogy, the detected signals can be separately extracted according to the motion sensor, electrocardiogram, electroencephalogram, blood oxygen, temperature, humidity sensor, etc., and the model can be trained. In this way, the user can monitor the status type of the detected object in different environments.
传感器1021-102n继续采集使被检测对象的动作信号,根据存储单元103中更新的状态模型,处理单元101继续识别被检测对象的状态类型,并训练不断更新和完善状态样本/模型。The sensors 1021-102n continue to collect motion signals for the detected object. Based on the updated state model in the storage unit 103, the processing unit 101 continues to identify the state type of the detected object and trains to continuously update and refine the state samples/models.
需要说明的是,由于样本数量的不足,在构建初始的模型时例如,构建的高斯模型,通过训练样本进行学习,计算均值、方差等,初始化高斯分布和先验概率,初始模型的识别率可能并不高。It should be noted that due to the insufficient number of samples, when constructing the initial model, for example, the constructed Gaussian model, learning by training samples, calculating mean, variance, etc., initializing Gaussian distribution and prior probability, the recognition rate of the initial model may be Not high.
随着检测到的被检测对象的信号的不断增多,训练样本的数量也不断增加,并合并同类状态的训练样本进行训练,在已有模型的基础上进行自适应学习,从而可能使得训练出的模型的识别率提高。As the detected signal of the detected object increases, the number of training samples also increases, and the training samples of the same state are combined for training, and adaptive learning is performed on the basis of the existing model, thereby possibly making the training The recognition rate of the model is improved.
优选地,存储单元103还可以用于存储被检测对象的检测信号和/或识别结果。Preferably, the storage unit 103 is further configured to store a detection signal and/or a recognition result of the detected object.
优选地,系统100的输入/输出装置104还可以提供用户界面,用于使用者可以选择不同的操作模式,例如,可以提供训练模式、监测模式、记录模式等。使用者可以根据需要通过输入/输出装置104选择不同的模式,例如训练模式,使用者可以主动进行模型训练并建立模型;在监测模式中,处理单元101可以根据识别算法和样本/模型库对被检测对象的状态进行监测和识别;在记录模式中,处理单元101可以记录被检测对象的信号和/或识别结果。Preferably, the input/output device 104 of the system 100 can also provide a user interface for the user to select different modes of operation, for example, a training mode, a monitoring mode, a recording mode, and the like can be provided. The user can select different modes through the input/output device 104 as needed, for example, the training mode, the user can actively perform model training and build a model; in the monitoring mode, the processing unit 101 can be compared according to the recognition algorithm and the sample/model library. The state of the detected object is monitored and identified; in the recording mode, the processing unit 101 can record the signal and/or the recognition result of the detected object.
图4所示为本发明的个性化自学习识别系统300。其中,包括客户端301和服务器302。客户端301与服务器302通过网络303进行数据传输,例如本领域公知的Wi-Fi、GSM、LAN、USB、蓝牙、WLAN等。4 shows a personalized self-learning recognition system 300 of the present invention. Among them, the client 301 and the server 302 are included. Client 301 and server 302 perform data transmission over network 303, such as Wi-Fi, GSM, LAN, USB, Bluetooth, WLAN, etc., as is known in the art.
其中,服务器302包括存储单元3023用于存储样本/模型库;The server 302 includes a storage unit 3023 for storing a sample/model library;
其中,客户端301中与图1所示系统100相同或相似功能的部件不再一一赘述。The components of the client 301 that have the same or similar functions as the system 100 shown in FIG. 1 are not described again.
其中,传感器30121-3012n,用于检测被检测对象的信号;Wherein, the sensors 30121-3012n are used to detect a signal of the detected object;
处理单元3011,用于接收传感器30121-3012n检测到的被检测对象的信号,并根据从服务器302下载的样本/模型库识别使用者的当前状态类型并通过输入/输出装置3013输出识别结果;The processing unit 3011 is configured to receive the signal of the detected object detected by the sensors 30121-3012n, and identify the current state type of the user according to the sample/model library downloaded from the server 302 and output the recognition result through the input/output device 3013;
当所识别的当前状态类型为拒识类型或者为错误类型时,使用者可以通过输入/输出装置3013输入一反馈信息,例如指示识别结果错误信息,处理单元3011根据反馈信息,并传送给处理单元3011;When the identified current status type is the rejection type or the error type, the user may input a feedback information through the input/output device 3013, for example, indicating the recognition result error information, and the processing unit 3011 transmits the feedback information to the processing unit 3011 according to the feedback information. ;
处理单元3011使用对应的训练样本训练模型,然后将训练完成的模型及对应的训练样本发送到服务器302;The processing unit 3011 uses the corresponding training sample training model, and then sends the trained completed model and the corresponding training samples to the server 302;
然后,服务器302更新样本/模型库。The server 302 then updates the sample/model library.
优选地,服务器302还用于存储检测到的信号库和/或识别结果。Preferably, the server 302 is further configured to store the detected signal library and/or the recognition result.
优选地,输入/输出装置3013还可以提示使用者输入要训练的模型标识,并且如果使用者输入的模型标识与已有样本/模型库中的模型标识相同时,则加入到已有模型对应的训练样本集中进行训练并更新样本/模型库。Preferably, the input/output device 3013 may also prompt the user to input the model identifier to be trained, and if the model identifier input by the user is the same as the model identifier in the existing sample/model library, then the corresponding model is added. The training samples are focused on training and updating the sample/model library.
进一步,服务器302中还可进一步包括处理单元3021、输入/输出装置3022,使用者可以通过服务器302中的处理单元3021将记录的被检测对象的各种检测信号发送给其他远程监控端,例如,发送给远程监护中心进行健康分析;使用者还可以通过服务器302中的输入/输出装置3022用于根据被检测对象的个性化情况及其状态,设置客户端的处理单元3011要处理的传感器的信号类型。例如,如果通过健康分析出被检测对象为心脏病患者,则可以设置配置信息为要检测的信号为心电信号、运动信号,并发送给客户端的处理单元3011,处理单元3011根据配置信息仅处理被检测对象的心电信号和运动信号。Further, the server 302 may further include a processing unit 3021 and an input/output device 3022. The user may send various detected detection signals of the detected object to other remote monitoring terminals through the processing unit 3021 in the server 302. For example, Sending to the remote monitoring center for health analysis; the user can also use the input/output device 3022 in the server 302 to set the signal type of the sensor to be processed by the processing unit 3011 of the client according to the personalized condition of the detected object and its status. . For example, if the detected object is a heart disease patient through the health analysis, the configuration information may be set as the ECG signal and the motion signal to be detected, and sent to the processing unit 3011 of the client, and the processing unit 3011 processes only according to the configuration information. The ECG signal and motion signal of the detected object.
根据本发明的另一实施例,系统300还可以配置为,客户端301的处理单元3011用于接收传感器30121-3012n检测到的被检测对象的信号,并根据从服务器302下载的样本/模型库识别使用者的状态类型;According to another embodiment of the present invention, the system 300 may be further configured to: the processing unit 3011 of the client 301 is configured to receive the signal of the detected object detected by the sensors 30121-3012n, and according to the sample/model library downloaded from the server 302. Identify the user's status type;
根据所识别的当前状态类型,如果是拒识类型或者错误类型时,使用者可以通过输入/输出装置3013输入反馈信息,包括模型标识信息;处理单元3011接收反馈信息并将对应的训练样本通过网络303发送给服务器302; According to the identified current state type, if it is a rejection type or an error type, the user can input feedback information including model identification information through the input/output device 3013; the processing unit 3011 receives the feedback information and passes the corresponding training sample through the network. 303 is sent to the server 302;
服务器302中的处理单元3021用于接收客户端301传来的反馈信息及要建立的模型的训练样本,并使用相应的训练样本集训练模型并标识建立的新模型,然后更新存储单元3023中的样本/模型库。The processing unit 3021 in the server 302 is configured to receive the feedback information sent by the client 301 and the training samples of the model to be established, and use the corresponding training sample set to train the model and identify the established new model, and then update the storage unit 3023. Sample/model library.
可以理解的是,本发明的系统还可以用于监测物体的状态。例如工作中的仪器是否正常等,可以将不同类型的传感器例如音频传感器、振动传感器、压力传感器等放置在相应的位置,用于检测声音、振动、压力信号,并根据正常或异常模型识别仪器的工作状况,使用者根据识别的结果训练和建立新的模型并不断更新样本/模型库,以便更精确监测出仪器的工作状态。It will be appreciated that the system of the present invention can also be used to monitor the condition of an object. For example, whether the instrument in operation is normal, etc., different types of sensors such as an audio sensor, a vibration sensor, a pressure sensor, etc. can be placed at corresponding positions for detecting sound, vibration, pressure signals, and identifying instruments according to normal or abnormal models. Working condition, the user trains and builds a new model based on the identified results and continuously updates the sample/model library to more accurately monitor the working state of the instrument.
以上所述仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以作出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。The above description is only a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It is considered as the scope of protection of the present invention.

Claims (1)

  1. . 一种个性化自学习识别系统,包括:A personalized self-learning recognition system comprising:
    一个或多个传感器,用于检测被检测对象的信号;One or more sensors for detecting a signal of the detected object;
    存储单元,用于存储样本/模型库,包括模型及训练样本集;a storage unit for storing a sample/model library, including a model and a training sample set;
    处理单元,用于接收所述一个或多个传感器检测到的所述被检测对象的信号,并根据所述样本/模型库中的相应模型识别所述被检测对象的状态类型;a processing unit, configured to receive a signal of the detected object detected by the one or more sensors, and identify a state type of the detected object according to a corresponding model in the sample/model library;
    输入/输出装置,用于输出识别结果以及接收基于所述识别结果输入的反馈信息; Input/output means for outputting a recognition result and receiving feedback information input based on the recognition result;
    所述处理单元还根据所述反馈信息使用相应的训练样本集训练模型并更新所述样本/模型库。The processing unit also trains the model using the corresponding training sample set and updates the sample/model library based on the feedback information.
    2. 根据权利要求1所述的系统,其特征在于:2. The system of claim 1 wherein:
    所述训练样本集包括所述被检测对象的信号和/或信号的特征。The set of training samples includes characteristics of signals and/or signals of the detected object.
    3. 根据权利要求1所述的系统,其特征在于:3. The system of claim 1 wherein:
    所述样本/模型库包括一个或多个场景下对应的模型。The sample/model library includes corresponding models in one or more scenarios.
    4.根据权利要求1所述的系统,其特征在于:4. The system of claim 1 wherein:
    所述反馈信息包括要建立的模型的标识。The feedback information includes an identification of a model to be established.
    5. 根据权利要求3所述的系统,其特征在于:5. The system of claim 3 wherein:
    所述反馈信息包括要建立的模型的场景标识及其对应的模型标识。The feedback information includes a scene identifier of a model to be established and a corresponding model identifier.
    6. 根据权利要求4或5所述的系统,其特征在于:6. System according to claim 4 or 5, characterized in that:
    当输入的要建立的模型的标识与所述样本/模型库中的模型的标识相同时,所述处理单元将对应训练样本加入到对应模型的训练样本集中进行训练以建立与所述标识相应的模型。When the input identifier of the model to be established is the same as the identifier of the model in the sample/model library, the processing unit adds the corresponding training sample to the training sample set of the corresponding model for training to establish a corresponding to the identifier. model.
    7. 根据权利要求1所述的系统,其特征在于:7. The system of claim 1 wherein:
    所述处理单元还用于根据所述输入/输出装置接收到的选择指令选择与所述一个或多个传感器进行通信。The processing unit is further configured to select to communicate with the one or more sensors according to a selection instruction received by the input/output device.
    8. 根据权利要求1所述的系统,其特征在于:8. The system of claim 1 wherein:
    所述输入/输出装置还用于接收输入选择的操作模式。The input/output device is also operative to receive an input selected mode of operation.
    9. 根据权利要求8所述的系统,其特征在于:9. The system of claim 8 wherein:
    所述操作模式包括训练模型模式、监测模式、记录模式之一或其组合;The operation mode includes one of a training model mode, a monitoring mode, a recording mode, or a combination thereof;
    所述处理单元根据所述输入的操作模式分别进行模型训练、状态识别、将所述识别结果和/或相应的检测信号存储到所述存储单元中。The processing unit separately performs model training, state recognition, and stores the recognition result and/or the corresponding detection signal into the storage unit according to the input operation mode.
    10. 一种个性化自学习识别方法,包括:10. A personalized self-learning recognition method, including:
    使用一个或多个传感器检测被检测对象的信号;Using one or more sensors to detect the signal of the detected object;
    接收检测到的所述被检测对象的信号,根据样本/模型库中存储的对应模型识别所述被检测对象的状态类型并输出识别结果;Receiving the detected signal of the detected object, identifying a state type of the detected object according to a corresponding model stored in the sample/model library, and outputting the recognition result;
    接收输入的反馈信息,并根据所述反馈信息训练模型并更新所述样本/模型库。The input feedback information is received, and the model is trained based on the feedback information and the sample/model library is updated.
    11. 根据权利要求10所述的方法,其特征在于:11. The method of claim 10 wherein:
    所述反馈信息包括要建立的模型的标识。The feedback information includes an identification of a model to be established.
    12. 根据权利要求11所述的方法,其特征在于:12. The method of claim 11 wherein:
    当输入的要建立的模型的标识与所述样本/模型库中的模型的标识相同时,将对应训练样本加入到对应模型的训练样本集中进行训练以建立与所述标识相应的模型。When the input identifier of the model to be established is the same as the identifier of the model in the sample/model library, the corresponding training sample is added to the training sample set of the corresponding model for training to establish a model corresponding to the identifier.
    13. 一种个性化自学习识别系统,包括:13. A personalized self-learning recognition system comprising:
    服务器,用于存储样本/模型库,包括训练样本集及模型; a server for storing a sample/model library, including a training sample set and a model;
    客户端,与服务器进行网络连接,并进一步包括,The client, the network connection with the server, and further includes,
    一个或多个传感器,用于检测被检测对象的信号; One or more sensors for detecting a signal of the detected object;
    处理单元,用于接收所述传感器检测到的所述被检测对象的信号,并根据所述服务器存储的所述样本/模型库识别所述被检测对象的状态类型;a processing unit, configured to receive a signal of the detected object detected by the sensor, and identify a state type of the detected object according to the sample/model library stored by the server;
    输入/输出装置,用于输出识别结果以及接收基于所述识别结果输入的反馈信息; Input/output means for outputting a recognition result and receiving feedback information input based on the recognition result;
    所述处理单元还根据所述反馈信息使用相应的训练样本集训练模型并更新所述样本/模型库。The processing unit also trains the model using the corresponding training sample set and updates the sample/model library based on the feedback information.
    14. 根据权利要求所述13的系统,其特征在于:14. A system according to claim 13 wherein:
    所述服务器还用于指示所述客户端的处理单元选择与所述一个或多个传感器进行通信。The server is further configured to instruct the processing unit of the client to select to communicate with the one or more sensors.
    15. 一种个性化自学习识别系统,包括客户端和服务器:15. A personalized self-learning recognition system, including client and server:
    所述服务器包括存储器,用于存储样本/模型库;The server includes a memory for storing a sample/model library;
    所述客户端,进一步包括,The client further includes
    一个或多个传感器,用于检测被检测对象的信号; One or more sensors for detecting a signal of the detected object;
    处理单元,用于接收所述传感器检测到的所述被检测对象的信号,并根据所述服务器存储的所述样本/模型库识别所述被检测对象的状态类型;a processing unit, configured to receive a signal of the detected object detected by the sensor, and identify a state type of the detected object according to the sample/model library stored by the server;
    输入/输出装置,用于输出识别结果以及接收基于所述识别结果输入的反馈信息;Input/output means for outputting a recognition result and receiving feedback information input based on the recognition result;
    所述处理单元还将所述反馈信息及要建立的模型的训练样本通过网络发送给所述服务器;以及The processing unit further transmits the feedback information and training samples of the model to be established to the server through a network;
    所述服务器,还用于接收所述客户端传来的反馈信息及要建立的模型的训练样本,并使用相应的训练样本集训练模型并更新所述模型库。The server is further configured to receive the feedback information sent by the client and the training samples of the model to be established, and use the corresponding training sample set to train the model and update the model library.
PCT/CN2012/074584 2012-04-24 2012-04-24 Customized self-learning identification system and method WO2013159282A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2012/074584 WO2013159282A1 (en) 2012-04-24 2012-04-24 Customized self-learning identification system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2012/074584 WO2013159282A1 (en) 2012-04-24 2012-04-24 Customized self-learning identification system and method

Publications (1)

Publication Number Publication Date
WO2013159282A1 true WO2013159282A1 (en) 2013-10-31

Family

ID=49482113

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/074584 WO2013159282A1 (en) 2012-04-24 2012-04-24 Customized self-learning identification system and method

Country Status (1)

Country Link
WO (1) WO2013159282A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110473306A (en) * 2019-08-15 2019-11-19 优估(上海)信息科技有限公司 A kind of Work attendance method based on face recognition, device and system
CN111310658A (en) * 2020-02-14 2020-06-19 北京海益同展信息科技有限公司 Method and device for updating motion pattern recognition model
CN111796980A (en) * 2019-04-09 2020-10-20 Oppo广东移动通信有限公司 Data processing method and device, electronic equipment and storage medium
CN113255748A (en) * 2021-05-14 2021-08-13 广州织点智能科技有限公司 Characteristic base updating method and device of commodity identification model
CN114625076A (en) * 2016-05-09 2022-06-14 强力物联网投资组合2016有限公司 Method and system for industrial internet of things
CN114841201A (en) * 2022-04-23 2022-08-02 中国人民解放军32802部队 Design method and device of dynamic knowledge base for intelligent radar countermeasure

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5078152A (en) * 1985-06-23 1992-01-07 Loredan Biomedical, Inc. Method for diagnosis and/or training of proprioceptor feedback capabilities in a muscle and joint system of a human patient
CN101662986A (en) * 2007-04-20 2010-03-03 皇家飞利浦电子股份有限公司 The system and method for assessment motor pattern
CN102087712A (en) * 2010-02-22 2011-06-08 艾利维公司 Systems and methods for personalized motion control
CN102368297A (en) * 2011-09-14 2012-03-07 北京英福生科技有限公司 Equipment, system and method for recognizing actions of detected object

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5078152A (en) * 1985-06-23 1992-01-07 Loredan Biomedical, Inc. Method for diagnosis and/or training of proprioceptor feedback capabilities in a muscle and joint system of a human patient
CN101662986A (en) * 2007-04-20 2010-03-03 皇家飞利浦电子股份有限公司 The system and method for assessment motor pattern
CN102087712A (en) * 2010-02-22 2011-06-08 艾利维公司 Systems and methods for personalized motion control
CN102368297A (en) * 2011-09-14 2012-03-07 北京英福生科技有限公司 Equipment, system and method for recognizing actions of detected object

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114625076A (en) * 2016-05-09 2022-06-14 强力物联网投资组合2016有限公司 Method and system for industrial internet of things
CN111796980A (en) * 2019-04-09 2020-10-20 Oppo广东移动通信有限公司 Data processing method and device, electronic equipment and storage medium
CN111796980B (en) * 2019-04-09 2023-02-28 Oppo广东移动通信有限公司 Data processing method and device, electronic equipment and storage medium
CN110473306A (en) * 2019-08-15 2019-11-19 优估(上海)信息科技有限公司 A kind of Work attendance method based on face recognition, device and system
CN111310658A (en) * 2020-02-14 2020-06-19 北京海益同展信息科技有限公司 Method and device for updating motion pattern recognition model
CN113255748A (en) * 2021-05-14 2021-08-13 广州织点智能科技有限公司 Characteristic base updating method and device of commodity identification model
CN114841201A (en) * 2022-04-23 2022-08-02 中国人民解放军32802部队 Design method and device of dynamic knowledge base for intelligent radar countermeasure

Similar Documents

Publication Publication Date Title
WO2013159282A1 (en) Customized self-learning identification system and method
EP3843617B1 (en) Camera-guided interpretation of neuromuscular signals
Esposito et al. A piezoresistive array armband with reduced number of sensors for hand gesture recognition
Wu et al. Fuzzy integral with particle swarm optimization for a motor-imagery-based brain–computer interface
CN106255449A (en) There is the mancarried device of the multiple integrated sensors scanned for vital sign
AU2013239151A1 (en) System for the acquisition and analysis of muscle activity and operation method thereof
US9770179B2 (en) System, method and device for detecting heart rate
KR20150061231A (en) Digital device and method for controlling the same
WO2017146519A1 (en) Sensor-based detection of changes in health and ventilation threshold
EP2839774B1 (en) Biosignal interface apparatus and operation method of biosignal interface apparatus
CN107440695B (en) Physiological signal sensing device
WO2013141419A1 (en) Biometric system using both hands for evaluation of blood vessel and cardio pulmonary function
WO2017188099A1 (en) Device, terminal and biometric information system
JP7330507B2 (en) Information processing device, program and method
WO2020122792A1 (en) Control of an active orthotic device
KR20190080598A (en) System for recognizing emotion using biometric data and method thereof
JP7303544B2 (en) Information processing device, program, and method
Miyake et al. Heel-contact gait phase detection based on specific poses with muscle deformation
JP3699996B2 (en) Remote controller using biological signals
JP2021089635A (en) Information processing device and program
US10691218B2 (en) Gesture recognition apparatus and components thereof
JP7343168B2 (en) Information processing device, program, and method
CN210052319U (en) Hand-held mandarin training device
WO2016149830A1 (en) System, method and device for detecting heart rate
TW201617027A (en) System and method for motion artifact reduction using surface electromyography

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12874957

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12874957

Country of ref document: EP

Kind code of ref document: A1