EP3510495A1 - Verfahren zur mustererkennung in einer vielzahl von signalen - Google Patents
Verfahren zur mustererkennung in einer vielzahl von signalenInfo
- Publication number
- EP3510495A1 EP3510495A1 EP17771501.8A EP17771501A EP3510495A1 EP 3510495 A1 EP3510495 A1 EP 3510495A1 EP 17771501 A EP17771501 A EP 17771501A EP 3510495 A1 EP3510495 A1 EP 3510495A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- context
- signals
- standard
- contexts
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N7/00—Computing arrangements based on specific mathematical models
- G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/18—Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
Definitions
- the present invention relates to the field of the analysis of complex signals, in particular for the detection of certain particular patterns in signals of different natures.
- the analysis of these data is a real challenge to be able to value the data from these sensors.
- the analysis of a single signal does not pose a problem in itself, because this analysis is most often to treat the curve with known mathematical tools (eg calculation of derivatives, analysis of variability, etc.).
- the increase in heart rate alone may mean that the patient is running or is in cardiac distress;
- - Increasing the consumption of the industrial machine may mean that the carburation of the engine is not working well or that the operator has requested an increase in production rate.
- the present invention thus aims at a method of recognizing a pattern in a plurality of time signals of a different nature, the method comprising: / a / receiving the plurality of time signals;
- Ibl for each signal received from the plurality of signals, creating a temporal asynchronous signal including events, said events being the same forms of the asynchronous signal representative of a characteristic of the received signal;
- the activity profile comprises at least one activity value which decreases as a function of the elapsed time since a most recent event among the successive events of said asynchronous signal ; for a given time:
- Distances can be distances in the mathematical sense.
- the distances can be Euclidean distances, Manhattan distances, Minkoswski distances, Chebyshev distances or other distances.
- Ibl for each signal received from the plurality of signals, creating a temporal asynchronous signal including events, said events being the same forms of the asynchronous signal representative of a characteristic of the received signal;
- Ib'l use the events of each asynchronous signal as current events and use the standard contexts of the first level of the hierarchical model as typical common contexts;
- the activity profile comprises at least one activity value which decreases as a function of the elapsed time since a most recent event among the successive events of said asynchronous signal ; Idl for each given time among a plurality of given times:
- M determination of a context, said context being defined as the set of values of the activity profiles, at the given time, of the asynchronous signals created,
- the first hierarchical level makes it possible to identify very basic forms, the higher order hierarchical levels making it possible to identify more complex forms from the lower levels.
- the comparison of the step / f / may comprise the calculation of a Bhattacharyya distance. Indeed, it has been found experimentally that this distance allowed better quality recognition.
- the comparison of the step / f / may include the calculation of a standardized distance.
- the comparison of step / f / may be a comparison between a number of instances of determination of the typical contexts at the last occurrence of step I02I with a signature base types.
- the decay of the activity profile can be a function of the level of the current hierarchical model.
- This adaptation may allow a slower rate of decay for higher hierarchical levels in order to have a responsiveness of these lower levels. Conversely, low level hierarchical levels (ie the first ones used) may have higher responsiveness.
- a computer program, implementing all or part of the method described above, installed on a pre-existing equipment, is in itself advantageous, since it allows pattern recognition in a plurality of signals.
- FIGS. 5a and 5b described in detail below can form the flowchart of the general algorithm of such a computer program.
- FIG. 1b illustrates a generation of events from a signal representative of a respiratory rate
- FIGS. 2a and 2b are examples of "activity profile" for the events resulting from received signals
- FIGS. 3a and 3b are examples of representation of a context determined from three received signals
- FIGS. 4a to 4d are examples of representation of four typical contexts
- FIG. 4e is an example of generation of four event flows from recognition in a signal of the typical contexts of FIGS. 4a to 4d;
- FIG. 4f is an example of determination of a signature for four event streams
- FIG. 5a is an example of a flow chart of a method according to a possible embodiment of the invention (i.e. without using a hierarchical model of typical contexts);
- FIG. 5b is an example of a flow chart of a method according to another possible embodiment of the invention (i.e. using a hierarchical model of standard contexts);
- FIG. 6 illustrates a device for implementing an embodiment according to the invention.
- Figure 1a illustrates generation of events from a signal representative of a heart rhythm.
- the curve 101 is representative of a heart rhythm.
- This curve can be received as continuous data (eg analog signal) or as sampled data (eg digital signal).
- the variability of a signal pattern eg variability of the R wave repetition period in an electrocardiogram or variability of an engine cycle time for a machine tool
- these characteristics can be representative of a function of the signal (eg of the derivative of the signal or of any mathematical transformation of the signal).
- an "asynchronous" signal comprising markers or events (eg curve 102 or 103). These events are most often Diracs in the asynchronous signal, because their generation is simple. Nevertheless, these events can be any pattern (eg triangular signal, rectangular, sinusoidal portion, AC signal portion, etc.). Each event of said asynchronous signal is advantageously the same pattern or a similar pattern (their amplitude or polarity (ie their meaning relative to the zero value) can nevertheless change from one event to another).
- the curve 102 is an asynchronous signal whose events are generated during the appearance of a QRS complex in the electrocardiogram of the curve 101.
- the curve 103 is an asynchronous signal whose events are generated when the width of a QRS complex of the electrocardiogram of the curve 101 exceeds a target value (eg average over the previous x minutes).
- the curve 105 is an asynchronous signal whose events are generated when the respiratory rate exceeds a predetermined threshold (i.e., horizontal dashed line) in the curve 104.
- the curve 106 is an asynchronous signal whose events are generated when the derivative of the respiratory rate exceeds a target value in the curve 104.
- FIGS. 2a and 2b are examples of three "activity profiles" t ⁇ S, for the events resulting from three received signals pi, p 2 and p 3 .
- This exponential decay can be illustrated in Figure 2b (see event 220, for example).
- the nature and the parameters of this decay can be chosen and different for each analyzed signal.
- the value of the activity profile S can be set to the sum (possibly weighted) of the current value of S just before the event 222 (ie h 0 ) and h.
- the decay of the curve S will start from the value h + h 0 as shown in FIG . 2b .
- T (p, i) max (t / ) ⁇ j ⁇ i or
- p ⁇ T (p, t) defines a map of the times of the last events occurring temporally just before a reference time (i.e. t).
- a predetermined time constant ⁇ S may be any function decreasing with time t over an interval comprising as lower bound T (p, t)).
- the function p ⁇ S (p, i) is called the "context" of the input signals for a given time t.
- the order of the components of the vector can be arbitrary in a large number of situations, it is possible to establish an order among these components as a function of the spatial and / or temporal dynamics of the signals.
- two consecutive components in a given context can represent signals having a near spatial and / or temporal dynamics.
- Figures 4a to 4d are examples of representation of four typical contexts. In order to detect patterns in the signals, it is possible to define standard contexts that will be compared with the previously defined S contexts.
- Figure 3a can be compared with each of the typical contexts 401, 402, 403 and 404.
- FIG. 4e it is also possible (FIG. 4e) to generate events for new asynchronous signals when a typical context is retained / recognized:
- the hierarchical model may have only one level in a particular case, it is possible to define a signature.
- Figure 4f is an example of determining a signature for four event streams.
- the signature is defined as being the vector or the histogram 420 of the number of occurrence (respectively n 40 i, n 40 2, n 40 3, n 404 ) of each of the determined standard contexts (respectively 401, 402 , 403, 404) for the last occurrence of the method described above.
- the distance between two histograms K x and ⁇ 2 (P ⁇ r example 420 and 421) can be calculated as a mathematical distance between two vectors whose coordinates are the number of occurrences for each of the standard contexts: It is also possible to calculate a standardized distance as follows:
- the distance from Bhattacharyya can also be used to replace the classic distance: with W j ( ⁇ ) the number of occurrences of the i th standard context of the histogram 3 ⁇ 4 ⁇ .
- the signature may also be the general form of the asynchronous signals of the four event streams.
- Each of the standard signatures may be associated with a given pattern in the received signals: for example, the type signature 421 may correspond to a mechanical failure of an engine while the type signature 422 corresponds to a normal operation of said engine.
- Fig. 5a is an exemplary flowchart of a method according to a possible embodiment of the invention (i.e. without using hierarchical model of typical contexts).
- step 502 On receiving signals 501, it is possible to create (step 502) asynchronous signals by generating events on the basis of signal characteristic detections, as described with reference to FIGS. 1a and 1b. Once these asynchronous signals have been created, it is possible to create (step 503), from each created asynchronous signal, an activity profile as described with reference to FIGS. 2a and 2b.
- the determined context can be defined as a vector of the values of the activity profiles, at the given time, of the asynchronous signals created.
- a typical context from a set of predetermined standard contexts (for example, pre-computed and stored in a database 505) by minimizing the distance between the context determined in step 504 and the typical contexts.
- a "pattern" 509 in the plurality of received signals Based on the determined typical context, it is then possible to determine (step 508) a "pattern" 509 in the plurality of received signals.
- Fig. 5b is an exemplary flowchart of a method according to another possible embodiment of the invention (i.e. using hierarchical model of typical contexts).
- step 502 On receiving signals 501, it is possible to create (step 502) asynchronous signals by generating events on the basis of signal characteristic detections, as described with reference to FIGS. 1a and 1b.
- the determined context can be defined as a vector of the values of the activity profiles, at the given time, of the asynchronous signals created. This determination can be performed for a plurality of given times (eg this plurality of times being a sampling of the time with a predetermined step).
- Each recognition of a standard context may allow the generation (step 512) of an event as described in connection with FIG. 4e.
- asynchronous signal ie in addition to new asynchronous signals created
- an asynchronous signal from a step similar to step 502.
- a received signal is a fast signal (whose variations are notable for a predetermined period of time)
- the signal received is slow (its variations are negligible over the predetermined period of time)
- This integration of this asynchronous signal will be done in parallel with the asynchronous signals generated in step 512 for the "faster" signals already integrated.
- step 506 determines a "pattern" by comparing the typical contexts determined at the last occurrence of step 506 with a signature base types.
- This comparison may comprise, for example, the calculation of the number of occurrences of determination of the standard contexts at the last occurrence of step 506 as described with reference to FIG. 4f.
- the comparison may also be a distance comparison between the asynchronous signals generated at the last occurrence of step 513 (in this case step 513 must be executed when the last level of the hierarchical model is used) and a signature database.
- Fig. 6 shows an exemplary pattern recognition device in one embodiment of the invention.
- the device comprises a computer 600, comprising a memory 605 for storing instructions for implementing the method, the received measurement data, and temporary data for performing the various steps of the method as described above. .
- the computer further comprises a circuit 604.
- This circuit may be, for example: a processor capable of interpreting instructions in the form of a computer program.
- a programmable electronic chip such as an FPGA chip (for "Field- Programmable Gâte Array "in English) whose steps of the method of the invention are described, for example, in a VHDL or Verilog code (hardware description languages for representing the behavior and the architecture of an electronic system).
- This computer has an input interface 603 for receiving the signals to be analyzed, and an output interface 606 for providing the recognized pattern.
- the computer may include, for easy interaction with a user, a screen 601 and a keyboard 602.
- the keyboard is optional, particularly in the context of a computer in the form of a touch pad, for example.
- FIG. 5a or 5b is a typical example of a program, some of whose instructions can be carried out with the device described. As such, FIG. 5a or 5b may correspond to the flowchart of the general algorithm of a computer program within the meaning of the invention.
- the proposed method can be used to analyze any type of data / signal in any possible industrial domain, without any particular limitation.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Analysis (AREA)
- Computational Mathematics (AREA)
- Mathematical Physics (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Algebra (AREA)
- Probability & Statistics with Applications (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Operations Research (AREA)
- Evolutionary Biology (AREA)
- Databases & Information Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- Image Analysis (AREA)
- Complex Calculations (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1658424 | 2016-09-09 | ||
PCT/FR2017/052393 WO2018046868A1 (fr) | 2016-09-09 | 2017-09-08 | Procédé de reconnaissance de motif dans une pluralité de signaux |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3510495A1 true EP3510495A1 (de) | 2019-07-17 |
Family
ID=57680373
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17771501.8A Pending EP3510495A1 (de) | 2016-09-09 | 2017-09-08 | Verfahren zur mustererkennung in einer vielzahl von signalen |
Country Status (7)
Country | Link |
---|---|
US (1) | US11080523B2 (de) |
EP (1) | EP3510495A1 (de) |
JP (2) | JP7209622B2 (de) |
CN (1) | CN109844739B (de) |
AU (1) | AU2017322448B2 (de) |
CA (1) | CA3035520A1 (de) |
WO (1) | WO2018046868A1 (de) |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3598110A (en) * | 1969-04-10 | 1971-08-10 | Physic Control Corp | Ventricular arrhythmia detection system |
US6700538B1 (en) | 2000-03-29 | 2004-03-02 | Time Domain Corporation | System and method for estimating separation distance between impulse radios using impulse signal amplitude |
US6684100B1 (en) * | 2000-10-31 | 2004-01-27 | Cardiac Pacemakers, Inc. | Curvature based method for selecting features from an electrophysiologic signals for purpose of complex identification and classification |
WO2007019498A2 (en) * | 2005-08-08 | 2007-02-15 | University Of Florida Research Foundation, Inc. | Device and methods for biphasis pulse signal coding |
GB0803140D0 (en) * | 2008-02-21 | 2008-03-26 | Sentec Ltd | Technique for inference of multiple appliances' power use from single point measurements |
US8401624B2 (en) * | 2008-12-03 | 2013-03-19 | Biosense Webster, Inc. | ECG signal analysis tool |
FR2944903B1 (fr) * | 2009-04-24 | 2016-08-26 | Thales Sa | Systeme et methode pour detecter des evenements audio anormaux |
WO2012118998A2 (en) * | 2011-03-02 | 2012-09-07 | The Regents Of The University Of California | Apparatus, system, and method for detecting activities and anomalies in time series data |
FR2983998B1 (fr) * | 2011-12-08 | 2016-02-26 | Univ Pierre Et Marie Curie Paris 6 | Procede de reconstruction 3d d'une scene faisant appel a des capteurs asynchrones |
WO2013126684A1 (en) * | 2012-02-22 | 2013-08-29 | Aclaris Medical, Llc | Physiological signal detecting device and system |
US9846845B2 (en) * | 2012-11-21 | 2017-12-19 | Disney Enterprises, Inc. | Hierarchical model for human activity recognition |
DE102013110151A1 (de) * | 2013-09-16 | 2015-04-02 | Airbus Defence and Space GmbH | Verfahren zum Detektieren eines Fehlers in einer Anordnung, Detektionsvorrichtung und Flugkörper |
US20160029974A1 (en) * | 2013-10-24 | 2016-02-04 | JayBird LLC | System and method for tracking biological age over time based upon heart rate variability using earphones with biometric sensors |
CN107072545B (zh) * | 2014-09-02 | 2020-01-31 | 吉莫·博尔只斤 | 用于快速诊断的心电图数据分析方法和系统 |
WO2016061668A1 (en) * | 2014-10-23 | 2016-04-28 | 2352409 Ontario Inc. | Device and method for identifying subject's activity profile |
FR3033914A1 (fr) * | 2015-03-16 | 2016-09-23 | Univ Pierre Et Marie Curie (Paris 6) | Procede de traitement d'un signal asynchrone |
-
2017
- 2017-09-08 WO PCT/FR2017/052393 patent/WO2018046868A1/fr unknown
- 2017-09-08 CA CA3035520A patent/CA3035520A1/fr active Pending
- 2017-09-08 JP JP2019513319A patent/JP7209622B2/ja active Active
- 2017-09-08 AU AU2017322448A patent/AU2017322448B2/en active Active
- 2017-09-08 US US16/331,808 patent/US11080523B2/en active Active
- 2017-09-08 CN CN201780055286.5A patent/CN109844739B/zh active Active
- 2017-09-08 EP EP17771501.8A patent/EP3510495A1/de active Pending
-
2022
- 2022-10-20 JP JP2022168637A patent/JP2023017794A/ja not_active Ceased
Also Published As
Publication number | Publication date |
---|---|
JP7209622B2 (ja) | 2023-01-20 |
JP2020502604A (ja) | 2020-01-23 |
AU2017322448A1 (en) | 2019-03-14 |
CA3035520A1 (fr) | 2018-03-15 |
CN109844739B (zh) | 2023-07-18 |
US20190370542A1 (en) | 2019-12-05 |
AU2017322448B2 (en) | 2021-10-21 |
US11080523B2 (en) | 2021-08-03 |
CN109844739A (zh) | 2019-06-04 |
JP2023017794A (ja) | 2023-02-07 |
WO2018046868A1 (fr) | 2018-03-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2483758B1 (de) | System und verfahren zur gestenerkennung | |
EP3271869B1 (de) | Verfahren zur verarbeitung eines asynchronen signals | |
EP2696344B1 (de) | Verfahren und System zum Erfassen von Schallereignissen in einer gegebenen Umgebung | |
KR101734829B1 (ko) | 지역성 말투를 구분하는 음성 데이터 인식 방법, 장치 및 서버 | |
US20160062456A1 (en) | Method and apparatus for live user recognition | |
CN111126069A (zh) | 一种基于视觉对象引导的社交媒体短文本命名实体识别方法 | |
FR2884007A1 (fr) | Procede d'identification de visages a partir d'images de visage, dispositif et programme d'ordinateur correspondants | |
CN111288986B (zh) | 一种运动识别方法及运动识别装置 | |
WO2010066563A1 (fr) | Dispositif a architecture pipeline de flot de donnees pour la reconnaissance et la localisation d'objets dans une image par balayage de fenetres de detection | |
WO2019110914A1 (fr) | Extraction automatique d'attributs d'un objet au sein d'un ensemble d'images numeriques | |
EP2917868B1 (de) | Methode zur identifikation | |
WO2013030508A1 (fr) | Procédé de configuration d'un dispositif de détection à capteur, programme d'ordinateur et dispositif adaptatif correspondants | |
EP2881841B1 (de) | Kontinuierliches Gestenerkennungsverfahren eines Benutzers eines greifbaren mobilen Endgeräts, das mit einem Set von Bewegungssensoren ausgestattet ist, und entsprechende Vorrichtung | |
CN110132276A (zh) | 一种基于行人运动状态的自适应步长估计方法 | |
WO2018046868A1 (fr) | Procédé de reconnaissance de motif dans une pluralité de signaux | |
CN112418271A (zh) | 一种目标检测方法、装置、系统及存储介质 | |
EP3252563A1 (de) | Bestimmung eines mobilitätskontextes eines nutzers eines tragbaren geräts, das mit trägheitssensoren ausgestattet ist | |
CN109239207B (zh) | 基于电子鼻的气味识别方法、装置和电子鼻系统 | |
FR3075995A1 (fr) | Procede de detection de donnees aberrantes. | |
CN107871019B (zh) | 人车关联搜索方法及装置 | |
CN111126294A (zh) | 一种基于移动终端数据识别终端用户步态的方法和服务器 | |
EP3360055B1 (de) | Verfahren zur optimierung der zerlegung eines asynchronen signals | |
CN117235650B (zh) | 一种高空作业状态检测方法、装置、设备及介质 | |
CN205563612U (zh) | 一种可用于机器人进行人脸识别的装置 | |
CN110990819A (zh) | 一种基于移动终端数据获取终端用户步态特征数据的方法和服务器 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190403 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20210923 |