WO2017120138A1 - System and method of extraction, identification, making and display of the heart valve signals - Google Patents

System and method of extraction, identification, making and display of the heart valve signals Download PDF

Info

Publication number
WO2017120138A1
WO2017120138A1 PCT/US2017/012031 US2017012031W WO2017120138A1 WO 2017120138 A1 WO2017120138 A1 WO 2017120138A1 US 2017012031 W US2017012031 W US 2017012031W WO 2017120138 A1 WO2017120138 A1 WO 2017120138A1
Authority
WO
WIPO (PCT)
Prior art keywords
vibration
events
valve
heart
sensor
Prior art date
Application number
PCT/US2017/012031
Other languages
French (fr)
Inventor
Kaustubh Kale
Luis Gonzalo Sanchez Giraldo
Original Assignee
AventuSoft, LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by AventuSoft, LLC filed Critical AventuSoft, LLC
Priority to EP17736198.7A priority Critical patent/EP3399905A4/en
Publication of WO2017120138A1 publication Critical patent/WO2017120138A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B7/00Instruments for auscultation
    • A61B7/02Stethoscopes
    • A61B7/04Electric stethoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/318Heart-related electrical modalities, e.g. electrocardiography [ECG]
    • A61B5/339Displays specially adapted therefor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/04Arrangements of multiple sensors of the same type
    • A61B2562/046Arrangements of multiple sensors of the same type in a matrix array
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1102Ballistocardiography

Definitions

  • the embodiments herein relate generally to cardiac health monitoring and more particularly to analysis software combined with transducers to capture multi-channel vibration signals along with an electrocardiogram signal for the measurement of heart functions.
  • Heart disease is the leading cause of death accounting for more than one-third (33.6%) of all U.S. deaths. Overall cardiac health can be significantly improved by proper triage.
  • Low invasive and non-invasive ultrasound techniques e.g., echocardiogram
  • a physician can work with patients to perform a comprehensive evaluation and design a personalized plan of care aimed at keeping them healthy.
  • the cardiohemic system which consists of the heart walls, valves and blood, creates vibrations during each cardiac cycle.
  • the vibrations are the result of the acceleration and deceleration of blood due to abrupt mechanical opening and closing of the valves during the cardiac cycle.
  • the exemplary embodiments herein provide a method and system based on a technique of separating, identifying and marking the heart signals, to extract information contained in cardiac vibration objects.
  • Machine learning, auditory scene analysis, or spare coding are approaches to the source separation problem.
  • the techniques and methods herein are not limited to acoustic, electrical or vibrational data as might be used in some stethoscopes, but can also be applied to other forms of monitoring such as echo imaging or sonograms, magnetic resonance imaging (MRI), computed tomography (CT) scanning, positron emission tomography (PET) scanning, and monitoring using various forms of catheterization.
  • MRI magnetic resonance imaging
  • CT computed tomography
  • PET positron emission tomography
  • the techniques and methods herein are primarily applicable to monitoring of heart valve events, but can be alternatively applied to other types of involuntary biological signaling emanating from the brain, intrauterine, pre-natal contractions, or elsewhere within both humans and other species.
  • vibration objects are Mitral valve opening and closing, Aortic valve opening and closing, Pulmonary valve opening and closing, Tricuspid valve opening and closing, and heart wall motions.
  • a portion of the energy produced by these vibrations lies in the infra-sound range, which falls in the inaudible and low sensitivity human hearing range.
  • a portion of the energy produced by these vibrations falls in the audible hearing range.
  • the vibration objects from the Mitral, Tricuspid, Aortic, and Pulmonary valve openings fall in a lower range of vibrations such as 0 to 60 Hertz
  • vibration objects from the Mitral, Tricuspid, Aortic, and Pulmonary valve closings fall in a higher range of vibrations such as 50 to 150 Hertz.
  • Accelerometer transducers placed on the chest capture these vibrations from both these ranges. Data is obtained using a tri-axial accelerometer or multiple tri-axial accelerometers placed on different points of a torso of a subject.
  • Source separation analysis in accordance with the methods described herein extract individual vibration objects from the composite vibration signal captured on the surface.
  • the individual vibration signals are identified to be from the mitral valve, aortic valve, tricuspid valve, and the pulmonary valve during individual heart beats. Along with separating breathing sounds, and heart wall motion.
  • the identified valve signals are marked to indicate their start and end of the event with respect to the start of the electrocardiogram (EKG). This event corresponds to the opening and closing of each valve.
  • the individual vibration signals are identified to be from the mitral valve, aortic valve, tricuspid valve, the pulmonary valve, coronary artery, murmurs, third sound, fourth sound, respiratory sound, breathing, and snoring during individual heart beats.
  • FIG. 1A illustrates a system for the extraction, identification, marking and display of the heart valve signals in accordance with one embodiment
  • FIGs. IB & 1C illustrate a detailed view of the system for extraction, identification, marking & display of heart valve signals in accordance with one embodiment
  • FIG. 2 is a flowchart of a method in accordance with one embodiment
  • FIG. 3 illustrates multichannel signals captured from the sensor array on the chest shown in accordance with one embodiment
  • FIG. 4 illustrates a cardiac cycle in relation with Electrocardiogram, acoustic and accelerometer sensors in accordance with one embodiment
  • FIG. 5A illustrates the schematic of the source separation approach of extracting individual vibration objects or each valve into individual streams in accordance with one embodiment
  • FIG. 5B illustrates graphic representations of the basis and activations used for the source separation approach of FIG. 5A in accordance with one embodiment
  • FIG. 5C shows a convolutional version of a matching pursuit algorithm to infer the activation of a given set of basis functions for use in the source separation approach of FIG. 5A in accordance with one embodiment
  • FIG. 5D shows a K-SVD algorithm to refine a set of basis elements given the desired signal and a set of activations for use in the source separation approach of FIG. 5A in accordance with one embodiment
  • FIGs. 6A, 6B, and 6C illustrate the identification of vibration objects or each valve into individual streams in accordance with one embodiment.
  • FIGs. 7A and 7B illustrate the marking of vibration objects or each valve into individual streams in accordance with one embodiment.
  • the exemplary embodiments may be further understood with reference to the following description and the appended drawings, wherein like elements are referred to with the same reference numerals.
  • the exemplary embodiments describe a system and method of extraction, identification, marking and display of the heart valve signals.
  • psychoacoustics are considered in separating cardiac vibration signals captured through the transducers. The system, the psychoacoustics, and a related method will be discussed in further detail below.
  • the exemplary embodiments provide a novel approach for small, portable, robust, fast and configurable source separation based software with transducer hardware.
  • the use of the vibration signal pattern and novel psychoacoustics help bypass conventional issues faced by linear time invariant systems.
  • the signals of the biomechanical system show a high clinical relevance when auscultated on the chest.
  • the heart and lung sounds are applied to the diagnosis of cardiac and respiratory disturbances, whereas the snoring sounds have been acknowledged as important symptoms of the airway obstruction.
  • the innovation here provides extraction of all three types of body sounds from the composite vibration captured at the skin.
  • the exemplary embodiments of the system and method proposed here for source separation can use the composite signal capture via different transducers not limited to accelerometer, acoustic, or piezoelectric 102. Any of these act as an electro-acoustic converter to establish a body sound for processing.
  • the source separation provides the capability to extract signals while operating in a medium that is non-linear and time variant.
  • a system 100 is an embedded platform which can be any smart processing platform with digital signal processing capabilities, application processor, data storage, display, input modality like touch-screen or keypad, microphones, speaker, Bluetooth, and connection to the internet via WAN, Wi-Fi, Ethernet or USB or other wireless or wired connection.
  • This embodies custom embedded hardware, smartphone, iPad-like and iPod-like devices.
  • Area 101 in FIGs. 1A and IB represents the auditory scene at the chest locations.
  • a transducer array 102 captures the heart signal.
  • the transducer array 102 includes vibration sensors such as accelerometers.
  • the transducer array includes a pad that includes a vibration sensor such as a vibration sensor 102b and an electrode 102a for an ECG sensor.
  • the transducer array can include a single pad, two pads as shown in FIG. IB or more than two pads as shown in FIG. 1C.
  • a transducer array 110 includes three pads ( 102) where each pad includes the vibration sensor 102b and the ECG electronic 102a.
  • Other embodiments can include three or more pads where each pad would have at least a vibration sensor and optionally an electrode for the ECG sensor.
  • a wearable microprocessor hardware module 103 can include digital signal processing capabilities, application processor, Analog to digital frontend, data storage, input modality like buttons, and wired or wireless connection via Bluetooth, Bluetooth low energy, near field communication transceiver, Wi-Fi, Ethernet or USB.
  • the module 103 comprises of the signal processing module 112 on the wearable microprocessor hardware module 103 that captures synchronized sensor data from the transducer array 102. The module saves the captured synchronized sensor data to memory and communicates with the system 100 for data transfer.
  • a module 105 communicatively coupled to the module 103 can calculate vital signs from the input sensor stream coming from the module 103 for the Heart rate, breathing rate, EKG signal, skin temperature, and associated vitals.
  • the module 105 can encrypt the raw sensor data for transmission to a cloud computing module 106.
  • the module 105 also communicates with a dashboard on 106 for data exchange, login, alerts, notifications, display of processed data.
  • Module 106 in Figure 1 serves as the cloud module that processes the individual streams for eventual source separation, identification and marking of the heart valve signals.
  • the system 100 i allows a user to visually see the individual streams and information from the heart valves and in some embodiments the system could present streams or information on a connected display or any other modality of display.
  • the transducer array 102 can include multiple sensor transducers that capture the composite signal that includes the electrocardiogram signals, heart sounds, lung sounds and snoring sounds for example.
  • the module 103 can be in the form of wearable hardware that synchronously collects the signals across the transducers and is responsible for the analog to digital conversion, storage and transmission to a portable unit 104. Note that the embodiments herein are not limited to processing the individual streams for source separation, identification and marking of the heart valve signals at the cloud computing module 106 only. Given sufficient processing power, the aforementioned processing can occur at the microprocessor hardware module 103, at the module 105, or at the cloud- computing module 106, or such processing can be distributed among such modules 103, 105, or 106.
  • Block 201 indicates the separation of sources from the composite signals which is done by source estimation using, for example, machine learning, auditory scene analysis, or sparse coding.
  • Block 202 represents the phase estimation between the separated sources at each of the sensor positions.
  • Block 203 represents calculating the time stamps of individual sources at each heartbeat with respect to the synchronized EKG signal and the other sensor or sensors.
  • Block 204 represents the source identification module responsible for tagging each of the separated source in individual heart beats to be one of the heart valve event, namely the Mitral valve closing and opening, the Tricuspid valve closing and opening, the Aortic valve opening and closing, and the Pulmonic valve opening and closing.
  • Block 205 represents the time marking module to estimate the time of occurrence of the above-mentioned valve events with respect to the start of the EKG signal.
  • FIG. 3 The exemplary embodiments of the system and method proposed here for the source extraction, identification, and marking of the heart valve signals from a composite signal 300 are shown in FIG. 3. Area(s) 301 illustrated in FIG. 3 indicates the locations at which the composite heart signal can be captured.
  • a vibration signal 302 as charted on the first line of FIG.
  • a vibration signal 303 represents a signal captured at the pulmonic auscultation location.
  • a vibration signal 304 represents a signal captured at the tricuspid auscultation location.
  • a vibration signal 305 represents a signal captured at the mitral auscultation location.
  • the last or bottom line in FIG. 3 represents an electrocardiogram signal 306 captured.
  • the number of sensors used (such as in the sensor array 102 of FIG.1), are less than the number of vibration sources.
  • 3 sensors can be used to ultimately extract signals for 4 (or more) vibration sources; or 2 sensors can be used to ultimately extract signals for 3 or 4 (or more) vibration sources; or 1 sensor can be used to ultimately extract signals for 2, or 3, or 4 (or more) vibration sources.
  • a timeline chart 400 in FIG. 4 shows a cardiac cycle.
  • Lines or signals 401a, 401b, and 401c represent or indicate the pressure changes during a cardiac cycle for aortic pressure (401a), atrial pressure (401b) and ventricular pressure (401c) measured in measured in millimeters of mercury (mmHg).
  • Line or signal 402 represents or indicates the volume changes during a cardiac cycle in milliliters (ml).
  • Line or signal 403 represents or indicates the electrical changes during a cardiac cycle captured by an electrocardiogram.
  • Line or signal 404 represents or indicates the acoustic changes during a cardiac cycle captured by an acoustic sensor such as in a phonocardiogram or PCG.
  • S I represents the first heart sound or the "lub" sound and the S2 represents the second heart sound or "dub" sound.
  • Line or signal 405 represents or indicates the vibration changes during a cardiac cycle captured by an accelerometer transducer at the location of our device.
  • Pattern 406 indicates the different valve opening and closing seen in line or signal 405 as captured by the accelerometer sensor or sensors.
  • a closer inspection of the pattern 406 reveals the closing of the mitral valve (Ml) and tricuspid valve (Tl) during the S I or first heart sound and the closing of the aortic valve (A2) and pulmonary valve (P2).
  • the bottom half of FIG. 4 goes on to further show a representation of the anatomy of the human heart relevant for the generation of the sounds and a corresponding graph representing the sounds belonging to coronary artery, murmurs, first sound, second sound, third sound, fourth sound, ejection sounds, opening sounds, respiratory sound, breathing, and snoring during individual heart beats, with respect to the electrocardiogram signal.
  • the left and right ventricles subsequently fill up with blood and during S2 the aortic valve and pulmonary valves each open and close in quick succession as blood is pumped towards the aorta and pulmonary artery respectively.
  • the first heart sound (SI) when recorded by a high-resolution phonocardiography (PCG) can consist of 5 sequential components that first includes small low frequency vibrations, usually inaudible, that coincide with the beginning of left ventricular contraction, second, includes a large high- frequency vibration, easily audible related to mitral valve closure (Ml), third, includes a second high frequency component closely following Ml and related to tricuspid valve closure Tl, fourth, SI includes small frequency vibrations that coincide with the acceleration of blood into the great vessel at the time of aortic valve opening AO, and fifth, SI includes small frequency vibrations that coincide with the acceleration of blood into the great vessel at the time of pulmonic valve opening PO.
  • the two major audible components are the louder Ml best heard at the apex followed by Tl heard best at the left lower sternal border. They are separated by only 20-30ms and at the apex are only appreciated as a single sound in the normal subject as the aforementioned "Lub”.
  • the second heart sound (S2) have two major components A2 and the P2 are coincident with the incisura of the aorta and pulmonary artery pressure trace, respectively, and terminate the right and left ventricular ejection periods.
  • Right ventricular ejection begins prior to left ventricular ejection, has a longer duration, and terminates after left ventricular ejection, resulting in P2 normally occurring after the A2 as shown in the pattern 406.
  • the first high-frequency component of both A2 and P2 is coincident with the completion of closure of the aortic and pulmonary valve leaflets.
  • A2 and P2 are not due to the clapping together of the valve leaflets but are produced by the sudden deceleration of retrograde flow of the blood column in the aorta and pulmonary artery when the elastic limits of the tensed leaflets are met. This abrupt deceleration of flow sets the cardio hemicsystem in vibration.
  • the higher frequency components result in A2 and P2.
  • S2 includes small frequency vibrations that coincide with the acceleration of blood into the left ventrical at the time of mitral valve opening MO
  • S2 includes small frequency vibrations that coincide with the acceleration of blood into the right ventrical at the time of tricuspid valve opening TO.
  • the exemplary embodiments of the system and accompanying method proposed herein provide a source separation analysis algorithm that allows for the separation of the vibrations from the cardiohemic system as illustrated in the system 500 of FIG. 5A and corresponding chart cluster 510 of FIG. 5B.
  • One of the proposed embodiments uses a separation algorithm via a two stage process. First, the signals such as multichannel signals 501 are decomposed using sparse coding 502 into components that appear sparsely across a time chart 503 and further provide sparse activation patterns 504. Then, cluster analysis 505 on the sparse activation patterns 504 is performed. Time locations of activations patterns that are clustered together get assigned to the same source as shown in timeline 509.
  • Method 500 depicts the steps involved in the process.
  • the boxes 502, 505, and 508 are considered computational modules and the boxes 501, 503 , 504, 506 and 509 denote data which is either input or output to each module.
  • K-SVD is a dictionary learning algorithm for creating a dictionary for sparse representations, via a singular value decomposition approach.
  • K-SVD is a generalization of the k-means clustering method, and it works by iteratively alternating between sparse coding the input data based on the current dictionary, and updating the atoms in the dictionary to better fit the data.
  • For clustering employment of a k-means algorithm on a set of altered activation patterns can be used.
  • the pseudo code for the matching pursuit algorithm is shown in 506 and the pseudo code for the KSVD is shown in 507.
  • the embodiments can include different source separation techniques specifically used for extracting the valve heart signals for application in a non-linear time variant system, where the number of sensors is less than the number of sources, such as, Determined Models, Principal Component Analysis (PCA), Independent Component Analysis ICA, Singular Value Decomposition (SVD), Bin-wise Clustering and Permutation posterior probability Alignment, Undetermined Models, Sparseness condition, Dictionary learning, Convolutive models, and K-SVD Matching Pursuit.
  • PCA Principal Component Analysis
  • ICA Independent Component Analysis
  • SVD Singular Value Decomposition
  • Bin-wise Clustering and Permutation posterior probability Alignment Undetermined Models, Sparseness condition, Dictionary learning, Convolutive models, and K-SVD Matching Pursuit.
  • the exemplary embodiments of the system and method proposed here provide a source identification algorithm for the vibrations from the cardiohemic system.
  • FIG. 6A in order to find the time stamps for events such as Mitral closing & opening, Tricuspid closing & opening, Aortic opening & closing, Pulmonic opening & closing, we look at all individual source separated (SS) signals 601 to 606 of a composite signal 607 & first try to find the location of max peak in the SS signal for each source and then find delay between two channels.
  • the chart 608 of FIG. 6B shows the frequency spectrum of the corresponding source separated signals.
  • Cross correlated vibrations in aortic and pulmonic channels for each interval for each source are calculated to find a consistent delay between two channels as represented by chart 609 of FIG. 6C.
  • QRS complex indicator of ventricular depolarization triggered by contraction of the ventricles
  • the vibration(s) within this interval is cross correlated with all vibrations in each source. This is done for both aortic & pulmonic channels.
  • PCA was applied to find timing information and delay between two channels.
  • PCA uses SS signal from each source in each channel to find the template which represents a majority of the vibrations within that source.
  • the template is then cross correlated with the whole source and a maximum of PCA signal in each interval is found and compared with the start of QRS.
  • SS signals from two channels but the same source are fed into PCA to find the template.
  • an aortic template is used for both channels' cross correlation to identify the different vibrations into valve events, breathing sounds, and vibrations of the heart walls.
  • the exemplary embodiments of the system and method proposed here provide a source marking algorithm for the vibrations from the cardiohemic system.
  • Next step is to use PCA to determine which source is associated with which event (Mitral closing & opening, Tricuspid closing & opening, Aortic opening & closing, Pulmonic opening and closing).
  • the following is a description of the architecture for automatic source tagging and timing of valvular events.
  • One way to identify which events are relevant to a source is by manually tagging the sources against the synchronized EKG signal and taking advantage of the timings relative to the QRS wave (identification of the S I and S2 sounds using the EKG signal as the reference has been widely researched in studies).
  • Another approach is an automatic tagging algorithm.
  • the tagging is composed of a classifier preceded by a feature extraction algorithm.
  • a feature extraction algorithm For the timing, we exploit the computations of one of the feature extraction algorithms to obtain an energy contour from which the time location of a given event can be inferred. Because our work builds upon having the ability to capture the signal at different locations simultaneously, we want to exploit the relations among channels to extract additional information about the sources. Likewise some source separation algorithms where channel relations are associated with location, the embodiments herein can leverage on the intrinsic relations among the channels to extract relevant information that helps distinguish among the events. In some embodiments, a system or method can hypothesize that phase information between channels is relevant for distinguishing among cardiac events since valves are located at different positions within the heart.
  • the exemplary embodiments of the system and method proposed here provide a source marking algorithm that allows from the explanation earlier for the marking of the Mitral valve closing (MC), Mitral valve opening (MO), Aortic valve opening (AO), Aortic valve closing (AC), Tricuspid valve closing (TC), Tricuspid valve opening (TO), Pulmonary valve closing (PC) and Pulmonary valve opening (PO) signals.
  • the extracted individual valve vibration objects are aligned into a signal for each of the four valves across multiple heart beats.
  • the chart 700 in FIG. 7A shows the source separation of heart valve opening and closing signals.
  • Line 701 indicates the length or duration of the vibration signal for the Mitral valve closing (Ml).
  • Line 702 indicates the length or duration of the vibration signal for the Tricuspid valve closing (T l).
  • Line 703 indicates the length or duration of the vibration signal for the Aortic valve closing (A2).
  • Line 704 indicates length or duration of the vibration signal for the Pulmonic valve closing (P2).
  • Signal 705 indicates the composite vibration signal captured by a particular transducer.
  • Signal 706 indicates the EKG signal captured by the system.
  • the Line 707 indicates the length or duration of the vibration of the Aortic valve opening (AO).
  • Line 708 indicates the length or duration of the vibration of the Pulmonic valve opening (PO).
  • the lines or signals 709 in FIG. 7A or 711 in FIG. 7B are actually several separated superimposed signals representing the vibration signals from separate sources coming from the mitral valve, tricuspid valve, aortic valve, and pulmonary valve (using less than 4 vibration sensors to extract such separated signals in some embodiments).
  • various novel ways of source separating individual heart vibration events from the composite vibration objects captured via multiple transducers can work on a single package that is embodied by an easy-to-use and portable device.
  • more complicated embodiments using the techniques described herein can use visual sensors, endoscopy cameras, ultrasound sensors, MRI, CT, PET, EEG and other scanning methods alone or in combination such that the monitoring techniques enable improvement in terms of source separation or identification, and/or marking of events such as heart valve openings, brain spikes, contractions, or even peristaltic movements or vibrations.
  • the focus of the embodiments herein are for non-invasive applications, the techniques are not limited to such non-invasive monitoring.
  • the techniques ultimately enable diagnosticians to better identify or associate or correlate detected vibrations or signaling with specific biological events (such as heart valve openings and closings, brain spikes, fetal signals, or pre-natal contractions.)
  • the exemplary embodiments develop novel methods of source identification, which in one embodiment uses the Pulmonary and Aortic auscultation locations, and in addition possibly the Tricuspid and Mitral auscultation locations, enabling the system to identify individual valve events from the vibrations.
  • novel methods of source marking can use the Pulmonary and Aortic auscultation locations, and in addition possibly the Tricuspid and Mitral auscultation locations, enabling the time marking of the occurrence of the individual valve events with respect to the electrocardiogram.
  • Such a system capable and suitable of measuring cardiac time intervals in a simple and non-invasive fashion.
  • Other exemplary embodiments provide tracking of individual valve signals over time. Such novel methods allow for both short-term and long-term discrimination between signals. Short-term pertains to tracking individual stream when they are captured simultaneously as part of the composite signal. Long-term tracking pertains to tracking individual streams across multiple heart beats, tracking valve signals as they transition in and out during each cardiac cycle.
  • Some of the exemplary embodiments of a system and method described herein includes an embedded hardware system, the main elements to capture body sounds that can include a sensor unit that captures the body sounds, performs digitization, and further digital processing of the body sounds for noise reduction, filtering and amplification.

Abstract

A system (100) for monitoring and diagnosing heart conditions includes a sensor array (102) with accelerometers, an electrocardiogram sensor, and a system to synchronously capture and process (103, 105, or 106) composite heart signals. The system performs separation, identification and marking (201-205 or 501-509) of the signals, to extract information in cardiac vibrations. Machine learning, auditory scene analysis, or spare coding approaches can be used to resolve source separation problems. Analysis of the composite signals separates different vibration signals (302, 303, 304, 305), identifies streams for particular valve signal, and marks them with event time information with respect to a synchronous electrocardiogram signal (306). The psychoacoustic analysis mimics human auditory processing to enhance hearing of heart valve sounds by separating valve vibrations from the composite signal, and providing extraction, identification, marking and display of individual valve signals.

Description

System and method of extraction, identification, marking and display of the heart valve signals
Cross Reference To Related Applications
[ 0001 ] This Application claims the priority benefit of US Provisional No 62274761, 62274763, and 62274770, each of which were filed on January 4, 2016, the entire disclosure of each are incorporated herein by reference.
Field
[ 0002 ] The embodiments herein relate generally to cardiac health monitoring and more particularly to analysis software combined with transducers to capture multi-channel vibration signals along with an electrocardiogram signal for the measurement of heart functions.
Background
[ 0003 ] Heart disease is the leading cause of death accounting for more than one-third (33.6%) of all U.S. deaths. Overall cardiac health can be significantly improved by proper triage. Low invasive and non-invasive ultrasound techniques (e.g., echocardiogram) are standard procedures, but the requirement of expensive devices and skilled operators limit their applicability. The following are the various types of heart disease that can be diagnosed and treated using the separated signal, namely, Coronary artery disease, Heart murmurs and valve abnormalities, Heart failure, Heart rhythm abnormalities (arrhythmias), Vascular disease, congenital heart disease, Cardiac resynchronization and Risk factor modification. A physician can work with patients to perform a comprehensive evaluation and design a personalized plan of care aimed at keeping them healthy.
[ 0004 ] The cardiohemic system which consists of the heart walls, valves and blood, creates vibrations during each cardiac cycle. The vibrations are the result of the acceleration and deceleration of blood due to abrupt mechanical opening and closing of the valves during the cardiac cycle.
Summary
[ 0005 ] The exemplary embodiments herein provide a method and system based on a technique of separating, identifying and marking the heart signals, to extract information contained in cardiac vibration objects. Machine learning, auditory scene analysis, or spare coding are approaches to the source separation problem. Further note that the techniques and methods herein are not limited to acoustic, electrical or vibrational data as might be used in some stethoscopes, but can also be applied to other forms of monitoring such as echo imaging or sonograms, magnetic resonance imaging (MRI), computed tomography (CT) scanning, positron emission tomography (PET) scanning, and monitoring using various forms of catheterization. The techniques and methods herein are primarily applicable to monitoring of heart valve events, but can be alternatively applied to other types of involuntary biological signaling emanating from the brain, intrauterine, pre-natal contractions, or elsewhere within both humans and other species.
[ 0006 ] Examples of vibration objects are Mitral valve opening and closing, Aortic valve opening and closing, Pulmonary valve opening and closing, Tricuspid valve opening and closing, and heart wall motions. A portion of the energy produced by these vibrations lies in the infra-sound range, which falls in the inaudible and low sensitivity human hearing range. A portion of the energy produced by these vibrations falls in the audible hearing range. For example, the vibration objects from the Mitral, Tricuspid, Aortic, and Pulmonary valve openings fall in a lower range of vibrations such as 0 to 60 Hertz, whereas vibration objects from the Mitral, Tricuspid, Aortic, and Pulmonary valve closings fall in a higher range of vibrations such as 50 to 150 Hertz. Accelerometer transducers placed on the chest capture these vibrations from both these ranges. Data is obtained using a tri-axial accelerometer or multiple tri-axial accelerometers placed on different points of a torso of a subject.
[ 0007 ] Source separation analysis in accordance with the methods described herein extract individual vibration objects from the composite vibration signal captured on the surface. The individual vibration signals are identified to be from the mitral valve, aortic valve, tricuspid valve, and the pulmonary valve during individual heart beats. Along with separating breathing sounds, and heart wall motion. The identified valve signals are marked to indicate their start and end of the event with respect to the start of the electrocardiogram (EKG). This event corresponds to the opening and closing of each valve. The individual vibration signals are identified to be from the mitral valve, aortic valve, tricuspid valve, the pulmonary valve, coronary artery, murmurs, third sound, fourth sound, respiratory sound, breathing, and snoring during individual heart beats.
Description of the Drawings
[ 0008 ] FIG. 1A illustrates a system for the extraction, identification, marking and display of the heart valve signals in accordance with one embodiment;
[ 0009 ] FIGs. IB & 1C illustrate a detailed view of the system for extraction, identification, marking & display of heart valve signals in accordance with one embodiment;
[ 00010 ] FIG. 2 is a flowchart of a method in accordance with one embodiment; [ 00011 ] FIG. 3 illustrates multichannel signals captured from the sensor array on the chest shown in accordance with one embodiment;
[ 00012 ] FIG. 4 illustrates a cardiac cycle in relation with Electrocardiogram, acoustic and accelerometer sensors in accordance with one embodiment;
[ 00013 ] FIG. 5A illustrates the schematic of the source separation approach of extracting individual vibration objects or each valve into individual streams in accordance with one embodiment;
[ 00014 ] FIG. 5B illustrates graphic representations of the basis and activations used for the source separation approach of FIG. 5A in accordance with one embodiment;
[ 00015 ] FIG. 5C shows a convolutional version of a matching pursuit algorithm to infer the activation of a given set of basis functions for use in the source separation approach of FIG. 5A in accordance with one embodiment;
[ 0001 6 ] FIG. 5D shows a K-SVD algorithm to refine a set of basis elements given the desired signal and a set of activations for use in the source separation approach of FIG. 5A in accordance with one embodiment;
[ 00017 ] FIGs. 6A, 6B, and 6C illustrate the identification of vibration objects or each valve into individual streams in accordance with one embodiment.
[ 00018 ] FIGs. 7A and 7B illustrate the marking of vibration objects or each valve into individual streams in accordance with one embodiment.
Detailed Description
[ 00019 ] The exemplary embodiments may be further understood with reference to the following description and the appended drawings, wherein like elements are referred to with the same reference numerals. The exemplary embodiments describe a system and method of extraction, identification, marking and display of the heart valve signals. Specifically, psychoacoustics are considered in separating cardiac vibration signals captured through the transducers. The system, the psychoacoustics, and a related method will be discussed in further detail below.
[ 00020 ] The exemplary embodiments provide a novel approach for small, portable, robust, fast and configurable source separation based software with transducer hardware. The use of the vibration signal pattern and novel psychoacoustics help bypass conventional issues faced by linear time invariant systems.
[ 00021 ] The signals of the biomechanical system show a high clinical relevance when auscultated on the chest. The heart and lung sounds are applied to the diagnosis of cardiac and respiratory disturbances, whereas the snoring sounds have been acknowledged as important symptoms of the airway obstruction. The innovation here provides extraction of all three types of body sounds from the composite vibration captured at the skin. The exemplary embodiments of the system and method proposed here for source separation can use the composite signal capture via different transducers not limited to accelerometer, acoustic, or piezoelectric 102. Any of these act as an electro-acoustic converter to establish a body sound for processing. The source separation provides the capability to extract signals while operating in a medium that is non-linear and time variant.
[ 00022 ] The exemplary embodiments of the system and method proposed here are shown in FIGs. 1A, IB and 1C. A system 100 is an embedded platform which can be any smart processing platform with digital signal processing capabilities, application processor, data storage, display, input modality like touch-screen or keypad, microphones, speaker, Bluetooth, and connection to the internet via WAN, Wi-Fi, Ethernet or USB or other wireless or wired connection. This embodies custom embedded hardware, smartphone, iPad-like and iPod-like devices. Area 101 in FIGs. 1A and IB represents the auditory scene at the chest locations. A transducer array 102 captures the heart signal. In some embodiments, the transducer array 102 includes vibration sensors such as accelerometers. In some embodiments, the transducer array includes a pad that includes a vibration sensor such as a vibration sensor 102b and an electrode 102a for an ECG sensor. In some embodiments, the transducer array can include a single pad, two pads as shown in FIG. IB or more than two pads as shown in FIG. 1C. In the particular embodiment of FIG. 1C, a transducer array 110 includes three pads ( 102) where each pad includes the vibration sensor 102b and the ECG electronic 102a. Other embodiments can include three or more pads where each pad would have at least a vibration sensor and optionally an electrode for the ECG sensor. A wearable microprocessor hardware module 103 can include digital signal processing capabilities, application processor, Analog to digital frontend, data storage, input modality like buttons, and wired or wireless connection via Bluetooth, Bluetooth low energy, near field communication transceiver, Wi-Fi, Ethernet or USB. The module 103 comprises of the signal processing module 112 on the wearable microprocessor hardware module 103 that captures synchronized sensor data from the transducer array 102. The module saves the captured synchronized sensor data to memory and communicates with the system 100 for data transfer. A module 105 communicatively coupled to the module 103 can calculate vital signs from the input sensor stream coming from the module 103 for the Heart rate, breathing rate, EKG signal, skin temperature, and associated vitals. The module 105 can encrypt the raw sensor data for transmission to a cloud computing module 106. The module 105 also communicates with a dashboard on 106 for data exchange, login, alerts, notifications, display of processed data. Module 106 in Figure 1 serves as the cloud module that processes the individual streams for eventual source separation, identification and marking of the heart valve signals. In some embodiments, the system 100 i allows a user to visually see the individual streams and information from the heart valves and in some embodiments the system could present streams or information on a connected display or any other modality of display. The transducer array 102 can include multiple sensor transducers that capture the composite signal that includes the electrocardiogram signals, heart sounds, lung sounds and snoring sounds for example. The module 103 can be in the form of wearable hardware that synchronously collects the signals across the transducers and is responsible for the analog to digital conversion, storage and transmission to a portable unit 104. Note that the embodiments herein are not limited to processing the individual streams for source separation, identification and marking of the heart valve signals at the cloud computing module 106 only. Given sufficient processing power, the aforementioned processing can occur at the microprocessor hardware module 103, at the module 105, or at the cloud- computing module 106, or such processing can be distributed among such modules 103, 105, or 106.
[ 00023 ] The exemplary embodiments of the system 200 and method proposed here for the source extraction, identification, and marking of the heart valve signals are shown in Figure 2. Block 201 indicates the separation of sources from the composite signals which is done by source estimation using, for example, machine learning, auditory scene analysis, or sparse coding. Block 202 represents the phase estimation between the separated sources at each of the sensor positions. Block 203 represents calculating the time stamps of individual sources at each heartbeat with respect to the synchronized EKG signal and the other sensor or sensors. Block 204 represents the source identification module responsible for tagging each of the separated source in individual heart beats to be one of the heart valve event, namely the Mitral valve closing and opening, the Tricuspid valve closing and opening, the Aortic valve opening and closing, and the Pulmonic valve opening and closing. Block 205 represents the time marking module to estimate the time of occurrence of the above-mentioned valve events with respect to the start of the EKG signal. [ 00024 ] The exemplary embodiments of the system and method proposed here for the source extraction, identification, and marking of the heart valve signals from a composite signal 300 are shown in FIG. 3. Area(s) 301 illustrated in FIG. 3 indicates the locations at which the composite heart signal can be captured. A vibration signal 302 as charted on the first line of FIG. 3 represents a signal captured at the aortic auscultation location. A vibration signal 303 represents a signal captured at the pulmonic auscultation location. A vibration signal 304 represents a signal captured at the tricuspid auscultation location. A vibration signal 305 represents a signal captured at the mitral auscultation location. The last or bottom line in FIG. 3 represents an electrocardiogram signal 306 captured. In some embodiments, note that the number of sensors used (such as in the sensor array 102 of FIG.1), are less than the number of vibration sources. For example, 3 sensors can be used to ultimately extract signals for 4 (or more) vibration sources; or 2 sensors can be used to ultimately extract signals for 3 or 4 (or more) vibration sources; or 1 sensor can be used to ultimately extract signals for 2, or 3, or 4 (or more) vibration sources.
[ 00025 ] The exemplary embodiments of the system and method proposed here draw inspirations from biology with respect to the cardiac cycle in-relation with electrocardiogram and accelerometer transducer captured cardiac signal. A timeline chart 400 in FIG. 4 shows a cardiac cycle. Lines or signals 401a, 401b, and 401c represent or indicate the pressure changes during a cardiac cycle for aortic pressure (401a), atrial pressure (401b) and ventricular pressure (401c) measured in measured in millimeters of mercury (mmHg). Line or signal 402 represents or indicates the volume changes during a cardiac cycle in milliliters (ml). Line or signal 403 represents or indicates the electrical changes during a cardiac cycle captured by an electrocardiogram. Line or signal 404 represents or indicates the acoustic changes during a cardiac cycle captured by an acoustic sensor such as in a phonocardiogram or PCG. S I represents the first heart sound or the "lub" sound and the S2 represents the second heart sound or "dub" sound. Line or signal 405 represents or indicates the vibration changes during a cardiac cycle captured by an accelerometer transducer at the location of our device. Pattern 406 indicates the different valve opening and closing seen in line or signal 405 as captured by the accelerometer sensor or sensors. More specifically, a closer inspection of the pattern 406 reveals the closing of the mitral valve (Ml) and tricuspid valve (Tl) during the S I or first heart sound and the closing of the aortic valve (A2) and pulmonary valve (P2). The bottom half of FIG. 4, goes on to further show a representation of the anatomy of the human heart relevant for the generation of the sounds and a corresponding graph representing the sounds belonging to coronary artery, murmurs, first sound, second sound, third sound, fourth sound, ejection sounds, opening sounds, respiratory sound, breathing, and snoring during individual heart beats, with respect to the electrocardiogram signal. Briefly, during SI, blood flows in from the pulmonary veins and fills the left atrium and causes the mitral valve to temporarily (open and close) provide access to the left ventricle while almost simultaneously the blood from the superior vena cava fills the right atrium and causes the tricuspid valve to temporarily (open and close) provide access to the right ventricle. The left and right ventricles subsequently fill up with blood and during S2 the aortic valve and pulmonary valves each open and close in quick succession as blood is pumped towards the aorta and pulmonary artery respectively. The first heart sound (SI) when recorded by a high-resolution phonocardiography (PCG) can consist of 5 sequential components that first includes small low frequency vibrations, usually inaudible, that coincide with the beginning of left ventricular contraction, second, includes a large high- frequency vibration, easily audible related to mitral valve closure (Ml), third, includes a second high frequency component closely following Ml and related to tricuspid valve closure Tl, fourth, SI includes small frequency vibrations that coincide with the acceleration of blood into the great vessel at the time of aortic valve opening AO, and fifth, SI includes small frequency vibrations that coincide with the acceleration of blood into the great vessel at the time of pulmonic valve opening PO. The two major audible components are the louder Ml best heard at the apex followed by Tl heard best at the left lower sternal border. They are separated by only 20-30ms and at the apex are only appreciated as a single sound in the normal subject as the aforementioned "Lub". The second heart sound (S2) have two major components A2 and the P2 are coincident with the incisura of the aorta and pulmonary artery pressure trace, respectively, and terminate the right and left ventricular ejection periods. Right ventricular ejection begins prior to left ventricular ejection, has a longer duration, and terminates after left ventricular ejection, resulting in P2 normally occurring after the A2 as shown in the pattern 406. The first high-frequency component of both A2 and P2 is coincident with the completion of closure of the aortic and pulmonary valve leaflets. As with sounds arising from the AV valves, A2 and P2 are not due to the clapping together of the valve leaflets but are produced by the sudden deceleration of retrograde flow of the blood column in the aorta and pulmonary artery when the elastic limits of the tensed leaflets are met. This abrupt deceleration of flow sets the cardio hemicsystem in vibration. The higher frequency components result in A2 and P2. Followed by the A2 and P2 are the vibrations associated with the valve openings. S2 includes small frequency vibrations that coincide with the acceleration of blood into the left ventrical at the time of mitral valve opening MO, and S2 includes small frequency vibrations that coincide with the acceleration of blood into the right ventrical at the time of tricuspid valve opening TO.
[ 0002 6 ] The exemplary embodiments of the system and accompanying method proposed herein provide a source separation analysis algorithm that allows for the separation of the vibrations from the cardiohemic system as illustrated in the system 500 of FIG. 5A and corresponding chart cluster 510 of FIG. 5B. One of the proposed embodiments uses a separation algorithm via a two stage process. First, the signals such as multichannel signals 501 are decomposed using sparse coding 502 into components that appear sparsely across a time chart 503 and further provide sparse activation patterns 504. Then, cluster analysis 505 on the sparse activation patterns 504 is performed. Time locations of activations patterns that are clustered together get assigned to the same source as shown in timeline 509. Finally, activations assigned to the same cluster using an activation mask 506 and multiplier 507 are used along with the basis elements (504) to recompose the sources as the source composition 508. Estimated sources 509 can be determined or extracted from the source composition 508. Method 500 depicts the steps involved in the process. The boxes 502, 505, and 508 are considered computational modules and the boxes 501, 503 , 504, 506 and 509 denote data which is either input or output to each module. In one implementation as shown in the algorithm 520 of FIG. 5C, we used a convolutional version of the matching pursuit algorithm to infer the activation of a given set of basis functions, and the K-SVD algorithm 530 of FIG. 5D to refine a set of basis elements given the desired signal and a set of activations. In applied mathematics, K-SVD is a dictionary learning algorithm for creating a dictionary for sparse representations, via a singular value decomposition approach. K-SVD is a generalization of the k-means clustering method, and it works by iteratively alternating between sparse coding the input data based on the current dictionary, and updating the atoms in the dictionary to better fit the data. For clustering, employment of a k-means algorithm on a set of altered activation patterns can be used. The pseudo code for the matching pursuit algorithm is shown in 506 and the pseudo code for the KSVD is shown in 507. The embodiments can include different source separation techniques specifically used for extracting the valve heart signals for application in a non-linear time variant system, where the number of sensors is less than the number of sources, such as, Determined Models, Principal Component Analysis (PCA), Independent Component Analysis ICA, Singular Value Decomposition (SVD), Bin-wise Clustering and Permutation posterior probability Alignment, Undetermined Models, Sparseness condition, Dictionary learning, Convolutive models, and K-SVD Matching Pursuit.
[ 00027 ] The exemplary embodiments of the system and method proposed here provide a source identification algorithm for the vibrations from the cardiohemic system. Referring to FIG. 6A, in order to find the time stamps for events such as Mitral closing & opening, Tricuspid closing & opening, Aortic opening & closing, Pulmonic opening & closing, we look at all individual source separated (SS) signals 601 to 606 of a composite signal 607 & first try to find the location of max peak in the SS signal for each source and then find delay between two channels. The chart 608 of FIG. 6B shows the frequency spectrum of the corresponding source separated signals. Cross correlated vibrations in aortic and pulmonic channels for each interval for each source are calculated to find a consistent delay between two channels as represented by chart 609 of FIG. 6C. Given the start of a QRS complex (indicative of ventricular depolarization triggered by contraction of the ventricles) and end point of each vibration, the vibration(s) within this interval is cross correlated with all vibrations in each source. This is done for both aortic & pulmonic channels. At the end, PCA was applied to find timing information and delay between two channels. PCA uses SS signal from each source in each channel to find the template which represents a majority of the vibrations within that source. The template is then cross correlated with the whole source and a maximum of PCA signal in each interval is found and compared with the start of QRS. In another implementation, In the second attempt, SS signals from two channels but the same source are fed into PCA to find the template. Then an aortic template is used for both channels' cross correlation to identify the different vibrations into valve events, breathing sounds, and vibrations of the heart walls. To accurately estimate Ml, Tl, A2, P2, AO, P0 from the frequency signal captured by the digital accelerometer on the wearable microprocessor hardware module, several sub-frequencies are considered. Some are noted here for example: 0-30Hz, 0-60Hz, 30- 150hz, 30-250Hz.
[ 0002 8 ] The exemplary embodiments of the system and method proposed here provide a source marking algorithm for the vibrations from the cardiohemic system. Next step is to use PCA to determine which source is associated with which event (Mitral closing & opening, Tricuspid closing & opening, Aortic opening & closing, Pulmonic opening and closing). The following is a description of the architecture for automatic source tagging and timing of valvular events. One way to identify which events are relevant to a source is by manually tagging the sources against the synchronized EKG signal and taking advantage of the timings relative to the QRS wave (identification of the S I and S2 sounds using the EKG signal as the reference has been widely researched in studies). Another approach is an automatic tagging algorithm. The tagging is composed of a classifier preceded by a feature extraction algorithm. For the timing, we exploit the computations of one of the feature extraction algorithms to obtain an energy contour from which the time location of a given event can be inferred. Because our work builds upon having the ability to capture the signal at different locations simultaneously, we want to exploit the relations among channels to extract additional information about the sources. Likewise some source separation algorithms where channel relations are associated with location, the embodiments herein can leverage on the intrinsic relations among the channels to extract relevant information that helps distinguish among the events. In some embodiments, a system or method can hypothesize that phase information between channels is relevant for distinguishing among cardiac events since valves are located at different positions within the heart. Perhaps, one of the most distinctive features of the cardiac events is their relative order of occurrence, which repeats periodically with each heartbeat. Time information extracted from the set of sources can be utilized to localize the occurrence of each source signal within the heart cycle. Therefore, the features proposed here are conceived to provide three aspects: 1) Spectral information, 2) Relations among channels, and 3) Relations among events in the form of relative times of occurrence.
[ 0002 9 ] The exemplary embodiments of the system and method proposed here provide a source marking algorithm that allows from the explanation earlier for the marking of the Mitral valve closing (MC), Mitral valve opening (MO), Aortic valve opening (AO), Aortic valve closing (AC), Tricuspid valve closing (TC), Tricuspid valve opening (TO), Pulmonary valve closing (PC) and Pulmonary valve opening (PO) signals. The extracted individual valve vibration objects are aligned into a signal for each of the four valves across multiple heart beats. The chart 700 in FIG. 7A shows the source separation of heart valve opening and closing signals. Line 701 indicates the length or duration of the vibration signal for the Mitral valve closing (Ml). Line 702 indicates the length or duration of the vibration signal for the Tricuspid valve closing (T l). Line 703 indicates the length or duration of the vibration signal for the Aortic valve closing (A2). Line 704 indicates length or duration of the vibration signal for the Pulmonic valve closing (P2). Signal 705 indicates the composite vibration signal captured by a particular transducer. Signal 706 indicates the EKG signal captured by the system. Referring to chart 710 of FIG. 7B, the Line 707 indicates the length or duration of the vibration of the Aortic valve opening (AO). Line 708 indicates the length or duration of the vibration of the Pulmonic valve opening (PO). Further note that the lines or signals 709 in FIG. 7A or 711 in FIG. 7B are actually several separated superimposed signals representing the vibration signals from separate sources coming from the mitral valve, tricuspid valve, aortic valve, and pulmonary valve (using less than 4 vibration sensors to extract such separated signals in some embodiments).
[ 00030 ] In the exemplary embodiments, various novel ways of source separating individual heart vibration events from the composite vibration objects captured via multiple transducers can work on a single package that is embodied by an easy-to-use and portable device. Of course, more complicated embodiments using the techniques described herein can use visual sensors, endoscopy cameras, ultrasound sensors, MRI, CT, PET, EEG and other scanning methods alone or in combination such that the monitoring techniques enable improvement in terms of source separation or identification, and/or marking of events such as heart valve openings, brain spikes, contractions, or even peristaltic movements or vibrations. Although the focus of the embodiments herein are for non-invasive applications, the techniques are not limited to such non-invasive monitoring. The techniques ultimately enable diagnosticians to better identify or associate or correlate detected vibrations or signaling with specific biological events (such as heart valve openings and closings, brain spikes, fetal signals, or pre-natal contractions.)
[ 00031 ] The exemplary embodiments develop novel methods of source identification, which in one embodiment uses the Pulmonary and Aortic auscultation locations, and in addition possibly the Tricuspid and Mitral auscultation locations, enabling the system to identify individual valve events from the vibrations.
[ 00032 ] In yet other exemplary embodiments, novel methods of source marking can use the Pulmonary and Aortic auscultation locations, and in addition possibly the Tricuspid and Mitral auscultation locations, enabling the time marking of the occurrence of the individual valve events with respect to the electrocardiogram. Such a system capable and suitable of measuring cardiac time intervals in a simple and non-invasive fashion.
[ 00033 ] Other exemplary embodiments provide tracking of individual valve signals over time. Such novel methods allow for both short-term and long-term discrimination between signals. Short-term pertains to tracking individual stream when they are captured simultaneously as part of the composite signal. Long-term tracking pertains to tracking individual streams across multiple heart beats, tracking valve signals as they transition in and out during each cardiac cycle.
[ 00034 ] Some of the exemplary embodiments of a system and method described herein includes an embedded hardware system, the main elements to capture body sounds that can include a sensor unit that captures the body sounds, performs digitization, and further digital processing of the body sounds for noise reduction, filtering and amplification.
[ 00035 ] It will be apparent to those skilled in the art that various modifications may be made in the present embodiments disclosed without departing from the spirit or scope of the claims. Thus, it is intended that the scope of the embodiments cover the modifications and variations within the scope of the claims recited and provided they come within the scope of the methods and systems described and their equivalents.

Claims

CLAIMS What is claimed is:
1. A system for measuring cardiac time intervals, comprising:
a non-invasive sensor unit for capturing electrical signals and composite vibration objects;
a processor for separating a plurality of individual heart vibration events from the composite vibration objects;
identifying the plurality of individual heart vibration events from the composite vibration objects;
marking individual heart valve events from the plurality of individual heart vibration events with respect to an electrocardiogram signal; and
presenting the individual heart valve events.
2. The system for measuring cardiac time intervals of claim 1, wherein the non-invasive sensor unit includes a first sensor configured for placement at or near a pulmonary auscultation location and a second sensor configured for placement at or near an aortic auscultation location.
3. The system for measuring cardiac time intervals of claim 1, wherein the non-invasive sensor unit includes a sensor configured for placement at or near a tricuspid auscultation location and a sensor configured for placement at or near a mitral auscultation location.
4. The system for measuring cardiac time intervals of claim 1, wherein the non-invasive sensor unit includes a first sensor configured for placement at a pulmonary auscultation location, a second sensor configured for placement at an aortic auscultation location, and at least a third sensor configured for placement at a tricuspid auscultation location or at a mitral auscultation locations or both.
5. The system for measuring cardiac time intervals of claim 1, further comprising a sensor for performing an electrocardiogram and wherein the non-invasive sensor unit comprises at least one sensor for sensing heart vibrations and wherein the system presents the individual heart valve events with respect to a QRS of the electrocardiogram.
6. The system for measuring cardiac time intervals of claim 1, wherein the processor is configured to:
perform source estimation to separate the plurality of individual heart vibration events from the composite vibration objects as separated vibration sources;
phase estimating a phase between the separated vibration sources; and
calculating time stamps for each of the separated vibration sources at each heart beat with respect to a synchronized electrocardiogram signal and one or more sensors of the noninvasive sensor unit.
7. The system of measuring cardiac time intervals of claim 6, wherein the processor is further configured to perform identification of each of the separated vibration sources in individual heart beats as one heart valve event among a mitral valve closing and opening, a tricuspid valve closing and opening, an aortic valve opening and closing or a pulmonary valve opening and closing and wherein a number of vibration sensors in the non-invasive sensor unit is less than the number of the separated vibration sources.
8. The system for measuring cardiac time intervals of claim 1, wherein the processor is configured to separate the plurality of individual heart vibration events from the composite vibration objects from multichannel signals by decomposing the multichannel signals into sparse activation patterns and clustering the sparse activation patterns.
9. The system for measuring cardiac time intervals of claim 1, wherein the processor is configured to separate the plurality of individual heart vibration events from the composite vibration objects from multichannel signals by decomposing the multichannel signals into sparse activation patterns using a sparse coding module, clustering the sparse activation patterns, and recomposing a plurality of source streams by applying an activation mask to the sparse activation patterns assigned to a cluster using basis elements.
10. The system for measuring cardiac time intervals of claim 8, wherein the processor decomposes the multichannel signals into sparse activation patterns using a K-SVD algorithm.
11. The system for measuring cardiac time intervals of claim 1, wherein thesystem comprises a wearable device in the form of a patch, band, necklace, belt, or bandage configured to communicate with a wireless node and further configured to capture an electrocardiogram signal synchronized with one or more accelerometer sensors of the noninvasive sensor unit.
12. The system for measuring cardiac time intervals of claim 8, wherein the processor separates the plurality of individual heart vibration events from the composite vibration objects from multichannel signals using at least one source separation technique used for extracting the valve heart signals for application in a non-linear time variant system, among Determined Models, Principal Component Analysis (PCA), Independent Component Analysis ICA, Singular Value Decomposition (SVD), Bin-wise Clustering and Permutation posterior probability Alignment, Undetermined Models, Sparseness condition, Dictionary learning, Convolutive models, or K-SVD Matching Pursuit.
13. The system for measuring cardiac time intervals of claim 1, wherein the marking of individual valve events comprises at least the marking of one or more among a Mitral valve opening (MO), Aortic valve opening (AO), Tricuspid valve opening (TO), or Pulmonary valve opening (PO).
14. A sensor array device, comprising:
a wearable device configured to capture an electrocardiogram signal synchronized with composite vibration objects from at least one accelerometer and further configured to communicate with a wireless node;
wherein the at least one accelerometer is configured for capturing the composite vibration objects;
an electrode for sensing an electrocardiogram signal; and
wherein the at least one accelerometer is configurable for measuring a lower frequency range vibration signal and a higher frequency range vibration signal.
15. The sensor array device of claim 14, wherein the processor is operatively coupled to the at least one accelerometer, the processor further being configured for:
separating a plurality of individual heart vibration events from the composite vibration objects;
identifying the plurality of individual heart vibration events from the composite vibration objects;
transmitting the composite vibration signals or the plurality of individual heart vibration events to a remote device; and
marking and presenting individual valve events from the plurality of individual heart vibration events with respect to a QRS of an electrocardiogram signal.
16. The sensor array device of claim 15, wherein the at least one accelerometer comprises a first sensor configured for placement near a pulmonary auscultation location, a second sensor configured for placement near an aortic auscultation location, and at least a third sensor configured for placement near a tricuspid auscultation location or near a mitral auscultation locations or both.
17. The sensor array device of claim 15, wherein the processor is configured to separate the plurality of individual heart vibration events from the composite vibration objects from multichannel signals by decomposing the multichannel signals into sparse activation patterns and clustering the sparse activation patterns.
18. The sensor array device of claim 15, wherein the sensor array device is portable and captures synchronized sensor data to a memory and wherein the processor is configurable in the process of separating the plurality of individual heart vibration events from the composite vibration objects into separate vibration sources and further identifying the individual heart vibration events among at least one of a mitral valve closing, mitral valve opening, a tricuspid valve closing, a tricuspid valve opening, an aortic valve closing, an aortic valve opening, or a pulmonary valve closing, or a pulmonary valve opening.
19. The sensor array device of claim 15, further comprising a wireless connection for transmission of sensor data or processed sensor data to a remote computing device or a cloud computing device.
20. A method of measuring cardiac time intervals, comprising:
capturing composite vibration objects using a non-invasive sensor unit;
separating, by one or more processors, a plurality of individual heart vibration events from the composite vibration objects;
identifying, by the one or more processors, the individual valve events from the plurality of individual heart vibration events with respect to an electrocardiogram signal, wherein the individual valve events comprises at least one among a mitral valve opening, a tricuspid valve opening, an aortic valve opening, or a pulmonary valve opening; and
presenting the individual valve events with respect to a QRS of the electrocardiogram, wherein the electrocardiogram is synchronized with at least one or more vibration sensors of the non-invasive sensor unit.
PCT/US2017/012031 2016-01-04 2017-01-03 System and method of extraction, identification, making and display of the heart valve signals WO2017120138A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP17736198.7A EP3399905A4 (en) 2016-01-04 2017-01-03 System and method of extraction, identification, making and display of the heart valve signals

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201662274770P 2016-01-04 2016-01-04
US201662274763P 2016-01-04 2016-01-04
US201662274761P 2016-01-04 2016-01-04
US62/274,761 2016-01-04
US62/274,763 2016-01-04
US62/274,770 2016-01-04

Publications (1)

Publication Number Publication Date
WO2017120138A1 true WO2017120138A1 (en) 2017-07-13

Family

ID=59273907

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/012031 WO2017120138A1 (en) 2016-01-04 2017-01-03 System and method of extraction, identification, making and display of the heart valve signals

Country Status (2)

Country Link
EP (1) EP3399905A4 (en)
WO (1) WO2017120138A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017208040A3 (en) * 2016-06-01 2018-02-15 Kozmann Gyoergy Zoltán Method and arrangement for monitoring specific activity parameters of the human heart
CN110074817A (en) * 2019-04-04 2019-08-02 肯尼斯.粲.何 A kind of method and apparatus of random detection or dynamic monitoring central artery pressure and cardiac function
WO2019202385A1 (en) * 2018-04-20 2019-10-24 RADHAKRISHNA, Suresh, Jamadagni Electronic stethoscope
US10828009B2 (en) 2017-12-20 2020-11-10 International Business Machines Corporation Monitoring body sounds and detecting health conditions

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USRE31097E (en) * 1977-07-21 1982-12-07 Cardiokinetics, Inc. Apparatus and method for detecton of body tissue movement
US20080021336A1 (en) * 2006-04-24 2008-01-24 Dobak John D Iii Devices and methods for accelerometer-based characterization of cardiac synchrony and dyssynchrony
US20080154144A1 (en) * 2006-08-08 2008-06-26 Kamil Unver Systems and methods for cardiac contractility analysis
US20110263994A1 (en) * 2007-12-13 2011-10-27 James Alexander Burns Method and Apparatus for Acquiring and Analyzing Data Relating to a Physiological Condition of a Subject
US20130137997A1 (en) 2002-12-30 2013-05-30 Cardiac Pacemakers, Inc. Method and apparatus for detecting atrial filling pressure
US20140213921A1 (en) * 2009-11-03 2014-07-31 Vivaquant Llc Method and Apparatus for Identifying Cardiac Risk
US20140296726A1 (en) 2009-11-03 2014-10-02 Vivaquant Llc Method and Apparatus for Identifying Cardiac Risk
US20150005588A1 (en) 2013-06-26 2015-01-01 Zoll Medical Corporation Therapeutic device including acoustic sensor
US20150065814A1 (en) 2012-10-15 2015-03-05 Rijuven Corporation Mobile front-end system for comprehensive cardiac diagnosis
US20150342487A1 (en) 2014-06-02 2015-12-03 Cardiac Pacemakers, Inc. Systems and methods for evaluating hemodynamic response to atrial fibrillation

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7351207B2 (en) * 2003-07-18 2008-04-01 The Board Of Trustees Of The University Of Illinois Extraction of one or more discrete heart sounds from heart sound information
US8475396B2 (en) * 2011-02-11 2013-07-02 AventuSoft, LLC Method and system of an acoustic scene analyzer for body sounds

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USRE31097E (en) * 1977-07-21 1982-12-07 Cardiokinetics, Inc. Apparatus and method for detecton of body tissue movement
US20130137997A1 (en) 2002-12-30 2013-05-30 Cardiac Pacemakers, Inc. Method and apparatus for detecting atrial filling pressure
US20080021336A1 (en) * 2006-04-24 2008-01-24 Dobak John D Iii Devices and methods for accelerometer-based characterization of cardiac synchrony and dyssynchrony
US20080154144A1 (en) * 2006-08-08 2008-06-26 Kamil Unver Systems and methods for cardiac contractility analysis
US20110263994A1 (en) * 2007-12-13 2011-10-27 James Alexander Burns Method and Apparatus for Acquiring and Analyzing Data Relating to a Physiological Condition of a Subject
US20140213921A1 (en) * 2009-11-03 2014-07-31 Vivaquant Llc Method and Apparatus for Identifying Cardiac Risk
US20140296726A1 (en) 2009-11-03 2014-10-02 Vivaquant Llc Method and Apparatus for Identifying Cardiac Risk
US20150065814A1 (en) 2012-10-15 2015-03-05 Rijuven Corporation Mobile front-end system for comprehensive cardiac diagnosis
US20150005588A1 (en) 2013-06-26 2015-01-01 Zoll Medical Corporation Therapeutic device including acoustic sensor
US20150342487A1 (en) 2014-06-02 2015-12-03 Cardiac Pacemakers, Inc. Systems and methods for evaluating hemodynamic response to atrial fibrillation

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
CALHOUN, VD ET AL.: "ICA of functional MRI data: an overview", 4TH INTERNATIONAL SYMPOSIUM ON INDEPENDENT COMPONENT ANALYSIS AND BLIND SIGNAL SEPARATION (ICA2003), April 2003 (2003-04-01), pages 281 - 288, XP055398009, Retrieved from the Internet <URL:http://mialab.mrn.org/software/gift/publications/2003_ica_overview.pdf> *
MONZÓN, S ET AL.: "Sparse spectral analysis of atrial fibrillation electrograms", MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP) , 2012 IEEE INTERNATIONAL WORKSHOP, 23 September 2012 (2012-09-23), XP032470817 *
See also references of EP3399905A4

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017208040A3 (en) * 2016-06-01 2018-02-15 Kozmann Gyoergy Zoltán Method and arrangement for monitoring specific activity parameters of the human heart
US11375940B2 (en) 2016-06-01 2022-07-05 Gyorgy Zoltan Kozmann Method and measuring arrangement for monitoring specific activity parameters of the human heart
US10828009B2 (en) 2017-12-20 2020-11-10 International Business Machines Corporation Monitoring body sounds and detecting health conditions
WO2019202385A1 (en) * 2018-04-20 2019-10-24 RADHAKRISHNA, Suresh, Jamadagni Electronic stethoscope
CN110074817A (en) * 2019-04-04 2019-08-02 肯尼斯.粲.何 A kind of method and apparatus of random detection or dynamic monitoring central artery pressure and cardiac function
CN110074817B (en) * 2019-04-04 2022-09-23 肯尼斯.粲.何 Method and equipment for randomly detecting or dynamically monitoring central arterial pressure and cardiac function

Also Published As

Publication number Publication date
EP3399905A4 (en) 2019-10-23
EP3399905A1 (en) 2018-11-14

Similar Documents

Publication Publication Date Title
US10362997B2 (en) System and method of extraction, identification, marking and display of heart valve signals
US20220265202A1 (en) Multifactorial telehealth care pregnancy and birth monitoring
KR102450536B1 (en) Wireless physiological monitoring device and systems
US20170347899A1 (en) Method and system for continuous monitoring of cardiovascular health
US20170188978A1 (en) System and method of measuring hemodynamic parameters from the heart valve signal
CN111050633A (en) Multi-sensor cardiac function monitoring and analysis system
US20140378849A1 (en) Method and apparatus to monitor physiologic and biometric parameters using a non-invasive set of transducers
US20180116626A1 (en) Heart Activity Detector for Early Detection of Heart Diseases
WO2017120138A1 (en) System and method of extraction, identification, making and display of the heart valve signals
US20200170527A1 (en) System and method of marking cardiac time intervals from the heart valve signals
US20230131629A1 (en) System and method for non-invasive assessment of elevated left ventricular end-diastolic pressure (LVEDP)
CN111031902B (en) Multi-sensor stroke output monitoring system and analysis method
US11232866B1 (en) Vein thromboembolism (VTE) risk assessment system
CN109414170B (en) Electronic device and control method thereof
EP4323741A1 (en) Physiological parameter sensing systems and methods
Alamdari A morphological approach to identify respiratory phases of seismocardiogram
US10952625B2 (en) Apparatus, methods and computer programs for analyzing heartbeat signals
CN106137245A (en) A kind of auscultation method with reference to multiple cardiographic detector signal analysis
US20230072872A1 (en) System and method of marking cardiac time intervals from the heart valve signals using a Near-Field Communication based patch biosensor
Arathy et al. PC based heart sound monitoring system
WO2023199334A1 (en) A blood pressure determining system and method thereof
Visagie et al. Autonomous detection of heart sound abnormalities using an auscultation jacket
Sighvatsson et al. Wearable Heart Monitor
CN117616259A (en) Physiological parameter sensing systems and methods
Ab Malek Design and development of wireless stethoscope with data logging functions

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17736198

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2017736198

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2017736198

Country of ref document: EP

Effective date: 20180806