WO2013057637A1 - A system and method for characterizing an upper airway using speech characteristics - Google Patents

A system and method for characterizing an upper airway using speech characteristics Download PDF

Info

Publication number
WO2013057637A1
WO2013057637A1 PCT/IB2012/055501 IB2012055501W WO2013057637A1 WO 2013057637 A1 WO2013057637 A1 WO 2013057637A1 IB 2012055501 W IB2012055501 W IB 2012055501W WO 2013057637 A1 WO2013057637 A1 WO 2013057637A1
Authority
WO
WIPO (PCT)
Prior art keywords
utterance
upper airway
patient
recorded
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2012/055501
Other languages
English (en)
French (fr)
Inventor
Stijn De Waele
Stefan Winter
Alexander Cornelis Geerlings
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Philips Intellectual Property and Standards GmbH
Koninklijke Philips NV
Original Assignee
Philips Intellectual Property and Standards GmbH
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to IN2660CHN2014 priority Critical patent/IN2014CN02660A/en
Priority to MX2014004534A priority patent/MX352472B/es
Priority to JP2014536371A priority patent/JP2014532448A/ja
Priority to BR112014009233A priority patent/BR112014009233A8/pt
Priority to RU2014120177A priority patent/RU2623129C2/ru
Priority to CN201280051551.XA priority patent/CN103889324B/zh
Application filed by Philips Intellectual Property and Standards GmbH, Koninklijke Philips Electronics NV filed Critical Philips Intellectual Property and Standards GmbH
Priority to EP12798375.7A priority patent/EP2744408B1/en
Priority to US14/352,336 priority patent/US10182787B2/en
Publication of WO2013057637A1 publication Critical patent/WO2013057637A1/en
Anticipated expiration legal-status Critical
Priority to US16/253,003 priority patent/US11207049B2/en
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16ZINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS, NOT OTHERWISE PROVIDED FOR
    • G16Z99/00Subject matter not provided for in other main groups of this subclass
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B7/00Instruments for auscultation
    • A61B7/003Detecting lung or respiration noise
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/08Measuring devices for evaluating the respiratory organs
    • A61B5/0826Detecting or evaluating apnoea events
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1075Measuring physical dimensions, e.g. size of the entire body or parts thereof for measuring dimensions by non-invasive methods, e.g. for determining thickness of tissue layer
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4803Speech analysis specially adapted for diagnostic purposes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4806Sleep evaluation
    • A61B5/4818Sleep apnoea
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4836Diagnosis combined with treatment in closed-loop systems or methods
    • A61B5/4839Diagnosis combined with treatment in closed-loop systems or methods combined with drug delivery
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/70Means for positioning the patient in relation to the detecting, measuring or recording means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271Specific aspects of physiological measurement analysis
    • A61B5/7282Event detection, e.g. detecting unique waveforms indicative of a medical condition
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient; User input means
    • A61B5/7475User input or interface means, e.g. keyboard, pointing device, joystick
    • A61B5/749Voice-controlled interfaces
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B7/00Instruments for auscultation
    • A61B7/02Stethoscopes
    • A61B7/04Electric stethoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0204Acoustic sensors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/486Biofeedback
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M15/00Inhalators
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • G10L25/66Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for extracting parameters related to health condition
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/75Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 for modelling vocal tract parameters

Definitions

  • the present invention relates to a system and method for characterizing an upper airway using speech characteristics.
  • OSA Obstructive Sleep Apnoea
  • apnoea a disease whereby the upper airway is obstructed many times per night to such an extent that the patient is unable to breathe (apnoea) or has a reduced breathing capacity (hyponea).
  • Diagnosis of OSA can be done in a sleep lab by monitoring a patient during an overnight measurement. If the total of number of apnoea' s and hyponeas exceeds a certain limit, the OSA diagnosis is assigned.
  • an acoustic pharyngometer can be used to actively extract geometric parameters of the upper airway by sending an acoustic signal into the throat and processing the reflections of the latter.
  • test/retest validity and the accuracy of an acoustic pharyngometry measurement performed by devices known in the art is not that high.
  • CA2585824 discloses a method for screening OSA, namely to derive flow information from breathing sounds in the ear, and combine them with the level of snoring. However, the method disclosed in CA '824 can only be used to detect apnoea as they happen.
  • a first aspect of the invention relates to systems for characterizing at least one anatomical parameter of an upper airway of a patient by analyzing spectral properties of an utterance, the system comprising:
  • a mechanical coupler comprising means for restricting the jaw position of the patient
  • processing means for determining at least one anatomical parameter of the upper airway from the recorded utterance and comparing the recorded utterance to a threshold value.
  • the characterization can be performed autonomously.
  • the system and method according to the present invention functions independently: once the operation is started, it continues until the operation is terminated, without manual intervention, but possibly under the control of a controller.
  • the system according to embodiments of the present invention can autonomously check whether that a user has preformed the required utterance.
  • the processing means provides real-time feedback.
  • the system further comprises means for speech recognition for controlling correctness of the recorded utterance.
  • system further comprises means for delivering at least one respiratory drug through the upper airway of the patient.
  • the at least one anatomical parameter is the cross-section of the upper airway and wherein the system further comprises means for determining at least one point of time when the cross-section is maximal during an utterance. In yet another embodiment the system further comprises means for delivering at least one respiratory drug through said upper airway of the patient at said at least one point of time when said cross-section of the upper airway is maximal. In one embodiment of the present invention the respiratory drug delivering means comprises a timing mechanism.
  • a second aspect of the invention relates to the use of the above mentioned systems as a diagnostics tool for assessing obstructive sleep apnea.
  • a further aspect of the invention relates to methods for assessing at least one anatomical parameter of an upper airway of a patient by analyzing spectral properties of an utterance, comprising the steps of:
  • the method further comprises the step of providing real-time feedback.
  • the method further comprises the step of adapting the patient's body position.
  • the method further comprises the step of storing the spectral properties of the recorded utterance in a database.
  • the threshold value is determined by means of speech recognition.
  • the invention according to embodiments of the invention further includes a method wherein the at least one anatomical parameter is the cross-section of said upper airway and wherein said method further comprises the step of determine at least one point of time when the cross-section is maximal when executing an utterance.
  • Embodiments of the invention include a method further comprising the step of delivering at least one respiratory drug in the upper airway of the patient.
  • the teachings of the present invention permit the design of improved methods and systems for guiding a user in performing accurate and reliable measurements for characterizing an upper airway.
  • Fig. la is a schematic representation of the approximated articulatory model of the vocal tract.
  • Fig lb is a schematic illustration of the approximated articulatory model using a concatenation of four lossless cylindrical acoustic tubes.
  • Fig. 2 is a schematic representation of the system according to an embodiment of the present invention.
  • Fig. 3 illustrates a representative output of an acoustic pharyngometry measurement.
  • Fig. 4a and Fig. 4b illustrate a real time estimation of upper airway tract based on uttered sounds using a system according to an embodiment of the present invention.
  • first, second, third and the like in the description and in the claims are used for distinguishing between similar elements and not necessarily for describing a sequence, either temporally, spatially, in ranking or in any other manner. It is to be understood that the terms so used are interchangeable under appropriate circumstances and that the embodiments of the invention described herein are capable of operation in other sequences than described or illustrated herein. Moreover, the terms top, bottom, over, under and the like in the description and the claims are used for descriptive purposes and not necessarily for describing relative positions. It is to be understood that the terms so used are interchangeable under appropriate circumstances and that the embodiments of the invention described herein are capable of operation in other orientations than described or illustrated herein.
  • an element described herein of an apparatus embodiment is an example of a means for carrying out the function performed by the element for the purpose of carrying out the invention.
  • utterance used herein relates to a complete unit of speech in spoken language. It is generally but not always bounded by silence. It can be represented and delineated in written language in many ways. It is obvious that utterances do not exist in written language, only their representations do.
  • real-time relates to hardware or software systems that are subject to a "real-time constraint", for instance operational deadlines from event to system response.
  • real-time programs preferably execute within strict constraints on response time.
  • a non-real-time system is one for which there is no deadline, even if fast response or high performance is desired or preferred.
  • the need of real-time software is often addressed in the context of real-time operating systems, and synchronous programming languages, which provide frameworks on which to build real-time application software.
  • Real-time computations can be said to have failed if they are not completed before their deadline, whereby their deadline is relative to an event. A real-time deadline must be met, regardless of the system load.
  • articulator or "speech organ” relates to organs which can produce the many sounds or utterances needed for language. Organs used include the lips, teeth, tongue, alveolar ridge, hard palate, velum (soft palate), uvula and glottis. Speech organs or articulators can be of two types: passive articulators and active articulators. Passive articulators remain static during the articulation of sound, such as upper lips, teeth, alveolar ridge, hard palate, soft palate, uvula, and pharynx wall, whereas active articulators move relative to these passive articulators to produce various speech sounds, in different manners. The most important active articulators are the tongue, the lower lip and glottis.
  • Aerodynamic energy refers to the airflow through the vocal tract. Its potential form is air pressure; its kinetic form is the actual dynamic airflow. The acoustic energy is variation in the air pressure that can be represented as sound waves.
  • Air cavities are containers of air molecules of specific volumes and masses. The main air cavities present in the articulatory system are the supraglottal cavity and the subglottal cavity. They are so- named because the glottis, the openable space between the vocal folds internal to the larynx, separates the two cavities.
  • the supraglottal cavity or the orinasal cavity is divided into an oral subcavity (the cavity from the glottis to the lips excluding the nasal cavity) and a nasal subcavity (the cavity from the velopharyngeal port, which can be closed by raising the velum to the nostrils).
  • the subglottal cavity consists of the trachea and the lungs.
  • the atmosphere external to the articulatory stem may also be consisted an air cavity whose potential connecting points with respect to the body are the nostrils and the lips.
  • the pitch must be set independently from the vowel quality and if the same vowel can be spoken on different voice qualities, the voice quality must be set independently from the vowel quality.
  • the vowel quality seems to depend mostly on tongue position: front-back and open-close, but vowel quality can also be affected by the position of other articulators, the jaw, lips and velum.
  • Fig. la An elementary segment (1, 2, 3, 4, 5, 6, 7, 8, 9 or 10 in Fig. la) of the upper airway is represented by a cylindrical tube of a specific length and cross-section area.
  • lb shows a schematic illustration of the approximated articulatory model using a concatenation of four lossless cylindrical acoustic tubes, each of length li and cross-section area A.
  • the upper airway can be viewed as an acoustic tube of varying cross-sectional area terminated by the vocal cords on one end and by the lip opening at the other.
  • Another model which can be used is the source-filter model of sound production in the upper airway.
  • This model of sound production assumes a source of sound and a filter that shapes that sound, organised so that the source and the filter are independent. This independence allows one to measure and quantify the source separately from the filter.
  • the source of sound is the regular vibration of the vocal folds in the larynx and the filter is the whole vocal tract tube between the larynx and the lips.
  • the source-filter model can also be applied to fricative sounds, whereby the source of sound is the turbulence generated by passing air through a constriction, and the filter is the vocal tract tube anterior to the constriction.
  • articulators that contribute to the spectral shaping of an utterance can be described and visualized in real-time for instance by applying a method disclosed by D. Hill et al in Proceedings of AVIOS '95, the 14th Annual International Voice Technologies Applications Conference of the American Voice I/O Society, San Jose September 11 -14 1995, AVIOS: San Jose, pp. 27-44.
  • the articulators which influence the cross-section of an airway are determined. More specifically, the geometry of an upper airway is preferably determined using the above mentioned models.
  • the present invention can also be applied using natural inhaled/exhaled breathing noise and not only utterance, for instance during sleep or prior to drug inhalation.
  • the invention according to an embodiment relates to a system 10 for characterizing at least one anatomical parameter of an upper airway of a patient, for instance a throat or a vocal tract, by analysing spectral properties of an utterance
  • the invention provides in one embodiment a system for characterizing at least one anatomical parameter of an upper airway of a patient by analysing spectral properties of an utterance, the system comprising:
  • a mechanical coupler 1 comprising a mouthpiece 1 1 which restricts the jaw position and which can be anatomically fitted according to the utterance the patient is supposed to perform;
  • a sound recording unit 2 for recording an utterance, for instance a microphone or the mechanical coupler used as a free-floating microphone; and a computing device preferably comprising a non-transitory memory adapted to determine at least one anatomical parameter of the upper airway from the recorded utterance and comparing the recorded utterance to a threshold value.
  • the system according to an embodiment of the invention is illustrated in Fig. 2.
  • the system comprises a mechanical coupler 1 which is used to transmit a generated audible sound signal, for instance a vocal utterance or a non-vocal utterance, like for instance natural inhaled/exhaled breathing noise, from the to be examined cavity into the system 10.
  • a generated audible sound signal for instance a vocal utterance or a non-vocal utterance, like for instance natural inhaled/exhaled breathing noise
  • both vocal and non- vocal utterances can be generated, however vocal utterances may provide less information on the lower airway system as compared to non- vocal utterances.
  • the mechanical coupler 1 enables the restriction of the jaw position.
  • the latter is in one embodiment of the invention enabled by using different mouthpieces 11 which can be anatomically fitted according to the utterance the patient is supposed to perform.
  • the mouthpiece 11 can ensure, for example, that the teeth and jaws are in a certain position and that the opening of
  • the mouthpiece 11 can restrict the position of the tongue as well.
  • the opening of the mouth has a very specific diameter leading that the variability in the utterances is reduced and thus enhancing the precision of the measurement.
  • the mechanical coupler 1 can further comprise a probe 12.
  • the mechanical coupler 1 and ,in one embodiment of the invention, the probe 12 can comprise means for recording an utterance, for instance by using a sound recording unit 2 for recording the utterances.
  • the mechanical coupler 1 and the probe 12 can have a tubular shape but different shapes can be applied as well.
  • the sound recording unit 2 is integrated with the tube formed by the coupler 1 and the probe 12. This can be enabled for instance by integrating a snoring microphone in an OptiVent Inline Spacer both developed by Philips Respironics. The setup illustrated in Fig.
  • the sound recording unit 2 is in one embodiment of the invention connected to a processing means 5.
  • the processing means 5 can determine the anatomical parameters of the upper airway from the recorded utterances or inhaled/exhaled breathing noise and compare the determined anatomical parameters to a threshold value.
  • the processing means 5 can provide feedback in real-time as a result of processing the obtained data in real-time.
  • the processing means 5 can be a computing device comprising in one embodiment of the invention a non-transitory memory. More specifically a personal computer, a laptop, a tablet computer, a smart phone, a mobile phone, a watch or any electronic visual displays which can comprise a touchscreen can be used. In another embodiment of the present invention the processing means 5 can be executed by a single operation for instance with respect to a predetermined button, and hence can be executed by an exceedingly simple operation. All processing means 5 which are known to a person skilled in the art can be used, as well as any software which could enable the characterization of the necessary anatomical parameters can also applied.
  • the system according to embodiments of the present invention can further comprise means to instruct and control a patient's body position.
  • the upper airway geometry at different body positions e.g. lying down and standing
  • the means to instruct and control a patient's body position can for instance be enabled by adding a 3D accelerometer to the system as illustrated in Fig. 2, which gives the orientation of the system and can be used to instruct and control the patient via the user interface (e.g. the patient could be asked to first do a measurement in standing and then in lying position).
  • the processing means 5 can also be connected to a database 4 (locally or remotely) and for instance a loudspeaker, a display or both 6 which can be used as means to provide the feedback to a user.
  • the display comprises an interface to instruct and provide feedback to the test subject, whereby the usability of the interface is very easy to use by the test subject.
  • the user interface comprises at least one screen, whereby one screen can be a main screen whereas another screen can be used to select a particular parameter, for instance a compression.
  • many of the functionality's that are important for a good result which can be done autonomously by the device are done by the system itself. An example of this is the determination of the frame rate which is done by determining the number of images in the sequence and the length of the speech fragment and calculating the frame rate using these numbers.
  • the database 4 in one embodiment of the invention contains a predefined sequence of utterances that a user can perform.
  • the database 4 can contain a set of sequences, from which an operator can choose.
  • the processing means 5 can for instance be integrated or installed on a mobile device, for instance a mobile phone.
  • a screen or speaker of the mobile phone can be used as means to provide feedback to a user and accordingly an integrated microphone which is standard on a mobile phone can be used as a sound recording unit.
  • the mechanical coupler 1 can be a cover that one can attach to the cell phone whereby said cover comprises a tube in front of the microphone.
  • the tube can be used as means to fix the mount of a user in a predefined way in relation to the integrated microphone.
  • the invention can provide real-time feedback for optimal administration and delivery of respiratory drugs.
  • Knowledge of the upper airway anatomy can improve the proportion of the administered drugs that have to be delivered to a desired location.
  • Drug delivery systems known in the art are not efficient since only about 25% of the administered drug is delivered where it should be, by obtaining real-time feedback on the upper airways one can model the flow of the particles through these upper airways.
  • Knowledge of the upper airway anatomy can improve the proportion of the administered drug that should be delivered to the desired location.
  • respiratory drug delivery the problem is getting the drug "beyond the throat". Once beyond the throat there are various systemic routes for the drug to reach the targeted alveoli. More drugs delivered "beyond the throat" means a shorter treatment time which is a real differentiator.
  • the means for delivering at least one respiratory drug through the airway of a patient can for instance be an aerosol device, the I-neb AAD system by Philips Respironics which is a fast aerosol generating system can be used.
  • an aerosol device the I-neb AAD system by Philips Respironics which is a fast aerosol generating system can be used.
  • the exact dose of the respiratory drugs can be calculated and visualized by applying a flow modelling and based on this the particle delivery is modelled for instance by applying CFD tools like for instance Star CD and Star CCM+ manufactured by CD-adapco. More specifically the particle delivery and the timing of the aerosol generation can be optimized and in this way the drug delivery can be personalized but restricted by the medication prescription.
  • the cross- section of the upper airway is determined by the processing means 5 and in addition a point in time when the cross-section is maximal during an utterance can be determined. This point of time when the cross-section of the upper airway is maximal, can be used for the timing of the aerosol generation, which then can be optimized for drug delivery, thus providing a system tuning approach.
  • a mechanical coupler restricting the jaw position for instance by applying a stepped-mouthpiece (K. Nikander et al in "Manipulation of upper airway volume using a stepped mouthpiece" ERS, September 2010) can be used as a way to force the upper airways to open up. Feedback to the patient on the way his/hers upper airway is opened up is beneficial to this goal. In addition it may support adherence and compliance.
  • Advantageously embodiments of the present invention enable the amount of drug delivery to be more controllable, consistent and repeatable over the various therapy sessions.
  • a method can comprise one of the following steps: the system tells the patient which utterance to perform, which the system records.
  • a processing means 5 performs can check on the correctness of the recorded utterance, for example by means of speech recognition to determine whether the correct utterance has been performed.
  • speech recognition models known in the art can be used to enable the latter, for instance by applying a vector Taylor series approach for environment-independent recognition, or by using a parallel model combination (PMC) scheme, or hidden Markov models. If the utterance was not correct, the system can ask the patient to repeat it. In a next step the system can repeat the previous steps until all predefined utterances have been performed correctly by the patient.
  • the processing means can then extract and analyse the features important for OSA diagnosis.
  • An example of a method which can be used is disclosed by Robb et al in Vocal tract resonance characteristics of adults with obstructive sleep apnoea in Acta Otolaryngology, 1997. 117(5): p. 760-3.
  • the following steps can be applied: spectral properties of the utterances can be analysed, resulting in a determination of the anatomical parameters of the upper airway, for instance dimensions of the throat between the vocal chords and the mouth.
  • the derived dimensions can be used as an indicator for OSA.
  • the dimensions can be linked to other measurements for which the predictive power has already been established, for instance measurement data of an acoustic pharyngometry measurement as illustrated in Fig. 3.
  • Figure 3 taken from Jung et al. shows the representative output of an acoustic pharyngometry measurement, having the parameter area on the Y-axis and the parameter distance on the X-axis.
  • the values can also be linked to the presence of OSA in a trial that is run specifically for derivation of a detector based on speech features.
  • Another method to derive the cross-sectional dimensions from the lips to the glottis is by applying a speech- coding by for instance Linear Predictive Coding (LPC).
  • LPC Linear Predictive Coding
  • This method can also be used for obtaining a real-time estimate of the instantaneous throat geometry for optimizing respiratory drug delivery in terms of more efficient deposition and shorter treatment times as illustrated in Fig. 4a and 4b.
  • Embodiments of the present invention provide feedback to the patient while he/she holds its throat open by uttering sounds, e.g. exhaling. In a subsequent inhale, while keeping the throat fixated, the drug delivery can take place. Direct feedback can improve adherence and compliance.
  • the determined values can be compared to predefined thresholds or used by a more sophisticated classifier to give a probability that the patient is suffering from OSA as illustrated in Figs. 4a and 4b.
  • the result can be given to an operator.
  • An example of a classifier is for instance the naive Bayesian classifier known in the art.
  • the classifier can also include physiological measures such as BMI and neck circumference to increase screening performance.
  • the present invention can additional be applied for OSA phenotyping.
  • the throat dimensions obtained from the processing means can help to identify different types of OSA, providing an indication for the most successful treatment (CPAP, surgery).
  • An alternative embodiment of the present invention is a system comprising a training mode.
  • the training mode can be applied to two groups of patients, one group diagnosed with OSA and another group diagnosed non-OSA. When the two groups are examined, reference data can be obtained which can then be used in future measurements.
  • the processor then autonomously can train the implemented classifier to be used for future tests.
  • the system is not only used for a one-time measurement but used in repeating check-ups.
  • a patient's results can be stored in a database (locally or remotely, not necessarily identical with the previously mentioned database).
  • the next time the patient receives a check-up the system can be used to record another measurement. This can then be compared to the previous results of this patient. This decreases the importance of absolute numbers obtained during a one-time measurement and enables the observation and evaluation of a trend.
  • the system can be equipped with a state-of-the-art speaker-recognition module. It autonomously can assign new measurements to previous measurements by identifying the speaker based on the performed utterances.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Veterinary Medicine (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Physiology (AREA)
  • Pulmonology (AREA)
  • Acoustics & Sound (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Pharmacology & Pharmacy (AREA)
  • Medicinal Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Signal Processing (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
PCT/IB2012/055501 2011-10-20 2012-10-11 A system and method for characterizing an upper airway using speech characteristics Ceased WO2013057637A1 (en)

Priority Applications (9)

Application Number Priority Date Filing Date Title
MX2014004534A MX352472B (es) 2011-10-20 2012-10-11 Un sistema y metodo para caracterizar una via respiratoria superior utilizando caracteristicas del habla.
JP2014536371A JP2014532448A (ja) 2011-10-20 2012-10-11 音声特性を用いて上気道を特徴づけるシステム及び方法
BR112014009233A BR112014009233A8 (pt) 2011-10-20 2012-10-11 sistema para a caracterização de pelo menos um parâmetro anatômico de uma via respiratória superior de um paciente pela análise de propriedades espectrais de um enunciado; uso de um sistema; e método para a avaliação de pelo menos um parâmetro anatômico de uma via respiratória superior de um paciente pela análise de propriedades espectrais de um enunciado
RU2014120177A RU2623129C2 (ru) 2011-10-20 2012-10-11 Система и способ получения характеристик верхних дыхательных путей с использованием характеристик речи
CN201280051551.XA CN103889324B (zh) 2011-10-20 2012-10-11 一种使用语音特性来表征上气道的系统和方法
IN2660CHN2014 IN2014CN02660A (enExample) 2011-10-20 2012-10-11
EP12798375.7A EP2744408B1 (en) 2011-10-20 2012-10-11 A system for characterizing an upper airway using speech characteristics
US14/352,336 US10182787B2 (en) 2011-10-20 2012-10-11 System and method for characterizing an upper airway using speech characteristics
US16/253,003 US11207049B2 (en) 2011-10-20 2019-01-21 System and method for characterizing an upper airway using speech characteristics

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161549315P 2011-10-20 2011-10-20
US61/549,315 2011-10-20

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US14/352,336 A-371-Of-International US10182787B2 (en) 2011-10-20 2012-10-11 System and method for characterizing an upper airway using speech characteristics
US16/253,003 Continuation US11207049B2 (en) 2011-10-20 2019-01-21 System and method for characterizing an upper airway using speech characteristics

Publications (1)

Publication Number Publication Date
WO2013057637A1 true WO2013057637A1 (en) 2013-04-25

Family

ID=47324215

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2012/055501 Ceased WO2013057637A1 (en) 2011-10-20 2012-10-11 A system and method for characterizing an upper airway using speech characteristics

Country Status (9)

Country Link
US (1) US10182787B2 (enExample)
EP (1) EP2744408B1 (enExample)
JP (1) JP2014532448A (enExample)
CN (1) CN103889324B (enExample)
BR (1) BR112014009233A8 (enExample)
IN (1) IN2014CN02660A (enExample)
MX (1) MX352472B (enExample)
RU (1) RU2623129C2 (enExample)
WO (1) WO2013057637A1 (enExample)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104523236A (zh) * 2015-01-07 2015-04-22 厦门大学 一种抗干扰的喉振动发声测评装置
WO2019094155A1 (en) * 2016-11-10 2019-05-16 Sonde Health, Inc. System and method for activation and deactivation of cued health assessment
WO2020060290A1 (en) * 2018-09-20 2020-03-26 Samsung Electronics Co., Ltd. System and method for pulmonary condition monitoring and analysis
FR3108492A1 (fr) * 2020-03-29 2021-10-01 Ghislaine ALAJOUANINE Dispositif de capture, d’enregistrement et d’analyse des bruits respiratoires
CN116473521A (zh) * 2023-06-21 2023-07-25 四川大学华西医院 疑似环杓关节脱位声音频谱识别方法及系统
GB2603573B (en) * 2020-10-08 2023-07-26 Ibm Multi-Modal lung capacity measurement for respiratory illness prediction
US11717214B2 (en) * 2017-05-05 2023-08-08 ResMed Pty Ltd Screening, diagnosis and monitoring of respiratory disorders

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
BR112014009233A8 (pt) 2011-10-20 2017-06-20 Koninklijke Philips Nv sistema para a caracterização de pelo menos um parâmetro anatômico de uma via respiratória superior de um paciente pela análise de propriedades espectrais de um enunciado; uso de um sistema; e método para a avaliação de pelo menos um parâmetro anatômico de uma via respiratória superior de um paciente pela análise de propriedades espectrais de um enunciado
AU2012325715A1 (en) 2011-10-20 2014-06-12 Albert VANGURA A hand-held tool for cutting laminated glass
WO2015161493A1 (en) * 2014-04-24 2015-10-29 Motorola Solutions, Inc. Method and apparatus for enhancing alveolar trill
US11672472B2 (en) * 2016-07-10 2023-06-13 B.G. Negev Technologies And Applications Ltd., At Ben-Gurion University Methods and systems for estimation of obstructive sleep apnea severity in wake subjects by multiple speech analyses
CN110013222A (zh) * 2019-04-03 2019-07-16 杭州电子科技大学 一种用于睡眠呼吸暂停检测的系统
EP3838137A1 (en) 2019-12-19 2021-06-23 Koninklijke Philips N.V. Automated and objective symptom severity score
CA3089395A1 (en) * 2020-06-18 2021-12-18 University Of Manitoba Systems and methods for screening obstructive sleep apnea during wakefulness using anthropometric information and tracheal breathing sounds
CN113571088B (zh) * 2021-07-27 2023-10-03 上海交通大学医学院附属第九人民医院 一种基于深度学习声纹识别的困难气道评估方法及装置
US11596334B1 (en) 2022-04-28 2023-03-07 Gmeci, Llc Systems and methods for determining actor status according to behavioral phenomena
US11882237B1 (en) 2022-11-30 2024-01-23 Gmeci, Llc Apparatus and methods for monitoring human trustworthiness

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5826570A (en) * 1991-03-05 1998-10-27 Aradigm Corporation Delivery of aerosol medications for inspiration
US6236963B1 (en) * 1998-03-16 2001-05-22 Atr Interpreting Telecommunications Research Laboratories Speaker normalization processor apparatus for generating frequency warping function, and speech recognition apparatus with said speaker normalization processor apparatus
JP2001249675A (ja) * 2000-03-07 2001-09-14 Atr Ningen Joho Tsushin Kenkyusho:Kk 調音状態の推定表示方法およびそのためのコンピュータプログラムを記録したコンピュータ読取可能な記録媒体
CA2585824A1 (en) 2007-03-29 2008-09-29 Telecommunications Research Laboratory Breathing sound analysis for detection of sleep apnea/hypopnea events
US20100252037A1 (en) * 2009-04-02 2010-10-07 Breathe Technologies, Inc. Methods, systems and devices for non-invasive open ventilation with gas delivery nozzles within nasal pillows
US20110240015A1 (en) * 2008-12-23 2011-10-06 Koninklijke Philips Electronics N.V. Method and apparatus comprising stepped mouthpiece for aerosol drug delivery

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2126240C1 (ru) * 1994-02-03 1999-02-20 Республиканское научно-практическое объединение медико-социальной реабилитации детей и подростков с врожденной челюстно-лицевой патологией и тяжелыми нарушениями речи "Бонум" Способ восстановления рече- и голосообразовательной функции у детей с ринолалией
US6726636B2 (en) * 2000-04-12 2004-04-27 Loran Technologies, Inc. Breathalyzer with voice recognition
US6666830B1 (en) 2000-08-17 2003-12-23 East River Ventures, Lp System and method for detecting the onset of an obstructive sleep apnea event
US6580944B1 (en) 2000-11-28 2003-06-17 The United States Of America As Represented By The Secretary Of The Navy Method and apparatus for diagnosing sleep breathing disorders while a patient in awake
US7160252B2 (en) 2003-01-10 2007-01-09 Medtronic, Inc. Method and apparatus for detecting respiratory disturbances
US20050197588A1 (en) * 2004-03-04 2005-09-08 Scott Freeberg Sleep disordered breathing alert system
US7640160B2 (en) * 2005-08-05 2009-12-29 Voicebox Technologies, Inc. Systems and methods for responding to natural language speech utterance
JP3887691B1 (ja) * 2006-07-18 2007-02-28 国立大学法人 岡山大学 音声の基本周波数検出方法及び声帯特性評価装置
JP4812029B2 (ja) * 2007-03-16 2011-11-09 富士通株式会社 音声認識システム、および、音声認識プログラム
US7559903B2 (en) * 2007-03-28 2009-07-14 Tr Technologies Inc. Breathing sound analysis for detection of sleep apnea/popnea events
US8297280B2 (en) 2007-07-20 2012-10-30 Canon Kabushiki Kaisha Inhaler
US20090285763A1 (en) * 2008-05-13 2009-11-19 Finlay Warren H Infant aerosol drug delivery systems and methods
US10387621B2 (en) * 2009-01-16 2019-08-20 Cerner Innovation, Inc. Matching of vibratory inhalers to patient vocal tract for optimization of particle dispersion
NZ617502A (en) * 2009-02-11 2015-05-29 Resmed Ltd Acoustic detection for respiratory treatment apparatus
JP5178607B2 (ja) 2009-03-31 2013-04-10 株式会社バンダイナムコゲームス プログラム、情報記憶媒体、口形状制御方法及び口形状制御装置
US8215302B2 (en) * 2009-09-22 2012-07-10 Kassatly L Samuel A Discontinuous positive airway pressure device and method of reducing sleep disordered breathing events
US9070357B1 (en) * 2011-05-11 2015-06-30 Brian K. Buchheit Using speech analysis to assess a speaker's physiological health
BR112014009233A8 (pt) 2011-10-20 2017-06-20 Koninklijke Philips Nv sistema para a caracterização de pelo menos um parâmetro anatômico de uma via respiratória superior de um paciente pela análise de propriedades espectrais de um enunciado; uso de um sistema; e método para a avaliação de pelo menos um parâmetro anatômico de uma via respiratória superior de um paciente pela análise de propriedades espectrais de um enunciado

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5826570A (en) * 1991-03-05 1998-10-27 Aradigm Corporation Delivery of aerosol medications for inspiration
US6236963B1 (en) * 1998-03-16 2001-05-22 Atr Interpreting Telecommunications Research Laboratories Speaker normalization processor apparatus for generating frequency warping function, and speech recognition apparatus with said speaker normalization processor apparatus
JP2001249675A (ja) * 2000-03-07 2001-09-14 Atr Ningen Joho Tsushin Kenkyusho:Kk 調音状態の推定表示方法およびそのためのコンピュータプログラムを記録したコンピュータ読取可能な記録媒体
CA2585824A1 (en) 2007-03-29 2008-09-29 Telecommunications Research Laboratory Breathing sound analysis for detection of sleep apnea/hypopnea events
US20110240015A1 (en) * 2008-12-23 2011-10-06 Koninklijke Philips Electronics N.V. Method and apparatus comprising stepped mouthpiece for aerosol drug delivery
US20100252037A1 (en) * 2009-04-02 2010-10-07 Breathe Technologies, Inc. Methods, systems and devices for non-invasive open ventilation with gas delivery nozzles within nasal pillows

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
D. HILL ET AL.: "Proceedings of AVIOS'95", 14TH ANNUAL INTERNATIONAL VOICE TECHNOLOGIES APPLICATIONS CONFERENCE OF THE AMERICAN VOICE I/O SOCIETY, 11 September 1995 (1995-09-11), pages 27 - 44
J KOREAN MED SCI, vol. 19, no. 5, 2004, pages 662 - 7
K. NIKANDER ET AL.: "Manipulation of upper airway volume using a stepped mouthpiece", ERS, September 2010 (2010-09-01)
ROBB ET AL.: "Vocal tract resonance characteristics of adults with obstructive sleep apnoea in", ACTA OTOLARYNGOLOGY, vol. 117, no. 5, 1997, pages 760 - 3

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104523236A (zh) * 2015-01-07 2015-04-22 厦门大学 一种抗干扰的喉振动发声测评装置
WO2019094155A1 (en) * 2016-11-10 2019-05-16 Sonde Health, Inc. System and method for activation and deactivation of cued health assessment
US10978181B2 (en) 2016-11-10 2021-04-13 Sonde Health, Inc. System and method for activation and deactivation of cued health assessment
US11869635B2 (en) 2016-11-10 2024-01-09 Sonde Health, Inc. System and method for activation and deactivation of cued health assessment
US11717214B2 (en) * 2017-05-05 2023-08-08 ResMed Pty Ltd Screening, diagnosis and monitoring of respiratory disorders
WO2020060290A1 (en) * 2018-09-20 2020-03-26 Samsung Electronics Co., Ltd. System and method for pulmonary condition monitoring and analysis
US11380351B2 (en) 2018-09-20 2022-07-05 Samsung Electronics Co., Ltd. System and method for pulmonary condition monitoring and analysis
FR3108492A1 (fr) * 2020-03-29 2021-10-01 Ghislaine ALAJOUANINE Dispositif de capture, d’enregistrement et d’analyse des bruits respiratoires
GB2603573B (en) * 2020-10-08 2023-07-26 Ibm Multi-Modal lung capacity measurement for respiratory illness prediction
US12023146B2 (en) 2020-10-08 2024-07-02 International Business Machines Corporation Multi-modal lung capacity measurement for respiratory illness prediction
CN116473521A (zh) * 2023-06-21 2023-07-25 四川大学华西医院 疑似环杓关节脱位声音频谱识别方法及系统
CN116473521B (zh) * 2023-06-21 2023-08-18 四川大学华西医院 疑似环杓关节脱位声音频谱识别方法及系统

Also Published As

Publication number Publication date
JP2014532448A (ja) 2014-12-08
CN103889324B (zh) 2017-05-17
MX352472B (es) 2017-11-27
US20140276228A1 (en) 2014-09-18
US10182787B2 (en) 2019-01-22
EP2744408B1 (en) 2022-02-16
EP2744408A1 (en) 2014-06-25
IN2014CN02660A (enExample) 2015-06-26
BR112014009233A8 (pt) 2017-06-20
RU2014120177A (ru) 2015-11-27
CN103889324A (zh) 2014-06-25
BR112014009233A2 (pt) 2017-06-13
MX2014004534A (es) 2014-07-28
RU2623129C2 (ru) 2017-06-22

Similar Documents

Publication Publication Date Title
US11207049B2 (en) System and method for characterizing an upper airway using speech characteristics
US10182787B2 (en) System and method for characterizing an upper airway using speech characteristics
CN112822976B (zh) 通过语音分析估计肺容量
KR20180115599A (ko) 발화 개선을 위한 두경부 물리 특성 기반의 가이드 및 피드백 시스템
JP6568071B2 (ja) 上気道の分析のためのシステム及び当該システムの作動方法、患者インタフェース装置、並びに、呼吸圧サポートシステム
CN102138795A (zh) 根据鼾声声学特征确定阻塞性睡眠呼吸暂停与低通气综合症严重程度的方法
JP6898912B2 (ja) 上気道を解析するシステム及び方法、並びに呼吸圧支持システム
Benavides et al. Formant frequencies and bandwidths in relation to clinical variables in an obstructive sleep apnea population
Werner et al. Inhalations in Speech: Acoustic and Physiological Characteristics.
Benavides et al. Using HMM to detect speakers with severe obstructive sleep apnoea syndrome
Lulich et al. Semi-occluded vocal tract exercises in healthy young adults: Articulatory, acoustic, and aerodynamic measurements during phonation at threshold
Salas Acoustic coupling in phonation and its effect on inverse filtering of oral airflow and neck surface acceleration
JPWO2021099279A5 (enExample)
KR102297353B1 (ko) 안면 구조에 적합한 휴대용 비강 개방도 측정장치
Slifka Respiratory constraints on speech production: Starting an utterance
Lundblad et al. Evaluation of Visual Feedback for fo and SPL in Subglottal Pressure Measurements—A Methodological Study
Tom et al. Vocal intensity in falsetto phonation of a countertenor: an analysis by synthesis approach
Zajac Speech Aerometry
WO2024091194A1 (en) Respiratory measurement and monitoring system
Frazer Approximating subglottal pressure from oral pressure: a methodological study
Hoffmeister et al. Characterization of upper esophageal sphincter pressures relative to vocal acoustics
Tseng et al. Effects of surgery on the relationship between subglottic pressure and fundamental frequency in vocal fold dynamics in patients with benign laryngeal diseases
Gregory Laryngeal Aspects of Infant Language Acquisition
Carmichael Instrumental assessment of respiratory and laryngeal function in patients with neurological disorders
Montero Benavides Statistical analysis of the connection between sleep apnea and speech

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12798375

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2014536371

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: MX/A/2014/004534

Country of ref document: MX

WWE Wipo information: entry into national phase

Ref document number: 14352336

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2014120177

Country of ref document: RU

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112014009233

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 112014009233

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20140416