CA2264642A1 - Psychological and physiological state assessment system based on voice recognition and its application to lie detection - Google Patents

Psychological and physiological state assessment system based on voice recognition and its application to lie detection Download PDF

Info

Publication number
CA2264642A1
CA2264642A1 CA002264642A CA2264642A CA2264642A1 CA 2264642 A1 CA2264642 A1 CA 2264642A1 CA 002264642 A CA002264642 A CA 002264642A CA 2264642 A CA2264642 A CA 2264642A CA 2264642 A1 CA2264642 A1 CA 2264642A1
Authority
CA
Canada
Prior art keywords
speech
psychological
test
characteristic
speech model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002264642A
Other languages
English (en)
French (fr)
Inventor
Rostislav Bogdashevsky
Vladimir Alexeev
Vitaly Yarigin
George Baker
Harrison Stanton
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dendrite Inc
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2264642A1 publication Critical patent/CA2264642A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification
    • G10L17/26—Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
CA002264642A 1997-03-19 1998-03-19 Psychological and physiological state assessment system based on voice recognition and its application to lie detection Abandoned CA2264642A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US08/820,566 US6006188A (en) 1997-03-19 1997-03-19 Speech signal processing for determining psychological or physiological characteristics using a knowledge base
US08/820,566 1997-03-19
PCT/US1998/005531 WO1998041977A1 (en) 1997-03-19 1998-03-19 Psychological and physiological state assessment system based on voice recognition and its application to lie detection

Publications (1)

Publication Number Publication Date
CA2264642A1 true CA2264642A1 (en) 1998-09-24

Family

ID=25231162

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002264642A Abandoned CA2264642A1 (en) 1997-03-19 1998-03-19 Psychological and physiological state assessment system based on voice recognition and its application to lie detection

Country Status (6)

Country Link
US (1) US6006188A (en.)
EP (1) EP0910850A1 (en.)
AU (1) AU6574298A (en.)
CA (1) CA2264642A1 (en.)
IL (1) IL128692A (en.)
WO (1) WO1998041977A1 (en.)

Families Citing this family (110)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6157913A (en) * 1996-11-25 2000-12-05 Bernstein; Jared C. Method and apparatus for estimating fitness to perform tasks based on linguistic and other aspects of spoken responses in constrained interactions
FI981508A (fi) * 1998-06-30 1999-12-31 Nokia Mobile Phones Ltd Menetelmä, laite ja järjestelmä käyttäjän tilan arvioimiseksi
IL128000A0 (en) * 1999-01-11 1999-11-30 Univ Ben Gurion A method for the diagnosis of thought states by analysis of interword silences
GB2348035B (en) * 1999-03-19 2003-05-28 Ibm Speech recognition system
GB9915842D0 (en) * 1999-07-06 1999-09-08 Btg Int Ltd Methods and apparatus for analysing a signal
US6480826B2 (en) * 1999-08-31 2002-11-12 Accenture Llp System and method for a telephonic emotion detection that provides operator feedback
US6275806B1 (en) * 1999-08-31 2001-08-14 Andersen Consulting, Llp System method and article of manufacture for detecting emotion in voice signals by utilizing statistics for voice signal parameters
US6697457B2 (en) 1999-08-31 2004-02-24 Accenture Llp Voice messaging system that organizes voice messages based on detected emotion
US7222075B2 (en) * 1999-08-31 2007-05-22 Accenture Llp Detecting emotions using voice signal analysis
US6427137B2 (en) * 1999-08-31 2002-07-30 Accenture Llp System, method and article of manufacture for a voice analysis system that detects nervousness for preventing fraud
US6363346B1 (en) * 1999-12-22 2002-03-26 Ncr Corporation Call distribution system inferring mental or physiological state
US6523008B1 (en) * 2000-02-18 2003-02-18 Adam Avrunin Method and system for truth-enabling internet communications via computer voice stress analysis
WO2003050799A1 (en) * 2001-12-12 2003-06-19 International Business Machines Corporation Method and system for non-intrusive speaker verification using behavior models
US6757362B1 (en) * 2000-03-06 2004-06-29 Avaya Technology Corp. Personal virtual assistant
US7917366B1 (en) * 2000-03-24 2011-03-29 Exaudios Technologies System and method for determining a personal SHG profile by voice analysis
US6910035B2 (en) * 2000-07-06 2005-06-21 Microsoft Corporation System and methods for providing automatic classification of media entities according to consonance properties
US7035873B2 (en) 2001-08-20 2006-04-25 Microsoft Corporation System and methods for providing adaptive media property classification
US6893265B2 (en) * 2000-08-11 2005-05-17 Energia, Inc. Color preference self-help system with improved color preference rankings and scoring
US6863534B1 (en) * 2000-08-11 2005-03-08 Energia, Inc. Color preference self-help system
US7062443B2 (en) * 2000-08-22 2006-06-13 Silverman Stephen E Methods and apparatus for evaluating near-term suicidal risk using vocal parameters
US6904408B1 (en) * 2000-10-19 2005-06-07 Mccarthy John Bionet method, system and personalized web content manager responsive to browser viewers' psychological preferences, behavioral responses and physiological stress indicators
US7366759B2 (en) * 2001-02-22 2008-04-29 Parity Communications, Inc. Method and system for characterizing relationships in social networks
EP1256937B1 (en) * 2001-05-11 2006-11-02 Sony France S.A. Emotion recognition method and device
US20020184075A1 (en) * 2001-05-31 2002-12-05 Hertz Paul T. Method and system for market segmentation
US6719707B1 (en) 2001-06-15 2004-04-13 Nathan Montgomery Apparatus and method for performing musical perception sound analysis on a system
US20030055634A1 (en) * 2001-08-08 2003-03-20 Nippon Telegraph And Telephone Corporation Speech processing method and apparatus and program therefor
EP1300831B1 (en) * 2001-10-05 2005-12-07 Sony Deutschland GmbH Method for detecting emotions involving subspace specialists
US7409373B2 (en) * 2001-12-28 2008-08-05 Concepta Ab Pattern analysis system and method
US7283962B2 (en) * 2002-03-21 2007-10-16 United States Of America As Represented By The Secretary Of The Army Methods and systems for detecting, measuring, and monitoring stress in speech
US7236963B1 (en) * 2002-03-25 2007-06-26 John E. LaMuth Inductive inference affective language analyzer simulating transitional artificial intelligence
AU2003265743B2 (en) * 2002-10-03 2008-02-14 Joachim Diederich Method and apparatus for assessing psychiatric or physical disorders
EP1545302A4 (en) * 2002-10-03 2008-12-17 Joachim Diederich METHOD AND DEVICE FOR THE INVESTIGATION OF PSYCHIATRICAL OR PHYSICAL DISEASES
SE0202948D0 (sv) * 2002-10-04 2002-10-04 Bergfalk & Knagenhjelm Ab Sätt att påvisa aktivitetsmönster som indikerar psykisk sjukdom, och motsvarande arrangemang
US7752045B2 (en) * 2002-10-07 2010-07-06 Carnegie Mellon University Systems and methods for comparing speech elements
US20040167774A1 (en) * 2002-11-27 2004-08-26 University Of Florida Audio-based method, system, and apparatus for measurement of voice quality
RU2320264C9 (ru) * 2003-06-24 2008-06-10 Лучин Марк Способ прогнозирования поведения человека и/или вида его деятельности, а также идентификации его личности
US7999857B2 (en) * 2003-07-25 2011-08-16 Stresscam Operations and Systems Ltd. Voice, lip-reading, face and emotion stress analysis, fuzzy logic intelligent camera system
KR20050027361A (ko) * 2003-09-15 2005-03-21 주식회사 팬택앤큐리텔 통화자 심리 상태 모니터링 기능을 가지는 통신 단말기 및 그 운용 방법
US20060036440A1 (en) * 2004-08-10 2006-02-16 Daniel Kunkel Biowaves technology
US8938390B2 (en) 2007-01-23 2015-01-20 Lena Foundation System and method for expressive language and developmental disorder assessment
US9240188B2 (en) * 2004-09-16 2016-01-19 Lena Foundation System and method for expressive language, developmental disorder, and emotion assessment
US10223934B2 (en) 2004-09-16 2019-03-05 Lena Foundation Systems and methods for expressive language, developmental disorder, and emotion assessment, and contextual feedback
US9355651B2 (en) 2004-09-16 2016-05-31 Lena Foundation System and method for expressive language, developmental disorder, and emotion assessment
WO2006043925A1 (en) * 2004-10-14 2006-04-27 John Mccarthy Bionet system for personalizing web content manager
US20080045805A1 (en) * 2004-11-30 2008-02-21 Oded Sarel Method and System of Indicating a Condition of an Individual
US7995717B2 (en) 2005-05-18 2011-08-09 Mattersight Corporation Method and system for analyzing separated voice data of a telephonic communication between a customer and a contact center by applying a psychological behavioral model thereto
US8094803B2 (en) 2005-05-18 2012-01-10 Mattersight Corporation Method and system for analyzing separated voice data of a telephonic communication between a customer and a contact center by applying a psychological behavioral model thereto
US8094790B2 (en) 2005-05-18 2012-01-10 Mattersight Corporation Method and software for training a customer service representative by analysis of a telephonic interaction between a customer and a contact center
US7511606B2 (en) 2005-05-18 2009-03-31 Lojack Operating Company Lp Vehicle locating unit with input voltage protection
US7580512B2 (en) * 2005-06-28 2009-08-25 Alcatel-Lucent Usa Inc. Selection of incoming call screening treatment based on emotional state criterion
US8478596B2 (en) * 2005-11-28 2013-07-02 Verizon Business Global Llc Impairment detection using speech
US20070150281A1 (en) * 2005-12-22 2007-06-28 Hoff Todd M Method and system for utilizing emotion to search content
WO2007072485A1 (en) * 2005-12-22 2007-06-28 Exaudios Technologies Ltd. System for indicating emotional attitudes through intonation analysis and methods thereof
CA2648706A1 (en) * 2006-04-20 2007-11-01 Iq Life, Inc. Monitoring system
US7571101B2 (en) * 2006-05-25 2009-08-04 Charles Humble Quantifying psychological stress levels using voice patterns
WO2007146437A2 (en) 2006-06-14 2007-12-21 Agent Science Technologies, Inc. User authentication system
WO2007149341A2 (en) 2006-06-14 2007-12-27 Agent Science Technologies, Inc. System to associate a demographic to a user of an electronic system
US8161530B2 (en) * 2006-07-11 2012-04-17 Identity Metrics, Inc. Behaviormetrics application system for electronic transaction authorization
US8452978B2 (en) * 2006-09-15 2013-05-28 Identity Metrics, LLC System and method for user authentication and dynamic usability of touch-screen devices
US8843754B2 (en) * 2006-09-15 2014-09-23 Identity Metrics, Inc. Continuous user identification and situation analysis with identification of anonymous users through behaviormetrics
CA2676380C (en) 2007-01-23 2015-11-24 Infoture, Inc. System and method for detection and analysis of speech
WO2008115927A2 (en) * 2007-03-20 2008-09-25 Cogito Health Inc. Methods and systems for performing a clinical assessment
US7869586B2 (en) 2007-03-30 2011-01-11 Eloyalty Corporation Method and system for aggregating and analyzing data relating to a plurality of interactions between a customer and a contact center and generating business process analytics
US8718262B2 (en) 2007-03-30 2014-05-06 Mattersight Corporation Method and system for automatically routing a telephonic communication base on analytic attributes associated with prior telephonic communication
US20080319276A1 (en) * 2007-03-30 2008-12-25 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Computational user-health testing
US8023639B2 (en) 2007-03-30 2011-09-20 Mattersight Corporation Method and system determining the complexity of a telephonic communication received by a contact center
US7945441B2 (en) * 2007-08-07 2011-05-17 Microsoft Corporation Quantized feature index trajectory
US10419611B2 (en) 2007-09-28 2019-09-17 Mattersight Corporation System and methods for determining trends in electronic communications
US8065293B2 (en) * 2007-10-24 2011-11-22 Microsoft Corporation Self-compacting pattern indexer: storing, indexing and accessing information in a graph-like data structure
US8346559B2 (en) 2007-12-20 2013-01-01 Dean Enterprises, Llc Detection of conditions from sound
JP5024154B2 (ja) * 2008-03-27 2012-09-12 富士通株式会社 関連付け装置、関連付け方法及びコンピュータプログラム
US8768489B2 (en) * 2008-06-13 2014-07-01 Gil Thieberger Detecting and using heart rate training zone
US8195460B2 (en) * 2008-06-17 2012-06-05 Voicesense Ltd. Speaker characterization through speech analysis
US20100057452A1 (en) * 2008-08-28 2010-03-04 Microsoft Corporation Speech interfaces
EP2333652B1 (en) * 2008-09-29 2016-11-02 Panasonic Intellectual Property Corporation of America Method and apparatus for improving privacy of users of a display device for several users wherein each user has a private space allocated to him
US8150695B1 (en) 2009-06-18 2012-04-03 Amazon Technologies, Inc. Presentation of written works based on character identities and attributes
WO2011011413A2 (en) * 2009-07-20 2011-01-27 University Of Florida Research Foundation, Inc. Method and apparatus for evaluation of a subject's emotional, physiological and/or physical state with the subject's physiological and/or acoustic data
US20110295597A1 (en) * 2010-05-26 2011-12-01 Brady Patrick K System and method for automated analysis of emotional content of speech
US20110294099A1 (en) * 2010-05-26 2011-12-01 Brady Patrick K System and method for automated analysis and diagnosis of psychological health
US8645136B2 (en) * 2010-07-20 2014-02-04 Intellisist, Inc. System and method for efficiently reducing transcription error using hybrid voice transcription
US9070357B1 (en) * 2011-05-11 2015-06-30 Brian K. Buchheit Using speech analysis to assess a speaker's physiological health
US8887044B1 (en) 2012-06-27 2014-11-11 Amazon Technologies, Inc. Visually distinguishing portions of content
US9299084B2 (en) 2012-11-28 2016-03-29 Wal-Mart Stores, Inc. Detecting customer dissatisfaction using biometric data
US9191510B2 (en) 2013-03-14 2015-11-17 Mattersight Corporation Methods and system for analyzing multichannel electronic communication data
US9899039B2 (en) * 2014-01-24 2018-02-20 Foundation Of Soongsil University-Industry Cooperation Method for determining alcohol consumption, and recording medium and terminal for carrying out same
US9934793B2 (en) * 2014-01-24 2018-04-03 Foundation Of Soongsil University-Industry Cooperation Method for determining alcohol consumption, and recording medium and terminal for carrying out same
US9916844B2 (en) * 2014-01-28 2018-03-13 Foundation Of Soongsil University-Industry Cooperation Method for determining alcohol consumption, and recording medium and terminal for carrying out same
KR101621797B1 (ko) 2014-03-28 2016-05-17 숭실대학교산학협력단 시간 영역에서의 차신호 에너지법에 의한 음주 판별 방법, 이를 수행하기 위한 기록 매체 및 장치
KR101621780B1 (ko) 2014-03-28 2016-05-17 숭실대학교산학협력단 차신호 주파수 프레임 비교법에 의한 음주 판별 방법, 이를 수행하기 위한 기록 매체 및 장치
KR101569343B1 (ko) 2014-03-28 2015-11-30 숭실대학교산학협력단 차신호 고주파 신호의 비교법에 의한 음주 판별 방법, 이를 수행하기 위한 기록 매체 및 장치
WO2016057781A1 (en) 2014-10-08 2016-04-14 The University Of Florida Research Foundation, Inc. Method and apparatus for non-contact fast vital sign acquisition based on radar signal
US20160135739A1 (en) * 2014-11-17 2016-05-19 Elwha LLC, a limited liability company of the State of Delaware Determining treatment compliance using combined performance indicators
US20160135738A1 (en) * 2014-11-17 2016-05-19 Elwha Llc Monitoring treatment compliance using passively captured task performance patterns
US20160135736A1 (en) * 2014-11-17 2016-05-19 Elwha LLC, a limited liability comany of the State of Delaware Monitoring treatment compliance using speech patterns captured during use of a communication system
US9589107B2 (en) 2014-11-17 2017-03-07 Elwha Llc Monitoring treatment compliance using speech patterns passively captured from a patient environment
US20160135737A1 (en) * 2014-11-17 2016-05-19 Elwha Llc Determining treatment compliance using speech patterns captured during use of a communication system
US20160140317A1 (en) * 2014-11-17 2016-05-19 Elwha Llc Determining treatment compliance using passively captured activity performance patterns
US10430557B2 (en) 2014-11-17 2019-10-01 Elwha Llc Monitoring treatment compliance using patient activity patterns
US9585616B2 (en) 2014-11-17 2017-03-07 Elwha Llc Determining treatment compliance using speech patterns passively captured from a patient environment
US20160140986A1 (en) * 2014-11-17 2016-05-19 Elwha Llc Monitoring treatment compliance using combined performance indicators
US9833200B2 (en) 2015-05-14 2017-12-05 University Of Florida Research Foundation, Inc. Low IF architectures for noncontact vital sign detection
US10930167B2 (en) * 2015-06-16 2021-02-23 Upchurch & Associates Inc. Sound association test
US9865281B2 (en) 2015-09-02 2018-01-09 International Business Machines Corporation Conversational analytics
US10008201B2 (en) * 2015-09-28 2018-06-26 GM Global Technology Operations LLC Streamlined navigational speech recognition
JP6748965B2 (ja) * 2016-09-27 2020-09-02 パナソニックＩｐマネジメント株式会社 認知機能評価装置、認知機能評価方法、およびプログラム
WO2019113477A1 (en) 2017-12-07 2019-06-13 Lena Foundation Systems and methods for automatic determination of infant cry and discrimination of cry from fussiness
RU2679217C1 (ru) * 2018-01-31 2019-02-06 Федеральное государственное казенное военное образовательное учреждение высшего образования "Академия Федеральной службы охраны Российской Федерации" (Академия ФСО России) Способ определения истинности речевой информации
US11495244B2 (en) 2018-04-04 2022-11-08 Pindrop Security, Inc. Voice modification detection using physical models of speech production
US11080484B1 (en) * 2020-10-08 2021-08-03 Omniscient Neurotechnology Pty Limited Natural language processing of electronic records
US20240051390A1 (en) * 2022-08-12 2024-02-15 Reby Inc. Detecting sobriety and fatigue impairment of the rider using face and voice recognition

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3971034A (en) * 1971-02-09 1976-07-20 Dektor Counterintelligence And Security, Inc. Physiological response analysis method and apparatus
US3855416A (en) * 1972-12-01 1974-12-17 F Fuller Method and apparatus for phonation analysis leading to valid truth/lie decisions by fundamental speech-energy weighted vibratto component assessment
US3855417A (en) * 1972-12-01 1974-12-17 F Fuller Method and apparatus for phonation analysis lending to valid truth/lie decisions by spectral energy region comparison
US3855418A (en) * 1972-12-01 1974-12-17 F Fuller Method and apparatus for phonation analysis leading to valid truth/lie decisions by vibratto component assessment
US4020567A (en) * 1973-01-11 1977-05-03 Webster Ronald L Method and stuttering therapy apparatus
US4093821A (en) * 1977-06-14 1978-06-06 John Decatur Williamson Speech analyzer for analyzing pitch or frequency perturbations in individual speech pattern to determine the emotional state of the person
US4490840A (en) * 1982-03-30 1984-12-25 Jones Joseph M Oral sound analysis method and apparatus for determining voice, speech and perceptual styles
US5148483A (en) * 1983-08-11 1992-09-15 Silverman Stephen E Method for detecting suicidal predisposition
US4675904A (en) * 1983-08-11 1987-06-23 Compusonics, Inc. Method for detecting suicidal predisposition
US4752889A (en) * 1986-08-18 1988-06-21 Neuron Data, Inc. Dynamic, interactive display system for a knowledge base
JPH01134628A (ja) * 1987-11-20 1989-05-26 Hitachi Ltd データベースの知識化利用方式
GB2237135A (en) * 1989-10-16 1991-04-24 Logica Uk Ltd Speaker recognition
US5369727A (en) * 1991-05-16 1994-11-29 Matsushita Electric Industrial Co., Ltd. Method of speech recognition with correlation of similarities
US5351338A (en) * 1992-07-06 1994-09-27 Telefonaktiebolaget L M Ericsson Time variable spectral analysis based on interpolation for speech coding
EP0656761A4 (en) * 1992-08-21 1995-07-26 Peter L Brill METHOD AND DEVICE FOR EVALUATING PSYCHOTHERAPEUTIC TREATMENT RESULTS.
IL108401A (en) * 1994-01-21 1996-12-05 Hashavshevet Manufacture 1988 Method and apparatus for indicating the emotional state of a person
US5516289A (en) * 1995-06-19 1996-05-14 Quigley; Joan C. Astrological comparison wheel

Also Published As

Publication number Publication date
WO1998041977A1 (en) 1998-09-24
US6006188A (en) 1999-12-21
IL128692A0 (en) 2000-01-31
IL128692A (en) 2003-11-23
AU6574298A (en) 1998-10-12
EP0910850A1 (en) 1999-04-28

Similar Documents

Publication Publication Date Title
US6006188A (en) Speech signal processing for determining psychological or physiological characteristics using a knowledge base
WO1998041977A9 (en) Psychological and physiological state assessment system based on voice recognition and its application to lie detection
CN107657964B (zh) 基于声学特征和稀疏数学的抑郁症辅助检测方法及分类器
Moran et al. Telephony-based voice pathology assessment using automated speech analysis
Tompkins et al. Perception of emotional intonation by brain-damaged adults: The influence of task processing levels
Steeneken et al. Speech under stress conditions: overview of the effect on speech production and on system performance
Breitenstein et al. The contribution of speech rate and pitch variation to the perception of vocal emotions in a German and an American sample
Huber et al. Impact of typical aging and Parkinson’s disease on the relationship among breath pausing, syntax, and punctuation
US7283962B2 (en) Methods and systems for detecting, measuring, and monitoring stress in speech
US7606701B2 (en) Method and apparatus for determining emotional arousal by speech analysis
US8788270B2 (en) Apparatus and method for determining an emotion state of a speaker
US20080045805A1 (en) Method and System of Indicating a Condition of an Individual
Natour et al. Fundamental frequency characteristics of Jordanian Arabic speakers
Bugdol et al. Prediction of menarcheal status of girls using voice features
Khan et al. Assessing Parkinson's disease severity using speech analysis in non-native speakers
Friend et al. A comparison of content‐masking procedures for obtaining judgments of discrete affective states
Ghitza Adequacy of auditory models to predict human internal representation of speech sounds
Pausewang Gelfer A multidimensional scaling study of voice quality in females
Hsieh et al. Temporal integration in absolute identification of musical pitch
Wang Detecting pronunciation errors in spoken English tests based on multifeature fusion algorithm
Palmieri Assessment of the vocal status of multiple sclerosis patients-comparison with healthy subjects and evaluation of vocal rehabilitation
Cole et al. Mechanisms of aural encoding: I. Distinctive features for consonants
Xie et al. Machine learning applied to GRBAS voice quality assessment
Sigmund et al. Statistical analysis of glottal pulses in speech under psychological stress
Fantoni Assessment of Vocal Fatigue of Multiple Sclerosis Patients. Validation of a Contact Microphone-based Device for Long-Term Monitoring

Legal Events

Date Code Title Description
EEER Examination request
FZDE Discontinued