WO2023059331A1 - Learning apparatus, analysis apparatus, learning method, analysis method, and program - Google Patents

Learning apparatus, analysis apparatus, learning method, analysis method, and program Download PDF

Info

Publication number
WO2023059331A1
WO2023059331A1 PCT/US2021/054086 US2021054086W WO2023059331A1 WO 2023059331 A1 WO2023059331 A1 WO 2023059331A1 US 2021054086 W US2021054086 W US 2021054086W WO 2023059331 A1 WO2023059331 A1 WO 2023059331A1
Authority
WO
WIPO (PCT)
Prior art keywords
time series
linear sum
oscillator
learning
analysis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2021/054086
Other languages
French (fr)
Inventor
Ryohei SHIBUE
Kunio Kashino
Masahiro Nakano
Hitonobu Tomoike
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NTT Inc
NTT Research Inc
Original Assignee
Nippon Telegraph and Telephone Corp
NTT Research Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Telegraph and Telephone Corp, NTT Research Inc filed Critical Nippon Telegraph and Telephone Corp
Priority to JP2024520687A priority Critical patent/JP7712482B2/en
Priority to US18/695,959 priority patent/US20240395406A1/en
Priority to PCT/US2021/054086 priority patent/WO2023059331A1/en
Publication of WO2023059331A1 publication Critical patent/WO2023059331A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/18—Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00—Computing arrangements based on specific mathematical models
    • G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients

Definitions

  • the present invention relates to a learning apparatus, an analysis apparatus, a learning method, an analysis method, and program.
  • Cardiac sounds are an important clue for knowing the condition of a patient’ s circulatory system.
  • Non-Patent Document 8 S Ari and Go Saha, “Classification of heart sounds using empirical mode decomposition based features,” Int. J. Med. Eng. Inform., vol. 1, no. 1, pp. 91-108, 2008.
  • a waveform indicated by a time series of a cardiac sound is decomposed into amplitude waveforms of a plurality of oscillators whose amplitudes change periodically. That is, the waveform of the time series of the cardiac sound is a linear sum of amplitude waveforms of a plurality of fluctuating oscillators.
  • a fluctuating oscillator is an oscillator whose amplitude changes periodically.
  • the present invention was contrived in view of such circumstances, and an object thereof is to provide a technique of improving the accuracy of analysis of a time series represented by a linear sum of amplitude waveforms of a fluctuating oscillator - whose amplitude changes periodically.
  • a learning apparatus including: a time series acquisition unit that is configured to, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquire an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series; and a learning processing execution unit that is configured to use an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, wherein the learning processing execution unit is configured to update the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model.
  • an analysis apparatus including: an analysis target acquisition unit that is configured to acquire a time series which is a target for analysis; and an analysis unit that is configured to analyze a time series which is a target for analysis using a learned linear sum estimation learning model obtained by a learning apparatus including a time series acquisition unit that is configured to, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquire an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series and a learning processing execution unit that is configured to use an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the
  • a learning method including: a time series acquisition step of, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquiring an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series; and a learning process execution step of using an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, wherein the learning process execution step includes updating the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model.
  • an analysis method including: an analysis target acquisition step of acquiring a time series which is a target for analysis; and an analysis step of analyzing a time series which is a target for analysis using a learned linear sum estimation learning model obtained by a learning apparatus including a time series acquisition unit that is configured to, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquire an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series and a learning processing execution unit that is configured to use an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed
  • Fig. 1 is a diagram illustrating an example of a configuration of an analysis system of an embodiment.
  • Fig. 2 is a diagram illustrating an example of a hardware configuration of a learning apparatus in the embodiment.
  • Fig. 3 is a diagram illustrating an example of a configuration of a control unit included in the learning apparatus in the embodiment.
  • Fig. 4 is a flow chart illustrating an example of a flow of processes which are executed by the learning apparatus in the embodiment.
  • Fig. 5 is a diagram illustrating an example of a hardware configuration of an analysis apparatus in the embodiment.
  • Fig. 6 is a diagram illustrating an example of a configuration of a control unit included in the analysis apparatus in the embodiment.
  • Fig. 7 is a flow chart illustrating an example of a flow of processes which are executed by the analysis apparatus in the embodiment.
  • Fig. 8 is a first diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
  • Fig. 9 is a second diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
  • Fig. 10 is a third diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
  • Fig. 11 is a fourth diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
  • Fig. 12 is a fifth diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
  • Fig. 13 is a sixth diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
  • Fig. 14 is a seventh diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
  • Fig. 15 is an eighth diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
  • Fig. 1 is a diagram illustrating an example of a configuration of an analysis system 100 of an embodiment.
  • the analysis system 100 will be described with a case in which a target for analysis in the analysis system 100 is a time series of a cardiac sound (hereinafter referred to as a “cardiac sound time series”) and the analysis system 100 estimates the condition of a heart which is a generation source of a cardiac sound time series on the basis of the cardiac sound time series as an example.
  • a target for analysis in the analysis system 100 is a time series of a cardiac sound (hereinafter referred to as a “cardiac sound time series”) and the analysis system 100 estimates the condition of a heart which is a generation source of a cardiac sound time series on the basis of the cardiac sound time series as an example.
  • cardiac sound time series a time series of a cardiac sound
  • a time series which is a target for analysis in the analysis system 100 does not necessarily have to be a time series of a cardiac sound.
  • the time series which is a target for analysis in the analysis system 100 may be any time series insofar as it is a time series represented by a linear sum of amplitude waveforms of an oscillator whose amplitude changes periodically (hereinafter referred to as a “fluctuating oscillator”). Since the waveform is a time series, the linear sum of amplitude waveforms of a fluctuating oscillator is a linear sum of an amplitude time series of a fluctuating oscillator.
  • an amplitude time series of a fluctuating oscillator is referred to as “oscillator time series”.
  • a linear sum of oscillator time series is referred to as “oscillator linear sum”.
  • the result of analysis which is output by the analysis system 100 does not necessarily have to be the result of estimation of the condition of a heart.
  • the result of analysis which is output by the analysis system 100 may be any result insofar as it is a result obtained on the basis of the oscillator linear sum.
  • the result of analysis which is output by the analysis system 100 may be an amplitude time series of each fluctuating oscillator of the oscillator linear sum.
  • the analysis system 100 includes a learning apparatus 1 and an analysis apparatus 2.
  • the learning apparatus 1 updates a machine learning model that estimates an oscillator linear sum (hereinafter referred to as a “linear sum estimation learning model”) through learning on the basis of an input cardiac sound time series.
  • the machine learning model is a mathematical model including one or a plurality of processes in which the condition and order of execution (hereinafter referred to as an “execution rule”) are determined in advance.
  • the term “learning” refers to updating a machine learning model using a machine learning method.
  • updating a machine learning model involves appropriately adjusting values of predetermined parameters included in the machine learning model.
  • the execution of a machine learning model involves executing each process included in the machine learning model in accordance with the execution rule.
  • the machine learning model is represented by, for example, a neural network.
  • the neural network is a circuit such as an electronic circuit, an electrical circuit, an optical circuit, or an integrated circuit and is a circuit that represents a machine learning model. Updating a machine learning model means also to update a neural network that represents the machine learning model by learning. Updating a neural network by learning means to update values of parameters of the neural network.
  • the parameters of a neural network are parameters of a circuit constituting the neural network, and are also parameters of a learning model represented by the circuit constituting the neural network.
  • the neural network that represents a linear sum estimation learning model may be any neural network insofar as it is a neural network capable of representing the linear sum estimation learning model.
  • the neural network that represents a linear sum estimation learning model is, for example, a deep neural network.
  • the learning apparatus 1 learns a linear sum estimation learning model until a predetermined end condition (hereinafter referred to as a “learning end condition”) is satisfied.
  • the learning end condition is, for example, a condition that learning has been performed a predetermined number of times.
  • the learning end condition may be, for example, a condition that a change of a linear sum estimation learning model due to update is smaller than a predetermined change.
  • the analysis apparatus 2 uses a learned linear sum estimation learning model obtained by the learning apparatus 1 to estimate an oscillator linear sum indicating an input cardiac sound time series.
  • the learned linear sum estimation learning model is a linear sum estimation learning model at a timing when the learning end condition is satisfied.
  • the linear sum estimation learning model includes a machine learning model that estimates the posterior distribution of the state of a cardiac cycle on the basis of the input cardiac sound time series.
  • a machine learning model that estimates the posterior distribution of the state of a cardiac cycle on the basis of the input cardiac sound time series is referred to as a “cardiac cycle state posterior distribution learning model”.
  • the linear sum estimation learning model includes a machine learning model that estimates the posterior distribution of an oscillator time series on the basis of the posterior distribution of the state of a cardiac cycle.
  • a machine learning model that estimates the posterior distribution of an oscillator time series on the basis of the posterior distribution of the state of a cardiac cycle is referred to as an “oscillator time series posterior distribution learning model”
  • the linear sum estimation learning model includes a machine learning model that estimates the marginal distribution of a cardiac sound time series using the posterior distribution of an oscillator time series.
  • a machine learning model that estimates the marginal distribution of a cardiac sound time series using the posterior distribution of an oscillator time series is referred to as a “cardiac sound time series marginal distribution learning model”.
  • the learning process includes a time series input process, a cardiac cycle state posterior distribution estimation process, an oscillator time series posterior distribution estimation process, a cardiac sound time series marginal distribution estimation process, and an update process.
  • the time series input process is a process in which a cardiac sound time series is input to a linear sum estimation learning model.
  • the cardiac cycle state posterior distribution estimation process is a process of estimating the posterior distribution of the state of a cardiac cycle on the basis of the input cardiac sound time series by the execution of a cardiac cycle state posterior distribution learning model.
  • the oscillator time series posterior distribution estimation process is a process of estimating the posterior distribution of an oscillator time series on the basis of the posterior distribution of the state of a cardiac cycle by the execution of an oscillator time series posterior distribution learning model.
  • the cardiac sound time series marginal distribution estimation process is a process of estimating the marginal distribution of a cardiac sound time series using the posterior distribution of an oscillator time series by the execution of a cardiac sound time series marginal distribution learning model.
  • the update process is a process of updating a linear sum estimation learning model so that a cardiac sound time series which is input through the time series input process increases a marginal likelihood based on the marginal distribution estimated in the cardiac sound time series marginal distribution estimation process.
  • Updating a linear sum estimation learning model involves, more specifically, updating a cardiac cycle state posterior distribution learning model, an oscillator time series posterior distribution learning model, and a cardiac sound time series marginal distribution learning model.
  • the cardiac cycle state posterior distribution learning model may be any mathematical model insofar as the posterior distribution of the state of a cardiac cycle can be calculated on the basis of a cardiac sound time series.
  • States of a cardiac cycle include four states, that is, an SI sound, a systolic phase, an S2 sound, and a diastolic phase.
  • the four states of the cardiac cycle that is, an SI sound, a systolic phase, an S2 sound, and a diastolic phase are periodically repeated. More specifically, the state of the cardiac cycle transitions from the state of the S 1 sound to the state of the systolic phase.
  • the state of the cardiac cycle transitions from the state of the systolic phase to the state of the S2 sound.
  • the state of the cardiac cycle transitions from the state of the S2 sound to the state of the diastolic phase.
  • the state of the cardiac cycle transitions from the state of the diastolic phase to the state of the S 1 sound.
  • the cardiac sound time series is a time series in which the amplitudes of a nonlinear oscillator mainly equivalent to the oscillation of an intracardiac valve are added to each other while changing periodically
  • the cardiac cycle state posterior distribution learning model is, for example, a mathematical model that acquires a posterior probability distribution which is represented by the following Expression (1) on the basis of the cardiac sound time series.
  • the cardiac sound time series is represented by the following Expression (2).
  • J is the number of microphones that acquire a cardiac sound.
  • R is the length of the cardiac sound time series.
  • z r is an unobserved state of the cardiac sound time series at the r-th time. The unobserved state is specifically the state of the cardiac cycle. Since there are four states of the cardiac cycle as described above, the possible values of z r are 1 to 4 as shown in Expression (4).
  • the state of the cardiac cycle does not transition to the next state immediately after state transition occurs.
  • the post-transition state continues for a finite period of time. That is, in each state of the cardiac cycle, there is a finite duration until the transition to the next state. Consequently, the transition probability defined by the following Expression (7) is defined.
  • a in Expression (8) is a transition matrix.
  • pj(8) is the distribution of duration.
  • the distribution of duration represented by pj(8) is represented by, for example, the negative binomial distribution of the following Expression (9).
  • 0j is the probability of success of a trial
  • m is a shape parameter.
  • e r in Expression (6) is a pseudo-state.
  • the pseudo-state is an amount indicating how long each state has continued.
  • z r A ⁇ - ⁇ which is defined by Expression (5) using the pseudo-states e r and z r . follows a Markov process with a probability transition matrix which is determined by (7), (8) and (9). Meanwhile, hereinafter, a symbol with a bar above the symbol is represented as symbol A ⁇ - ⁇ . For example, z r A ⁇ - ⁇ indicates a symbol with a bar above the symbol z r .
  • z r A ⁇ - ⁇ indicates the symbol on the left side of Expression (5).
  • the probability of z r coincides with the probability of marginalizing z r A ⁇ - ⁇ with respect to the pseudo-state.
  • the amount of calculation for calculating the value of Expression (1) can be reduced to the order of 4mR.
  • the approximate expression of the above (13) is an example, and the potential may be any function insofar as it is a part of the function representing the posterior probability distribution of the state of the cardiac cycle and a function in which content to be represented is defined in advance.
  • An expression indicating the potential is obtained using a machine learning model such as, for example, a neural network on the basis of the cardiac sound time series. Therefore, in a case where the posterior probability distribution of the state of the cardiac cycle is represented using the potential, the expression indicating the potential is also updated in learning of the linear sum estimation learning model.
  • the oscillator time series posterior distribution learning model is a mathematical model representing the relationship between a probabilistic state transition such as a hidden Markov model or a hidden semi-Markov model and a symbol output that is information which is probabilistically output in each state.
  • the state in the mathematical model representing the relationship between a probabilistic state transition and a symbol output is the state of the cardiac cycle.
  • the symbol output in the mathematical model representing the relationship between a probabilistic state transition and a symbol output is an oscillator time series.
  • the mathematical model representing the relationship between a probabilistic state transition and a symbol output is a hidden semi-Markov model
  • the mathematical model also represents the duration of each state.
  • the cardiac sound time series marginal distribution learning model will be described in more detail.
  • the cardiac sound time series is observed as the linear sum of the fluctuating oscillators in accordance with Expression (14).
  • Expression (19) is a distribution followed by the fluctuating oscillator and an expression derived from
  • Expression (17) representing the generation mechanism of the cardiac sound time series.
  • Expression (17) is a differential equation representing the generation mechanism of the cardiac sound time series.
  • r is the variance of an observation noise distribution.
  • the amount y ri on the left side of Expression (16) indicates the amplitude of the 1-th fluctuation oscillator at a time r.
  • M is the mass of the valve of the heart.
  • u is the displacement of the valve of the heart.
  • AP is pressure exerted on the valve of the heart.
  • D is an attenuation coefficient indicating the magnitude of movement attenuation of the valve of the heart.
  • K is the stiffness coefficient of the valve of the heart.
  • C and a are constants.
  • co is an angular frequency
  • vp is an initial phase shift
  • t is a time.
  • ai is the attenuation coefficient of the 1-th fluctuation oscillator
  • fi is the average frequency of the 1-th fluctuation oscillator
  • f s is a sampling frequency
  • on 2 is the variance of a system noise distribution.
  • the variance oii 2 strongly depends on the state of the cardiac cycle, and changes a dominant fluctuating oscillator included in the cardiac sound time series on the basis of the state of the cardiac cycle. Particularly, a large value of the variance on 2 means that the 1-th fluctuation oscillator is dominant in a case where the state of the cardiac cycle is i.
  • the linear sum estimation learning model is updated so as to maximize a log marginal likelihood represented by the following Expression (20).
  • the linear sum estimation learning model may be updated so as to maximize the lower bound of the likelihood represented by the following Expression (21).
  • updating the linear sum estimation learning model means specifically updating, for example, ⁇ 0j ⁇ , ⁇ ai ⁇ , ⁇ fi ⁇ , ⁇ on ⁇ , ⁇ gji ⁇ and r.
  • Expression (23) in Expression (22) represents Expression (14).
  • Expression (24) in Expression (22) represents Expression (19).
  • Expression (25) in Expression (22) is the transition probability of z A ⁇ - ⁇ which is derived from Expressions (7), (8), (9), and (10).
  • the potential is included in Expression (27), and as described above, the expression indicating the potential is obtained by a machine learning model such as a neural network.
  • the potential is, for example, the following Expression (28).
  • cp(-) appearing on the right side of Expression (28) is a mapping from the following Expression (29) to the following Expression (30).
  • s is a window length having a fixed length determined in advance.
  • the symbol of the following Expression (31) appearing on the right side of Expression (28) is an operator for returning the (i, 8)-th element of an input matrix.
  • the input matrix is specifically (30) expression.
  • CNN convolutional neural network
  • RNN recurrent neural network
  • Expression (32) and the following Expression (33) are a z A ⁇ - ⁇ initial probability and a transition probability which are derived from Expressions
  • the lower bound of the likelihood represented by Expression (21) is maximized with the amount of calculation smaller than the amount of calculation required to maximize the log marginal likelihood represented by Expression (20).
  • Expression (34) is specifically derived by modifying the following Expressions (36) and (37).
  • Fig. 2 is a diagram illustrating an example of a hardware configuration of the learning apparatus 1 in the embodiment.
  • the learning apparatus 1 includes a control unit 11 provided with an processor 91 such as a central processing unit (CPU) and a memory 92 which are connected to each other through a bus, and executes a program.
  • the learning apparatus 1 functions as a device including the control unit 11, an input unit 12, a communication unit 13, a storage unit 14, and an output unit 15 by executing a program.
  • the processor 91 reads out the program stored in the storage unit 14, and stores the read-out program in the memory 92.
  • the learning apparatus 1 functions as the device including the control unit 11, the input unit 12, the communication unit 13, the storage unit 14, and the output unit 15.
  • the control unit 11 controls operations of various functional units included in the learning apparatus 1.
  • the control unit 11 executes a learning process.
  • the control unit 11 controls, for example, an operation of the output unit 15, and causes the output unit 15 to output the execution result of the learning process.
  • the control unit 11 records, for example, various types of information generated by the execution of the learning process in the storage unit 14.
  • Various types of information stored in the storage unit 14 include, for example, the learning result of the linear sum estimation learning model.
  • the input unit 12 is configured to include an input device such as a mouse, a keyboard, or a touch panel.
  • the input unit 12 may be configured as an interface for connecting the input device to the learning apparatus 1.
  • the input unit 12 accepts inputs of various types of information to the learning apparatus 1. For example, the cardiac sound time series is input to the input unit 12.
  • the communication unit 13 is configured to include a communication interface for connecting the learning apparatus 1 to an external device.
  • the communication unit 13 communicates with the external device through wired or wireless connection.
  • the external device is, for example, a device which is a transmission source of the cardiac sound time series.
  • the external device is, for example, the analysis apparatus 2.
  • the communication unit 13 transmits the linear sum estimation learning model learned through communication with the analysis apparatus 2 to the analysis apparatus 2.
  • the storage unit 14 is configured using a computer readable storage medium device such as a magnetic hard disk device or a semiconductor storage device.
  • the storage unit 14 stores various types of information relating to the learning apparatus 1.
  • the storage unit 14 stores, for example, information which is input through the input unit 12 or the communication unit 13.
  • the storage unit 14 stores, for example, the linear sum estimation learning model.
  • the storage unit 14 stores, for example, various types of information generated by the execution of the learning process.
  • the output unit 15 outputs various types of information.
  • the output unit 15 is configured to include a display device such as, for example, a cathode ray tube (CRT) display, a liquid crystal display, or an organic electro-luminescence (EL) display.
  • the output unit 15 may be configured as an interface for connecting the display device to the learning apparatus 1.
  • the output unit 15 outputs, for example, information which is input to the input unit 12 or the communication unit 13.
  • the output unit 15 may display, for example, the execution result of the learning process.
  • Fig. 3 is a diagram illustrating an example of a configuration of the control unit 11 included in the learning apparatus 1 in the embodiment.
  • the control unit 11 includes a cardiac sound time series acquisition unit 111, a learning processing execution unit 112, an end determination unit 113, a recording unit 114, and an output control unit 115.
  • the cardiac sound time series acquisition unit 111 acquires the cardiac sound time series which is input to the input unit 12 or the communication unit 13. In a case where the cardiac sound time series has been recorded in the storage unit 14 in advance, the cardiac sound time series acquisition unit 111 may read out the cardiac sound time series from the storage unit 14. [0111]
  • the learning processing execution unit 112 executes the learning process.
  • the end determination unit 113 determines whether the learning end condition is satisfied.
  • the linear sum estimation learning model which is obtained through the learning process executed by the learning processing execution unit 112 and which is the linear sum estimation learning model at a point in time when the learning end condition is satisfied by the end determination unit 113 is the learned linear sum estimation learning model.
  • the learning processing execution unit 112 includes a time series input unit 121, a cardiac cycle state posterior distribution estimation unit 122, an oscillator time series posterior distribution estimation unit 123, a cardiac sound time series marginal distribution estimation unit 124, and an update unit 125. [0113]
  • the time series input unit 121 executes the time series input process with respect to the cardiac sound time series acquired by the cardiac sound time series acquisition unit 111. That is, the time series input unit 121 inputs the cardiac sound time series acquired by the cardiac sound time series acquisition unit 111 to the linear sum estimation learning model.
  • the cardiac cycle state posterior distribution estimation unit 122 executes the cardiac cycle state posterior distribution estimation process.
  • the oscillator time series posterior distribution estimation unit 123 executes the oscillator time series posterior distribution estimation process.
  • the cardiac sound time series marginal distribution estimation unit 124 executes the cardiac sound time series marginal distribution estimation process.
  • the update unit 125 executes the update process.
  • the recording unit 114 records various types of information in the storage unit 14.
  • the output control unit 115 controls the operation of the output unit 15. [0116]
  • Fig. 4 is a flow chart illustrating an example of a flow of processes which are executed by the learning apparatus 1 in the embodiment.
  • the time series input unit 121 inputs the cardiac sound time series to linear sum estimation learning model (step S 101).
  • the cardiac cycle state posterior distribution estimation unit 122 executes the cardiac cycle state posterior distribution estimation process (step S 102). That is, the cardiac cycle state posterior distribution estimation unit 122 estimates the posterior distribution of the state of the cardiac cycle on the basis of the input cardiac sound time series.
  • the oscillator time series posterior distribution estimation unit 123 executes the oscillator time series posterior distribution estimation process (step S103). That is, the oscillator time series posterior distribution estimation unit 123 estimates the posterior distribution of the oscillator time series on the basis of the posterior distribution of the state of the cardiac cycle.
  • the cardiac sound time series marginal distribution estimation unit 124 executes the cardiac sound time series marginal distribution estimation process (step S104). That is, the cardiac sound time series marginal distribution estimation unit 124 estimates the marginal distribution of the cardiac sound time series using the posterior distribution of the oscillator time series.
  • the update unit 125 executes the update process (step S105). The linear sum estimation learning model is updated by executing the update process.
  • step S106 determines whether the learning end condition is satisfied. In a case where the learning end condition is not satisfied (step S106: NO), the flow returns to the process of step S 101. On the other hand, in a case where the learning end condition is satisfied (step S106: YES), the process ends.
  • Fig. 5 is a diagram illustrating an example of a hardware configuration of the analysis apparatus 2 in the embodiment.
  • the analysis apparatus 2 includes a control unit 21 provided with a processor 93 such as a CPU and a memory 94 which are connected to each other through a bus, and executes a program.
  • the analysis apparatus 2 functions as a device including the control unit 21, an input unit 22, a communication unit 23, a storage unit 24, and an output unit 25 by executing a program.
  • the processor 93 reads out the program stored in the storage unit 24, and stores the read-out program in the memory 94.
  • the analysis apparatus 2 functions as the device including the control unit 21, the input unit 22, the communication unit 23, the storage unit 24, and the output unit 25.
  • the control unit 21 controls operations of various functional units included in the analysis apparatus 2.
  • the control unit 21 executes the learned linear sum estimation learning model.
  • the control unit 21 controls, for example, an operation of the output unit 25, and causes the output unit 25 to output the execution result of the learned linear sum estimation learning model.
  • the control unit 21 records, for example, various types of information generated by executing the learned linear sum estimation learning model in the storage unit 24.
  • the input unit 22 is configured to include an input device such as a mouse, a keyboard, or a touch panel.
  • the input unit 22 may be configured as an interface for connecting the input device to the analysis apparatus 2.
  • the input unit 22 accepts inputs of various types of information to the analysis apparatus 2. For example, the cardiac sound time series which is a target for analysis is input to the input unit 22.
  • the communication unit 23 is configured to include a communication interface for connecting the analysis apparatus 2 to an external device.
  • the communication unit 23 communicates with the external device through wired or wireless connection.
  • the external device is, for example, a device that is a transmission source of the cardiac sound time series which is a target for analysis.
  • the external device is, for example, the learning apparatus 1.
  • the communication unit 23 acquires the linear sum estimation learning model learned through communication with the learning apparatus 1.
  • the storage unit 24 is configured using a computer readable storage medium device such as a magnetic hard disk device or a semiconductor storage device.
  • the storage unit 24 stores various types of information relating to the analysis apparatus 2.
  • the storage unit 24 stores, for example, information which is input through the input unit 22 or the communication unit 23.
  • the storage unit 24 stores, for example, the learned linear sum estimation learning model.
  • the storage unit 24 stores, for example, various types of information generated by the execution of the learned linear sum estimation learning model.
  • the output unit 25 outputs various types of information.
  • the output unit 25 is configured to include a display device such as, for example, a CRT display, a liquid crystal display, or an organic EL display.
  • the output unit 25 may be configured as an interface for connecting the display device to the analysis apparatus 2.
  • the output unit 25 outputs, for example, information which is input to the input unit 22 or the communication unit 23.
  • the output unit 25 may display, for example, the execution result of the learned linear sum estimation learning model.
  • Fig. 6 is a diagram illustrating an example of a configuration of the control unit 21 in the embodiment.
  • the control unit 21 includes an analysis target acquisition unit 211, an analysis unit 212, a recording unit 213, and an output control unit 214. [0127]
  • the analysis target acquisition unit 211 acquires the cardiac sound time series that is a target for analysis which is input to the input unit 22 or the communication unit
  • the analysis target acquisition unit 211 may read out the cardiac sound time series which is a target for analysis from the storage unit
  • the analysis unit 212 analyzes the cardiac sound time series which is a target for analysis. More specifically, the analysis unit 212 executes the learned linear sum estimation learning model with respect to the cardiac sound time series which is a target for analysis to thereby acquire an output of the learned linear sum estimation learning model as the result of analysis. Executing the learned linear sum estimation learning model with respect to the cardiac sound time series which is a target for analysis specifically means inputting the cardiac sound time series which is a target for analysis to the learned linear sum estimation learning model and executing the learned linear sum estimation learning model to which the cardiac sound time series which is a target for analysis is input.
  • the posterior distribution of the state of the cardiac cycle is first estimated on the basis of the cardiac sound time series which is a target for analysis.
  • the posterior distribution of the oscillator time series is next estimated on the basis of the obtained posterior distribution of the state of the cardiac cycle.
  • the recording unit 213 records various types of information in the storage unit 24.
  • the output control unit 214 controls the operation of the output unit 25.
  • Fig. 7 is a flow chart illustrating an example of a flow of processes which are executed by the analysis apparatus 2 in the embodiment.
  • the analysis target acquisition unit 211 acquires the cardiac sound time series which is a target for analysis (step S201).
  • the analysis unit 212 executes the learned linear sum estimation learning model with respect to the cardiac sound time series which is a target for analysis (step S202).
  • the posterior distribution of the oscillator time series is estimated by the execution of the learned linear sum estimation learning model.
  • the output control unit 214 causes the output unit 25 to output the obtained posterior distribution of the oscillator time series (step S203).
  • a first data set and a second data set are normal cardiac sound time series and abnormal cardiac sound time series in various types of symptoms which are associated with auscultation textbooks. These data sets include a total of 119 time series.
  • Fig. 8 is a first diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment.
  • Fig. 8 is an example of a cardiac sound time series included in the first data set.
  • the vertical axis of Fig. 8 represents a normalized amplitude.
  • Fig. 9 is a second diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment.
  • Fig. 9 is an example of a cardiac sound time series included in the second data set.
  • the vertical axis of Fig. 9 represents a normalized amplitude.
  • the third data set is a cardiac sound time series obtained by one microphone.
  • the cardiac sound time series included in the third data set is a cardiac sound time series in which annotations of the S 1 sound and the S2 sound are added manually.
  • the fourth data set is a cardiac sound time series obtained simultaneously by a large number of microphones.
  • EMD empirical mode decomposition
  • IMF intrinsic mode functions
  • the Fl score was an amount which is defined by the following Expression (38).
  • P+ is precision, and S e is recall.
  • Fig. 10 is a third diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment.
  • Fig. 10 is an example of oscillator decomposition obtained from a normal cardiac sound time series using the analysis system 100.
  • the oscillator decomposition involves acquiring the waveform of each fluctuating oscillator of the oscillator linear sum.
  • PCG indicates a cardiac sound time series which is a target for analysis
  • each of IMF 1 to IMF 3 indicates a time series of a fluctuating oscillator obtained from the cardiac sound time series which is a target for analysis.
  • the vertical axis of each graph of the PCG, the IMF 1, the IMF 2, and the IMF 3 represents the amplitude. It is true of Figs.
  • each of IMF 1 to IMF 3 indicates a time series of a fluctuating oscillator obtained from the cardiac sound time series which is a target for analysis
  • the vertical axis of each graph of the PCG, the IMF 1, the IMF 2, and the IMF 3 represents the amplitude.
  • Fig. 11 is a fourth diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment.
  • Fig. 11 is an example of oscillator decomposition obtained from a normal cardiac sound time series using the EEMD.
  • Fig. 12 is a fifth diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment.
  • Fig. 12 is an example of oscillator decomposition obtained from an abnormal cardiac sound time series using the analysis system 100.
  • Fig. 13 is a sixth diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment.
  • Fig. 13 is an example of oscillator decomposition obtained from an abnormal cardiac sound time series using the EEMD.
  • Fig. 14 is a seventh diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment.
  • the term “Our model” of Fig. 14 refers to the analysis system 100.
  • N of Fig. 14 is the number of SI sounds and the S2 sounds.
  • TP of Fig. 14 is true positive.
  • FP of Fig. 14 is false positive.
  • FN of Fig. 14 is false negative.
  • “Fi” of Fig. 14 is the Fl score.
  • (a) of Fig. 14 is the first data set
  • (b) of Fig. 14 is the second data set
  • (c) of Fig. 14 is the third data set.
  • Fig. 14 shows that the estimation of the onsets of the SI sound and the S2 sound performed by the analysis system 100 is more accurate than in the EEMD in all three data sets from the first data set to the third data set.
  • Fig. 15 is an eighth diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment.
  • Each of Ch 1 and Ch 2 of Fig. 15 is an oscillator time series which is a target for analysis and indicates a time series of each dimension of a two-dimensional oscillator time series.
  • IMF 1, IMF 2, IMF 3 and IMF 4 of Fig. 15 indicate waveforms of four fluctuating oscillators obtained from the oscillator time series of Ch 1 and Ch 2.
  • the vertical axis of each graph of Ch 1, Ch 2, IMF 1, IMF 2, IMF 3 and IMF 4 represents the amplitude.
  • the graph of Eabel of Fig. 15 represents the estimated state of the cardiac cycle.
  • Fig. 15 shows that the analysis system 100 can extract a fluctuating oscillator from the cardiac sound time series acquired by a plurality of microphones.
  • the analysis system 100 of the embodiment configured in this manner obtains a learned linear sum estimation learning model on the basis of an expression representing the generation mechanism of the cardiac sound time series and a mathematical model representing the relationship between a probabilistic state transition and a symbol output. Therefore, it is possible to obtain a linear sum of fluctuating oscillators from the cardiac sound time series which is a target for analysis with a higher level of accuracy than in a mathematical model obtained without using an expression representing the generation mechanism of the cardiac sound time series. Therefore, the analysis system 100 can improve the accuracy of analysis of a time series represented by the linear sum of fluctuating oscillators.
  • the analysis system 100 of the embodiment is not a technique of using empirical mode decomposition.
  • the occurrence of a problem called Mode mixing has been known. Since the analysis system 100 is not a technique of using the empirical mode decomposition, it can suppress the occurrence of Mode mixing.
  • the analysis system 100 of the embodiment is not a technique of using empirical mode decomposition, as represented by Expression (18), the analysis system 100 can incorporate the generation mechanism of a time series into a mathematical model for obtaining the linear sum of fluctuating oscillators.
  • the cardiac sound time series is an example, and the analysis system 100 does not necessarily have to analyze the time series of the cardiac sound.
  • the time series which is a target for analysis in the analysis system 100 may be any time series insofar as it is a time series represented by a linear sum of amplitude waveforms of the fluctuating oscillator.
  • the time series represented by a linear sum of amplitude waveforms of the fluctuating oscillator may be, for example, a time series of a respiratory sound.
  • the analysis system 100 uses an expression representing the generation mechanism of the respiratory sound time series instead of an expression representing the generation mechanism of the cardiac sound time series.
  • the expression representing the generation mechanism of the cardiac sound time series is an example of an expression representing the generation mechanism of a time series which is a target for analysis.
  • the state of a mathematical model representing the relationship between a probabilistic state transition and a symbol output is a two-phase state of an expiratory phase and an inspiratory phase in a case where the time series represented by a linear sum of amplitude waveforms of the fluctuating oscillator is a respiratory sound.
  • the state of a mathematical model representing the relationship between a probabilistic state transition and a symbol output is the state of a generation source of a time series represented by a linear sum of amplitude waveforms of the fluctuating oscillator.
  • the learning apparatus 1 and the analysis apparatus 2 may be mounted using a plurality of information processing devices which are communicably connected to each other through a network.
  • each functional unit included in the learning apparatus 1 and the analysis apparatus 2 may be distributed and mounted in a plurality of information processing devices.
  • the learning apparatus 1 and the analysis apparatus 2 do not necessarily have to be mounted as different devices.
  • the learning apparatus 1 and the analysis apparatus 2 may be mounted as, for example, one device having both functions.
  • the functions of the analysis system 100, the learning apparatus 1, and the analysis apparatus 2 may be realized using hardware such as an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), or the like.
  • the program may be recorded in a computer readable recording medium.
  • the computer readable recording medium refers to, for example, a portable medium such as a flexible disk, a magnetooptic disc, a ROM, or a CD-ROM, or a storage device such as a hard disk built into a computer system.
  • the program may be transmitted through an electrical telecommunication line.
  • cardiac sound time series is an example of an observed time series.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Biomedical Technology (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Algebra (AREA)
  • Probability & Statistics with Applications (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Operations Research (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

An aspect of the present invention is a learning apparatus including a time series acquisition unit that is configured to, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquire an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series and a learning processing execution unit that is configured to use an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, wherein the learning processing execution unit is configured to update the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model.

Description

[DESCRIPTION]
[TITLE OF INVENTION]
LEARNING APPARATUS, ANALYSIS APPARATUS, LEARNING METHOD,
ANALYSIS METHOD, AND PROGRAM
[Technical Field]
[0001]
The present invention relates to a learning apparatus, an analysis apparatus, a learning method, an analysis method, and program.
[Background Art]
[0002]
Cardiac sounds are an important clue for knowing the condition of a patient’ s circulatory system.
[Citation List]
[Non-Patent Literature]
[0003]
[Non-Patent Document 1]
L G Gamero and R Watrous, “Detection of the first and second heart sound using probabilistic models,” Proc. IEEE Eng. Med. Biol. Soc., vol. 3, pp. 2877-2880, 2003.
[Non-Patent Document 2]
D Gill, N Gavrieli, and N Intrator, “Detection and identification of heart sounds using homomorphic envelogram and self-organizing probabilistic model,” pp. 957-960, 2005.
[Non-Patent Document 3]
A D Rieke, R J Povinelli, and M T Johnson, “Automatic segmentation of heart sound signals using hidden Markov models,” pp. 953-956, 2005.
[Non-Patent Document 4]
P Sedighian, A W Subudhi, F Scalzo, and S Asgari, “Pediatric heart sound segmentation using hidden Markov model,” pp. 5490-5493, 2014.
[Non-Patent Document 5]
S E Schmidt, C Holst-Hansen, C Graff, E Toft, and J J Struijk, “Segmentation of heart sound recordings by a duration-dependent hidden Markov model,” Physiol. Meas., vol. 31, no. 4, pp. 513-529, 2010.
[Non-Patent Document 6]
D B Springer, LTarassenko, and G D Clifford, “Logistic regression-HSMM- based heart sound segmentation,” IEEE Trans. Biomed. Eng., vol. 63, no. 4, pp. 822-832, 2016.
[Non-Patent Document 7]
S Ari and Go Saha, “Classification of heart sounds using empirical mode decomposition based features,” Int. J. Med. Eng. Inform., vol. 1, no. 1, pp. 91-108, 2008. [Non-Patent Document 8]
H Sun, W Chen, and J Gong, “An improved empirical mode decompositionwavelet algorithm for phonocardiogram signal denoising and its application in the first and second heart sound extraction,” pp. 187-191, 2013.
[Non-Patent Document 9]
C D Papadaniil and L J Hadjileontiadis, “Efficient heart sound segmentation and extraction using ensemble empirical mode decomposition and kurtosis features,” IEEE J Biomed Health Inform, vol. 18, no. 4, pp. 1138-1152, 2014.
[Non-Patent Document 10]
E F Blick, H N Sabbah, and P D Stein, “One-dimensional model of diastolic semilunar valve vibrations productive of heart sounds,” J. Biomech., vol. 12, no. 3, pp. 223-227, 1979.
[Non-Patent Document 11]
M J Johnson and A S Willsky, “Stochastic variational inference for bayesian time series models,” pp. II- 1854-11- 1862, 2014.
[Non-Patent Document 12]
D L Sikarskie, P D Stein, and M Vable, “A mathematical model of aortic valve vibration,” J. Biomech., vol. 17, no. 11, pp. 831-837, 1984.
[Non-Patent Document 13]
H Ozcan Gulcur and Y Bahadirlar, “Estimation of systolic blood pressure from the second heart sounds,” Int. Biom. Eng. Days, pp. 39-41, 1998.
[Non-Patent Document 14]
X-Y Zhang and Y-T Zhang, “Model-based analysis of effects of systolic blood pressure on frequency characteristics of the second heart sound,” Proc. IEEE Eng. Med. Biol. Soc., vol. 2006, pp. 2888-2891, 2006.
[Non-Patent Document 15]
T Matsuda and F Komaki, “Multivariate time series decomposition into oscillation components,” Neural Comput., vol. 29, no. 8, pp. 2055-2075, 2017. [Non-Patent Document 16]
H Soulat, E P Stephen, A M Beck, and P L Purdon, “State space methods for phase amplitude coupling analysis,” bioRxiv, 2019.
[Non-Patent Document 17]
E Archer, I M Park, L Buesing, J Cunningham, and L Paninski, “Black box variational inference for state space models,” 2015.
[Summary of Invention] [Technical Problem]
[0004]
Although a plurality of previous studies have proposed methods of automatically estimating the condition of a heart at each time from a cardiac sound time series, the accuracy of estimating the condition of the heart at each time is not good. For this reason, even now, estimating the condition of the heart through cardiac sound requires labor to create supervised data using an electrocardiograph in advance.
[0005]
The poor accuracy of estimating the condition of the heart at each time will be described in a little more detail. A waveform indicated by a time series of a cardiac sound is decomposed into amplitude waveforms of a plurality of oscillators whose amplitudes change periodically. That is, the waveform of the time series of the cardiac sound is a linear sum of amplitude waveforms of a plurality of fluctuating oscillators. A fluctuating oscillator is an oscillator whose amplitude changes periodically. The poor accuracy of estimating the condition of the heart at each time means specifically that the accuracy of decomposing the time series of the cardiac sound into a linear sum of time series of the amplitudes of the fluctuating oscillators is not good.
[0006]
Meanwhile, such a problem is not necessarily limited to cardiac sounds, and also exists for analysis of a time series represented by a linear sum of amplitude waveforms of the fluctuating oscillators.
[0007]
The present invention was contrived in view of such circumstances, and an object thereof is to provide a technique of improving the accuracy of analysis of a time series represented by a linear sum of amplitude waveforms of a fluctuating oscillator - whose amplitude changes periodically. [Solution to Problem] [0008]
According to an aspect of the present invention, there is provided a learning apparatus including: a time series acquisition unit that is configured to, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquire an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series; and a learning processing execution unit that is configured to use an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, wherein the learning processing execution unit is configured to update the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model. [0009]
According to an aspect of the present invention, there is provided an analysis apparatus including: an analysis target acquisition unit that is configured to acquire a time series which is a target for analysis; and an analysis unit that is configured to analyze a time series which is a target for analysis using a learned linear sum estimation learning model obtained by a learning apparatus including a time series acquisition unit that is configured to, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquire an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series and a learning processing execution unit that is configured to use an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, the learning processing execution unit updating the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model. [0010]
According to an aspect of the present invention, there is provided a learning method including: a time series acquisition step of, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquiring an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series; and a learning process execution step of using an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, wherein the learning process execution step includes updating the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model. [0011]
According to an aspect of the present invention, there is provided an analysis method including: an analysis target acquisition step of acquiring a time series which is a target for analysis; and an analysis step of analyzing a time series which is a target for analysis using a learned linear sum estimation learning model obtained by a learning apparatus including a time series acquisition unit that is configured to, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquire an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series and a learning processing execution unit that is configured to use an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, the learning processing execution unit updating the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model.
[0012]
According to an aspect of the present invention, there is provided a computer program for causing a computer to function as the above learning apparatus. [0013]
According to an aspect of the present invention, there is provided a computer program for causing a computer to function as the above analysis apparatus. [Advantageous Effects of Invention] [0014]
According to the present invention, it is possible to improve the accuracy of analysis of a time series represented by a linear sum of amplitude waveforms of a fluctuating oscillator whose amplitude changes periodically.
[Brief Description of Drawings]
[0015]
Fig. 1 is a diagram illustrating an example of a configuration of an analysis system of an embodiment.
Fig. 2 is a diagram illustrating an example of a hardware configuration of a learning apparatus in the embodiment.
Fig. 3 is a diagram illustrating an example of a configuration of a control unit included in the learning apparatus in the embodiment.
Fig. 4 is a flow chart illustrating an example of a flow of processes which are executed by the learning apparatus in the embodiment.
Fig. 5 is a diagram illustrating an example of a hardware configuration of an analysis apparatus in the embodiment.
Fig. 6 is a diagram illustrating an example of a configuration of a control unit included in the analysis apparatus in the embodiment.
Fig. 7 is a flow chart illustrating an example of a flow of processes which are executed by the analysis apparatus in the embodiment.
Fig. 8 is a first diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
Fig. 9 is a second diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
Fig. 10 is a third diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
Fig. 11 is a fourth diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
Fig. 12 is a fifth diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
Fig. 13 is a sixth diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
Fig. 14 is a seventh diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
Fig. 15 is an eighth diagram illustrating an example of a result of an experiment using the analysis system of the embodiment.
[Description of Embodiments]
[0016]
(Embodiment)
Fig. 1 is a diagram illustrating an example of a configuration of an analysis system 100 of an embodiment. Hereinafter, for the purpose of simplification of description, the analysis system 100 will be described with a case in which a target for analysis in the analysis system 100 is a time series of a cardiac sound (hereinafter referred to as a “cardiac sound time series”) and the analysis system 100 estimates the condition of a heart which is a generation source of a cardiac sound time series on the basis of the cardiac sound time series as an example.
[0017]
However, a time series which is a target for analysis in the analysis system 100 does not necessarily have to be a time series of a cardiac sound. The time series which is a target for analysis in the analysis system 100 may be any time series insofar as it is a time series represented by a linear sum of amplitude waveforms of an oscillator whose amplitude changes periodically (hereinafter referred to as a “fluctuating oscillator”). Since the waveform is a time series, the linear sum of amplitude waveforms of a fluctuating oscillator is a linear sum of an amplitude time series of a fluctuating oscillator. Hereinafter, an amplitude time series of a fluctuating oscillator is referred to as “oscillator time series”. Hereinafter, a linear sum of oscillator time series is referred to as “oscillator linear sum”.
[0018]
In addition, the result of analysis which is output by the analysis system 100 does not necessarily have to be the result of estimation of the condition of a heart. The result of analysis which is output by the analysis system 100 may be any result insofar as it is a result obtained on the basis of the oscillator linear sum. The result of analysis which is output by the analysis system 100 may be an amplitude time series of each fluctuating oscillator of the oscillator linear sum.
[0019]
The analysis system 100 includes a learning apparatus 1 and an analysis apparatus 2. The learning apparatus 1 updates a machine learning model that estimates an oscillator linear sum (hereinafter referred to as a “linear sum estimation learning model”) through learning on the basis of an input cardiac sound time series.
[0020]
Meanwhile, the machine learning model is a mathematical model including one or a plurality of processes in which the condition and order of execution (hereinafter referred to as an “execution rule”) are determined in advance. The term “learning” refers to updating a machine learning model using a machine learning method. In addition, updating a machine learning model involves appropriately adjusting values of predetermined parameters included in the machine learning model. In addition, the execution of a machine learning model involves executing each process included in the machine learning model in accordance with the execution rule.
[0021]
Meanwhile, the machine learning model is represented by, for example, a neural network. Meanwhile, the neural network is a circuit such as an electronic circuit, an electrical circuit, an optical circuit, or an integrated circuit and is a circuit that represents a machine learning model. Updating a machine learning model means also to update a neural network that represents the machine learning model by learning. Updating a neural network by learning means to update values of parameters of the neural network. In addition, the parameters of a neural network are parameters of a circuit constituting the neural network, and are also parameters of a learning model represented by the circuit constituting the neural network.
[0022]
The neural network that represents a linear sum estimation learning model may be any neural network insofar as it is a neural network capable of representing the linear sum estimation learning model. The neural network that represents a linear sum estimation learning model is, for example, a deep neural network.
[0023]
The learning apparatus 1 learns a linear sum estimation learning model until a predetermined end condition (hereinafter referred to as a “learning end condition”) is satisfied. The learning end condition is, for example, a condition that learning has been performed a predetermined number of times. The learning end condition may be, for example, a condition that a change of a linear sum estimation learning model due to update is smaller than a predetermined change. [0024]
The analysis apparatus 2 uses a learned linear sum estimation learning model obtained by the learning apparatus 1 to estimate an oscillator linear sum indicating an input cardiac sound time series. The learned linear sum estimation learning model is a linear sum estimation learning model at a timing when the learning end condition is satisfied.
[0025]
<Linear sum estimation learning model and process of learning of linear sum estimation learning model>
The relationship between a linear sum estimation learning model and a process in which the learning apparatus 1 learns the linear sum estimation learning model (hereinafter referred to as a “learning process ”) will be described. The linear sum estimation learning model includes a machine learning model that estimates the posterior distribution of the state of a cardiac cycle on the basis of the input cardiac sound time series. Hereinafter, a machine learning model that estimates the posterior distribution of the state of a cardiac cycle on the basis of the input cardiac sound time series is referred to as a “cardiac cycle state posterior distribution learning model”. The linear sum estimation learning model includes a machine learning model that estimates the posterior distribution of an oscillator time series on the basis of the posterior distribution of the state of a cardiac cycle. Hereinafter, a machine learning model that estimates the posterior distribution of an oscillator time series on the basis of the posterior distribution of the state of a cardiac cycle is referred to as an “oscillator time series posterior distribution learning model” The linear sum estimation learning model includes a machine learning model that estimates the marginal distribution of a cardiac sound time series using the posterior distribution of an oscillator time series. Hereinafter, a machine learning model that estimates the marginal distribution of a cardiac sound time series using the posterior distribution of an oscillator time series is referred to as a “cardiac sound time series marginal distribution learning model”.
[0026]
The learning process includes a time series input process, a cardiac cycle state posterior distribution estimation process, an oscillator time series posterior distribution estimation process, a cardiac sound time series marginal distribution estimation process, and an update process.
[0027]
The time series input process is a process in which a cardiac sound time series is input to a linear sum estimation learning model.
[0028]
The cardiac cycle state posterior distribution estimation process is a process of estimating the posterior distribution of the state of a cardiac cycle on the basis of the input cardiac sound time series by the execution of a cardiac cycle state posterior distribution learning model.
[0029]
The oscillator time series posterior distribution estimation process is a process of estimating the posterior distribution of an oscillator time series on the basis of the posterior distribution of the state of a cardiac cycle by the execution of an oscillator time series posterior distribution learning model.
[0030]
The cardiac sound time series marginal distribution estimation process is a process of estimating the marginal distribution of a cardiac sound time series using the posterior distribution of an oscillator time series by the execution of a cardiac sound time series marginal distribution learning model.
[0031]
The update process is a process of updating a linear sum estimation learning model so that a cardiac sound time series which is input through the time series input process increases a marginal likelihood based on the marginal distribution estimated in the cardiac sound time series marginal distribution estimation process. [0032]
Updating a linear sum estimation learning model involves, more specifically, updating a cardiac cycle state posterior distribution learning model, an oscillator time series posterior distribution learning model, and a cardiac sound time series marginal distribution learning model.
[0033]
<Cardiac cycle state posterior distribution learning model>
The cardiac cycle state posterior distribution learning model may be any mathematical model insofar as the posterior distribution of the state of a cardiac cycle can be calculated on the basis of a cardiac sound time series. States of a cardiac cycle include four states, that is, an SI sound, a systolic phase, an S2 sound, and a diastolic phase. The four states of the cardiac cycle, that is, an SI sound, a systolic phase, an S2 sound, and a diastolic phase are periodically repeated. More specifically, the state of the cardiac cycle transitions from the state of the S 1 sound to the state of the systolic phase. The state of the cardiac cycle transitions from the state of the systolic phase to the state of the S2 sound. The state of the cardiac cycle transitions from the state of the S2 sound to the state of the diastolic phase. The state of the cardiac cycle transitions from the state of the diastolic phase to the state of the S 1 sound.
[0034] The sound in the state of the S 1 sound and the sound in the state of the S2 sound are extremely loud sounds among cardiac sounds, and are sounds caused by the oscillation of valves which are generated when the mitral valve and the aortic valve are closed. Therefore, the cardiac sound time series is a time series in which the amplitudes of a nonlinear oscillator mainly equivalent to the oscillation of an intracardiac valve are added to each other while changing periodically
[0035]
The cardiac cycle state posterior distribution learning model is, for example, a mathematical model that acquires a posterior probability distribution which is represented by the following Expression (1) on the basis of the cardiac sound time series. The cardiac sound time series is represented by the following Expression (2).
[0036]
[Expression 1]
Figure imgf000016_0001
- (1)
[0037]
[Expression 2]
Figure imgf000016_0002
[0038]
[Expression 3]
Figure imgf000016_0003
[0039]
[Expression 4] ,. 6 1, 2, 3, 4 .- (4) [0040]
[Expression 5]
Figure imgf000017_0002
[0041]
[Expression 6]
Figure imgf000017_0003
[0042]
J is the number of microphones that acquire a cardiac sound. R is the length of the cardiac sound time series. In addition, zr is an unobserved state of the cardiac sound time series at the r-th time. The unobserved state is specifically the state of the cardiac cycle. Since there are four states of the cardiac cycle as described above, the possible values of zr are 1 to 4 as shown in Expression (4).
[0043]
The state of the cardiac cycle does not transition to the next state immediately after state transition occurs. After the state transition occurs, the post-transition state continues for a finite period of time. That is, in each state of the cardiac cycle, there is a finite duration until the transition to the next state. Consequently, the transition probability defined by the following Expression (7) is defined.
[0044]
[Expression 7]
Figure imgf000017_0001
- (7)
[0045]
[Expression 8]
Figure imgf000018_0003
[0046]
A in Expression (8) is a transition matrix. In addition, pj(8) is the distribution of duration. The distribution of duration represented by pj(8) is represented by, for example, the negative binomial distribution of the following Expression (9).
[0047]
[Expression 9]
Figure imgf000018_0001
- (9)
[0048]
Here, 0j is the probability of success of a trial, and m is a shape parameter. In addition, er in Expression (6) is a pseudo-state. The pseudo-state is an amount indicating how long each state has continued. zr A{-} which is defined by Expression (5) using the pseudo-states er and zr. follows a Markov process with a probability transition matrix which is determined by (7), (8) and (9). Meanwhile, hereinafter, a symbol with a bar above the symbol is represented as symbolA{-}. For example, zr A{-} indicates a symbol with a bar above the symbol zr. Therefore, zr A{-} indicates the symbol on the left side of Expression (5). In addition, as in Expression (10), the probability of zr coincides with the probability of marginalizing zr A{-} with respect to the pseudo-state. [0049]
[Expression 10]
Figure imgf000018_0002
- (10)
[0050] In the calculation of Expression (1), it is necessary to calculate the numerator of Expression (1) for all combinations of latent variables zA{ -} and then perform normalization so that the posterior probabilities on the left side add up to 1. However, the number of possible combinations of states is (4m)R, and the amount of calculation is on the order of (4m)R. Such an increase in the amount of calculation is suppressed by, for example, replacing the term of the following Expression (11) in the numerator of Expression (1) with the approximate expression on the right side of Expression (13) which is an expression using the function of Expression (12) . Hereinafter, the function of Expression (12) is referred to as a “potential”.
[0051]
[Expression 11]
Figure imgf000019_0001
[0052]
[Expression 12]
Figure imgf000019_0003
[0053]
[Expression 13]
Figure imgf000019_0002
- (13)
[0054]
By the approximation of Expression (13), the amount of calculation for calculating the value of Expression (1) can be reduced to the order of 4mR. Meanwhile, the approximate expression of the above (13) is an example, and the potential may be any function insofar as it is a part of the function representing the posterior probability distribution of the state of the cardiac cycle and a function in which content to be represented is defined in advance.
[0055]
An expression indicating the potential is obtained using a machine learning model such as, for example, a neural network on the basis of the cardiac sound time series. Therefore, in a case where the posterior probability distribution of the state of the cardiac cycle is represented using the potential, the expression indicating the potential is also updated in learning of the linear sum estimation learning model.
[0056]
<Oscillator time series posterior distribution learning model>
The oscillator time series posterior distribution learning model will be described in more detail. The oscillator time series posterior distribution learning model is a mathematical model representing the relationship between a probabilistic state transition such as a hidden Markov model or a hidden semi-Markov model and a symbol output that is information which is probabilistically output in each state. The state in the mathematical model representing the relationship between a probabilistic state transition and a symbol output is the state of the cardiac cycle.
[0057]
The symbol output in the mathematical model representing the relationship between a probabilistic state transition and a symbol output is an oscillator time series. In a case where the mathematical model representing the relationship between a probabilistic state transition and a symbol output is a hidden semi-Markov model, the mathematical model also represents the duration of each state.
[0058]
<Cardiac sound time series marginal distribution learning model> The cardiac sound time series marginal distribution learning model will be described in more detail. The cardiac sound time series is observed as the linear sum of the fluctuating oscillators in accordance with Expression (14). Expression (19) is a distribution followed by the fluctuating oscillator and an expression derived from
Expression (17) representing the generation mechanism of the cardiac sound time series.
Expression (17) is a differential equation representing the generation mechanism of the cardiac sound time series.
[0059]
[Expression 14]
Figure imgf000021_0001
[0060]
[Expression 15]
Figure imgf000021_0002
- (15)
[0061]
[Expression 16]
Figure imgf000021_0003
[0062]
[Expression 17]
Figure imgf000021_0004
[0063]
Here, r is the variance of an observation noise distribution. The amount yri on the left side of Expression (16) indicates the amplitude of the 1-th fluctuation oscillator at a time r.
[0064]
M is the mass of the valve of the heart. In addition, u is the displacement of the valve of the heart. AP is pressure exerted on the valve of the heart. D is an attenuation coefficient indicating the magnitude of movement attenuation of the valve of the heart. K is the stiffness coefficient of the valve of the heart.
[0065]
The formal solution of Expression (17) is the following Expression (18). [0066]
[Expression 18]
Figure imgf000022_0001
[0067]
C and a are constants. In addition, co is an angular frequency, vp is an initial phase shift, and t is a time.
[0068]
Since the amplitude of the waveform indicated by the cardiac sound time series is proportional to the first-order differential of displacement u of the valve of the heart (that is, the speed of the heart valve membrane), the fluctuating oscillator is represented by a second-order autoregressive model. Therefore, the following Expression (19) is established.
[0069]
[Expression 19]
Figure imgf000023_0001
- (19)
[0070]
Here, ai is the attenuation coefficient of the 1-th fluctuation oscillator, fi is the average frequency of the 1-th fluctuation oscillator, fs is a sampling frequency, and on2 is the variance of a system noise distribution. The variance oii2 strongly depends on the state of the cardiac cycle, and changes a dominant fluctuating oscillator included in the cardiac sound time series on the basis of the state of the cardiac cycle. Particularly, a large value of the variance on2 means that the 1-th fluctuation oscillator is dominant in a case where the state of the cardiac cycle is i.
[0071]
<Update process>
The update process will be described in more detail. In the update process, for example, the linear sum estimation learning model is updated so as to maximize a log marginal likelihood represented by the following Expression (20).
[0072]
[Expression 20]
Figure imgf000023_0002
- (20)
[0073]
In the update process, for example, the linear sum estimation learning model may be updated so as to maximize the lower bound of the likelihood represented by the following Expression (21). Meanwhile, updating the linear sum estimation learning model means specifically updating, for example, {0j}, {ai}, {fi}, {on}, {gji} and r. [0074]
[Expression 21]
Figure imgf000024_0001
- (21)
[0075]
The log marginal likelihood represented by Expression (20) and the lower bound of the likelihood represented by Expression (21) are related to the following Expression (22).
[0076]
[Expression 22] logp(.;z:i;p)
Figure imgf000024_0002
... (22)
[0077]
The term of the following Expression (23) in Expression (22) represents Expression (14). The term of the following Expression (24) in Expression (22) represents Expression (19). The term of the following Expression (25) in Expression (22) is the transition probability of zA{-} which is derived from Expressions (7), (8), (9), and (10).
[0078]
[Expression 23]
Figure imgf000024_0003
[0079]
[Expression 24]
Figure imgf000025_0005
[0080]
[Expression 25]
Figure imgf000025_0001
[0081]
In maximizing the lower bound of the likelihood represented by Expression (21), the relations of the following Expressions (26) and (27) are used in order to reduce the amount of calculation.
[0082]
[Expression 26]
Figure imgf000025_0002
[0083]
[Expression 27]
Figure imgf000025_0003
- (27)
[0084]
The potential is included in Expression (27), and as described above, the expression indicating the potential is obtained by a machine learning model such as a neural network. The potential is, for example, the following Expression (28). [0085]
[Expression 28]
Figure imgf000025_0004
[0086] Here, cp(-) appearing on the right side of Expression (28) is a mapping from the following Expression (29) to the following Expression (30).
[0087]
[Expression 29]
Figure imgf000026_0001
- (29)
[0088]
[Expression 30]
Figure imgf000026_0002
[0089]
Here, s is a window length having a fixed length determined in advance. The symbol of the following Expression (31) appearing on the right side of Expression (28) is an operator for returning the (i, 8)-th element of an input matrix. Meanwhile, the input matrix is specifically (30) expression.
[0090]
[Expression 31]
Figure imgf000026_0003
[0091]
As the form of the expression indicating the potential, those used in supervised cardiac sound segmentation such as a convolutional neural network (CNN) or a recurrent neural network (RNN) may be used.
[0092]
Meanwhile, the following Expression (32) and the following Expression (33) are a zA{-} initial probability and a transition probability which are derived from Expressions
(7), (8), (9), and (10). [0093]
[Expression 32]
Figure imgf000027_0004
[0094]
[Expression 33]
Figure imgf000027_0001
[0095]
The relation of Expression (22) is converted into the relation of the following
Expression (34) by Expressions (23) to (33).
[0096]
[Expression 34]
Figure imgf000027_0002
[0097]
[Expression 35]
Figure imgf000027_0003
[0098]
By using a message propagation method, the lower bound of the likelihood represented by Expression (21) is maximized with the amount of calculation smaller than the amount of calculation required to maximize the log marginal likelihood represented by Expression (20).
[0099]
Meanwhile, Expression (34) is specifically derived by modifying the following Expressions (36) and (37).
[0100]
[Expression 36]
Figure imgf000028_0001
- (36) [0101]
[Expression 37]
Figure imgf000028_0002
[0102]
Fig. 2 is a diagram illustrating an example of a hardware configuration of the learning apparatus 1 in the embodiment. The learning apparatus 1 includes a control unit 11 provided with an processor 91 such as a central processing unit (CPU) and a memory 92 which are connected to each other through a bus, and executes a program. The learning apparatus 1 functions as a device including the control unit 11, an input unit 12, a communication unit 13, a storage unit 14, and an output unit 15 by executing a program.
[0103] More specifically, the processor 91 reads out the program stored in the storage unit 14, and stores the read-out program in the memory 92. By the processor 91 executing the program stored in the memory 92, the learning apparatus 1 functions as the device including the control unit 11, the input unit 12, the communication unit 13, the storage unit 14, and the output unit 15.
[0104]
The control unit 11 controls operations of various functional units included in the learning apparatus 1. The control unit 11 executes a learning process. The control unit 11 controls, for example, an operation of the output unit 15, and causes the output unit 15 to output the execution result of the learning process. The control unit 11 records, for example, various types of information generated by the execution of the learning process in the storage unit 14. Various types of information stored in the storage unit 14 include, for example, the learning result of the linear sum estimation learning model.
[0105]
The input unit 12 is configured to include an input device such as a mouse, a keyboard, or a touch panel. The input unit 12 may be configured as an interface for connecting the input device to the learning apparatus 1. The input unit 12 accepts inputs of various types of information to the learning apparatus 1. For example, the cardiac sound time series is input to the input unit 12.
[0106]
The communication unit 13 is configured to include a communication interface for connecting the learning apparatus 1 to an external device. The communication unit 13 communicates with the external device through wired or wireless connection. The external device is, for example, a device which is a transmission source of the cardiac sound time series. The external device is, for example, the analysis apparatus 2. The communication unit 13 transmits the linear sum estimation learning model learned through communication with the analysis apparatus 2 to the analysis apparatus 2.
[0107]
The storage unit 14 is configured using a computer readable storage medium device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 14 stores various types of information relating to the learning apparatus 1. The storage unit 14 stores, for example, information which is input through the input unit 12 or the communication unit 13. The storage unit 14 stores, for example, the linear sum estimation learning model. The storage unit 14 stores, for example, various types of information generated by the execution of the learning process.
[0108]
The output unit 15 outputs various types of information. The output unit 15 is configured to include a display device such as, for example, a cathode ray tube (CRT) display, a liquid crystal display, or an organic electro-luminescence (EL) display. The output unit 15 may be configured as an interface for connecting the display device to the learning apparatus 1. The output unit 15 outputs, for example, information which is input to the input unit 12 or the communication unit 13. The output unit 15 may display, for example, the execution result of the learning process.
[0109]
Fig. 3 is a diagram illustrating an example of a configuration of the control unit 11 included in the learning apparatus 1 in the embodiment. The control unit 11 includes a cardiac sound time series acquisition unit 111, a learning processing execution unit 112, an end determination unit 113, a recording unit 114, and an output control unit 115.
[0110] The cardiac sound time series acquisition unit 111 acquires the cardiac sound time series which is input to the input unit 12 or the communication unit 13. In a case where the cardiac sound time series has been recorded in the storage unit 14 in advance, the cardiac sound time series acquisition unit 111 may read out the cardiac sound time series from the storage unit 14. [0111]
The learning processing execution unit 112 executes the learning process. The end determination unit 113 determines whether the learning end condition is satisfied. The linear sum estimation learning model which is obtained through the learning process executed by the learning processing execution unit 112 and which is the linear sum estimation learning model at a point in time when the learning end condition is satisfied by the end determination unit 113 is the learned linear sum estimation learning model. [0112]
The learning processing execution unit 112 includes a time series input unit 121, a cardiac cycle state posterior distribution estimation unit 122, an oscillator time series posterior distribution estimation unit 123, a cardiac sound time series marginal distribution estimation unit 124, and an update unit 125. [0113]
The time series input unit 121 executes the time series input process with respect to the cardiac sound time series acquired by the cardiac sound time series acquisition unit 111. That is, the time series input unit 121 inputs the cardiac sound time series acquired by the cardiac sound time series acquisition unit 111 to the linear sum estimation learning model.
[0114]
The cardiac cycle state posterior distribution estimation unit 122 executes the cardiac cycle state posterior distribution estimation process. The oscillator time series posterior distribution estimation unit 123 executes the oscillator time series posterior distribution estimation process. The cardiac sound time series marginal distribution estimation unit 124 executes the cardiac sound time series marginal distribution estimation process. The update unit 125 executes the update process.
[0115]
The recording unit 114 records various types of information in the storage unit 14. The output control unit 115 controls the operation of the output unit 15. [0116]
Fig. 4 is a flow chart illustrating an example of a flow of processes which are executed by the learning apparatus 1 in the embodiment. The time series input unit 121 inputs the cardiac sound time series to linear sum estimation learning model (step S 101). Next, the cardiac cycle state posterior distribution estimation unit 122 executes the cardiac cycle state posterior distribution estimation process (step S 102). That is, the cardiac cycle state posterior distribution estimation unit 122 estimates the posterior distribution of the state of the cardiac cycle on the basis of the input cardiac sound time series.
[0117]
Next, the oscillator time series posterior distribution estimation unit 123 executes the oscillator time series posterior distribution estimation process (step S103). That is, the oscillator time series posterior distribution estimation unit 123 estimates the posterior distribution of the oscillator time series on the basis of the posterior distribution of the state of the cardiac cycle. Next, the cardiac sound time series marginal distribution estimation unit 124 executes the cardiac sound time series marginal distribution estimation process (step S104). That is, the cardiac sound time series marginal distribution estimation unit 124 estimates the marginal distribution of the cardiac sound time series using the posterior distribution of the oscillator time series. Next, the update unit 125 executes the update process (step S105). The linear sum estimation learning model is updated by executing the update process.
[0118]
Next, the end determination unit 113 determines whether the learning end condition is satisfied (step S106). In a case where the learning end condition is not satisfied (step S106: NO), the flow returns to the process of step S 101. On the other hand, in a case where the learning end condition is satisfied (step S106: YES), the process ends.
[0119]
Fig. 5 is a diagram illustrating an example of a hardware configuration of the analysis apparatus 2 in the embodiment. The analysis apparatus 2 includes a control unit 21 provided with a processor 93 such as a CPU and a memory 94 which are connected to each other through a bus, and executes a program. The analysis apparatus 2 functions as a device including the control unit 21, an input unit 22, a communication unit 23, a storage unit 24, and an output unit 25 by executing a program.
[0120]
More specifically, the processor 93 reads out the program stored in the storage unit 24, and stores the read-out program in the memory 94. By the processor 93 executing the program stored in the memory 94, the analysis apparatus 2 functions as the device including the control unit 21, the input unit 22, the communication unit 23, the storage unit 24, and the output unit 25.
[0121]
The control unit 21 controls operations of various functional units included in the analysis apparatus 2. The control unit 21 executes the learned linear sum estimation learning model. The control unit 21 controls, for example, an operation of the output unit 25, and causes the output unit 25 to output the execution result of the learned linear sum estimation learning model. The control unit 21 records, for example, various types of information generated by executing the learned linear sum estimation learning model in the storage unit 24.
[0122]
The input unit 22 is configured to include an input device such as a mouse, a keyboard, or a touch panel. The input unit 22 may be configured as an interface for connecting the input device to the analysis apparatus 2. The input unit 22 accepts inputs of various types of information to the analysis apparatus 2. For example, the cardiac sound time series which is a target for analysis is input to the input unit 22. [0123]
The communication unit 23 is configured to include a communication interface for connecting the analysis apparatus 2 to an external device. The communication unit 23 communicates with the external device through wired or wireless connection. The external device is, for example, a device that is a transmission source of the cardiac sound time series which is a target for analysis. The external device is, for example, the learning apparatus 1. The communication unit 23 acquires the linear sum estimation learning model learned through communication with the learning apparatus 1. [0124]
The storage unit 24 is configured using a computer readable storage medium device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 24 stores various types of information relating to the analysis apparatus 2.
The storage unit 24 stores, for example, information which is input through the input unit 22 or the communication unit 23. The storage unit 24 stores, for example, the learned linear sum estimation learning model. The storage unit 24 stores, for example, various types of information generated by the execution of the learned linear sum estimation learning model.
[0125]
The output unit 25 outputs various types of information. The output unit 25 is configured to include a display device such as, for example, a CRT display, a liquid crystal display, or an organic EL display. The output unit 25 may be configured as an interface for connecting the display device to the analysis apparatus 2. The output unit 25 outputs, for example, information which is input to the input unit 22 or the communication unit 23. The output unit 25 may display, for example, the execution result of the learned linear sum estimation learning model.
[0126]
Fig. 6 is a diagram illustrating an example of a configuration of the control unit 21 in the embodiment. The control unit 21 includes an analysis target acquisition unit 211, an analysis unit 212, a recording unit 213, and an output control unit 214. [0127]
The analysis target acquisition unit 211 acquires the cardiac sound time series that is a target for analysis which is input to the input unit 22 or the communication unit
23. In a case where the cardiac sound time series which is a target for analysis is recorded in the storage unit 24 in advance, the analysis target acquisition unit 211 may read out the cardiac sound time series which is a target for analysis from the storage unit
24.
[0128]
The analysis unit 212 analyzes the cardiac sound time series which is a target for analysis. More specifically, the analysis unit 212 executes the learned linear sum estimation learning model with respect to the cardiac sound time series which is a target for analysis to thereby acquire an output of the learned linear sum estimation learning model as the result of analysis. Executing the learned linear sum estimation learning model with respect to the cardiac sound time series which is a target for analysis specifically means inputting the cardiac sound time series which is a target for analysis to the learned linear sum estimation learning model and executing the learned linear sum estimation learning model to which the cardiac sound time series which is a target for analysis is input.
[0129]
In the execution of the learned linear sum estimation learning model with respect to the cardiac sound time series which is a target for analysis, the posterior distribution of the state of the cardiac cycle is first estimated on the basis of the cardiac sound time series which is a target for analysis. In the execution of the learned linear sum estimation learning model with respect to the cardiac sound time series which is a target for analysis, the posterior distribution of the oscillator time series is next estimated on the basis of the obtained posterior distribution of the state of the cardiac cycle.
[0130]
The recording unit 213 records various types of information in the storage unit 24. The output control unit 214 controls the operation of the output unit 25.
[0131]
Fig. 7 is a flow chart illustrating an example of a flow of processes which are executed by the analysis apparatus 2 in the embodiment. The analysis target acquisition unit 211 acquires the cardiac sound time series which is a target for analysis (step S201). Next, the analysis unit 212 executes the learned linear sum estimation learning model with respect to the cardiac sound time series which is a target for analysis (step S202). The posterior distribution of the oscillator time series is estimated by the execution of the learned linear sum estimation learning model. Next, the output control unit 214 causes the output unit 25 to output the obtained posterior distribution of the oscillator time series (step S203).
[0132]
<Experiment results>
The results of experiments using the analysis system 100 will be described. In the experiment, four types of data sets have been used. A first data set and a second data set are normal cardiac sound time series and abnormal cardiac sound time series in various types of symptoms which are associated with auscultation textbooks. These data sets include a total of 119 time series.
[0133]
Fig. 8 is a first diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment. Fig. 8 is an example of a cardiac sound time series included in the first data set. The vertical axis of Fig. 8 represents a normalized amplitude.
[0134]
Fig. 9 is a second diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment. Fig. 9 is an example of a cardiac sound time series included in the second data set. The vertical axis of Fig. 9 represents a normalized amplitude.
[0135]
The third data set is a cardiac sound time series obtained by one microphone.
The cardiac sound time series included in the third data set is a cardiac sound time series in which annotations of the S 1 sound and the S2 sound are added manually. The fourth data set is a cardiac sound time series obtained simultaneously by a large number of microphones.
[0136]
In the experiment, a comparison was made with the ensemble empirical mode decomposition method with a kurtosis feature (EEMD) described in Non-Patent Document 9.
[0137]
In the method using the EEMD, empirical mode decomposition (EMD) was first applied to extract intrinsic mode functions (IMF). During the period between the S 1 sound and the S2 sound, the amplitude of each IMF increases simultaneously. In the EEMD, the kurtosis of IMF was calculated using a sliding window in order to detect such an increase. In a case where the window contains the onsets of the S 1 sound and the S2 sound, the marginal distribution of the window has a heavier lower edge and a higher kurtosis than in a case where the window does not contain the onsets of the S 1 sound and the S2 sound. Therefore, the onsets of the S 1 sound and the S2 sound can be estimated by detecting the peak of the product of the kurtosis of the marginal distribution of the IMF in a window having a different scale.
[0138]
In the experiment, all the cardiac sound time series were downsampled to 2,000 Hz and underwent bandpass filtering through a frequency band from 10 Hz to 150 Hz. The time series thus obtained was applied to the analysis system 100 and the EEMD. In the experiment, the potential of Expression (28) was used as the potential, s was 64, and (p was learned through a two-layer CNN. Although the noise level differs for each data, the same value was used for hyper parameters of both methods in the experiment in order to verify robustness.
[0139]
It was determined that the estimation of the onset of the S 1 sound and the S2 sound was appropriate insofar as an interval between the estimated onset and the true onset is 100 ms.
[0140]
An Fl score was used to verify the appropriateness of the segmentation. The Fl score is an amount which is defined by the following Expression (38).
[0141]
[Expression 38]
Figure imgf000039_0001
[0142]
P+ is precision, and Se is recall.
[0143]
Fig. 10 is a third diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment. Fig. 10 is an example of oscillator decomposition obtained from a normal cardiac sound time series using the analysis system 100. The oscillator decomposition involves acquiring the waveform of each fluctuating oscillator of the oscillator linear sum. PCG indicates a cardiac sound time series which is a target for analysis, and each of IMF 1 to IMF 3 indicates a time series of a fluctuating oscillator obtained from the cardiac sound time series which is a target for analysis. The vertical axis of each graph of the PCG, the IMF 1, the IMF 2, and the IMF 3 represents the amplitude. It is true of Figs. 11 to 13 that the PCG indicates a cardiac sound time series which is a target for analysis, each of IMF 1 to IMF 3 indicates a time series of a fluctuating oscillator obtained from the cardiac sound time series which is a target for analysis, and the vertical axis of each graph of the PCG, the IMF 1, the IMF 2, and the IMF 3 represents the amplitude.
[0144]
Fig. 11 is a fourth diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment. Fig. 11 is an example of oscillator decomposition obtained from a normal cardiac sound time series using the EEMD. [0145]
Fig. 12 is a fifth diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment. Fig. 12 is an example of oscillator decomposition obtained from an abnormal cardiac sound time series using the analysis system 100. [0146]
Fig. 13 is a sixth diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment. Fig. 13 is an example of oscillator decomposition obtained from an abnormal cardiac sound time series using the EEMD. [0147]
Fig. 14 is a seventh diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment. The term “Our model” of Fig. 14 refers to the analysis system 100. “N” of Fig. 14 is the number of SI sounds and the S2 sounds. “TP” of Fig. 14 is true positive. “FP” of Fig. 14 is false positive. “FN” of Fig. 14 is false negative. “Fi” of Fig. 14 is the Fl score. In addition, (a) of Fig. 14 is the first data set, (b) of Fig. 14 is the second data set, and (c) of Fig. 14 is the third data set.
[0148]
Fig. 14 shows that the estimation of the onsets of the SI sound and the S2 sound performed by the analysis system 100 is more accurate than in the EEMD in all three data sets from the first data set to the third data set.
[0149]
Fig. 15 is an eighth diagram illustrating an example of a result of an experiment using the analysis system 100 of the embodiment. Each of Ch 1 and Ch 2 of Fig. 15 is an oscillator time series which is a target for analysis and indicates a time series of each dimension of a two-dimensional oscillator time series. IMF 1, IMF 2, IMF 3 and IMF 4 of Fig. 15 indicate waveforms of four fluctuating oscillators obtained from the oscillator time series of Ch 1 and Ch 2. The vertical axis of each graph of Ch 1, Ch 2, IMF 1, IMF 2, IMF 3 and IMF 4 represents the amplitude. The graph of Eabel of Fig. 15 represents the estimated state of the cardiac cycle. Fig. 15 shows that the analysis system 100 can extract a fluctuating oscillator from the cardiac sound time series acquired by a plurality of microphones.
[0150]
The analysis system 100 of the embodiment configured in this manner obtains a learned linear sum estimation learning model on the basis of an expression representing the generation mechanism of the cardiac sound time series and a mathematical model representing the relationship between a probabilistic state transition and a symbol output. Therefore, it is possible to obtain a linear sum of fluctuating oscillators from the cardiac sound time series which is a target for analysis with a higher level of accuracy than in a mathematical model obtained without using an expression representing the generation mechanism of the cardiac sound time series. Therefore, the analysis system 100 can improve the accuracy of analysis of a time series represented by the linear sum of fluctuating oscillators.
[0151] In addition, the analysis system 100 of the embodiment is not a technique of using empirical mode decomposition. In a case where the empirical mode decomposition is used, the occurrence of a problem called Mode mixing has been known. Since the analysis system 100 is not a technique of using the empirical mode decomposition, it can suppress the occurrence of Mode mixing.
[0152]
In addition, in the technique of empirical mode decomposition, it is difficult to incorporate the generation mechanism of a time series into a mathematical model for obtaining a linear sum of fluctuating oscillators due to heuristic calculation or loose restrictions imposed on the time series after decomposition. Since the analysis system 100 of the embodiment is not a technique of using empirical mode decomposition, as represented by Expression (18), the analysis system 100 can incorporate the generation mechanism of a time series into a mathematical model for obtaining the linear sum of fluctuating oscillators.
[0153]
In addition, the technique of empirical mode decomposition not being able to obtain a linear sum of fluctuating oscillators from a multi-channel time series recorded simultaneously by a plurality of microphones has become known. The analysis system 100 assumes a situation in which a multi-dimensional time series is observed, and thus can obtain a linear sum of fluctuating oscillators from a multi-channel time series. [0154]
(Modification example)
As described above, the cardiac sound time series is an example, and the analysis system 100 does not necessarily have to analyze the time series of the cardiac sound. The time series which is a target for analysis in the analysis system 100 may be any time series insofar as it is a time series represented by a linear sum of amplitude waveforms of the fluctuating oscillator. The time series represented by a linear sum of amplitude waveforms of the fluctuating oscillator may be, for example, a time series of a respiratory sound. In a case where the time series represented by a linear sum of amplitude waveforms of the fluctuating oscillator is a time series of a respiratory sound, the analysis system 100 uses an expression representing the generation mechanism of the respiratory sound time series instead of an expression representing the generation mechanism of the cardiac sound time series. In this manner, the expression representing the generation mechanism of the cardiac sound time series is an example of an expression representing the generation mechanism of a time series which is a target for analysis.
[0155]
In addition, the state of a mathematical model representing the relationship between a probabilistic state transition and a symbol output is a two-phase state of an expiratory phase and an inspiratory phase in a case where the time series represented by a linear sum of amplitude waveforms of the fluctuating oscillator is a respiratory sound. In this manner, the state of a mathematical model representing the relationship between a probabilistic state transition and a symbol output is the state of a generation source of a time series represented by a linear sum of amplitude waveforms of the fluctuating oscillator.
[0156]
The learning apparatus 1 and the analysis apparatus 2 may be mounted using a plurality of information processing devices which are communicably connected to each other through a network. In this case, each functional unit included in the learning apparatus 1 and the analysis apparatus 2 may be distributed and mounted in a plurality of information processing devices.
[0157]
Meanwhile, the learning apparatus 1 and the analysis apparatus 2 do not necessarily have to be mounted as different devices. The learning apparatus 1 and the analysis apparatus 2 may be mounted as, for example, one device having both functions. [0158]
Meanwhile, all or some of the functions of the analysis system 100, the learning apparatus 1, and the analysis apparatus 2 may be realized using hardware such as an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), or the like. The program may be recorded in a computer readable recording medium. The computer readable recording medium refers to, for example, a portable medium such as a flexible disk, a magnetooptic disc, a ROM, or a CD-ROM, or a storage device such as a hard disk built into a computer system. The program may be transmitted through an electrical telecommunication line.
[0159]
Meanwhile, the cardiac sound time series is an example of an observed time series.
[0160]
Hereinbefore, the embodiments of the present invention have been described in detail with the accompanying drawings, but specific configurations are not limited to these embodiments, and may also include a design and the like without departing from the scope of the present invention.
[Reference Signs List]
[0161]
100 Analysis system 1 Learning apparatus
2 Analysis apparatus
11 Control unit
12 Input unit
13 Communication unit
14 Storage unit
15 Output unit
111 Cardiac sound time series acquisition unit
112 Learning processing execution unit
113 End determination unit
114 Recording unit
115 Output control unit
121 Time series input unit
122 Cardiac cycle state posterior distribution estimation unit
123 Oscillator time series posterior distribution estimation unit
124 Cardiac sound time series marginal distribution estimation unit
125 Update unit
21 Control unit
22 Input unit
23 Communication unit
24 Storage unit
25 Output unit
211 Analysis target acquisition unit
212 Analysis unit
213 Recording unit Output control unit Processor Memory Processor Memory

Claims

[CLAIMS] What is claimed is:
1. A learning apparatus comprising: a time series acquisition unit that is configured to, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquire an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series; and a learning processing execution unit that is configured to use an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, wherein the learning processing execution unit is configured to update the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model.
2. The learning apparatus according to claim 1, wherein the mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state is a hidden semi-Markov model.
3. The learning apparatus according to claim 1 wherein the observed time series is a time series of a cardiac sound.
4. An analysis apparatus comprising: an analysis target acquisition unit that is configured to acquire a time series which is a target for analysis; and an analysis unit that is configured to analyze a time series which is a target for analysis using a learned linear sum estimation learning model obtained by a learning apparatus including a time series acquisition unit that is configured to, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquire an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series and a learning processing execution unit that is configured to use an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, the learning processing execution unit updating the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model.
5. A learning method comprising: a time series acquisition step of, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquiring an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series; and a learning process execution step of using an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, wherein the learning process execution step includes updating the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model.
6. An analysis method comprising: an analysis target acquisition step of acquiring a time series which is a target for analysis; and an analysis step of analyzing a time series which is a target for analysis using a learned linear sum estimation learning model obtained by a learning apparatus including a time series acquisition unit that is configured to, with a time series of an amplitude of a fluctuating oscillator whose amplitude changes periodically being defined as an oscillator time series, acquire an observed time series which is a time series represented by an oscillator linear sum which is a linear sum of the oscillator time series and a learning processing execution unit that is configured to use an expression representing a generation mechanism of the observed time series and a mathematical model representing a relationship between a probabilistic state transition of a state of a generation source of the observed time series and a symbol output which is information probabilistically output in the state to execute a linear sum estimation learning model which is a mathematical model that is configured to estimate the oscillator linear sum of the observed time series on the basis of the observed time series, the learning processing execution unit updating the linear sum estimation learning model on the basis of a result of execution of the linear sum estimation learning model.
7. A non-transitory computer-readable medium having computerexecutable instructions that, upon execution of the instructions by a processor of a computer, cause the computer to function as the learning apparatus according to claim 1.
8. A non-transitory computer-readable medium having computerexecutable instructions that, upon execution of the instructions by a processor of a computer, cause the computer to function as the analysis apparatus according to claim 4.
PCT/US2021/054086 2021-10-08 2021-10-08 Learning apparatus, analysis apparatus, learning method, analysis method, and program Ceased WO2023059331A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2024520687A JP7712482B2 (en) 2021-10-08 2021-10-08 Learning device, analysis device, learning method, analysis method, and program
US18/695,959 US20240395406A1 (en) 2021-10-08 2021-10-08 Learning apparatus, analysis apparatus, learning method, analysis method, and program
PCT/US2021/054086 WO2023059331A1 (en) 2021-10-08 2021-10-08 Learning apparatus, analysis apparatus, learning method, analysis method, and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2021/054086 WO2023059331A1 (en) 2021-10-08 2021-10-08 Learning apparatus, analysis apparatus, learning method, analysis method, and program

Publications (1)

Publication Number Publication Date
WO2023059331A1 true WO2023059331A1 (en) 2023-04-13

Family

ID=85804599

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2021/054086 Ceased WO2023059331A1 (en) 2021-10-08 2021-10-08 Learning apparatus, analysis apparatus, learning method, analysis method, and program

Country Status (3)

Country Link
US (1) US20240395406A1 (en)
JP (1) JP7712482B2 (en)
WO (1) WO2023059331A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130013274A1 (en) * 2007-09-10 2013-01-10 Cedars-Sinai Medical Center Mass spectrometry systems
US20160097716A1 (en) * 2014-09-29 2016-04-07 Zyomed Corp. Systems and methods for blood glucose and other analyte detection and measurement using collision computing
WO2019094729A1 (en) * 2017-11-09 2019-05-16 Strong Force Iot Portfolio 2016, Llc Methods and systems for the industrial internet of things
US20190237164A1 (en) * 2010-07-05 2019-08-01 Sony Corporation Biological information processing method and device, recording medium and program

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012513858A (en) * 2008-12-30 2012-06-21 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Method and system for processing heart sound signals
EP3363351B1 (en) * 2017-02-16 2023-08-16 Tata Consultancy Services Limited System for detection of coronary artery disease in a person using a fusion approach
CN112567459B (en) * 2018-08-24 2023-12-12 三菱电机株式会社 Sound separation device, sound separation system, sound separation method and storage medium
JP6989968B2 (en) * 2019-07-10 2022-01-12 株式会社ニューギン Pachinko machine

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130013274A1 (en) * 2007-09-10 2013-01-10 Cedars-Sinai Medical Center Mass spectrometry systems
US20190237164A1 (en) * 2010-07-05 2019-08-01 Sony Corporation Biological information processing method and device, recording medium and program
US20160097716A1 (en) * 2014-09-29 2016-04-07 Zyomed Corp. Systems and methods for blood glucose and other analyte detection and measurement using collision computing
WO2019094729A1 (en) * 2017-11-09 2019-05-16 Strong Force Iot Portfolio 2016, Llc Methods and systems for the industrial internet of things

Also Published As

Publication number Publication date
US20240395406A1 (en) 2024-11-28
JP2024535512A (en) 2024-09-30
JP7712482B2 (en) 2025-07-23

Similar Documents

Publication Publication Date Title
Dhar et al. Cross-wavelet assisted convolution neural network (AlexNet) approach for phonocardiogram signals classification
JP7337788B2 (en) Genome discovery for use in machine learning methods
US10265029B2 (en) Methods and systems for calculating and using statistical models to predict medical events
Yang et al. Adaptive change detection in heart rate trend monitoring in anesthetized children
Altan Diagnosis of coronary artery disease using deep belief networks
JP2020036633A (en) Abnormality determination program, abnormality determination method, and abnormality determination device
CN119074038B (en) Cardiopulmonary sound data monitoring method and system based on big data
Murthy et al. ANN, SVM and KNN classifiers for prognosis of cardiac ischemia-a comparison
Xie et al. Intelligent analysis of premature ventricular contraction based on features and random forest
Yang et al. Application of artificial intelligence-based auxiliary diagnosis in congenital heart disease screening
Gupta et al. Heart Disease Prediction using Machine learning algorithms
Mondal et al. Boundary estimation of cardiac events S1 and S2 based on Hilbert transform and adaptive thresholding approach
CN113469218A (en) Electrocardiosignal critical value processing method, system and medium based on deep learning
JP7712482B2 (en) Learning device, analysis device, learning method, analysis method, and program
Elgendi et al. Detection of Heart Sounds in Children with and without Pulmonary Arterial Hypertension―Daubechies Wavelets Approach
Al-Sharu et al. Detection of valvular heart diseases using fourier transform and simple cnn model
CN116763281B (en) Fistula maturity monitoring method, device and medium based on blood flow acoustic response
CN115067962B (en) Method and device for classifying electrocardiogram signals
Popalzai et al. Enhancing Cardiac Health Diagnoses Through Machine Learning Analysis of Phonocardiograms (PCG)
Zhang et al. An Integrated Framework for Assessing the Quality of Non-invasive Fetal Electrocardiography Signals
Maragoudakis et al. Heart sound screening in real-time assistive environments through MCMC Bayesian data mining
Zhang et al. A Study on the Association between Korotkoff Sound Signaling and Chronic Heart Failure (CHF) Based on Computer‐Assisted Diagnoses
CN115177260A (en) Intelligent electrocardio-heart sound diagnosis method and device based on artificial neural network
US20230301616A1 (en) Lung sound analysis system
Chen et al. Research on Heart Sound Classification Based on SVM Model

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21960065

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18695959

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2024520687

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21960065

Country of ref document: EP

Kind code of ref document: A1