CN114305485A - Heartbeat monitoring method, heartbeat monitoring device and computer readable storage medium - Google Patents
Heartbeat monitoring method, heartbeat monitoring device and computer readable storage medium Download PDFInfo
- Publication number
- CN114305485A CN114305485A CN202111671822.9A CN202111671822A CN114305485A CN 114305485 A CN114305485 A CN 114305485A CN 202111671822 A CN202111671822 A CN 202111671822A CN 114305485 A CN114305485 A CN 114305485A
- Authority
- CN
- China
- Prior art keywords
- heart sound
- target
- original
- sound data
- detected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a heartbeat monitoring device, a heartbeat monitoring method and a computer readable storage medium, wherein the heartbeat monitoring device comprises: a microphone array including a plurality of microphone units, the plurality of microphone units being arranged in an array; the microphone units are used for acquiring heart sound data of a target to be detected to obtain a plurality of original heart sound data; and the processing unit is connected with the microphone unit and used for determining the phonocardiogram of the target to be detected based on the original phonocardiogram data. The method can acquire the phonocardiogram of the target to be detected in a non-contact mode, meets the requirements of users on privacy and sanitation, and can be used for medical diagnosis.
Description
Technical Field
The present invention relates to the field of sound recognition technologies, and in particular, to a heartbeat monitoring method, a heartbeat monitoring device, and a computer-readable storage medium.
Background
In the existing heart monitoring equipment, the equipment specialty with good cost performance is not enough; the equipment with better specialty has high cost, needs to be used by groups, has the defects of queuing, privacy and sanitation, and the use scenes are mostly limited in the aspect of medical diagnosis.
Heart sounds are sounds generated by opening and closing of valves, contraction of muscle of tendons, impact of blood flow, and vibration of a wall of a heart vessel during heart activities, and a phonocardiogram is a visual record of heart sounds. Phonocardiograms provide valuable information for understanding cardiovascular function, selecting treatments, judging pathophysiology, and studying the mechanisms of certain diseases.
A conventional heart sound monitoring device such as a stethoscope is composed of a stethoscope head, a sound guide tube and an ear hook, wherein the stethoscope head is in contact with the body of a monitored person and is responsible for picking up sound; the sound-conducting tube and the ear loop are responsible for the sound conduction, which together form a sound transmission channel that is less attenuated than the propagation in air. By using the stethoscope, a doctor can listen to the heart sound of the monitor more clearly. The stethoscope is mainly a contact type measurement, is not friendly to privacy and sanitation, has high requirements on operators, and requires the operators to have abundant clinical experience and good hearing.
The existing electrocardiograph has high measurement precision and rich medical reference value information. However, the unit price of the equipment is high, the equipment is often used as medical equipment, certain time cost and economic burden are brought to users, the requirement for operation is high, operators are required to have abundant clinical experience and equipment use experience, and the electrocardiograph is not friendly to privacy and sanitation when in contact measurement.
The existing sports bracelet monitors heartbeat activity based on a photoelectric plethysmography, which is a non-invasive detection method for detecting blood volume change in living tissues by utilizing a photoelectric means. When a light beam of a certain wavelength is irradiated onto the skin surface, the contraction and expansion of blood vessels affects the transmission or reflection of light every heartbeat. When light is transmitted through the skin tissue and then reflected to the light sensitive sensor, there is some attenuation of the light. The absorption of light by the tissues like muscles, bones, veins and other connections is substantially constant (provided that there is no substantial movement of the measurement site), but the arteries will be different and naturally also vary due to the pulsation of the blood in the arteries. When we convert light into an electrical signal, the signal obtained can be divided into a direct current signal and an alternating current signal just because the absorption of light by the artery changes and the absorption of light by other tissues is basically unchanged. The alternating current signal in the heart beat monitoring device is extracted, so that the flowing characteristic of blood can be reflected, and further the heart beat monitoring is realized. However, the measurement accuracy of the sports bracelet is not enough, and only heart rate and blood oxygen monitoring are needed, so that the information of reference value for medical diagnosis is not much.
Disclosure of Invention
The invention provides a heartbeat monitoring method and a heartbeat monitoring device, which can acquire a phonocardiogram of a target to be detected in a non-contact mode, meet the requirements of users on privacy and sanitation and can be used for medical diagnosis.
In order to solve the above technical problems, a first technical solution provided by the present invention is: provided is a heartbeat monitoring method, including: acquiring heart sound data of a target to be detected by using a plurality of microphone units to obtain a plurality of original heart sound data, wherein the plurality of microphone units form a microphone array; and determining the heart sound image of the target to be detected based on the original heart sound data.
Wherein the step of determining the phonocardiogram of the target to be detected based on the original phonocardiogram data comprises the following steps: and fusing the original heart sound data to obtain a heart sound picture of the target to be detected.
The step of fusing the plurality of original heart sound data to obtain the heart sound image of the target to be detected comprises the following steps: framing the original heart sound data based on preset overlapped frames to obtain a plurality of original heart sound fragments; and overlapping the corresponding original heart sound fragments in the same time period in each original heart sound data to further obtain a heart sound picture of the target to be detected.
Wherein, the step of superposing the original heart sound segments corresponding to the same time period in each original heart sound data comprises: converting the original heart sound segment into a frequency domain signal; filtering the frequency domain signal to obtain a predicted heart sound segment; and superposing the predicted heart sound segments corresponding to the same time period to obtain a heart sound picture of the target to be detected.
Wherein the step of filtering the frequency domain signal comprises: determining a filter coefficient of each original heart sound data based on the frequency of the original heart sound data, the position of a microphone unit corresponding to the original heart sound data and the position of a sound source; and carrying out filtering processing on the frequency domain signal based on the filtering coefficient.
Wherein, the step of obtaining the phonocardiogram of the target to be detected by superposing the predicted phonocardiogram segments corresponding to the same time period comprises the following steps: and splicing the superposed predicted heart sound segments based on a preset overlapped frame to obtain a heart sound picture of the target to be detected.
The step of splicing the superposed predicted heart sound segments based on the preset overlapped frame to obtain the heart sound picture of the target to be detected comprises the following steps: converting the superimposed predicted heart sound segments into time domain signals; and splicing the time domain signals based on a preset overlapped frame to obtain a phonocardiogram of the target to be detected.
In order to solve the above technical problems, a second technical solution provided by the present invention is: there is provided a heartbeat monitoring device including: a microphone array including a plurality of microphone units, the plurality of microphone units being arranged in an array; the microphone units are used for acquiring heart sound data of a target to be detected to obtain a plurality of original heart sound data; and the processing unit is connected with the microphone unit and used for determining the phonocardiogram of the target to be detected based on the original phonocardiogram data.
Wherein the microphone array comprises a first combination and a second combination, the first combination comprises partial microphone units, and the partial microphone units are arranged along a first direction; the second combination includes the remaining microphone units, and the remaining microphone units are arranged along the first direction.
In order to solve the above technical problems, a second technical solution provided by the present invention is: there is provided a computer readable storage medium storing a program file executable to implement the method of any one of the above.
The method has the beneficial effects that the method is different from the prior art, the heart sound data of the target to be detected is collected through the plurality of microphone units, and a plurality of original heart sound data are obtained; and determining the heart sound image of the target to be detected based on the original heart sound data. The method can acquire the phonocardiogram of the target to be detected in a non-contact mode, meets the requirements of users on privacy and sanitation, and can be used for medical diagnosis.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without inventive efforts, wherein:
FIG. 1 is a schematic structural diagram of a heartbeat monitoring device according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a microphone array according to an embodiment of the invention;
FIG. 3 is a schematic position diagram of a heartbeat monitoring device, a sound source, and a speaker according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of raw heart sound data according to the present invention;
fig. 5 is a flowchart illustrating a heartbeat monitoring method according to an embodiment of the present invention.
FIG. 6 is a schematic diagram of a coordinate system of a sound source and microphone unit;
FIG. 7 is a schematic diagram of framing original heart sound data;
FIG. 8 is a schematic illustration of stitching second overlay data;
fig. 9 is a schematic structural diagram of a computer-readable storage medium.
Detailed description of the invention
In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless explicitly specifically limited otherwise. All directional indications (such as up, down, left, right, front, and back) in the embodiments of the present application are only used to explain the relative positional relationship between the components, the movement, and the like in a specific posture (as shown in the drawings), and if the specific posture is changed, the directional indication is changed accordingly. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 is a schematic structural diagram of a heartbeat monitoring device according to an embodiment of the present invention. The heartbeat monitoring device comprises a front-end acquisition device and a rear-end processing algorithm. Specifically, the front-end acquisition device is a microphone array 11, and the back-end processing algorithm is a processing unit 12. The microphone array 11 can collect heart sounds of the target to be measured and environmental noise. In operation, the distance between the precordial region (i.e. the position of the anterior chest close to the heart) of the target to be measured and the microphone array 11 is required to be controlled within 50 cm. The processing unit 12 divides pre-filtering and directional sound pickup to finally obtain an enhanced phonocardiogram by suppressing full-space high-frequency noise and low-frequency noise outside the precordial range of the heart sound.
The frequency band of the heart sound is 1-800 Hz, but the energy is mainly concentrated within 250Hz, so the system design should take the heart sound within 250Hz as the optimization target. This object can be achieved in particular in two steps. Pre-filtering to suppress sound in the full spatial range and with frequency higher than 250 Hz; the directional sound pickup is used for restraining the environmental background noise with the frequency below 250Hz in the area except the heart sound area. Specifically, the microphone array 11 needs to adopt a proper array type and array element number, and is matched with directional pickup to suppress interference noise; the back-end processing algorithm needs to complete data processing of pre-filtering and directional sound pickup.
Different spatial resolutions can be achieved with different microphone types and numbers. For sounds in the frequency band of 1-250 Hz (referred to as heart sounds and ambient background noise), the following facts exist: the acoustic wavelengths within this band cover 1.36 to 340 meters. The longer the wavelength, the weaker the sound directivity, and the stronger the diffraction ability; sounds within 50Hz are almost non-directional, and sounds above 100Hz gradually exhibit directivity. Therefore, there is a strong need for sound collection in the 1 to 250Hz band, and background noise and heart sound are separated as much as possible by using sound directivity. The spatial resolution is optimal when the microphone spacing is half wavelength, and the 250Hz directivity is considered to be the best, so when the microphone array 11 is designed, the microphone spacing may be arranged to be half wavelength of 250Hz sound wave, i.e. 0.68 m. In a living room, the noise is not uniformly distributed in the vertical and horizontal directions, and more sound is generally transmitted in the horizontal direction. In the vertical direction, generally, because the ceiling and the floor are complete planes, sound from the outside which propagates in the vertical direction is shielded more; in the horizontal direction, sound from the outside traveling in the horizontal direction is likely to enter the living room by diffraction due to the close size of the doors and windows and the proximity of low frequency sound wavelengths. In addition, the sound generated in the living room mainly comes from electric appliances and human beings, and the heights of the electric appliances and the human beings are mainly distributed between 50cm and 160 cm. In view of this, the microphone array 11 requires a higher spatial resolution in the horizontal direction to distinguish different sound sources.
Based on the above facts, the present application proposes a microphone array as shown in fig. 2, the microphone array includes a first combined mic1 and a second combined mic2, the first combined mic1 includes partial microphone units, and the partial microphone units are arranged along a first direction; the second combined mic2 includes the remaining microphone units, and the remaining microphone units are arranged in a first direction; the distance between the first combined mic1 and the second combined mic2 is 50-80 cm. In one embodiment, the distance between the first combination mic1 and the second combination mic2 is 68 cm. The first direction may be longitudinal or transverse.
In one embodiment, the microphone array used in the present application includes 128 microphone units, the 128 microphone units are divided into a first combination mic1 and a second combination mic2, and the first combination mic1 and the second combination mic2 respectively include 64 microphone units, and 64 microphone units in each combination are longitudinally distributed. I.e. 128 microphones are separated into two columns, each column comprising 64 microphone units.
In one embodiment, when the heart sound data is collected by the microphone array 11, the microphone array 11 is placed indoors, and the indoor background noise is actually measured as 40dB SPL by a sound pressure meter. By taking the central point of the microphone array 11 as a reference, a test person is 50cm away from the microphone array, a sound box is arranged 280 cm left of the test person to play news programs, and the sound pressure level of the sound box is measured by a sound pressure meter to be 60dB SPL when the sound box is played. The sound box is designed to play news programs, and the purpose is to evaluate the interference degree of a small amount of life noise on the heart sound monitoring. The data acquisition and the spatial relationship are shown in fig. 3. After the collection environments are arranged, the heart sound data obtained by one of the microphone units is visually displayed as shown in fig. 4, it can be seen that there is no obvious heart sound envelope in the microphone waveform, and if the file is played by a player, news programs played by a sound box with the length of 2.8 meters can be heard invisibly.
To sum up, the heartbeat monitoring device of this application can set up in the target distance 1 ~ 50cm department that awaits measuring when gathering heart sound data.
After the microphone array 11 collects the heart sound data of the target to be detected to obtain a plurality of original heart sound data, the processing unit 12 determines the heart sound image of the target to be detected based on the original heart sound data. In an embodiment, the processing unit 12 may be a stand-alone electronic device, such as a mobile phone, a computer, or the like, and may also be a software execution subject centralized in other devices.
Whether the processing unit 12 is a stand-alone device or integrated with other devices, the devices are required to include interconnected memory and processors.
The memory is used for storing program instructions for implementing the heartbeat monitoring method.
The processor is operable to execute program instructions stored by the memory.
The processor may also be referred to as a CPU (Central Processing Unit). The processor may be an integrated circuit chip having signal processing capabilities. The processor may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory can be a memory bank, a TF card, etc., and can store all information in the electronic equipment, including input original data, computer programs, intermediate operation results and final operation results, which are stored in the memory. It stores and retrieves information based on the location specified by the controller. With the memory, the electronic device can only have the memory function to ensure the normal operation. The storage of electronic devices can be classified into a main storage (internal storage) and an auxiliary storage (external storage) according to the use, and also into an external storage and an internal storage. The external memory is usually a magnetic medium, an optical disk, or the like, and can store information for a long period of time. The memory refers to a storage component on the main board, which is used for storing data and programs currently being executed, but is only used for temporarily storing the programs and the data, and the data is lost when the power is turned off or the power is cut off.
In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented by other methods. For example, the above-described apparatus implementation methods are merely illustrative, e.g., the division of modules or units into only one logical functional division, and additional division methods may be implemented in practice, e.g., units or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment of the method.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a system server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the implementation method of the present application.
Referring to fig. 5, a schematic flow chart of an embodiment of the heartbeat monitoring method of the present invention includes:
step S51: the method comprises the steps of collecting heart sound data of a target to be detected by utilizing a plurality of microphone units to obtain a plurality of original heart sound data, wherein the plurality of microphone units form a microphone array.
Specifically, a plurality of microphone units are used for collecting heart sound data of a target to be detected, and a plurality of original heart sound data are obtained. As shown in fig. 2, a plurality of microphone units constitute a microphone array. It should be noted that each microphone unit acquires and stores original heart sound data, which is acquired by the microphone unit. Assuming that the number of the microphone units is 128, 128 pieces of original heart sound data are obtained, and are stored as M _1, M _2, M _3, and M _4.
Step S52: and determining a heart sound picture of the target to be detected based on the original heart sound data.
Specifically, a plurality of original heart sound data are fused to obtain a heart sound image of the target to be detected. In a specific embodiment, the original heart sound data is subjected to framing processing based on preset overlapped frames to obtain a plurality of original heart sound fragments; and overlapping the corresponding original heart sound fragments in the same time period in each original heart sound data to further obtain a heart sound picture of the target to be detected. Specifically, the original heart sound segment is a time domain signal, the original heart sound segment is converted into a frequency domain signal, then the frequency domain signal is filtered to obtain a predicted heart sound segment, and the predicted heart sound segments corresponding to the same time period are overlapped to obtain a heart sound image of the target to be detected. In one embodiment, it is desirable to determine a filter coefficient, for example, a filter coefficient for each of the raw heart sound data based on the frequency of the raw heart sound data, the position of the microphone unit corresponding to the raw heart sound data, and the sound source position; and carrying out filtering processing on the frequency domain signal based on the filtering coefficient. And after the predicted heart sound segments are overlapped, splicing the overlapped predicted heart sound segments based on a preset overlapped frame to obtain a heart sound picture of the target to be detected. Specifically, the superposed predicted heart sound segments are converted into time domain signals; and splicing the time domain signals based on a preset overlapped frame to obtain a phonocardiogram of the target to be detected.
The phonocardiogram comprises a first heart sound signal which represents the diastolic state of the target to be detected; and/or the phonocardiogram comprises a second heart sound signal which represents the heart contraction state of the object to be detected; and/or the phonocardiogram comprises a third heart sound signal which represents the vibration of the heart and the valve of the target to be detected; and/or the phonocardiogram comprises a fourth heart sound signal caused by a contraction of the heart.
The heartbeat monitoring process of the present application is described below with reference to specific embodiments. And after acquiring the original heart sound data through the microphone unit, filtering the original heart sound data. The purpose of the filtering is to suppress the high frequency signals and to preserve the low frequency part signals where the heart sound data are located. If necessary, a sample rate conversion is also added to match the front-end and back-end rates. For human heart sound monitoring, the application intercepts 250HZ heart sound data by filtering the original heart sound data. The animal can be appropriately adjusted according to specific needs.
Specifically, when the original heart sound data is filtered, a proper filter coefficient needs to be selected. Specifically, the filter coefficient of the original heart sound data is determined based on the frequency of the original heart sound data, the position of the microphone unit corresponding to the original heart sound data, and the sound source position. In one embodiment, a coordinate system is established in which each microphone unit and sound source (heart) has its corresponding coordinate position. Taking the microphone unit m as an example, as shown in fig. 6, in the figure, the coordinate system origin is represented by o, the sound source is represented by s, and m represents a certain microphone unit. The path difference of sound from the sound source s point to the coordinate system origin o point and the microphone unit m point is represented by d, as follows:
this is to calculate the reference point using the o point as the path difference, but other points may be used as the reference. For example, the s point is directly used as a path difference calculation reference, and the path difference d is directly expressed as:
given that the propagation velocity of sound in air is C, the phase difference due to the difference in the distance traveled by d can be obtained for a sound signal with frequency f by the following equation:
for a sampling rate of fsDiscrete Fourier transform of length L, frequency resolution fΔExpressed as:
the frequency point distribution is as follows:
{0，fΔ，2fΔ，...，0.5fs，0.5fs-fΔ，0.5fs-2fΔ，...，2fΔ，fΔ}；
wherein, {0, fΔ，2fΔ，...，0.5fsThe front half is;
{0.5fs-fΔ，0.5fs-2fΔ，...，2fΔ，fΔthe second half.
For the first half, the filter coefficients are expressed as:
for the second half, the filter coefficients are expressed as follows:
due to phase difference
Is a function of frequency f, microphone coordinates m, and sound source coordinates s, the spatial filter coefficient r can be further expressed as a function of f, m, and s, such as: r ═ R (f, m, s).
It should be noted that each microphone unit obtains a set of filter coefficients by calculation, and for one microphone unit, each frequency f corresponds to one filter coefficient.
In an embodiment, the original heart sound data is subjected to framing processing based on a preset overlapping frame to obtain a plurality of original heart sound fragments. In one embodiment, each frame is of length L, requiring 1/2 frames of overlap between preceding and succeeding frames, as shown in fig. 7. m denotes the number of the microphone units in the microphone array, and t (m) denotes the signal of the original heart sound data of the microphone unit m after being filtered. T (m, n) represents a frame with the sequence number n after the framing processing of T (m). As can be seen from fig. 7, the preset overlap frame selected in the present embodiment is 1/2 frames. As shown in fig. 7, the original heart sound segments T (m, n1), T (m, n2), T (m, n3) and T (m, n4) are obtained after framing.
The method comprises the steps of converting an original heart sound segment into a frequency domain signal, specifically, performing Fourier transform on the original heart sound segment, and further converting the original heart sound segment into the frequency domain signal. It should be noted that. The original heart sound segment is a time domain signal. Specifically, the original heart sound segment is subjected to discrete fourier transform to obtain a frequency domain signal F (m, n), W represents a windowing function adopted during fourier transform, and DFT represents the discrete fourier transform. Is represented as follows:
and carrying out filtering processing on the frequency domain signal based on the filtering coefficient to obtain a predicted heart sound segment. Specifically, the fourier transform result F (m, n) is multiplied by the spatial filtering coefficient R (F, m, s) to obtain the predicted heart sound segment, that is:
G(m，n)＝F(m，n)R(f，m，s)。
specifically, a 256-order low-pass filter is designed by adopting a Chebyshev window function, and the out-of-band attenuation is 100 dB. And then, reading the frequency domain signals one by one and filtering the frequency domain signals.
Further, the predicted heart sound segments corresponding to the same time period are superposed to obtain a heart sound picture of the target to be detected. Specifically, a total of 128 pieces of original heart sound data M1_1, M1_2, M1_3, and M1_4. For example, the original heart sound data M1_1 obtains four predicted heart sound segments T1_1, T1_2, T1_3 and T1_4, the original heart sound data M1_2 obtains four predicted heart sound segments T2_1, T2_2, T2_3 and T2_4, the original heart sound data M1_3 obtains four predicted heart sound segments T3_1, T3_2, T3_3 and T3_4, and the original heart sound data M1_128 obtains four predicted heart sound segments T128_1, T128_2, T128_3 and T128_4, wherein T1_1, T2_1, T3_1 and T128_1 correspond to the same time; t1_2, T2_2, T3_2 and T128_2 correspond to the same time; t1_3, T2_3, T3_3 and T128_3 correspond to the same time; wherein, T1_128, T2_128, T3_128 and T128_128 correspond to the same time. At this time, T1_1, T2_1, T3_1 and T128_1 are superimposed, T1_2, T2_2, T3_2 and T128_2 are superimposed, T1_3, T2_3, T3_3 and T128_3 are superimposed, and T1_128, T2_128, T3_128 and T128_128 are superimposed. Specifically, if the total number of microphone units provided by the microphone array is J, the result of the n-th frame of the multi-channel superimposition processing for the sound from the sound source s is represented by Φ (n), as follows:
and determining the phonocardiogram of the target to be detected based on the superposed data. Specifically, the superimposed predicted heart sound segment is converted into a time domain signal. And splicing the time domain signals based on a preset overlapped frame to obtain a phonocardiogram of the target to be detected. In a specific embodiment, the superimposed predicted heart sound segment is transformed by an inverse fourier transform, and the superimposed predicted heart sound segment is further transformed into a time-domain signal. .
Because phi (n) is the representation of the heart sound in the frequency domain, the time domain signal of the corresponding frame can be recovered only by performing inverse Fourier transform on phi (n), the superposed predicted heart sound segment is represented by T' (n), and the time domain signal is as follows:
furthermore, since the audio data is processed into L frames according to length and 1/2 overlaps between frames, the T '(n) frame and the T' (n +1) frame are added and spliced according to 1/2 offset positions to restore a continuous audio time domain signal, as shown in fig. 8.
In practice, since the original signal is a real signal, the heart sound signal can be obtained by overlapping and adding the real part of T' (n) with 1/2 frames, and the graphical display thereof is a heart sound diagram, which can be used for medical diagnosis and health monitoring. The imaginary part of T' (n) can be directly discarded.
From the technical route, the proposal achieves the purpose of heart monitoring based on acoustic signals. Compared with the existing scheme (stethoscopes and phonocardiographs), the method can realize non-contact monitoring, expands the application scenes (except medical treatment, sports health, intelligent breeding, animal protection and the like), can well solve privacy and health problems by the non-contact monitoring, and has no requirements on clinical experience and hearing of operators.
Compared with a method based on video analysis, the non-contact type application form has the advantages that the provided monitoring information is wider in frequency spectrum and richer in information, the first heart sound and the second heart sound can be clearly seen, and the medical diagnosis value is higher. The first heart sound occurs at the beginning of systole, with a deep tone and a long duration (about 0.15 seconds). The causes include the contraction of the ventricular muscle, the sudden closing of the atrioventricular valve and the subsequent ejection of blood into the aorta. The optimal auscultation site for the first heart sound is in the fifth intercostal space at the midline of the clavicle or at the right sternum margin. The second heart sound occurs at the beginning of diastole, with a higher frequency and a shorter duration (about 0.08 seconds). The reason for this is the vibrations caused by the closing of the semilunar valves, the impact of the valves on each other and the deceleration of the blood in the aorta and the rapid drop in the intraventricular pressure. The optimal auscultation sites for the second heart sound are in the aortic valve region to the right and pulmonary valve region to the left of the second intercostal space.
The heartbeat monitoring method and the heartbeat monitoring device can be applied to medical related equipment, such as a wall-mounted general diagnostic apparatus. After the method is adopted, the equipment can detect the heart sound of the user only by the user approaching the equipment and display the heart sound on the display screen, and a diagnosis suggestion can be given by further utilizing a heart sound diagnosis algorithm.
The heartbeat monitoring method and the heartbeat monitoring device can also be applied to sports equipment, such as a treadmill. After the method is adopted, the heart rate of the user can be obtained in real time, the user can move without the handrail, and the restraint is less.
The heartbeat monitoring method and the heartbeat monitoring device can also be applied to intelligent breeding, pet medical treatment and endangered animal protection, and can develop non-contact monitoring equipment for animal heart sounds. The intelligent solution is provided for intelligent breeding, pet medical treatment and endangered animal protection.
Referring to fig. 9, which is a schematic structural diagram of an embodiment of a computer-readable storage medium of the present invention, the storage medium of the present application stores a program file 91 capable of implementing all the methods described above, where the program file 91 may be stored in the storage medium in the form of a software product, and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute all or part of the steps of each implementation method of the present application. The aforementioned storage device includes: various media capable of storing program codes, such as a usb disk, a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, or terminal devices, such as a computer, a server, a mobile phone, and a tablet.
The above description is only an implementation method of the present invention, and not intended to limit the scope of the present invention, and all equivalent structures or equivalent flow transformations made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A method of heartbeat monitoring, comprising:
acquiring heart sound data of a target to be detected by using a plurality of microphone units to obtain a plurality of original heart sound data, wherein the plurality of microphone units form a microphone array;
and determining the heart sound image of the target to be detected based on the original heart sound data.
2. The method of claim 1, wherein the step of determining a phonocardiogram of the target to be tested based on the raw heart sound data comprises:
and fusing the original heart sound data to obtain a heart sound picture of the target to be detected.
3. The method according to claim 2, wherein the step of fusing the plurality of original heart sound data to obtain the heart sound map of the target to be measured comprises:
framing the original heart sound data based on preset overlapped frames to obtain a plurality of original heart sound fragments;
and overlapping the corresponding original heart sound fragments in the same time period in each original heart sound data to further obtain a heart sound picture of the target to be detected.
4. The method according to claim 3, wherein the step of superimposing the original heart sound segments corresponding to the same time period in each of the original heart sound data comprises:
converting the original heart sound segment into a frequency domain signal;
filtering the frequency domain signal to obtain a predicted heart sound segment;
and superposing the predicted heart sound segments corresponding to the same time period to obtain a heart sound picture of the target to be detected.
5. The method of claim 4, wherein the step of filtering the frequency domain signal comprises:
determining a filter coefficient of each original heart sound data based on the frequency of the original heart sound data, the position of a microphone unit corresponding to the original heart sound data and the position of a sound source;
and carrying out filtering processing on the frequency domain signal based on the filtering coefficient.
6. The method according to claim 4, wherein the step of obtaining the phonocardiogram of the target to be measured by superposing the predicted phonocardiogram segments corresponding to the same time period comprises:
and splicing the superposed predicted heart sound segments based on a preset overlapped frame to obtain a heart sound picture of the target to be detected.
7. The method according to claim 6, wherein the step of splicing the superposed predicted heart sound segments based on the preset overlapped frames to obtain the heart sound map of the target to be detected comprises:
converting the superimposed predicted heart sound segments into time domain signals;
and splicing the time domain signals based on a preset overlapped frame to obtain a phonocardiogram of the target to be detected.
8. A heartbeat monitoring device, comprising:
a microphone array including a plurality of microphone units, the plurality of microphone units being arranged in an array; the microphone units are used for acquiring heart sound data of a target to be detected to obtain a plurality of original heart sound data;
and the processing unit is connected with the microphone unit and used for determining the phonocardiogram of the target to be detected based on the original phonocardiogram data.
9. The apparatus of claim 8, wherein the microphone array comprises a first combination and a second combination, the first combination comprising a portion of the microphone units, and the portion of the microphone units being arranged in a first direction; the second combination includes the remaining microphone units, and the remaining microphone units are arranged along the first direction.
10. A computer-readable storage medium, characterized in that a program file is stored, which program file can be executed to implement the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111671822.9A CN114305485A (en) | 2021-12-31 | 2021-12-31 | Heartbeat monitoring method, heartbeat monitoring device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111671822.9A CN114305485A (en) | 2021-12-31 | 2021-12-31 | Heartbeat monitoring method, heartbeat monitoring device and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114305485A true CN114305485A (en) | 2022-04-12 |
Family
ID=81020913
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111671822.9A Pending CN114305485A (en) | 2021-12-31 | 2021-12-31 | Heartbeat monitoring method, heartbeat monitoring device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114305485A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110353725A (en) * | 2019-07-10 | 2019-10-22 | 东南大学 | A kind of heart sound acquisition and analysis system and method based on cloud framework |
| JP2020137890A (en) * | 2019-02-28 | 2020-09-03 | 株式会社Ｏｂｅｘ | Wearable device for pregnant woman, information processing system, portable information terminal, uterine contraction degree measuring method, and program of the same |
| CN112714383A (en) * | 2020-12-30 | 2021-04-27 | 西安讯飞超脑信息科技有限公司 | Microphone array setting method, signal processing device, system and storage medium |
| CN113299307A (en) * | 2021-05-21 | 2021-08-24 | 深圳市长丰影像器材有限公司 | Microphone array signal processing method, system, computer device and storage medium |
| CN113842123A (en) * | 2021-09-26 | 2021-12-28 | 中国科学院软件研究所 | Microphone array-based non-contact heartbeat detection method and system |
-
2021
- 2021-12-31 CN CN202111671822.9A patent/CN114305485A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2020137890A (en) * | 2019-02-28 | 2020-09-03 | 株式会社Ｏｂｅｘ | Wearable device for pregnant woman, information processing system, portable information terminal, uterine contraction degree measuring method, and program of the same |
| CN110353725A (en) * | 2019-07-10 | 2019-10-22 | 东南大学 | A kind of heart sound acquisition and analysis system and method based on cloud framework |
| CN112714383A (en) * | 2020-12-30 | 2021-04-27 | 西安讯飞超脑信息科技有限公司 | Microphone array setting method, signal processing device, system and storage medium |
| CN113299307A (en) * | 2021-05-21 | 2021-08-24 | 深圳市长丰影像器材有限公司 | Microphone array signal processing method, system, computer device and storage medium |
| CN113842123A (en) * | 2021-09-26 | 2021-12-28 | 中国科学院软件研究所 | Microphone array-based non-contact heartbeat detection method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107205716B (en) | Infrasonic stethoscope for monitoring physiological processes | |
| CN103313662B (en) | System, the stethoscope of the risk of instruction coronary artery disease | |
| US5727561A (en) | Method and apparatus for non-invasive detection and analysis of turbulent flow in a patient's blood vessels | |
| US20170188978A1 (en) | System and method of measuring hemodynamic parameters from the heart valve signal | |
| KR20140121366A (en) | Electronic stethoscopy apparatus, automatic diagnostic apparatus and method for diagnosing automatically | |
| JPH11506970A (en) | Method and apparatus for characterizing gastrointestinal sounds | |
| US20170209115A1 (en) | Method and system of separating and locating a plurality of acoustic signal sources in a human body | |
| WO2010019198A2 (en) | Spectrum analysis of coronary artery turbulent blood flow | |
| RU2346653C2 (en) | Cardiovascular sound analysis method and system | |
| WO2018045499A1 (en) | Pulse wave diagnostic system having respiratory wave collection function | |
| Jing et al. | Noninvasive acoustical analysis system of coronary heart disease | |
| CN114305485A (en) | Heartbeat monitoring method, heartbeat monitoring device and computer readable storage medium | |
| JP6628935B2 (en) | Fetal size monitoring system and method | |
| Pariaszewska et al. | Digital stethoscope system: the feasibility of cardiac auscultation | |
| Schlaikjer et al. | Simulation of RF data with tissue motion for optimizing stationary echo canceling filters | |
| Monika et al. | Embedded Stethoscope for Real Time Diagnosis of Cardiovascular Diseases | |
| Charlier et al. | AcCorps: A low-cost 3D printed stethoscope for fetal phonocardiography | |
| Szymanowska et al. | Development of an electronic stethoscope | |
| Al-Jarrah et al. | Novel hybrid computed axial phono-cardiac tomography system for heart sound sources localization | |
| Saha et al. | Relationship between vowel sound features and pharyngeal airway cross-sectional area during normal breathing | |
| Mehamedyasin | OBJECTIVE IDENTIFICATION OF HEART BEAT STATUS USING SPECTRAL ANALYSIS | |
| McKee et al. | Multi-sensor Stethoscope for chest sound localization | |
| Wong | Design, Characterization and Application of a Multiple Input Stethoscope Apparatus | |
| TWI635851B (en) | Sensing device and sensing system for instantaneously organ organ audio | |
| Moussavi | Acoustic mapping and imaging of thoracic sounds |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |