CN110477944A - Method and apparatus for converting body signal - Google Patents

Method and apparatus for converting body signal Download PDF

Info

Publication number
CN110477944A
CN110477944A CN201810461855.2A CN201810461855A CN110477944A CN 110477944 A CN110477944 A CN 110477944A CN 201810461855 A CN201810461855 A CN 201810461855A CN 110477944 A CN110477944 A CN 110477944A
Authority
CN
China
Prior art keywords
data flow
signal
data
time
acoustic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810461855.2A
Other languages
Chinese (zh)
Inventor
马库斯·科尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ergo Sony Co Ltd
Original Assignee
Ergo Sony Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ergo Sony Co Ltd filed Critical Ergo Sony Co Ltd
Priority to CN201810461855.2A priority Critical patent/CN110477944A/en
Publication of CN110477944A publication Critical patent/CN110477944A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B7/00Instruments for auscultation
    • A61B7/02Stethoscopes
    • A61B7/04Electric stethoscopes
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)

Abstract

A method of for generating acoustic information according to the biological activity of human organism.First time signal intensity curve generates from the measurement of the electrical activity of the brain of organism and thus generates the first data flow.Second data flow is to generate from the measurement of the electrical activity of heart, and third data flow is generated from the measurement of breathing.Acoustic signal is generated in real time in audible frequency spectrum and is exported via acoustic transducer, wherein, at least one parameter of acoustic signal is determined according to the Current data values from the first data flow in time, a parameter is determined according to the Current data values from the second data flow in time, and determines a parameter according to the Current data values from third data flow in time.Parameter determination is derived from data value according to computation rule or the distribution stored, wherein computation rule or what is stored be distributed into difference, so that the variation of each data flow in data flow causes the associated audible change in acoustic signal.

Description

Method and apparatus for converting body signal
Technical field
The present invention relates to the method and apparatus for generating acoustic information according to the biological activity of human organism.
Background technique
Many organic process occur simultaneously in human body, the observation to the conscious understanding of this process for a people It is difficult for person and is itself difficult generally for a people.Therefore, in medical technology, there are many inspections Measurement equipment and detection scheme make it possible to observe or can assess the bio signal to convert the bio signal of the mankind.
For example, EEG (electroencephalogram) system becomes known for the electrical activity of testing and evaluation human brain.For human heart Electrical activity, it is known that ECG (electrocardiogram) system or optical monitoring system, and temperature sensor (air-flow/nasal cavity/mouth can be passed through Chamber flow sensor thermistor) or breathing zone (chest strap and abdominal belt) monitor the breathing of the mankind and patient.In addition, using For measuring the EDA system (the EDA sensor in hand inner surface) of skin resistance, or use for equally passing through pulse blood oxygen The sensor that instrument measures the oxygen saturation in blood (has the infrared diode and infrared crystals pipe for detecting light transmittance Finger clamp).
For examined subject itself and untrained observer, these signals and assessment are not usually intuitive Ground is detectable, and cannot be explained in the case where no basic medical knowledge.Even for well-trained monitoring people The assessment of member, data and signal is also often cumbersome.Observation to this information variable in time, especially to existing The observation of the information of multiple while monitored organic process in monitoring, needs sufficient attention, and still often not Entire information depth can be detected.
Body signal is converted into graphical representation or acoustic signal from the prior art is known for various purposes.For example, literary It offers KR 20040070145 (A) and describes the method that brain wave is shown as sound or image.
Feel that imperceptible body processes are converted into earcon also from the prior art various other with the mankind In file it is known that for example in The Sonification Handbook, by Thomas Hermann, Andy Hunt, John G.Neuhoff;Logos Publishing House, Berlin 2011,586pages, 1st edition (11/2011), ISBN978-3-8325-2819-5;Baier, G., Hermann T. , &Stephani U. (2007).
The EEG rhythm and pace of moving things based on event is ultrasonically treated (Event-based sonification of EEG rhythms in real time in real time).Clinical neurophysiology (Clinical Neurophysiology) 1377-1386;Wallis, I., Ingalls, T., Rikakis, T., Olsen, L., Chen, Y., Xu, W. , &Sundaram, H. (2007).
Ultrasonic motion (the Real-time sonification of movement of real-time immersive stroke rehabilitation environment for an immersive stroke rehabilitation environment).International sense of hearing display conference collection of thesis (Proceedings of the International Conference on Auditory Display), 497-503. The one aspect for the process in system inevitable choice human organism known and prepare this respect.Here, only detecting and conveying A part of the current state of subject.
Summary of the invention
The object of the present invention is to provide a kind of method and a kind of device, the method and device are as far as possible comprehensively in the mankind Treatment process and the process is converted into simple appreciable performance in organism.
The purpose through the invention for generate acoustic information method and device used to perform the method To realize.
According to according to the method for the present invention, the biological activity of human organism is converted into acoustic information.The present invention passes through Wherein all measurement parameters illustrate various process in human organism with a kind of representation combined representation Interaction.
Here, science background is cardiac function, respiratory function and with the cognition in frequency spectrum and movable brain activity The rhythm and pace of moving things system of the rhythm and pace of moving things.It establishes using breathing and the circulatory system as the considerations of the tract to work with having the rhythm and pace of moving things.Everyone Experience heart pulse rate and breathing are used as rhythmic process straight and directly.However, these rhythm and pace of moving things are entirely physiological to the mankind Importance obtains sufficient full appreciation not yet.Since the interaction of rhythm and pace of moving things process can be observed, establish to it is organic when Between the understanding organized.For example, the relationship between the heart pulse rate and breathing of midnight deep sleep stages tends to the ratio of integers of 1:4 Example.The rhythm and pace of moving things is proportional.Between the variation of the rhythm and pace of moving things of breathing and blood pressure or the sanguimotor cyclically-varying of peripheral organs It determines and arrives similar integer ratio.Entire organism is characterized in that the time course of the coordination of multiplicity.Organism this when Between coordinate to mean the correlation in time and orthofunction of the life process of rule progress.Therefore, rhythm and pace of moving things Time effects have apparent influence to entire rhythm and pace of moving things organism.Health is necessarily associated with the complete rhythm and pace of moving things order of vital functions Sequence.The disorder of order in this disease is confirmed extensively.
Heart pulse rate be in in the synchronous coordination of a large amount of rhythm and pace of moving things of organism, such as along with blood pressure wave or organ blood The rhythm and pace of moving things of circulation.On the other hand, heart pulse rate directly depends on breathing.Different from heart pulse rate, breathing can be with the rhythm and pace of moving things and depth It spends and arbitrarily changes.Meanwhile breathing is unconscious or semiconsciousness psychological condition is (for example, deep sigh, the expiration led off, tight In breathing stop etc.) most directly performance.This reacts on the physiology of the circulation again in turn.
According to the present invention, at least one first time signal intensity curve is the electrical activity from the brain of human organism It is generated in measurement.The first data flow is generated from the first time signal intensity curve.Data flow can for example be turned by AD It changes and is generated from signal intensity curve and the digitized signal information converted in real time is provided.Real time data is corresponding processed and shows Show.These real time datas can be recorded to carry out Scientific evaluation.
The detection of the electrical activity of brain can be by traditional devices, particularly the tradition with corresponding signal output end EEG is carried out, and signal output end detects the various activities of human brain on multiple channels, this can be used for example 6,12 or 48, the EEG in 56 channels, the signal resolution with 16 or 24 bits, the recording rate for each channel can be mono- from 4/s Solely it is adjusted to 512/s;Optional 4096/s.
According to the present invention, meanwhile, the second time signal change curve is the survey from the electrical activity of the heart of human organism It is generated in amount.Wherein the second data flow is generated from the second time signal change curve.Second data flow also real-time detection Process in organism, wherein also can use traditional devices (the especially EEG system of the electrical activity for recording human heart Or cardiovascular band) Lai Jinhang change in detection signal curve detection.For this method, it is to appoint that the data of heartbeat, which generate type, Meaning, such as can use 3 channel ECG sensors or utilize the finger clamp of the pulse blood oxygen instrument for detecting heart rate to detect Heart rate).
In addition, generating third time signal change curve simultaneously from the measurement that human organism breathes.The third letter Number change curve is converted into third data flow.
Therefore, according to the present invention, realize while the mankind for detecting the electrical activity of brain, the electrical activity of heart and subordinate are organic The breathing of body, wherein all measurements are all to carry out at the same person and parallel.Be converted to data flow and further Processing is real-time perfoming.In the frame of the application, term " processing in real time " is understood to that signal is converted and is further processed Delay until the output of acoustical sound information be with carried out in time for running simultaneously of reality.Therefore, it is not uniting The processing is carried out in the case where targeted delay or elongation and compression in one time scale.In addition, term is " real When " be understood to, Data Detection and data processing and output between delay answer it is as small as possible, so the reaction time is very short. Correspondingly highest has carried out several seconds between the detection of information and the output of acoustic information described in answering within the framework of the invention Duration, preferably less than one second duration.Some EEG phenomenons can only be identified in the time delay of very little.Measurement Equipment regularly detects these values in several milliseconds, within the scope of the acoustics conversion carried out by sound wave is similarly positioned in millisecond.
According to the present invention, therefore at least there are three data flows, from the electrical activity of brain, the electrical activity of heart and also from Three data flows are exported in breathing.In the context of the present invention, entirely possible, for every in these organic activities One organic activity each of can all generate multiple signal intensity curves and data flow, but be necessary for these body movements Body movement generates at least one data flow.
From generate acoustic signal in these data flows in real time in audible frequency spectrum and via acoustic transducer it is defeated The acoustic signal out, in this case, it is audible all that the signal in audible frequency spectrum is interpreted as the mankind Signal, that is to say, that signal in the range of from several hertz to about 20kHz, wherein in practice, usually in 50Hz and Frequency range between 10kHz is sufficient.
The detection of term acoustic transducer generates all devices of audible sound, thus especially loudspeaker from electronic signal And earphone.
From all detected data flows, continuous, unified appreciable acoustic signal is generated according to the present invention, this It can be monitored people itself by acoustic transducer and be that third party hears.In order to perceive body movement can, according to The present invention, at least one parameter of acoustic signal change in time and herein according to the current datas from the first data flow Value determines.In addition, determining the parameter of acoustic signal in time according to the Current data values from the second data flow, and root Determine the parameter of acoustic signal in time according to the Current data values from third data flow.
Parameter determination is derived from Current data values according to computation rule and/or the distribution stored.According to this hair Bright, computation rule to data flow and/or what is stored be distributed into difference, the change of each data flow causes acoustic signal The audible change distributed, and the influence of especially different data streams will not cancel out each other.
According to the present invention, a parameter or multiple ginsengs are influenced in different ways by three data flows detected simultaneously Number.Therefore acoustic signal is provided to audience, in the acoustic signal, audience can obtain by the time change of acoustic signal Conclusion about brain-cardiac function and respiratory function out, and to obtain the conclusion of the state of monitored subject.Uniformly it is in Existing signal makes audience be easy to the invisible process in the organism for intuitively grasping and perceiving subject.Herein it is noted that It is that in terms of the temporal resolution of the mankind and intuition processing, the Auditory Perception of the mankind is different exploitations from visual perception.With view Feel is compared, and the sense of hearing can relatively well distinguish two short sequence signals because it does not needed compared with eyes decompose and again Assembling chemical substance.The mankind can will be up to 20 signals each second and be perceived as the independent phenomenon being separated from each other.In such case Under the sense of hearing be better than visual performance because visually, such as the rhythm and pace of moving things with upper frequency can be assessed less preferably.
According to the present invention, change and modulate the acoustics conversion that can be used for individual traffic.Only for example, it refers to herein One possible conversion, so that the circulation of the ECG data from heartbeat changes the parameter of the rhythm and pace of moving things, the EEG data from brain activity into Circulation changes the parameter of melody into, and the data flow from breathing has determined the parameter of overtone.Audiovideo has been generally formed, In, value interaction and it is interrelated, so as to the interpretation and interaction of clear human organ's function.
Due to changing continuous unique acoustic signal in different parameters, so signal than individually adds for audience Add or to be superimposed separate acoustic signal much easier.
Detection simultaneously and the signal for converting and exporting simultaneously three major functions from the organism simultaneously The Information expansion physical condition of monitored subject and the acoustics sentience of the state of mind and allow than previous system Preferably perceive its situation and its body movement.Physical condition and the state of mind, biorgan's function and emotion and psychological table Sign can be perceived and be clearly shown by acoustics.The method by human organ's function bring into measured personnel and In the acoustic perceptual for measuring user.
All three autonomic functions of brain activity, heartbeat and breathing are incorporated to simultaneously in unique sound processing, unique sound It is still that can discretely be perceived in its meaning each other although processing allows them that can be perceived simultaneously.
It is particularly useful for that subject is made to gain more insight into simultaneously more preferable geography with relevant apparatus according to the method for the present invention Solve themselves physical condition and possible morbid state (for example, for epileptic or paralytic).The application can For use as body function or the measuring instrument of mental functioning, such as monitoring apparatus in intensive care unit or as diagnosis Instrument.In treatment use, described device is used for feedback method.Individual biofeedback therapy, for example, in wound and compassion The neural feedback therapy that self efficacy is realized in the diseases such as wound or obesity, for reflecting in sad people and changing people's Physiological structure (the limited processing of pressure cvd and nerve), for rehabilitation after apoplexy or for multiple sclerosis (MS) Treatment training.One important application is that have the nerve in multi-mode pain therapy for the correlation technique of pain patients anti- Feedback, thus they can check their cardiovascular functions and nervous function inherent state their thought and impression or he Mental representation, and learn which state can reduce or even forget the pain in pain grade.
Neural feedback also can be used in the attention relative to oneself itself with ambient enviroment, generally training supported to pay attention to In power and the environment of perception training and training of shifting one's love, reflects " top performance " in due course, reflect human organ system Change inherent attitude, the active of optimization loosens, and improves self-value and mood ability, and optimization is absorbed in that (open is special Note), preferably receive and processing failure is to increase power.
In addition, doctor or nursing staff can be benefited from such system, because the system may be used as example moving The tool of feelings training.It can be shown in two or more personal interactions by this method for doctor or nursing staff, Opposite other side and its body function and mental functioning have mutual effect.By using two surveys to two personnel in interaction Instrument is measured, can show has influence to opposite side in the presence of on the effect of opposite side and heart attitude and sensible form.This application Have a significant impact to the processing of doctor-patient relationship.For example, patient can also be made to understand the perception that the mankind intuitively trust by sound Reaction of the his or her body to different stimulated or different living conditions (such as in anxiety).According to the present invention, organic activity Synthetic image be created and convert, and be prepared in such a way that the unified sense organ by people is easy-to-handle.This application is not It can only use, teacher in the teaching of teacher and student, interpersonal relationships or can also be expanded for medical treatment, treatment personnel Exhibition is extended consultant client of closely related (interaction) same as another person.
As described above, the present invention is related to legacy system (such as EEG, ECG) and for examining in the data that detection is previously mentioned Survey the system (such as breathing zone) of breathing.By these system detections to input signal be converted into digital signal and carry out standard It is standby.Before conversion or later, it can be realized herein when detecting multiple channels and remove DC voltage component, bandpass filtering or logical Road selection.In addition, multiple channels may be mixed together and carry out average or be discretely further processed.When necessary, Detection device is already provided with the independent A/D conversion of data, so as to omit the switch process of postposition.Detected data Stream is converted into processing data or metadata for sound generation or sound modification according to computation rule.
Therefore it is divided into the part of signal acquisition, signal processing and signal output according to the method for the present invention.According to this hair It is bright, point that the data derived from acquired signal flow to the parameter change of audio signal is executed during signal processing Match.Before output, all sound determine that the connection of parameter carries out again, so that being in such a way that unification is appreciable in output Existing acoustic signal.
According to the present invention, in the general type of the invention, determine that the assessment of different data streams is substantially according to parameter Identical parameter can be influenced, but have in different ways influences there.But in the preferred embodiment of the present invention In, different data flows respectively influences the other parameters of acoustic signal.
By means of the influence of the various parameters of acoustic signal, can the audience for signal carry out in a simple manner intuitively Distribution.For example, a data flow in data flow will affect sound, another data flow will affect the level or sound of acoustic signal Amount, and another data flow will affect the frequency location of voice signal.
Preferably, at least one parameter in the parameter of acoustic signal is from the frequency for including sound level, acoustic signal With select in the group of frequency spectrum.
For example, the sound level of generated acoustic signal can change according to breathing, such as increase with air-breathing And reduce with expiration.In addition, the frequency of such as acoustic signal can as another data flow (such as derived from EEG number According to stream) change.For this purpose, for example, the voltage signal detected from brain activity can be converted into the range of audibility.Acoustics letter Number frequency spectrum and associated tone color can also for example be changed according to heart rate according to a data flow in data flow so that sound It learns signal and obtains the tone color that can change and pulse with heart rate.
Distribution in this way, whole events is simultaneously but to be to continue with and separably detect, because listening numerous generals institute The body function of subordinate is intuitively distributed in the variation of the rhythm and pace of moving things of perception and the parameter for being assigned to these rhythm and pace of moving things.
According to the present invention, how substantially arbitrary from data flow generation signal.Correspondingly therefore for example pass through in the future Changed in audible frequency range from the stream compression of the measurement of brain activity and calculate signal, the tone color of the signal or frequency spectrum with And loudness or sound pressure level are influenced by other data flows.The present apparatus provides the parameter and its signal for indicating organ dysfunction Modularization sound a possibility that.
However, in a preferred embodiment of the invention, by make Basic of Acoustics signal undergo at least one acoustic filtering come Acoustic signal is generated, wherein the parameter of at least one acoustic filtering is according at least one data flow in the data flow Current value and change.
Therefore, in the described embodiment, filter parameter, filter ginseng are selected according to a data flow in data flow Number changes existing basis signal according to the current value of data flow.Multiple filters, the multiple filter may also be undergone It is influenced in one or more parameters by one or more data flows respectively.
Basic of Acoustics signal by filtering before, acoustic signal herein can according to one or more data flows create or Person therefrom exports.
In the preferable configuration scheme of aforementioned embodiments, acoustic filtering includes at least one resonance filter or formant Filter.Resonance filter is commonly used in promoting parameterized frequency or decaying in particular level.It can be changed according to data flow Therefore the resonance filter of change can be for example arranged, the bandwidth or its gain of selected resonance frequency, institute's subordinate of filter Changed according to the current value of data flow.
Formant filter emphasizes multiple frequencies, especially from the frequency of the sound spectrum of human speech.It is filtered according to formant The parameter of wave device, the frequency amplified and inhibited can change.In order to configure such filter, it is able to use formant table Lattice, formant table be usually can be used and for various mankind's sounding, the especially vowel articulation of voice, there is institute The group of the formant frequency of subordinate.Table selection and filter parameterization can be completed according to one or more data flows.
Preferably, the level of acoustic signal according to the current data from the second data flow or third data flow in time Variation.Second data stream packets are containing the information about the signal derived from the cardiomotility of human organism.Third data stream packets contain The information of time signal change curve about the respiration measurement from human organism.The time change of signal level, such as Level change in heart rate or the rhythm and pace of moving things of respiratory rate makes it possible to intuitively and directly introduce to the audience of acoustic signal tested The related physical rhythm and pace of moving things at person.But not being indispensable herein is, the level is with frequency identical with basic body frequency Rate variation.In fact, related data can be exported from data flow certainly, and heart rate or respiratory rate are for example converted into volume Level, so that the level for being related to heart beat cycle obtained in acoustic signal when heart rate accelerates increases.With the overall electricity of signal Flat decline, cause heart rate reduction and subject it is steady.Frequency determine in the several seconds, can on such as 5 to 10 seconds periods It is determined with being for example considered for level.
In yet another embodiment of the present invention, use the basis signal that is synthetically generated as basic signal.Synthesis produces Raw sound is usually the sound for passing through the electronic equipment for generating sound and generating.Thus it refers specifically to produce using synthesizer Raw sound (granular synthesis).Here, actually generating Basic of Acoustics signal using synthesizer can not only also can according to data flow It is totally independent of data flow enough to carry out.For example, can produce base sound sequence or noise, only by carrying out according to data flow Filtering the feature of the organ dysfunction according to human body is applied to the sound sequence or noise.Alternatively, such as pass through The data of brain activity are converted into audible frequency spectrum and use noise signal as the synthesis basis signal generated, according to data The current data of at least one data flow in stream also can synthetically generate basis signal.Equally, sound can be used for signal Acoustics indicate, these signals be from the music recording of sound being played, being recorded or institute's editing develop sound rendering. Music block can be played and convert and use in systems.
In an alternate embodiment of the present invention, basis signal is generated from the sound event sequence stored, Especially generated from the sound sequence or melody stored.
Based on this alternate embodiment is using the voice data for preparing and being stored, namely sampling, and it is These voice datas apply variation according to detected data flow by filtering.Alternatively, melody can also be used as note number According to presence or random generation.The property of SoundRec, which might be chosen such that, can clearly identify the feature showed.This can It can relate to the rhythm and pace of moving things, overtone also or melody.Melody in EEG can be for example from the monk chorus played or what is played small mention Qin sequence develops, or is constructed based on granular synthesis.
In having in special structural scheme of the stored sound event as basic signal for present embodiment, according to number The sound event for selecting these to be stored according to the Current data values of at least one data flow in stream.For example, for different Respiratory rate or heart rate, basis signal can exist respectively as the sound event stored, be selected according to scheduled distribution The sound event stored.For example, associated stored pitch sequences can be used for specific heart rate corridor, and with the heart The increase of rate selects alternative melody.Under any circumstance, basis signal then can all be filtered according to remainder data stream and Variation.To which the type of such as melody or other sound sequences can provide the information about brain activity or cardiomotility, and The distortion of melody or other sound sequences and tone color and volume provide the information of the body function monitored about other.It is described System is modular exploitation, and can flexibly switch to reappear the appropriate sound performance of measured situation.
It is a part of tone sequence generated of data flow between one other alternative embodiment offer use at runtime Column or melody, and change according to detected data flow the property of the pitch sequences.Pitch sequences can be by with The melody that machine tone generates, the melody are played by synthesizer or play recorded sound thing again in the melody there Part.Other than the described filtering possibility for changing sound, the parameter of pitch sequences may is that tone size, sound Adjust length, range, the selection of scale, the rhythm and pace of moving things, rhythm, rhythm and pace of moving things variation.Melody caused by this way is as other structural schemes So that all input traffics can be identified and can be distinguished.
Other than foregoing invention method and embodiment, the device for executing every kind of method is also disclosed.For this purpose, root There are at least three interfaces according to the device of the invention, to record the measurement from brain activity, cardiomotility and respiratory activity Time signal change curve.These interfaces can be constructed such that the interface for providing these initial data as defeated The initial data of the common Medical Instruments of signal is compatible out.Importantly, the data real-time mirror image of measuring instrument is into system, and It is not first as archive data, it means that initial data is provided directly as output signal.The apparatus according to the invention With at least one Changer Device, the Changer Device coupled with interface and by time signal change curve be converted to Few three data flows.Control and assessment equipment are coupled to Changer Device, for receiving and handling digitized data flow.Place Reason may include filtering, conversion, combination or other calculation processings.Control and assessment equipment especially can be by with relevant treatments The computer of software is constituted.
Sound generating apparatus is coupled to control and assessment equipment, and the sound generating apparatus is again by control and assessment equipment control System.Sound generating apparatus may include synthesizer and multiple filters, the multiple filter by control and assessment equipment according to Current value in data flow is parameterized.Sound generating apparatus has the interface for connecting at least one acoustic transducer. Correspondingly, sound generating apparatus is for example equipped with Earphone joint or speaker connector.
In the present invention, it is possible to, the derived institute in addition to the electrical activity of electrical activity, heart from brain and from breathing Other body data can be converted into data flow and be additionally used for the modification of acoustic signal by the data flow mentioned.Example Such as, the measurement of skin resistance can be used to generate another data flow for influencing the sound of acoustic signal and generating.
It can be particularly used for corresponding device according to the method for the present invention with more or less (continuous warps of shifting one's love Go through) interaction in measure the correlation of two personnel and the personnel, or by can also observe two in sound The close unification to show measured value of the organ dysfunction of measured personnel.The sound together forms new sound and closes At.
In addition multiple subjects be can use and be performed simultaneously multiple methods.Subject can for example hear from another herein The generated acoustic signal of the body movement of a subject.It has shown that, is may be implemented in this way in multiple personnel Between physical condition certain coordinate and consistency.(referring also to " Brains Swinging in Concert:Cortical Phase Synchronization While Playing Guitar ", Ulman Lindenberger, Shu-Chen Li, Walter Gruber and Viktor M ü ller BMC Neuroscience 10:22, on March 17th, 2009)
Other than foregoing invention, the supplementary data of human organism can detecte, to detect and show plant simultaneously The interaction of cardiovascular function and cognitive ability.This is full for example including oxygen is measured by the finger clamp for pulse blood oxygen instrument With degree, periphery finger sphygmogram and pulse wave velocity.As assay value, heart rate variability can be additionally as data adfluxion At into system.
Acoustic method according to the present invention can be supplemented by the way that combination parameter is converted to visual representation.By by color Measured value/parameter is distributed to generate image, rather than acoustics is converted into sense of hearing wave.The big of measured value is shown with color intensity It is small.Therefore, other than the audiovideo of acoustics, the visual pattern of process is also produced in human body human organism.
Visual representation is used as the supplement of sense of hearing presentation, to show to explain.However, making the mutual of parameter by acoustics conversion Effect is apparent from, and color image concurrently shows and does well.
Detailed description of the invention
The present invention is more specifically illustrated by means of attached drawing at this time.
Fig. 1 schematically shows the device according to first embodiment for application according to the method for the present invention;
Fig. 2 shows the block diagrams of the processing equipment in Fig. 1;
Fig. 3 schematically shows the use according to the method for the present invention in the interaction of two people.
Specific embodiment
Fig. 1 shows the subject 1 coupled with multiple detection devices.Subject 1 carries the chest of the breathing of detection subject 1 Band 2.ECG3 is also coupled to subject.In order to record brain activity, EEG 4 is coupled to subject 1 via multiple signal collectors Head.Associated equipment is that equipment, the equipment are not shown in the schematic diagram according to prior art, because described The structural scheme of equipment is not crucial for the present invention.It is crucial that the equipment, which is coupled to, to be had for detection device Interface 5a, 5b, 5c processing equipment 5.Processing equipment may include computer system.
The conversion for the signal being detected as analog signal can occur in detection device itself, i.e., in EEG, ECG In chest strap, will pass through interface 5a, 5b, 5c transmission digital signal.It is alternatively possible to which the interface in processing equipment 5 carries out Analog-to-digital conversion.It is coupled by the acoustic transducer 6 of form of loudspeaker with processing equipment 5, the loudspeaker is for example connected to processing The sound card of the computer system of equipment 5.Therefore, the image of Fig. 1 shows the primary clustering of the system according to the present invention, wherein showing Show, the detection of the information that is multiple complicated and can quickly changing for subject 1 is converted into through acoustic transducer 6 The audible acoustic signal of the unification of output.The acoustic signal derived data flow by data detected by whole and therefrom Influence.It is readily apparent that acoustic signal can be intuitively detected after output generation, and to the body function of subject 1 The analytical home position observation of detected value is nearly impossible.
Fig. 2 shows the block diagrams of processing equipment of the invention.In this example, processing equipment is constructed such that the place Reason equipment is worked with the filtering to the signal being synthetically generated.Shown on the left of attached drawing signal input part 10a, 10b, 10c, 10b, the signal input part indicate the interface for inputting EEG signal in this illustration.Interface 10a, 10b, 10c, 10d can actually be configured to unified interface.The signal intensity curve of these interfaces EEG and by these signal intensities Curve transform is at digit data stream, and then numerical data is streamed to central processing unit 13 by interface.
Other interface 11a, 11b, 11c receives the signal intensity curve from ECG and also by these signal intensities song Line is converted into digit data stream, these digit data streams continue to be forwarded to central processing unit 13.
The signal of breathing zone is converted via interface 12a and is fed to central processing unit 13.
Central processing unit 13 can be formed by corresponding configuration and the computer system of programming.In central processing unit 13 In, correspondingly, the data quilt about the brain activity of the subject, cardiomotility and breathing detected at subject Continuous input simultaneously.Be coupled to central processing unit 13 is resonance filter 14 and formant filter 15 and level control Device 16.In this example, sound generation unit is set by synthesizer 17.Synthesizer 17 is generated about its parameter by central processing The signal that unit 13 influences.In the combiner, such as the combination of noise signal and waveform can be used for voice signal generation, noise The parameter (such as frequency and amplitude) of signal and waveform changes according to input traffic.It may be thus possible, for example, to according to institute respectively The body function of measurement generates the selection of tone size, waveform.
The signal generated by synthesizer 17 is by resonance filter 14, and the parameter of resonance filter is as described above according to data It flows and is affected.In this example, resonance filter is parameterized about brain activity according only to data flow.
Then signal passes through formant filter, in the described embodiment, according to detected data flow, from subject The filter frequencies of formant filter are exported in monitored breathing.
Finally, the electrical level match portion 16 that signal is steered and according to detected cardiac data.Therefore the electricity It is flat to be changed according to corresponding cardiac rhythm, or can also be by means of other cardiac datas (such as across the period Heart rate on duration) change.
Then obtained signal is handled in adjuster 18 signal is presented, and then as signal, particularly stood Body acoustical signal is exported.This for example by sound card common on the market and by means of connected earphone or can pass through figure Loudspeaker 6 shown in 1 carries out.
Therefore, various bio signals (EEG, EKH, breathing) are all presented on exported sound or sound on time and frequency spectrum In frequency signal, so that various bio signals acoustically separate very well, and therefore can individually it be perceived.This signal Audience can draw a conclusion after brief introduction or intuitively from the sound component on the associated biomolecule signal of body, because Can intuitively to identify the signal according to the rhythm and pace of moving things of signal.
Signal from multiple subjects can be prepared as to unified signal.In this case it is possible, for example, to be every Select other tone sizes, other sound also or other in the preparation that a personnel are carried out in stereo signal by adjuster 18 Spatial position.
Another embodiment of the invention is shown in Fig. 3.Herein, technically implement two personnel 30,31 Between interaction aspect.During personnel's interaction, the apparatus according to the invention 35 is used for two personnel 30,31.
Signal receiver 40 is utilized by each personnel 30,31 once again;41 monitoring brain activities.Utilize signal receiver 42; 43 receive heart signal, and carry out monitoring of respiration using corresponding chest strap 44,45.
In the described embodiment, according to Current data values, sound event is shown simultaneously by two personnel.Modular system permits Perhaps all input traffics are distributed into described parameter, therefore all data being detected and the data of single personnel It is all recognizable and differentiable.
In addition, the good of all sound events may be implemented and work in coordination from the viewpoint of sound aesthetics.These moulds Block allows audio signal, i.e. sample, such as the base drum of heart, phase of the base drum in second device and with this matched side drum It is defined or is formed in interaction.In short, the two sound implement sounding together each other, and express in two devices into One step acts on the identical parameters of other data flows.It can certainly be a sequence of notes, and the sequence of notes is root It is generated according to stochastic parameter.The ultrasonication of two sound mappings carried out simultaneously needs to select to be suitble to mood and tone size Two sequence of notes appropriate.The content implemented in the monologue of a people develops into this part of the method The dialogue of two systems.According to according to the method for the present invention, the biological activity of two human biological objects is converted into acoustic information. For this purpose, from the breathing of the electrical activity, the electrical activity and each human organism of cardiomotility (ECG) of two brains (EEG) At least one first time signal intensity curve is generated in measurement.In this other embodiments of the invention, signal Interpretation can be realized by two subjects itself being checked and unbred observer.
Voice signal passes through earphone 50;51 outputs are to personnel 30,31.In this case, the apparatus according to the invention 35 The signal of two personnel can be exported jointly, so that two personnel 30,31 receive identical acoustic information.But it can also be to Each personnel convey the acoustic information converted from themselves body signal.
Finally, equally the body signal from corresponding other personnel can be presented for each of personnel 30,31 personnel In acoustic information.This for treat or shift one's love train it is particularly useful.

Claims (12)

1. a kind of method for generating acoustic information according to the biological activity of human organism,
Wherein at least one first time signal intensity curve is generated from the measurement of the electrical activity of the brain of human organism , wherein the first data flow is generated from the first time signal intensity curve,
Wherein at least one the second time signal change curve is from the measurement of the electrical activity of the heart of the human organism It generates, wherein the second data flow is generated from the second time signal change curve,
Wherein at least one third time signal change curve is generated from the measurement of the breathing of the human organism, In from the third time signal change curve generate third data flow,
Acoustic signal is wherein generated in real time in audible frequency spectrum and is exported via acoustic transducer,
At least the one of the acoustic signal is wherein determined according to the Current data values from first data flow in time A parameter,
At least the one of the acoustic signal is wherein determined according to the Current data values from second data flow in time A parameter,
At least the one of the acoustic signal is wherein determined according to the Current data values from the third data flow in time A parameter,
Wherein the parameter determination be according to computation rule and/or the distribution stored derived from the data value,
The wherein computation rule to the data flow and/or what is stored be distributed into difference, so that every in the data flow The variation of a data flow causes the associated audible change in the acoustic signal.
2. according to the method described in claim 1, wherein each data flow in the data flow influences the acoustic signal Different parameters.
3. according to the method described in claim 1, wherein, from middle choosing of forming a team as composed by the sound level, frequency, frequency spectrum Select at least one parameter in the parameter of the acoustic signal.
4. according to the method described in claim 1, and wherein undergoing at least one acoustic filtering by making Basic of Acoustics signal The acoustic signal is generated, wherein the parameter of at least one acoustic filtering is according at least one data in the data flow The current value of stream and change.
5. according to the method described in claim 4, wherein the acoustic filtering includes resonance filter or formant filter, and And at least one parameter of the resonance filter or formant filter is according to a data flow in the data flow Current data change in time.
6. method according to any one of claim 3 to 5, wherein the level of the acoustic signal is according to from the second number Current data according to stream or third data flow changes in time.
7. according to the method described in claim 4, wherein the acoustic signal is the basis signal being synthetically produced.
8. according to the method described in claim 7, wherein synthetically generating institute according to the current data of at least one data flow State basis signal.
9. according to the method described in claim 4, wherein the basis signal is generated from the sound event sequence stored , especially generated from the sound sequence or melody stored.
10. according to the method described in claim 9, wherein according to the current data of at least one data flow in the data flow Value selects stored sound event sequence.
11. it is a kind of for executing the device of method according to any one of claim 1 to 10,
With at least three interfaces (5a, 5b, 5c),
In the measurement for the electrical activity that wherein first interface (5a) is configured to the brain from the human organism first when Between data flow input terminal,
In the measurement for the electrical activity that wherein second interface (5b) is configured to the heart from the human organism second when Between data flow input terminal,
Wherein third interface (5c) is configured to the third time data flow in the measurement of the breathing from the human organism Input terminal,
Wherein the interface (5a, 5b, 5c) is coupled in control and assessment equipment (13),
Wherein the sound generating apparatus (17,14,15,16,18) is coupled to the control and assessment equipment,
Wherein the control and assessment equipment (13) are configured to manipulate the sound generating apparatus according to the data flow (17、14、15、16、18)
Wherein the sound generating apparatus (17,14,15,16,18) has for connecting connecing at least one acoustic transducer (6) Mouthful.
12. device according to claim 11, wherein an at least Changer Device is respectively set before the interface, The time signal change curve is converted into data flow respectively by the Changer Device.
CN201810461855.2A 2018-05-15 2018-05-15 Method and apparatus for converting body signal Pending CN110477944A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810461855.2A CN110477944A (en) 2018-05-15 2018-05-15 Method and apparatus for converting body signal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810461855.2A CN110477944A (en) 2018-05-15 2018-05-15 Method and apparatus for converting body signal

Publications (1)

Publication Number Publication Date
CN110477944A true CN110477944A (en) 2019-11-22

Family

ID=68545220

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810461855.2A Pending CN110477944A (en) 2018-05-15 2018-05-15 Method and apparatus for converting body signal

Country Status (1)

Country Link
CN (1) CN110477944A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112370071A (en) * 2020-11-06 2021-02-19 湖南万脉医疗科技有限公司 Flexible patch for monitoring breath sound

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5730140A (en) * 1995-04-28 1998-03-24 Fitch; William Tecumseh S. Sonification system using synthesized realistic body sounds modified by other medically-important variables for physiological monitoring
JP2000116612A (en) * 1998-10-16 2000-04-25 Dainippon Printing Co Ltd Biomedical signal monitoring apparatus
EP2113194A1 (en) * 2008-05-02 2009-11-04 Paracelsus Klinik Lustmühle AG Device and method for acoustic and visual representation of prepared physiological data and use of prepared data
CN102835953A (en) * 2011-05-16 2012-12-26 阿利弗克公司 Wireless, ultrasonic personal health monitoring system
US20150150520A1 (en) * 2013-12-02 2015-06-04 The Board Of Trustees Of The Leland Stanford Junior University Method of Sonifying Signals Obtained from a Living Subject
CN104768455A (en) * 2012-09-11 2015-07-08 L.I.F.E.公司 Wearable communication platform
CN106999143A (en) * 2014-12-12 2017-08-01 皇家飞利浦有限公司 acoustic monitoring system, monitoring method and monitoring computer program

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5730140A (en) * 1995-04-28 1998-03-24 Fitch; William Tecumseh S. Sonification system using synthesized realistic body sounds modified by other medically-important variables for physiological monitoring
JP2000116612A (en) * 1998-10-16 2000-04-25 Dainippon Printing Co Ltd Biomedical signal monitoring apparatus
EP2113194A1 (en) * 2008-05-02 2009-11-04 Paracelsus Klinik Lustmühle AG Device and method for acoustic and visual representation of prepared physiological data and use of prepared data
CN102835953A (en) * 2011-05-16 2012-12-26 阿利弗克公司 Wireless, ultrasonic personal health monitoring system
CN104768455A (en) * 2012-09-11 2015-07-08 L.I.F.E.公司 Wearable communication platform
US20150150520A1 (en) * 2013-12-02 2015-06-04 The Board Of Trustees Of The Leland Stanford Junior University Method of Sonifying Signals Obtained from a Living Subject
CN106999143A (en) * 2014-12-12 2017-08-01 皇家飞利浦有限公司 acoustic monitoring system, monitoring method and monitoring computer program

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112370071A (en) * 2020-11-06 2021-02-19 湖南万脉医疗科技有限公司 Flexible patch for monitoring breath sound

Similar Documents

Publication Publication Date Title
JP2571732B2 (en) A device that induces various human states of consciousness
Khalfa et al. Role of tempo entrainment in psychophysiological differentiation of happy and sad music?
US9480812B1 (en) Methodology, system, use, and benefits of neuroacoustic frequencies for assessing and improving the health and well-being of living organisms
Chuen et al. Psychophysiological responses to auditory change
EP1871219A2 (en) Methods and systems for physiological and psycho-physiological monitoring and uses thereof
Hinterberger The sensorium: a multimodal neurofeedback environment
Yu et al. Designing Auditory Display of Heart Rate Variability in Biofeedback Context.
Saperston The Effects of Consistent Tempi and Physiologically Interactive Tempi1 on Heart Rate and EMG Responses
Ramírez et al. Assessment of emotional states through physiological signals and its application in music therapy for disabled people
Ortiz et al. Biosignal-driven art: beyond biofeedback
JP2008516701A (en) Physiological monitoring method and apparatus
US20050154251A1 (en) Method and apparatus for correction of functional state of person
Ma et al. Exploring the effect of virtual reality relaxation environment on white coat hypertension in blood pressure measurement
CN110477944A (en) Method and apparatus for converting body signal
Jovanov On physiological bases of states of expanded consciousness
Yurci Emotion detection from EEG signals: correlating cerebral cortex activity with music evoked emotion
KR102223512B1 (en) Neckband type healthcare service method and system
Hinterberger Orchestral sonification of brain signals and its application to brain-computer interfaces and performing arts
Rodero Measuring People's Cognitive and Emotional Response: Psychophysiological Methods to Study Sound Design
JP4248634B2 (en) Biological signal monitoring device
Fachner et al. Ethno Therapy, Music and Trance: an EEG investigation into a sound-trance induction
Horrell Music and the Brain: Composing with the Electroencephalogram
Leslie Inner rhythms: vessels as a sustained brain-body performance practice
Oomen et al. Deviations in Sound Waves Associated with Physiological and Psychological States
KR20130061698A (en) The apparatus and method for displaying imitation neuron using sounds and images

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20191122

WD01 Invention patent application deemed withdrawn after publication