AU636287B2 - Apparatus for translating the eeg into music - Google Patents
Apparatus for translating the eeg into music Download PDFInfo
- Publication number
- AU636287B2 AU636287B2 AU23039/88A AU2303988A AU636287B2 AU 636287 B2 AU636287 B2 AU 636287B2 AU 23039/88 A AU23039/88 A AU 23039/88A AU 2303988 A AU2303988 A AU 2303988A AU 636287 B2 AU636287 B2 AU 636287B2
- Authority
- AU
- Australia
- Prior art keywords
- generating
- musical
- signal
- eeg signal
- ongoing eeg
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 210000004556 brain Anatomy 0.000 claims description 185
- 230000000694 effects Effects 0.000 claims description 141
- 230000004044 response Effects 0.000 claims description 66
- 238000000034 method Methods 0.000 claims description 61
- 239000000796 flavoring agent Substances 0.000 claims description 56
- 235000019634 flavors Nutrition 0.000 claims description 56
- 230000008859 change Effects 0.000 claims description 38
- 230000000638 stimulation Effects 0.000 claims description 28
- 230000001537 neural effect Effects 0.000 claims description 18
- 230000001965 increasing effect Effects 0.000 claims description 15
- 210000000697 sensory organ Anatomy 0.000 claims description 14
- 241000282414 Homo sapiens Species 0.000 claims description 10
- 230000001747 exhibiting effect Effects 0.000 claims description 9
- 210000000653 nervous system Anatomy 0.000 claims description 9
- 230000000306 recurrent effect Effects 0.000 claims description 9
- 230000003014 reinforcing effect Effects 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 8
- 230000001960 triggered effect Effects 0.000 claims description 8
- 230000004936 stimulating effect Effects 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 5
- 238000001914 filtration Methods 0.000 claims description 5
- 230000003466 anti-cipated effect Effects 0.000 claims description 3
- 238000012545 processing Methods 0.000 description 19
- 238000010586 diagram Methods 0.000 description 14
- 238000004458 analytical method Methods 0.000 description 13
- 230000001766 physiological effect Effects 0.000 description 13
- 210000004761 scalp Anatomy 0.000 description 13
- 230000002996 emotional effect Effects 0.000 description 12
- 238000004519 manufacturing process Methods 0.000 description 12
- 208000019901 Anxiety disease Diseases 0.000 description 10
- 230000036506 anxiety Effects 0.000 description 10
- 230000010355 oscillation Effects 0.000 description 9
- 230000000875 corresponding effect Effects 0.000 description 8
- 230000000763 evoking effect Effects 0.000 description 8
- 230000006461 physiological response Effects 0.000 description 8
- 230000003111 delayed effect Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 230000015572 biosynthetic process Effects 0.000 description 5
- 238000002474 experimental method Methods 0.000 description 5
- 238000003786 synthesis reaction Methods 0.000 description 5
- 239000003086 colorant Substances 0.000 description 4
- 230000007423 decrease Effects 0.000 description 4
- 230000037361 pathway Effects 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 230000007177 brain activity Effects 0.000 description 3
- 230000001149 cognitive effect Effects 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 3
- 230000001351 cycling effect Effects 0.000 description 3
- 230000001066 destructive effect Effects 0.000 description 3
- 230000006397 emotional response Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000010363 phase shift Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000003925 brain function Effects 0.000 description 2
- 230000001054 cortical effect Effects 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000001939 inductive effect Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000009533 lab test Methods 0.000 description 2
- 230000000926 neurological effect Effects 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- 230000035790 physiological processes and functions Effects 0.000 description 2
- 230000001737 promoting effect Effects 0.000 description 2
- 230000000979 retarding effect Effects 0.000 description 2
- 230000001225 therapeutic effect Effects 0.000 description 2
- 238000002560 therapeutic procedure Methods 0.000 description 2
- 208000023514 Barrett esophagus Diseases 0.000 description 1
- 206010019196 Head injury Diseases 0.000 description 1
- 208000016621 Hearing disease Diseases 0.000 description 1
- 241000282412 Homo Species 0.000 description 1
- 241000053208 Porcellio laevis Species 0.000 description 1
- 230000009118 appropriate response Effects 0.000 description 1
- 230000037007 arousal Effects 0.000 description 1
- 210000003926 auditory cortex Anatomy 0.000 description 1
- 230000003542 behavioural effect Effects 0.000 description 1
- 230000004071 biological effect Effects 0.000 description 1
- 210000004958 brain cell Anatomy 0.000 description 1
- 208000029028 brain injury Diseases 0.000 description 1
- 210000003710 cerebral cortex Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000009849 deactivation Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 238000002405 diagnostic procedure Methods 0.000 description 1
- 238000010252 digital analysis Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 150000002170 ethers Chemical class 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 239000010931 gold Substances 0.000 description 1
- 229910052737 gold Inorganic materials 0.000 description 1
- 230000005764 inhibitory process Effects 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000006996 mental state Effects 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 230000003387 muscular Effects 0.000 description 1
- 230000003557 neuropsychological effect Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000008430 psychophysiology Effects 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 230000001020 rhythmical effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 210000003478 temporal lobe Anatomy 0.000 description 1
- 230000008733 trauma Effects 0.000 description 1
Description
OPI DATE 23/03/90 APPLN. ID 23039 88 PcT AOJP DATE 26/04/90 PCT NUMBER PCT/US88/02725 INTERNATIONAL APPLICATION PUBLISHED UNDbK IHb FAItN I Ltuurcrtiiian tir cixtY (PCT) (51) International Patent Classification 4 A61B 5/04 (11) International Publication Number: A (43) International Publication Date: WO 90/01897 8 March 1990 (08.03.90) (21) International Application Number: PCT/US88/02725 (22) International Filing Date: 17 August 1988 (17.08.88) (71)Applicant: NEUROSONICS, INC. [US/US]; -3604 -Monterey-Road;-Baltimore-MD-242+8-(US).
(72) Inventors: KNISPEL, Joel ,-39-Ballyhlunis Court, Timoni- -am,-M-D--24O93(US). WRIGHT, C-offrey ;-3604-Mo-- -terey-Road-Apartfent-Fr-Baltimore, -D 21218 (US).
(74) Agents: KENNEY, Ernest et al.; Bacon Thomas, 625 Slaters Lane, Fourth Floor, Alexandria, VA 22314 (US).
(81) Designated States: AT (European patent), AU, BE (European patent), CH (European patent), DE (European patent), DK, FI, FR (European patent), GB (European patent), IT (European patent), JP, KR, NL (European patent), NO, SE (European patent).
Published With international search report.
-57( Roano ueni-a TYou'sQ Oc £C^c \c. 5i^ I g c ac c 63287 (54) Title: APPARATUS FOR TRANSLATING THE EEG INTO MUSIC MODE 8 EEG Z 7 6 CHANNEL DELAY
CONDITIONER
11 1 SOU N D SIGNAL SSYNrESIMil PROCESSOR (57) Abstract A method and apparatus for applying a musical feedback signal to the human brain, or any other brain, to induce contrcllable psychological and physiological responses. A signal representing the ongoing electroencephalographic (EEG) signal of a brain preferably is obtained from the electrode location on the scalp known as CZ or P3 in clinical notation. A signal proce.sor converts the ongoing EEG into electrical signals which are converted into music by synthesizers The music is acousti.
cally fed back to the brain after a time delay calculated to saift the phase of th- feedback in order to reinforce specific or desired ongoing EEG activity from the scalp position of interest. The music is comprised of at least one voice that follows the moment-by moment contour of the EEG in real time to reinforce the desired EEG activity. The music drives the brain into resorance with the music to provide a closed loop or physiological feedback effect.
WO 90/01897 PCT/US88/02725 APPARATUS FOR TRANSLATING THE EEG INTO MUSIC BACKGROUND OF THE INVENTION 1. Field of Invention.
The present invention relates to the general field of psychoacoustics which is defined, for purposes of this application, as the neuropsychological response of the brain to music. Specifically, the invention relates to a method and apparatus for translating an electroencephalographic (EEG) signal into specifically engineered music, feeding back that music to a selected area of the brain, via the ear, from which the EEG signal was generated so as to induce and control a wide variety of psychological and physiological states. The invention uses a new type of biofeedback music. The principles controlling the generation of this biofeedback are henceforth known as neuroacoustics.
2. Description of related knowledae..
(More p-ecs I( -gero toC The human brain exhibits peaiodic electrical activity, also known as brain waves, at the microvolt level in discrete frequency ranges. This brain wave astivity has traditionally been classified by frequency as fellfowt alpha waves lie in the frequency range of 8 to 13 Hz, aeta waves lie in the frequency range of 13 to 28 Hz, and tlpta waves lie in the frequency range of 4 to 8 Hz. The brain also exhibits delta waves during sleep which are characterized by a relatively high amplitude and very low frequency, WO 90/01897 PCT/US88/02725 2 typically less than one complete cycle per second. Beta waves have a relatively low amplitude and correspond to a high level of arousal or anxiety. The brain is known to produce primarily alpha waves when a person is in a state of rest and relaxation. Theta waves are often associated with pre-sleep, dream-like mentations and visual imagery.
It is also known that EEG activity, muscular activity and other physiological measures may be modified with "biofeedback". Conventional biofeedback involves converting some measurable physiological activity of an individual into a feedback signal comprising an auditory or visual stimulus. The feedback signal provides the individual with an indication of his or her physiological activity. One type of biofeedback apparatus converts alpha waves into an audible tone that has a vol:u.m or pitch corresponding to the average level of alpha wave activity.
Some individuals can alter their internal emotional state and relax by learning to alter the feedback signal.
Conventional biofeedback, however, has well known limitations. Most individuals require multiple sessions with a trained therapist to learn to adjust their brain wave activity in response to the feedback signal. Biofeedback can be tiresome and boring when the feedback signal has no interesting or pleasing qualities. Some studies have found that conventional biofeedback is so mechanistically routine that the feedback signal does not induce an effect unless a therapist is present to add emotional content and direction to the experience.
The feedback signal normally indicates only a time average of the relevant physiological activity. As such, conventional biofeedback provides an information pathway by which the brain is made consciously aware of 4he physiological activity. The feedback signal, however, has no direct effect on .ngoin'g physiological activity and therefore cannot produce a true real time cybernetic feedback loop. United States Patents 3,978,847 and 4,031,884 to Fehmi et al disclose a multiple channel phase WO 90/01897 WO 9001897PCT/1JS88/02725 -3 integrating biofeec~back computer that generates a feedback signal having a tone whose volume rises and falls with the rise and fall of the voltage in subsequent cycles of a brain wave train such as an alpha burst. The therapist or individual using the biofeedback computer may adjust a phase shift network to shift the phase of the feedback signal relative to the user's brain wave activity in accord with personal experience or personal preference. This feedback signal, however, does not appear to actively promote brain 1o wave activity, nor does the feedback tone have musical or emotional content. Hence, the exact phase relationship of the feedback signal to the brain wave activity is not specified and does not appear to be critical to the proper functioning of the biofeedback computer.
various approaches have been proposed to overcome the inadequacies of conventional biofeedback. one method for promoting relaxation is to play prerecorded complex sounds or colors which are at least n~ot annoying and perhaps even psychologically enjoyable. The prerecorded sounds or colors may or may not be controlled by some measured physiological quantity. The feedbackt however, does not communicate current, ongoing physiol~ gical activity, nor does the feedback induce or reiriforce a physiological response. Rather, the feedback signal remains only an aid 2- to learning which permits a person to learn to adjust his or her physiological activity.
Composers such as David Rosenboom and Alvin Lucier have incorporated EEG signals into musical compositions.
These efforts have produced music that is intereating fro~m an aesthetic perspective. The signals are obtained fro-m electrodes that are placed on the scalp without regard the physiological significance of the area of the brain that is producing the EEG activity. It is not surprising, therefore, that these musical composers have neither attained a real time physiological feedback loop nor advanced, a workable methodology for attaining such an end.
WO 90/01897 PCFUS88'02725 4 Thomas Mullholland and Benard Turskey have criticized conventional biofeedback because the biofeedback signal communicates exclusively learning information. They maintain that the biofeedback signal should incorporate principles of engineering and cybernetics. Specifically, the feedback signal should be multidimensional and contain information about many features of the physiological response of interest. Fvrther, the return of the feedback signal to the biological system of origin should be controlled so as to directly encourage and reinforce a desired physiological response. This criticism of conventional biofeedback is well taken. However, no known biofeedback device can induce a physiological response consistent with the procedural objectives proposed by Mullholland and Turskey.
Neurophysiologists know how to induce neural activity in the human brain using external stimuli. Sound is particularly useful stimulus because much of the cerebral cortex is sensitive to acoustical stimulation. Large scale neural activity may be induced in response to a variety of sounds. For example, the cortical electroencephalogram is particularly responsive to punctate sounds such as those produced by a drum or bell. The 'evoked potential" phenomenon uses punctate sounds to periodically stimulate the brain. The brain eventually responds to the stimulation by producing brain wave activity at the same frequency as the stimulus. The punctate sound "drives" the brain to produce brain wave activity at the frequency selected by the neurophysiologist. A flashing light is sometimes used as an alternate form of stimulation or as a supplement to the acoustical stimulation.
The physiological stiimulation associated with the evoked potential becomes unpleasant if continued for a period of time. Indeed, an evoked potential session becomes particularly unpleasant when uninteresting, regularly occurring stimuli are used to synchronously drive the EEG at a particular frequency. This unfavorable psychological response appears to result, at least in part, from the inability of the brain to control the external stimulus.
Musicians know how to give sound a form, content and direction that is both interesting and emotionally moving to a listener. Such sounds are commonly known as music. The ability of music to produce an emotional response has been known for many centuries in cultures throughout the world. Only recently, however, have psychologists and musicians begun to codify the principles that govern the emotional response to music or to exploit this knowledge with newly developed methods of precise music synthesis.
Music typically has not been used to evoke controlled responses in the brain nor has the feedback signal produced by conventional biofeedback devices been specifically organized into musical form. This is surprising since musicians know how to make sound coiivey many levels of meaning. The art has yet to appreciate the utility of music to induce particular, selectable forms of neural activity. This failure stems, at least in part, from a perceived dissimilarity in goals between the fields of music and psychophysiology. Further, the basic principles governing the unique neurological, physiological and emotional effects which music can induce when used systematically in a real time cybernetic biofeedback loop have no precedence in the art.
SUMMARY OF THE INVENTION In accordance with the present invention there is provided a biofeedoack apparatus for producing and utilizing acoustically expressed EEG derived music, including means "for receiving an ongoing EEG signal from at least one region of the brain of a biological entity having a brain iesponsive to acoustically expressed music, said at least one region of the brain responding to acoustical stimulation, said ongoing EEG signal having a voltage amplitude exhibiting quasi-periodic change; means for translating said ongoing EEG signal into EEG derived music; and means for acoustically directing said music so as to be received by the brain; characterized in that said translating means includes means for generating an acoustical indication of the quasi-periodic change in said ongoing EEG signal, and means for generating musical flavor and adding said acoustical musical flavor to said acoustical indication to operate EEG derived music; and ieans for delaying said S1 930113,p:\opc\dbw,23039,88, -6directing means for a period of time determined so that the brain response to said EEG derived music occurs with a predetermined phase relationship with respect to the ongoing EEG signal generated at said region of the brain.
The present invention also provides a method of producing acoustically expressed EEG derived music useful for biofeedback applications to biological entities having brains responsive to acoustically expressed music, including the steps of extracting an ongoing EEG signal from at least one region of the brain of a biological entity, said at least one region of the brain responding to acoustical stimulation, said ongoing EEG signal having a voltage amplitude exhibiting quasi-periodic change; and translating said ongoing EEG signal into EfG derived music, characterized by the steps of generating an acoustical indication of the quasi-periodic change in said ongoing EEG signal, generating acoustical musical flavor, and adding said musical flavor to said acoustical indication to generate EEG derived music; directing said music so as to be acoustically received by the brain; and delaying said directing for a period of time determined such that the brain response to said EEG derived music occurs with a predetermined phase relationship with respect to the ongoing EEG signal extracted from said region of the brain.
The pre-ent invention also provides an acoustically expressed musical signal derived from brain waves by a process including extracting at. ongoing EEG signal from at least one region of the brain of a biological entity, said at least one region of the brain responding to acoustical stimulation, said ongoing EEG signal exhibitinjg quasi-periodic, moment-by-moment change; wherein the process is further characterized by the steps of generating an acoustical indication of the moment-by-moment change of said ongoing 25 EEG signal; adding musical flavor to said acoustical indication to produce an EEG derived musical signal; acoustically directing said acoustical indication so as to be received by the brain; and delaying said step of directing said musical signal for a period of time determined so that the brain response te said musical signal occurs with a predetermintd phase relationship with respect to the ongoing EEG signal extracted from said region of the brain.
The present invention also provides an acoustically expressed EEG derived 930113,p:\opcrWbw,23039.88,6 6A musical signal characterized by a first musical voice generated in response to moment-by-moment changes in an ongoing EEG signal of a biological entity having a brain as the source of said EEG signal, said first musical voice remaining in the background of the perceptual field of the music; a second musical voice generated in response to a predetermined, recurrent feature of said ongoing EEG signal, said second musical voice moving from the background to the foreground of the perceptual field of the music with increasing amplitude in said ongoing EEG signal; a third musical voice generated in response to a rate of reoccurrence of said recurrent feature of the ongoing EEG signal, said third musical voice moving from the background to the midground of the perceptual field of the music with increasing amplitude in said ongoing EEG signal; and a fourth musical voice generated in response to an average level of said ongoing EEG signal, said fourth musical voice moving from the foreground to the background of the perceptual field of the music with increasing amplitude in said ongoing EEG signal, The present invention also provides a brain wave driven cybernetic interface circuit, adapted for cooperation with a nervous system, a living brain, and an acoustical sensory organ, characterized by means for selecting a predetermined form of electrical activity from the nervous system, said brain producing said electrical activity, said acoustical sensory organ adapted to respond to acoustical impulses, including means for receiving an ongoing EEG signal from a region of the brain, and means for filtering said ongoing EEG signal to select a particular type of neuroelectrical activity in the brain, said neuroelectrical activity exhibiting quasi-periodic change; means for reinforcing said neuroelectrical activity in the brain, including means for generating an acoustical indication of said quasi-periodic change, means for adding musical flavor to said acoustical indication to form a musical feedback signal, means for converting said i" musical feedback signal into acoustical impulses comprising feedback music, means for directing said feedback music so as to be received by said acoustical sensory organ, and means for delaying said directing means for a period of time determined so that the brain response to said feedback music occurs with a predetermined phase relationship with respect to the ongoing EEG signal received from said region of the brain; and means for generating a control signal in response to a predetermined musical pattern in said feedback music.
93O113,pA\opez\dbw2339.88,7 6B The present invention also provides a method of forming a cybernetic interface, characterized by the steps of selecting a predetermined form of electrical activity from a nervous system, said nervous system having a living brain to produce said electrical activity and an acoustical sensory organ to respond to acoustical impulses, including the steps of receiving an ongoing EEG signal from a region of the brain, and filtering said ongoing EEG signal to select a particular type of neuroelectrical activity in the brain, said neuroelecrical activity exhibiting quasi-periodic change; reinforcing said neuroelectrical activity in the brain including the steps of generating an acoustical indication of said quasi-periodic change, adding musical flavor to said acoustical indication to form a musical feedback signal, converting said musical feedback signal into acoustical impulses comprising feedback music, directing said feedback music to be received by said acoustical sensory organ, arnd delaying said step of directing for a period of time determined so that the brain response to said feedback music occurs with a predetermined phase relationship with respect to the ongoing EEG signal received from said region of the brain; and generating a control signal in response to a predetermined musical pattern in said feedback music.
The present invention also provides a neural stimulation apparatus, including means for noninvasively extracting an ongoing EEG signal from a predetermined region of a brain; means for converting said EEG signal into acoustically expressed music, said music having physiological information and musical flavor; and means for directing said music to an auditory sensory organ of said brain; characterized by means for delaying said directing means for a period of time determined so that said response of said region of the brain to said music occurs with a predetermined phase relationsip with respect to the ongoing EEG signal extracted from said region of the brain.
i The present invention also provides a method of stimulating neural activity, including the steps of noninvasively extracting an ongoing EEG signal from a prcdetcrmined region of a brain; converting said EEG signal into acoustically expressed music, said music having physiological information and musical flavor; directing said music to an auditory sensory organ of said brain; characterized by delaying uid directing step for a period of time determined so that the response of said region of the brain to 9M I 13,p-\cpcr\dbw,2339.88.S -6Csaid music occurs with a predetermined phase relationship with respect to the ongoing EEG signal extracted from said region of the brain.
The physiological response of the brain to the feedback music actively drives the ongoing EEG activity into resonance with the music to form a real time physiological feedback oop. The musical qualities and encoded physiological information of the feedback signal selectively reinforce biologically produced brain wave activity. The type of brain wave activity that is reinforced, together with the musical program in which it is encoded, can be used to promote emotional states without additional stimuli such as the presence of a therapist, For example, alpha activity can be enhanced so as to induce relaxation solely by musically reinforcing the alpha activity that is sensed by an electrode located on the scalp at the positions on the scalp known as CZ or P3 in the nomenclature of clinical neurology. Both locations, but particularly CZ, are preferred.
The feedback music may comprise at least one voice for recording cortical auditory activity that follows and reinforces the real time, moment-by-moment contour of the EEG. At least one or more additional musical voices provide musical flavor that conveys psychological as well as psychoacoustical content. The term musical flavor means some component of the amplitude envelope or harmonic spectrum of the feedback music that is discrete from and compliments the sound used to communicate the moment-by-moment contour of the EEG. The musical flavor enlivens the feedback and makes it enjoyable for extended periods of listening. The additional one or more voices are more derivative of the contours of the ongoing EEG signal but are still psychoacoustically correct with respect to the type of EEG activity being reinforced. The term psychoacoustically correct as applied to acoustical stimuli *64 9* 930113,p;\op\dbw,23039.88,9 WO 90/01897 PCTrUS88/02725 7 in this context means music that is formulated in accordance with the principles of psychoacoustics, music theory, musicology, and the emotional psychology of music to produce a desirea physiological response in the resonance feedback loop. Thus formulated, the feedback music provides the emotional content normally supplied by a therapist in conventional biofeedback as well as learning information that enables a person undergoing resonance feedback to learn to control his brain wave patterns. re y At its most basic level, the present invention is a biofeedback apparatus that conveys real time physiological information to the brain in a musical context. The resonance loop should comprise at least two levels of information. The first level comprises physiological information about the moment-by-moment oscillations of the ongoing EEG signal. The physiological information can be conveyed by frequency modulating a tone or chord with the ongoing EEG signal so that the pitch of the tone varies in proportion to the amplitude of the ongoing EEG signal. The fed back periodic changes in frequency make the brain aware of its ongoing brain wave activity and actively reinforce its continuance unless the ,oal is to discourage the activity by adjusting the phase relationship of the feedback signal to cause destructive interference. The second level of information is musical flavor. The musical flavor may comprise independently generated, pseudorandom timbre modulation, Preferably, however, the musical flavor is also a psychoacoustically correct sound that is derived from ongoing brain wave activity such as timbre modulation produced by modulating an overtone sweep with the ongoing EEG signal, The preferred embodiment of the present invention uses musical feedback comprising four distinct musical voices that create and sustain the physiological feedback loop. The four voices constitute a hierarchy of EEG analysis. A first musical voice io formed by frequency modulating a tone chord with the ongoing EEG signal to WO 90/01897 PCT/US88/02725 8 communicate to the brain the moment-by-moment contour of the EEG. A second musical voice extracts and reinforces specific features of the ongoing EEG activity. The second voice may comprise a punctata sound that is generated in response to a major feature o' the EEG such as a crest (local amplitude maxima) in a brain wave. The punctate sound has an effect on the brain that is analogous to a conventional evoked potential response but differs in being directly controlled by the brain so as to reinfoice only naturally occurring EEG activity. A third voice uses timbre modulation to indicate the relative frequency of occurrence of a particular feature of the ongoing EEG signal. The third voice provides more derivative physiological information by more slowly modulating the upper octaves of an independently generated tone chord signal with an overtone sweep. Each overtone sweep lasts for a period of time that is greater than the pariod of the brain wave activity in question so that the timbre modulation appears to get brighter during a burst of brain wave activity. The timbre modulation thus bears some resemblance to the naturally occurring EEG activity even while being more derivative of its moment-by -moment profile. A fourth voice conveys physiological information by slowing and retriggering a note sequence in response to the amplitude of the ongoing EEG signal exceeding predetermined levels and in phase with the timbre modulation.
The interplay of the 1irst, second, third and fourth voices establish a polyphonic music in which the four voices dynamically interact with the changing physiological state of the person generating the ongoing EEG signal. The fourth voice comprizes a sequence that cycles through a series of notes in rapid succession. The rate at which the sequencer cycles and the duration of a cycle decreases in relation to the amplitude of the ongoing EEG signal. The sequencer responds to predetermined threshold levels of the amplitude of the ongoing EEG signal. Thus, the sequencer does not begin to reduce its cycling rate until the WO 90/01897) PC'1'US88/02725 9 an7plitude of the ongoing EEG signal exceeds a first threshold level. The sequencer starts over its sequence whenever the amplitude of the ongoing EEG signal exceeds a second, higher threshold level. The third voice, the overtone sweep, sounds only in response to the ongoing EEG signal exceeding the first threshold level. The amplitude of the timbre modulation produced by the overtone sweep is related to the number of occurrences of a predetermined feature of interest in the ongoing EEG signal. The second voice, the punctate bell sound-, sounds only when the amplitude of the ongoing EEG signal exceeds the first threshold level- The pitch of the bell is proportional to the amplitude of the ongoing EEG signal. The first voice is a continuously varying frequency modulated tone chord. The four voices thus combine to give the feedback signal musical flavor in the form of a rich, constantly changing musical pattern that is psychologically enjoyable and psychoacoustically correct with respect to the physiological phenomenon being driven by the resonance loop.
The feedback signal communicates psychoacoustic information to the brain through a musical "language" based on the four musical voices forming a polyphonic hierarchy of perceptual prominence. A voice which is readily apparent to a listener is said to be in the foraground of the music. A less apparent voice which is still readily perceptible is said to be a midground voice. A voice which is not readily appare:.t in the perceptual field is said to be a background voice. In the preferred embodiment, the sequencer is a foreground voice in the absence of s:ciflcant EEG activity. However, once tbe ampli'qle of the ongoing EEG signal exceeds the first threshr>< level, the prominence of the sequencer declines into t~a idground region where it is joined by the sounds of bells and timbre modulation. The sequencer drops into the background and the bells move into the foreground as the amplitude of the ongoing EEG signa.
increases even further. The timbre modulation remains a midground voice and follows the bell sound as "ahost" sound WO 90/01897 PCT/US88/02725 10 that adds a natural harmonic content to the feedback music.
The frequency modulated tone chord remains in the background of the perceptual field as a constantly changing, ever present voice. The frequency modulation, however, is phase locked with the bell sound so that both voices reinforce ongoing EEG activity in the brain.
The perceptual hierarchy is consistent with the elements of complex musical structure advanced by Shenker, Lerdahl and Jackendoff, and ethers. The music, however, has unique psychoacoustical properties. The brain responds to the music as an acoustical stimulus that reinforces particular physiological activity in a real time feedback loop. The musical attributes of the feed back signal keep the physiological information from becoming either boring or annoying and make the feedback psychologically emotionally acceptable for eytended listing. It is to be appreciated that the four musical voices that comprise the preferred embodiment of the present invention represent a compromise between the often contradictory considerations governing the composition of music and the selection of adequate physiological stimuli that satisfy the necessary requirements for a real time feedback loop.
The character of the musical voices also may be adjusted to contain desirable psychological and musical information. For example, the notes generated by the sequencer may be tuned in a progressiely more dissonant pattern. The musical quality of the acoustical feedback is then dissonant in the absence of the desired type of EEG activity but becomes musically consonant with the production of more of the desired type of EEG activity. The person undergoing resonance feedback is thus psychologically rewarded with consonant music for producing th3 preferred type of EEG activity. The base frequency of the first voice may be varied in accordance with inaividual taste to further enhance the therapeutic effect of the resonance feedback by making the music more attractive. For example, some researchers report that individuals prefer musical tunings WO 90/01897 PCT/US88/02725 11 that approximate the frequency range of their own voice.
Also, the bell sound may be replaced by any number of other punctate sounds such as a drum or harp at the preference of the individual.
The four voices communicate a complex informational stimulus on the extent to which the person has entered into a desired brain state so that the person may learn to alter his physiological activity. The preferred embodiment conveys learning information about long term, time average physiological activity through the rate, retriggering, and perceived prominence of the note sequence. The other voices also contribute information to the learning process through their relative activity and perceptual prominence.
It is significant -4 e-t~ -pro C -invention that the learning information and psychological information need not interfere with the physiological content of the resonance feedback loop. The physiological resonance loop reinforces naturally occurring EEC activity so long as at least som of the musical voices are psychoacoustically correct and the remaining musical voices are not psychoacoustically incorrect in the sense of producing a physiological, psychological or psychoacoustical response that antagonizes the physiological resonance activity. The note sequencer is an example of a musical voice that provides only marginal direct physiological information by starting over when the ongoing EEG signal exceeds the second threshold. The note sequencer is nevertheless not inconsistent with physiological resonance since the production of each note is unrelated to the moment-by-moment activity of the ongoing EEG signal and the sequence as a whole does not interfere with the other voices. Arranging the sequence of notes in a dissonance pattern has the additional advantage of making the note sequencer a psychologically correct voice, in terms of incentive, as well as the primary conveyer of learning information.
The musical structure of the feedback signal enables a person to learn how to bring his EEG activity WO 90/01897 PCT/US88/02725 12 under volitional control. Experiments have shown that persons can learn to adjust their EEG activity in less than six minutes which is faster than commonly seen with conventional biofeedback. Indeed, it hal bden shown that individuals can modify their EEG activity to repeat musical patterns. These musical patterns are coplo melodies which are unique to each individual. Neverthflets, the patterns constitute recognizable melodies that the individual producing the music can repeat at will. The learning l0 information conveyed by the feedback signal permits people to literally produce music by cognitive control. Further, repeatable musical patterns could be used as control sign ,ls for instruments other than musical Instruments. The present invention is therefore applicable to the field of man/machine interface.
It is to be appreciated that the feedback signal of the preferred embodiment of the present invention simultaneously conveys many levels of meaning through the real time resonance feedback loop. The hierarchical approach to forming the musical flavor provides a grammar which can be used to evoke an emotional response in accord with the principles of psychology and musicology. The feedback music provides emotional content such as normally siopplied by the client-tierapist interaction during conventional biofeedback.
Laboratory experiments have demonstrated that resonance feedback according to the present invention enhances the production of alpha wave activity in comparison to silence or the same feedback music played back as not to be contingent on ongoing EEG activity. Further, increasing the intensity of resonance feedback m.sic produces more EEG activity of the desired type once the level exceeds a threshold of approximately 86 decibels, at present signal to noise ratios. The words "signal" and "noise" in this context mean sound that is or is not directly correlated with ongoing physiological activity, respectively. Increasing the volume of noncontingent WO 90/01897 WO 90/01897PCr/,US88/O02725 1.3 feedback music actually blocks production of the desired EEG activity. In addition, the time delay used in the feedback loop can maximize production of brain wave activity by precisely matzhing the frequency at which the brain of an individual i,;i most inclined to generate the desired EEG activity.
The frequency modulation, hell sound, overtone sweep and note sequence comprise the only fou~r voices that have been sho~wn in laboratory experiments t\Io promote physiological resonance while -also maintaining the desired musical form, content and direction associated with psychoacoustically correct music. These four musical voices have been chosen for the purpose of increasing alpha activity so as to induce relaxation. It is believed that other sounds can be synthesized to obtain this result as well as other physiological and psychoacoustical objectives following %he principles of neuroacoustics presented in this application.
The present invention can be practiced with music synthesizers that use analog components. it is considered preferable, however, to use digital nEG analysis and sound synthesis. Such implementation should Lave the advantages of increased reliability and preciarei idjustrent of tone, pitch and gain parameters automatically$ as well as automatic control over delay times and, EEG feature extraction. These refinements should decrease the signal to noise ratio of the feedback music and thua lower the threshold for the onset of resonance feedback. Further, the task of creating p~iychoacoustically correct sounds should be greatly simplified with digital implementation due to the ease with which sounds and EEG analyses can be designed, stored and tested with digital synthesizers.
The present invention has many applications. For example, the musical feedback is itself an enjoyable form of music. Additional voices may be added to the music, inside or outside the feedback loop, to create interesting effects. For example, a white noise signal may be added to 14produce a thunder-like dramatic effect when the amplitude of the ongoing EEG signal exceeds a preselected threshold. The invention may be used by a clinical psychologist to facilitate various therapeutic procedures such as guided imagery by enhancing or retarding particular brain states. A neurologist may use the present invention as a musically pleasing test of brain functions by introducing a controlled punctate stimulus embedded within the music, to generate evoked potential response. Yet another possible use for the invention is to create a form of interpersonal communication where music is generated ir response to the collectively produced brain activity of several individuals. Numerou other applications are considered possible.
BRIEF DESCRIPTION OF THE DRAWINGS Preferred embodiments of the present invention are hereinafter described, by way of example only, with reference to the accompanying drawings, wherein: Figure 1 is a block diagram of an embodiment of the present invention as used in conjunction with a single individual; Figure 2 is a block diagram of a simplified circuit arrangement for practicing the present invention; Figure 3 is a flowchart showing the steps of signal processing used in a simplified embodiment of the invention such as the apparatus shown in Figure 2; Figure 4 is a block diagram of a signal processing unit for the preferred embodiment of the present invention; eFigure 5 is a block diagram of the frequency modulation unit shown in Figure 4; Figure 6 is a block diagram of the bells unit shown in Figure 4; Figure 7 is a block diagram Of the overtone sweep unit shown in Figure 4; Figure 8 is a block diagram of the sequencer unit shown in Figure 4; Figure 9 is a flowchart of the signal processing according to the preferred embodiment of the present irvention such as used in the signal processing unit shown in Figures 4-8; Figure 10 illustrates the ability of the present invention to induce relaxation in human beings; 9301 13,p\apc\4bW =9,8R.14 WO 90/01897 r/S8025 PCr/US88/02725 15 Figure 11 illustrates the ability of the 'musical feedback of the present invention to induce increased alpha activity using a physiologic~al resonance feedback loop; Figure 12 illustrates the threshold at which alpha activity is induced by increasing the intensity of the acoustical feedback signal in resonance mode compared with the same type of music played so as not to be contingent on ongoing EEG activity; and Figures 13 and 14 illustrate how the amount of alpha wave activity can be maximized by adjusting the delay time used in the resonance feedback loop to coincide with the frequency of the brain wave activity that the brain is predisposed to produce.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Figure 1 is a block diagram of a simplified embodiment of the present invention. A Grass gold plated EEG cup electrode 3 is applied to the scalp of a person 1.
The differential recording may be either monopolar or bipolar. Using the nomenclature which is conventionally used in clinical n, q rtology, electrode 3 is preferably located at the CZ or P3 location for reinforcing alpha activity and producing relaxation. Other locations on the scalp might be used to induce other brain states. An electroencephalograph (EEG) channel conditioner comprising a Tektronix TM 503 amplifier and a, Krohn-HIite ~3700 filter, amplifies the EEG 10,000 to 50,000 times and filters the electrical signal from electrode 3 to produce an ongoing EEG signal, in the range of 0.5 Hz to 35 Hz, corresponding to ongoing EEG activity in the brain of the person. The ongoing EEG signal is delayed in a delay line represented by delay line 7 and discussed in detail below.
An EEG analyzts unit 8 determines the most probable time to the next wave Porm of intetest and adjusts delay line 7 accordingly. An EEG signal analysi-- processor 9 converts ongoing EEG signal into electrical signals from which sound synthesizer 10 can produce music. The theory and functioning of the sotind synthesizer is described in detail 90/01897 WO 9001897PCr/US88/02725 16 elsewhere in this application. Headphones 11 receive output signals from sound synthesizar 9 and direct an acoustical indication of the feedback %ignal to the ears of the person.
Delay line 7 shifts the phase of the periodic feedback signal so that the acoustical stimulus has a predetermined phase relationship to the ongoing EEG activity occurring in the brain of the person 1. Hence, delay could occur anywhere between sensor 3 and headphones 11 such as in a a Yamaha SPX 90 digital delay located between the sound synthesizer and the headphones. To produce an appropriate phase shift, delay line 7 must compensate for the time required for the brain to process sound, the time required to ainalyze the EEG, the time required f or the sound synthesizer to actually produce the sound, the time required for the sound to propagate through the air to the listener, and the approximate period of time to the next EEG waveform of interest. The neural conduction time from ear to auditory cortex in humans is in the range of milliseconds. Thus, for example, promoting alpha wave activitj' typically having a period of approximately 100 milliseconds requires an additional delay in delay line 7 of approximately 65 milliseconds so that the acoustical stimulation is approximately ir phase with the next alpha wave and actively reinforces the biologically produced alphia activity. Conversely, a delay of only 15 milliseconds in delay line 7 produces a total delay of 50 milliseconds so that the acoustical stimulation is shifted 90 dectrees out of phase with the production of alpha wave activity. In this last. instance, the acoustical feedback presumably destructively interferes with the p,.-oduction of alpha wave activity and thereby allows the production of other types of EEG activity associated with other brain states. Other strategies for producing destructive interference, such as reversing electrode polarity, are available.
The degree of phase shift in delay line 7 changes with the type of EG activity being measured, location of the EEG activity, and whether' and to what extent the user WO 90/01897 PCT/US88/02725 17 desires the feedback to constructively or destructively interfere with the particular form of brain wave activity.
The present invention selectively encourages or dicourages EEG activity associated with various behavioral states and states of conscioasness by varying the period of time by which the acoustical feedback is delayed.
The EEG analysis unit 8 may comprise an analog to digital converter to convert the EEG into a digital signal and an IBM PC programed to perform a cross point analysis on the digitized EEG signal. The crosspoint analysis progrant may comprise counting the time required for each wave form in the ongoing EEG signal to cross a base line and then summing the number of wave forms that occur within discrete frequency ranges. The frequency range with the r t occurrences is the preferred frequency of that suject. The delay line is adjusted with the inverse of the preferred frequency to approximzate the period of time to the next EEG waveform. Other types of analysis other than cross point analysis such as FFT may be vsed. It is thought preferable to adjust the delay line on a moment-by-moment basis so that the anticipated arrival of the next brain wave corresponds to the period of the preceding brain wave.
A speaker 13, shown in Figure 1, is connected to the output of sound synthesizer 10 by a switch 15. The speaker permits additional individuals to hear the acoustical output from the sound synthesizer. Speaker 13 may replace headphones 11 and supply feedback to person 1 if delay line 7 is adjusted to account for the longer period of time required for the sound to travel from the speaker to the person. Speaker 13 and headphones 11 should not, however, be used simultaneously unless provisions are made to prevent the acoustical output from the speaker and headphones from interfering with each other. Further, the output from sound synthesizer 10, or any other element, may be directed to additional signal processing equipment such as a recording device for subsequent editing, processing or playback.
WO 90/01897 WO 9001897PCT/1JS88/02725 18 It is to be appreciated that the present invention differs from other biofeedback or evoked potential devices by actively evoking a response with an acoustical feedbk.ck signal representing thr., brain's own ongoing EEG activity.
The acoustipal feedback actually makes the brain immediately follow its current EEG activity. Further, the physiological information encoe' d in the acoustical feedback signa~l is optimally suited to affec~t brain activity in desired ways because the response which the acoustical feedback induces in the brain is related to ongoing EEG activity produced by the brain itself. The utility of the present invention depends on giving the feedback sounds a form, content and direction sufflcient to induce the desired response in the subject. Experiments have shown useful resonance feed back cannot be obtained withovt encoding the physiological information in a type of xusic designed in accorchance with the principles of acoustics, music theory, musicology and the emotional psychology of music as explained in this application.
ABBREVIATED MODEL Figure 2 is a functional block diagram of an abbreviated model for converting the ongoing EEG signal into a musical feedback signal in accordance with the present invention. The abbreviated apparatus establishes physiological resonance with a minimum of musical processing and is particularly useful for quick setup and limited experiamentation. Delay line 7 is omitted for simplicity of the illustration. Tone generator 23 comprises three Moog 921 B voltage controlled oscillators (VCO's), 23a, 23b 23c respectively, having base frequencies of 75 Hz 115 Hz and 225 Hz, respectively. The 921 B oscillators individually produce a triangular wave output signal. A Moog 921 A oscillator controller 21 determines the frequency swings of the VCO's in the proportion of a one octave increase in frequency per volt increase in the amplitude of the ongoing EEG signal from signal conditioner 5. The sensitivity of the VCO's may be adjusted by placing a Moog WO 90/01897 /8rCr US88/0272S 19 CP3A voltage gain/attenuator at the input from the EEG signal conditioner 5. A Moog CP3A mixer 25 combines the output from the three VCO's in the proportion of 10:6:5, respectively, so that the output signal of mixer 25 can generate a chord tone.
The output signal from zixer 25 supplies an input signal to a Moog 904A high resonant voltage control low pass filter (VCLPF) 27. The value of the voltage from the ongoing EEG signal from signal conditioner 5 modulates VCLPF 27 so that it passes the higher frequencies of the VCO's from the oscillator of mixer 25 in proportion to the amplitude of the voltage signal. In other words, the VCLPF provides mixer 29 with more of the higher frequency signals in response to more intense EEG activity. A Moog CP3A mixer 29 combines the output signals from mixsr 25 and VCLPF 27 in the ratio of 1:10. The output signal from mixer 29 is converted into the acoustical feedback signal and directed to the person through headphones, not shown in Figure 2. The musical feedback thus consists primarily of the overtone sweep generated by VCLPF 27. It is to be appreciated that the moment-by-moment oscillations in the EEG are further accentuated by maintaining the phase relationship between VCO's 23 and VCLPF 27 so that the relative strength of the higher frequency tones increases as the oscillation frequencies of the VCO's increase.
A further refinement of the invention involves adding a pseudorandom, time varying signal to the VCLPF control line so as to offset the regularity of the electronically produced sound. As shown in Figure 2, a Moog CP3A audio mixer 24 combines the output of three Moog 921 B voltage controlled oscillators to generate an output signal from pseudorandom signal generator 22. The VCO's are adjusted to have different, relatively low frequencies of oscillation on the order of 1Hz. The VCLPF 27 combines the control signals from mixer 24 and EEG signal conditioner in the ratio of 1:1.
WO 90/01897 PCT/US88/02725 20 The VCLPF 27 adds musical flavor to the output pitch from the audio frequency generator 23 in the form of timbre modulation so that the musical feedback is more pleasing to listen to over time. Modulating the timbre in proportion to, and in phase wit, the ongoing EEG signal provides physiological informatio; 4. the listener and is therefore effective at inducing resonance feedback. The pseudorandom voltage signal acts on the timbre or "color" of the output sound in much the same way as vibrato on an instrument such as a violin. The pseudorandom signal adds an apparent gentle rhythmic randomness to the rapid moment-by-moment oscillations of the overtone sweep and frequency modulated chord tone so as to make the timbre modulation psychologically pleasant to the listener.
Figure 3 is a flow chart of the signal processing steps performed by the apparatus shown in Figure 2. The ongoing EEG signal, after being amplified and filtered, forms an input at step 5 that is delayed at step 7. The time delay may occur anywhere along the signal processing path and is illustrated as occarring to the input signal so as to be consistent with Figure 1. Physiological information is generated at physiological content step 31 by converting the moment-by-moment oscillations of the ongoing EEG signal into a signal that an audio speaker can con-art into a sound to which the brain of the listener is responsive. It is psychoacoustically preferable that the physiological content step comprise a frequency modulation of the pitch of a tone chord from signal generater '3 in response to thEi ongoing EEG signal because the humaan brain is more than 30 times more sensitive to changes in pitch than changes in amplitude (loudness). Part of the output from physiological content unit 31 supplies a flavor step 37 that adds a harmonic base to the music suitable for prolonged listening. Additional flavor may be supplied by'a pseudorandom signal generator 32, or the pseudorandom signal may provide the only input signal at step 37. The output from flavor step 37 and physiological content step 31 are WO 9)0/01897 W 9PCUS8/02725 21 mixed at step 39 to form an output signal at step suitable for conversion into a musical feedback signal.
It is to be appreciated that the functional attributes of the flow chart shown in Figure 3 may be implemented in a number of ways using many different apparatus, including apparatuses using the techniques of digital sound synthesis, to function in accord with the teachings of the present invention.
ENHANCED MODEL Figure 4 is a block diagram for an analog implementation of the preferred embodiment of the present invention. A signal bus 6 receives the ongoing EEG signal from EEG signal conditioner 5. Delay line 7 has been omitted for simplicity of illustration. Frequency modulation unit 410, bells unit 420, overtone sweep unit 430 and sequencer unit 440 convert the ongoing EEG signal on bus 6 into four signals that are mixed and converted into four musical voices through means well known in the art such as a Tascam M?12 mixer, not shown in Figure 4.
Frequency modulation unit 410 generates a tone chord that is modulated by the amplitude variations of the ongoing EEG signal. The FM unit comprises three phase locked vol 4 age controlled oscillators tied together to form a desired harmonic relationship with other voices. The frequency modulation unit provides physiological information in the form of moment-by-moment acoustical feedback corresponding to the amplitude contour of the ongoing EEG signal on line 6, as well as a harmonic background to the complex musical superstructure formed by the other three musical voices.
Bells unit 420 generates a second voice in the form ?i a punctate acoustical impulse such as the sound of a sl ruck bell. The ball unit accepts two control signal inputs, 420a and 420b, for controlling the amplitude and pitch, respectively, of the bell sound into which its output signal is ultimately converted. The occurrence of the bell is determined in relationship to the amplitude of the WO 90/01897PC/S8/72 PCT/US88/02725 22 voltage of the ongoing EEG signal, If the EEG signal exceeds a first threshold level, a first thresholdi detector 421, such as a Moog 912 Schmidt trigger, supplies a voltage control signal tc sample and hold unit 422 at input 422a. The sample and hold unit responds to the voltage control signal by sampling thie incoming EEG aind tuning a tone generator in bells unit 420.
The voltage control signal from first threshold detector 421 to sample and hold unit 422 is delayed in delay line 424 for a period of time that app.:,oximates the time required for the ongoing EEG signal to crest at a local maxima. The value of the delay time is an experimentaly determined parameter, calculated for each subject, that depends on the value of the threshold level as well as the the frequency and amplitude of the ongoing EEG signal. The frequency of the tone from the tone genprator is proportional to the value of the voltage at control input 422b which corresponds to the relative moment-by-moment amplitude of the ong~iing EEG signal at the time that the sample and hold unit is triggered. Thus, the pitch of the tone generator is proportional to the (approximate) amplitude of the ongoing EEG signal at the crest of a brain wave.
The output from an envelope generator 423 modulates the amplitude of the signal from the bell unit so that it assumes the amplitu~de envelope of a bell. If the EEG signal does not exceed the first threshold level, bells unit 420 does not generate an output signal and no bell sound is produced.
Overtone sweep unit 430 generates an output signal that forms a third musical voice for the musical feedback.
The overtons sweep unit comprises a plurality of tone generators. A highly resonant voltage controlled low pass filter is modulated with respect to the ongoing EEG signal as to pass more high frequency tones in response to a greater amplitude in the ongoing EEG signal. The overtone sweep is triggered only in response to the amplitude o the WO 90/01897 PCr/IJS88/02725 23 ongoing EEG signal exceeding the first threshold level as indicated by a signal from envelope generator 432. Envelope generator 432 is constructed with a slow attack so that the maximum timbre modulation occurs after the sound of the bell. The timbre modulation thus serves as' a "ghost" sound to the bells which adds psychoacoustically correct flavor to the music of the feedback signal.
Further, the envelope generator preferably does not completely shut off immediately after the ongoing EEG signal drops below the first threshold level. This hysteresis causes the amplitude of the output of the envelope generator to increase with increasing frequency of occurrence of brain waves that have an amplitude greater than the first threshold level. Thus, the overtone sweep produces a feedback signal that is more derivative of the ongoing EEG signal while still maintaining some correspondence with the physiological information contained in the EEG.
The output signal from sequencer unit 440 forms a fourth musical voice for the musical feedback. The sequencer can generate twenty-four notes in sequence. The sequeneer receives two control signals from the ongoing EEG signal. Ona control signal which controls the rate at whi the sequencer cycles through its sequence corresponds to t.
negative of the output of envelope generator 432 by passing through inverter 431. The negative of the voltage of the signal from envelope generator 432 slows the cycling rate or sequencer 440 in proportion to the incidence of the ongoing EEG signal exceeding the first threshold. A second threshold detector 441, such as a Moog 912 Schmidt trigger, derives a second control stidial directly from the ongoing EEG signal. The second threshold is preferably set at a greater voltage level than first threshold detector 421.
The second control signal resets the sequencer to the beginning of its sequence of notes. Thus, h.e sequencer slows whenever the ongoing EEG signal exceeds the first threshold and starts over whenever the ongoing EEG signal exceeds the second threshold.
WO 90/01897 PCT/US88/02725 24 Figure 5 is a more detailed functional block diagram of the frequency modulation uniit 410 shown in Figure 4. A Moog CP3A gai control unit 51 controls the amplitude of the ongoing EEG signal from line 6 that is supplied to a Moog 921A oscillation controller 53. The oscillator control 53 produces an output signal that controls the oscillation frequency of three Moog 921B voltage controlled oscillators, 55a, 55b and respectively, having base frequencies of 75 Hz, 158 Hz and 225Hz, respectively. Thp output from the frequency oscillators comprise rich harmo'nic structures such as triangular wave forms. A Moog '3A audio mixer 57 combines the output signals from the VCO's in the ratio of 10:6:5, respectively, as indicated by settings on the Moog mixer.
Figure 6 whows a more detailed functional block diagram of the bells unit 420 and sample and hold unit 422 and envelope generator 423 shown in Figure 4. A Moog 902 voltage controlled amplifier 621 directs the ongoing EEG signal froim line 6 to a Moog 1528 sample and hold unit 422 from Figure 4. The sample and hold unit is triggered by first threshold detector 421 to produce ai output voltage that is proportional to the voltage of the ongoing EEG signal from signal bus 6. Once triggered, the sample and hold unit 422 determines the oscillation freqvency of a, Moog 921 voltage controlled osuillator 623 which has a cei ter frequency of 10.7KHz. A Moog 902 voltage controlled amplifier 625 receives an input signal from voltage oscillator 623 in the forzi of a triangular wave. A Moog 911 envelope generator 423 modulates the amplitude of the voltage output signal trom VCA 625 so that the resulting audio output sounds like a bell and may therefore supply musical flavor to the resulting audio output. The envelope generator reaches maximum amplitude four milliseconds after being triggered by threshold detector 421. In order to bring the bell sound and FM sound into phase alignment, the FM sound should be delayed an additional 4 milliseconds, and this delay should be taken into account in calculating the NVO 90/01897 O/O~97PCr/UJS88/02725 25 delay time. The FM unit, however, is not shown as bein~g so delayed. This relatively sharp rise time corresponds to a sharp attack time which is characteristic of a stzuck bell.
The amplitude envelope then decays to 60% of i ,a X4Mura amplitude after 200 milliseconds. The generator shuts off after an additional 200 milliseconds so as to approximate the ringing of a bell.
Figure 7 is a more detailed functional block diagram of overtone sweep unit 430 shown in Figure 4. A Moog CP3A audio mixer 73 mixes,, in the ratio, of 10:3.5:5, the triangular wave output signals from Moog 921 voltage controlled oscillators 71a, 71b and 71c, having base frecruencies of of 75Hz, 144 Hz, and 257Hz, respectively. A Moog 904 A voltage controlled low~ pliss filter 759 directs the output signal of audio mixer 73 to the main mixer after its tizbre spectral content is modulated by envelope generator 432 of Figure 4. Envelope generator 432 produces an output signal that reaches maximum value 500 Lilliseconds after being triggered by threshold detector 421. The amplitude of the output envelope then falls 70% of peak value over the next 400 milliseconds and completely shuts off after an additional 500 milliseconds. The total conduction time of envelope generator 432 is therefore greater than the expected duration of an alpha wave. Hence, a subsequent alpha wave increases or maintains at maximum the ampliltude of the control signal and maintains or increases the amplitude of the overtone sweep. The envelope generator eventually shuts of f at the end of an alpha burst.
Figure 8 is a more detailed block diagram of the sequencer unit 440 shown in Figure 4. The 6atput of envelope generator 432 is inverted by inverter~ 431, as shown in Figure 4, to trigger a M~oog 960 sequence clock controller 81, which supplies a clocking signal to sequenze generator 82. The sequence generator has three rows of eight notes each for a total of 24 notes. The sequence generator, cycles through the 24 notes at a fixed rate and modulates a, Bode 1630 harmonic frequency shifter 84 which WO 90/01897 PCT/US88/02725 26 shifts the frequency of the square wave output signal from a Moog 901 voltage controlled oscillator 83. The output signal frola frequency shifter 84 passes through a Moog 902 voltage controlled amplifier 85 which is amplitude modulated by the output signal from a Moog 911 envelope generator 87 in response to a trigger signal from sequence clock controller 81.
The cycling rate of sequence generator 5e is reduced in proportion to the amplitude of a control signal from sequential controller 81 which is proportional to the voltage value of envelope generator control signal from first threshold detector 421. Sequence clock 81 also triggers envelope generator 87 through a Moog 961CP interface unit 86. The envelope generator adds musical flavor of the output signal from harmonic frequency shifter 84 by changing the output amplitude envelope to correspond to any desired instrument.
The sequential generator also comprises a control signal input for 'etriggering the sequence to the first row. Sequence generator 82 comprises a Moog 962 sequential switch which has three control ports for retriggering the sequential controller to any of the three columns. The output signal from threshold detector 441 uses a Moog 961CP interface to trigger the output switch to the first row and the sequence generator to the first column each time the ongoing EEG signal exceeds the second threshold level.
Figure 9 is a flow chart of the signal processing steps such as performed by the apparatus disclosed in Figures 4-8. The ongoing EEG signal received at step supplies a continuum of signal processing paths that ranges between following moment-by-moment change in the ongoing EEG signal to controlling independently generated sounds.
Various intermediate signal processing paths respond to specific features or properties of the ongoing EEG signal in ways specifically engineered to incorporate multiple information pathways into the musical feedback signal. The music thus communicates a real time analysis of the ongoing WO 90/01897 PCTUS8/02725 27 EEG signal in a psychoacoustically correct form which can affect the biological activity of the brain when used in a real time resonance loop.
Referring to Figure 9, the moment-by-moment change in the ongoing EEG signal is communicated at step 91. The preferred method for indicating moment-by-moment change is to frequency modulate a tone chord with ongoing EEG signal.
In the alternative, the amplitude (intensity) may be modulated with the amplitude of the ongoing EEG signal.
Frequency modulation is preferred because the human auditory system is more than 30 times more sensitive to changes in frequency. The output signal from step 91 supplies an input signal to mixing step 92. This first level of signal processing provides the most immediate possible indication of current EEG activity.
Another level of EEG signal processing and analysis extracts major features of the EEG and reinforces them by sounding whenever the EEG signal generates the predetermined feature sensed at conditional test 94. No output is generated in the' absence of the feature of interest. Any of several sounds might be generated to reinforce the particular features. However, no sound is absolutely physiologically correct if its attack time peak intensity exceeds the duration of the EEG feature that is being reinforced because a sound having a longer duration permits preceding features to obscure subsequent occurrences of the same feature. For example, reinforcing each peak for alpha activity having a frequency of approximately 10Hz requires a sound having an attack time of less than 100 milliseconds.
A bell, chime or harp sound is preferred because it has a sufficiently short attack time and is also psychologically musically pleasing to the listener and thus adds musical flavor to the feedback music.
Another level of signal analysis and processing of the ongoing EEG signal comprises generating an indication of the current flavnr of the ongoing EEG signal. The current flavor may be indicated by generating an overtone sweep at WO 90/01897 PC/US88/02725 28 step 97 in response to a feature such as a crest of the ongoing EEG signal. Whe ongoing EEG thus changes the musical flavor of the feedback music by increasing the harmonic content of the feedback as the ongoing EEG signal first exhibits the preferred activity and then continues to pass more harmonics with repeated instances of the preferred activity. The overtone sweep provides a more derivative indication of ongoing physiological activity since its production is not engineered to evoke an immediate response. Nevertheless, the overtone sweep is a relevant indication of ongoing EEG activity and a the extent of the production of a particular type of EEG activity.
Yet another level of signal analysis and processing of the ongoing EEG signal comprises generating an indication of the time average of the musical flavor in a manner that is analogous to conventional biofeedback. The time average flavor can be indicated by modifying a sequence of notes at step 98 in response to some property of the ongoing EEG signal such as its relative amplitude. .Further, the sequence of notes can supply considerable musical flavor to the acoustical output independent of the ongoing EEG signal to make the feedback music psychologically pleasing for extended periods of time.
As shown in Figure 9, the feature extraction, current flavor and average flavor signal processing levels all respond to a common feature of the ongoing EEG signal detected at conditional step 94. The multiple information pathways thus tend to reinforce the same physiological activity in different ways even while being derivative of moment-by-moment changes in the ongoing EEG signal. In addition, additional musical flavr may be triggered in response to other characteristics of the ongoing EEG signal as indicated by conditional test 99. It is to be appreciated that the musical flavor provides both current physiological information and more perceptually discernible time average learning information that enables a person to learn to control his EEG activity.
WO 90AM97 WO 90QP397PCrI/US88/02725 29 It has been found that particular utility can be obtaiiied by organizing thla information pathways in musical form. For example, the current musical flavor and feature extraction sounds, and l.ong term flavor sound can be made to function as counter melodies of one another to add musical texture to the feedback. The relative perceptual prominence of each voice can be made to change so as to indicate the relative magnitude of a desired brain state as described in the summary of the invention section.
it is to be appreciated that the signal processing steps performed in the flow chart shown in Figure 9 may be implemented with different apparatus, including preferably apparatus using the techniques of digi~tal sound synthesis, to produce an apparatus that operates in accord with the teachings of the present invention. Numerous additional musical voices may be added to the output. other musical relationships can be established between the musical voices, either perzanently or through time-va,,riant means.
ALT M ATE EMBODIMENTS A modification to the embodiment 69 the invention shown in Figure 1 involves measuring the ongoing EEG signal from additional locations on the scalp and modifying the acoustical feedback to simultaneously enhance the EEG at several locations, or to enhance it at one location while discouraging its production at another location. For example, it is thought to be preferable for reinforcing alpha wave activity with an electrode at the P3 location to direct physiological information, i.e. the frequency modulated tone chord and bell sound to the right ear and the overtone sweep and note sequence to the left ear. In terms of dichotic listening, the physiological stimulation thus is confined to the left side of the brain because sound heard with the right ear stimulates the left side of the brain.
The right side of the brain is thus free to produce other types of EtG activity such as beta waves. The literature suggests that alpha activity at P3 with corresponding beta activity in the temporal lobe of right brain corresponds to WO 961/01897 PM~fUSPRIOV02"725 30 a state of inwardly focused attention with positive emotional imagery. Further, right brain is better able to holistirally process the learning information communicated by the note sequencer and overtone sweep, and respond to its changing musical structure.
It is to be appreciated that the signal processing steps shown in Figures 2 and 4 may be implemented with digital musical equipment. Indeed, digital sound synthesis techniques are thought to be preferable because a wide range of voices may be implemented in response to a wider range of phenomena present in the ongoing EEG signal. The particular EE( phenomena used to produce a voice and the musical structure of the voice may be selected, on an experimental basis, to produce a desired physiological response.
Further, digital equipment permits more precise feature extraction as well as automatic scaling of the triggering thresholds during use so that the feedback music continues to induce the appropriate response in the person as his EEG parameters change throughout the session and he enters deepe- into the desired state. Alternately or additionally, the musical voices may be organized by a composer based on purely aesthetic considerations. Digital analysis and synthesizing equipment greatly simplifies composing and implementing of the acoustical feedback by reducing the amount and time consumed in experimentally finding physiologically and psychoacoustically "correct" sounds.
Additional voices may be added to create interesting and physiologically relevant effects. Both the type of musical sound produced and the quality of that sound directly affect the ability of the present invention to enhance brain wave activity. The criteria used to select a proper sound have been described above. The musical quality of the feedback music must exceed :n as of yet indefinite minimum threshold to allow the resonance feedback effect to proceed.
One unusual result obtained with the present invention is the production of synesthesic effects, or the WO 90/018977 PC US88/02725 31 observations of lights and colors, in response to the various musical voices in the resonance feedback. Specific colors or color patterns have been observed to follow particular voices in the music. Synesthesic effects have been experienced by approximately one third of individuals tested using the principles of the present invention. This result suggests that the addition of visual feedback may augment the effects obtained with acoustical feedback.
APPLICATIONS
The present invention is useful for producing enjoyable music. For example, the second voice can comprise a bell sound, chime or any other desired tone. Likewise, the sequencer may play twenty-four notes from any desired type of instrument to produce any type of melody. The invention may be used as a musical instrument on which a person may learn and play music by cognitive control without also having to physically perform a composition.
The invention may be used as a relaxation device that operates by resonantly reinforcing high amplitude, low frequency EEG activity such as alpha wave activity. Such biofeedback also permits an individual to monitor and change his brain wave patterns to obtain various internal states.
A clinical psychologist may facilitate various therapeutic procedures, such as guided imagery, by enhancing or retarding a particular brain state. A neurologist may use the present invention as a musically pleasing test of brain functions by introducing a controlled signal, such as punctate sounds embedded within the feedback music, to generate an evoked potential response. Yet another application is as a clinical monitoring device which permits a physician or researcher, such as an anesthesiologist, to monitor the status of a patient's or subject's brain over a loudspeaker without having to maintain a constant vigil on the visual image formed on an oscilloscope.
Experiments have shown that the present invention provides an individual with a pleasant way to control his brain wave activity within a matter of a few minutes.
WO 90/01891 cr S8/22 I'Cr/US88/02725 32 moreover, individuals who have experienced biofeedback resonance according to the present inviention have shown a statistically significant reduction in anxiety, The present inverntion appears to actively promote alpha wave activity since the amount of alpha activity increases during feedback in contradistinction to no sound or a noncontingent, but in other respects similar, Ncoustical stimulus. In contrast, nonresonance biofeedback t% chniques may block alpha wave activity with an incongruent feedback signal.
The invention can be used to diagnose psychological and neurological conditions. The dramatic portrayal of the emotional and functional states of an individual contained in the feedback music provides a direct indication of the psychological state of a person. Empirical guidelines should be established to enable a practitioner to criticall~y and analytically list to the feedback music and form diagnostic opinions about the individual. Further, the invention could be used to eOreate diagnostic methods for assessing hearing disorders kifter traumas such as ttroke or head injury because the sourde of the BEG signal used to create the feedback music andi the efficacy of the feedback can be precisely defined. The invtntAlon may also be useful for mapping brain activity S-n relation to the production or perception of music or language.
An additlonal application of the present invention is to the generaI, field of man/machine interface such as between the human brain and a computer. Experiments have shown that the present invention enables individuals to control their BEG activity so as to repeat audible patterns. The human brain can easily remember and distinguish between a large number of musical patterns such as melodies. individuals should be able to rememnber and reliably reproduce a large number of distinct control signals. Thus, referring to Figure 1, speaker 5 Viay be replaced by a pattern recognition device which, after recognizing a desired musical pattern, generates the WO 90/01897 PC'r/US88/02725 33 appropriate control signal to a de%,ice which is not necessarily a musical device.
The present invention also permits interpersonal communications. One skilled in the art may readily appreciate that various voices may be added to the feedback signal that indicate a particular synchronism or mental state among more than one individual. The musical feedback thus comprises a form of communication which is analogous to the type of communication which occurs between, for example, a violin and a cello playing a duet. In the present instance, however, the communication comprises a form of cognitive "group thought" and emotional communication not hitherto known.
EXAMPLE 1 The capabilities of the present invention to induce relaxation are illustrated by the experimental results presented in Figure 10. A sample group of 15 subjects was selected. No subject was a clinical patient and none exhibited signs of psychopathology. Each subject experienced a ten minute control period of sitti i quietly without sound, followed by a ten minte period of resonance feedback. The state of anxiety of each subject was measured before and after the ten minute periods using the spielberger self report anxiety scale. The Spielberger scale is well known to those skilled in the art. The ordinate of Figure 10 shows the relative anxiety scores as measured by the Spielberger scale. Scores in the range of 45 to 50 correspond to overt signs of anxiety. Scores in the mid 30's indicate moderately high levels of anxiety.
The lowest possible score on the scale is As shown in Figure 10, quiet did not significantly change the level the anxiety as seen by comparing the scores for blocks A and B ibtained before and after th3 period of qu. et, respectively. Measurements remained in the mid-30's. After resonance feedback, however, anxiety decreased markedly from the mid-30's to the mid-20's as sh by comparing blocks C and D corresponding to scores WO 90/01897 WO /18 CT/ U S U/ 02725 obtained before and after resonance feedback, respectively.
The decrease in anxiety as a result of resonance feedback was significant at tho P<0.05 level of statistical significance.
EXAMPL.E 2 Figure 11 exemplifies the increase in alpha activity in a single subject during resonaiice feedback. The ordinate corresponds to the number of alpha waves counted during a 30 second period at the CZ location on the scalp.
1o FB corresponds to the wave count obtained from a single representative individual experiencing resonance feedback In contrast, NS represents the alpha count for a control condition corresponding to a comparable period without sound. NC corresponds to the alpha count for the same individual listening to the music corresponding to his own brain wave activity but which hais been delayed by a few minutes so as not to be contingent on the ongoing EEG signal. Figure 11 clearly illustrates that the resonance feedback produces a greater number of alpha waves than obtained by mere silence. Further, the greater number of alpha waves obtained with resonance feedback as opposed to music that is not contingent upon the ongoing EEG signal shows the importance of resonance feedback at inducing the desired form of EEG activity.
EXAM'PLE 3 Figure 12 corresponds to a representative comparison of the effects of resonance teedback at various de ibel intensity levels for a single subject for a single oubject. The vertical scale corresponds to the relative power present in the alpha wave signal as measured by an electrode attached to the CZ location on the scalp (400 units -13.6 Zicrovolts). The horizontal axis corresponds to the intensity of the feedback in decibels. Referring to Figure 12, it is apparent that the amount of alpha activity present with resonance feedback, represented by curve 130, diverges substantially at approximately 86 decibels fr.mn that produced with the same type of- music played as WO 90/01897 C''U8/72 PCIVUS89/02725 35 noncontingr-nt sound as represented by curve 131. Further, the amount of activity measured with resonance feedback and cont1-ingent feedback begins to converge as the intensity ;'-,lines at approximately 82 decibels. It is 3 to be appeciatad that an intensity of 86 decibels correspo~nds to approximately the volume produosd by a home stereo systeia, a-Verating at moderately high listening levels. Further, the amount of alpha activity generated with resonance feedback appears to increase w~th '.nteznsity after 86 decie *ls. in contrast, the amount of alpha. wave activity r 1 4,,duco-d by the non'contingent feedback decreases with incriasing inmensity as illivstrated by the miniiaum in curve 131 at maximum intensity. Experiments conducted with several individuals have shown that the 86 decibel threshold, in the context of ciirrent signal to noise ratios, appears to be critical to the commencement of resonance feedback.
EXAMPLE 4 Figures 13 and 14 ilvstrate the importance of the, delay period to maximize retinant. feedback. Figure 13a s.hows the distribution of alpha waves with frequency at 1-h P3 location on the scalp co'f a representative individual.
The ordinate corresponds to the number of EEG waves observed during a 30 second interval and the horizonal axis shows the range in frequencies obtained by using a cross point analysis. This particular individual exhibits maximumn alpha wave activity art 10 Hz. In Figure 13b, the vertical axis represents thet alpha wave count and the horizontal axis represents thn total delay time in r.C lliseconds obtained during resornaz~re feedback using the present invention. The optimal amount of alpha wave activity was obtained with a delay timne of 100 milliseconds which, corresponds to a frequency of 10 Hz having a period of 100 milliseconds.
Thus,, the optimal delay time exactly corresponds to the preferred alpha frequency of~ this subject.
Figure 14 shows similar re-1t for a second representative individual. As shown in YVigure 14at this WO 90/01897 W7crT/US88/027'25 36 individual has a preferred alpha frequency of 8 Hz which corresponds to a period of 125 milliseconds. Figure 14b shows that the maximum amount of alpha wave activity obtained using the the present invention occurred with a total delay time of 125 milliseconds which, again, corresponds to the preferred EEG alpha frequency. Thus, for any particular individual the preferred frequency of the desired EEG activity determines the optimal delay time present in the resonance feedback loop. Resonance is maximized by matching the feedback time delay to the frequency at which the brain prefers to produce the EEG activity of interest.
SUGGESTIONS FOR FURTHER RESEARCH Numerous possible applications of the present invention have been described above. A particularly promising application is the use of resonance feedback as an an alternative to conventional invasive brain stimulation techniques.
Current methods of brain stimulation involve surgically implanting an electrode into an region of the brain that is to be stimulated. The resulting effect on the brain depends on the location of the electrode and the frequency of the stimulation. For example, a region of the brain can be activated with high frequency stimulation, whereas inhibition and deactivation result fom low frequency stimulation. The process of surgically implanting an electrode, however, is highly invasive and greatly limits the both research into brain stimulation and its utility as a diagnostic or therapeutic tool.
In contrast, resonance feedback uses noninvasive electrodes that are located on the scalp. The position of the electrodes determines the area of the bra.in that is "stimulated" by the feedback music. Further, the use of constructive and destructive interference, selective filtering and judicious manipulation of delay times may produce different frequencies of "stimulation". Resonance WO 90/01897 )cri US88/02725 37 feedback thus offers the possibility of systematically stimulating selected areas of the brain.
One potential application for brain stimulation using resonance feedback involves neural exercise.
Rehabilitation programs for persons who have suffered brain injuries are essentially designed around the concept of neural exercise, wherein the region of the brain that surrounds a region that has been damaged is systematically stimulated in the hope tiat it will assume the functions of the damaged brain cells. It is thought likely that resonance feedback is effective at stimulating neural activity in selected region of the brain aid should therefore serve as a form of neural exercise. Resonance feedback is thought to offer particular utility in cases involving music and langiuge impairment.
Recent davelopments in superconductivity and research directed to recording brain waves with magnometers indicate that increased resolution and selectivity may soon be available to aid resonance rtimulation of any region of the brain. Magnometers may replace the scalp electrode 3 shown in Figure 1 to generate an input signal corresponding to the semiperiodic changes in amplitude of the magnetic field that are associated with ongoing EEG activity.
Magnometers can tringulate the semiperiodic magnetic activity so as to generate a signal indicative of EEG activity occurring in a well defined region deep within the brain. The delay inserted into the feedback loop can be adjusted to obtain a desired phase relationship between the feedback signal and the ongoing EEG activity since magnometers can also be used to determine the response of the region of the brain to acoustic stimulation.
In addition, EEG computer analysis methods, such as BEAM developed by Frank Duffy, are providing extensive maps of the brain that indicate what EEG activity in which regions of the brain are associated with particular states of emotion, cognition and consciousness. This information can be used as a guide for designing resonance feedback WO 90/01897 PCr/US88/02725 38 protocols and in selecting regions of the brain for resonance stimulation.
The principles, preferred embodiments and modes of operation of the present invention have been described in the foregoing specification. The invention, which is intended to be protected herein, should not, howe' be construed as limited to the particular forms described, or the particular examples given, as these are to be regarded as illustrative rather than restrictive. Variations and changes may be made by those skilled in the art without departing from the spirit of the invention. Accordingly, the foregoing detailed description should be considered exemplary in nature and as in no way limiting to the scope and pioneering spirit of the invention as set forth in the appended claims.
Claims (62)
1. A biofeedback apparatus for producing and utilizing acoustically expressed EEG derived music, including means for receiving an ongoing EEG signal from at least one region of the brain of a biological entity having a brain responsive to acoustically expressed music, said at least one region of the brain responding to acoustical stimulation, said ongoing EEG signal having a voltage amplitude exhibiting quasi-periodic change; means for translating said ongoing EEG signal into EEG derived music; and means for acoustically directing said music so as to be received by the brain; characterized in that said translating means includes means for generating an acoustical indication of the quasi-periodic change in said ongoing EEG signal, and means for generating musical flavor and adding said acoustical musical flavor to said acoustical indication to operate EEG derived music; and means for delaying said directing means for a period of time determined so that the brain response to said EEG derived music occurs with a predetermined phase relationship with respect to the ongoing EEG signal generated at said region of the brain.
2. A biofeedback apparatus as claimed in Claim 1, further characterized by means for anticipating an occurrence of said quasi-periodic change in said ongoing EEG signal.
3. A biofeedback apparatus as claimed in Claim 2, characterized in that said anticipating means comprises means for determining a preferred frequency at which said Sbrain produces said quasi-periodic change over a predetermined period of time. 9303p p bw230398839 .iii> 9301 13p:\opcr\dbw,2303.3 9
4. A biofeedback apparatus as claimed in Claim 2, characterized in that said anticipating means comprises means for determining a period for a most recent preceding quasi-periodic change. A biofeedback apparatus as claimed in claims 2, 3 or 4, further characterized by means for modifying said delaying means to correspond to said anticipated occurrence of said quasi-periodic change in said ongoing EEG signal.
6. A biofeedback apparatus as claimed in claim 2, characterized in that said means for generating said EEG derived music comprises means for generating sound selected from a tone chord that is frepquency modulated with said ongoing EEG signal, or a punctate sound having a short attack time that is produced in response to a predetermined recurrent feature of said ongoing EEG signal or and timbre modulation produced by modulating an overtone sweep with said ongoing EEG signal.
7. A biofeedback apparatus as claimed in Claim 6, characterized in that the generated sound is a punctate sound and said means for generating said punctate sound comprises means for generating a sound selected from the group consisting of a bell; a drum; and a harp.
8. A biov'dback apparatus as claimed in Claim 6, characterized in that the generated sound is a punctate sound and said means for generating said punctate sound comprises means for generating a bell sound in response to a local maxima in said ongoing EEG signal. 41
9. A biofeedback apparatus as claimed in Claim 2, characterized in that said means for generating said EEG derived music comprises means for generating a tone chord; and further characterized by means for frequency modulating said tone chord with said ongoing EEG signal. A biofeedback apparatus as claimed in Claim 9, characterized in that said means for generating musical flavor further comprises means for modulating an overtone sweep with a low frequency, pseudorandom control signal.
11. A biofeedback apparatus as claimed in Claim 9, characterized in that said means for generating musical flavor comprises means for generating a timbre modulated tone chord that is modulated with a low frequency, pseudorandom control signal; and means for generating a timbre modulated chord that is modulated with the voltage amplitude of said ongoing EEG signal.
12. A biofeedback apparatus as claimed in claim 9, characterized in that said means for generating musical flavor comprises means for generating a sound selected from a timbre modulated tone chord that is modulated with a low frequency, pseudorandom control signal or a punctate sound having a short attack time that is produced in response to a predetermined recurrent feature of said ongoing EEG signal or a timbre modulated tone chord that is modulated with said ongoing EEG signal; or and a sequence of musical notes.
13. A biofeedback apparatus as claimed in Claim 12, characterized in that the generated sound is a punctate sound and said means for generating said *a 42 punctate sound further comprises means for generating the sound of a bell, a drum or a harp.
14. A biofeedback apparatus as claimed in Claim 12, characterized in that the generated sound is a punctate sound and said means for generating said punctate sound comprises means for generating a bell sound in response to a local maxima in said ongoing EEG signal- A biofeedback apparatus as claimed in Claim 12, characterized in that the generated sound is a sequence of musical tones; and said means for generating said sequence of tones comprises means for generating said tones at a predetermined rate; and further characterized by means for slowing said rate in proportion to the frequency of occurrence of high amplitude waves of said ongoing EEG sgn.h
16. A biofeedback apparatus as claimed in Claim 15, further characterized by means for triggering said slowing means only when the amplitude of said ongoing EEG signal exceeds a first predetermined threshold level.
17. A biofeedback apparatus as claimed in Claim 16, further characterized by means for generating said sequence of tones over again when the amplitude of said ongoing EEG signal exceeds a second predetermined threshold level that is greate, than said first predetermined threshold level.
18. A biofeedback apparatus as claimed in Claim further characterized by means for generating said sequence of tones over again when the 43 amplitude of said ongoing EEG signal exceeds a second predetermined threshold level that is greater than said first predetermined threshold level,
19. A ofeedback apparatus as claimed in Claim 9, characterized in that said means for generating an acoustical indication of the quasi-pariodic change in said ongoing EEG signal produces a first musical voice. A biofeedback apparatus as claimed in Claim 19, characterized, in that said musical flavor comprises means for generating a second musical voice indicative of a predetermined feature of said ongoing EEG signal; means for generating a third musical voice indicative of the occurrence of a quasi-periodic predetermined feature of the ongoing EEG signal; and means for generating a fourth musical voice indicative of an average value of the ongoing EEG signal.
21. A biofeedback apparatus as claimed in Claim 20, characterized in that said means for generating said first musical voice comprises means for generating a tone chord and means for frequency modulating said tone chord with said ongoing EEG signal; said means for generating said second musical voice comprises means for generating a bell sound in response to a local maxima of said ongoing EEG signal; said means for generating said third musical voice comprises means for generating an overtone sweep of a chord tone, said overtone sweep being modulated by the amplitude of said ongoing EEG signal at a local maxima; and said means for generating said fourth musical voice comprises means for generating a series of notes in sequence at a rate determined by the amplitude of said ongoing EEG signal. 44
22. A biofeedback apparatus as claimed in claim 21, characterized in that said means for generating said second voice comprises means for not generating said second voice unless thie amplitude of said ongoing EEG signal exceeds a first predetermined threshold level; and said means for generating said fourth voice comprises means for not generating said sequence rate at a slower rate unless the amplitude of said ongoing EEG signal exceeds said first threshold level.
23. A biofeedback apparatus as claimed in Claim 22, characterized in that said means for generating said third voice comprises means for not generating 3aid third voice unless the amplitude of said ongoing EEG signal exceeds said first threshold ie-, 1 1 and said means for generating said sequence of notes comprises means for generating said sequence again whenever said ongoing EEG signal exceeds a second predetermined threshold level that is greater than said first predetermined threshold level.
24. A biofeedback apparatus as claimed in Claim 23, characterized in that said means for generating said sequence of notes comprises means for generating a progressively more dissonant pattern.
25. A biofeedback apparatus as claimed in Claim 23, characterized in that said means for generating said second voice comprises means for modulating the pitch of said bell sound around a center frequency in proportion to said amplitude of said ongoing EEG signal.
26. A biofeedback apparatus as claimed in Claim 23, characterized in that said means for generating said fourth voice comprises an envwlop generator means for amplitude modulating said fourth voice, said envelope generator means being triggered independently of said ongoing EEG signal.
27. A method of producing acoustically expressed EEG derived music useful for biofetdback applications to biological entities having brains responsive to acoustically expressed music, including the steps of extracting an ongoing EEG signal from at least one region of the brain of a biological entity, said at least one region of the brain responding to acoustical stimulation, said ongoing EEG signal having a voltage amplitude exhibiting quasi-periodic change; and translating said ongoing EEG signal into EEG derived music, characterized by the steps of generating an acoustical indication of the quasi-periodic change in said ongoing EEG signal, generating acoustical musical flavor, and odding said musical flavor to said acoustical indication to generate EEG derived music; directing said music so a to be acoustically received by the brain; and delaying said directing for a period of time determined such that the brain response to said EEG derived music occurs with a predetermined phase relationship with respect to the ongoing EEG signal extracted from said region of the brain.
28. A method of producing a biofeedback signal as clairnm in Claim 27, ffurther characterized by the step of anticipating an occurrence of said quasi-periodic change in sjid ongoing EEG signal.
29. A method of producing a biofeedback signal as claimed in Claim 28, characterized in that said step of anticipating comprises the step of determining a preferred frequency it which said brain produces said quasi-periodic change o, a S predetermined period of time. 46 A method of producing a biofeedback signal as claimed In Claim 28, characterized in that said step of anticipating comprises the step of determining a period for a most recent preceding quasi-periodic change.
31. A method of producing a biofeedback signal as claimed in claim 28, further characterized by the step of modifying said delaying time period to correspond to said anticipated occurrence of said quasi-periodic change in said ongoing EEG signal. 32, A method of producing a biofeedback signal as claimed in Claim 28, characterized in that said step of generating said EEG derived music comprises the step of generating a sound selected from the group consisting of a tone chord that is frequency modulated with said ongoing EEG signal; a punctate sound having a short attack time that is produced in response to a predetermined recurrent feature of said ongoing EEG signal; and timbre modulation produced by modulating an overtone sweep with said ongoing EEG signal.
33. A method of producing a biofeedback signal as claimed in Claim 32, characterized in that the generated sound is punctate and said step of generating said punctate sound comprises generating the sound of a bell, a drum and a harp.
34. A method of producing a biofeedback signal as claimed in Claim 32, characterized in that the generated sound is punctate and said step of generating said punctate sound comprises the step of generating a bell sound in response to a local maxima in said ongoing EEG signal. 47 A method of producing a biofeedback signal as claimed in Claim 28, characterized in that said step of generating said EEG derived music comprises the step of generating a tone chord and the step of frequency modulating said tone chord with said ongoing EEG signal.
36. A method of producing a biofeedback signal as claimed in Claim characterized in that said step of generating musical flavor further comprises the step of modulating an overtone sweep with a low frequency, pseudorandom control signal.
37. A method of producing a biofeedback signal as claimed in Claim characterized in that said step of generating musical flavor comprises the steps of generating a timbre modulated tone chord that is modulated with a low frequency, pseudorandom control signal; and generating a timbre modulated chord that is modulated with the voltage amplitude of said ongoing EEG signal.
38. A method of producing a blofeedback signal as claimed in Claim characterized in that said step of generating musical flavor comprises the step of generating the sound of a timbre modulated tone chord that is modulated with a low frequency, pseudorandom control signal; a punctate sound having a short attack time that Is produced in response to a predetermined recurrent feature of said ongoing EEG signal; a timbre modulated tone chord that is modulated with said ongoing EEG signal; or a sequence of musical notes.
39. A method of producing a biofeedback signal as claimed in Claim 38, characterized in that the generated sound is punctate and said step of generating .2 48 said punctate sound further comprises the step of generating the sound of a bell, a drum, or a harp. A method of producing a biofeedback signal as claimed in Claim 38, characterized in that the generated aV'ovdJ 3 a punctate sound and said stop of generating said punctate sound further comprises the step of grisrating a bell sound in response to a local maxim in said ongoing EEG signal.
41. A method of producing a biofeedback signal as claimed in claim 38, characterized in that the sound is a sequence f musical notes, and said step of generating said sequence of notes comprises the step of generating said notes at a predetermined rate; and the step of slowing said rate in proportion to the frequency of occurrence of high amplitude waves of said ongoing EEG signal.
42. A method of producing a biofeedback sigril as claimed In Claim 41, further characterized by the step of triggering said slowing step only when the amplitude of said ongoing EEG signal exceeds a first predetermined threshold level.
43. A method of producing a biofeedback signal as claimed irn Claim 42, further characterized by the step of generating said sequence of notes over again when the amplitude of said ongoing EEG signal exceeds a second predetermined threshold level that is greater than said first predetermined threshold level.
44. A method of producing a biofeedback signal as claimed In Claim 41, further characterized by the step of generating said sequence of notes over again 49 when the amplitude of said ongoing EEG signal exceeds a second predetermined threshold level that is greater than said first predetermined threshold level. A method of producing biofeedback as claimed in Claim 33 characterized in that said step of adding musical flavor to said acoustical indication comprises the step of modifying said musical flavor with said ongoing EEG signal.
46. A method of producing biofeedback as claimed in Claim characterized in that said step of genera ;ig said acoustical indication comprises generati.Ig a tone chord and the step of frequency modulating said tone chord with said ongoing EE' sigial; and said step of adding musical flavor comprises the step of timbre modulating said tone chord wth the voltage amplitude of said ongoing EEG signal.
47. A method of producing biofeedback as claimed in Claim 46, characterized in that said step of adding musical flavor further comprises the step of modulating said timbre of said tone chord with an independently produced signal that is independent of said ongoing EEG signal.
48. A method of producing biofeedback as claimed in Claim 47, characterized in that said independently produced signal comprises a low frequency, pseudorandom signal.
49. A method of producing biofeedback as claimed in t;irtm characterized in that said step of generating said acoustical indication of the quasi- Speriodic change in aid ongoing EEG signal produces a first musical voice. A method of producing biofeedback as claimed in Claim 49, characterized in tiat said step of generating musical flavor comprises the steps of generating a second musical voice indicative of a predetermined feature of said ongoing EEG sigrnal; generating a third musical voice indicative of the recent amplitude of the ongoing EEG signal; and generating a fourth musical voice indicative of an average value of the ongoing EEG signal
51. A method of producing biofeedback as claimed in Claim characterized in that said step of generating said first musical voice comprises the step of generating a tone chord that is frequency modulated with said ongoing EEG signal; said step of generating a second musical voice comprises the step of generating a bell sound ir iponse to a local maxima of said ongoing EEG signal; said step of generating said third musical voice comprises the step of generating an overtone sweep of a chord tone, said overtone sweep being modulated by the relative frequency of occurrence of an at least quasi-periodic predetermined feature of said ongoing EEG signal; and said step of generating said fou;th musical voice comprises the step of generating a series of notes that are played in sequence at a rate determined by the amplitude of said ongoing EEG signal.
52. A method of producing biofeedback as claimed in Claim 51, characterized in that said step of generating said second voice is performed only in response to the amplitude of said ongoing EEG signal exceeding a first predetermined threshold level; and said step of generating said fourth voice comprises the step of slowing said sequence rate in proportion to the amplitude of said ongoing EEG signal only when said ongoing EEG signal exceeds said first threshold level. 51
53. A method of producing biofeedback as claimed in Claim 52, characterized in that said step of generating said third voice comprises the step of modifying said. third voice only when the amplitude of said ongoing EEG signal exceeds said first predetermined threshold level; and said step of generating said fourth voice comprises the step of generating said sequence a:'jin whenever said ongoing EEG signal exceeds a second threshold level that is gIr ter than said first threshold level. 54, A method of producing biofeedback as claimed in Claim 53, chacracterized in that said sequence of notes comprises a progressively more dissonant pattern. A method of producing biofeedback as claimed in Claim 53, characterized in that said step of generating said secod voice comprises the step of modulating the pitch of said bell sound around a center frequency in proportion to said amplitude of said ongoing EEG signal.
56. A method of producing biofeedback as claimed in Claim 53, characterized in that said step nf generating said fourth voice comprises the step of modifying the feedback signal with a signal that is independent of said ongoing EEG signal.
57. An acoustically expressed musical signal derived from brain waves by a process including extracting an ongoing EEG signal from at least one region of the brain of a biological entity, said at least one region of the brain responding to acoustical stimulation, said ongoing EEG signal exhibiting quasi-periodic, moment-by- .fl, 52 moment change; wherein the process is furthir characterized by the steps of generating an acoustical indication of the moment-by-moment change of said ongoing EEG signal; adding musical flavor to said acoustical indication to produce an EEG derived musical signal; acoustically directing said acoustical indication so as to be received by the brain; and delaying said step of directing said musical signal for a period of time determined so that the brain response to said musical signal occurs with a predetermined phase relationship with respect to i:he ongoing EEG signal extracted from said region of the brain.
58. A musical signal as claimed in claim 57, wherein said musical signal is characterized as a polyphonic hierarchy of musical voices that are mutually physiologically and psychoacoustically correct.
59. A musical signal as claimed in Claim 58, characterized in that said polyphonic hierarchy comprises a background first voice derived from said ongoing EEG signal; a second musical voice indicative of a predetermined feature of said ongoing EEG signal; a third musical voice indicative of an at least quasi-periodic predetermined feature of the ongoing EEG signal; and a fourth musical voice indicative of an average value of the ongoing EEG signal. A musical signal as claimed in Claim 59, characterized in that said first, second, th'rd and fourth muoical voices comprise sounds selected from the group consisting of a timbre modulated tone chord that is modulated with the ongoing EEG signal; a punctate sound having a short attack time that is short relative to and prvoduced in response to a predetermined recurrent feature of said 53 ongoing EEG signal; a timbre modulated tone chord that is modulated with said ongoing EEG signal; and a sequence of dissonant musical notes.
61. An acoustically expressed EEG derived musical signal characterized by a first musical voice generated in response to moment-by-moment changes in an ongoing EEG signal of a biological entity having a brain as the source of said EEG signal, said first musical voice remaining in the background of the perceptual field of the music; a second musical voice generated in response to a predetermined, recurrent feature of said ongoing EEG signal, said second musical voice moving from the background to the foreground of ;he perceptual field of the music with increasing amplitude in said ongoing EEG signal; a third musical voice generated in ,esponse to a rate of reoccurrence of said recurrent feature of the ongoing EEG signal, said third musical voice moving from the background to the midground of the perceptual field of the music with increasing amplitude ir said ongoing EEG signal; and a fourth musical voice generated in response to an average level of said ongoing EEG signal, said fourth musical voice moving from the foreground to the background of the perceptual field of the music with increasing amplitude in said ongoing EEG signal.
62. A musical signal as claimed in Claim 61, characterized in that said first and second musical voices are mutually in phase; said third musical voice maintains a constant phase relationship with said second musical voice; said third musical voice moves in perceptual prominence in inverse proportion to said fourth musical voice. :f 54
63. A brain wave driven cybernetic interface circuit, adapted for cooperation with a nervous system, a living brain, and an acoustical sensory organ, characterized by means for selecting a predetermined form of electrical activity from the nervous system, said brain producir' -Id electrical activity, said acoustical sensory organ adapted to respond to acoustical imr.'es, including means for receiving an ongoing EEG signal from a region of the brain, and means for filtering said ongoing EEG sigral to select a particular type of neuroelectrical activity in the brain, said neuroelec'rical activity exhibiting quasi-periodic change; means for reinforcing said neuroelectrical activity in the brain, including means for generating an acoustical indication of said quasi-periodic change, means for adding musical flavor to said acoustical indication to form a musical feedback signal, means for converting said musical feedback signal into acoustical impulses comprising feedback music, means for directing said feedback music so as to be received by said acoustical sensory organ, and means for delaying said directing means for a period of time determined so that the brain response to said feedback music occurs with a predetermined phase relationship with respect to the ongoing EEG signal received from said region of the brain; and means for generating a control signal in response to a predetermined musical pattern in said feedback music.
64. A brain wave driven cybernetic intrfaca circuit as claimed in Claim 63, further characterized by a musical instrument to receive said control signal and generate music in response thereto. A method of forming a cybernetic interface, characterized by the steps of selecting a predetermined form of electrical activity from a nervous system, said nervous; system having a living brain to produce said electrical activity and an acoustical sensory organ to respond to acoustical impulses, including the steps of receiving an ongoing EEG signal from a region of the brain, and filtering said ongoing EEG signal to se!sct a particular type of neuroelectrical activity in the brain,said neuroelectrical activity exhibiting quasi-periodic change; reinforcing said neuroelectrical activity in the brain including the steps of generating an acoustical indication of said quasi-periodic change, adding musical flavor to said acoustical indication to form a musical feedback signal, converting said musical feedback signal into acoustical impulses comprising feedback music, directing said feedback music to be received by said acoustical sensory organ, and delaying said step of directing for a period of time determined so that the brain response to said feedback music occurs with a predeterrmned phase relationship with respect to the ongoing EEG signal received from said region of the brain; and generating a control signal in response to a predetermined musical pattern in said feedback music.
66. A method of forming a cybernetic interface as claimed in Claim further characterized by the step of directing said control signal to a musical instrument that generates music in response thereto.
67. A method of forming a cybernetic interface as claimed in Claim characterized in that said nervous system is a human nervous system.
68. A neural stimulation apparatus, including means for noninvasively extracting an ongoing EEG signal from a predetermined region of a brain; means for converting said EEG signal into acoustically expressed music, said music having physiological information and musical flavor; and means for directing said music to an auditory sensory organ of said brain; characterized by means for delaying said 56 directing means for a p riod of time determined so that said response of said region of the brain to said music occurs with a predetermined phase relationship with respect to the ongoing EEG signal extracted from said region of the brain.
69. A neural stimulation apparatus as claimed in Claim 68, characterized in that said noninvasive extraction means comprises a magnetometer. A neural stimulation apparatus as claimed in claim 69, characterized in that said magnetometer comprises means for triangulating EEG activity occurring within said brain.
71. A method of stimulating neural activity, including the steps of noninvasively extracting an ongoing EEG signal from a predetermined region of a brai; converting said EEG signal into acoustically expressed music, said music having physiological information and musical flavor; directing said music to an auditory sensory organ of said brain; characterized by delaying said directing step for a period of time determined so that the response of said region of the brain to said music occurs with a predetermined phase relationship with repect to the ongoing EEG signal extracted from said region of the brain. S72. A method of stimulating neural activity as claimed in Claim 71, characterized in that said step of extracting said ongoing EEG signal comprises the step of detecting quasi-periodic change, in magnetic field indicative of said ongoing EEG activity. 57
73. A method of stimulating neural activity as claimed in Claim 72, characterized in that said step of detecting quasi-periodic changes in magnetic field comprises the step of triangulating said ongoing EEG activity so as to extract only ongoing EEG activity from a well defined region of said brain.
74. A biofeedback apparatus substantially as hereinbefore described with reference to the accompanying drawings. A method of producing acoustically expressed EEG derived music substantially as hereinbefore described with reference to the accompanying drawings.
76. An acoustically expressed EEG derived music signal substantially as hereinbefore described with reference to the accompanying drawings.
77. A brain wave driven cybernetic interface circuit substantially as hereinbefore described with reference to the accompanying drawings.
78. A method of forming a cybernetic interface substantially as hereinbefore described with reference to the accompanying drawings.
79. A neural stimulation apparatus substantially as hereinbefore described with reference to the accompanying drawings. 80, A method of stimulating neural activity substrntially as hereinbefore described S 25 with reference to the accompanying drawings. DATED this 13th day of January, 1993 NEUROSONICS, INC. By its Patent Attorneys DAVIES COLLISON CAVE 930113,p:\operdbw,23039.88J7
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| AU23039/88A AU636287B2 (en) | 1988-08-17 | 1988-08-17 | Apparatus for translating the eeg into music |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/US1988/002725 WO1990001897A1 (en) | 1988-08-17 | 1988-08-17 | Apparatus for translating the eeg into music |
| AU23039/88A AU636287B2 (en) | 1988-08-17 | 1988-08-17 | Apparatus for translating the eeg into music |
| CA000575147A CA1322026C (en) | 1988-08-17 | 1988-08-18 | Method and apparatus for translating the eeg into music to induce and control various psychological and physiological states and to control a musical instrument |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| AU2303988A AU2303988A (en) | 1990-03-23 |
| AU636287B2 true AU636287B2 (en) | 1993-04-29 |
Family
ID=25618776
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| AU23039/88A Ceased AU636287B2 (en) | 1988-08-17 | 1988-08-17 | Apparatus for translating the eeg into music |
Country Status (1)
| Country | Link |
|---|---|
| AU (1) | AU636287B2 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2036486A1 (en) * | 2007-09-13 | 2009-03-18 | Hocoma AG | Rehabilitation system for neurological disorders |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3855998A (en) * | 1973-03-14 | 1974-12-24 | Hidalgo A De | Entertainment device |
| US4031883A (en) * | 1974-07-29 | 1977-06-28 | Biofeedback Computers, Inc. | Multiple channel phase integrating biofeedback computer |
| US4454886A (en) * | 1981-09-14 | 1984-06-19 | Lee Arnold S J | EEG With audio output |
-
1988
- 1988-08-17 AU AU23039/88A patent/AU636287B2/en not_active Ceased
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3855998A (en) * | 1973-03-14 | 1974-12-24 | Hidalgo A De | Entertainment device |
| US4031883A (en) * | 1974-07-29 | 1977-06-28 | Biofeedback Computers, Inc. | Multiple channel phase integrating biofeedback computer |
| US4454886A (en) * | 1981-09-14 | 1984-06-19 | Lee Arnold S J | EEG With audio output |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2036486A1 (en) * | 2007-09-13 | 2009-03-18 | Hocoma AG | Rehabilitation system for neurological disorders |
| US8905926B2 (en) | 2007-09-13 | 2014-12-09 | Hocoma Ag | Rehabilitation system for neurological disorders |
Also Published As
| Publication number | Publication date |
|---|---|
| AU2303988A (en) | 1990-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US4883067A (en) | Method and apparatus for translating the EEG into music to induce and control various psychological and physiological states and to control a musical instrument | |
| Frühholz et al. | The role of the medial temporal limbic system in processing emotions in voice and music | |
| Fujioka et al. | Musical training enhances automatic encoding of melodic contour and interval structure | |
| Zatorre et al. | When the brain plays music: auditory–motor interactions in music perception and production | |
| Fitch et al. | Perception and production of syncopated rhythms | |
| Hodges | Bodily responses to music | |
| JP2571732B2 (en) | A device that induces various human states of consciousness | |
| CN105451801B (en) | The sleep method and system for the method for sound induction | |
| Hurley et al. | Spontaneous sensorimotor coupling with multipart music. | |
| Chalfoun et al. | Subliminal cues while teaching: HCI technique for enhanced learning | |
| JPH0329668A (en) | Biofeedback system of electro-encephalogram for training voluntary controllability of human electro-encephalographic action | |
| JP2017113263A (en) | Sound source device | |
| CN104688222B (en) | EEG-based (electroencephalogram-based) tone synthesizer | |
| Leydon et al. | The role of auditory feedback in sustaining vocal vibrato | |
| WO2003005339A1 (en) | Systems and method for producing music as a function of physiological parameters | |
| CN113171534B (en) | Superposition enhancement nerve modulation method and device based on music and energy wave functions | |
| Miranda | Plymouth brain-computer music interfacing project: from EEG audio mixers to composition informed by cognitive neuroscience | |
| EP0432152B1 (en) | Apparatus for translating the eeg into music | |
| AU636287B2 (en) | Apparatus for translating the eeg into music | |
| US10857323B2 (en) | Audio signal generation device, audio signal generation method, and computer-readable storage medium | |
| JP2735592B2 (en) | A device that converts brain waves into music | |
| WO1990001897A1 (en) | Apparatus for translating the eeg into music | |
| Janata | Cognitive neuroscience of music | |
| JP2003210587A (en) | Sleep-inducing system, sleep-inducting method, psychological physiological effect-imparting-supporting device, psychological physiological effect-imparting- device, psychological physiological effect-imparting method, psychological physiological effect-imparting system, program to make computer perform the method, and computer-readable recording medium on which program to make computer perform the method is recorded | |
| Loui | Neuroscience of Musical Improvisation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MK14 | Patent ceased section 143(a) (annual fees not paid) or expired |