CN105596119B - The major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method - Google Patents
The major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method Download PDFInfo
- Publication number
- CN105596119B CN105596119B CN201610056261.4A CN201610056261A CN105596119B CN 105596119 B CN105596119 B CN 105596119B CN 201610056261 A CN201610056261 A CN 201610056261A CN 105596119 B CN105596119 B CN 105596119B
- Authority
- CN
- China
- Prior art keywords
- electrode
- frequency
- signal
- cochlea
- music
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
- A61F2/02—Prostheses implantable into the body
- A61F2/18—Internal ear or nose parts, e.g. ear-drums
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F11/00—Methods or devices for treatment of the ears or hearing sense; Non-electric hearing aids; Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense; Protective devices for the ears, carried on the body or in the hand
- A61F11/04—Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense, e.g. through the touch sense
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F11/00—Methods or devices for treatment of the ears or hearing sense; Non-electric hearing aids; Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense; Protective devices for the ears, carried on the body or in the hand
- A61F11/04—Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense, e.g. through the touch sense
- A61F11/045—Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense, e.g. through the touch sense using mechanical stimulation of nerves
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N1/00—Electrotherapy; Circuits therefor
- A61N1/02—Details
- A61N1/04—Electrodes
- A61N1/05—Electrodes for implantation or insertion into the body, e.g. heart electrode
- A61N1/0526—Head electrodes
- A61N1/0541—Cochlear electrodes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
- A61F2/02—Prostheses implantable into the body
- A61F2/18—Internal ear or nose parts, e.g. ear-drums
- A61F2002/183—Ear parts
Abstract
The invention discloses the major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method, on each basilar membrane, according to the characteristic frequency corresponding relation of musical tones, phonosensitive Whole frequency band corresponding to cupula cochleae to snail bottom is separated into the music response region for responding particular note stimulus signal；One is placed in each music response region and is used to conducting or perceive the counter electrode of the band signal, i.e., each electrode is placed in the character pair frequency band where musical tones, and the electrode is divided into two groups, is implanted into corresponding one group of electrode in bilateral cochlear respectively.The present invention implements relatively easy because electrode is arranged in bilateral cochlear, and bilateral cochlear arrangement electrode can preferably perceive music.
Description
Technical field
The present invention relates to artificial cochlea field, and in particular to enhancing music rhythm perceive the major-minor arrangement of cochlear electrode, device,
System and method.
Background technology
Hearing compensation or reconstruction mainly include hearing aids selection and artificial cave.To bilateral severe or pole severe phonosensitive
Nerve Deaf and Hard of Hearing Talents, when using audiphone 3 to 6 months without positive effect, it is contemplated that Cochlear Implantation weight
Build hearing.
Artificial cochlea implanting device is a kind of converter for the cochlear function for simulating people.It by voice signal by speech at
Reason device is transformed into electric signal, and the sensation of frequency of incoming inner ear answers position electrode, with faint stimulation mode (such as electricity, light, thermally or mechanically
Pressure etc.) directly excited auditory nerve, so as to produce the sense of hearing.Artificial cochlea device mainly divides two large divisions：Implant part (including connect
Receiving apparatus and multilead electrode) and External connecting part (including sound collector, speech processor, transmitter etc.).
According to Auditory Perception principle, the sense of hearing is to collect conducted acoustic waves, middle ear amplification acoustic vibration signal, Jin Er by external ear
Inner ear (i.e. cochlea) is organized in time, frequency by some sense of hearing ends acoustic cell (also known as hair cell) of specific frequency corresponding relation
And the exciting signal of corresponding auditory nerve is converted into intensity, through auditory nerve granting, conduction, integrated in Brainstem Auditory area, form the sense of hearing
Perceive.Artificial cochlea device is exactly the successful application of the principle, and the device, which preferably solves, at present rebuilds part hearing ability,
As human speech perceives, and for appreciating and perceiving beautiful music information, some problem also be present, have much room for improvement.
Research finds, music signal when, frequency distribution character and voice signal larger difference be present, such as Fig. 1 a- Fig. 1 b institutes
Show.For voice signal, the distinguishing characteristics of the loud part of pronunciation word is mainly shown as in spectral envelope peak Distribution, i.e. spectrum bag
Formant centre frequency position, quantity and the intensity of network, usual formant negligible amounts, main is no more than 5, but each common
The peak center frequency location that shakes is not known, each formant broader bandwidth (the harmonic spectrum peak bandwidth for comparing music), and is wherein included
Tone information；Not loud unvoiced part in speech, also mainly showed with wider spectrum energy concentration zones, such as Fig. 1 a " voice "
It is shown；In time domain, when people speaks vocal cord vibration whether and speed, show as corresponding to pitch frequency whether there is, Yi Jigao
Low, for music, excursion is smaller, is usually no more than 500Hz, but consecutive variations, the pronunciation of every section of meaning of having any different
Clip durations do not have rule.On the whole, voice signal principal character frequency is on docking end auditory nerve, to frequency resolution
It is required that it is relatively low, formant distributing position is mainly manifested in, the main sound feature of voice segments is expressed with how many individual frequency segmentation bands
It is to solve the key issue that speech perceives.Current artificial cochlea electrode quantity is usually no more than 22, although each producer's product
Electrod-array be distributed on frequency values corresponding relation and be slightly different, but be substantially in accordance with critical band or frequency masking relation is drawn
Point, voiced sound formant and voiceless sound information in speech are transmitted with such distribution of electrodes, its resolution ratio is substantially enough, if but transmitting
During music acoustic intelligence, due to the difference of music signal spectrum structure and voice spectrum, the fundamental frequency of many musical tones can not
Accurately conducted by auditory nerve, 22 electrode pairs that certain artificial cochlea's product is provided referring to table 1 answer frequency band covering and note base
Wave frequency rate covering (or leap) is generally corresponding to relation, so current cochlear implant is difficult to appreciate music information, to sound
Musicality is known bad.
Certain the artificial cochlea's product distribution of electrodes of table 1 and it is generally corresponding to relation with note fundamental frequency
For musical sound, its sound comes from certain musical instrument.All musical instruments with melody performance, its volume up-down is by sound
Symbol determines, does not include the percussion instrument without melody performance here.The same note of different instrument playings, the distribution of its signal spectrum are
Combined by other subharmonic of essentially identical fundamental wave and different amplitude distributions and formed, whole spectrum envelope is relatively flat, frequency domain
Span is more wider than voice, usually not voice signal spectrum envelope multiple formant changes obvious like that, but music signal harmonic wave
Quantity is more, and, its overtone order arrives several times up to tens times, each harmonic peaks narrower bandwidth according to note from low to high,
Peak separation is very regular, substantially by fundamental frequency multiple frequency division cloth, as shown in Fig. 1 b music signal spectrograms.The wherein base of note
Wave spectrum peak is most important, can not misplace or lack, and otherwise, rebuilds music signal and listens perception to get out of tune；And the 2nd corresponding to note, 3,4,
5th ... some higher hamonic wave peaks are waited, if lacking indivedual harmonic waves, do not interfere with Note Melodic Fragment perception, will not get out of tune, but when missing compared with
More higher hamonic waves, tonequality have significant change；From low to high, fundamental frequency excursion is very big for the note of music rhythm, from several
Ten hertz~a few KHzs, as shown in the note frequencies table in table 2.1.In addition, in time domain, the length of each note, i.e. sound
Journey, it is regular change by beat, can be encoded and be controlled by by signal time.Therefore, come for cochlear implant
Say, the perception of musical sound, the distribution of electrodes density docked with auditory nerve has direct relation.
At present, of both perception of the artificial cochlea to music be present：
1st, sound source signal is carried out after outside collection, conversion should the frequency band corresponding with cochlear electrode match, and the skill
The problem of art presently, there are be external conversion note signal by signal analysis filtering process after, each band component is being delivered to
During cochlear electrode, because current distribution of electrodes position can not be directed at the frequency area of cochlea perception music, make music frequency information wrong
Ground transmission is lost in position, is the main reason for causing implantation person to lack of proper care or can not perceive Music perception.
2nd, perception to music is realized by increasing enough number of electrodes modes in unilateral cochlear, although in theory may be used
To realize and (have Patents at present to disclose), still, it is limited to current technology limitation, unilateral cochlear is distributed excessive electrode will
Cause to be difficult in technique.
The content of the invention
To solve the shortcomings of the prior art, the present invention discloses the cochlear electrode that enhancing music rhythm perceives and arranges, is
System and method, the present invention improve i-coch sensation of frequency with reference to musical tones fundamental wave characteristic distributions by suitably increasing number of electrodes
Density is answered, using bilateral cochlear location mode, to ensuring that technique is realized and to improve perception of the single, double ear to music information effective
Fruit.
To achieve the above object, concrete scheme of the invention is as follows：
Strengthen the major-minor arrangement of cochlear electrode that music rhythm perceives, near every side basilar membrane, according to musical tones
Characteristic frequency corresponding relation, by phonosensitive Whole frequency band corresponding to cupula cochleae to snail bottom be separated into response particular note frequency field；
The electrode of the band signal, i.e., the feature band that each electrode is placed in where musical tones are placed in each frequency field
It is interior, the characteristics of using ears two-channel, electrode is divided into two groups, uses major-minor method distribution of electrodes to bilateral ear, both sides cochlea is each
Be implanted into corresponding one group of electrode, be implanted into the electrode of varying number in bilateral cochlear respectively, wherein one pick up the ears arrangement one group of electrode
For master, side supplemented by one group of electrode of another arrangement of picking up the ears, in the frequency band of setting, it is grouped and is laid out by assigned frequency interleaved
Electrod-array.Wherein, each electrode is generally corresponding to from the fundamental frequency point of different notes, and electrode is conducting electrode or stimulates electricity
Pole.
Further, when being implanted into the electrode of varying number respectively in the cochlea of both sides, side corresponds to cochlea in addition to low frequency range
Main frequency induction zone distribution " main electrode group ", totally 38, opposite side correspond to cochlea main frequency induction zone be distributed " auxiliary electrode
Group ", totally 27.
Wherein side cochlea, the main electrode group layout of distribution are：
First electrode is corresponding with the fundamental frequency of B8 notes；The fundamental frequency phase of 38th electrode and G3 notes
Corresponding, the electrode between first electrode and 38 electrodes is arranged according to note frequencies corresponding relation with setting means；
Auxiliary electrode group is implanted into opposite side cochlea, layout is：
First electrode is corresponding with the fundamental frequency of A#/Bb8 notes；The base of 27th electrode and G#/Ab3 notes
Wave frequency rate is corresponding, and the electrode between first electrode and 27 electrodes is according to note frequencies corresponding relation with setting means
Arrangement.
Further, in low frequency range, choose the corresponding frequency that represents and arrange corresponding electrode, be implanted into both sides cochlea respectively,
Both sides are distributed identical 3 electrodes.
Further, it is respectively in low frequency range, 3 electrodes：41st electrode is relative with the fundamental frequency of A1 notes
Should, the 40th electrode is corresponding with the fundamental frequency of E2 notes, and the 39th electrode is relative with the fundamental frequency of C3 notes
Should；30th electrode is corresponding with the fundamental frequency of A1 notes, and the 29th electrode is relative with the fundamental frequency of E2 notes
Should, the 28th electrode is corresponding with the fundamental frequency of C3 notes.
Strengthen the major-minor method for arranging of cochlear electrode that music rhythm perceives, comprise the following steps：
Electrode is divided into two groups, is implanted into corresponding one group of electrode in bilateral cochlear respectively, each electrode is placed in musical tones
In the character pair frequency band at place, the main centralized arrangement of electrode is in 100Hz-8000Hz main frequency induction zones, in low frequency area
Domain, choose the corresponding frequency that represents and arrange electrode；
In major-minor method, when electrode is divided into two groups that quantity does not wait, electrode is according to note fundamental wave feature frequency in snail of often picking up the ears
Rate is arranged with setting means.
Strengthen the cochlear electrode array device that music rhythm perceives, including multiple electrodes, each electrode include multiple ring-types
Electrode contacts, ring electrode contact are connected by the wire of tape insulation layer with electrode loop, and the electrode also includes parcel
The flexible covering of all electrode loops, the electrode are arranged to array according to above-mentioned electrode method for arranging.The electrode array is equipped
Put, in addition to using above-mentioned conductive material, it is also possible to which above-mentioned electricity is corresponded to using conduction light or the special material structure of heat or pressure
Pole method for arranging.
In order to preferably implement the above-mentioned electrode arrangement mode of the present invention, the invention also discloses enhancing music rhythm to perceive
Artificial cochlea system, including implant part and External connecting part, implant part and External connecting part can use radio communication connection side
Formula or wired connection mode, wherein implant part comprise at least electrode array device, and External connecting part comprises at least Sound Processor Unit
And the voice collection device being connected with processor, voice signal are obtained by voice collection device, music signal is completed by processor
The note of theme, the analysis of interval and coding, processor MIDI music encodings according to corresponding to producing musical instrument kind, pass through phase
The Processing Algorithm processing answered, is converted into snail electrode stimulating encoded signal of respectively picking up the ears, is driven through radio communication or special wireline interface,
It is sent to stimulation location.
Further, for radio communication connected mode, electrode array device and plant of the reception device as artificial cochlea
Enter part, the External connecting part of transmitter, processor and voice collection device as artificial cochlea.
Further, for wired connection mode, implant part of the electrode array device as artificial cochlea, wireline interface
As External connecting part, the signal through voice collection device collection passes for device, signal drive device, processor and voice collection device
Transport to processor, processor is sent to signal drive device, letter through decomposing, quantifying to produce corresponding signal to obtained signal
Number drive device transmits each road signal caused by driving to wireline interface device, at wireline interface device, each road signal with
Each road signal docking of implant electrode, to produce corresponding stimulus signal.
Further, implant part and External connecting part communication can be Blue-tooth communication method, infrared communication side
Formula or RF radio communication modes, wired connection mode use the attachment structure wrapped up with flexible material；Attachment structure can be that light connects
Binding structure, thermally coupled structure or mechanical connecting structure.
Strengthen the method for work for the artificial cochlea system that music rhythm perceives, comprise the following steps：
The signal gathered through voice collection device is transmitted to processor, and the sound of music signal theme is completed by processor
Symbol, the analysis of interval and coding, wherein processor can according to corresponding to producing musical instrument kind MIDI music encodings, by with pattern
Corresponding Processing Algorithm processing；
Processor determines the effective working electrode position of each note, it is determined that per side array and each according to electrode mode of operation
Electrode coded sequence；
Processor is handled by Processing Algorithm corresponding with pattern, is converted into snail electrode stimulating encoded signal of respectively picking up the ears, warp
Radio communication or the driving of special wireline interface, are sent to stimulation location.
Beneficial effects of the present invention：
The present invention provides bilateral cochlear implant electrode method for arranging, is divided by the pitch of note characteristic frequency half, corresponding musical sound
With the most frequently used frequency band of speech (about 100Hz-8000Hz), by assigned frequency interlock (i.e. major-minor method) be grouped in ears layout electrode
Array, bulk is not easy to be distributed the low end frequency area of multifrequency point, only chooses and represent frequency, be distributed in master or double sided electrode
In array, to rebuild and strengthen music and speech perception；The present invention is distributed because electrode is arranged in bilateral cochlear than unilateral cochlear
Such multi-electrode easily realizes, and this distribution of electrodes method both can unilateral adapted or bilateral adapted simultaneously, make use of double
The synergistic effect of ear phonosensitive, enables implantation person preferably to perceive music.
Distribution of electrodes after optimization, due to considering the distribution of musical sound frequency occupy-place, it is close that snail of often picking up the ears all improves electrode
Degree, Music perception can be strengthened, while this method covers original voice electrode frequency, even if any one lateral electrode work of adapted, leads to
Cross selection, the switching of outer link voice processor operating mode and sound coding strategy, it is ensured that speech perception caused by this method
The speech perception obtained not less than current distribution of electrodes method.Thus, the present invention perceives more rich to enhancing artificial cochlea
Musical sound effects there is practical significance.
Brief description of the drawings
Fig. 1 a voice signals when, frequency distribution character；
Fig. 1 b music signals when, frequency distribution character；
Fig. 2 a wireless transmission method unilateral or bilateral artificial cochlea system structured flowcharts；
Fig. 2 b wired connection mode unilateral or bilateral artificial cochlea system structured flowcharts；
Each lateral electrode system signal processing flow block diagrams of Fig. 3；
Fig. 4 is per lateral electrode array structure schematic diagram；
Fig. 5 bilaterals ear is superimposed musical sound analog synthesis signal waveform；
Oscillogram corresponding to one section of music rhythm in Fig. 6 examples of implementation.
Embodiment：
The present invention is described in detail below in conjunction with the accompanying drawings：
As the cochlea with analysis or induction frequencies composition function, hair cell (i.e. acoustic cell) on its basilar memebrane with it is last
End auditory nerve is connected, and the topology location in cochlea has corresponding relation with frequency content.If wishing, brain listens area's accurate reconstruction sound
Happy perception, cochlear implant is experienced the beautiful of music rhythm, number of electrodes should be increased and docked with corresponding auditory nerve.
But it is difficult that the present invention has bilateral cochlear using human ear and ears have superposition to feel in side cochlea implantation to be limited to excessive number electrode
Effect is answered, frequency values are selected with major-minor method, stimulating electrode is distributed on topology location in corresponding cochlea, listens god to dock end
Through.
Table 2.1 is that note frequencies correspondingly illustrate table in major-minor method, wherein, note frequencies corresponding to master medium-high frequency electrode are
Thickened portion；Note frequencies corresponding to auxiliary side medium-high frequency electrode are italicized item；The common arrangement electrode diaphone of low frequency part
Symbol frequency is that overstriking underlines part.
In major-minor method, for major-minor lateral electrode in specific arrangement, the physical relationship of electrode and note frequencies is shown in Table 3.1 and table
3.2。
Table 2.1 " major-minor method " note frequencies corresponding table (master：It is black；Auxiliary side：Italic；Low frequency shares：Black matrix+underscore)
The major-minor method master distribution of electrodes of table 3.1
The auxiliary lateral electrode distribution of 3.2 major-minor method of table
| Sequence number | Note | Centre frequency | Free transmission range |
| 27 | G#/Ab3 | 207.65 | 201.7-213.6 |
| 26 | A#/Bb3 | 233.08 | 226.4-239.8 |
| 25 | C#/Db4 | 277.18 | 269.1-285.2 |
| 24 | D#/Eb4 | 311.13 | 302.1-320.2 |
| 23 | F#/Gb4 | 369.99 | 359.4-380.6 |
| 22 | G#/Ab4 | 415.3 | 403.4-427.2 |
| 21 | A#/Bb4 | 466.16 | 452.8-479.5 |
| 20 | C#/Db5 | 544.37 | 538.3-570.5 |
| 19 | D#/Eb5 | 622.25 | 604.1-640.5 |
| 18 | F#/Gb5 | 739.99 | 718.9-761.1 |
| 17 | G#/Ab5 | 830.61 | 806.9-854.3 |
| 16 | A#/Bb5 | 932.33 | 905.7-958.9 |
| 15 | C#/Db6 | 1108.70 | 1076.3-1141.1 |
| 14 | D#/Eb6 | 1244.50 | 1208.3-1280.7 |
| 13 | F#/Gb6 | 1480.00 | 1437.5-1522.5 |
| 12 | G#/Ab6 | 1661.2 | 1613.5-1708.9 |
| 11 | A#/Bb6 | 1864.7 | 1811.1-1918.3 |
| 10 | C#/Db7 | 2217.50 | 2153.3-2281.7 |
| 9 | D#/Eb7 | 2489.00 | 2416.9-2561.1 |
| 8 | F#/Gb7 | 2960 | 2874.7-3045.3 |
| 7 | G#/Ab7 | 3322.4 | 3226.7-3418.1 |
| 6 | A#/Bb7 | 3729.3 | 3621.9-3836.7 |
| 5 | C#/Db8 | 4434.90 | 4306.5-4563.3 |
| 4 | D#/Eb8 | 4978.00 | 4833.9-5122.1 |
| 3 | F#/Gb8 | 5919.9 | 5749.5-6090.3 |
| 2 | G#/Ab8 | 6644.9 | 6454-6835.8 |
| 1 | A#/Bb8 | 7458.6 | 7245.1-7672.1 |
As shown in Fig. 2 a- Fig. 2 b, electrode is used for artificial cochlea system by the present invention when implementing, including implant part and outside
Socket part point, implant part include the electrode array device arranged in the manner described above, implant part and External connecting part radio communication
When, electrode array device is connected with reception device, and External connecting part includes transmitter, processor and the sound collection dress being sequentially connected
Put.Voice collection device transmits the signal of collection to processor, processor to being transmitted after the further processing of signal to transmitter,
Signal after processing is wirelessly sent to reception device, reception device and triggers electricity according to the signal being connected to by transmitter
The action of pole, the action of respective electrode is so that human ear can hear corresponding music signal.
When implant part and External connecting part wire communication, electrode array device is implant part, and External connecting part is included successively
Wireline interface device, signal drive device, processor and the voice collection device of connection.Voice collection device is by the signal of collection
Transmit to processor, processor after the further processing of signal to transmitting to signal drive device, and signal drive device is by after processing
Signal sent by wireline interface device to electrode array device, electrode array device is according to the signal trigger electrode received
Action, the action of respective electrode is so that human ear can hear corresponding music signal.
Wherein, the processor outside ear by the parsing to music signal, can be converted to the MIDI coded datas of music, this lattice
The data of formula can drive the stimulus signal of corresponding each path electrode.Obviously, the electrode method of more dense distribution, not only can be accurately right
Each frequency of musical tones is answered, cochlear implant is accurately obtained note harmonic information, and to phonetic feature frequency
The transmission of rate, working electrode can be determined from more dense electrode according to " mapping nearby " principle, it is corresponding to be handled using speech
Coding strategy, therefore the electrode method for arranging and system have taken into account the transmission of voice messaging, do not interfere with speech perception.But
Transmitted according to original less electrode pair musical tones using mapping, even if external Sound Processor Unit accurately parses note
Information is accorded with, internal cochlear electrode also can not accurately correspond to frequency docking auditory nerve, pass to brain, Music perception is still missing from
's.This also illustrates why current artificial cochlea can not preferably perceive music.
Experimental study also found that human ear has bilateral ear phonosensitive superimposed characteristics, and the characteristic is not only contributed to differentiate sound source, improved
Sound source direction ability, it can also integrate brain stem area audio, you can increase the loudness and superposition music rhythm and harmonic information of sound.
The signal processing flow of each lateral electrode is as shown in Figure 3 in artificial cochlea system：
Step 1：Determine each note of music, interval (similar MIDI coding informations)；
Step 2：Determine the fundamental frequency and harmonic frequency of each note；
Step 3：Music tamber is determined, adjusts coefficient correlation；
Step 4：According to electrode mode of operation, including major-minor bilateral pattern and major-minor one-sided mode, music pattern/voice
Pattern etc., the effective working electrode position of each note is determined, wherein being handled according to a variety of principles or strategy, such as critical band, note not
Point side, homonymy are corresponded to and suitably given up nearby.
Step 5：It is determined that per side working electrode position and each electrode signal coded sequence；
Step 6：Driving or transfer electron coding, generation stimulation pulse signal.
In examples of implementation, perceived effect is superimposed for music rhythm multichannel, we have done special simulation analysis, false
If artificial cochlea's optimal recovery effect is emulated up to normal human ear binaural perceptual using normal human ear.As shown in figure 5, upper,
Lower two waveforms are respectively the voice signal time domain waveform that left and right sound channels cochlea is heard, its top L channel waveform, are left ear electricity
Pole synthesis of artificial sound, the synthesis sound signal of fundamental wave and major harmonic including corresponding note；Its underpart is R channel waveform,
For auris dextra electrode synthesis of artificial sound, the synthesis sound signal of fundamental wave and major harmonic including corresponding note.Thus left and right sound
Road alternately transmits synthesis, the music for listening area to hear in brain, and it is complete, accurate that the melody of its tune, which perceives,.
The results show, two-channel technology can transmit the more subband features of music signal, can be more accurately, easily
Fundamental wave and crucial harmonic components are transmitted, in a disguised form add the electrode number of artificial cochlea.
The tone of musical tones is mainly determined by fundamental frequency, and the tone color of note then determines according to spectral characteristic, i.e. root
How much determined according to fundamental wave and harmonic wave ratio and harmonic wave.The electrode layout of this patent is exactly first all musical tones tables
It is good up to required fundamental frequency position distribution, and it is divided into two component sides arrangement, to reduce single-sided electrode number, it is difficult to reduce arrangement
Degree, is then mapped on the electrod-array of side to the fundamental wave harmony wave frequency rate of some that to be expressed notes according to certain principle, from
And ensuring that same note works in a lateral electrode, different notes can express in different lateral electrode arrays, to realize whole music
Duan Caiyong bilaterals alternately synthesize the melody processing strategy of audio.In actual corresponding conversion, expression, a few harmonics centre frequency can
On energy meeting " falling on nearby " another lateral electrode position, " homonymy is nearby " or " suitably giving up " principle in this case, can be taken
It is acted upon.
In order to better illustrate the effect that the electrode arrangement mode of the present invention is reached, The present invention gives another embodiment
Son：
Based on above-mentioned two-channel cochlear electrode method for arranging, artificial cochlea's musical sound processor is according to electrode mode of operation
And coding strategy, counter electrode stimulus signal is produced by Fig. 3 signal processing flows, wherein note is lower, in Music perception frequency band
In the range of its harmonic wave number it is more, corresponding stimulating electrode number should be more, and note is higher, and its harmonic number is fewer, effective stimulus electrode
Number is fewer.It is determined that during each note working electrode, according to critical band principle, determine each effective working electrode, i.e., fundamental wave and
Effective harmonic wave is accurate or approximation corresponding to the same side cochlea each electrode, it is such as approximate to another wherein indivedual harmonic waves may be given up
The harmonic wave of one lateral electrode.The analysis and processing work are completed by external Sound Processor Unit.
Due to different musical instrument kinds, the amplitude mutual ratios relation of its harmonic components is different, generally need to be according to musical instrument
Kind does suitable parameter adjustment.
With the working condition of prescribed electrode for one section of simple melody：
One section of music rhythm is chosen, is made up of three notes, is A3, G3, C4 successively, it is assumed that each note interval is equal, signal
Waveform is as shown in Figure 6.
The fundamental wave of note is determined first, then according to Fig. 3 handling processes and coding strategy (i.e. critical band limitation, same sound
The harmonic wave of symbol determines working electrode in homonymy, gives up not homonymy harmonic wave counter electrode etc.) processing, distribute the note fundamental wave and each
The alternate electrode of harmonic wave, as shown in table 4.1, to stimulate auditory nerve system, ensure that the music signal of same note docks regardless of side
Auditory nerve stimulates, and does not destroy each note and perceives globality.So, each note determines each working electrode in side, different
Note, may be in homonymy or not in homonymy alternation, and complete music rhythm is to be stimulated to listen god by bilateral cochlear electrod-array
The Overlay of warp obtains Music perception.
If being worked under major-minor double sided electrode pattern, the melody section A3, G3, C4, because fundamental frequency is distributed with master, then three
Individual note works on master cochlear electrode successively, specific works situation such as table 4.1.
Table 4.1 the 1st (A3), 2 (G3), 3 (C4) the notes working electrode under major-minor method bilateral pattern (successively in master)
In addition, with the development of technology, when cochlear electrode layout is not realized technique limitation, all frequencies in table 2.1
It is most ideal design to be laid out in unilateral cochlear, when all electrodes are arranged in monaural, above-mentioned artificial cochlea device and
Corresponding optimization system is still applicable.
Although above-mentioned the embodiment of the present invention is described with reference to accompanying drawing, model not is protected to the present invention
The limitation enclosed, one of ordinary skill in the art should be understood that on the basis of technical scheme those skilled in the art are not
Need to pay various modifications or deformation that creative work can make still within protection scope of the present invention.
Claims (6)
1. strengthen the major-minor arrangement array of cochlear electrode that music rhythm perceives, it is characterized in that, it is included in each frequency field and puts
The electrode for the band signal put, i.e., each electrode are placed in the feature band where musical tones；The frequency field
For near every side basilar membrane, according to the characteristic frequency corresponding relation of musical tones, by phonosensitive corresponding to cupula cochleae to snail bottom
Whole frequency band is separated into the frequency field of response particular note；
The characteristics of using ears two-channel, the electrode include two groups, and the electrode is using major-minor method arrangement to bilateral ear
Electrode, be master in one group of electrode implantation side cochlea, another group of electrode be implanted into opposite side cochlea supplemented by side, each electrode puts
In in the character pair frequency band where musical tones, the main centralized arrangement of electrode is in 100Hz-8000Hz main frequency induction zones；
In the frequency band of setting, layout electrod-array is grouped by assigned frequency interleaved；
When the electrode of varying number is implanted into the cochlea of both sides respectively, in snail of often picking up the ears electrode according to note fundamental wave characteristic frequency to set
Determine mode to arrange, side corresponds to main frequency induction zone distribution " main electrode group " of the cochlea in addition to low frequency range, totally 38, another
Side corresponds to cochlea main frequency induction zone and is distributed " auxiliary electrode group ", totally 27；
Wherein side cochlea, the main electrode group layout of distribution are：
First electrode is corresponding with the fundamental frequency of B8 notes；38th electrode is relative with the fundamental frequency of G3 notes
Should, the electrode between first electrode and 38 electrodes is arranged according to note frequencies corresponding relation with setting means；
Auxiliary electrode group is implanted into opposite side cochlea, layout is：
First electrode is corresponding with the fundamental frequency of A#/Bb8 notes；The fundamental wave frequency of 27th electrode and G#/Ab3 notes
Rate is corresponding, and the electrode between first electrode and 27 electrodes is according to note frequencies corresponding relation with setting means cloth
Put；
In low frequency range, choose the corresponding frequency that represents and arrange corresponding electrode, be implanted into both sides cochlea, both sides distribution identical respectively
3 electrodes.
2. the major-minor arrangement array of cochlear electrode that enhancing music rhythm perceives as claimed in claim 1, it is characterized in that, in low frequency
Area, 3 electrodes are respectively：The 41st electrode of main electrode group is corresponding with the fundamental frequency of A1 notes, the 40th electrode
Corresponding with the fundamental frequency of E2 notes, the 39th electrode is corresponding with the fundamental frequency of C3 notes；Auxiliary electrode group the 3rd
Ten electrodes are corresponding with the fundamental frequency of A1 notes, and the 29th electrode is corresponding with the fundamental frequency of E2 notes, and second
18 electrodes are corresponding with the fundamental frequency of C3 notes.
3. strengthen the cochlear electrode array device that music rhythm perceives, including multiple electrodes, the electrode are composition aforesaid right
It is required that the electrode in the major-minor arrangement array of cochlear electrode that any described enhancing music rhythms of 1-2 perceive, each electrode include
Multiple ring electrode contacts, ring electrode contact are connected by the wire of tape insulation layer with electrode loop, and the electrode is also
Flexible covering including wrapping up all electrode loops, the electrode are arranged to according to the method for arranging described in the claims 2
Array.
4. strengthen the artificial cochlea system that music rhythm perceives, the ear perceived using the enhancing music rhythm described in claim 3
Snail electrode array device, it is characterized in that, including implant part and External connecting part, implant part and External connecting part can use channel radio
Letter connected mode or wired connection mode, wherein implant part comprise at least electrode array device, and External connecting part comprises at least sound
Sound processor and the voice collection device being connected with processor, voice signal are obtained by voice collection device, are completed by processor
The note of music signal theme, the analysis of interval and coding, processor MIDI music according to corresponding to producing musical instrument kind are compiled
Code, is handled by corresponding Processing Algorithm, is converted into snail electrode stimulating encoded signal of respectively picking up the ears, through radio communication or special wired
Interface driver, it is sent to stimulation location.
5. the artificial cochlea system that enhancing music rhythm perceives as claimed in claim 4, it is characterized in that, connect for radio communication
Connect mode, electrode array device and implant part of the reception device as artificial cochlea, transmitter, processor and sound collection dress
Put the External connecting part as artificial cochlea；
Implant part and External connecting part communication can be Blue-tooth communication method, over the horizon communication system or RF radio communications
Mode, wired connection mode use the attachment structure wrapped up with flexible material.
6. the artificial cochlea system that enhancing music rhythm perceives as claimed in claim 4, it is characterized in that, for wired connection side
Formula, implant part of the electrode array device as artificial cochlea, wireline interface device, signal drive device, processor and sound
As External connecting part, the signal that is gathered through voice collection device transmits to processor harvester, processor to obtained signal,
Sent through decomposing, quantifying to produce corresponding signal to signal drive device, signal drive device will drive caused by each road signal
Transmit to wireline interface device, at wireline interface device, each road signal docks with each road signal of implant electrode, corresponding to produce
Stimulus signal.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610056261.4A CN105596119B (en) | 2016-01-27 | 2016-01-27 | The major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method |
| PCT/CN2016/108235 WO2017128856A1 (en) | 2016-01-27 | 2016-12-01 | Cochlear electrode arrangement, device, system and method for enhancing melody perception |
| US15/575,078 US11123550B2 (en) | 2016-01-27 | 2016-12-01 | Cochlea electrode arrangement, device, system and method for enhancing musical melody perception |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610056261.4A CN105596119B (en) | 2016-01-27 | 2016-01-27 | The major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105596119A CN105596119A (en) | 2016-05-25 |
| CN105596119B true CN105596119B (en) | 2017-11-14 |
Family
ID=55976864
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610056261.4A Active CN105596119B (en) | 2016-01-27 | 2016-01-27 | The major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105596119B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11123550B2 (en) | 2016-01-27 | 2021-09-21 | Shandong University | Cochlea electrode arrangement, device, system and method for enhancing musical melody perception |
| EP3509550A4 (en) | 2016-11-04 | 2019-08-07 | Med-El Elektromedizinische Geraete GmbH | Bilateral synchronized channel selection for cochlear implants |
| CN108261605B (en) * | 2018-02-13 | 2021-07-30 | 山东大学 | Flexible single-layer conductive microstructure artificial cochlea electrode and manufacturing method thereof |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4284856A (en) * | 1979-09-24 | 1981-08-18 | Hochmair Ingeborg | Multi-frequency system and method for enhancing auditory stimulation and the like |
| US20090024184A1 (en) * | 2007-07-17 | 2009-01-22 | Nurotron Biotechnology, Inc. | Cochlear implant utilizing multiple-resolution current sources and flexible data encoding |
| CN101564334A (en) * | 2008-04-22 | 2009-10-28 | 上海耳蜗医学科技有限公司 | Artificial cochlear device |
| US9463319B2 (en) * | 2009-09-11 | 2016-10-11 | Med-El Elektromedizinische Geraete Gmbh | Low pulse rate cochlear implant stimulation in conjunction with a separate representation of fundamental frequencies and voiced/unvoiced distinctions |
| US9352153B2 (en) * | 2011-01-24 | 2016-05-31 | Cochlear Limited | Systems and methods for detecting nerve stimulation with an implanted prosthesis |
| CN102500059A (en) * | 2011-11-21 | 2012-06-20 | 深圳市圣祥高科技有限公司 | Multi-band music electrotherapy instrument |
| US20140052217A1 (en) * | 2012-08-14 | 2014-02-20 | Cochlear Limited | Fitting Bilateral Hearing Prostheses |
| CN103190966B (en) * | 2013-03-15 | 2015-04-22 | 浙江诺尔康神经电子科技股份有限公司 | System and method of information processing for cochlear implant virtual channel for enhancing time domain information |
| AU2014302242B2 (en) * | 2013-06-28 | 2016-09-22 | Med-El Elektromedizinische Geraete Gmbh | Fast fitting for cochlear implants |
| DK2919483T3 (en) * | 2014-03-11 | 2019-07-22 | Univ London | Bilateral hearing aid system and a method for adapting a bilateral hearing aid system |
| CN104013480B (en) * | 2014-06-13 | 2016-04-13 | 山东大学 | Can artificial cochlea's acoustic nerve conducting electrode array of perception music rhythm |
| CN205515041U (en) * | 2016-01-27 | 2016-08-31 | 山东大学 | Cochlea electrode of reinforcing music melody perception is arranged, device and system |
-
2016
- 2016-01-27 CN CN201610056261.4A patent/CN105596119B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN105596119A (en) | 2016-05-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7920925B2 (en) | Optimizing pitch and other speech stimuli allocation in a cochlear implant | |
| JP4884474B2 (en) | Cochlear implant, device for generating a control signal for a cochlear implant, device for generating a combined signal, combined signal, and corresponding method | |
| US5271397A (en) | Multi-peak speech processor | |
| CN103140260B (en) | Cochlear implant stimulation with low frequency channel privilege | |
| US8295937B2 (en) | Optimizing pitch allocation in a cochlear stimulation system | |
| US20060100672A1 (en) | Method and system of matching information from cochlear implants in two ears | |
| CN100502819C (en) | Artificial cochlea manufacture method suitable for Chinese voice coding strategy | |
| CN105555354B (en) | It is used as the auditory prosthesis stimulation rate of the multiple of natural oscillation | |
| CN105596119B (en) | The major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method | |
| CN102596309A (en) | Low pulse rate cochlear implant stimulation in conjunction with a separate representation of fundamental frequencies and voiced/unvoiced distinctions | |
| JP2791031B2 (en) | Artificial hearing organ and signal processing device | |
| WO1991003913A1 (en) | Multi-peak speech processor | |
| RU2010105130A (en) | METHOD FOR STIMULATION SIGNALS GENERATION FOR AN IMPLANTABLE COCHLEAR IMPLANT ELECTRODE MATRIX (OPTIONS) AND COCHLEAR IMPLANT SYSTEM | |
| CN205515041U (en) | Cochlea electrode of reinforcing music melody perception is arranged, device and system | |
| CN105596120B (en) | Strengthen the cochlear electrode that music rhythm perceives and divide equally arrangement, device, system and method | |
| US8036753B2 (en) | Stimulation mode for cochlear implant speech coding | |
| TWI398243B (en) | Electrode simulating method and system thereof | |
| CN107708794A (en) | Selective stimulating with cochlear implant | |
| CN104013492A (en) | Cochlear implant signal processing unit and method based on auditory perception prompts | |
| CN107925829B (en) | Stimulation rate and location matched to instantaneous frequency | |
| US20110004273A1 (en) | Sound command to stimulation converter | |
| Rubinstein et al. | A novel acoustic simulation of cochlear implant hearing: effects of temporal fine structure | |
| US11123550B2 (en) | Cochlea electrode arrangement, device, system and method for enhancing musical melody perception | |
| Kallel et al. | Influence of a shift in frequency distribution and analysis rate on phoneme intelligibility in noisy environments for simulated bilateral cochlear implants | |
| CN203001232U (en) | Earplug type sound sensing assisting device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200120 Address after: Room 601, building 3, Aosheng building, 1166 Xinluo street, high tech Zone, Jinan City, Shandong Province 250101 Patentee after: JINAN USUAL LARGE TECHNOLOGY CO., LTD. Address before: 250061, No. ten, No. 17923, Lixia District, Ji'nan City, Shandong Province Patentee before: Shandong University |
|
| TR01 | Transfer of patent right |