WO2012002467A1 - Dispositif de traitement d'informations musicales, procédé, programme, système de traitement d'informations musicales pour implant cochléaire, procédé de production d'informations musicales et support pour implant cochléaire - Google Patents

Dispositif de traitement d'informations musicales, procédé, programme, système de traitement d'informations musicales pour implant cochléaire, procédé de production d'informations musicales et support pour implant cochléaire Download PDF

Info

Publication number
WO2012002467A1
WO2012002467A1 PCT/JP2011/064981 JP2011064981W WO2012002467A1 WO 2012002467 A1 WO2012002467 A1 WO 2012002467A1 JP 2011064981 W JP2011064981 W JP 2011064981W WO 2012002467 A1 WO2012002467 A1 WO 2012002467A1
Authority
WO
WIPO (PCT)
Prior art keywords
scale
cochlear implant
music information
melody
sound
Prior art date
Application number
PCT/JP2011/064981
Other languages
English (en)
Japanese (ja)
Inventor
茂良 北澤
Original Assignee
Kitazawa Shigeyoshi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kitazawa Shigeyoshi filed Critical Kitazawa Shigeyoshi
Priority to JP2012522680A priority Critical patent/JPWO2012002467A1/ja
Publication of WO2012002467A1 publication Critical patent/WO2012002467A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00—Electrotherapy; Circuits therefor
    • A61N1/02—Details
    • A61N1/04—Electrodes
    • A61N1/05—Electrodes for implantation or insertion into the body, e.g. heart electrode
    • A61N1/0526—Head electrodes
    • A61N1/0541—Cochlear electrodes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00—Electrotherapy; Circuits therefor
    • A61N1/18—Applying electric currents by contact electrodes
    • A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
    • A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
    • A61N1/36036—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation of the outer, middle or inner ear
    • A61N1/36038—Cochlear stimulation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
    • G10H1/0083—Recording/reproducing or transmission of music for electrophonic musical instruments using wireless transmission, e.g. radio, light, infrared
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0091—Means for obtaining special acoustic effects
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/18—Selecting circuits
    • G10H1/20—Selecting circuits for transposition
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/066—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/395—Special musical scales, i.e. other than the 12- interval equally tempered scale; Special input devices therefor
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/555—Tonality processing, involving the key in which a musical piece or melody is played
    • G10H2210/561—Changing the tonality within a musical piece
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/281—Protocol or standard connector for transmission of analog or digital data to or from an electrophonic musical instrument
    • G10H2240/311—MIDI transmission
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2250/00—Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
    • G10H2250/025—Envelope processing of music signals in, e.g. time domain, transform domain or cepstrum domain
    • G10H2250/031—Spectrum envelope processing
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2250/00—Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
    • G10H2250/315—Sound category-dependent sound synthesis processes [Gensound] for musical use; Sound category-specific synthesis-controlling parameters or control means therefor
    • G10H2250/455—Gensound singing voices, i.e. generation of human voices for musical applications, vocal singing sounds or intelligible words at a desired pitch or with desired vocal effects, e.g. by phoneme synthesis
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2250/00—Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
    • G10H2250/471—General musical sound synthesis principles, i.e. sound category-independent synthesis methods
    • G10H2250/481—Formant synthesis, i.e. simulating the human speech production mechanism by exciting formant resonators, e.g. mimicking vocal tract filtering as in LPC synthesis vocoders, wherein musical instruments may be used as excitation signal to the time-varying filter estimated from a singer's speech
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/60—Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles
    • H04R25/604—Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles of acoustic or vibrational transducers
    • H04R25/606—Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles of acoustic or vibrational transducers acting directly on the eardrum, the ossicles or the skull, e.g. mastoid, tooth, maxillary or mandibular bone, or mechanically stimulating the cochlea, e.g. at the oval window

Definitions

  • the present invention relates to a music information processing apparatus, method, program, music information processing system for cochlear implant, music information manufacturing method and medium for cochlear implant, and in particular, for providing sound such as music to a cochlear implant wearer.
  • the present invention relates to a music information processing apparatus, method, program, cochlear implant music information processing system, cochlear implant music information manufacturing method, and medium.
  • the cochlear implant is provided with a plurality of electrodes in the cochlea, and the voice information sampled through the microphone is classified into channels for each frequency band using a plurality of band pass filters. Then, the audio information for each channel is sent to the electrode as a stimulation command corresponding to the channel to generate an electrical stimulation pulse, and this stimulation pulse is given to the cochlea to reinforce hearing (for example, Reference 1: See US Pat. No. 5,597,380). Specifically, voice conversion is performed in which voice information is converted into stimulation pulses by a voice processor provided in the cochlear implant. As a result, it has become possible for a cochlear implant wearer to recognize words without using reading together.
  • the cochlear implant wearer can recognize words without using reading together, but it recognizes speech such as conversation and has not yet recognized music. For example, when listening to music, there is a case where it cannot be recognized as music as a result of voice conversion by the cochlear implant. This is because, in the cochlear implant, electrical stimulation by a plurality of electrodes provided in the cochlea is due to sound conversion on the premise of sound, and the frequency band of sound information corresponding to the plurality of electrodes is discrete and limited. This is considered to be biased toward a typical frequency range.
  • the present invention has been made in consideration of the above facts, and a music information processing apparatus, method, program, and cochlear implant music that can improve recognition when a cochlear implant wearer listens to music or the like.
  • An object is to provide an information processing system, a method for producing music information for a cochlear implant, and a medium.
  • an electrical stimulation pulse is generated by providing a plurality of electrodes in a cochlea and sending a sound signal corresponding to an input sound to each of the electrodes as a stimulation command. Then, for the cochlear implant that gives the input sound as the stimulation pulse to the cochlea, input means for inputting music information including a melody in which a plurality of musical sounds are continuous, and a main melody from the music information input by the input means.
  • Extracting means for extracting, dividing the main melody in predetermined units, analyzing the scale and pitch constituting the divided melody for each of the divided divided melody, and the scales of the scales arranged in time series of the divided melody
  • Analyzing means for obtaining a scale set consisting of a sequence of pitches and a pitch sequence of pitches, and each electrode provided in the cochlear implant that is in charge of a predetermined frequency band, depending on the frequency represented by the frequency band Associating floors, and making the group of electrodes of the plurality of electrodes as a cochlear implant scale, including the cochlear implant scale, and based on a scale map indicating a sequence of scales according to the magnitudes of fundamental frequency components of a plurality of musical sounds, Transposing means for transposing the scale set so as to include many different scales included in the cochlear implant scale while maintaining the pitch sequence of the scale set substantially, and using the transposed scale set as an extended scale set, the obtained Provided is a music information processing apparatus comprising: conversion means
  • the main melody from music information such as MIDI data by the extracted MIDI is divided by a predetermined unit such as a predetermined time, measure or phrase,
  • the scale and pitch are analyzed with respect to the divided melody, and a scale set including a scale sequence of pitches and a pitch sequence of pitches arranged in time series is obtained.
  • the scale set is transposed so as to include many different scales included in the cochlear implant scale while substantially maintaining the pitch sequence of the obtained scale set.
  • This transposed scale set is defined as an extended scale set.
  • a plurality of scale sets including the cochlear implant scale are searched, and the transposed scale set including the largest number of different scales included in the cochlear implant scale is set as the extended scale set.
  • the transposed scale set including the largest number of different scales included in the cochlear implant scale is set as the extended scale set.
  • the cochlear implant generates the stimulation pulse by classifying sounds into channels for each frequency band using a plurality of band pass filters and sending signals to the electrodes for each corresponding channel.
  • the input means inputs music information further including lyric information along the melody
  • the output means inputs lyric information along the melody to the converted extended scale set. Is provided as an extended scale set.
  • music information further including lyric information along the melody is input, and information in which the lyric information along the melody is associated with the converted extended scale set is output as an extended scale set.
  • the third aspect of the present invention provides a music information processing apparatus further comprising sound generating means for generating a musical sound based on an expanded scale set output from the output means and generating a generated musical sound.
  • a musical tone is generated by generating a musical tone based on the extended scale set output from the output means.
  • the fourth aspect of the present invention provides a music information processing apparatus further comprising transmission means for generating musical sound data based on the extended scale set output from the output means and transmitting the generated musical sound data.
  • the musical sound data is generated based on the extended scale set output from the output means, and the generated musical sound data is transmitted. Accordingly, music can be provided to the cochlear implant wearer by at least one of wireless communication and wired communication. Note that data communication is preferable for communication in this case.
  • an electrical stimulation pulse is generated by providing a plurality of electrodes in the cochlea and sending a sound signal corresponding to an input sound as a stimulation command to each of the electrodes.
  • the cochlear implant that gives the cochlea as the stimulation pulse, an input process for inputting music information including a melody in which a plurality of musical sounds are continuous, and an extraction process for extracting the main melody from the music information input by the input means; Divide the main melody by a predetermined unit, and for each of the divided divided melody, analyze the scale and pitch that constitute the divided melody, and the scale sequence and the pitch of the pitch arranged in the time series of the divided melody
  • An analysis step for obtaining a scale set consisting of a sequence, and each electrode provided in the cochlear implant that is in charge of a sound in a predetermined frequency band, and a scale corresponding to a frequency representative of the frequency band, Based on a scale map that includes a scale group of a plurality of electrodes as a coch
  • an electrical stimulation pulse is generated by providing a plurality of electrodes in the cochlea and sending a sound signal corresponding to an input sound as a stimulation command to each of the electrodes.
  • the scale set is based on a scale map that includes the artificial inner ear scale and indicates the arrangement of the scale
  • a transposition step in which the scale set is transposed so as to include many different scales included in the cochlear implant scale, and the transposed scale set is an extended scale set, and the obtained extended scale is maintained.
  • a music information processing program including a conversion step for converting a scale sequence of a set so as to correspond to a scale included in a predetermined voice band, and an output step for outputting the converted extended scale set.
  • a plurality of electrodes are provided in the cochlea, and an electrical stimulation pulse is generated by sending a sound signal corresponding to the input sound as a stimulation command to each of the electrodes, and the input sound
  • a cochlear implant device that supplies the cochlea as a stimulation pulse and the music information processing device is provided.
  • an electrical stimulation pulse is generated by providing a plurality of electrodes in the cochlea and sending a sound signal corresponding to the input sound as a stimulation command to each of the electrodes.
  • the cochlear implant that gives the cochlea as the stimulation pulse, an input process for inputting music information including a melody in which a plurality of musical sounds are continuous, and an extraction process for extracting the main melody from the music information input by the input means; Divide the main melody by a predetermined unit, and for each of the divided divided melody, analyze the scale and pitch that constitute the divided melody, and the scale sequence and the pitch of the pitch arranged in the time series of the divided melody
  • An analysis step for obtaining a scale set consisting of a sequence, and each electrode provided in the cochlear implant that is in charge of a sound in a predetermined frequency band, and a scale corresponding to a frequency representative of the frequency band, Based on a scale map that includes a scale group of a plurality of electrodes as a co
  • an artificial sound that generates a musical sound that can be reproduced by a playback device based on the converted extended scale set and manufactures the generated musical sound as music information for a cochlear implant.
  • a method for producing music information for the inner ear is provided.
  • the input step inputs music information further including lyric information along the melody
  • the manufacturing step includes lyric information along the melody in the converted extended scale set.
  • a method for producing cochlear implant music information for producing cochlear implant music information is provided using the information associated with the above as an extended scale set.
  • the eleventh aspect of the present invention provides a recording medium on which the manufactured music information for a cochlear implant is recorded.
  • music data is converted into cochlear implant data, and sound based on the converted data is generated. is there.
  • data MIDI data
  • MIDI Musical Instrument Digital Interface
  • FIG. 1 is a schematic configuration diagram of a music information processing apparatus 10 according to the present embodiment.
  • the music information processing apparatus 10 includes a sound source device 12 that outputs MIDI data, a music information processing apparatus main body 14, an audio information processing apparatus 22, an acoustic signal generator 24, and a speaker 26.
  • the music information processing apparatus main body 14 is configured by a computer including a CPU, ROM, and RAM, and functions as a music analysis unit 16, a transposition processing unit 18, and a scale map 20 by executing a music information processing program to be described later. Is included.
  • the music data converted from the MIDI data by the music information processing apparatus 10 is provided as a musical sound by the speaker 26 and provided to the cochlear implant device 30. The case where the cochlear implant device 30 is used as it is will be described.
  • the music information processing apparatus main body 14 of the music information processing apparatus 10 is a read / write device that accesses various recording buttons (not shown) and recording media such as a flexible disk, CDROM, and DVD disk, and writes and reads data. Can be provided. Various types of information used for processing to be described later may be read from and written to a storage device (not shown) in the music information processing apparatus main body 14 or read from and written to a read / write device (not shown).
  • the sound source device 12 is a device that outputs music information such as MIDI data for creating music for a cochlear implant user.
  • the music information processing apparatus main body 14 is an apparatus that converts music information such as MIDI data into data for a cochlear implant user. Specifically, as described later, the main melody is extracted from the music information such as the acquired MIDI data, and the music analysis (scale) is performed for each divided melody obtained by dividing the main melody by a predetermined division unit (measure, phrase, time, etc.). And musical interval analysis) to obtain a musical scale set composed of musical scale sequences and musical pitch sequences. Then, the scale set is used to convert (transpose) the scale using the extended cochlear implant scale while maintaining the pitch of the original music so that the cochlear implant wearer can recognize the melody of the music. Execute.
  • the voice information processing device 22 is a device that creates vocal music based on music information including lyrics data and outputs it to the acoustic signal generator 24.
  • the audio information processing apparatus 22 does not necessarily need to be provided as a configuration. That is, the configuration may be such that the data for the cochlear implant user converted by the music information processing apparatus main body 14 is output to the acoustic signal generator 24 without providing the audio information processing apparatus 22.
  • the acoustic signal generator 24 is a device that operates the speaker 26 at a pitch of each scale, converts an inputted scale set into an electrical signal that drives the speaker 26, and outputs a signal so that the speaker 26 operates. .
  • the speaker 26 is a device that provides a musical sound by a drive signal from the acoustic signal generator 24.
  • a console 15 can be connected to the music information processing apparatus main body 14.
  • the console 15 is connected to the music information processing apparatus main body 14 by wire, wireless, light, etc., and is used for data input and information display.
  • the console 15 can be operated by a specialist or a trained cochlear implant user himself and can adjust the cochlear implant scale and the extended cochlear implant scale of the cochlear implant wearer.
  • the console 15 can perform analysis from the extraction of the main melody to create a scale set. Thereby, the favorite music suitable for the cochlear implant wearer's own image can be produced.
  • the cochlear implant device 30 shown in FIG. 2 includes an external device 32 that is worn outside the body and an internal device 34 that is embedded inside the body.
  • the cochlear implant device 30 reinforces hearing by applying an electrical stimulation pulse to the cochlea 48.
  • the external device 32 includes a microphone 36 that captures external sound as an electrical signal, and a sound processor 38 that programmatically performs sound processing for converting sound information sampled via the microphone 36 into a stimulation command.
  • an external coil 40 constituting an antenna outside the body, and the internal device 34 is sent from the voice processor 38 via the internal coil 42 constituting the antenna inside the body and the external coil 40 and the internal coil 42.
  • a stimulation unit 44 that converts a stimulation command that is sound information into an electrical stimulation pulse, and an electrode array 46 that is provided in the cochlea 48 and includes a plurality of electrodes that actually output the stimulation pulse.
  • the current generated by each electrode stimulates the end of the auditory nerve and is perceived as sound.
  • 22 electrodes of the electrode array 46 are provided and can be used properly according to the state of the user.
  • the electrodes 46-01 to 46-22 divide the entire audible sound range into M (M is a natural number) bands to form channels and correspond to the channels.
  • M is a natural number
  • this embodiment demonstrates the case where 22 electrodes are provided, a use aspect is not restricted to this.
  • 17 may be provided.
  • the description will be given of the case where 20 electrodes are used without using the electrodes 46-01 and 02 corresponding to the high frequency band channel among the 22 electrodes. The embodiment is not limited to this.
  • FIG. 3 is a correspondence diagram showing an example of the relationship between electrodes and bands in the cochlear implant device 30 targeted by the music information processing apparatus 10 according to the present embodiment.
  • the 22nd electrode 46-22 is an electrode of the channel 22 and has a center frequency of about 200 Hz and takes charge of a band of about 120 Hz to about 280 Hz.
  • the sound processor 38 includes this band pass filter.
  • the other electrodes also correspond to those in FIG.
  • the scale of the sound corresponding to the center frequency of the band-pass filter or the nearby sound is the scale corresponding to the electrode, and can be regarded as the cochlear implant scale.
  • the cochlear implant scale with 20 electrodes is a series of musical sounds (G3, F4, C5, E5, G # 5, C6, D6, E6, F # 6, A6, B6, D7, E7, G7, A7, C8, D # 8, F # 8, A8, B8).
  • G3, F4, C5, E5, G # 5, C6, D6, E6, F # 6, A6, B6, D7, E7, G7, A7, C8, D # 8, F # 8, A8, B8) are biased toward the high frequency band, they are unsuitable for expressing music in the artificial inner ear scale as it is due to the inner ear scale.
  • ⁇ Extended cochlear implant scale> By the way, the present inventor has conducted various experiments to measure the hearing ability using the center frequency of the bandpass filter group and the corresponding vibration sound, or to generate musical sound by applying it and to play the music. It was. At this time, it has been considered that a cochlear implant wearer can listen to music with 20 cochlear implant scales, but the present invention has the knowledge that it can be presumed that the music is being listened to more like music from various experiments. One got. This is based on a delicate sensory result that scale groups belonging to the same channel are difficult to distinguish from each other, but not at all. Therefore, we adopted an extended cochlear implant scale that includes all scales.
  • FIG. 4 is a correspondence diagram showing the extended cochlear implant scale by the bandpass filter of the voice processor.
  • This extended cochlear implant scale is composed of the center frequency of each bandpass filter and the sound of the corresponding scale (sounds of any of the possible scales of each channel, ie the scales that apply within the band of each bandpass filter, FIG. The number of sounds in the Semitone column corresponding to the scale).
  • the sound of the scale corresponding to this center frequency refers to a set of sounds that can be selected and determined as appropriate by combining them so as to match the tune of the music. As shown in FIG.
  • the 22nd electrode 46-22 is an electrode of the channel 22 and has a center frequency of about 200 Hz and takes charge of a band of about 120 Hz to about 280 Hz.
  • This channel 22 corresponds to 15 sounds of scales 2B to 4C #.
  • the cochlear implant scale is represented as G3
  • the extended cochlear implant scale is represented as 3G (English characters / symbols and numbers are reversed).
  • a musical tone includes a number of harmonic components together with a fundamental frequency component corresponding to the height. That is, it is necessary that the fundamental frequency component is relatively dominant in auditory sense. Therefore, a sequence of musical sounds in which fundamental frequency components that can be captured by a cochlear implant wearer are arranged at appropriate intervals is defined as a cochlear implant scale. For a cochlear implant wearer, it can be interpreted fairly flexibly that the fundamental frequency is relatively auditory-sensitive.
  • FIG. 5 shows a sequence of musical sounds (G3, F4, C5, E5, G # 5, C6, D6, E6, F # 6, A6, B6, D7, E7, G7, A7, C8, D # 8, F #).
  • A8, B8) are scales having a frequency of fundamental frequency ⁇ (1/2, 1/3, 1/4, 1/6, 1/8) when the cochlear implant scale is used. . Note that 1/5 and 1/7 are not used because they are not compatible with Western music sequences consisting of 12 scales. In FIG. 5, numerical values are applied in the cells so as to increase by “1” as the semitone is increased.
  • cochlear implant scales (G3, F4, C5, E5, G # 5, C6, D6, E6, F # 6, A6, B6, D7, E7, G7, A7, C8, D # 8, F #).
  • the cells of (8, A8, B8) are surrounded by thick lines. In terms of numerical values in the cell, they are 43, 53, 60, 64, 68, 72, 74, 76, 78, 81, 83, 86, 88, 91, 93, 96, 99, 102, 105, 107.
  • the scale having a frequency of ⁇ 1/2 is a sound one octave (12 semitones) lower, and it is only necessary to move to the cell adjacent to the left by one.
  • a scale with a frequency of x1 / 3 is 19 semitones lower, a scale with a frequency of x1 / 4 is 2 octaves lower (24 semitones), and a scale with a frequency of x1 / 6 is A scale that is 31 semitones lower and has a frequency of 1/8 is a sound that is 3 octaves lower (36 semitones). Therefore, the cochlear implant scale can be expanded. Furthermore, in the present embodiment, the above-described extended cochlear implant scale is applied to expansion by harmonics.
  • the voice range is about 80 to 470 Hz for men and about 250 to 1100 Hz for women.
  • “28” to “58” correspond to the values in the cell for males
  • “48” to “72” correspond to the values for the females in the cell.
  • voice ranges common to males and females correspond to values “48” to “58” in the cell.
  • the relationship between the above-described electrode and the bandpass filter is not limited to this, and a channel and a scale may be appropriately selected and designated in accordance with the speech processor of the target cochlear implant device.
  • the music information processing apparatus main body 14 acquires MIDI data indicating the original song “Sakura Sakura” from the sound source device 12 as music information.
  • the main melody is extracted from the acquired MIDI data.
  • MIDI data has a large number of identification data
  • the main melody can be automatically extracted with reference to the identification data.
  • the main melody can be extracted from other MIDI data by extracting the melody of the instructed MIDI data in accordance with a melody instruction from an input means (not shown).
  • the music software having a musical score GUI may be used to instruct and extract the melody.
  • the conversion target period is a division unit for dividing a music piece into a plurality of time series and sequentially converting the music piece.
  • the division unit includes a measure, a phrase, and time. These division units can be determined by predetermined setting values. For example, a setting value indicating one measure unit for dividing the main melody by one measure unit, a setting value indicating a phrase unit for dividing by a phrase unit, and a setting value indicating a predetermined time for dividing every predetermined time may be adopted. it can.
  • As the set value a value stored in advance in the music information processing apparatus main body 14 can be read, or an input value by the input device can be read.
  • any one divided melody (unit melody) divided by the set conversion target period (divided unit) is selected and extracted.
  • This selection may be made sequentially according to the time series of the main melody, or an arbitrary divided melody may be selected.
  • An arbitrary divided melody can be selected according to the size of the processing load due to the similarity between the divided melody. For example, it is possible to reduce the number of processes by selecting and extracting any one of the divided melodies having high similarity as the representative divided melodies and substituting the divided melodies having high similarity with the representative divided melodies.
  • the most preferable example of the division melody having high similarity is the case where the division melody matches.
  • step 108 music analysis is performed on the divided melody.
  • This music analysis analyzes which scale is used for the division melody and how much the pitch is. For example, if the musical piece “Sakura Sakura” as an example is divided into phrases, the scales used are 4B, 5C, 5E, 5F, 5A, 5B, 6C, and 1, 4, 1, 4, 2, 1 semitone There is a division melody that is.
  • the scales “4B, 5C, 5E, 5F, 5A, 5B, 6C” arranged in time series are set as a scale sequence, and the intervals “1, 4, 1, 4, 2, 1” are set as a pitch sequence. Find a scale set consisting of columns.
  • step 110 conversion processing (FIG. 7) is executed using the above scale set.
  • the process of step 110 is a process of transposing the scale while maintaining the pitch of the original music so that the cochlear implant wearer can recognize the melody of the music.
  • the scale set of the division melody is the scale sequence “4B, 5C, 5E, 5F, 5A, 5B, 6C” and the pitch sequence “1, 4, 1, 4, 2, 1”.
  • the pitch of the conventional cochlear implant scale is "10, 7, 4, 4, 4, 2, 2, 2, 3, 2, 3, 2, 3, 2, 3, 3, 3, 2" semitones .
  • the upper two sounds and the lower one are not used because the pitch of the cochlear implant wearer is poor.
  • the pitch of the pitch sequence “2, 2, 2, 3, 2, 3” semitones That is, it is converted into a scale sequence “6C, 6D, 6E, 6F #, 6A, 6B, 7D”.
  • the scale corresponds to the center frequency of the electrode, which is the channel, the original music information is lost, which is insufficient for musical expression. That is, since all the melodies are individually assigned to stimulate different electrodes, the cochlear implant wearer can recognize the tendency of the pitch associated with the music melodies.
  • the pitch was changed only with the cochlear implant scale, so there was a slight sensation. Therefore, in this embodiment, further conversion (transposition) is performed using the extended cochlear implant scale.
  • step 200 the scale set of the divided melody obtained as described above is read in step 200, and transposition processing is executed in the next step 202.
  • the transposition process is a process of searching for a pitch sequence that contains the most musical scales corresponding to stimulating different electrodes that are close to the pitch sequence of a certain phrase of the music and that have different pitch sequences. Stimulating this different electrode is confirmed with reference to the augmented cochlear implant scale of FIG. That is, as the first process, while maintaining the pitch of the music, the transposition is performed so as to stimulate as many different pitches as possible. As a second process, when different pitches are overlapped with the same electrode, they are associated with different electrodes with the minimum pitch shift. At this time, as a third process, when the electrodes are associated with different electrodes, the musical scale is determined so as to cross between the electrodes, that is, the musical scale is continuous between the adjacent electrodes.
  • the transposition processing may be performed in the order of the first processing, the second processing, and the third processing, but may shift from the first processing to the third processing.
  • a process of giving priority to the pitch of the music (original music) and assigning it to the extended cochlear implant scale is executed.
  • the scale sequence “6C, 6C #, 6F, 6F #, 6A #, 7C, 7C #” and the pitch sequence “1, 4, 1, 4, 2, 1” can be converted. it can. That is, since all melodies are individually assigned to stimulate different electrodes, the cochlear implant wearer can recognize the music melodies. Since only the cochlear implant scale changes the pitch, there was a slight sensation of impression, but the extended cochlear implant scale does not have it at all.
  • the scale sequence “6C, 6D, 6E, 6F #, 6A, 6B, 7D” and the pitch sequence “2, 2, 2, 3, 2” are performed by the first and second processes. , 3 ".
  • the third sequence is converted into the scale sequence “6C, 6C #, 6F, 6F #, 6A #, 7C, 7C #” and the pitch sequence “1, 4, 1, 4, 2, 1”. . That is, all melodies are individually assigned to stimulate different electrodes and the scale is maintained, so that the cochlear implant wearer can recognize the music melodies. With this transposition processing, the extended cochlear implant scale disappeared completely due to the somewhat timid impression of changing the pitch of only the cochlear implant scale.
  • transposition is performed so that many pitches stimulate different electrodes while maintaining the pitch of the music, and when different pitches overlap the same electrode, the minimum pitch shifts to different electrodes. Matched.
  • it is preferable to define a continuous scale so that the scales extend between the electrodes, that is, the scales are continuous between adjacent electrodes.
  • FIG. 8 is an explanatory diagram of improvements in transposition processing.
  • the transposition process which is the first and second processes described above is denoted as transposition 1, and the transposition process by the improved third process is denoted as transposition 2.
  • transposition process of transposition many pitches are transposed so as to stimulate different electrodes, but there are places where the pitches are separated from the original music. Therefore, in the transposition process of transposition 2, first, a musical scale is selected from the musical scale group belonging to each electrode (each channel) so as to maintain the pitch of the original music as much as possible. And at the time of this selection, a musical scale is defined so that a musical scale may straddle between adjacent electrodes (continuous).
  • the scale sequence “6C, 6C #, 6F, 6F #, 6A #, 7C, 7C #” is determined.
  • This is a feature of the present invention that employs an extended cochlear implant scale and is achieved by selecting a plurality of possible sounds from any of the scales that apply within each channel or band of each bandpass filter.
  • the electrode stimulated by the scale set of the scale set by the transposition process of the transposition 1 and the electrode stimulated by the scale series of the scale set by the transposition process of the transposition 2 match.
  • the pitch sequence by the scale set by the transposition process of transposition 2 becomes the pitch sequence “1, 4, 1, 4, 2, 1”, which is improved from the pitch sequence by the scale set by the transposition process of transposition 1, It became close to the pitch sequence (in this case, it was a complete match).
  • the music for the cochlear implant closer to the original music could be provided. This greatly contributes to selecting an arbitrary scale that can maintain the pitch from a plurality of scales belonging to the same electrode.
  • determining the scale so that the scale is continuous between adjacent electrodes also greatly contributes.
  • This voice matching process is a process of extending the cochlear implant scale by harmonics. In other words, it is a process of moving to an integral multiple of the frequency component of the pitch height or a pitch of 1 / integer pitch by the effect of harmonics and subharmonics. That is, the scale sequence (melody) associated with the extended cochlear implant scale is moved to fall within the range of male voice or female voice. This is to move the scale to a scale having a frequency of fundamental frequency ⁇ (1/2, 1/3, 1/4, 1/6, 1/8).
  • the scale sequence becomes “4C, 4D, 4E, 4F #, 4A, 4B, 5D” Listen as normal music.
  • the scale sequence becomes “4C, 4C #, 4F, 4F #, 4A #, 5C, 5C #”. Listening as normal music.
  • the scale set by the scale sequence stored in the range of the male voice or female voice as described above is determined as the extended scale set, and this routine is terminated.
  • this routine is terminated.
  • step 112 in FIG. 6 it is determined in step 112 in FIG. 6 whether there is a remaining divided melody. If there is a divided melody that has not undergone transposition processing, an affirmative decision is made in step 112, the process returns to step 106, and the above processing is repeatedly executed.
  • Step 114 the extended scale set is output and this processing routine is terminated.
  • the extended scale set is converted into an electric signal for driving the speaker 26 by the acoustic signal generator 24, and the speaker 26 is operated.
  • the speaker 26 is operated at the pitch of each musical scale, musical sounds including not only a frequency component having a height corresponding to the pitch but also harmonics and subharmonics are provided to the cochlear implant device 30. Thereby, the cochlear implant wearer can perceive music.
  • the cochlear implant wearer can be made to listen to music.
  • any voice can be satisfactorily heard as long as it is voice. It is not limited to the prosody at the time of discourse, but listening to the singing voice is sufficiently good.
  • the vocal range of the singing is about 80 to 470 Hz for male voices and 250 to 1100 Hz for female voices in the scale diagram shown in FIG. 5. Is preferably assigned to. By assigning the lower scale in the range of each gender, good results have been obtained that the cochlear implant wearer has improved in listening to music.
  • the music information processing apparatus main body 14 may acquire lyrics data indicating the lyrics of the music as music information together with the MIDI data indicating the music from the sound source device 12 (step 100).
  • the music information including the lyrics data is provided to the voice information processing apparatus 22.
  • the voice information processing device 22 creates vocal music based on the music information including the lyrics data and outputs it to the acoustic signal generator 24.
  • the acoustic signal generator 24 is converted into an electric signal for driving the speaker 26 by voice music, and the speaker 26 is operated.
  • the audio information processing apparatus 22 is not necessarily required to be provided as a configuration. Therefore, the following three types of data may be input to the acoustic signal generator 24.
  • the first is a case where only the extended scale set is inputted from the music information processing apparatus main body 14 as a scale set by a scale sequence stored in the range of male voice or female voice. In this case, the extended scale set is converted into an electric signal for driving the speaker 26 by the acoustic signal generator 24.
  • music information including lyrics data is provided to the voice information processing apparatus 22 instead of outputting the music information to the acoustic signal generator 24.
  • the voice information processing apparatus 22 creates vocal music based on the music information including the lyrics data and outputs it to the acoustic signal generator 24. Then, the voice signal is converted into an electric signal for driving the speaker 26 by the acoustic signal generator 24.
  • an extended scale set is input from the music information processing apparatus main body 14 to the acoustic signal generator 24, and vocal music created based on music information including lyrics data is input from the voice information processing apparatus 22.
  • the acoustic signal generator 24 converts the vocal music together with the extended scale set into an electric signal for driving the speaker 26. Switching between these three types of data input may be set in advance, or one of the first to third may be selected. For this selection, a selection switch can be provided in the path of the acoustic signal generator 24 or the music information processing apparatus main body 14 or the acoustic signal generator 24 and the music information processing apparatus main body 14.
  • transposition is performed so as to stimulate different electrodes using the extended cochlear implant scale, so that it is possible to obtain a scale sequence and a pitch sequence that substantially maintain the pitch of the original music.
  • Music can be provided so that can recognize the melody of music. In addition, even a normal hearing person can listen to the music without a sense of incongruity.
  • the music information processing apparatus main body 14 acquires MIDI data indicating the original music from the sound source apparatus 12 as music information has been described.
  • the present invention is not limited to this, and at least the melody. Any music data may be used.
  • the sound source device 12 includes a sound input device such as a microphone and an analog-digital conversion device.
  • the sound input device such as a microphone collects the original sound of the music, converts the original sound into digital data, and outputs the digital data. It may be.
  • a receiving device that receives a signal from the transmitting device is provided in the vicinity of the microphone 36 of the cochlear implant device 30, and the receiving device is provided with a speaker, and the musical sound generated by the received signal is operated at a pitch of each scale.
  • the cochlear implant wearer can perceive music by wireless communication. It is also possible to directly transmit stimulus instructions directly.
  • the music information processing apparatus 10 and the cochlear implant device 30 are separately configured has been described in the present embodiment, the music information processing apparatus 10 may be incorporated in the voice processor 38 and processed by the voice processor 38. Good.
  • this embodiment demonstrated the case where the extended cochlear implant scale shown in FIG. 4 was used, it is not limited only to this extended cochlear implant scale. For example, a plurality of different extended cochlear implant scales may be prepared and any one of them may be selected.
  • a plurality of different augmented cochlear implant scales are stored in an external device (for example, an external memory or a storage device such as a file barber on the Internet), and the music information processing apparatus 10 is expanded artificially by wireless communication or wired communication.
  • the inner ear scale may be obtained.
  • the sound processor 38 may obtain the extended cochlear implant scale by wireless communication or wired communication.
  • an extended cochlear implant scale suitable for listening to the wearer of the cochlear implant device 30 can be selected.
  • the wearer of the cochlear implant device 30 feels the music with a difference and can listen as if it was arranged.
  • necessary operations and settings can be confirmed from the outside of the cochlear implant device 30 by an operation console 15 that can be appropriately connected to the built-in music information processing device 10.
  • the music information converted from the MIDI data by the music information processing apparatus 10 is provided as a musical sound by the speaker 26 and provided to the cochlear implant device 30.
  • the present invention is not limited to this. Is not to be done.
  • the computer can function as a music information processing apparatus or a music information processing apparatus body.
  • the above-described music information processing program is stored in a recording medium to be executed by a computer, and the music information processing program is executed from the recording medium to function as a music information processing apparatus or a music information processing apparatus main body.
  • the music information processing program can be installed on the computer from the recording medium, and the music information processing program can be executed on the computer to function as the music information processing apparatus or the music information processing apparatus body.
  • music information for a cochlear implant can be produced from music information as music generally used by a normal hearing person. That is, by providing a plurality of electrodes in the cochlea and sending a sound signal corresponding to the input sound as a stimulation command to each electrode, an electrical stimulation pulse is generated and the input sound is given to the cochlea as the stimulation pulse
  • music information for the cochlear implant can be manufactured by a method including an input process, an extraction process, an analysis process, a transposition process, a conversion process, and a manufacturing process.
  • music information including a melody in which a plurality of musical sounds are continuous is input.
  • the extraction step extracts the main melody from the music information input by the input means.
  • the analyzing step divides the main melody by a predetermined unit, analyzes the scale and pitch that constitute the divided melody for each of the divided divided melody, and stores a scale sequence of scales arranged in a time series of the divided melody A scale set consisting of a pitch sequence of pitches is obtained.
  • each electrode provided in the cochlear implant that is in charge of sound of a predetermined frequency band is associated with a scale corresponding to a frequency represented by a frequency band, and the scale group of the plurality of electrodes is set as a cochlear implant scale, Included in the cochlear implant scale while substantially maintaining the pitch sequence of the scale set, based on a scale map that includes a cochlear implant scale and that indicates the arrangement of scales according to the magnitudes of the fundamental frequency components of a plurality of musical sounds
  • the scale set is transposed so as to include many different scales, and the transposed scale set is set as an extended scale set.
  • the converting step converts the scale sequence of the obtained extended scale set so as to correspond to a scale included in a predetermined voice band.
  • the manufacturing process manufactures the converted extended scale set as music information for the cochlear implant.
  • a musical sound that can be reproduced by a reproduction device is generated based on the converted extended scale set, and the generated musical sound can be manufactured as music information for the cochlear implant.
  • the manufactured cochlear implant music information can generate musical sounds with a loudspeaker, a playback device, etc., and can provide music to a normal hearing person without discomfort, and can provide music to a wearer of the cochlear implant apparatus without discomfort.
  • Music information for cochlear implants can be produced.
  • music information further including lyric information along the melody is input, and in the manufacturing step, information relating the lyric information along the melody to the converted extended scale set is set as an extended scale set.
  • Music information for cochlear implants can be produced. Since the manufactured music information for the cochlear implant can be manufactured as lyric information including not only the melody but also the lyrics, the music information for the cochlear implant can be provided as the music accompanied by the lyrics.
  • the produced recording medium on which the cochlear implant music information is recorded can easily provide the cochlear implant music information to a third party.
  • the cochlear implant music information can be provided to a third party. That is, by making the music information for the cochlear implant into music information such as MIDI data, the music information for the cochlear implant can be reproduced as music by a computer device or the like for reproducing the music information such as MIDI data as music.
  • the music information for the inner ear can be provided to a third party.
  • the cochlear implant music information can be provided to a third party so that it can be played back as it is.
  • the music information processing apparatus 10 and the music information processing apparatus main body 14 may be incorporated in the voice processor 38 and processed by the voice processor 38.
  • the above-described music information for the cochlear implant is used for a musical sound produced for a normal hearing person.
  • the music that is assumed to be listened to by the cochlear implant wearer is a music generated by a telephone (for example, a melody at the time of holding) or a music provided to a train or a train passenger (for example, at a home announcement) Melody that flows at the beginning of the sound), musical sounds provided to operators and users of home appliances (for example, a melody at the time of setting or completion of processing), etc. can be employed.
  • the music information processing apparatus of the present embodiment it is possible to provide music (melody) that can be sufficiently listened to even for a cochlear implant user who has conventionally been insufficiently considered.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Otolaryngology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Acoustics & Sound (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • Radiology & Medical Imaging (AREA)
  • Multimedia (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Cardiology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Prostheses (AREA)

Abstract

La présente invention concerne la facilitation d'une reconnaissance améliorée lorsqu'une personne avec un implant cochléaire entend de la musique ou d'autres sons. Des données MIDI d'une composition musicale provenant d'un dispositif de source sonore (12) sont traitées avec un corps principal de dispositif de traitement d'informations musicales (14). Premièrement, la mélodie principale est extraite, les échelles et les intervalles sont analysés, et un ensemble d'échelle, comprenant des séquences d'échelle et des séquences d'intervalle, est dérivé. L'ensemble d'échelle est transposé à un ensemble d'échelle qui stimulera des électrodes plus différentes tout en retenant les intervalles de la composition originale, afin que la personne avec l'implant cochléaire soit capable de reconnaître la mélodie de la musique. Un haut-parleur (26) est excité par un générateur de signal audio (24), de manière à transmettre la musique à un dispositif d'implant cochléaire (30).
PCT/JP2011/064981 2010-06-29 2011-06-29 Dispositif de traitement d'informations musicales, procédé, programme, système de traitement d'informations musicales pour implant cochléaire, procédé de production d'informations musicales et support pour implant cochléaire WO2012002467A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2012522680A JPWO2012002467A1 (ja) 2010-06-29 2011-06-29 音楽情報処理装置、方法、プログラム、人工内耳用音楽情報処理システム、人工内耳用音楽情報製造方法及び媒体

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010-148284 2010-06-29
JP2010148284 2010-06-29

Publications (1)

Publication Number Publication Date
WO2012002467A1 true WO2012002467A1 (fr) 2012-01-05

Family

ID=45402171

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/064981 WO2012002467A1 (fr) 2010-06-29 2011-06-29 Dispositif de traitement d'informations musicales, procédé, programme, système de traitement d'informations musicales pour implant cochléaire, procédé de production d'informations musicales et support pour implant cochléaire

Country Status (2)

Country Link
JP (1) JPWO2012002467A1 (fr)
WO (1) WO2012002467A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104013480A (zh) * 2014-06-13 2014-09-03 山东大学 可感知音乐旋律的人工耳蜗听神经传导电极阵列

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11504479A (ja) * 1995-04-26 1999-04-20 アドヴァンスド バイオニクス コーポレイション 刺激波形の柔軟な制御を行なうマルチチャンネル蝸牛補助具
JP2008178680A (ja) * 2006-12-28 2008-08-07 Semiconductor Energy Lab Co Ltd 人工内耳装置、および体外集音装置、ならびにそれらを有する人工内耳システム
WO2008142651A1 (fr) * 2007-05-22 2008-11-27 Koninklijke Philips Electronics N.V. Dispositif et procédé de traitement de données audio
JP2008545170A (ja) * 2005-06-29 2008-12-11 フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ 音声信号を分析する装置、方法、およびコンピュータ・プログラム
JP2009508607A (ja) * 2005-09-19 2009-03-05 フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ 人工内耳、人工内耳の制御信号を生成するための装置、組合せ信号を生成するための装置、及び組合せ信号、並びに対応する方法
WO2009036146A1 (fr) * 2007-09-11 2009-03-19 Med-El Elektromedizinische Geraete Gmbh Stimulation intracochléaire simultanée
JP4295765B2 (ja) * 2003-08-07 2009-07-15 財団法人浜松科学技術研究振興会 人工内耳の音声変換方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11504479A (ja) * 1995-04-26 1999-04-20 アドヴァンスド バイオニクス コーポレイション 刺激波形の柔軟な制御を行なうマルチチャンネル蝸牛補助具
JP4295765B2 (ja) * 2003-08-07 2009-07-15 財団法人浜松科学技術研究振興会 人工内耳の音声変換方法
JP2008545170A (ja) * 2005-06-29 2008-12-11 フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ 音声信号を分析する装置、方法、およびコンピュータ・プログラム
JP2009508607A (ja) * 2005-09-19 2009-03-05 フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ 人工内耳、人工内耳の制御信号を生成するための装置、組合せ信号を生成するための装置、及び組合せ信号、並びに対応する方法
JP2008178680A (ja) * 2006-12-28 2008-08-07 Semiconductor Energy Lab Co Ltd 人工内耳装置、および体外集音装置、ならびにそれらを有する人工内耳システム
WO2008142651A1 (fr) * 2007-05-22 2008-11-27 Koninklijke Philips Electronics N.V. Dispositif et procédé de traitement de données audio
WO2009036146A1 (fr) * 2007-09-11 2009-03-19 Med-El Elektromedizinische Geraete Gmbh Stimulation intracochléaire simultanée

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104013480A (zh) * 2014-06-13 2014-09-03 山东大学 可感知音乐旋律的人工耳蜗听神经传导电极阵列
CN104013480B (zh) * 2014-06-13 2016-04-13 山东大学 可感知音乐旋律的人工耳蜗听神经传导电极阵列

Also Published As

Publication number Publication date
JPWO2012002467A1 (ja) 2013-08-29

Similar Documents

Publication Publication Date Title
Gfeller et al. Effects of frequency, instrumental family, and cochlear implant type on timbre recognition and appraisal
Laneau et al. Improved music perception with explicit pitch coding in cochlear implants
KR100275799B1 (ko) 음향구성장치
Drullman et al. Speech perception and talker segregation: Effects of level, pitch, and tactile support with multiple simultaneous talkers
US20100260363A1 (en) Midi-compatible hearing device and reproduction of speech sound in a hearing device
WO2011100802A1 (fr) Appareil auditif et procédé de modification ou d'amélioration de l'audition
JP2007017572A (ja) 外国語学習装置、外国語学習方法、外国語学習の記録媒体およびプログラム
JP5598516B2 (ja) カラオケ用音声合成システム，及びパラメータ抽出装置
CN107925830B (zh) 听力假体声音处理
Omran et al. Pitch ranking, melody contour and instrument recognition tests using two semitone frequency maps for nucleus cochlear implants
WO2012002467A1 (fr) Dispositif de traitement d'informations musicales, procédé, programme, système de traitement d'informations musicales pour implant cochléaire, procédé de production d'informations musicales et support pour implant cochléaire
Marozeau et al. Timbre perception with cochlear implants
Strydom et al. The performance of different synthesis signals in acoustic models of cochlear implants
Nogueira Evaluation of new music compositions in live concerts by cochlear implant users and normal hearing listeners
Innes-Brown et al. New music for the Bionic Ear: An assessment of the enjoyment of six new works composed for cochlear implant recipients
Griffin Pitch perception in musical chords for cochlear implant users
US11463829B2 (en) Apparatus and method of processing audio signals
Cappotto et al. Dominant melody enhancement in cochlear implants
JP5925493B2 (ja) 会話保護システム及び会話保護方法
Saimai et al. Speech synthesis algorithm for Thai cochlear implants
Vecellio Music-Remixing Preferences of Prelingual and Postlingual Cochlear Implant Users
Parker Music Perception of Cochlear Implant recipients using a Genetic Algorithm MAP
Reich Instrument identification through a simulated cochlear implant processing system
Brueggeman et al. Effect of Spectral Complexity Reduction and Number of Instruments on Musical Enjoyment with Cochlear Implants.
KR100528180B1 (ko) 청각 훈련 방법 및 청각 훈련용 기록 매체

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11800929

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2012522680

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11800929

Country of ref document: EP

Kind code of ref document: A1