JP5292893B2 - Modulation device, demodulation device, information communication system, and program - Google Patents

Description

  The present invention relates to a technique for transmitting and receiving information by sound.

There is a technique for transmitting information superimposed on audible sound. For example, Patent Document 1 describes a technique for superimposing a DTMF signal (so-called tone signal) on a program. Japanese Patent Application Laid-Open No. 2004-228561 describes a technique for removing a high frequency component from an acoustic signal and superimposing a modulation signal so as to match the spectrum envelope of the removed component.
JP-A-8-37511 JP 2007-104598 A

In the technique described in Patent Document 1, the DTMF signal can be heard directly by the user. Here, since the DTMF signal does not need to be heard, it is heard as noise for the user. In addition, the technique described in Patent Document 2 removes some components of the sound to be heard.
On the other hand, an object of the present invention is to enable transmission / reception of information without disturbing listening to sound.

The modulation device according to the present invention synthesizes a waveform of a plurality of frequencies based on sound information acquisition means for acquiring sound information representing at least the fundamental frequency of the sound to be heard, and sound information acquired by the sound information acquisition means Information obtained by the information obtaining means, waveform obtaining means for producing a waveform, information obtaining means for obtaining information, and values of certain elements of a plurality of waveforms synthesized by the waveform producing means according to a predetermined rule And changing means for changing from a predetermined reference value according to the above.
Alternatively, the modulation device according to the present invention includes a waveform generation unit that generates a waveform obtained by synthesizing a plurality of waveforms representing a sound to be heard, an information acquisition unit that acquires information, and the waveform according to a predetermined rule. A change unit that changes a value of an element of a plurality of waveforms synthesized by the generation unit from a predetermined reference value according to information acquired by the information acquisition unit, and an element to be changed by the change unit are selected. And a selecting means.
Alternatively, the modulation device according to the present invention, according to a predetermined rule, a waveform generation unit that generates a waveform obtained by synthesizing waveforms of a plurality of frequencies constituting a timbre corresponding to a musical instrument, an information acquisition unit that acquires information, And changing means for changing a value of a certain element of the plurality of waveforms synthesized by the waveform generating means from a predetermined reference value according to the information acquired by the information acquiring means.
The modulation apparatus according to the present invention includes encoding means for converting the information acquired by the information acquisition means into a code string, and the changing means converts each of the codes constituting the code string encoded by the encoding means. A configuration may be adopted in which each element of the plurality of waveforms synthesized by the waveform generation unit is assigned to the element, and the value of the element to which the sign is assigned is changed according to the rule corresponding to the sign.
In the modulation device according to the present invention, the element may include at least one of a frequency, a level, and a phase of the plurality of waveforms.
In the modulation device according to the aspect of the invention, the changing unit may change the element of the waveform of another frequency without changing the element of the waveform of the fundamental frequency among the plurality of waveforms synthesized by the waveform generating unit. May be.

The demodulating device according to the present invention is an element of a waveform of a sound collected by the sound collecting means, and an element for acquiring element information representing each element of a set of a plurality of frequency components including a fundamental frequency of the sound to be heard Information acquisition means, comparison means for comparing the value of each element represented by the element information acquired by the element information acquisition means with a predetermined reference value, and calculating the difference between them, calculated by the comparison means according to a predetermined rule It is characterized by comprising specifying means for specifying information according to the difference value and output means for outputting the information specified by the specifying means.
Alternatively, the demodulator according to the present invention obtains element information representing each element of a set of a plurality of frequency components, which are sound waveform elements that are collected by the sound collecting means and constitute a timbre corresponding to the musical instrument. Element information acquisition means, comparison means for comparing the value of each element represented by the element information acquired by the element information acquisition means with a predetermined reference value and calculating the difference, and the comparison means according to a predetermined rule And a specifying unit for specifying information according to the difference value calculated by the step (a) and an output unit for outputting the information specified by the specifying unit.

An information communication system according to the present invention includes a transmitter including the modulation device and a receiver, and the transmitter includes sound emission means for emitting sound according to the waveform generated by the waveform generation means. The receiver is a sound collecting means for collecting the sound emitted by the sound emitting means, and an element of a waveform of the sound collected by the sound collecting means, each of a set of a plurality of frequency components In accordance with the rules, element information acquisition means for acquiring element information representing an element, comparison means for comparing the value of the element represented by the element information acquired by the element information acquisition means with the reference value, and calculating the difference thereof, It is characterized by comprising specifying means for specifying information according to the difference value calculated by the comparing means, and output means for outputting the information specified by the specifying means.

  The present invention can also be specified as a program for causing a computer to realize the functions of the modulation device or the demodulation device described above, or a recording medium storing such a program. The present invention can also be specified as a modulation method, a demodulation method, and a communication method of information performed by the modulation device and the demodulation device described above.

  According to the present invention, information can be transmitted and received without disturbing listening to sound.

[Embodiment]
FIG. 1 is a block diagram showing a configuration of an information communication system according to an embodiment of the present invention. As shown in the figure, the information communication system 10 of this embodiment includes a transmitter 100 and a receiver 200. The transmitter 100 transmits information by reproducing sound, and the receiver 200 receives information by collecting the sound. That is, in the information communication system 10, information is included in the reproduced sound of the transmitter 100.

  FIG. 2 is a block diagram illustrating a configuration of the transmitter 100. As shown in the figure, the transmitter 100 includes a sound information supply unit 110, a timbre number supply unit 120, an information supply unit 130, an encoder 140, a selector 150, a modulator 160, and a combiner. 170 and a speaker 180. The transmitter 100 includes storage means such as a memory, and stores a coding table TB1, a tone color database DB1, and a modulation rule database DB2. The storage means may be rewritable, or may be detachable from the transmitter 100 like a so-called memory card.

The sound information supply unit 110 supplies sound information to the synthesizer 170. The sound information is information representing a sound, and in the present embodiment, represents a certain sound. The sound information includes at least information indicating the pitch (pitch) of the sound, and more preferably includes information indicating the intensity and length of the sound. The sound information supply unit 110 may read and supply the sound information from the storage unit, or may acquire and supply the sound information from an external device.
The timbre number supply unit 120 supplies the timbre number to the selector 150. The timbre number is an ID for identifying a timbre, and is information uniquely assigned to each timbre. In the present embodiment, a timbre number is assigned to identify various musical instruments such as “snare drum” and “piano”. The timbre number supply unit 120 may supply a predetermined timbre number, or may accept a user operation and supply a user-selected timbre number selected from a plurality of timbre numbers.

The information supply unit 130 supplies information to be supplied to the receiver 200 to the encoder 140. Here, the information is arbitrary content, but can be encoded by the encoder 140.
The encoder 140 encodes the information supplied from the information supply unit 130 with a predetermined algorithm, and supplies information converted into a code string (hereinafter referred to as “encoded information”) to the modulator 160. The encoding algorithm by the encoder 140 is arbitrary and is described in the encoding table TB1. In this embodiment, the encoder 140 generates encoded information represented by a combination of “0” and “1”.

  The selector 150 reads out the timbre parameter corresponding to the timbre number supplied from the timbre number supply unit 120 from the timbre database DB1 and supplies it to the modulator 160. The timbre database DB1 is a database in which a plurality of pairs of timbre numbers and timbre parameters are described. The timbre parameter is a set of elements that constitute the corresponding timbre, and this enables the waveform represented by the corresponding timbre to be specified. In the present embodiment, elements include a frequency and its level.

  The modulator 160 acquires the timbre parameter and the encoding information, and changes the timbre parameter according to the encoding information. Such a change is referred to herein as “modulation”. The modulator 160 refers to the modulation rule database DB2 describing the modulation rules, and changes the timbre parameters according to the rules described therein. The timbre parameter changed by the modulator 160 is hereinafter referred to as “modulated timbre parameter”.

  The synthesizer 170 generates an acoustic signal representing a waveform obtained by synthesizing a plurality of waveforms based on the sound information acquired from the sound information supply unit 110 and outputs the sound signal to the speaker 180. The synthesizer 170 determines a waveform to be synthesized based on the sound information and the modulated timbre parameter. In the present embodiment, the elements of the waveform determined by the synthesizer 170 are the frequency and its level. The speaker 180 emits a sound corresponding to the acoustic signal output from the synthesizer 170.

FIG. 3 is a diagram illustrating a main configuration of the synthesizer 170. As shown in the figure, the synthesizer 170 includes oscillators 171 ₁ , 171 ₂ , 171 ₃ ,..., 171 _n , amplifiers 172 ₁ , 172 ₂ , 172 ₃ ,..., 172 _n, and an adder 173. . Here, the subscripts (1 to n) of the reference numerals are attached to distinguish each. Therefore, when it is not necessary to distinguish each of the oscillators 171 _{1 to} 171 _n or the amplifiers 172 _{1 to} 172 _n , their subscripts are omitted and expressed as “oscillator 171” or “amplifier 172”. The number of oscillators 171 and amplifiers 172, that is, the value of n is an arbitrary natural number.

The oscillator 171 oscillates at a specified frequency and generates a sine wave signal representing a sine wave. The amplifier 172 is an amplifier whose gain is variable, and amplifies the level of the sine wave signal oscillated by the corresponding oscillator 171. The adder 173 adds the sine wave signals amplified by the amplifier 172, and outputs the result as an acoustic signal representing one waveform.
The frequencies assigned to the oscillators 171 ₁ , 171 ₂ , 171 ₃ ,..., 171 _n are different from each other. The gains of the amplifiers 172 ₁ , 172 ₂ , 172 ₃ ,..., 172 _n are determined for each designated frequency. The frequency and gain are determined based on the sound information and the modulation tone color parameter.

The configuration of the transmitter 100 is as described above. Here, an operation performed by the transmitter 100 having such a configuration will be described with an example.
FIG. 4 is a diagram for explaining the operating principle of the transmitter 100. Now, as sound information, data of a sound having a pitch, that is, a frequency (fundamental frequency) of f ₀ is given, and frequencies f ₁ , f ₂ and f _3, and data corresponding to this are given as timbre parameters. Suppose that The levels of the frequencies f ₁ , f ₂ and f ₃ are relatively determined based on the sound level of the frequency f ₀ . When such information is given, if these frequencies are specified and the synthesizer 170 oscillates, amplifies and synthesizes, the waveforms of the frequencies f ₀ , f ₁ , f ₂ and f ₃ are synthesized. The obtained acoustic signal is obtained. The frequency spectrum of this acoustic signal is as shown in FIG.
Here, it is desirable that the frequencies f ₁ , f _2, and f ₃ have a harmonic relationship with respect to the fundamental frequency f ₀ , but they do not necessarily have to be harmonics.

In the case where such sound information and timbre parameters are given, it is assumed that 3-digit encoded information “B ₁ B ₂ B ₃ ” is given. Here, B ₁ , B _2, and B ₃ are bit values of “0” or “1”, respectively. When such encoded information is supplied, the modulator 160 assigns the bit value B ₁ to the frequency f ₁ , the bit value B ₂ to the frequency f ₂ , and the bit value B ₃ to the frequency f _3. . Here, it is assumed that the bit value B ₁ is “1”, the bit value B ₂ is “0”, and the bit value B ₃ is “1”. That is, the encoded information is a code string “101”.

After performing the assignment as described above, the modulator 160 changes the timbre parameters (in this case, the frequencies f ₁ , f ₂ and f ₃ ) according to the rules described in the modulation rule database DB ₂ . In this case, the modulation rule database DB2 describes frequency shift amounts corresponding to the bit values “0” and “1”. Here, the shift amount corresponding to the bit value “0” is “Δ ₀ ”, and the shift amount corresponding to the bit value “1” is “Δ ₁ ”.

It is desirable that Δ ₀ and Δ ₁ are sufficiently small as compared to the above-described difference in frequency (that is, | f ₁ −f ₂ | and | f ₂ −f ₃ |). In order to clarify the difference between Δ ₀ and Δ ₁ , it is preferable to reverse the sign. However, since Δ ₀ and Δ ₁ are sufficient if they represent different shift amounts, both may be positive (or both negative), one is 0 (ie, no shift) and the other is It may be a non-zero value. In addition, Δ ₀ and Δ ₁ may represent the shift amount by a numerical value (how much Hz is shifted), or may be expressed by a ratio (how much% the frequency value is shifted). It may be what you did.
In the following description, it is assumed that Δ ₀ is negative and Δ ₁ is positive.

The modulator 160 applies such a shift amount to the timbre parameter. In this example, the modulator 160 changes the frequency f ₁ to “f ₁ + Δ ₁ ”, the frequency f ₂ to “f ₂ + Δ ₀ ”, and the frequency f ₃ to “f ₃ + Δ ₁ ”. Then, the synthesizer 170 is designated with the changed frequency, oscillates at the designated frequency, and outputs an acoustic signal having a waveform obtained by synthesizing the respective waveforms. Specifically, the frequency f ₀ is the oscillator 171 _1, the frequency f ₁ + delta ₁ is the oscillator 171 _2, in so on, one frequency is assigned to one of the oscillator 171.

The frequency spectrum of the sound represented by the output acoustic signal is as shown in FIG. Comparing FIG. 4A and FIG. 4B, when the frequency spectrum of FIG. 4A is used as a reference, the frequencies f ₁ , f ₂ and f ₃ are changed from the reference (broken line). Yes. That is, the acoustic signal modulated in this way has a waveform different from the reference waveform. Therefore, the receiver 200 collects the reproduced sound that deviates from the reference in this way.

The receiver 200 restores the information contained in the sound by specifying a “deviation” from the reference value of the element of the collected reproduced sound. Such restoration is referred to herein as “demodulation”.
FIG. 5 is a block diagram illustrating a configuration of the receiver 200. As shown in the figure, the receiver 200 includes a microphone 210, an analyzer 220, a comparator 230, a decoder 240, and an information output unit 250. The receiver 200 includes storage means such as a memory, and stores a coding table TB1, a tone color database DB1, and a modulation rule database DB2. These data include the same data as the data stored in the transmitter 100.

The microphone 210 is a microphone that picks up sound reproduced by the transmitter 100. The microphone 210 converts the reproduced sound into an acoustic signal and supplies it to the analyzer 220.
The analyzer 220 analyzes the acoustic signal acquired from the microphone 210 and converts it into information that can be compared by the comparator 230. The information after the conversion by the analyzer 220 is hereinafter referred to as “analysis data”. The analysis performed by the analyzer 220 is, for example, FFT (Fast Fourier Transform). When FFT is performed, an acoustic signal can be converted into a set of frequency components. In this case, the analysis data is a set of frequency components. This analysis data is an example of element information in the present invention.

  The comparator 230 compares the analysis data acquired from the analyzer 220 with the timbre parameter, and calculates a difference from the timbre parameter as a reference, that is, a “deviation”. The comparator 230 refers to the modulation rule database DB2 and identifies what encoding information the calculated “deviation” represents. The comparator 230 supplies the specified encoded information to the decoder 240.

When the timbre parameter used for comparison is unknown and needs to be specified, the comparator 230 acquires the timbre number corresponding to the timbre parameter from the outside. In this case, for example, the timbre number is supplied to the comparator 230 by a user operation or via a communication unit (not shown), and the comparator 230 sets the timbre parameter corresponding to the acquired timbre number to the timbre database DB1. Read from.
When the timbre number supply unit 120 of the transmitter 100 supplies a predetermined timbre number, the comparator 230 need only store the timbre parameters corresponding to the timbre number as the timbre database DB1. There is no need to specify timbre parameters. Further, in this case, the configuration of the timbre number supply unit 120 may be omitted.

The decoder 240 refers to the coding table TB1 and identifies the coding information acquired from the comparator 230 by decoding. That is, the decoder 240 performs inverse conversion of the conversion performed by the encoder 140. The decoder 240 supplies the information specified by decoding to the information output unit 250.
The information output unit 250 outputs information acquired from the decoder 240. Here, “output” performed by the information output unit 250 refers to notification so that the user of the receiver 200 can perceive information. For example, the information output unit 250 may visually notify the acquired information using a display unit such as a liquid crystal display, or may notify tactilely using a vibration unit such as a vibrator. Of course, the information output unit 250 may notify the information by hearing, taste, smell or the like.

  The configuration of the receiver 200 is as described above. With this configuration, the receiver 200 extracts information from the collected reproduced sound and outputs it. In the comparator 230, the “deviation” as shown in FIG. 4B is calculated from the analysis data based on the reference tone color parameter, and the sign is based on the rule described in the modulation rule database DB2. Identified. Further, the decoder 240 decodes a code string composed of the specified codes, and obtains original information.

  Thus, according to the information communication system 10 of the present embodiment, it is possible to include information in the reproduced sound and restore it. Here, the reproduced sound is different from the reference sound, but the listening itself is not hindered. Further, if the reproduced sound has a “deviation”, that is, if the shift amount is sufficiently small, the timbre will not change drastically, and the “deviation” can be made not perceptible to hearing. Therefore, the reproduced sound does not essentially lose the original sound information. Therefore, when the user listens to the reproduced sound, the user can perceive that it is the same as the sound that is not modulated. For example, even if the user may feel that the timbre has changed slightly within the perceived range of a “snare drum” sound, it should be a “snare drum”. The sound never sounds like a “piano” sound.

  Further, according to the information communication system 10 of the present embodiment, sounds other than the sound represented by the sound information are not reproduced. Therefore, the user is spared from hearing a sound (noise) that does not need to be heard when transmitting and receiving information. Further, since the information communication system 10 of the present embodiment changes the waveform of the sound represented by the sound information, the information communication system 10 does not receive the restriction of the frequency band and emits and collects sound in a higher frequency range than the sound that should be listened to originally. There is no need to make it possible.

  Since the information communication system 10 of this embodiment includes information in the reproduced sound, the information communication system 10 can be used in any place where the reproduced sound can be heard. As an aspect of use of the information communication system 10, there can be mentioned a method in which predetermined information is superimposed on a guide sound (or warning sound) in a pedestrian crossing or the like, a chime for notifying time, or the like. For example, by superimposing information (latitude, longitude, etc.) that represents a place on such a guide sound, the place can be specified only by those who know the rules of encoding and modulation, and others are aware of anything. It is possible to build a system that will not be damaged. In addition, by superimposing time information on the time signal sound so that a person with hearing impairment possesses the receiver 200, it is possible to notify a person with hearing impairment of the time by visual or tactile sense. Become. That is, according to the information communication system 10 of the present embodiment, when some sound is generated, information is transmitted only to a specific person without causing inconvenience to other persons, or known to other persons. For example, information that is inconvenient can be transmitted only to a specific person, or auditory information can be transmitted in another alternative manner.

[Modification]
The present invention can be implemented in a form different from the above-described embodiment. The following modifications are examples of modifications applicable to the present invention. In addition, these modifications may be implemented by appropriately combining each as required.

(1) Modification 1
In the embodiment described above, the frequency is changed among the elements of the timbre parameter. However, the element to be changed may be a level corresponding to each frequency. When the frequency level is used, the information may be represented by a relative ratio difference between a plurality of levels.
FIG. 6 is a diagram illustrating a case where information is represented by a frequency level. FIG. 6A illustrates a bit value of “0”, and FIG. 6B illustrates a bit value of “1”. It represents.

  Further, the phase of the sine wave of each frequency may be used as the element to be changed, or the waveform itself (that is, the shape of the waveform) is regarded as an element, and a predetermined code is assigned to the determined waveform. Also good. Note that the waveform used for the synthesis is not limited to a sine wave, and may be, for example, a triangular wave or a rectangular wave.

Further, a plurality of elements having different attributes may be combined, for example, a code having a frequency shift amount is assigned and another code is assigned to the frequency level shift amount. In this way, it is possible to further increase the amount of information that can be superimposed on one waveform compared to the case of using an element with a single attribute.
Further, for example, different shift amounts may be assigned to the code strings “00”, “01”, “10”, and “00”. That is, the code assigned to the value of a certain element is not limited to 1 bit, and the number of bits can be increased (within a range that can be analyzed later). Even in this case, it is possible to further increase the amount of information that can be superimposed on one waveform.

(2) Modification 2
In the above-described embodiment, a plurality of frequencies exist as a timbre parameter for a certain basic frequency, and only the other frequencies are changed without changing the basic frequency. Changes may be made to this according to the given code. In this way, it is possible to further increase the amount of information that can be superimposed on one waveform compared to the case of the embodiment. However, it is desirable not to change the fundamental frequency if it is desired to suppress changes in timbre perception.

(3) Modification 3
In the present invention, the sound information may be anything as long as it represents the pitch of the sound. The sound information may be, for example, MIDI (Musical Instrument Digital Interface: registered trademark) data. In the case of MIDI data, the sound information may be data of only a note number or may include other data. Further, the sound information may be one in which the pitch of the sound that it represents changes to another pitch according to time.

  In addition, when the sound information represents a sound such as an electronic siren or a bell whose temporal change is regular, a parameter related to time may be used as an element. Such parameters include, for example, attack (the time from when a sound is produced until it reaches the maximum level), decay (the time until the volume changes from the maximum level to the sustain level), and hold (the time for maintaining the volume at a certain level). ), Release (the time from when the volume decreases to 0). When modulation is performed using such parameters, a so-called envelope changes according to information.

  Furthermore, a human voice or the like can be used as the sound information. For example, in the case of synthesizing a voice by combining a plurality of formants, the present invention can be implemented by changing the same manner as in the above-described embodiment, that is, by changing the formant frequency according to the code. In this case, in the receiver 200 described above, it is necessary to specify which sound is superimposed with information (for example, “A”, “I”). For example, the sound can be specified by adding a function of voice recognition to the analyzer 220. In this case, when the analyzer 220 determines that a desired sound has been input by voice recognition, the analyzer 220 analyzes the acoustic signal and generates analysis data.

  In addition, although embodiment mentioned above presupposed that sound is heard, in this invention, the sound which sound information represents may be a sound which is not heard like an ultrasonic wave.

(4) Modification 4
In the present invention, the amount of shift, that is, the degree of changing the value of an element may vary depending on the application of the invention and the mode of sound information. For example, if the sound represented by the sound information is like music, the shift amount is desirably relatively small. On the other hand, the shift amount may be relatively large if the sound represented by the sound information is not listened with particular attention and is sufficient if it is known whether it is sounding.

(5) Modification 5
In the present invention, there may be a plurality of description contents of the modulation rule database DB2, that is, modulation and demodulation rules, and further, stepped levels may be provided for distinction. For example, a lower rule and an upper rule are defined, and depending on the upper rule, modulation and demodulation can be performed using more elements than the lower rule. More specifically, in the example shown in FIG. 4, when the lower rule is followed, modulation and demodulation with the elements of the frequencies f ₁ and f ₂ are possible, and when the higher rule is followed. It is possible to modulate and demodulate with elements of frequencies f ₁ , f ₂ and f ₃ .

  When such a level is provided, the receiver 200 can vary the amount of information that can be demodulated according to the level of the modulation rule database DB2. That is, according to this example, in the receiver 200 in which only the lower rule is stored, a part of the information contained in the reproduced sound cannot be restored, and the reception in which the higher rule is stored is stored. In the apparatus 200, it is possible to restore all of the information contained in the reproduced sound. Similarly, in the transmitter 100, it is possible to vary the amount of information that can be modulated according to the level of the modulation rule database DB2.

  When a plurality of rules are provided in this way, the respective rules may be stored in the transmitter 100 or the receiver 200, and any one of the rules may be selected as necessary to be used properly. In this case, the plurality of rules may be in a relationship in which a certain rule (superior rule) includes another rule (subordinate rule), or may be different rules that are independent of each other.

(6) Modification 6
The transmitter 100 described above is an example of a modulation device according to the present invention, and the receiver 200 described above is an example of a demodulation device according to the present invention. The modulation device and the demodulation device according to the present invention are not limited to the configuration of the above-described embodiment, and an appropriate configuration can be added, omitted, or replaced. For example, the modulation device and the demodulation device according to the present invention may further include a communication unit via a network, and may be configured to download (or upload) the above-described table or database data. In addition, both the receiver 200 and the receiver 200 may be configured so that information can be transmitted and received mutually.

  Further, a part of the functions realized by the transmitter 100 or the receiver 200 described above may be realized as an integrated circuit, or a part of the functions may be described as a program and executed by an arithmetic device such as a CPU. It may be. The program according to the present invention can be used in a form stored in a recording medium or can be used in a form downloaded via a network.

Block diagram showing configuration of information communication system Block diagram showing the configuration of the transmitter Diagram showing the configuration of the combiner Diagram showing the operating principle of the transmitter Block diagram showing the configuration of the receiver The figure which illustrates the case where information is expressed by the level of frequency

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Information communication system 100 ... Transmitter 110 ... Sound information supply part 120 ... Tone number supply part 130 ... Information supply part 140 ... Encoder 150 ... Selector 160 ... Modulator 170 ... Synthesis 180 ... speaker 200 ... receiver 210 ... microphone 220 ... analyzer 230 ... comparator 240 ... decoder 250 ... information output unit

Claims (16)

Sound information acquisition means for acquiring sound information representing at least the fundamental frequency of the sound to be heard;
Based on the sound information acquired by the sound information acquisition means, a waveform generation means for generating a waveform obtained by combining waveforms of a plurality of frequencies;
Information acquisition means for acquiring information;
And changing means for changing values of certain elements of the plurality of waveforms synthesized by the waveform generating means from a predetermined reference value according to the information acquired by the information acquiring means according to a determined rule. Modulation device. Waveform generating means for generating a waveform obtained by synthesizing waveforms of a plurality of frequencies representing the sound to be heard ;
Information acquisition means for acquiring information;
Change means for changing the value of a certain element of a plurality of waveforms synthesized by the waveform generation means from a predetermined reference value according to the information acquired by the information acquisition means, according to a determined rule ;
A modulation apparatus comprising: selection means for selecting an element to be changed by the changing means . Waveform generating means for generating a waveform obtained by synthesizing waveforms of a plurality of frequencies constituting a timbre corresponding to a musical instrument ;
Information acquisition means for acquiring information;
And changing means for changing values of certain elements of the plurality of waveforms synthesized by the waveform generating means from a predetermined reference value according to the information acquired by the information acquiring means according to a determined rule. Modulation device. Encoding means for converting the information acquired by the information acquisition means into a code string;
The changing means assigns each code constituting the code sequence encoded by the encoding means to each element of a plurality of waveforms synthesized by the waveform generating means, and the value of the element to which the code is assigned The modulation device according to any one of claims 1 to 3, wherein the modulation device is changed according to the rule according to the code. It said element, modulating device according to any one of the frequencies of the waveforms, claims 1, characterized in that it comprises at least one of the level and phase 4. The change unit changes the element of the waveform of the other frequency without changing the element of the waveform of the fundamental frequency among the plurality of waveforms synthesized by the waveform generation unit. 6. The modulation device according to any one of 1 to 5 . Modulating device according to any one of claims 1 to 6, characterized in that the sound information is information indicating the pitch of the sound. Element information acquisition means for acquiring element information representing each element of a set of a plurality of frequency components including the fundamental frequency of the sound to be heard, which is an element of the waveform of the sound collected by the sound collection means;
A comparison unit that compares the value of each element represented by the element information acquired by the element information acquisition unit with a predetermined reference value to calculate the difference;
A specifying means for specifying information according to a difference value calculated by the comparing means according to a determined rule;
An output means for outputting the information specified by the specifying means. Element information acquisition means for acquiring element information representing each element of a set of a plurality of frequency components, which is an element of a sound waveform that is collected by a sound collection means and constitutes a timbre corresponding to a musical instrument ,
A comparison unit that compares the value of each element represented by the element information acquired by the element information acquisition unit with a predetermined reference value to calculate the difference;
A specifying means for specifying information according to a difference value calculated by the comparing means according to a determined rule;
An output means for outputting the information specified by the specifying means. It has a transmitter provided with the modulation device according to any one of claims 1 to 7, and a receiver,
The transmitter is
A sound emitting means for emitting a sound corresponding to the waveform generated by the waveform generating means;
The receiver
Sound collecting means for collecting the sound emitted by the sound emitting means;
Element information acquisition means for acquiring element information representing each element of a set of a plurality of frequency components, which is an element of a waveform of the sound collected by the sound collection means;
Comparing means for comparing the element value represented by the element information acquired by the element information acquiring means with the reference value and calculating the difference;
In accordance with the rule, a specifying unit that specifies information according to a difference value calculated by the comparing unit;
An information communication system comprising: output means for outputting information specified by the specifying means. The transmitter and the receiver are:
Communication means for transmitting or receiving data describing the rule via a network
The information communication system according to claim 10. Computer
Sound information acquisition means for acquiring sound information representing at least the fundamental frequency of the sound to be heard;
Based on the sound information acquired by the sound information acquisition means, a waveform generation means for generating a waveform obtained by combining waveforms of a plurality of frequencies;
Information acquisition means for acquiring information;
Changing means for changing the value of an element of a plurality of waveforms synthesized by the waveform generating means from a predetermined reference value according to the information acquired by the information acquiring means in accordance with a determined rule
Program to function as. Computer
Waveform generating means for generating a waveform obtained by synthesizing waveforms of a plurality of frequencies representing the sound to be heard;
Information acquisition means for acquiring information;
Change means for changing the value of a certain element of a plurality of waveforms synthesized by the waveform generation means from a predetermined reference value according to the information acquired by the information acquisition means, according to a determined rule;
Selection means for selecting an element to be changed by the changing means
Program to function as. Computer
Waveform generating means for generating a waveform obtained by synthesizing waveforms of a plurality of frequencies constituting a timbre corresponding to a musical instrument;
Information acquisition means for acquiring information;
Changing means for changing the value of an element of a plurality of waveforms synthesized by the waveform generating means from a predetermined reference value according to the information acquired by the information acquiring means in accordance with a determined rule
Program to function as. Computer
Element information acquisition means for acquiring element information representing each element of a set of a plurality of frequency components including the fundamental frequency of the sound to be heard, which is an element of the waveform of the sound collected by the sound collection means;
A comparison unit that compares the value of each element represented by the element information acquired by the element information acquisition unit with a predetermined reference value to calculate the difference;
A specifying means for specifying information according to a difference value calculated by the comparing means according to a determined rule;
Output means for outputting information specified by the specifying means
Program to function as. Computer
Element information acquisition means for acquiring element information representing each element of a set of a plurality of frequency components, which is an element of a sound waveform that is collected by a sound collection means and constitutes a timbre corresponding to a musical instrument,
A comparison unit that compares the value of each element represented by the element information acquired by the element information acquisition unit with a predetermined reference value to calculate the difference;
A specifying means for specifying information according to a difference value calculated by the comparing means according to a determined rule;
Output means for outputting information specified by the specifying means
Program to function as.

Images