WO2013186901A1

WO2013186901A1 - Vibration signal generating device and method, computer program, recording medium and somesthetic sound system

Info

Publication number: WO2013186901A1
Application number: PCT/JP2012/065265
Authority: WO
Inventors: 高橋　努; 勝利稲垣
Original assignee: パイオニア株式会社
Priority date: 2012-06-14
Filing date: 2012-06-14
Publication date: 2013-12-19
Also published as: JPWO2013186901A1

Abstract

This vibration signal generating device (10) generates a vibration signal from an sound signal, and is provided with an extraction means (14) which extracts multiple first frequency components from the sound signal, a determination means (15) which determines whether or not prescribed conditions are fulfilled by the frequency ratio of multiple second frequency components obtained by converting the multiple first frequency components to frequency components falling within a vibration frequency band, and a generation means (17) which generates, depending on the determination result of the determination means, either (i) a vibration signal that includes the multiple second frequency components, or (ii) a vibration signal that includes one of the multiple second frequency components.

Description

Vibration signal generating apparatus and method, computer program, recording medium, and sensory sound system

The present invention relates to a vibration signal generating apparatus and method, a computer program, a recording medium, and a body sensation sound system that generate a vibration signal having a relatively low frequency supplied to an electro-mechanical vibration converter employed in a body sensation sound apparatus, for example. In the technical field.

As this type of vibration signal generation device, for example, a vibration signal generation device that converts a vibration signal including vibration of a relatively high frequency component into a vibration signal including relatively low frequency component vibration has been proposed. (See Patent Document 1).

Japanese Patent No. 40625570

Here, the oscillation signal often includes a plurality of frequency components. In this case, the vibration signal generation device disclosed in Patent Literature 1 is technically incapable of generating a swing signal that can provide a suitable body vibration to the user depending on the plurality of frequency components. Has a problem. Specifically, for example, when a plurality of frequency components are in a relationship that generates a dissonance, a technical problem that it is not possible to generate a swing signal that can provide a suitable body vibration to the user. have.

The present invention has been made in view of the above problems, for example, and provides a vibration signal generation apparatus and method, a computer program, a recording medium, and a body acoustic system that can provide a user with more suitable body vibration. Is an issue.

A vibration signal generation apparatus for solving the above-described problem generates a vibration signal composed of a frequency component in a vibration frequency band that is narrower than the audible band from an acoustic signal including a frequency component in the audible band. The vibration signal generation device for extracting the first frequency components from the acoustic signal and converting the plurality of first frequency components into frequency components that fall within the vibration frequency band. A determination unit that determines whether or not a frequency ratio of a plurality of second frequency components satisfies a predetermined condition; and according to a determination result of the determination unit, (i) the vibration signal including the plurality of second frequency components and (ii) generating means for generating any one of the vibration signals including any one second frequency component of the plurality of second frequency components.

A vibration signal generation method for solving the above problem generates a vibration signal composed of a frequency component in a vibration frequency band that is a frequency band narrower than the audible band from an acoustic signal including a frequency component in the audible band. A vibration signal generating method for obtaining a plurality of first frequency components from the acoustic signal, and converting the plurality of first frequency components into frequency components that fall within the vibration frequency band. A determination step of determining whether a frequency ratio of a plurality of second frequency components satisfies a predetermined condition; and, according to a determination result of the determination step, (i) the vibration signal including the plurality of second frequency components and (ii) including a generation step of generating any one of the vibration signals including any one second frequency component of the plurality of second frequency components.

A computer program for solving the above-described problems causes a computer to function as the vibration signal generation device described above.

A recording medium for solving the above problem stores the above-described computer program.

A body sensation sound system for solving the above problems is a body sensation sound system comprising a terminal device, a server device, and an electro-mechanical vibration converter connected to each other via a network, and the server device includes a plurality of And music information indicating a list of the plurality of music data, and the terminal device receives the music information via the network, and accepting means capable of accepting user input. A display means for acquiring and displaying to the user, and a signal for identifying one piece of music data among a plurality of pieces of music data indicated by the music information in accordance with the user input received by the receiving means And a first communication means for transmitting the music specifying signal to the server device via the network, the server device having the music specific signal. From an acoustic signal corresponding to one piece of music data specified by the signal and including a frequency component in an audible band, from a frequency component in a vibration frequency band that is a narrower frequency band than the audible band A vibration signal generating device for generating a vibration signal, and extracting means for extracting a plurality of first frequency components from the acoustic signal, and converting the plurality of first frequency components into frequency components that fall within the vibration frequency band Determining means for determining whether the frequency ratio of the plurality of second frequency components obtained by satisfying a predetermined condition; and (i) determining the plurality of second frequency components according to a determination result of the determining means. Generating means for generating any one of the vibration signal including (ii) the vibration signal including any one second frequency component of the plurality of second frequency components; and It said vibration signal, via the network, the electro - further comprising a second communication means for transmitting the mechanical vibration converter.

The operation and other advantages of the present invention will be clarified from the embodiments to be described below.

It is a block diagram which shows the structure of the vibration signal generation apparatus of a present Example. It is a flowchart which shows the flow of operation | movement of the vibration signal generation apparatus of a present Example. It is the waveform diagram which shows the waveform of an audio signal, and the power spectrum figure obtained by performing a FFT process with respect to the said audio signal. It is a musical score which shows the scale used as a low interval limit. It is a graph which shows the aspect of the production | generation of a vibration signal in case the frequency ratio of a 1st and 2nd vibration component satisfy | fills 1st conditions. It is a graph which shows the aspect of the production | generation of a vibration signal in case the frequency ratio of a 1st and 2nd vibration component does not satisfy | fill 1st conditions. It is a graph which shows the aspect of a production | generation of a vibration signal in case the frequency value of a 1st and 2nd vibration component satisfy | fills 2nd conditions. It is a graph which shows the aspect of the production | generation of a vibration signal in case the frequency value of a 1st and 2nd vibration component does not satisfy | fill 2nd conditions. It is a block diagram which shows the structure of the acoustic experience system of 1st Example. It is a block diagram which shows the structure of the acoustic experience system of 2nd Example. It is a block diagram which shows the structure of the acoustic experience system of 3rd Example. It is a block diagram which shows the structure of the acoustic experience system of 4th Example.

Hereinafter, description will be made on each embodiment of the vibration signal generating apparatus and method, the computer program, the recording medium, and the body sensation sound system.

(Embodiment of vibration signal generation device)
<1>
The vibration signal generation device of the present embodiment generates a vibration signal composed of a frequency component in a vibration frequency band that is a frequency band narrower than the audible band, from an acoustic signal including a frequency component in the audible band. A generating device that extracts a plurality of first frequency components from the acoustic signal; and a plurality of first frequency components obtained by converting the plurality of first frequency components into frequency components that fall within the vibration frequency band. A determination means for determining whether a frequency ratio of two frequency components satisfies a predetermined condition; and (i) the vibration signal including the plurality of second frequency components according to a determination result of the determination means; and (ii) Generating means for generating any one of the vibration signals including any one second frequency component of the plurality of second frequency components.

According to the vibration signal generation device of the present embodiment, a frequency component in a vibration frequency band that is a frequency band narrower than the audible band is obtained from an acoustic signal including a frequency component in an audible band (for example, 20 Hz to 20000 Hz). A vibration signal which is a signal consisting of is generated.

The “vibration frequency band” is typically set as a frequency band (for example, 60 Hz to 150 Hz, etc.) that can be appropriately converted into mechanical vibration by an electro-mechanical vibration converter. Such a “vibration frequency band” is preferably set as appropriate according to the performance of the target electromechanical vibration converter.

In order to generate such a vibration signal, the vibration signal generation device of the present embodiment includes an extraction unit, a determination unit, and a generation unit.

The extraction means extracts a plurality of first frequency components from the acoustic signal. That is, the extraction means extracts a plurality of first frequency components that satisfy some criteria from a large number of frequency components included in the acoustic signal. Specifically, for example, as will be described in detail later, the extraction unit extracts a plurality of frequency components having relatively high signal strength (for example, FFT power described later) or higher than a predetermined threshold from the acoustic signal. You may extract as several 1st frequency components.

The determining means determines whether or not the frequency ratio of the plurality of second frequency components (that is, the ratio of the frequencies corresponding to the plurality of second frequency components) satisfies a predetermined condition. Here, the plurality of second frequency components are a plurality of frequency components obtained by converting the plurality of first frequency components extracted by the extraction unit into frequency components that fall within the vibration frequency band. In consideration of the fact that the vibration frequency band is narrower than the audible band, the plurality of second frequency components can be obtained by lowering the frequency (in other words, the scale) of the plurality of first frequency components extracted by the extracting means. It may be a plurality of frequency components. Specifically, for example, the plurality of second frequency components lowers the frequency of the plurality of first frequency components extracted by the extraction unit by a predetermined number of octaves so as to be within the vibration frequency band (or 1 / N ( However, N is a plurality of frequency components obtained by multiplying N).

As the “predetermined condition”, the frequency ratio of the plurality of second frequency components that can affect the comfort of the sensible vibration realized by the vibration signal including all of the plurality of second frequency components is taken into consideration. It is preferable that appropriate conditions are determined. In other words, it is preferable that an appropriate condition is determined in consideration of the frequency ratio of the plurality of second frequency components that may affect whether or not the plurality of second frequency components are in a relationship that generates a consonant sound. As such a predetermined condition, for example, as described in detail later, “a ratio in which the frequency ratio of the plurality of second frequency components is a ratio that can realize a chord (particularly a chord preferable for the user) or does not generate a dissonance. An example of the condition is “becomes”. However, considering that the feeling of chords and dissonances varies from user to user, different predetermined conditions (that is, predetermined conditions optimized or adjusted for each user) may be used. Of course, a predetermined condition common to all users may be used.

More specifically, as such a predetermined condition, as described in detail later, for example, a condition that “the frequency ratio of the plurality of second frequency components is a ratio of natural numbers equal to or less than a predetermined value” The frequency ratio of the second frequency components of the second frequency component is a ratio between a natural number of one digit and a natural number of two digits (preferably a natural number of 10 to 19), or the frequency ratio of the plurality of second frequency components is An example is a condition that “the ratio is a single-digit natural number (or a simple natural number ratio)”.

The generating means generates a vibration signal from the acoustic signal. At this time, according to the determination result of the determination unit, the generation unit includes any one of the vibration signal including the plurality of second frequency components and the vibration signal including any one of the plurality of second frequency components. One of the vibration signals is generated. In other words, according to the determination result of the determination unit, the generation unit generates a vibration signal including all of the plurality of second frequency components or two or more second frequency components of the plurality of second frequency components. Or a vibration signal including only one second frequency component of the plurality of second frequency components.

As described above, the vibration signal generation device of the present embodiment can generate a vibration signal including a plurality of second frequency components. That is, the vibration signal generation device of the present embodiment can generate a vibration signal including a plurality of second frequency components corresponding to a plurality of sounds (for example, music parts). For this reason, by using the vibration signal generation device of the present embodiment, the flow of the acoustic signal (as compared with the case where the user is provided with the sensible vibration based on the vibration signal including only the single second frequency component) In other words, the user can be provided with vibrations that are relatively well matched to the music flow). In other words, by using the vibration signal generation device according to the present embodiment, compared to the case where the user is provided with a user-sensed vibration based on a vibration signal including only a single second frequency component, the user can experience a thicker sensory vibration. Is provided.

On the other hand, the vibration signal generation device of the present embodiment has a vibration signal including a single second frequency component instead of a vibration signal including a plurality of second frequency components depending on the frequency ratio of the plurality of second frequency components. Can be generated. For this reason, the vibration signal generation device according to the present embodiment has a plurality of second frequency components when, for example, a plurality of second frequency components interfere with each other or do not resonate beautifully, and thus a dissonance can be generated. A vibration signal including a single second frequency component can be generated instead of the vibration signal including. For this reason, it is possible to provide the user with a more pleasant sensation vibration (for example, a more comfortable sensation vibration considering a chord).

<2>
In another aspect of the vibration signal generation device of the present embodiment, the generation means generates (i) the vibration signal including the plurality of second frequency components when the frequency ratio satisfies the predetermined condition, (ii) When the frequency ratio does not satisfy the predetermined condition, the vibration signal including any one second frequency component of the plurality of second frequency components is generated.

According to this aspect, when the frequency ratio satisfies a predetermined condition (for example, the frequency ratio is a ratio that can realize a chord (particularly a chord preferable for the user) or a ratio that does not generate a dissonance). A vibration signal including a plurality of second frequency components can be generated. On the other hand, when the frequency ratio does not satisfy a predetermined condition (for example, the frequency ratio is not a ratio that can realize a chord or a ratio that can generate a dissonance), a plurality of second frequency components are generated. The vibration signal including any one of the second frequency components can be generated.

<3>
In another aspect of the vibration signal generation device according to the present embodiment, the determination unit determines whether the frequency ratio is a ratio at which the plurality of second frequency components can realize a chord or a ratio that does not generate a dissonance. Determine whether.

According to this aspect, the determination means determines whether the frequency ratio of the plurality of second frequency components satisfies a predetermined condition (for example, the frequency ratio is a ratio that can realize a chord (particularly a chord preferable for the user) or a dissonance) It can be suitably determined whether the ratio is not generated).

It should be noted that in consideration of how the feeling of chords and dissonances varies from user to user, it is preferable that the “ratio where the chord can be realized or the ratio that does not generate dissonance” is appropriately adjusted for each user. Of course, a ratio common to all users may be used as “a ratio that can realize a chord or a ratio that does not generate a dissonance”.

<4>
As described above, in the aspect of the vibration signal generating apparatus that determines whether the frequency ratio is a ratio at which the plurality of second frequency components can achieve a chord or a ratio that does not generate a dissonance, the generating unit includes: i) when the frequency ratio is a ratio at which the plurality of second frequency components can realize a chord or a ratio that does not generate a dissonance, the vibration signal including the plurality of second frequency components is generated; (ii) When the frequency ratio is not a ratio at which the plurality of second frequency components can realize a chord or does not generate a dissonance, the first frequency of any one of the plurality of second frequency components The vibration signal including two frequency components is generated.

According to this aspect, in the case where the frequency ratio is a ratio that can realize a chord (particularly a chord that is preferable for the user) or a ratio that does not generate a dissonance), the generation unit generates a plurality of second frequency components. A vibration signal can be generated. On the other hand, when the frequency ratio does not become a ratio that can realize a chord or is a ratio that can generate a dissonance, the generation unit uses any one second frequency component of the plurality of second frequency components. A vibration signal can be generated.

<5>
In another aspect of the vibration signal generation device of the present embodiment, the determination unit determines whether or not the frequency ratio is a natural number ratio equal to or less than a predetermined value.

<6>
As described above, in the aspect of the vibration signal generating apparatus that determines whether or not the frequency ratio is a ratio of a natural number equal to or less than a predetermined value, the generation unit (i) The vibration signal including the plurality of second frequency components is generated, and (ii) any one of the plurality of second frequency components when the frequency ratio is not a natural number ratio equal to or less than a predetermined value. The vibration signal including one second frequency component is generated.

According to this aspect, the generation unit is a ratio of natural numbers whose frequency ratio is equal to or less than a predetermined value (for example, the frequency ratio is a ratio that can realize a chord (particularly a chord preferable for the user) or does not generate a dissonance. In this case, a vibration signal including a plurality of second frequency components can be generated. On the other hand, when the frequency ratio does not become a ratio of natural numbers equal to or less than a predetermined value (for example, the frequency ratio does not become a ratio that can realize a chord or becomes a ratio that can generate a dissonance), A vibration signal including any one of the second frequency components can be generated.

<7>
In another aspect of the vibration signal generation device of the present embodiment, the extraction unit extracts the plurality of first frequency components having higher signal strength than the other frequency components from the acoustic signal.

According to this aspect, the extracting means can suitably extract a plurality of first frequency components.

<8>
In another aspect of the vibration signal generation device of the present embodiment, an electro-mechanical vibration conversion device that generates mechanical vibration based on the vibration signal is the machine that is caused by deviation of a plurality of frequency components included in the vibration signal. When used in a state in which vibration undulation is allowed, the generation means includes the vibration signal including the plurality of second frequency components and the second frequency of any one of the plurality of second frequency components. Instead of the vibration signal including a component, the vibration signal including a predetermined frequency component and a frequency component in the vicinity of the predetermined frequency component is generated.

According to this aspect, the generation means is used in a state where the electro-mechanical vibration conversion device allows mechanical vibration undulations (that is, mechanical vibration undulations caused by deviations of a plurality of frequency components included in the vibration signal). In this case, it is possible to generate a vibration signal including a predetermined frequency component and a frequency component in the vicinity of the predetermined frequency component. In this case, the sensory vibration based on such a vibration signal is provided to the user as a swell due to a frequency shift between a predetermined frequency component and a frequency component in the vicinity of the predetermined frequency component. For this reason, the user can enjoy body vibration such as massage. That is, according to this aspect, the generation unit can switch the vibration signal to be generated according to the application of the electro-mechanical vibration converter.

In this aspect, the extraction means is a state in which the electro-mechanical vibration conversion device that generates mechanical vibration based on the vibration signal allows mechanical vibration undulation caused by a shift of a plurality of frequency components included in the vibration signal. In the case of being used in the above, it is not necessary to extract a plurality of first frequency components. In other words, the extraction means is not used in a state where the electro-mechanical vibration conversion device that generates mechanical vibration based on the vibration signal allows mechanical vibration undulation caused by a shift of a plurality of frequency components included in the vibration signal. In this case, a plurality of first frequency components may be extracted.

Similarly, the determination means is used in a state in which the electro-mechanical vibration conversion device that generates mechanical vibration based on the vibration signal allows mechanical vibration undulation caused by deviation of a plurality of frequency components included in the vibration signal. In this case, it is not necessary to determine whether or not the frequency ratio satisfies a predetermined condition. In other words, the determination unit is not used in a state where the electro-mechanical vibration conversion device that generates mechanical vibration based on the vibration signal allows mechanical vibration undulation caused by a shift of a plurality of frequency components included in the vibration signal. In this case, it may be determined whether the frequency ratio satisfies a predetermined condition.

(Embodiment of vibration signal generation method)
<9>
The vibration signal generation method of the present embodiment generates a vibration signal that includes a frequency component in a vibration frequency band that is a frequency band narrower than the audible band, from an acoustic signal that includes a frequency component in the audible band. In the generation method, an extraction step of extracting a plurality of first frequency components from the acoustic signal, and a plurality of first frequency components obtained by converting the plurality of first frequency components into frequency components that fall within the vibration frequency band. A determination step of determining whether a frequency ratio of two frequency components satisfies a predetermined condition; and (i) the vibration signal including the plurality of second frequency components, and (ii) according to a determination result of the determination step A generation step of generating any one of the vibration signals including any one second frequency component of the plurality of second frequency components.

According to the vibration signal generation method of the present embodiment, various effects that can be enjoyed by the vibration signal generation device of the present embodiment described above can be suitably enjoyed.

Incidentally, in response to the various aspects adopted by the vibration signal generation apparatus of the present embodiment described above, the vibration signal generation method of the present embodiment can also adopt various aspects.

(Embodiment of computer program)
<10>
The computer program according to the present embodiment causes the computer to function as the vibration signal generating device according to the present embodiment described above (including various aspects thereof).

According to the computer program of this embodiment, various effects that can be enjoyed by the above-described vibration signal generation device of this embodiment can be suitably enjoyed.

Incidentally, in response to the various aspects adopted by the vibration signal generation device of the present embodiment described above, the computer program of the present embodiment can also adopt various aspects.

(Embodiment of recording medium)
<11>
The recording medium of the present embodiment stores the above-described computer program of the present embodiment (including various aspects thereof).

According to the recording medium of the present embodiment, various effects that can be enjoyed by the above-described vibration signal generation device of the present embodiment can be suitably enjoyed.

Incidentally, in response to the various aspects adopted by the vibration signal generation apparatus of the present embodiment described above, the recording medium of the present embodiment can also adopt various aspects.

(Embodiment of bodily sensation acoustic system)
<12>
The bodily sensation vibration system of this embodiment is a bodily sensation sound system including a terminal device, a server device, and an electromechanical vibration conversion device that are connected to each other via a network. And storing means for storing music information indicating a list of the plurality of music data, wherein the terminal device receives the music information via the network, receiving means capable of receiving user input, and The music which is a signal for specifying one piece of music data among the plurality of pieces of music data indicated by the music information in response to the input of the user received by the receiving means and the display means displayed to the user First communication means for transmitting a specific signal to the server device via the network, wherein the server device is characterized by the music specific signal. A vibration signal comprising a frequency component within a vibration frequency band that is a frequency band narrower than the audible band, from an acoustic signal corresponding to a piece of music data and including a frequency component within the audible band A vibration signal generation device that generates a plurality of first frequency components from the acoustic signal, and converts the plurality of first frequency components into frequency components that fall within the vibration frequency band. A determination unit that determines whether or not a frequency ratio of a plurality of second frequency components obtained satisfies a predetermined condition; and (i) the vibration including the plurality of second frequency components according to a determination result of the determination unit And (ii) generating means for generating any one of the vibration signals including any one of the plurality of second frequency components, and the vibration signal generated by the generating means , Via the network, the electro - further comprising a second communication means for transmitting the mechanical vibration converter.

According to the body sensation sound system of this embodiment, the terminal device, the server device, and the electro-mechanical vibration converter are connected to each other via a network such as the Internet or a LAN (Local Area Network). The terminal device includes an accepting unit and a first communication unit. The server device includes a storage unit, an extraction unit, a determination unit, a generation unit, and a second communication unit. For this reason, according to the body sensation sound system of this embodiment, the various effects which the vibration signal generation apparatus of this embodiment mentioned above can enjoy can be enjoyed suitably.

Incidentally, in response to the various aspects adopted by the vibration signal generation device of the present embodiment described above, the body sensation sound system of the present embodiment can also adopt various aspects.

Such an operation and other advantages of the present embodiment will be clarified from examples described below.

As described above, the vibration signal generation device according to the present embodiment includes the extraction unit, the determination unit, and the generation unit. The vibration signal generation method of the present embodiment includes an extraction step, a determination step, and a generation step. The computer program of this embodiment causes a computer to function as the vibration signal generation device of this embodiment. The recording medium of this embodiment stores the computer program of this embodiment. The body sensation sound system according to the present embodiment includes a server device including an extraction unit, a determination unit, and a generation unit, a terminal device, and an electromechanical vibration conversion device. Accordingly, it is possible to provide the user with a more suitable body vibration.

Hereinafter, examples will be described with reference to the drawings.

(1) Embodiment of Vibration Signal Generation Device First, the vibration signal generation device 10 of this embodiment will be described with reference to FIGS. 1 to 8.

(1-1) Configuration of Vibration Signal Generation Device First, the configuration of the vibration signal generation device 10 of the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram illustrating a configuration of a vibration signal generation device 10 according to the present embodiment. In FIG. 1, for convenience of explanation, only members that are directly related to the present invention are shown, and other members are not shown.

As shown in FIG. 1, the vibration signal generation device 10 of this embodiment includes a signal input unit 11, a purpose determination unit 12, an FFT (Fast Fourier Transform) processing unit 13, a frequency determination unit 14, and a frequency ratio determination. A unit 15, a frequency value determination unit 16, and a vibration signal generation unit 17 are provided. The purpose determination unit 12, the FFT processing unit 13, the frequency determination unit 14, the frequency ratio determination unit 15, the frequency value determination unit 16, and the vibration signal generation unit 17 may be physically configured by hardware such as an electronic circuit. Alternatively, it may be logically realized by software operating on the CPU. When the purpose determination unit 12, the FFT processing unit 13, the frequency determination unit 14, the frequency ratio determination unit 15, the frequency value determination unit 16, and the vibration signal generation unit 17 are logically realized by software operating on the CPU, The computer functions as the vibration signal generation device 10 by loading a recording medium storing the software (that is, a computer program) into the computer or by downloading the software to the computer via a communication line or the like. Can do.

The signal input unit 11 includes music data stored in a recording medium (not shown) (for example, a flash memory, a hard disk drive, and an optical disk), music data input via a microphone (not shown), Accepts input of music data etc. acquired via the network. As a result, an audio signal corresponding to the music data (that is, an audio signal including an audible frequency component ranging from 20 Hz to 20000 Hz) is input to the vibration signal generation device 10.

The purpose determination unit 12 determines the purpose of a system that uses the vibration signal generated by the vibration signal generation device 10 (for example, a bodily sensation acoustic system described in detail later with reference to FIGS. 9 to 12). Specifically, for example, the purpose determination unit 12 determines whether or not the purpose of the bodily sensation sound system is massage.

The FFT processing unit 13 performs FFT processing on the audio signal input to the signal input unit 11.

The frequency determination unit 14 is based on a plurality of sound components included in the audio signal input to the signal input unit 11 (in other words, sound components distinguished by frequency and substantially the same as the plurality of frequency components). Determine at least two sound components (in other words, frequency components) used to generate the vibration signal. In other words, the frequency determination unit 14 extracts at least two sound components used for generating a vibration signal from a plurality of sound components included in the audio signal input to the signal input unit 11. At this time, the frequency determination unit 14 is at least used for generating a vibration signal based on the power spectrum output from the FFT processing unit 13 (that is, the power spectrum of the audio signal input to the signal input unit 11). Two sound components are determined.

The frequency ratio determination unit 15 converts at least two sound components determined by the frequency determination unit 14 into frequency components in a vibration frequency band (for example, a frequency band extending from 60 Hz to 150 Hz) that is a frequency band narrower than the audible band. It is determined whether or not the frequency ratio of at least two vibration components obtained in this way satisfies a predetermined first condition.

The frequency value determination unit 16 converts the frequency of at least two vibration components obtained by converting at least two sound components determined by the frequency determination unit 14 into frequency components in a vibration frequency band that is a frequency band narrower than the audible band. It is determined whether the value satisfies a predetermined second condition.

The vibration signal generation unit 17 generates a vibration signal that is a signal including a frequency component in a vibration frequency band that is a frequency band narrower than the audible band, from an audio signal including a frequency component of the audible band. In particular, in this embodiment, the vibration signal generation unit 17 generates a vibration signal while referring to the determination result of the purpose determination unit 12, the determination result of the frequency ratio determination unit 15, and the determination result of the frequency value determination unit 16.

More specific operations of the purpose determination unit 12, the FFT processing unit 13, the frequency determination unit 14, the frequency ratio determination unit 15, the frequency value determination unit 16, and the vibration signal generation unit 17 are described below (from FIG. 2). Detailed description is omitted here for the purpose of detailing (see FIG. 8).

(1-2) Operation of Vibration Signal Generation Device Next, the operation of the vibration signal generation device 10 of this embodiment will be described with reference to FIGS. FIG. 2 is a flowchart showing an operation flow of the vibration signal generation device 10 of the present embodiment. FIG. 3 is a waveform diagram showing a waveform of an audio signal and a power spectrum diagram obtained by performing FFT processing on the audio signal.

As shown in FIG. 2, the purpose determination unit 12 determines whether or not the purpose of the bodily sensation sound system that uses the vibration signal generated by the vibration signal generation device 10 is massage (step S11). At this time, the purpose determination unit 12 may determine whether or not the purpose of the bodily sensation sound system is massage, for example, by monitoring the user's instruction content or the user's operation content. Specifically, for example, when an instruction content indicating that massage is desired is input from the user to the body sensation sound system, the purpose determination unit 12 may determine that the purpose of the body sensation sound system is massage. . On the other hand, for example, when the instruction content indicating that massage is desired is not input from the user to the sensory sound system, the purpose determination unit 12 may determine that the purpose of the sensory sound system is not massage.

When the purpose of the bodily sensation sound system is massage, on the bodily sensation sound system, mechanical vibration (that is, an electro-mechanical vibration converter, which will be described later) is caused by a frequency shift of a plurality of sound components included in the vibration signal. In many cases, the undulation of the mechanical vibration provided by 40 is allowed. In other words, when the purpose of the bodily sensation sound system is massage, since mechanical vibration undulations occur, the mechanical vibration corresponding to the vibration signal is often not synchronized with the audio signal. This is because such mechanical vibration undulations can contribute to an effective massage. Therefore, in addition to or instead of determining whether or not the purpose of the body sensory sound system is massage, the purpose determination unit 12 detects mechanical vibration caused by frequency shifts of a plurality of sound components included in the vibration signal. It may be determined whether or not the bodily sensation sound system allows swell. At this time, for example, the purpose determination unit 12 monitors the setting state of the sensory sound system, so that the sensory sound system allows mechanical vibration undulation caused by frequency shifts of a plurality of sound components included in the vibration signal. It may be determined whether or not.

As a result of the determination in step S11, the purpose of the bodily sensation sound system is massage (or the bodily sensation sound system allows undulation of mechanical vibration due to frequency shift of a plurality of sound components included in the vibration signal). If determined (step S11: Yes), the vibration signal generation unit 17 generates a vibration signal including a specific frequency component and a frequency component in the vicinity of the specific frequency component (step S18). At this time, the specific frequency component and the adjacent frequency component have a relationship shifted by about several Hz (for example, 1 Hz to 2 Hz). When a vibration signal including a plurality of frequency components whose frequencies are shifted by about several Hz is input to the electro-mechanical vibration converter 40 described later, the mechanical vibration generated by the electro-mechanical vibration converter 40 described later is swelled. (In other words, a swell of about several Hz corresponding to a frequency shift) occurs. As a result, the user can enjoy body vibration such as massage (that is, body vibration that can be felt as if massage is performed by undulation).

On the other hand, as a result of the determination in step S11, the purpose of the bodily sensation sound system is not massage (or the bodily sensation sound system does not allow undulation of mechanical vibration due to frequency shift of plural sound components included in the vibration signal ) (Step S11: No), the FFT processing unit 13 performs an FFT process on the audio signal input to the signal input unit 11 (step S12). As a result, the FFT processing unit 12 uses the FFT power (that is, the audio signal at a certain time t) as the signal on the frequency axis from the audio signal (see FIG. 3A) that is the signal on the time axis. The FFT power of each sound component of FIG. 3 (see FIG. 3B) can be calculated. In other words, the FFT processing unit 12 can calculate the power spectrum of the audio signal input to the signal input unit 11.

After that, the frequency determination unit 14 uses two sound components (specifically, two sound components used to generate a vibration signal from a plurality of sound components included in the audio signal based on the power spectrum calculated by the FFT processing unit 13. , First sound component and second sound component) are determined (step S13).

Here, as shown in FIG. 3B, the frequency determination unit 14 outputs the sound component having the highest FFT power (the sound component corresponding to the frequency f1 (t) in FIG. 3B) to the first. The sound component may be determined. Similarly, as shown in FIG. 3B, the frequency determining unit 14 converts the sound component having the second largest FFT power (the sound component corresponding to the frequency f2 (t) in FIG. 3B), You may determine as a 2nd sound component. However, the frequency determination unit 14 may determine the two sound components in other manners. For example, the frequency determination unit 14 may determine two sound components corresponding to a specific music part as sound components used to generate a vibration signal from a plurality of sound components included in the audio signal. Specifically, for example, the frequency determination unit 14 uses, from a plurality of sound components included in the audio signal, a sound component corresponding to vocal and a sound component corresponding to the drum to generate a vibration signal. May be determined as

The frequency determination unit 14 determines three or more sound components used for generating a vibration signal from a plurality of sound components included in the audio signal based on the power spectrum calculated by the FFT processing unit 13. May be. However, in the following, for simplification of description, the description will be made using an example in which the frequency determination unit 14 determines two sound components (that is, the first and second sound components).

Thereafter, the frequency ratio determination unit 15 converts the first and second sound components determined by the frequency determination unit 14 into frequency components within the vibration frequency band, and specifically, the two vibration components (specifically, the first sound component). It is determined whether or not the frequency ratio of the vibration component and the second vibration component satisfies a predetermined first condition (step S14). That is, the frequency ratio determination unit 15 determines that the ratio between the frequency of the first vibration component obtained by converting the first sound component and the frequency of the second vibration component obtained by converting the second sound component is predetermined. It is determined whether or not the first condition is satisfied.

Note that the vibration frequency band may be automatically set by the vibration signal generation device 10, for example. Alternatively, the vibration frequency band may be manually set by the user of the vibration signal generation device 10. However, the vibration frequency band is preferably a frequency band that can be appropriately converted into mechanical vibration by an electro-mechanical vibration converter 40 (see FIGS. 9 to 12) described later. Therefore, the vibration frequency band is preferably set as appropriate according to the performance of the target electro-mechanical vibration converter 40. An example of such a vibration frequency band is a frequency band in the range of 60 Hz to 150 Hz.

Here, the frequency ratio determination unit 15 may determine whether or not the frequency ratio of the first and second vibration components is a single-digit natural number ratio. Specifically, for example, the frequency ratio determination unit 15 determines the frequency of the first vibration component: the frequency of the second vibration component = A1 (where A1 is a natural number satisfying 1 ≦ A1 ≦ 9): A2 (where A2 May be determined whether or not the condition of a natural number satisfying 1 ≦ A2 ≦ 9 is satisfied. When the frequency ratio of the first and second vibration components is a natural digit ratio, the frequency ratio determination unit 15 determines that the frequency ratio of the first and second vibration components satisfies the first condition. Also good. On the other hand, when the frequency ratio of the first and second vibration components does not become a natural digit ratio, the frequency ratio determination unit 15 does not satisfy the first condition. May be determined.

However, the frequency ratio determination unit 15 determines whether or not the frequency ratio between the first and second vibration components is a ratio between a natural number of one digit and a natural number of two digits (preferably a natural number of 10 or more and 19 or less). You may judge. Specifically, for example, the frequency ratio determination unit 15 determines the frequency of the first vibration component: the frequency of the second vibration component = B1 (where B1 is a natural number satisfying 1 ≦ B1 ≦ 9): B2 (where B2 Or a natural number satisfying 10 ≦ B2 ≦ 19) or the condition of the frequency of the first vibration component: the frequency of the second vibration component = B2: B1 may be determined. When the frequency ratio of the first and second vibration components is a ratio between a natural number of one digit and a natural number of two digits, the frequency ratio determination unit 15 determines that the frequency ratio of the first and second vibration components is the first condition. You may determine with satisfy | filling. On the other hand, when the frequency ratio between the first and second vibration components does not become a ratio between the natural number of one digit and the natural number of two digits, the frequency ratio determination unit 15 determines that the frequency ratio of the first and second vibration components is It may be determined that the first condition is not satisfied.

In addition, the frequency ratio determination unit 15 may determine whether or not the frequency ratio between the first and second vibration components is a two-digit natural number (preferably a natural number of 10 or more and 19 or less). . Specifically, for example, the frequency ratio determination unit 15 determines the frequency of the first vibration component: the frequency of the second vibration component = C1 (where C1 is a natural number satisfying 10 ≦ C1 ≦ 19): C2 (where C2 May be determined whether or not the condition of a natural number satisfying 10 ≦ C2 ≦ 19 is satisfied. When the frequency ratio between the first and second vibration components is a two-digit natural number ratio, the frequency ratio determination unit 15 determines that the frequency ratio between the first and second vibration components satisfies the first condition. Also good. On the other hand, when the frequency ratio of the first and second vibration components does not become a natural number ratio of two digits, the frequency ratio determination unit 15 does not satisfy the first condition. May be determined.

However, the determination as to whether the frequency ratio between the first and second vibration components is the natural number ratio described above is an example of a determination operation performed by the frequency ratio determination unit 15. Therefore, the frequency ratio determination unit 15 may determine whether or not the frequency ratio of the first and second vibration components satisfies the first condition in another aspect. For example, the frequency ratio determination unit 15 can provide a comfortable sensation vibration to the user by using a vibration signal in which the frequency ratio of the first and second vibration components includes the first and second vibration components. It may be determined whether or not. When the frequency ratio between the first and second vibration components is a ratio that can provide a pleasant sensation vibration to the user, the frequency ratio determination unit 15 determines that the frequency ratio between the first and second vibration components is the first. It may be determined that one condition is satisfied. On the other hand, when the frequency ratio between the first and second vibration components does not reach a ratio that can provide a comfortable vibration for the user, the frequency ratio determination unit 15 determines the frequency of the first and second vibration components. It may be determined that the ratio does not satisfy the first condition.

Specifically, for example, even when the frequency ratio of the first and second vibration components does not become the above-described natural number ratio (for example, when it becomes a two-digit natural number ratio of 20 or more), the first and second vibration components There may be a user who feels that the sensible vibration realized by the vibration signal including both vibration components is comfortable. Therefore, even if the frequency ratio of the first and second vibration components is a desired ratio other than the natural number ratio described above, the frequency ratio of the first and second vibration components is determined to satisfy the first condition. Also good.

Alternatively, for example, when the first and second vibration components generate a chord (particularly a chord preferable for the user) or do not generate a dissonance (particularly a dissonance that is not preferable for the user), the first and second vibration components There may be a user who feels that the sensible vibration realized by the vibration signal including both is comfortable. Therefore, even when the frequency ratio of the first and second vibration components is a ratio in which the first and second vibration components generate a chord or do not generate a dissonance, the frequency ratio of the first and second vibration components is the first. It may be determined that one condition is satisfied.

Alternatively, for example, when the first and second sound components generate a chord (particularly a chord preferable for the user) or do not generate a dissonance (particularly a dissonance that is not preferable for the user), the first and second sound components There may be a user who feels that the sensation vibration realized by the vibration signal including both the first and second vibration components obtained by converting the sound is pleasant. Therefore, even when the frequency ratio of the first and second vibration components is a ratio in which the first and second sound components generate chords or do not generate dissonance, the frequency ratio of the first and second vibration components is the first. It may be determined that one condition is satisfied.

Further, the first condition may be set individually for each user who uses the body sensation sound system. This is because the first condition is preferably set from the viewpoint of improving the comfort of the sensation vibration realized by the vibration signal, but the comfort of the sensation vibration can vary depending on the user.

In addition, as described above, in the present embodiment, the frequency determination unit 14 may determine N or more (N is an integer of 3 or more) sound components used for generating a vibration signal. In this case, the frequency ratio determination unit 15 determines whether the frequency ratio of the N vibration components obtained by converting the N sound components into the frequency components in the vibration frequency band satisfies the first condition. May be. For example, the frequency ratio determination unit 15 determines the frequency of the first vibration component: the frequency of the second vibration component:...: The frequency of the Nth vibration component = A1 (where A1 is a natural number satisfying 1 ≦ A1 ≦ 9). : A2 (where A2 is a natural number satisfying 1 ≦ N2 ≦ 9):...: AN (provided that AN is a natural number satisfying 1 ≦ AN ≦ 9). May be.

In addition, the conversion of the first and second sound components corresponds to a conversion that lowers the scale by a predetermined octave. Accordingly, the ratio of the frequency of the first vibration component obtained by lowering the scale of the first sound component by a predetermined octave and the frequency of the second vibration component obtained by lowering the scale of the second sound component by a predetermined octave is: It becomes equal to the ratio of the frequency of the sound component and the frequency of the second sound component. Therefore, in addition to or instead of determining whether the frequency ratio of the first and second vibration components satisfies the first condition, the frequency ratio determination unit 15 determines the frequency ratio of the first and second sound components. It may be determined whether or not the first condition is satisfied.

As a result of the determination in step S14, when it is determined that the frequency ratio of the first and second vibration components does not satisfy the first condition (step S14: No), the vibration signal generation unit 17 performs the first and second vibrations. A vibration signal including only one of the vibration components is generated (step S17). In other words, the vibration signal generation unit 17 does not generate a vibration signal including both the first and second vibration components. This is because when the frequency ratio of the first and second vibration components does not satisfy the first condition (that is, the frequency ratio of the first and second sound components does not satisfy the first condition), the first vibration component Like the first sound component and the second sound component, the second vibration component may interfere with each other. In this case, the sensory vibration realized by the vibration signal including both the first and second vibration components is a sensory vibration such as a so-called dissonance. As a result, the sensory vibration realized by the vibration signal including both the first and second vibration components whose frequency ratio does not satisfy the first condition may not be comfortable for the user. Therefore, in the present embodiment, when the frequency ratio between the first and second vibration components does not satisfy the first condition, a vibration signal including only one of the first and second vibration components is generated. This eliminates such technical problems.

The amplitude of the vibration signal including only one of the first and second vibration components may be determined according to the amplitude of one of the first and second vibration components. For example, the amplitude of the vibration signal generated by the vibration signal generation unit 11 may be proportional to or similar to the amplitude of one of the first and second vibration components.

As described above, in the present embodiment, the frequency ratio determination unit 15 has the first frequency ratio of the N vibration components obtained by converting the N sound components into the frequency components in the vibration frequency band. It may be determined whether the condition is satisfied. In this case, when it is determined that the frequency ratio of the N vibration components does not satisfy the first condition, the vibration signal generation unit 17 includes the vibration signal including only one vibration component of the N vibration components. May be generated.

On the other hand, as a result of the determination in step S14, when it is determined that the frequency ratio of the first and second vibration components satisfies the first condition (step S14: Yes), subsequently, the frequency ratio determination unit 15 Two vibration components (specifically, the first vibration component and the second vibration component) obtained by converting the first and second sound components determined by the frequency determination unit 14 into frequency components within the vibration frequency band. It is determined whether or not the frequency value satisfies a predetermined second condition (step S15). That is, the frequency ratio determination unit 15 has a frequency value of the first vibration component obtained by converting the first sound component and a frequency value of the second vibration component obtained by converting the second sound component, It is determined whether or not a predetermined second condition is satisfied.

Here, the frequency value determination unit 16 may determine whether or not the frequency values of the first and second vibration components are below a low interval limit (LIL: Low Interval Limit). When the frequency values of the first and second vibration components do not fall below the low interval limit, the frequency ratio determination unit 15 may determine that the frequency values of the first and second vibration components satisfy the second condition. . On the other hand, when the frequency values of the first and second vibration components are below the low interval limit, the frequency ratio determination unit 15 determines that the frequency values of the first and second vibration components do not satisfy the second condition. May be.

Here, the low interval limit will be described with reference to FIG. FIG. 4 is a musical score showing a musical scale that becomes a low interval limit.

As shown in FIG. 4, the low interval limit is set so that the sound does not become muddy when a plurality of sounds having different scales (for example, two sounds in FIG. 4) are played simultaneously or within a minute time. It means the limit pitch. In other words, the “low interval limit” means a limit pitch that can be heard turbidly when a plurality of sounds each having a predetermined scale (for example, two sounds in FIG. 4) are emitted in a lower sound range. Such a low interval limit is determined in advance for each type of chord as shown in FIG.

However, the determination of whether or not the frequency values of the first and second vibration components are equal to or lower than the low interval limit is an example of a determination operation performed by the frequency value determination unit 16. Therefore, the frequency value determination unit 16 may determine whether or not the frequency values of the first and second vibration components satisfy the second condition in another manner. For example, the frequency value determination unit 16 is a lower limit at which the frequency values of the first and second vibration components can provide comfortable bodily sensation vibration to the user by using vibration signals including the first and second vibration components. You may determine whether it becomes below a value. If the frequency values of the first and second vibration components do not fall below the lower limit value that can provide a comfortable sensation vibration to the user, the frequency value determination unit 16 determines the frequency values of the first and second vibration components. May be determined to satisfy the second condition. On the other hand, when the frequency values of the first and second vibration components are equal to or lower than the lower limit value that can provide a comfortable sensation vibration to the user, the frequency value determination unit 16 determines the first and second vibration components. May be determined not to satisfy the second condition.

In addition, as described above, in the present embodiment, the frequency determination unit 14 may determine N or more (N is an integer of 3 or more) sound components used for generating a vibration signal. In this case, the frequency value determination unit 16 sets the frequency values of at least two vibration components out of the frequency values of the N vibration components obtained by converting the N sound components into frequency components within the vibration frequency band. After paying attention, it may be determined whether the frequency values of the two vibration components satisfy the second condition.

As a result of the determination in step S15, when it is determined that the frequency values of the first and second vibration components do not satisfy the second condition (step S15: No), the vibration signal generation unit 17 performs the first and second vibrations. A vibration signal including only one of the vibration components is generated (step S17). In other words, the vibration signal generation unit 17 does not generate a vibration signal including both the first and second vibration components. This is because when the frequency values of the first and second vibration components do not satisfy the second condition (that is, the frequency values of the first and second sound components do not satisfy the second condition), the first vibration component Like the first sound component and the second sound component, the second vibration component may not resonate beautifully. In this case, the sensory vibration realized by the vibration signal including both the first and second vibration components is a sensory vibration such as a so-called dissonance (that is, a sensory vibration at a frequency of a chord lower than the low interval limit). As a result, the sensory vibration realized by the vibration signal including both the first and second vibration components whose frequency values do not satisfy the second condition may not be comfortable for the user. Therefore, in this embodiment, when the frequency values of the first and second vibration components do not satisfy the second condition, a vibration signal including only one of the first and second vibration components is generated. This eliminates such technical problems.

As described above, in the present embodiment, the frequency value determination unit 16 uses the second frequency value of the N vibration components obtained by converting the N sound components into the frequency components in the vibration frequency band. It may be determined whether the condition is satisfied. In this case, when it is determined that the frequency values of the N vibration components do not satisfy the second condition, the vibration signal generation unit 17 includes the vibration signal including only one vibration component of the N vibration components. May be generated.

On the other hand, as a result of the determination in step S15, when it is determined that the frequency values of the first and second vibration components satisfy the second condition (step S15: Yes), the vibration signal generation unit 17 A vibration signal including both of the second vibration components is generated (step S17).

The amplitude of the vibration signal including only the vibration components of both the first and second vibration components may be determined according to the amplitude of both the vibration components of the first and second vibration components. For example, the amplitude of the vibration signal generated by the vibration signal generation unit 11 may be proportional to or similar to the amplitude of the vibration component obtained by combining the first and second vibration components.

As described above, in the present embodiment, the frequency ratio determination unit 15 has the first frequency ratio of the N vibration components obtained by converting the N sound components into the frequency components in the vibration frequency band. It may be determined whether the condition is satisfied. Similarly, in this embodiment, the frequency value determination unit 16 determines whether the frequency values of the N vibration components obtained by converting the N sound components into the frequency components in the vibration frequency band satisfy the second condition. It may be determined whether or not. In this case, when it is determined that the frequency ratio of the N vibration components satisfies the first condition and the frequency value of the N vibration components satisfies the second condition, the vibration signal generation unit 17 A vibration signal including at least two vibration components of the vibration components may be generated.

In the present embodiment, the frequency value of the first and second vibration components is changed to the first after the determination (step S14) whether or not the frequency ratio of the first and second vibration components satisfies the first condition. Whether or not two conditions are satisfied is determined (step S15). However, after determining whether the frequency values of the first and second vibration components satisfy the second condition (step S15), does the frequency ratio of the first and second vibration components satisfy the first condition? Determination of whether or not (step S14) may be performed.

Alternatively, in this embodiment, it is determined whether or not the frequency ratio between the first and second vibration components satisfies the first condition (step S14) and whether the frequency values of the first and second vibration components satisfy the second condition. Both determinations (step S15) are made. However, it is determined whether or not the frequency ratio of the first and second vibration components satisfies the first condition (step S14) and whether or not the frequency values of the first and second vibration components satisfy the second condition (step S14). Only one of the determinations in step S15) may be performed. That is, it is determined whether the frequency ratio of the first and second vibration components satisfies the first condition (step S14), while the frequency value of the first and second vibration components satisfies the second condition. The determination of whether or not (step S15) may not be performed. Similarly, it is determined whether the frequency values of the first and second vibration components satisfy the second condition (step S15), while the frequency ratio of the first and second vibration components satisfies the first condition. Or not (step S14) may not be performed.

Here, referring to FIG. 5 to FIG. 8, the generation of the vibration signal according to whether the frequency ratio of the first and second vibration components satisfies the first condition, and the frequency values of the first and second vibration components The generation of the vibration signal according to whether or not the second condition is satisfied will be described in more detail. FIG. 5 is a graph showing an aspect of generation of a vibration signal when the frequency ratio between the first and second vibration components satisfies the first condition. FIG. 6 is a graph showing an aspect of generation of a vibration signal when the frequency ratio between the first and second vibration components does not satisfy the first condition. FIG. 7 is a graph showing a manner of generating a vibration signal when the frequency values of the first and second vibration components satisfy the second condition. FIG. 8 is a graph showing an aspect of generation of a vibration signal when the frequency values of the first and second vibration components do not satisfy the second condition.

As shown in FIG. 5, it is assumed that the frequency determination unit 14 has determined the first sound component corresponding to the frequency of 400 Hz and the second sound component corresponding to the frequency of 500 Hz. In this case, the first and second sound components have a first vibration component corresponding to a frequency of 100 Hz and a first frequency component corresponding to a frequency of 125 Hz by lowering the respective scales of the first and second sound components by two octaves. It is converted into two vibration components. The frequency ratio of the first and second vibration components is 100: 125 = 4: 5. That is, in the example shown in FIG. 5, the frequency ratio between the first and second vibration components is a single-digit natural number ratio. As a result, in the example illustrated in FIG. 5, the vibration signal generation unit 17 generates a vibration signal including both the first vibration component corresponding to the frequency of 100 Hz and the second vibration component corresponding to the frequency of 125 Hz.

As shown in FIG. 6, it is assumed that the frequency determination unit 14 has determined the first sound component corresponding to the frequency of 400 Hz and the second sound component corresponding to the frequency of 400 Hz. In this case, the first and second sound components have the first vibration component corresponding to the frequency of 100 Hz and the first frequency corresponding to the frequency of 110 Hz by lowering the respective scales of the first and second sound components by two octaves. It is converted into two vibration components. The frequency ratio of the first and second vibration components is 100: 110 = 10: 11. That is, in the example shown in FIG. 6, the frequency ratio between the first and second vibration components is not a single-digit natural number ratio. As a result, in the example illustrated in FIG. 6, the vibration signal generation unit 17 has one of the first vibration component corresponding to the frequency of 100 Hz and the second vibration component corresponding to the frequency of 110 Hz (for example, A vibration signal including only the first vibration component having a higher FFT power is generated.

7, it is assumed that the frequency determination unit 14 has determined the first sound component corresponding to the frequency of 480 Hz and the second sound component corresponding to the frequency of 600 Hz. In this case, the first and second sound components have a first vibration component corresponding to a frequency of 120 Hz and a first frequency component corresponding to a frequency of 150 Hz by lowering the respective scales of the first and second sound components by two octaves. It is converted into two vibration components. The frequency ratio of the first and second vibration components is 120: 150 = 4: 5. Accordingly, the first and second vibration components correspond to chords with a length of 3 degrees. The low interval limit for a chord of 3 degrees is 112.6: 140.8 (see FIG. 4). Therefore, in the example shown in FIG. 7, the frequency values (120: 150) of the first and second vibration components do not fall below the low interval limit (112.6: 140.8). As a result, in the example illustrated in FIG. 7, the vibration signal generation unit 17 generates a vibration signal including both the first vibration component corresponding to the frequency of 120 Hz and the second vibration component corresponding to the frequency of 150 Hz.

As shown in FIG. 8, it is assumed that the frequency determination unit 14 has determined a first sound component corresponding to a frequency of 400 Hz and a second sound component corresponding to a frequency of 500 Hz. In this case, the first and second sound components have a first vibration component corresponding to a frequency of 100 Hz and a first frequency component corresponding to a frequency of 125 Hz by lowering the respective scales of the first and second sound components by two octaves. It is converted into two vibration components. The frequency ratio of the first and second vibration components is 100: 125 = 4: 5. Accordingly, the first and second vibration components correspond to chords with a length of 3 degrees. The low interval limit for a chord of 3 degrees is 112.6: 140.8 (see FIG. 4). Therefore, in the example shown in FIG. 8, the frequency values (100: 125) of the first and second vibration components are below the low interval limit (112.6: 140.8). As a result, in the example illustrated in FIG. 8, the vibration signal generation unit 17 has either one of the first vibration component corresponding to the frequency of 100 Hz and the second vibration component corresponding to the frequency of 125 Hz (for example, A vibration signal including only the first vibration component having a higher FFT power is generated.

According to the vibration signal generation device 10 of the present embodiment described above, the following technical effects are realized.

First, the vibration signal generation device 10 of this embodiment can generate a vibration signal including both the first and second vibration components. That is, the vibration signal generation device 10 of the present embodiment can generate a vibration signal including a plurality of vibration components corresponding to a plurality of sound components. For this reason, by using the vibration signal generation device 10 of this embodiment, the flow of the audio signal (so to speak) is compared with the case where the user is provided with the sensible vibration based on the vibration signal including only a single vibration component. , Vibrations that are relatively well matched to the music flow) are provided to the user. In other words, by using the vibration signal generation device 10 of the present embodiment, compared with a case where a user is provided with a body vibration based on a vibration signal including only a single vibration component, a thick body vibration is provided. Provided.

On the other hand, the vibration signal generation device 10 of the present embodiment replaces the vibration signal including both the first and second vibration components depending on the frequency ratio or the frequency value of the plurality of vibration components, and the first and second vibrations. A vibration signal including only one of the vibration components can be generated.

Specifically, when it is determined that the frequency ratio between the first and second vibration components does not satisfy the first condition, the vibration signal generation unit 17 performs vibration of either one of the first and second vibration components. A vibration signal including only components is generated. As a result, the user is provided with little or no bodily sensation vibration such as a dissonance due to a vibration signal including both the first and second vibration components whose frequency ratio does not satisfy the first condition. Therefore, in this embodiment, even if the frequency ratio between the first and second vibration components does not satisfy the first condition, a vibration signal including only one of the first and second vibration components is generated. Since it is generated, vibrations that are comfortable for the user are provided.

In addition, when it is determined that the frequency values of the first and second vibration components do not satisfy the second condition, the vibration signal generation unit 17 determines only one of the first and second vibration components. A vibration signal including is generated. As a result, the user is provided with little or no bodily sensation vibration such as a dissonance due to the vibration signal including both the first and second vibration components whose frequency values do not satisfy the second condition. Therefore, in this embodiment, even if the frequency values of the first and second vibration components do not satisfy the second condition, a vibration signal including only one of the first and second vibration components is generated. Since it is generated, vibrations that are comfortable for the user are provided.

As described above, the vibration signal generation device 10 according to the present embodiment can provide the user with more suitable body vibration.

(2) Example of body sensation sound system Hereinafter, an example when the vibration signal generation device 10 of this embodiment is applied to the body sensation sound system will be described with reference to FIGS. 9 to 12.

(2-1) First Example of a Sensory Sound System First, a sensory sound system 100 of a first example will be described with reference to FIG. FIG. 9 is a block diagram illustrating a configuration of the acoustic experience system according to the first example. In addition, the arrow in a figure has shown the flow of a signal (same in subsequent figures).

As shown in FIG. 9, the body sensation acoustic system 100 of the first embodiment includes a vibration signal generation device 10 and an electro-mechanical vibration converter 40.

The signal input unit 11 receives an input of an audio signal supplied from the outside. As a result, the vibration signal generation unit 14 generates a vibration signal in the manner described above. The vibration signal generated by the vibration signal generation unit 14 is supplied to the electro-mechanical vibration converter 40. As a result, the electro-mechanical vibration converter 40 converts the vibration signal into mechanical vibration, thereby providing a suitable body vibration for the user.

(2-2) Second Example of the Sensory Sound System Next, a sensory sound system 200 of the second example will be described with reference to FIG. FIG. 10 is a block diagram showing the configuration of the acoustic experience system 200 of the second embodiment. In addition, below, the description which overlaps with the body sensation sound system 100 of 1st Example is abbreviate | omitted, and the same code | symbol is attached | subjected and shown to a common location on drawing, and only a different point is demonstrated.

As shown in FIG. 10, the sensory sound system 200 of the second embodiment includes a vibration signal generation device 10, a user interface unit 20, a memory 30, an electro-mechanical vibration converter 40, and a delay circuit (Delay) 50. And an output terminal (Audio OUT) 60.

The user interface unit 20 includes a display unit (not shown) that provides the user with a music selection screen, a mode selection screen, and the like, and buttons (not shown) for the user to perform input operations.

The “music selection screen” displays a list of one or more music data stored in advance in the memory 30 such as a flash memory.

In the “mode selection screen”, a name (for example, “massage execution”) corresponding to the purpose of the body sensation sound system 200 is displayed. The purpose determination unit 12 included in the vibration signal generation device 10 may determine whether or not the purpose of the bodily sensation sound system 200 is massage by monitoring the user's operation content via the mode selection screen.

When a user selects one piece of music data from the list of music data displayed on the music selection screen, a signal indicating the selected one piece of music data is transmitted from the user interface unit 20 to the memory 30. . Then, one piece of music data (that is, an audio signal corresponding to one piece of music data) is transmitted from the memory 30 to the signal input unit 15 of the vibration signal generation device 10.

In the vibration signal generation device 10, the signal input unit 11 transmits one piece of music data to the purpose determination unit 12. As a result, the vibration signal generation unit 14 generates a vibration signal in the manner described above. The vibration signal generated by the vibration signal generation unit 14 is supplied to the electro-mechanical vibration converter 40. As a result, the electro-mechanical vibration converter 40 converts the vibration signal into the mechanical vibration, thereby providing the user with a body vibration.

The signal input unit 11 further transmits one piece of music data to the output terminal 60 via the delay circuit 50.

Here, since one piece of music data output from the output terminal 60 is delayed by a period caused by the delay circuit 50, the reproduction position of one piece of music data and the machine generated by the electro-mechanical vibration converter 40 are used. The vibration is synchronized. For this reason, the body sensation sound system 200 of the second embodiment can provide a user with suitable body vibration while maintaining harmony with the music corresponding to one piece of music data.

(2-3) Third Example of the Sensory Sound System Next, a sensory sound system 300 of the third example will be described with reference to FIG. FIG. 11 is a block diagram illustrating a configuration of an acoustic experience system 300 according to the third embodiment. In the following description, the description overlapping the bodily sensation acoustic system 200 of the second embodiment from the bodily sensation acoustic system 100 of the first embodiment is omitted, and the same reference numerals are given to the common parts on the drawings, and the basics are shown. Only the differences will be described.

As shown in FIG. 11, in the sensory sound system 300 of the third embodiment, the electro-mechanical vibration converter 40 has a sensory sound as a constituent element of the vibration unit 310 compared to the sensory sound system 200 of the second embodiment. It is different in that it is separated from the system 300.

In the body sensation sound system 300 of the third embodiment, the vibration signal generated by the vibration signal generation unit 17 is transmitted to the vibration unit 310 via a network (not shown) (for example, a wired network or a wireless network) by the operation of the communication unit 70. Sent. The vibration unit 310 includes a communication unit 311 that receives a vibration signal transmitted from the sensory acoustic system 300, an amplifier 312 that amplifies the received vibration signal, and an electro-mechanical vibration that converts the amplified vibration signal into mechanical vibration. And a converter 40. For this reason, the body sensation sound system 300 of the third embodiment, like the body sensation sound system 200 of the second embodiment, provides the user with a suitable body vibration while maintaining harmony with the music corresponding to one piece of music data. Can be provided.

(2-4) Fourth Example of the Sensory Sound System Next, a sensory sound system 400 of the fourth example will be described with reference to FIG. FIG. 12 is a block diagram illustrating a configuration of the body sensation sound system 400 according to the fourth embodiment. In addition, while omitting the description overlapping the bodily sensation acoustic system 300 of the third embodiment from the bodily sensation acoustic system 100 of the first embodiment, common portions in the drawings are denoted by the same reference numerals, and are basically different. Only will be described.

As shown in FIG. 12, the bodily sensation sound system 400 of the fourth embodiment includes a terminal device 410, a server device 420, and a vibration unit 430 connected to each other via a network 440.

The user interface unit 20 of the terminal device 410 acquires music information indicating a list of one or more music data stored in the memory 30 of the server device 420 via the communication unit 412, the network 440, and the communication unit 422. . The user interface unit 20 displays the acquired music information to the user.

When the user interface unit 20 receives an input indicating one piece of music data among the pieces of music data indicated by the piece of music information, the user interface unit 20 sends a music specifying signal for specifying one piece of music data to the server device 420. The data is transmitted via the network 440 and the communication unit 422.

The control unit 421 of the server device 420 transmits one piece of music data specified by the received music specifying signal to the reproduction unit 411 of the terminal device 410 via the communication unit 422, the network 440, and the communication unit 412. . The control unit 421 further transmits one piece of music data to the vibration signal generation device 10.

The control unit 421 transmits the vibration signal output from the vibration signal generation device 10 to the electro-mechanical vibration conversion unit 40 of the vibration unit 430 via the communication unit 422, the network 440, and the communication unit 431. As a result, the electro-mechanical vibration converter 40 included in the vibration unit 430 converts the vibration signal into a mechanical vibration, thereby providing a suitable body vibration to the user.

The present invention is not limited to the above-described embodiments, and can be appropriately changed without departing from the gist or concept of the invention that can be read from the claims and the entire specification. In addition, a computer program and a sensory sound system are also included in the technical scope of the present invention.

DESCRIPTION OF SYMBOLS 10 Vibration signal generation apparatus 11 Signal input part 12 Purpose determination part 13 FFT processing part 14 Frequency determination part 15 Frequency ratio determination part 16 Frequency value determination part 17 Vibration signal generation part 20 User interface part 30 Memory 40 Electro-mechanical vibration converter 50 Delay circuit (Delay)
60 Output terminal (Audio OUT)
DESCRIPTION OF SYMBOLS 70 Radio | wireless part 100 Body sensation sound system 200 Body sensation sound system 300 Body sensation sound system 310 Vibration unit 311 Communication part 312 Amplifier 400 Body sensation sound system 401 Terminal device 411 Playback part 412 Communication part 420 Server apparatus 421 Control part 422 Communication part 430 Vibration unit 431 Communication Department 440 Network

Claims

A vibration signal generation device that generates a vibration signal composed of a frequency component in a vibration frequency band that is a frequency band narrower than the audible band from an acoustic signal including a frequency component in the audible band,
Extraction means for extracting a plurality of first frequency components from the acoustic signal;
Determining means for determining whether a frequency ratio of a plurality of second frequency components obtained by converting the plurality of first frequency components into a frequency component that falls within the vibration frequency band satisfies a predetermined condition;
According to the determination result of the determination means, (i) the vibration signal including the plurality of second frequency components and (ii) the second frequency component of any one of the plurality of second frequency components A vibration signal generation device comprising: generation means for generating any one of vibration signals.
The generating means generates (i) the vibration signal including the plurality of second frequency components when the frequency ratio satisfies the predetermined condition, and (ii) the frequency ratio does not satisfy the predetermined condition. The vibration signal generation device according to claim 1, wherein the vibration signal including any one second frequency component of the plurality of second frequency components is generated.
2. The determination unit according to claim 1, wherein the determination unit determines whether the frequency ratio is a ratio at which the plurality of second frequency components can realize a chord or a ratio that does not generate a dissonance. 3. Vibration signal generator.
The generating means includes (i) the frequency ratio including the plurality of second frequency components when the plurality of second frequency components is a ratio capable of realizing a chord or a ratio that does not generate a dissonance. Generating a vibration signal, and (ii) when the frequency ratio does not become a ratio at which the plurality of second frequency components can realize a chord or does not generate a dissonance, of the plurality of second frequency components The vibration signal generation apparatus according to claim 3, wherein the vibration signal including any one of the second frequency components is generated.
2. The vibration signal generating apparatus according to claim 1, wherein the determination unit determines whether or not the frequency ratio is a natural number ratio equal to or less than a predetermined value.
The generating means generates (i) the vibration signal including the plurality of second frequency components when the frequency ratio is a natural number ratio equal to or less than a predetermined value, and (ii) the frequency ratio is equal to or less than a predetermined value. 6. The vibration signal generation device according to claim 5, wherein the vibration signal including any one second frequency component of the plurality of second frequency components is generated when the natural number ratio is not satisfied. .
2. The vibration signal generating apparatus according to claim 1, wherein the extraction means extracts the plurality of first frequency components having a higher signal intensity than the other frequency components from the acoustic signal.
When an electro-mechanical vibration conversion device that generates mechanical vibration based on the vibration signal is used in a state in which the mechanical vibration undulation caused by a shift of a plurality of frequency components included in the vibration signal is allowed. The generating means replaces the vibration signal including any one of the vibration signal including the plurality of second frequency components and the second frequency component of the plurality of second frequency components with a predetermined frequency component. The vibration signal generation apparatus according to claim 1, wherein the vibration signal includes a frequency component in the vicinity of the predetermined frequency component.
A vibration signal generating method for generating a vibration signal composed of a frequency component in a vibration frequency band that is a frequency band narrower than the audible band from an acoustic signal including a frequency component in an audible band,
An extraction step of extracting a plurality of first frequency components from the acoustic signal;
A determination step of determining whether a frequency ratio of a plurality of second frequency components obtained by converting the plurality of first frequency components into a frequency component that falls within the vibration frequency band satisfies a predetermined condition;
According to the determination result of the determination step, (i) the vibration signal including the plurality of second frequency components and (ii) the second frequency component of any one of the plurality of second frequency components And a generation step of generating any of the vibration signals.
A computer program for causing a computer to function as the vibration signal generation device according to claim 1.
A recording medium storing the computer program according to claim 10.
A bodily sensation acoustic system comprising a terminal device, a server device, and an electro-mechanical vibration converter connected to each other via a network,
The server device has storage means for storing a plurality of music data and music information indicating a list of the plurality of music data,
The terminal device
Accepting means capable of accepting user input;
Display means for acquiring the music information via the network and displaying it to the user;
In response to the user input received by the receiving means, a music specifying signal, which is a signal for specifying one piece of music data among a plurality of pieces of music data indicated by the music information, is sent to the server via the network. First communication means for transmitting to the device,
The server device
From an acoustic signal corresponding to one piece of music data specified by the music specifying signal and including a frequency component within the audible band, within a vibration frequency band that is a frequency band narrower than the audible band A vibration signal generation device that generates a vibration signal composed of frequency components,
Extraction means for extracting a plurality of first frequency components from the acoustic signal;
Determining means for determining whether a frequency ratio of a plurality of second frequency components obtained by converting the plurality of first frequency components into a frequency component that falls within the vibration frequency band satisfies a predetermined condition;
According to the determination result of the determination means, (i) the vibration signal including the plurality of second frequency components and (ii) the second frequency component of any one of the plurality of second frequency components Generating means for generating any of the vibration signals;
The sensory acoustic system further comprising: a second communication unit that transmits the vibration signal generated by the generation unit to the electro-mechanical vibration conversion device via the network.