JPH08205300A - Sound controller - Google Patents

Abstract

PURPOSE: To give a user presence and an operation feeling providing the sound controller used to control the sounds showing the centroid information, attitude information, or living body information like physiological index of the user to plainly transmit the meaning of shown sounds to the user. CONSTITUTION: A load measuring means 1 measures the load of the user for the purpose of changing sound information by the load. A sound effect information calculating means 3 obtains sound effect information corresponding to the load obtained by the load measuring means 1 based on correspondence information between the load and the sound effect which is held in a correspondence information data base 2. A sound effect adding means 4 changes the sound signal inputted from the outside based on sound effect information obtained by the sound effect information calculating means 3 and outputs the result to the outside.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention is applied to the position of the center of gravity and the mind and body in the field of artificial reality system in which realism is important, the field of man-machine interface using sound, and the field of information equipment for welfare use. The present invention relates to a sound control device that controls sound according to a user's state such as a state.

[0002]

2. Description of the Related Art Conventionally, there has been known an apparatus for detecting the position of the center of gravity of a user and changing the presented image. By using this device, it is possible to detect the center-of-gravity position information that changes depending on the user's motion, and it is possible to change the video presented to the user based on the user's motion.

On the other hand, a sound generated in the virtual world for showing the position of the user in the virtual world is presented in a three-dimensional sound field, and an alarm is given when the load of the user exceeds a predetermined value. Those that emit sound are known.

[0004]

However, when the conventional device for presenting the position of the center of gravity in an image is applied to the field of the artificial reality system where the presence is important, it is used for the position of the center of gravity of the user. There is a problem in that the information presented to the person is only the image, and the user cannot have a sufficient sense of presence.

Further, in a device that uses a three-dimensional sound field to indicate the position of the user in the virtual world, there is a problem that it is not possible to reflect the individual motions of the user and the sound presenting the physical and mental state. Furthermore, there is a problem in that the device that generates a warning sound when the load of the user exceeds a predetermined value cannot present the motion of the user as a change in sound.

In summary, with the conventional device, it was not possible to present it as an acoustic change directly corresponding to the user's motion or mental and physical condition. For this reason, it becomes impossible for the user to associate the presented sound with the user's own motion or physical and mental state, and it is difficult for the user to make sense of the presented sound. It was As a result, in the conventional device, it is insufficient to give the user a sense of presence or a virtual operation feeling.

The present invention is intended to solve the above-mentioned problems, and an object thereof is to provide an acoustic control device used for controlling acoustics for presenting biometric information such as user load information, posture information and physiological indexes. However, it is possible to convey the meaning of the presented sound to the user in an easy-to-understand manner and, as a result, to give the user a sense of presence and operation.

[0008]

According to a first aspect of the present invention, in a sound control device for controlling presented sound according to a state of a user, a load measuring means for measuring a position of a center of gravity of the user and outputting load information. A correspondence information database which holds correspondence information between load information and acoustic effects and outputs the correspondence information; acoustic effect information calculation means for obtaining acoustic effect information from the load information and the correspondence information; And a sound effect adding means for inputting a sound signal given by the above and changing the sound signal according to the sound effect information and outputting the sound signal to the outside.

A second aspect of the present invention is, in an acoustic control device for controlling the presented sound according to the state of the user, a load measuring means for measuring the position of the center of gravity of the user and outputting the load information, the load information and the acoustic effect. Correspondence information database which holds the correspondence information and outputs the correspondence information, acoustic effect information calculation means for obtaining acoustic effect information from the load information and the correspondence information, the acoustic effect information and a plurality of externally provided acoustic effect information The selection information holding the selection information indicating the correspondence between the load and the sound to be selected, and the sound effect adding means for obtaining the sound effect added sound to which the sound effect based on the sound effect information is input by inputting the sound signal. A sound selection information database for outputting, sound selection information calculation means for obtaining sound selection information from the load information and the selection information, the sound selection information and the sound effect addition The seeking an input audio signal to be output by the acoustic selection information and having an acoustic selection means for outputting to the outside.

According to a third aspect of the present invention, in an acoustic control device for controlling the presented sound according to the state of the user, the posture measuring means for measuring the posture of the user and outputting the posture information, the posture information and the sound effect. Corresponding information database that holds the corresponding information and outputs the corresponding information, acoustic effect information calculation means for obtaining acoustic effect information from the posture information and the corresponding information, the acoustic effect information and an acoustic signal provided from the outside. And a sound effect adding means for changing the sound signal according to the sound effect information as an input and outputting the sound signal to the outside.

According to a fourth aspect of the present invention, in an acoustic control device for controlling presented sound according to a state of a user, a posture measuring means for measuring the posture of the user and outputting the posture information, the posture information and the sound effect. Corresponding information database that holds the corresponding information and outputs the corresponding information, acoustic effect information calculation means that obtains acoustic effect information from the posture information and the corresponding information, the acoustic effect information and a plurality of externally provided acoustics A sound effect adding means for obtaining a sound effect added sound to which a sound effect based on the sound effect information is added by inputting a signal, and selection information representing correspondence between a posture and a sound to be selected is held and the selection information is stored. A sound selection information database to be output, sound selection information calculation means for obtaining sound selection information from the posture information and the selection information, the sound selection information and the sound effect addition sound. And having an acoustic selecting means for outputting to the outside seeking sound signal outputted by said acoustic selection information and force.

A fifth aspect of the present invention is an acoustic control device for controlling the presented sound according to the state of the user, and a physiological index measuring means for measuring the physiological index of the user and outputting the physiological index, the physiological index and the sound. Correspondence information database which holds correspondence information with effects and outputs the correspondence information, acoustic effect information calculation means for obtaining acoustic effect information from the physiological index and the correspondence information, the acoustic effect information and externally provided sound And a sound effect adding means for inputting a signal and changing the sound signal according to the sound effect information and outputting the sound signal to the outside.

According to a sixth aspect of the present invention, in a sound control device for controlling presented sound according to a state of a user, a physiological index measuring means for measuring a physiological index of the user and outputting the physiological index, a physiological index and sound. Correspondence information database which holds correspondence information with effects and outputs the correspondence information, acoustic effect information calculation means for obtaining acoustic effect information from the physiological index and the correspondence information, the acoustic effect information and a plurality of externally provided acoustic effect information The sound effect adding means for obtaining the sound effect added sound to which the sound effect based on the sound effect information is input, and the selection information indicating the correspondence between the physiological index and the sound to be selected are held. A sound selection information database that outputs selection information, a sound selection information calculation unit that obtains sound selection information from the physiological index and the selection information, the sound selection information, and the sound. And having an acoustic selecting means for outputting to the outside seeking sound signal outputted by said acoustic selection information as input fruit addition sound.

[0014]

Embodiments of the present invention 1 will now be described with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of the present invention 1. In this embodiment, the load measuring means 1 for measuring the position of the center of gravity and outputting the load information, the correspondence information database 2 for holding the correspondence information between the load information and the sound effect, and the sound effect information from the load information and the correspondence information are obtained. Sound effect information calculation means 3
And sound effect adding means 4 for changing the sound signal according to the sound effect information.

The load measuring means 1 measures the position of the center of gravity of the user to obtain load information. The load information includes, for example, the position of the center of gravity of the user, the difference between the position of the center of gravity of the user and the center position, and the difference between the position of the center of gravity of the user and the ideal position of the center of gravity of the user. To obtain the load information, for example, one or more load sensors are placed on the floor, and the output of these load sensors is used to measure the position of the user's center of gravity to obtain the load information. There is a method (Japanese Unexamined Patent Publication No. 3-212263) for obtaining the position of the center of gravity of the user by disposing one or a plurality of load sensors on a table on which is placed.

The correspondence information database 2 holds correspondence information which is correspondence between load information and sound effects. As a method of associating the load information and the acoustic effect, for example, there is one as shown in FIG. This correspondence can be held in a function format or a table format. Figure 2
The correspondence between the load information x and the acoustic effect y in (A) can be represented by a mathematical expression such as y = ax + b in the functional form. Here, a and b are parameters that represent the correspondence between the load information and the acoustic effect. The parameters of the function representing such correspondence are previously set by the system designer as a = 2.0, b = 0.
Set it as 5, for example. An example of this parameter is
If no load is applied and the load information is 0,
0.5 is given as an acoustic effect, for example, load information is 1.0
If the predetermined reference value is taken, 2.5 is given as the acoustic effect. Further, this example of the function form is an example in which when the load information increases, the acoustic effect is added in proportion to the degree of increase of the load information.
Further, FIG. 3 shows an example in which FIG. 2A is expressed in a table format. The width of the load information used in the table, the range of the load information, the value of the corresponding acoustic effect, the accuracy of the value of the acoustic effect, etc. are set in advance by the system designer. Correspondence information database 2
Can be realized using a storage device such as a ROM, a RAM with a power supply device, a magnetic card, a magnetic disk device, or a magneto-optical disk device. The correspondence information database 2 can be realized by storing the type of function, the function parameter, or each value of the table as data in these storage devices.

The acoustic effect information calculating means 3 receives the load information from the load measuring means 1 and the correspondence information from the correspondence information database 2, respectively, and refers to the correspondence information for the sound effect information representing the acoustic effect corresponding to the load information. Ask for. When the correspondence information is in the table format of FIG. 3 and the load information obtained from the load measuring means 1 is 3.0, the acoustic effect information is obtained as 2.5 by searching the table. When there is no load information column in the table that corresponds to the measured load information, in order to obtain the acoustic effect information, the values before and after the table are appropriately interpolated, or the acoustic effect information with the closest load information is obtained. You can deal with it by using. Corresponding information is represented by a function y = 2x + 0.5 between the load information x and the sound effect information y, and if the load information obtained from the load measuring means 1 is 3.0, the sound effect information is 6. Calculate as 5. The sound effect information calculation means 3 can be implemented as a program that operates on a personal computer PC-9801 series manufactured by NEC Corporation, for example.

The acoustic effect adding means 4 receives the acoustic signal from the outside and the acoustic effect information from the acoustic effect information calculating means 3, respectively, changes the acoustic signal according to the acoustic effect information, and an external device such as a speaker or a headphone. Output to. As a method of changing the sound signal, the volume is changed according to the sound effect information, the sound in the predetermined range is amplified or attenuated according to the sound effect information, and the sound is amplified or attenuated according to the sound effect information. There are methods such as changing the range, changing additional sounds such as echo reverb according to the sound effect information, changing the pitch according to the sound effect information, and changing the tempo according to the sound effect information. The sound effect adding means 4 is an AD converter, a DS
It can be realized by a combination of P and DA converters, and various sound effects can be added by a program on the DSP. For calculation of sound effects, please refer to Musical Applications of Microprocessors (Musica
l Applications of Microprocessors, 1985, Heiden Book Company, USA, hereinafter referred to as Reference 1). It is also possible to describe and implement a program for causing the CPU of the main body of the personal computer to perform the sound effect addition calculation with a configuration in which an AD converter and a DA converter are added to the personal computer. Furthermore, a commercially available sound adding device may be used as the sound effect adding means 4. An example of a commercially available sound adding device is a digital mixing processor DMP7 manufactured by Yamaha Corporation.

When the sound effect calculation means 3 is implemented as a program on a personal computer and the sound effect adding means 4 is configured to use an external sound adding device, the communication between the musical instruments and the computer is performed during the communication. The sound effect information can be communicated by a communication method based on the MIDI standard defined by the MIDI Standards Council as a standard for communicating performance information. Regarding the MIDI standard, M
IDI 1.0 standard, detailed in 1989, MIDI Standards Council (hereinafter referred to as Reference 2).

Next, referring to FIG. 1, FIG. 3 and FIG. 4, in the present embodiment, the load measuring means 1 uses the position of the center of gravity obtained from a load sensor placed on the floor as load information. The volume information is used as the acoustic information to be changed, the table of FIG. 3 is used to associate the load information with the volume information, and the correspondence information database 2 stored in the ROM is used to calculate the acoustic effect information. As the means 3, the one calculated by the program of the personal computer is used,
As the sound effect adding means 4, a Yamaha digital mixing processor DMP7 is used, and the sound effect information is MIDI.
The operation will be described using a specific example, taking as an example the case of communication using a standard.

Digital mixing processor DMP7
Has a MIDI receiving terminal and receives the input acoustic signal as M
Adjust the output volume to 12 according to the message obtained from IDI.
The output can be changed in 8 steps. Prior to the operation, the MIDI reception channel of the DMP 7 is set to 1 or OMNI so that the DMP 7 can receive the data output to the MIDI channel 1. In this setting, in order to change the output volume of DMP7, M
This can be realized by changing the stereo level of the parameter number 135 of the DMP 7 with the control number 4 of the IDI control change. M to make control change of MIDI channel 1
The IDI message is a hexadecimal number message having a length of 3 bytes including B0, a control number, and a control value. After all, M to change the volume of DMP7
The IDI message has a hexadecimal notation of B0, 4, and a volume value and has a length of 3 bytes. This volume value is a value from 0 to 127, and the output volume increases as the value increases.

In the load measuring means 1, the position of the center of gravity obtained from the load sensor is used as load information (FIG. 4, step A).
1). Next, the acoustic effect calculation means 3 generates volume information corresponding to the measured load information from the load information and the correspondence information held in the correspondence information database 2 (FIG. 4, step A2). Next, the DMP 7 which is the sound effect adding means 4
Is a sound effect information calculation means 3 through a MIDI cable.
From the acoustic signal input terminal, receives the acoustic signal from the acoustic signal input terminal, increases or decreases the volume of the received acoustic signal based on the volume information, and outputs the acoustic signal to the acoustic signal output terminal (FIG. 4, step A3).

The operation of the acoustic effect calculation means 3 in the above description will be described in detail with reference to FIG. First, load information is received from the load measuring means 1 (FIG. 5, step A21).
Next, the volume is searched from the correspondence table of FIG. 3 held in the correspondence information database 2. (FIG. 5, Step A2
2). For example, when the load information is 1.0, 1.5 is set as the search result. Next, the volume obtained from the table is normalized to the volume range handled by the DMP 7 (FIG. 5, step A2).
3). If the range of the volume of the correspondence table of FIG. 3 is 0.0 to 15.0, the volume obtained from the table can be normalized by, for example, multiplying the volume by 8 and rounding down to the nearest whole number. . If the volume obtained from the table is 1.5, the normalized volume value is 24. Next, a MIDI message is generated based on the normalized volume (step A24 in FIG. 5). The MIDI message when the normalized volume value is 24 is B0, 4,
It will be 18. Next, the generated MIDI message is D
It is transmitted to MP7 (FIG. 5, step A25).

In the above explanation of the operation, the volume obtained by searching the correspondence information database 2 is normalized and then the MIDI is performed.
Although the description has been given so as to generate a message, it is possible to store a normalized sound volume value in the correspondence information database in advance. In this case, the process of step A23 in FIG. 5 can be omitted.

Further, the sound effect information calculating means 3 and the sound effect adding means 4 may be implemented as a program of a personal computer having an AD converter and a DA converter. In this case, the sound effect information can be communicated via a temporary storage area of a personal computer, and the sound addition processing is performed by externally AD-converting each sample value and volume value of the sound signal input. It can be obtained by multiplication with. By performing D / A conversion on the obtained value again, the acoustic signal added with the acoustic can be output to the outside.

Further, the sound effect information calculating means 3 can be mounted as a program on a personal computer, and the sound adding means 4 can be mounted on a DSP board dedicated to signal processing having an AD converter and a DA converter. In this case, the sound effect information can be communicated through the bus to which the personal computer and the DSP board are connected.

An embodiment of the present invention 2 will be described below with reference to the drawings. FIG. 6 is a block diagram showing an embodiment of the present invention 2. In this embodiment, the load measuring means 11 for measuring the movement of the center of gravity and outputting the load information, the correspondence information database 12 for holding the correspondence information between the load information and the sound effect, and the sound effect information from the load information and the correspondence information are obtained. Acoustic effect information calculating means 13 and acoustic effect adding means 14 for obtaining an acoustic effect added sound by changing an acoustic signal according to the acoustic effect information.
A sound selection information database 15 that holds selection information indicating correspondence between load information and sounds to be selected, sound selection information calculation means 16 that obtains sound selection information from the load information and the selection information, sound selection information and sound. The sound selection means 17 for obtaining a sound signal to be output from the effect-added sound.

The load measuring means 11 measures the position of the center of gravity of the user to obtain load information. As the load information, for example,
The position of the center of gravity of the user, the difference between the position of the center of gravity of the user and the center position, the difference between the position of the center of gravity of the user and the ideal position of the center of gravity of the user, and the like. To obtain the load information, for example, one or more load sensors are placed on the floor, and the output of these load sensors is used to measure the position of the user's center of gravity to obtain the load information. There is a method (Japanese Unexamined Patent Publication No. 3-212263) for obtaining the position of the center of gravity of the user by disposing one or a plurality of load sensors on a table on which is placed.

The correspondence information database 12 holds correspondence information which is correspondence between load information and sound effects.
For example, as shown in FIG.
There is something like. This correspondence can be held in a function format or a table format. Figure 2
The correspondence between the load information x and the acoustic effect y in (A) can be represented by a mathematical expression such as y = ax + b in the functional form. Here, a and b are parameters that represent the correspondence between the load information and the acoustic effect. The parameters of the function representing such correspondence are previously set by the system designer as a = 2.0, b = 0.
Set it as 5, for example. An example of this parameter is
If no load is applied and the load information is 0,
0.5 is given as an acoustic effect, for example, load information is 1.0
If the predetermined reference value is taken, 2.5 is given as the acoustic effect. Further, this example of the function form is an example in which when the load information increases, the acoustic effect is added in proportion to the degree of increase of the load information.
Further, FIG. 3 shows an example in which FIG. 2A is expressed in a table format. The width of the load information used in the table, the range of the load information, the value of the corresponding acoustic effect, the accuracy of the value of the acoustic effect, etc. are set in advance by the system designer. Correspondence information database 12
Can be realized using a storage device such as a ROM, a RAM with a power supply device, a magnetic card, a magnetic disk device, or a magneto-optical disk device. The correspondence information database 12 can be realized by storing the type of function, the function parameter, or each value of the table as data in these storage devices.

The acoustic effect information calculating means 13 receives the load information from the load measuring means 11 and the correspondence information from the correspondence information database 12, respectively, and refers to the correspondence information for the sound effect information representing the acoustic effect corresponding to the load information. Ask for. The correspondence information is in the form of a table in FIG. 3, and the load measuring means 11
If the load information obtained from the above is 3.0, the acoustic effect information is obtained as 2.5 by searching the table. When there is no load information column in the table that corresponds to the measured load information, in order to obtain the acoustic effect information, the values before and after the table are appropriately interpolated, or the acoustic effect information with the closest load information is obtained. You can deal with it by using. Corresponding information is represented by a function y = 2x + 0.5 between the load information x and the sound effect information y, and if the load information obtained from the load measuring means 11 is 3.0, the sound effect information is 6. Calculate as 5. The sound effect information calculation means 13 is, for example, a personal computer PC-980 manufactured by NEC Corporation.
It can be implemented as a program that operates on one series.

The sound effect adding means 14 receives a plurality of sound signals from the outside and the sound effect information from the sound effect information calculating means 13, respectively, changes the plurality of sound signals received according to the sound effect information, and adds sound. Produces a sound. As a method of changing the sound signal, the volume is changed according to the sound effect information, the sound in the predetermined range is amplified or attenuated according to the sound effect information, and the sound is amplified or attenuated according to the sound effect information. There are methods such as changing the range, changing additional sounds such as echo reverb according to the sound effect information, changing the pitch according to the sound effect information, and changing the tempo according to the sound effect information. The sound effect adding means 14 includes an AD converter, a DS
It can be realized by a combination of P and DA converters, and various sound effects can be added by a program on the DSP. For the sound effect addition calculation, refer to Reference 1 and the like. It is also possible to describe and implement a program for causing the CPU of the main body of the personal computer to perform the sound effect addition calculation with a configuration in which an AD converter and a DA converter are added to the personal computer. Furthermore, a commercially available sound adding device may be used as the sound effect adding means 14. An example of a commercially available sound adding device is a digital mixing processor DMP7 manufactured by Yamaha Corporation.

When the sound effect information calculating means 13 is implemented as a program on a personal computer and the sound effect adding means 14 is configured to use an external sound adding device, a communication system conforming to the MIDI standard is used for communication between them. Sound effect information can also be communicated. For details on the MIDI standard, see Reference 2.

The selection information database 15 holds selection information which is information for associating load information with acoustic selection information. As a method of associating the load information and the sound selection information, for example, there is one as shown in FIG. FIG. 7 (A) is an example of acoustic selection information in the case of selecting only one sound to be output according to the load information, and FIG. 7 (B) mixes and outputs a plurality of input sounds. In this case, the correspondence between the mixing ratio of the input sounds and the load information is used as the acoustic selection information.
The range of load information, the value of corresponding sound selection information, etc. are set in advance by the system designer. The selection information database 15 can be realized using a storage device such as a ROM, a RAM with a power supply device, a magnetic card, a magnetic disk device, and a magneto-optical disk device. The selection information database 15 can be realized by storing the type of function, the function parameter, or each value of the table as data in these storage devices.

The sound selection information calculating means 16 receives the load information from the load measuring means 11 and the correspondence information from the selection information database 15, and refers to the selection information for the sound selection information representing the sound selection corresponding to the load information. Ask for. If the selection information is in the table format of FIG. 7A and the load information obtained from the load measuring means 11 is 3.0, the acoustic selection information is found to be 1 by searching the table. When there is no load information column in the table corresponding to the measured load information, to obtain the acoustic selection information, the values before and after the table are interpolated appropriately, or the acoustic selection information with the closest load information is selected. You can deal with it by using. The sound selection information calculation means 16 can be implemented as a program that operates on a personal computer PC-9801 series manufactured by NEC Corporation, for example.

The sound selecting means 17 includes the sound adding means 14
From the acoustic selection information calculating means 16 respectively, acoustic signals to be output from the acoustic addition sounds received according to the acoustic selection information are obtained and output to the outside. For sound selection, there is a method of outputting only one of a plurality of input sounds, and a method of changing the volume levels of a plurality of input sounds and mixing and outputting them. The sound selection means 17 is realized by a combination of a plurality of AD converters, DSPs, DA converters, and various sounds can be selected by a program on the DSP. For details of sound selection information calculation, refer to Reference 1 and the like. It is also possible to describe and implement a program that causes the CPU of the main body of the personal computer to perform acoustic selection calculation with a configuration in which a plurality of AD converters and DA converters are added to the personal computer. Further, a commercially available sound selection device may be used as the sound selection means 17. An example of a commercially available sound selection device is a Yamaha digital mixing processor DMP7.

When the sound selection information calculation means 16 is implemented as a program on a personal computer and the sound selection means 17 is configured to use an external sound selection device,
For the communication during this period, the sound effect information can be communicated by a communication method based on the MIDI standard. For details on the MIDI standard, refer to Reference 2 and the like.

Next, referring to FIGS. 3, 6, 7 and 8, the load measuring means 11 in this embodiment uses the load center information obtained from the load sensor placed on the floor as the load center information. Is used as the acoustic information to be changed, the bass equalization amount is used, the load information and the bass equalization amount are associated with each other using FIG. 3A, and the load information and the acoustic selection information are associated with each other. 7 (B), the correspondence information database 12 and the selection information database 15 stored in the ROM are used, and the acoustic effect information calculation means 13 is used.
And the sound selection information calculation means 16 uses the one calculated by the program of the personal computer, the sound effect addition means 14 and the sound selection means 17 uses the Yamaha digital mixing processor DMP7, and the sound effect information and the sound selection information are MIDI. The operation will be described using a specific example, taking as an example the case of communication using a standard.

Digital mixing processor DMP7
Has a MIDI receiving terminal and can set the bass equalization amount and the output volume of a plurality of input acoustic signals according to the message obtained by MIDI, and can mix and output inputs of up to 8 channels. it can.
Prior to operation, the MID of the DMP7 is set so that the DMP7 can receive the data output to the MIDI channel 1.
The I reception channel is set to 1 or OMNI.
In this setting, in order to set the bass equalization amount of the input 1 of the DMP 7, MIDI note-on number 24 is used, and to set the bass equalization amount of the input 2, MIDI is set.
You can set a value for each note on No. 25. The message for making note-on of MIDI channel 1 is hexadecimal notation, 80, note number,
The message has a 3-byte length of the velocity value.
Therefore, the MIDI message for setting the bass equalization amount of the input 1 of the DMP 7 is 80, 1 in hexadecimal notation.
The message has a length of 3 bytes, C and the equalize amount. Similarly, the MIDI message for setting the bass equalization amount of the input 2 of the DMP 7 is 80,
The message has a length of 3 bytes, which is 1D and the equalize amount. The bass equalization amount is a value from 0 to 127, and the higher the value, the greater the bass output that is output. Also, to change the volume of input 1,
MIDI control change control number 3
In order to change the volume of input 2 with MIDI, use MIDI.
With the control number 33 of the control change of
Each value can be set. M to make control change of MIDI channel 1
The IDI message is a hexadecimal number message having a length of 3 bytes of B0, control number, and control value. Therefore, the MIDI message for setting the volume of the input 1 of the DMP 7 is B0, 2 in hexadecimal notation.
The message has a length of 3 bytes of 0 and the volume value.
Similarly, the MIDI message for setting the volume of the input 2 of the DMP 7 is a hexadecimal notation having a length of 3 bytes, B0, 21, and the volume value. These volume values are values from 0 to 127, and the output volume also increases as the value increases.

The load measuring means 11 calculates the load information based on the gravity center information obtained from the load sensor (FIG. 8, FIG.
Step B1). Next, the acoustic effect information calculation means 13 generates a MIDI message for setting the bass equalization amount corresponding to the measured load information from the load information and the correspondence information held in the correspondence information database 12 (FIG. 8, FIG. Step B2). Next, the DMP 7, which is the sound effect adding means 14, uses M for setting the bass equalization amount from the sound effect information calculating means 13 through the MIDI cable.
The acoustic signal is received from the acoustic signal input terminal for the IDI message, and the bass equalization amount for the received acoustic signal is increased or decreased (FIG. 8, step B3). Next, the sound selection information calculation means 16 generates sound selection information corresponding to the measured load information from the load information and the selection information held in the selection information database 15 (FIG. 8, step B4). Next, the DMP 7 which is the sound selection means 17
Receives the sound selection information from the sound selection information calculating means 16, increases or decreases the volume of the sound added sound, mixes the sound, and outputs the mixed sound to the sound signal output terminal (step B5 in FIG. 8).

Acoustic effect information calculation means 1 in the above description
The operation of No. 3 will be described in detail with reference to FIG. First, load information is received from the load measuring means 11 (FIG. 5, step A).
21). Next, the bass equalization amount is searched from the correspondence table of FIG. 3 held in the correspondence information database 12 (FIG. 5, step A22). For example, the load information is 1.0
If 1.5, the search result is 1.5. Next, the bass equalization amount obtained from the table is normalized to the range of the bass equalization amount handled by the DMP 7 (FIG. 5, step A23).
The volume range of the correspondence table in FIG. 3 is 0.0 to 15.
If it is 0, for example, the sound volume obtained from the table is multiplied by 8 and the fractional part is rounded down to be an integer, so that the normalization can be performed. If the volume obtained from the table is 1.5, the normalized bass equalization amount is 24. Next, a MIDI message is generated based on the normalized bass equalization amount (step A24 in FIG. 5). The MIDI message when the normalized bass equalization amount is 24 is
Hexadecimal notation 80, 1C, 1C, 80, 1D, 1C
Will be 6 bytes. Next, the generated MIDI message is transmitted to the DMP 7 (FIG. 5, step A25).

Next, the operation of the sound selection information calculation means 16 in the above description will be described in detail with reference to FIG. First,
Load information is received from the load measuring means 11 (FIG. 9, step B41). Next, the volume is searched from the correspondence table of FIG. 7B held in the selection information database 15 (FIG. 9, step B42). For example, when the load information is 1.0, sound 1 is 0.0 and sound 2 is 1.0 as the search result. Next, the selection information obtained from the table is normalized to the volume range handled by the DMP 7 (FIG. 9, step B43). If the range of the volume of the correspondence table in FIG. 3 is 0.0 to 1.0, the volume obtained from the table can be normalized by multiplying the volume by 127 and rounding down to the integer. . If the sound 1 obtained from the table is 0.0, the volume value of the normalized sound 1 is 0, and if the sound 2 obtained from the table is 1.0, the volume value of the normalized sound 2 is It becomes 127. next,
A MIDI message is generated based on the normalized volume (step B44 in FIG. 9). When the normalized sound 1 has a sound volume value of 0 and the normalized sound 2 has a sound volume value of 127, the MIDI message is hexadecimal notation B0, 2
It becomes 0, 0, B0, 21, 7F. Then the generated M
The IDI message is transmitted to the DMP 7 (FIG. 5, step B45).

Further, the sound effect information calculation means 13, the sound effect addition means 14, the sound selection information calculation means 16, and the sound selection means 17 can be implemented as a program of a personal computer having an AD converter and a DA converter. . In this case, the sound effect information and the sound selection information are
Communication is possible via a temporary storage area of a personal computer, and the sound addition processing and sound selection processing are filter processing and mixing processing for each sample value of the sound signal input by AD conversion from the outside. Can be sought by. The obtained value is again DA
By converting, it is possible to output the audio signal for which the sound is added and the sound is selected.

Further, the sound effect information calculating means 13 and the sound selecting information calculating means 16 are mounted as a program on a personal computer, and the sound adding means 14 and the sound selecting means 17 are signals having a plurality of AD converters and DA converters. It is also possible to mount using a DSP board dedicated to processing. In this case, the sound effect information and the sound selection information can be communicated through the bus connecting the personal computer and the DSP board.

An embodiment of the present invention 3 will be described below with reference to the drawings. FIG. 10 is a block diagram showing an embodiment of the present invention 3. In this embodiment, a posture measuring unit 21 that measures posture to obtain posture information, a correspondence information database 22 that holds correspondence information between posture information and sound effects, and a sound that obtains sound effect information from the posture information and correspondence information. The effect information calculation means 23 and the sound effect addition means 24 for changing the sound signal according to the sound effect information.

The posture measuring means 21 measures the posture of the user and obtains posture information. The posture information is information indicating what posture the user is in, and can be represented by the angles of joints such as ankle joints and knee joints. It is also possible to use the difference between the angle of these joints and the angle of the joints of the ideal user as the posture information. In order to obtain the posture information, for example, a method using a device in which a sensor for measuring the position and direction of the footrest is attached to a movable footrest is used (Japanese Patent Application No. 6-21).
7472). There is also a method of measuring the posture by mounting one or more of a magnetic sensor, an optical sensor, an ultrasonic sensor, or a combination thereof on the user's body. These attitude measuring methods are described in detail in, for example, artificial reality generation technology and its application, Science Co., Ltd. (hereinafter referred to as Document 3) in 1992.

The correspondence information database 22 holds correspondence information which is correspondence between posture information and sound effects.
For example, as shown in FIG.
There is something like 1. This correspondence can be held in a function format or a table format. Figure 1
The correspondence between the posture information x of 1 (A) and the acoustic effect y is
In the functional form, it can be expressed by a mathematical expression such as y = ax + b. Here, a and b are parameters that represent the correspondence between the posture information and the acoustic effect. The parameter of the function representing such correspondence is a = 2.0, b =
Set it to 0.5. An example of this parameter is that if the posture information such as the knee angle is 0 when the posture is standing, 0.5 is given as the acoustic effect, and the posture information such as the knee angle is 1.0 in advance. When the predetermined reference value is taken, 2.5 is given as the acoustic effect. Further, this example of the function format is an example in which when the posture information increases, a sound effect is added in proportion to the degree of increase of the posture information. In addition, FIG.
FIG. 12 shows an example in which is expressed in a table format. The width of the posture information used in the table, the range of the posture information, the value of the corresponding acoustic effect, the accuracy of the value of the acoustic effect, and the like are set in advance by the system designer. The correspondence information database 22 includes a ROM, a RAM with a power supply device, a magnetic card, a magnetic disk device,
It can be realized by using a storage device such as a magneto-optical disk device. The correspondence information database 22 can be realized by storing the types of functions, the function parameters, or the respective values in the table as data in these storage devices.

The acoustic effect information calculating means 23 receives the posture information from the posture measuring means 21 and the correspondence information from the correspondence information database 22, and refers to the correspondence information for the sound effect information representing the acoustic effect corresponding to the posture information. Ask for. The correspondence information is in the table format of FIG. 12, and the posture measuring means 2
If the posture information obtained from 1 is 3.0, the acoustic effect information is obtained as 2.5 by searching the table. In order to obtain the sound effect value from the posture information in which the posture values in the table do not exist, it is possible to appropriately interpolate the values before and after the table, or to use the acoustic effect value having the closest posture information. Further, the correspondence information is represented by a function y = 2x + 0.5 between the posture information x and the acoustic effect y, and if the posture information obtained from the posture measuring means 21 is 3.0, the acoustic effect is 6.5. Do the calculations that Sound effect information calculation means 23
Can be implemented as a program that operates on a personal computer PC-9801 series manufactured by NEC Corporation, for example.

The acoustic effect adding means 24 receives an acoustic signal from the outside and acoustic effect information from the acoustic effect information calculating means 23, changes the acoustic signal according to the acoustic effect information, and external devices such as a speaker and headphones. Output to. As a method of changing the sound signal, the volume is changed according to the sound effect information, the sound in the predetermined range is amplified or attenuated according to the sound effect information, and the sound is amplified or attenuated according to the sound effect information. There are methods such as changing the range, changing additional sounds such as echo reverb according to the sound effect information, changing the pitch according to the sound effect information, and changing the tempo according to the sound effect information. The sound effect adding means 24 is an AD converter, D
It can be realized by a combination of SP and DA converters, and various sound effects can be added by a program on the DSP. For the sound effect addition calculation, refer to Reference 1 and the like. It is also possible to describe and implement a program for causing the CPU of the main body of the personal computer to perform the sound effect addition calculation with a configuration in which an AD converter and a DA converter are added to the personal computer. Furthermore, a commercially available sound adding device may be used as the sound effect adding means 24. An example of a commercially available sound adding device is a digital mixing processor DMP7 manufactured by Yamaha Corporation.

When the sound effect calculating means 23 is implemented as a program on a personal computer and the sound effect adding means 24 is configured to use an external sound adding device,
For the communication during this period, the sound effect information can be communicated by a communication method based on the MIDI standard. For details on the MIDI standard, see Reference 2.

Next, referring to FIGS. 10, 12 and 13, the attitude measuring means 21 of the present embodiment is used to determine the angle of the ankle joint as the attitude information, and the volume information is used as the acoustic information to be changed. 12 is used for associating the posture information and the volume information, the correspondence information database 22 stored in the ROM is used, and the sound effect information calculating means 23 is calculated by the program of the personal computer. Sound effect adding means 2
Digital mixing processor DM manufactured by Yamaha Corporation
The operation will be described using a specific example, using P7 as the example and a case where the acoustic effect information is communicated using the MIDI standard.

Digital mixing processor DMP7
Has a MIDI receiving terminal and receives the input acoustic signal as M
Adjust the output volume to 12 according to the message obtained from IDI.
The output can be changed in 8 steps. Prior to the operation, the MIDI reception channel of the DMP 7 is set to 1 or OMNI so that the DMP 7 can receive the data output to the MIDI channel 1. In this setting, in order to change the output volume of DMP7, M
This can be realized by changing the stereo level of the parameter number 135 of the DMP 7 with the control number 4 of the IDI control change. M to make control change of MIDI channel 1
The IDI message is a hexadecimal number message having a length of 3 bytes of B0, control number, and control value. After all, the MIDI message for changing the volume of the DMP 7 is a message of hexadecimal notation having a length of 3 bytes of B0, 4, and the volume value. This volume value is a value from 0 to 127, and the output volume increases as the value increases.

The posture measuring means 21 measures the angle of the ankle joint to obtain posture information (FIG. 13, step C1). Next, the acoustic effect calculation means 23 generates volume information corresponding to the measured posture from the posture information and the correspondence information held in the correspondence information database 22 (FIG. 13, step C).
2). Next, the DMP 7, which is the sound effect adding means 24,
Volume information is received from the acoustic effect information calculating means 23 through the MIDI cable, acoustic signals are respectively received from the acoustic signal input terminals, and the volume of the received acoustic signals is increased or decreased based on the volume information and output to the acoustic signal output terminal (Fig. 13, step C3).

The operation of the acoustic effect calculation means 23 in the above description will be described in detail with reference to FIG. First, the posture information is received from the posture measuring means 21 (FIG. 14, step C).
21). Next, the volume is searched from the correspondence table of FIG. 12 held in the correspondence information database 22 (FIG. 1
4, step C22). For example, when the posture information is 1.0, 1.5 is set as the search result. Next, the volume obtained from the table is normalized to the volume range handled by the DMP 7 (see FIG. 1).
4, step C23). If the range of the volume of the correspondence table of FIG. 12 is 0.0 to 15.0, the volume obtained from the table can be normalized by, for example, multiplying the volume by 8 and rounding to the nearest whole number. . If the volume obtained from the table is 1.5, the normalized volume value is 24. Next, a MIDI message is generated based on the normalized volume (step C24 in FIG. 14). The MIDI message when the normalized volume value is 24 is B0, 4, and 18 in hexadecimal notation. Then the generated M
The IDI message is transmitted to the DMP 7 (FIG. 14, step C25).

In the above description of the operation, the sound volume obtained by searching the correspondence information database 22 is normalized and then the MID
Although the explanation has been given so as to generate the I message, it is possible to store the normalized volume value in the correspondence information database in advance. In this case, the process of step C23 in FIG. 14 can be omitted.

Further, the sound effect information calculation and the sound effect adding process can be implemented as a program of a personal computer having an AD converter and a DA converter. In this case, the sound effect information can be communicated via a temporary storage area of a personal computer, and the sound addition calculation is performed by externally performing AD conversion on each sample value and volume value of the sound signal input. It can be obtained by multiplication with. The obtained value is again DA
The converted acoustic signal can be output to the outside by conversion.

Further, the sound effect information calculating means 23 can be installed as a program of a personal computer, and the sound addition calculating means 24 can be installed using a DSP board for signal processing having an AD converter and a DA converter. is there. In this case, a personal computer and D
The sound effect information can be communicated through the bus to which the SP board is connected.

An embodiment of the present invention 4 will be described below with reference to the drawings. FIG. 15 is a block diagram showing an embodiment of the present invention 4. In this embodiment, a posture measuring unit 31 that measures posture to obtain posture information, a correspondence information database 32 that holds correspondence information between posture information and sound effects, and sound that obtains sound effect information from the posture information and correspondence information. The effect information calculation means 33 and the sound effect adding means 34 for changing the sound signal according to the sound effect information to obtain the sound effect added sound.
, An acoustic selection information database 35 holding selection information representing correspondence between posture and acoustic to be selected, acoustic selection information calculating means 36 for obtaining acoustic selection information from posture information and selection information, acoustic selection information and acoustic effects. The sound selection unit 37 calculates the sound signal output from the additional sound.

The posture measuring means 31 measures the posture of the user and obtains posture information. The posture information is information indicating what posture the user is in, and can be represented by the angles of joints such as ankle joints and knee joints. It is also possible to use the difference between the angle of these joints and the angle of the joints of the ideal user as the posture information. In order to obtain the posture information, for example, a method using a device in which a sensor for measuring the position and direction of the footrest is attached to a movable footrest is used (Japanese Patent Application No. 6-21).
7472). There is also a method of measuring the posture by mounting one or more of a magnetic sensor, an optical sensor, an ultrasonic sensor, or a combination thereof on the user's body. Details of these attitude measuring methods are described in Document 3 and the like.

The correspondence information database 32 holds correspondence information which is correspondence between posture information and sound effects.
For example, as shown in FIG.
There is something like 1. This correspondence can be held in a function format or a table format. Figure 1
The correspondence between the posture information x of 1 (A) and the acoustic effect y is
In the functional form, it can be expressed by a mathematical expression such as y = ax + b. Here, a and b are parameters that represent the correspondence between the posture information and the acoustic effect. The parameter of the function representing such correspondence is a = 2.0, b =
Set it to 0.5. An example of this parameter is that if the posture information such as the knee angle is 0 when the posture is standing, 0.5 is given as the acoustic effect, and the posture information such as the knee angle is 1.0 in advance. When the predetermined reference value is taken, 2.5 is given as the acoustic effect. Further, this example of the function format is an example in which when the posture information increases, a sound effect is added in proportion to the degree of increase of the posture information. In addition, FIG.
FIG. 12 shows an example in which is expressed in a table format. The width of the posture information used in the table, the range of the posture information, the value of the corresponding acoustic effect, the accuracy of the value of the acoustic effect, and the like are set in advance by the system designer. The correspondence information database 32 includes a ROM, a RAM with a power supply device, a magnetic card, a magnetic disk device,
It can be realized by using a storage device such as a magneto-optical disk device. The correspondence information database 32 can be realized by storing the type of function, the function parameter, or each value of the table as data in these storage devices.

The acoustic effect information calculating means 33 receives the posture information from the posture measuring means 31 and the correspondence information from the correspondence information database 32, and refers to the correspondence information for the sound effect information representing the acoustic effect corresponding to the posture information. Ask for. The correspondence information is in the table format of FIG. 12, and the posture measuring means 3
If the posture information obtained from 1 is 3.0, the acoustic effect information is obtained as 2.5 by searching the table. In order to obtain the sound effect value from the posture information in which the posture value in the table does not exist, it is possible to deal with it by appropriately interpolating the values before and after the table or by using the sound effect value having the closest posture.
In addition, the correspondence information is a function y = between the posture x and the sound effect y.
If the posture information represented by 2x + 0.5 and the posture information obtained from the posture measuring means 31 is 3.0, the acoustic effect is calculated to be 6.5. The sound effect information calculation means 33 is, for example, a personal computer PC-98 manufactured by NEC Corporation.
It can be implemented as a program that operates on the 01 series.

The sound effect adding means 34 receives a plurality of sound signals from the outside and the sound effect information from the sound effect information calculating means 33, changes the plurality of sound signals received according to the sound effect information, and adds sound. Produces a sound. As a method of changing the sound signal, the volume is changed according to the sound effect information, the sound in the predetermined range is amplified or attenuated according to the sound effect information, and the sound is amplified or attenuated according to the sound effect information. There are methods such as changing the range, changing additional sounds such as echo reverb according to the sound effect information, changing the pitch according to the sound effect information, and changing the tempo according to the sound effect information. The sound effect adding means 34 includes an AD converter, a DS
It can be realized by a combination of P and DA converters, and various sound effects can be added by a program on the DSP. For the sound effect addition calculation, refer to Reference 1 and the like. It is also possible to describe and implement a program for causing the CPU of the main body of the personal computer to perform the sound effect addition calculation with a configuration in which an AD converter and a DA converter are added to the personal computer. Furthermore, a commercially available sound adding device may be used as the sound effect adding means 34. An example of a commercially available sound adding device is a digital mixing processor DMP7 manufactured by Yamaha Corporation.

When the sound effect information calculating means 33 is implemented as a program on a personal computer and the sound effect adding means 34 is configured to use an external sound adding device, the communication between them is performed according to the MIDI standard. Sound effect information can also be communicated. For details on the MIDI standard, see Reference 2.

The selection information database 35 holds selection information which is information relating the posture information and the acoustic selection information. As a method of associating the posture information and the sound selection information, for example, there is one as shown in FIG. FIG. 16 (A) shows
FIG. 16B is an example of acoustic selection information in the case of selecting only one sound to be output according to the posture information, and FIG. In this example, the correspondence between the ratio and the posture information is used as the selection information.
The range of the posture information and the value of the corresponding sound selection information are set by the system designer in advance. The selection information database 35 can be realized using a storage device such as a ROM, a RAM with a power supply device, a magnetic card, a magnetic disk device, and a magneto-optical disk device. The selection information database 35 can be realized by storing the types of functions, the function parameters, or the respective values in the table as data in these storage devices.

The sound selection information calculating means 36 stores the attitude information from the attitude measuring means 31 in the sound selection information database 35.
The selection information is received from each of them and the sound selection information representing the sound selection corresponding to the posture information is obtained by referring to the selection information. If the selection information is in the table format of FIG. 16A and the posture information obtained from the posture measuring means 31 is 3.0, the acoustic selection information is found to be 1 by searching the table. If there is no posture information column in the table corresponding to the measured posture information, in order to obtain the acoustic selection information,
This can be dealt with by appropriately interpolating from the values before and after the table, or by using the acoustic selection information having the closest orientation information. The sound selection information calculation means 36 can be implemented as a program that operates on a personal computer PC-9801 series manufactured by NEC Corporation, for example.

In the sound selecting means 37, the sound adding means 34
From the acoustic selection information calculation means 36, the acoustic signals to be output are obtained from the acoustic addition sounds received according to the acoustic selection information, and are output to the outside. For sound selection, there is a method of outputting only one of a plurality of input sounds, and a method of changing the volume levels of a plurality of input sounds and mixing and outputting them. The sound selection unit 37 is realized by a combination of a plurality of AD converters, DSPs, DA converters, and various sounds can be selected by a program on the DSP. For details of the sound selection process, refer to Reference 1 and the like. It is also possible to describe and implement a program that causes the CPU of the personal computer main body to perform the sound selection process with a configuration in which a plurality of AD converters and DA converters are added to the personal computer. Furthermore, a commercially available sound selection device may be used as the sound selection means 37. An example of a commercially available sound selection device is a Yamaha digital mixing processor DMP7.

When the sound selection information calculation means 36 is implemented as a program on a personal computer and the sound selection means 37 is configured to use an external sound selection device,
For the communication during this period, the sound effect information can be communicated by a communication method based on the MIDI standard. For details on the MIDI standard, refer to Reference 2 and the like.

Next, FIG. 12, FIG. 15, FIG. 16 and FIG.
With reference to FIG. 5, the posture measuring unit 31 of the present embodiment is used to determine the angle of the ankle joint as posture information, and the bass equalization amount is used as the acoustic information to be changed, and the posture and the bass equalization amount are associated with each other. 12A is used, FIG. 16B is used for associating the posture with the selection information, and the correspondence information database 32 and the selection information database 35 stored in the ROM are used. Information calculation means 33 and sound selection information calculation means 3
6 is calculated by a program of a personal computer, a digital mixing processor DMP7 manufactured by Yamaha Corporation is used as the sound effect adding means 34 and the sound selecting means 37, and the sound effect information and the sound selection information are M.
The operation will be described using a specific example, taking as an example the case of communication using the IDI standard.

Digital mixing processor DMP7
Has a MIDI receiving terminal and can set the bass equalization amount and the output volume of a plurality of input acoustic signals according to the message obtained by MIDI, and can mix and output inputs of up to 8 channels. it can.
Prior to operation, the MID of the DMP7 is set so that the DMP7 can receive the data output to the MIDI channel 1.
The I reception channel is set to 1 or OMNI.
In this setting, in order to set the bass equalization amount of the input 1 of the DMP 7, MIDI note-on number 24 is used, and to set the bass equalization amount of the input 2, MIDI is set.
You can set a value for each note on No. 25. The message for making note-on of MIDI channel 1 is hexadecimal notation, 80, note number,
The message has a 3-byte length of the velocity value.
Therefore, the MIDI message for setting the bass equalization amount of the input 1 of the DMP 7 is 80, 1 in hexadecimal notation.
The message has a length of 3 bytes, C and the equalize amount. Similarly, the MIDI message for setting the bass equalization amount of the input 2 of the DMP 7 is 80,
The message has a length of 3 bytes, which is 1D and the equalize amount. The bass equalization amount is a value from 0 to 127, and the higher the value, the greater the bass output that is output. Also, to change the volume of input 1,
MIDI control change control number 3
In order to change the volume of input 2 with MIDI, use MIDI.
With the control number 33 of the control change of
Each value can be set. M to make control change of MIDI channel 1
The IDI message is a hexadecimal number message having a length of 3 bytes of B0, control number, and control value. Therefore, the MIDI message for setting the volume of the input 1 of the DMP 7 is B0, 2 in hexadecimal notation.
The message has a length of 3 bytes of 0 and the volume value.
Similarly, the MIDI message for setting the volume of the input 2 of the DMP 7 is a hexadecimal notation having a length of 3 bytes, B0, 21, and the volume value. These volume values are values from 0 to 127, and the output volume also increases as the value increases.

The posture measuring means 31 measures the angle of the joint of the ankle and sets it as posture information (FIG. 17, step D1). Next, the acoustic effect information calculation means 33 generates a MIDI message for setting the bass equalization amount corresponding to the measured posture from the posture information and the correspondence information held in the correspondence information database 32 (FIG. 17, step D2). . next,
The DMP 7, which is the sound effect adding means 34, receives a MIDI message for setting a bass equalization amount from the sound effect information calculating means 33 through the MIDI cable, receives acoustic signals from the acoustic signal input terminals, and bass equalizes the received acoustic signal. The amount is increased or decreased (FIG. 17, step D3). Next, the acoustic selection information calculation means 3
6 generates acoustic selection information corresponding to the measured posture from the posture information and the selection information stored in the selection information database 35 (FIG. 17, step D4). Next, the DMP 7, which is the sound selection means 37, has the sound selection information calculation means 36.
The sound selection information is received from, the volume of the sound added sound is increased or decreased, and the sound is mixed and output to the sound signal output terminal (FIG. 17, step D5).

Acoustic effect information calculation means 3 in the above description
The operation of No. 3 will be described in detail with reference to FIG. First, the posture information is received from the posture measuring means 31 (FIG. 14, step C21). Next, the bass equalization amount is searched from the correspondence table of FIG. 3 held in the correspondence information database 32 (FIG. 14, step C22). For example, when the posture information is 1.0, 1.5 is set as the search result. Next, the bass equalization amount obtained from the table is normalized to the range of the bass equalization amount handled by the DMP 7 (FIG. 14, step C).
23). The volume range of the correspondence table in FIG. 12 is 0.0
From 1 to 15.0, for example, the sound volume obtained from the table is multiplied by 8 and the fractional part is rounded down to an integer, so that the sound volume can be normalized. If the volume obtained from the table is 1.5, the normalized bass equalization value is 24. Next, a MIDI message is generated based on the normalized bass equalization amount (FIG. 14, step C24). MID when the normalized bass equalization amount is 24
The I message is in hexadecimal notation 80, 1C, 1C,
There are 6 bytes of 80, 1D and 1C. Next, the generated MIDI message is transmitted to the DMP 7 (FIG. 14, step C25).

Next, the operation of the sound selection calculation means 36 in the above description will be described in detail with reference to FIG. First, the posture information is received from the posture measuring means 31 (FIG. 18, step D41). Next, the volume is searched from the correspondence table of FIG. 16B held in the selection information database 35 (FIG. 18, step D42). For example, the posture information is 1.
When the value is 0, the sound 1 is 0.0 and the sound 2 is 1.0, which is the search result. Next, the selection information obtained from the table is normalized to the volume range handled by the DMP 7 (step D4 in FIG. 18).
3). If the range of the volume of the correspondence table in FIG. 12 is 0.0 to 1.0, the volume obtained from the table can be normalized by multiplying the volume by 127 and rounding down to the whole number. . If the sound 1 obtained from the table is 0.0, the volume value of the normalized sound 1 is 0, and the sound 2 obtained from the table is 2.
Is 1.0, the volume value of the normalized sound 2 is 127.
Becomes Next, a MIDI message is generated based on the normalized volume (step D44 in FIG. 18). When the volume value of the normalized sound 1 is 0 and the volume value of the normalized sound 2 is 127, the MIDI message is B0, 20, 0, B0, 21, 7F in hexadecimal notation. . Next, the generated MIDI message is transmitted to the DMP 7 (FIG. 18, step D45).

Further, the sound effect information calculating means 33, the sound effect adding means 34, the sound selecting information calculating means 36, and the sound selecting means 37 can be mounted as a program of a personal computer having an AD converter and a DA converter. . In this case, the sound effect information and the sound selection information are
Communication is possible via a temporary storage area of a personal computer, and the sound addition calculation and sound selection processing are filter processing and mixing processing for each sample value of the sound signal input by AD conversion from the outside. Can be sought by. The obtained value is again DA
By converting, the sound can be output to the outside as a sound signal that has been subjected to sound addition processing and sound selection processing.

Further, the sound effect information calculation means 33 and the sound selection information calculation means 34 are mounted as a program of a personal computer, and the sound addition means 34 and the sound selection means 35 are signal processing having a plurality of AD converters and DA converters. It is also possible to mount it as a dedicated DSP board. In this case, a personal computer and DS
The sound effect information and the sound selection information can be communicated through the bus to which the P board is connected.

An embodiment of the present invention 5 will be described below with reference to the drawings. FIG. 19 is a block diagram showing an embodiment of the present invention 5. In this embodiment, a physiological index measuring means 41 for measuring a physiological index, a correspondence information database 42 for holding correspondence information between the physiological index and the acoustic effect, and an acoustic effect information calculation for obtaining acoustic effect information from the physiological index and the corresponding information. Means 43
And sound effect adding means 44 for changing the sound signal according to the sound effect information.

The physiological index measuring means 41 calculates the physiological index of the user. Tension is one of the physiological indicators. For obtaining the physiological index, for example, there is a method in which one or more physiological index measuring sensors are attached to the user and the physiological index of the user is measured from the outputs of these sensors. In order to measure the degree of tension, there is a method of mounting a pulse wave sensor on the user's fingertip. Regarding the physiological index measuring method, JP-A-6-2966
For details, see No. 13, Reference 3, etc.

The correspondence information database 42 holds correspondence information which is a correspondence between the physiological index and the sound effect.
For example, as shown in FIG.
There is something like 0. This correspondence can be held in a function format or a table format. Figure 2
The correspondence between the physiological index x of 0 (A) and the acoustic effect y is
In the functional form, it can be expressed by a mathematical expression such as y = ax + b. Here, a and b are parameters that represent the correspondence between the physiological index and the acoustic effect. The parameter of the function representing such correspondence is a = 2.0, b =
Set it to 0.5. An example of this parameter is that if the user is not nervous and the degree of tension, which is one of the physiological indexes, is 0, 0.5 is given as an acoustic effect, and the degree of tension that is one of the physiological indexes, for example, is given. When a predetermined reference value of 1.0 is taken, 2.5 is given as an acoustic effect. Further, this example of the function form is an example in which when the physiological index increases, a sound effect is added in proportion to the degree of increase of the physiological index. Also,
FIG. 21 shows an example in which FIG. 20 (A) is expressed in a table format. The width of the physiological index used in the table, the range of the physiological index, the value of the corresponding acoustic effect, the accuracy of the value of the acoustic effect, etc. are set in advance by the system designer. Correspondence information database 42
Can be realized using a storage device such as a ROM, a RAM with a power supply device, a magnetic card, a magnetic disk device, or a magneto-optical disk device. The correspondence information database 42 can be realized by storing the types of functions, the function parameters, or the respective values in the table as data in these storage devices.

The sound effect information calculating means 43 stores the physiological index from the physiological index measuring means 41 in the correspondence information database 42.
Corresponding information is received from each and acoustic effect information representing an acoustic effect corresponding to the physiological index is obtained by referring to the corresponding information. If the corresponding information is in the table format of FIG. 21 and the physiological index obtained from the physiological index measuring means 41 is 3.0, the acoustic effect information is calculated as 2.5 by searching the table. In order to obtain the sound effect value from the physiological index having no physiological index value in the table, it is possible to appropriately interpolate the values before and after the table or to use the acoustic effect value having the closest physiological index value. Further, the correspondence information is represented by a function y = 2x + 0.5 between the physiological index x and the acoustic effect y, and if the physiological index obtained from the physiological index measuring means 41 is 3.0, the acoustic effect is 6.5. Calculate as follows. The sound effect information calculation means 43 can be implemented as a program that operates on a personal computer PC-9801 series manufactured by NEC Corporation, for example.

The sound effect adding means 44 receives the sound signal from the outside and the sound effect information from the sound effect information calculating means 43, changes the sound signal according to the sound effect information, and external devices such as speakers and headphones. Output to. As a method of changing the sound signal, the volume is changed according to the sound effect information, the sound in the predetermined range is amplified or attenuated according to the sound effect information, and the sound is amplified or attenuated according to the sound effect information. There are methods such as changing the range, changing additional sounds such as echo reverb according to the sound effect information, changing the pitch according to the sound effect information, and changing the tempo according to the sound effect information. The sound effect adding means 44 is an AD converter, D
It can be realized by a combination of SP and DA converters, and various sound effects can be added by a program on the DSP. For the sound effect addition calculation, refer to Reference 1 and the like. It is also possible to describe and implement a program for causing the CPU of the main body of the personal computer to perform the sound effect addition calculation with a configuration in which an AD converter and a DA converter are added to the personal computer. Furthermore, a commercially available sound adding device may be used as the sound effect adding means 44. An example of a commercially available sound adding device is a digital mixing processor DMP7 manufactured by Yamaha Corporation.

When the sound effect calculation means 43 is implemented as a program on a personal computer and the sound effect adding means 44 is configured to use an external sound adding device,
For the communication during this period, the sound effect information can be communicated by a communication method based on the MIDI standard. For details on the MIDI standard, see Reference 2.

Next, with reference to FIGS. 19, 21 and 22, the physiological index indicating the degree of tension from the pulse wave obtained from the pulse wave sensor worn by the user as the physiological index measuring means 41 in this embodiment. 21 is used for associating the physiological index with the volume information, and the correspondence information database 42 stored in the ROM is used. As an example, a case in which a computer program is used as the sound effect information calculation means 43, a Yamaha digital mixing processor DMP7 is used as the sound effect addition means 44, and sound effect information is communicated using the MIDI standard is taken as an example. The operation will be described using a specific example.

The digital mixing processor DMP7 has a MIDI receiving terminal and receives the input acoustic signal as MID.
According to the message obtained in I, the volume of the output can be changed in 128 steps and output. Prior to the operation, the MIDI reception channel of the DMP 7 is set to 1 or OMNI so that the DMP 7 can receive the data output to the MIDI channel 1. In this setting, in order to change the output volume of DMP7, MI
This can be realized by changing the stereo level of the parameter number 135 of the DMP 7 with the control number 4 of the DI control change. M to make control change of MIDI channel 1
The IDI message is a hexadecimal number message having a length of 3 bytes of B0, control number, and control value. After all, the MIDI message for changing the volume of the DMP 7 is a message of hexadecimal notation having a length of 3 bytes of B0, 4, and the volume value. This volume value is a value from 0 to 127, and the output volume increases as the value increases.

The physiological index measuring means 41 calculates the degree of tension as a physiological index based on the pulse wave obtained from the pulse wave sensor (FIG. 22, step E1). Next, the acoustic effect calculation means 43 generates volume information corresponding to the measured physiological index from the physiological index and the correspondence information stored in the correspondence information database 42 (FIG. 22, step E2). Next, the DMP 7, which is the sound effect adding means 44, receives the volume information from the sound effect information calculating means 43 and the sound signal from the sound signal input terminal through the MIDI cable, and determines the volume of the received sound signal based on the sound volume information. It is increased or decreased and output to the acoustic signal output terminal (FIG. 22, step E3).

The operation of the acoustic effect calculation means 43 in the above description will be described in detail with reference to FIG. First, the physiological index is received from the physiological index measuring means 41 (FIG. 23, step E21). Next, the volume is searched from the correspondence table of FIG. 21 held in the correspondence information database 42 (FIG. 2).
3, step E22). For example, when the physiological index is 1.0, 1.5 is set as the search result. Next, the volume obtained from the table is normalized to the volume range handled by the DMP 7 (see FIG. 2).
3, step E23). If the volume range of the correspondence table of FIG. 21 is 0.0 to 15.0, the volume obtained from the table can be normalized by, for example, multiplying the volume by 8 and rounding to the nearest whole number. . If the volume obtained from the table is 1.5, the normalized volume value is 24. Next, a MIDI message is generated based on the normalized volume (step E24 in FIG. 23). The MIDI message when the normalized volume value is 24 is B0, 4, and 18 in hexadecimal notation. Then the generated M
The IDI message is transmitted to the DMP 7 (FIG. 23, step E25).

In the above description of the operation, the sound volume obtained by searching the correspondence information database 42 is normalized and then the MID
Although the explanation has been given so as to generate the I message, it is possible to store the normalized volume value in the correspondence information database in advance. In this case, the process of step E23 in FIG. 23 can be omitted.

Further, the sound effect information calculating means 43 and the sound effect adding means 44 can be mounted as a program of a personal computer having an AD converter and a DA converter. In this case, the sound effect information can be communicated via a temporary storage area of a personal computer, and the sound addition processing is performed by externally AD-converting each sample value and volume value of the sound signal input. It can be obtained by multiplication with. By performing D / A conversion on the obtained value again, the acoustic signal added with the acoustic can be output to the outside.

Further, the sound effect information calculating means 43 can be mounted as a program of a personal computer, and the sound adding means 44 can be mounted using a DSP board for signal processing having an AD converter and a DA converter. . In this case, the sound effect information can be communicated through the bus to which the personal computer and the DSP board are connected.

An embodiment of the present invention 6 will be described below with reference to the drawings. FIG. 24 is a block diagram showing an embodiment of the present invention 6. In this embodiment, a physiological index measuring means 51 for measuring a physiological index, a correspondence information database 52 for holding correspondence information between a physiological index and a sound effect, and an acoustic effect information calculation for obtaining acoustic effect information from the physiological index and the correspondence information. A means 53, a sound effect adding means 54 for obtaining a sound effect added sound by changing a sound signal according to the sound effect information, and a sound selection information database 55 holding selection information representing correspondence between a physiological index and a sound to be selected. , Acoustic selection information calculating means 56 for obtaining acoustic selection information from the physiological index and the selection information
And sound selection means 57 for obtaining a sound signal to be output from the sound selection information and the sound effect added sound.

The physiological index measuring means 51 calculates the physiological index of the user. Tension is one of the physiological indicators. For obtaining the physiological index, for example, there is a method in which one or more physiological index measuring sensors are attached to the user and the physiological index of the user is measured from the outputs of these sensors. In order to measure the degree of tension, there is a method of mounting a pulse wave sensor on the user's fingertip. Regarding the physiological index measuring method, JP-A-6-2966
For details, see No. 13, Reference 3, etc.

The correspondence information database 52 holds correspondence information which is a correspondence between the physiological index and the sound effect.
For example, as shown in FIG.
There is something like 0. This correspondence can be held in a function format or a table format. Figure 2
The correspondence between the physiological index x of 0 (A) and the acoustic effect y is
In the functional form, it can be expressed by a mathematical expression such as y = ax + b. Here, a and b are parameters that represent the correspondence between the physiological index and the acoustic effect. The parameter of the function representing such correspondence is a = 2.0, b =
Set it to 0.5. An example of this parameter is that if the user is not nervous and the degree of tension, which is one of the physiological indexes, is 0, 0.5 is given as an acoustic effect, and the degree of tension that is one of the physiological indexes, for example, is given. When a predetermined reference value of 1.0 is taken, 2.5 is given as an acoustic effect. Further, this example of the function form is an example in which when the physiological index increases, a sound effect is added in proportion to the degree of increase of the physiological index. Also,
FIG. 21 shows an example in which FIG. 20 (A) is expressed in a table format. The width of the physiological index used in the table, the range of the physiological index, the value of the corresponding acoustic effect, the accuracy of the value of the acoustic effect, etc. are set in advance by the system designer. Correspondence information database 52
Can be realized using a storage device such as a ROM, a RAM with a power supply device, a magnetic card, a magnetic disk device, or a magneto-optical disk device. The correspondence information database 52 can be realized by storing the type of function, the function parameter, or each value of the table as data in these storage devices.

The acoustic effect information calculating means 53 stores the physiological index from the physiological index measuring means 51 in the correspondence information database 52.
Corresponding information is received from each and acoustic effect information representing an acoustic effect corresponding to the physiological index is obtained by referring to the corresponding information. If the corresponding information is in the table format of FIG. 21 and the physiological index obtained from the physiological index measuring means 51 is 3.0, the acoustic effect information is calculated as 2.5 by searching the table. In order to obtain the sound effect value from the physiological index having no physiological index value in the table, it is possible to appropriately interpolate the values before and after the table or to use the acoustic effect value having the closest physiological index value. Further, the correspondence information is represented by a function y = 2x + 0.5 between the physiological index x and the acoustic effect y, and if the physiological index obtained from the physiological index measuring means 51 is 3.0, the acoustic effect is 6.5. Calculate as follows. The sound effect information calculation means 53 can be implemented as a program that operates on a personal computer PC-9801 series manufactured by NEC Corporation, for example.

The sound effect adding means 54 receives a plurality of sound signals from the outside and the sound effect information from the sound effect information calculating means 53, changes the plurality of sound signals received according to the sound effect information, and adds sound. Produces a sound. As a method of changing the sound signal, the volume is changed according to the sound effect information, the sound in the predetermined range is amplified or attenuated according to the sound effect information, and the sound is amplified or attenuated according to the sound effect information. There are methods such as changing the range, changing additional sounds such as echo reverb according to the sound effect information, changing the pitch according to the sound effect information, and changing the tempo according to the sound effect information. The sound effect adding means 54 includes an AD converter, a DS
It can be realized by a combination of P and DA converters, and various sound effects can be added by a program on the DSP. For the sound effect addition calculation, refer to Reference 1 and the like. It is also possible to describe and implement a program for causing the CPU of the main body of the personal computer to perform the sound effect addition calculation with a configuration in which an AD converter and a DA converter are added to the personal computer. Furthermore, a commercially available sound adding device may be used as the sound effect adding means 54. An example of a commercially available sound adding device is a digital mixing processor DMP7 manufactured by Yamaha Corporation.

When the sound effect information calculating means 53 is implemented as a program on a personal computer and the sound effect adding means 54 is configured to use an external sound adding device, the communication between them is performed by a communication method based on the MIDI standard. Sound effect information can also be communicated. For details on the MIDI standard, see Reference 2.

The selection information database 55 holds selection information which is information relating the physiological index and the sound selection information. As a method of associating the physiological index with the sound selection information, for example, there is one as shown in FIG. FIG. 25 (A)
25B is an example of acoustic selection information in the case of selecting only one sound to be output according to the physiological index. FIG. This is an example in which the correspondence between the mixing ratio and the physiological index is used as the acoustic selection information. The range of the physiological index and the value of the corresponding sound selection information are set by the system designer in advance. The selection information database 55 is a ROM or R with a power supply device.
It can be realized using a storage device such as an AM, a magnetic card, a magnetic disk device, and a magneto-optical disk device. The selection information database 55 can be realized by storing the type of function, the function parameter, or each value of the table as data in these storage devices.

The acoustic selection information calculating means 56 stores the physiological index from the physiological index measuring means 51 in the selection information database 55.
Corresponding information is received from each and acoustic selection information representing acoustic selection corresponding to the physiological index is obtained by referring to the selection information. If the selection information is in the table format of FIG. 25A and the physiological index obtained from the physiological index measuring means 51 is 3.0, the acoustic selection information is determined to be 1 by searching the table. When the physiological index column of the table corresponding to the measured physiological index does not exist, in order to obtain the acoustic selection information, the values before and after the table are appropriately interpolated, or the acoustic selection information with the closest physiological index value is selected. You can deal with it by using. The sound selection information calculation means 56 can be implemented as a program that operates on a personal computer PC-9801 series manufactured by NEC Corporation, for example.

In the sound selecting means 57, the sound adding means 54
From the acoustic selection information calculation unit 56, the acoustic signals to be output are obtained from the plural acoustic addition sounds received according to the acoustic selection information, and are output to the outside. For sound selection, there is a method of outputting only one of a plurality of input sounds, and a method of changing the volume levels of a plurality of input sounds and mixing and outputting them. The sound selection means 57 is realized by a combination of a plurality of AD converters, DSPs, DA converters, and various sounds can be selected by a program on the DSP. For the sound selection calculation, refer to Reference 1 and the like. It is also possible to describe and implement a program that causes the CPU of the main body of the personal computer to perform acoustic selection calculation with a configuration in which a plurality of AD converters and DA converters are added to the personal computer. Furthermore, a commercially available sound selection device may be used as the sound selection means 57. An example of a commercially available sound selection device is a Yamaha digital mixing processor DMP7.

When the sound selection information calculation means 56 is implemented as a program on a personal computer and the sound selection means 57 is configured to use an external sound selection device,
For the communication during this period, the sound effect information can be communicated by a communication method based on the MIDI standard. For details on the MIDI standard, refer to Reference 2 and the like.

Next, FIG. 21, FIG. 24, FIG. 25 and FIG.
With reference to, the physiological index measuring means 51 in the present embodiment uses one that obtains the degree of tension as a physiological index from the pulse wave obtained from the pulse wave sensor attached to the user's fingertip, and as the acoustic information to be changed. The bass equalization amount is used, FIG. 21A is used to associate the physiological index with the bass equalization amount, and FIG. 25 is used to associate the physiological index with the acoustic selection information.
(B) is used, the correspondence information database 52 and the selection information database 55 are those stored in the ROM, and the sound effect information calculation means 53 and the sound selection information calculation means 56 are those calculated by the program of the personal computer. As the sound effect adding means 56 and the sound selecting means 57, a Yamaha digital mixing processor DMP7 is used, and the sound effect information and the sound selecting information are M.
The operation will be described using a specific example, taking as an example the case of communication using the IDI standard.

Digital mixing processor DMP7
Has a MIDI receiving terminal and can set the bass equalization amount and the output volume of a plurality of input acoustic signals according to the message obtained by MIDI, and can mix and output inputs of up to 8 channels. it can.
Prior to operation, the MID of the DMP7 is set so that the DMP7 can receive the data output to the MIDI channel 1.
The I reception channel is set to 1 or OMNI.
In this setting, in order to set the bass equalization amount of the input 1 of the DMP 7, MIDI note-on number 24 is used, and to set the bass equalization amount of the input 2, MIDI is set.
You can set a value for each note on No. 25. The message for making note-on of MIDI channel 1 is hexadecimal notation, 80, note number,
The message has a 3-byte length of the velocity value.
Therefore, the MIDI message for setting the bass equalization amount of the input 1 of the DMP 7 is 80, 1 in hexadecimal notation.
The message has a length of 3 bytes, C and the equalize amount. Similarly, the MIDI message for setting the bass equalization amount of the input 2 of the DMP 7 is 80,
The message has a length of 3 bytes, which is 1D and the equalize amount. The bass equalization amount is a value from 0 to 127, and the higher the value, the greater the bass output that is output. Also, to change the volume of input 1,
MIDI control change control number 3
In order to change the volume of input 2 with MIDI, use MIDI.
With the control number 33 of the control change of
Each value can be set. M to make control change of MIDI channel 1
The IDI message is a hexadecimal number message having a length of 3 bytes of B0, control number, and control value. Therefore, the MIDI message for setting the volume of the input 1 of the DMP 7 is B0, 2 in hexadecimal notation.
The message has a length of 3 bytes of 0 and the volume value.
Similarly, the MIDI message for setting the volume of the input 2 of the DMP 7 is a hexadecimal notation having a length of 3 bytes, B0, 21, and the volume value. These volume values are values from 0 to 127, and the output volume also increases as the value increases.

The physiological index measuring means 51 calculates the degree of tension as a physiological index based on the pulse wave obtained from the pulse wave sensor (FIG. 26, step F1). Next, the acoustic effect information calculation means 53 generates a MIDI message for setting the bass equalization amount corresponding to the measured physiological index from the physiological index and the correspondence information held in the correspondence information database 52 (FIG. 26, Step F2). Next, the DMP 7, which is the sound effect adding unit 54, receives the MIDI message for setting the bass equalization amount from the sound effect information calculating unit 53 through the MIDI cable, receives the sound signal from the sound signal input terminal, and receives the sound signal. Increase or decrease the amount of bass equalization for audio signals (Fig. 2
6, step F3). Next, the acoustic selection information calculation means 56
Generates selection information corresponding to the measured physiological index from the physiological index and the acoustic selection information stored in the selection information database 55 (FIG. 26, step F4). Next, the DMP 7, which is the sound selection means 57, has the sound selection information calculation means 5
The selection information is received from 6, and the volume of the sound to which the sound is added is increased or decreased, mixed, and output to the audio signal output terminal (FIG. 26, step F5).

Acoustic effect information calculation means 5 in the above description
The operation of No. 3 will be described in detail with reference to FIG. First, the physiological index is received from the physiological index measuring means 51 (FIG. 23, step E21). Next, the bass equalization amount is retrieved from the correspondence table of FIG. 3 held in the correspondence information database 52 (FIG. 23, step E22). For example, when the physiological index is 1.0, 1.5 is set as the search result. Next, the bass equalization amount obtained from the table is normalized to the range of the bass equalization amount handled by the DMP 7 (FIG. 23, step E).
23). The range of the volume of the correspondence table in FIG. 21 is 0.0
From 1 to 15.0, for example, the sound volume obtained from the table is multiplied by 8 and the fractional part is rounded down to an integer, so that the sound volume can be normalized. If the volume obtained from the table is 1.5, the normalized bass equalization amount is 24. Next, a MIDI message is generated based on the normalized bass equalization amount (step E24 in FIG. 23). MID when the normalized bass equalization amount is 24
The I message is in hexadecimal notation 80, 1C, 1C,
There are 6 bytes of 80, 1D and 1C. Next, the generated MIDI message is transmitted to the DMP 7 (FIG. 23, step E25).

Next, the operation of the sound selection calculation means 56 in the above description will be described in detail with reference to FIG. First, a physiological index is received from the physiological index measuring means 51 (FIG. 27,
Step F41). Next, the volume is searched from the correspondence table of FIG. 25B held in the selection information database 55 (FIG. 27, step F42). For example, when the physiological index is 1.0, sound 1 is 0.0 and sound 2 is 1.0 as search results. Next, the selection information obtained from the table is normalized to the volume range handled by the DMP 7 (step F in FIG. 27).
43). The range of the volume of the correspondence table in FIG. 21 is 0.0
From 1.0 to 1.0, for example, the sound volume obtained from the table is multiplied by 127, and the number after the decimal point is truncated so that it becomes an integer. If the sound 1 obtained from the table is 0.0, the volume value of the normalized sound 1 is 0, and the sound 2 obtained from the table is 2.
Is 1.0, the volume value of the normalized sound 2 is 127.
Becomes Next, a MIDI message is generated based on the normalized volume (step F44 in FIG. 27). When the volume value of the normalized sound 1 is 0 and the volume value of the normalized sound 2 is 127, the MIDI message is B0, 20, 0, B0, 21, 7F in hexadecimal notation. . Next, the generated MIDI message is transmitted to the DMP 7 (FIG. 27, step F45).

Further, the sound effect information means 53, the sound effect adding means 54, the sound selection information calculation means 56, and the sound selection means 57 can be implemented as a program of a personal computer having an AD converter and a DA converter. In this case, the sound effect information and the sound selection information can be communicated via a temporary storage area of the personal computer, and the sound addition processing and the sound selection processing are sound input by external AD conversion. It can be obtained by filtering and mixing for each sample value of the signal. By performing DA conversion on the obtained value again, it is possible to output the acoustic signal subjected to the acoustic addition and acoustic selection processing to the outside.

Further, the sound effect information calculating means 53 and the sound selecting information calculating means 56 are mounted as a program of a personal computer, and the sound adding means 54 and the sound selecting means 55 are signal processing having a plurality of AD converters and DA converters. It is also possible to mount it on a dedicated DSP board. In this case, the sound effect information and the sound selection information can be communicated through the bus connecting the personal computer and the DSP board.

[0104]

As described above, according to the present invention, it is possible to present the acoustic effect that directly corresponds to the motion of the user and the state of mind and body. Therefore, by using the present invention, it is possible to convey the meaning of the presented sound to the user in an easy-to-understand manner, as compared with the conventional device that cannot be presented as an acoustic change directly corresponding to the user's motion or mental and physical condition. As a result, it is possible to give the user a sense of presence and operation.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention 1. FIG.

FIG. 2 is an explanatory diagram for explaining the operation of the first embodiment of the present invention.

FIG. 3 is an explanatory diagram for explaining the operation of the first embodiment of the present invention.

FIG. 4 is a flow chart for explaining an embodiment of the present invention 1.

FIG. 5 is a flowchart for explaining one embodiment of the present invention 1.

FIG. 6 is a block diagram showing an embodiment of the present invention 2;

FIG. 7 is an explanatory diagram for explaining the operation of one embodiment of the present invention 2;

FIG. 8 is a flow chart for explaining an embodiment of the present invention 2.

FIG. 9 is a flow chart for explaining an embodiment of the present invention 2.

FIG. 10 is a block diagram showing an embodiment of the present invention 3;

FIG. 11 is an explanatory diagram for explaining the operation of the third embodiment of the present invention.

FIG. 12 is an explanatory diagram for explaining the operation of the third embodiment of the present invention.

FIG. 13 is a flowchart for explaining one embodiment of the present invention 3.

FIG. 14 is a flow chart for explaining an example of the present invention 3.

FIG. 15 is a block diagram showing an embodiment of the present invention 4;

FIG. 16 is an explanatory diagram for explaining the operation of the fourth embodiment of the present invention.

FIG. 17 is a flow chart for explaining an embodiment of the present invention 4.

FIG. 18 is a flow chart for explaining an example of the present invention 4.

FIG. 19 is a block diagram showing an embodiment of the present invention 5;

FIG. 20 is an explanatory diagram for explaining the operation of the embodiment of the present invention 5;

FIG. 21 is an explanatory diagram for explaining the operation of the fifth embodiment of the present invention.

FIG. 22 is a flow chart for explaining an example of the present invention 5.

FIG. 23 is a flow chart for explaining an example of the present invention 6;

FIG. 24 is a block diagram showing an embodiment of the present invention 6;

FIG. 25 is an explanatory diagram for explaining the operation of the embodiment of the present invention 6;

FIG. 26 is a flowchart for explaining an example of the present invention 6;

FIG. 27 is a flowchart for explaining an example of the present invention 6;

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 load measuring means 2 correspondence information database 3 acoustic effect calculating means 4 acoustic effect adding means 11 load measuring means 12 correspondence information database 13 acoustic effect calculating means 14 acoustic effect adding means 15 selection information database 16 acoustic selection information calculating means 17 acoustic selecting means 21 Posture information measuring means 22 Correspondence information database 23 Acoustic effect information calculating means 24 Acoustic effect adding means 31 Posture information measuring means 32 Corresponding information database 33 Acoustic effect information calculating means 34 Acoustic effect adding means 35 Selection information database 36 Acoustic selection information calculating means 37 sound selecting means 41 physiological index measuring means 42 correspondence information database 43 acoustic effect information calculating means 44 acoustic effect adding means 51 physiological index measuring means 52 correspondence information database 53 acoustic effect information calculating means 54 with acoustic effect Means 55 selects information database 56 sound selection information calculating unit 57 sound selection means

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Office reference number FI Technical display location G09F 25/00 J G10K 15/00 H04R 3/00 310 H04S 5/02

Claims (6)

[Claims] 1. A sound control device for controlling presented sound according to a user's condition, load measuring means for measuring a position of a center of gravity of a user and outputting load information, and correspondence information between the load information and the sound effect. Correspondence information database that holds and outputs the correspondence information, acoustic effect information calculation means for obtaining acoustic effect information from the load information and the correspondence information, and input the acoustic effect information and an externally provided acoustic signal A sound control device, comprising: a sound effect adding unit that changes a sound signal according to sound effect information and outputs the sound signal to the outside. 2. An acoustic control device for controlling presented sound according to a user's condition, load measuring means for measuring a position of a center of gravity of the user and outputting load information, and correspondence information between the load information and the sound effect. A correspondence information database that holds the correspondence information and outputs the correspondence information, a sound effect information calculation unit that obtains sound effect information from the load information and the correspondence information, and inputs the sound effect information and a plurality of sound signals given from the outside. A sound effect adding means for obtaining a sound effect added sound to which a sound effect based on the sound effect information is added, and a sound for holding the selection information indicating the correspondence between the load and the sound to be selected and outputting the selection information A selection information database, sound selection information calculation means for obtaining sound selection information from the load information and the selection information, and inputting the sound selection information and the sound effect addition sound Sound control apparatus characterized by having a sound selection means for outputting to the outside seeking sound signal outputted by said acoustic selection information. 3. An acoustic control device for controlling the presented sound according to the state of the user, comprising: posture measuring means for measuring the posture of the user and outputting the posture information; and correspondence information between the posture information and the acoustic effect. A correspondence information database that holds and outputs the correspondence information, a sound effect information calculation unit that obtains sound effect information from the posture information and the correspondence information, the sound effect information and the sound signal given from the outside as the sound A sound control device, comprising: a sound effect adding unit that changes a sound signal according to effect information and outputs the sound signal to the outside. 4. An acoustic control device for controlling presented sound according to a user's state, comprising attitude measuring means for measuring a user's attitude and outputting attitude information, and correspondence information between the attitude information and the acoustic effect. Correspondence information database which holds and outputs the correspondence information, acoustic effect information calculation means for obtaining acoustic effect information from the posture information and the correspondence information, and the acoustic effect information and a plurality of acoustic signals provided from the outside as an input A sound effect adding means for obtaining a sound effect added sound to which a sound effect based on the sound effect information is added, and a sound selection for holding the selection information indicating the correspondence between the posture and the sound to be selected and outputting the selection information. An information database, a sound selection information calculation unit that obtains sound selection information from the posture information and the selection information, and the sound selection information and the sound effect addition sound as input Sound control apparatus characterized by having a sound selection means for outputting to the outside determined acoustic signal output by the acoustic selection information. 5. A sound control device for controlling a sound to be presented according to a state of a user, a physiological index measuring means for measuring a physiological index of the user and outputting the physiological index, and a correspondence between the physiological index and a sound effect. A correspondence information database that holds information and outputs the correspondence information, a sound effect information calculation unit that obtains sound effect information from the physiological index and the correspondence information, and the sound effect information and a sound signal given from the outside as an input. A sound control device comprising: a sound effect adding unit that changes a sound signal according to the sound effect information and outputs the sound signal to the outside. 6. A sound control device for controlling a sound to be presented according to a state of a user, a physiological index measuring means for measuring a physiological index of the user and outputting the physiological index, and a correspondence between the physiological index and a sound effect. A correspondence information database that holds information and outputs the correspondence information, a sound effect information calculation unit that obtains sound effect information from the physiological index and the correspondence information, the sound effect information and a plurality of sound signals given from the outside. The sound effect adding means for obtaining the sound effect added sound to which the sound effect based on the sound effect information is input, and the selection information indicating the correspondence between the physiological index and the sound to be selected are held and the selection information is output. A sound selection information database, sound selection information calculation means for obtaining sound selection information from the physiological index and the selection information, the sound selection information and the sound effect addition sound Sound control apparatus characterized by having a sound selection means for outputting to the outside seeking an input audio signal to be output by the sound selection information.