JP3590869B2 - Voice guidance system by bark - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a voice guidance system based on a cry that provides a user with commentary on the animal or bird based on the cry of the animal or bird in a facility such as a natural park.
[0002]
[Prior art]
In general, in a natural park or the like, a user moves appropriately in the site of the natural park or the like and observes the natural appearance of animals and birds.
In order to provide the user with information on animals and birds, for example, images such as pictures and photographs of animals and birds, and guide boards and pamphlets with commentary on them are prepared.
[0003]
[Problems to be solved by the invention]
However, it is usually difficult for a user to discriminate the sounds of animals and birds. For this reason, the user cannot determine the type of the animal or the bird even if the squeal is heard.
Therefore, especially in the case of a wild bird, even if it is attempted to find the shape of the wild bird, if the wild bird is not known, it cannot be easily searched because the wild bird itself is small.
[0004]
In view of the above points, an object of the present invention is to provide a voice guidance system based on sounds of animals and birds, which provides a user with an explanation of the animals and birds based on the sounds of the animals and birds.
[0005]
[Means for Solving the Problems]
According to the present invention, there is provided a microphone array comprising a plurality of fixed microphones appropriately arranged in a site of a facility such as a natural park, and a GPS, a movable microphone and headphones carried by a user of the facility. A sound source separation and sound source localization unit that performs sound source localization and sound data separation for each sound source from sound signals from at least one headset and each fixed microphone of the microphone array and the movable microphone of each headset. And a discriminating unit that specifies the type of animal or the like that squeals from the sound data for each sound source separated by the sound source separation / sound source localization unit, and the absolute coordinate position of the sound source localized by the sound source separation / sound source localization unit Is converted into a relative coordinate position based on the position information of each headset by GPS, and the species of the animal or the like specified by the determination unit is converted. Accordingly, by creating a description data related to the headset, the audio guidance system according cries, characterized in that it includes a guide creation unit that outputs to the headphone of the head set, a, is achieved.
[0006]
Preferably, the sound guide system based on bark according to the present invention, wherein the sound source separation / sound source localization unit includes a reception unit for receiving position information by GPS from each headset and an acoustic signal by a movable microphone, and A transmitting unit for transmitting commentary data, wherein each of the headsets transmits positional information by GPS and an acoustic signal by a movable microphone to the receiving unit, and receives commentary data from the transmitting unit. A transmission / reception unit is provided.
[0007]
Preferably, the sound guide system based on a call according to the present invention is configured such that the sound source separation / sound source localization unit performs sound source generation by a mathematical solution using a general microphone array based on acoustic signals from each fixed microphone and each movable microphone. Perform separation.
[0008]
In the voice guidance system based on a call according to the present invention, preferably, the sound source separation / sound source localization unit performs sound source separation using a direction pass filter.
[0009]
In the voice guidance system based on a call according to the present invention, preferably, the sound source separation / sound source localization unit further performs sound source separation by independent component analysis.
[0010]
In the sound guidance system according to the present invention, preferably, the determination unit refers to a type database provided with the sounds of various animals and the like, and specifies the type of the animals and the like from the sounds of the animals and the like.
[0011]
In the voice guidance system based on squealing according to the present invention, preferably, the discriminating unit performs detailed discrimination such as sex discrimination of animals and the like and situation discrimination based on the type of the animals and the like and further by referring to various detailed databases. .
[0012]
According to the above configuration, the fixed microphones of the microphone array and the movable microphones of each headset collect sounds of animals and birds in the premises such as a natural park, and sound source separation and sound source localization are performed based on the collected sound signals. The unit separates the sound into the absolute coordinate position of the sound source of each call and the sound data of each sound source.
Then, the discriminating unit specifies the type of animal or the like that squeaked for each sound source from the acoustic data of each sound source separated by the sound source separation / localization unit, and the guide creating unit determines the type of this animal or the like. To generate commentary data corresponding to the positional information of each headset, and the output unit outputs the commentary data to the headphones of the headset.
This allows the user to listen to the commentary flowing from the headphones of the headset carried by the user, thereby obtaining the commentary on the animal, bird, or the like that squeals, and the relative coordinate position of the animal, bird, or the like. , The animal, bird, or the like can be easily found.
[0013]
The sound source separation / sound source localization unit includes a reception unit that receives position information by GPS from each headset and an acoustic signal by a movable microphone, and the guide creation unit includes a transmission unit that transmits commentary data. In the case where each of the headsets includes a transmitting and receiving unit that transmits GPS positional information and an acoustic signal from a movable microphone to the receiving unit and receives commentary data from the transmitting unit, Can transmit and receive data wirelessly by transmitting position information by GPS and acoustic signals by a movable microphone to the sound source separation / sound source localization unit, and by receiving commentary data from the guide creation unit. it can. Therefore, the user can freely move in the premises such as a natural park while carrying the headset.
[0014]
When the sound source separation / sound source localization unit performs sound source separation by a mathematical solution using a general microphone array based on acoustic signals from each fixed microphone and each movable microphone, a broad sense including the movable microphone is used. Sound source separation can be performed by such a mathematical solution using a microphone array.
[0015]
When the sound source separation / sound source localization unit performs sound source separation using a direction pass filter, sound source separation can be easily performed by using a direction pass filter.
[0016]
When the sound source separation / sound source localization unit further performs sound source separation by independent component analysis, sound source separation can be reliably performed by using independent component analysis.
[0017]
When the discriminating unit specifies the type of the animal or the like from the call of the animal by referring to the type database having the call of the various animals or the like, the call of the animal or the like to be discriminated is prepared in advance in the database. Therefore, the type of the animal or the like can be quickly identified from the cry of the animal or the like.
[0018]
When the discriminating unit performs detailed discrimination such as sex discrimination of an animal or the like and situation discrimination based on the type of the animal or the like and further by referring to various detailed databases, a more detailed discrimination based on the call of the animal or the like is performed. It is possible to make a determination, that is, determine the sex of the animal, under what circumstances the squeal is emitted, and so on.
[0019]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, the present invention will be described in detail based on embodiments shown in the drawings.
FIG. 1 shows an electrical configuration of an embodiment of a voice guidance system based on a bird's cry applied to the present invention.
In FIG. 1, a voice guide system 10 includes a microphone array 11 that sounds from a plurality of fixed microphones 11a, 11b,... Appropriately arranged in a site 10a of a facility such as a natural park shown in FIG. It comprises a separation / sound source localization unit 12, a discrimination unit 13, a guide creation unit 14, and a headset 20 carried by a facility user.
[0020]
As shown in FIG. 2, the microphone array 11 is composed of a plurality of fixed microphones 11a, 11b,... Which are appropriately fixed in a site 10a of a facility such as a natural park. Each of the fixed microphones 11a, 11b,... Basically uses a directional microphone because it only needs to collect the sound of birds from above.
The sound signals of the fixed microphones 11a, 11b,... Are input to a sound source separation / sound source localization unit 12, which will be described later.
Each of the fixed microphones 11a, 11b,... May be connected to the sound source separation / localization unit 12 via a cable, or may be connected wirelessly.
[0021]
The sound source separation / sound source localization unit 12 is provided in, for example, a management building 10b or the like provided in a site 10a of a facility such as a natural park, and fixed microphones 11a, 11b,. The sound of the bird is detected based on the sound signal from the movable microphone of the headset 20, and the sound localization (position information to absolute coordinate position) of the bird and the sound of the bird are separated. .
At this time, the positions of the fixed microphones 11a, 11b,... Of the microphone array 11 have been input to the sound source separation / sound source localization unit 12 in advance, and the positions of the headsets 20 are provided in the headset 20. It will be detected based on the position information by GPS.
[0022]
The sound source separation / sound source localization unit 12 includes a sound source separation unit 12a, a direction pass filter 12b, and an ICA (Independent Component Analysis) unit 12c.
[0023]
The sound source separation unit 12a performs a mathematical solution using a general microphone array based on acoustic signals from the fixed microphones 11a, 11b,... Of the microphone array 11 and the movable microphone of each headset 20, It is configured to perform sound source separation.
[0024]
Further, the direction pass filter 12b is based on acoustic signals from the fixed microphones 11a, 11b,... Of the microphone array 11 and the movable microphone of each headset 20, and is based on the binaural phase difference IPD, the binaural intensity. The sound source is separated using the difference IID.
[0025]
Further, the ICA unit 12c performs independent component analysis based on acoustic signals from the individual fixed microphones 11a, 11b,. In accordance with the acoustic signal level of each microphone, the acoustic signal of each sound source is restored by matrix calculation to separate the sound sources, and the absolute coordinate position of the sound source is detected.
[0026]
The discriminating unit 13 is also provided in, for example, the management ridge 10b or the like provided in the site 10a of the facility such as a natural park, and the singing and positional information of the bird separated by the sound source separation and sound source localization unit 12 ( When the position information of each headset 20 is input, the sound of each bird is specified, and includes a type discriminating unit 13a and a detailed discriminating unit 13b.
[0027]
The type discriminating unit 13a refers to the type database 13c having the sounds of various birds, specifies the type of the bird from the song of the bird, and stores the type information and the position information (absolute coordinate position) of the bird and each head. The position information of the set 20 is sent to the guide creating unit 14.
Further, based on the bird's singing from the sound source separation / sound source locating unit 12 and the bird's type information from the type determining unit 13a, the detailed discriminating unit 13b includes a detailed database 13d having a singing according to the sex, situation, etc. of the bird. With reference to the above, detailed discrimination such as discrimination of sex and situation of the bird is performed based on the call of the bird, and detailed information of the bird is transmitted to the guide creating unit 14.
[0028]
The guide creating unit 14 is also provided in, for example, the management building 10b or the like provided in the site 10a of the facility such as a natural park, and the position information (absolute coordinates) from the determining unit 13 is provided for each headset 20. Position) is converted into a relative coordinate position of the bird position information based on the GPS position information of each headset 20, and the corresponding head is determined based on the bird type information and detailed information determined by the determination unit 13. The commentary data on the set 20 is created and transmitted to the headset 20 by the transmission / reception unit 24 shown in FIG.
[0029]
Here, when creating the commentary data, the guide creating unit 14 can hear the periphery of the headset 20, that is, the user using the headset 20, based on the position information of each headset 20. Create commentary data limited to birdsong within the range.
In the illustrated case, the guide creating unit 14 is provided for each headset 20. However, the present invention is not limited to this, and one guide creating unit 14 creates commentary data corresponding to all headsets 20. Alternatively, a smaller number of guide creation units 14 than the number of headsets 20 may be prepared, and commentary data may be created for the headset 20 as needed.
[0030]
At least one headset 20 is provided so that a user of a facility such as a natural park can carry the headset 20, and as shown in FIG. 3, a movable microphone 21, a GPS 22, and a headphone 23 are provided. , A transmission / reception unit 24, and a noise cancellation circuit 25.
[0031]
The movable microphone 21 detects sound around the headset 20 and generates an acoustic signal.
The GPS 22 has a known configuration, and detects a position of the headset 20 by receiving a radio wave from a GPS satellite to generate position information.
[0032]
Further, the headphones 23 provide a commentary voice to the user based on the commentary data from the guide creation unit 14.
The transmission / reception unit 24 transmits the sound signal from the movable microphone 21 and the position information from the GPS 22 to the sound source separation / sound source localization unit 12 and receives the commentary data from the guide creation unit 14. It has become.
[0033]
Further, the noise canceling circuit 25 cancels noise so that the user using the headset 20 does not disturb the commentary sound from the headphones 23.
[0034]
The voice guide system 10 according to the embodiment of the present invention is configured as described above, and as shown in the flowchart of FIG. 4, the headset 20 uses the headset 20 for each user based on the birdsong in a facility such as a natural park. Commentary is provided.
[0035]
First, in FIG. 4, in step ST1, the fixed microphones 11a, 11b,... Of the microphone array 11 and the movable microphone 21 of each headset 20 detect a bird call in a facility such as a natural park. An acoustic signal is transmitted to the sound source separation / localization unit 12.
Here, the positions of the fixed microphones 11a and 11b are input to the sound source separation / sound source localization unit 12 in advance, and the position of the movable microphone 21 of each headset 20 is based on the position information of the headset 20 by GPS. This is known by being input to the sound source separation / sound source localization unit 12.
[0036]
Next, in step ST2, the sound source separation / sound source localization unit 12 performs sound source separation based on sound signals from the fixed microphones 11a, 11b,... Of the microphone array 11 and the movable microphone 21 of each headset 20. The sound source separation is performed by a mathematical solution method using a general microphone array 11 in the unit 12a, the sound source separation is performed by using the IPD and the IID by the directional pass filter 12b, and the independent component analysis is performed in the ICA unit 12c. By performing sound source separation, the position information (absolute coordinate position) of the bird that emitted the squeal as the sound source is detected, and the singing sound of each bird is separated.
Then, the sound source separation / sound source localization unit 12 outputs the position information (absolute coordinate position) of the bird and the call of the bird to the discrimination unit 13 together with the position information of each headset 20.
[0037]
Subsequently, in step ST <b> 3, the determination unit 13 determines the type based on the bird's position information (absolute coordinate position) and the bird's cry and the headset 20's position information input from the sound source separation and sound source localization unit 12. The discriminating unit 13a specifies the type of bird from the song of the bird using the type database 13c.
Then, the type discriminating unit 13a outputs the type information and the position information (absolute coordinate position) of the bird to the guide creating unit 14 and, at the same time, transmits the bird call and the type information to the detailed discriminating unit 13b. Send out.
[0038]
Thereby, in step ST4, the detail discriminating unit 13b makes a detailed discrimination of the bird using the detailed database 13d based on the bird's cry and the type information, and outputs the bird's detailed information to the guide creating unit 14. .
[0039]
Then, in step ST5, the guide creating unit 14 stores the position information (absolute coordinate position) of the bird type information, detailed information, and position information (absolute coordinate position) from the determination unit 13 for each headset 20. Based on the position information of each headset 20 by the GPS 22, the position information of the bird is converted into the relative coordinate position based on the position information, and the comment data on the headset 20 is created based on the type information and the detailed information. The data is transmitted to the headset 20 by the unit.
[0040]
Thus, in step ST6, each headset 20 receives the commentary data created by the guide creation unit 14 by the transmission / reception unit 24, performs noise cancellation by the noise canceling circuit 25, and then makes the explanation sound from the headphones 23. Is provided to the user. Therefore, the user can listen to the comment based on the relative coordinate position with respect to the bird to be observed from the user's position by the commentary sound heard from the headphones 23, and can easily find the bird and at that time. It is possible to grasp the situation of the bird by the squeal.
[0041]
Thus, according to the voice guide system 10 according to the embodiment of the present invention, the acoustic signals from the fixed microphones 11a, 11b,... Of the microphone array 11 and the movable microphone of the headset 20 carried by each user Based on the sound signal from 21, the sound source separation and sound source localization unit 12 performs sound source separation and sound source localization relating to the bird's singing, and the discriminating unit 13 performs bird type and detailed discrimination from the bird's singing. The explanation corresponding to the position of the headset 20 can be provided to the headset 20 of each user.
At this time, the sound source separation and the sound source localization are performed with reference to the acoustic signal from the movable microphone 21 of each headset 20, so that the sound source localization can be performed more accurately with respect to the position of each user.
[0042]
In the above-described embodiment, the sound guide system based on the birdsong has been described. However, the present invention is not limited to this, and it is apparent that the present invention can be applied to a sound guide system based on the sounds of animals other than birds.
[0043]
【The invention's effect】
As described above, according to the present invention, each fixed microphone of the microphone array and the movable microphone of each headset collect the sounds of animals and birds on the premises such as a natural park, and the sound signals collected from the collected sound signals are used. The sound source separation / sound source localization unit separates the sound into the absolute coordinate position of the sound source of each sing and the sound data of each sound source.
Then, the discriminating unit specifies the type of animal or the like that squeaked for each sound source from the acoustic data of each sound source separated by the sound source separation / localization unit, and the guide creating unit determines the type of this animal or the like. To generate commentary data corresponding to the positional information of each headset, and the output unit outputs the commentary data to the headphones of the headset. This allows the user to listen to the commentary flowing from the headphones of the headset carried by the user, thereby obtaining the commentary on the animal, bird, or the like that screams, and the relative coordinate position of the animal, bird, or the like. , The animal, bird, or the like can be easily found.
Therefore, according to the present invention, there is provided a voice guidance system using an extremely excellent cry, which provides a user with a commentary on the animal or the bird based on the cry of the animal or the bird.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an electric configuration of an embodiment of a voice guidance system based on a bird's cry according to the present invention.
FIG. 2 is a schematic perspective view showing the entire configuration of the voice guide system of FIG.
FIG. 3 is a block diagram showing a configuration of a headset in the voice guide system of FIG. 1;
FIG. 4 is a flowchart showing an operation of the voice guide system of FIG. 1;
[Explanation of symbols]
Reference Signs List 10 Sound guide system by birdsong 11 Microphone array 11a, 11b, ... Fixed microphone 12 Sound source separation / sound source localization unit 12a Sound source separation unit 12b Direction pass filter 12c ICA unit 13 Discrimination unit 13a Type discrimination unit 13b Detailed discrimination unit 13c Type database 13d Detailed database 14 Guide creation unit 20 Headset 21 Movable microphone 22 GPS
23 Headphones 24 Transceiver

Claims (7)

A microphone array consisting of a plurality of fixed microphones appropriately arranged on the premises of a facility such as a natural park,
At least one headset including a GPS, a movable microphone, and headphones carried by a user of the facility;
From a sound signal from each fixed microphone of the microphone array and a movable microphone of each headset, a sound source separation / sound source localization unit that performs sound source localization and sound data separation for each sound source for each call.
A discriminating unit that identifies the type of animal or the like that squeaks from acoustic data for each sound source separated by the sound source separation / sound source localization unit
The absolute coordinate position of the sound source localized by the sound source separation / sound source localization unit is converted into a relative coordinate position based on the position information of each headset by GPS, and the type of animal or the like specified by the determination unit, A guide creation unit that creates commentary data on the headset and outputs the data to headphones of the headset;
A voice guidance system based on howling. The sound source separation and sound source localization unit includes a receiving unit that receives position information by GPS from each headset and an acoustic signal by a movable microphone,
The guide creation unit includes a transmission unit that transmits commentary data,
2. The headset according to claim 1, wherein each of the headsets includes a transmission / reception unit that transmits positional information by GPS and an acoustic signal by a movable microphone to the reception unit, and receives commentary data from the transmission unit. A voice guidance system based on the cry described in. 2. The sound source separation and sound source localization unit performs sound source separation based on acoustic signals from each fixed microphone and each movable microphone by a mathematical solution using a general microphone array. Or an audio guide system based on the squeal described in 2. The voice guidance system according to any one of claims 1 to 3, wherein the sound source separation / sound source localization unit performs sound source separation using a direction pass filter. The voice guidance system according to any one of claims 1 to 4, wherein the sound source separation / sound source localization unit further performs sound source separation by independent component analysis. The method according to any one of claims 1 to 5, wherein the determination unit refers to a type database including sounds of various animals and the like, and specifies the type of the animals and the like from the sounds of the animals and the like. Voice guidance system by the described call. 7. The method according to claim 1, wherein the discriminating unit performs detailed discrimination such as sex discrimination of animals and the like and situation discrimination based on types of animals and the like and further by referring to various detailed databases. A voice guide system based on the cries described in Crab.

Images