JP2002304191A - Audio guide system using chirping - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an audio guide system using chirping, which provides explanations of an animal or a bird for a user, based on the chirping of the animal or the bird. SOLUTION: The audio guide system includes a microphone array 11, consisting of many fixed microphones 11a, 11b, etc., at least one head set 20 consisting of a GPS 22, a mobile microphone 21, and a headphone 23, a sound source separating and locating part 12, which locates and separates a sound source related to each chirp according to sound signals of individual fixed microphones and the mobile microphone, a discrimination part 13 which specifies a classification of chirping animal or the like according to sound data of each separated sound source, and a guide generation part 14 which converts the absolute coordinate position of the sound source located by the sound source separating and locating part to a the relative coordinate position, on the basis of position information of the GPS in each head set and generates explanation data related to the head set from the classification of animals or the like specified by the discrimination part and outputs this generated data to the headphone.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a voice guidance system based on a singing sound which provides a user with a commentary on the animal or bird based on the singing sound of the animal or bird in a facility such as a natural park. is there.

[0002]

2. Description of the Related Art Generally, in a natural park or the like, a user moves appropriately within the site of the natural park or the like and observes the natural appearance of animals and birds. In order to provide the user with information on animals and birds, for example, images such as pictures and photographs of animals and birds, and guide boards and pamphlets with commentary on them are prepared.

[0003]

However, it is usually difficult for a user to discriminate the sounds of animals and birds. For this reason, the user cannot determine the type of the animal or the bird even if the squeal is heard. Therefore, in particular, in the case of wild birds, even if an attempt is made to find the shape of the wild bird, if the wild bird is not known, the wild bird itself is small and cannot be easily searched.

SUMMARY OF THE INVENTION In view of the above, it is an object of the present invention to provide a voice guidance system based on the sounds of animals and birds, which provides the user with a commentary on the animals and birds. And

[0005]

SUMMARY OF THE INVENTION According to the present invention, there is provided a microphone array comprising a plurality of fixed microphones appropriately arranged on a site of a facility such as a natural park, and a user of the facility. Based on at least one headset including a portable GPS, a movable microphone and headphones, and sound signals from the fixed microphones and the movable microphones of the microphone array, localization of sound sources and sound data of each sound source for each sound source are determined. A sound source separation / sound source localization unit for performing separation, a discrimination unit for specifying a type of an animal or the like that squeals from sound data for each sound source separated by the sound source separation / sound source localization unit, and the sound source separation / sound source localization unit The absolute coordinate position of the sound source localized in step 2 is converted into a relative coordinate position based on the positional information of each headset by GPS, and According to the type of animals and the like specified by, to create commentary data on the headset, and a guide creation unit that outputs to the headphones of the headset, by a voice guidance system by barking, Achieved.

[0006] In the voice guidance system based on a call according to the present invention, preferably, the sound source separation / sound source localization unit includes a reception unit for receiving position information by GPS from each headset and an acoustic signal by a movable microphone. The guide creation unit includes a transmission unit that transmits commentary data. Each of the headsets transmits position information by GPS and an acoustic signal by a movable microphone to the reception unit, and the commentary data from the transmission unit. Is provided.

[0007] In the voice guidance system according to the present invention, preferably, the sound source separation / sound source localization unit uses a general microphone array based on acoustic signals from each fixed microphone and each movable microphone. Sound source separation is performed by the solution method.

[0008] In the voice guidance system based on a call according to the present invention, preferably, the sound source separation / sound source localization unit performs sound source separation by a direction pass filter.

[0009] In the voice guidance system according to the cry of the present invention, preferably, the sound source separation and sound source localization unit further performs sound source separation by independent component analysis.

[0010] In the voice guidance system according to the present invention, preferably, the discriminating unit refers to a type database provided with the sounds of various animals and the like, and specifies the type of the animals and the like from the sounds of the animals and the like. Do.

[0011] In the voice guidance system based on the call of the present invention, it is preferable that the discriminating unit refers to the type of the animal or the like and further refers to various detailed databases to determine the sex of the animal or the like and the details of the situation discrimination. Make a determination.

According to the above arrangement, the fixed microphones of the microphone array and the movable microphones of each headset collect the sounds of animals and birds in the premises such as a natural park, and separate the sound source from the collected sound signals. The sound source localization unit separates the sound into the absolute coordinate position of the sound source of each call and the sound data of each sound source. Then, the discriminating unit specifies the type of animal or the like that squeaked for each sound source from the acoustic data of each sound source separated by the sound source separation / localization unit, and the guide creating unit determines the type of this animal or the like. To create commentary data corresponding to the position information of each headset, and the output unit outputs the commentary data to the headphones of the headset. This allows the user to listen to the commentary flowing from the headphones of the headset carried by the user, thereby obtaining the commentary on the animal, bird, or the like that screams, and the relative coordinate position of the animal, bird, or the like. , The animal, the bird, and the like can be easily found.

[0013] The sound source separation / sound source localization unit includes a receiving unit for receiving positional information from each headset by GPS and an acoustic signal from a movable microphone, and the guide creating unit includes a transmitting unit for transmitting commentary data. When each of the headsets transmits position information by GPS and an acoustic signal by a movable microphone to the receiving unit, and includes a transmitting and receiving unit that receives commentary data from the transmitting unit, Each headset transmits the position information by GPS and the acoustic signal by the movable microphone to the sound source separation / sound source localization unit, and also receives the commentary data from the guide creation unit to transmit and receive data wirelessly. Can do it. Therefore, the user
The user can freely move around the premises such as a natural park while carrying a headset.

When the sound source separation / sound source localization unit performs sound source separation by a mathematical solution using a general microphone array based on acoustic signals from each fixed microphone and each movable microphone, Sound source separation can be performed by such a mathematical solution using a microphone array in a broad sense including the above.

When the sound source separation / sound source localization unit performs sound source separation using a direction pass filter, sound source separation can be easily performed by using a direction pass filter.

When the sound source separation / sound source localization unit further performs sound source separation by independent component analysis, sound source separation can be reliably performed by using independent component analysis.

When the discriminating unit specifies the type of the animal or the like from the call of the animal by referring to the type database including the call of the animal or the like, the call of the animal or the like to be discriminated is determined. Since the database is prepared in advance, the type of the animal or the like can be quickly specified from the call of the animal or the like.

The above-mentioned discriminating section is based on a kind of an animal or the like.
Further, when performing detailed discrimination such as sex discrimination of animals and the like and situation discrimination with reference to various detailed databases, more detailed discrimination, that is, sex of animals,
It is possible to determine under what circumstances the call is uttered.

[0019]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail based on embodiments shown in the drawings. FIG. 1 shows an electrical configuration of an embodiment of a voice guidance system based on a bird's cry applied to the present invention. In FIG. 1, a voice guide system 10 includes a microphone array 11 that sounds from a plurality of fixed microphones 11a, 11b,... Separation / sound source localization unit 12, discrimination unit 13,
It comprises a guide creating unit 14 and a headset 20 carried by a facility user.

As shown in FIG. 2, the microphone array 11 includes a plurality of fixed microphones 11a, 11b, which are appropriately fixed and arranged within a site 10a of a facility such as a natural park.
... Each fixed microphone 11a, 11
For b,..., basically, it is only necessary to collect the birdsong from above, so a directional microphone is used. Each fixed microphone 11a, 11b,...
The signal is input to a sound source separation / sound source localizing unit 12 described later. The fixed microphones 11a, 11b,.
May be connected to the sound source separation / localization unit 12 via a cable, respectively, or may be connected wirelessly.

The sound source separation / sound source localization unit 12 is provided, for example, in the management building 1 provided in a site 10a of a facility such as a natural park.
. 0b, etc., and detects the singing of the bird based on the acoustic signals from the fixed microphones 11a, 11b,... Of the microphone array 11 and the movable microphone of each headset 20. The localization (position information to the absolute coordinate position) and the call of the bird are separated. At this time, the positions of the fixed microphones 11a, 11b,... Of the microphone array 11 have been input to the sound source separation / sound source localization unit 12 in advance, and the positions of the headsets 20 are provided in the headset 20. GP
It will be detected based on the position information by S.

The sound source separation / sound source localization unit 12
Is a sound source separation unit 12a, a direction pass filter 1
2b and ICA (Independent Compo)
Nent Analysis-Independent Component Analysis) 12c
Contains.

The sound source separating section 12a is based on acoustic signals from the fixed microphones 11a, 11b,... Of the microphone array 11 and the movable microphones of each headset 20, and is based on mathematical analysis using a general microphone array. It is configured to perform sound source separation by a solution method.

The above-mentioned direction pass filter 1
2b denotes each fixed microphone 11 of the microphone array 11.
, and sound signals from the movable microphones of the respective headsets 20 to separate sound sources using the interaural phase difference IPD and the binaural intensity difference IID.

Further, the ICA section 12c performs independent component analysis based on the acoustic signals from the individual fixed microphones 11a, 11b,. According to the acoustic signal level of each microphone according to the probability distribution of, the acoustic signal of each sound source is restored by matrix calculation to separate the sound sources, and the absolute coordinate position of the sound source is detected.

The discriminating unit 13 is provided in, for example, a management building 10b or the like provided in a site 10a of a facility such as a natural park, and is provided with a sound of a bird separated by the sound source separation / localization unit 12. By inputting the position information (absolute coordinate position) and the position information of each headset 20,
It identifies the call of each bird.
3a and a detail discriminating unit 13b.

The type discriminating unit 13a refers to the type database 13c having various types of bird calls and specifies the type of the bird based on the bird calls, and the type information and position information (absolute coordinate position) of the birds. Then, the position information of each headset 20 is sent to the guide creating unit 14. Further, based on the bird's singing from the sound source separation / sound source localizing unit 12 and the bird's type information from the type determining unit 13a, the detailed discriminating unit 13b has a detailed database 13d having a singing according to the gender and situation of the bird. , And perform detailed discrimination such as gender discrimination and situation discrimination of the bird based on the call of the bird.
It is sent to the guide creation unit 14.

The guide creating unit 14 is, for example, a management building 10 provided on the site 10a of a facility such as a natural park.
b, etc., for each headset 20, the position information (absolute coordinate position) from the determination unit 13 is calculated based on the position information of each headset 20 by GPS, and the relative coordinate position of the bird position information. And, based on the type information and the detailed information of the bird determined by the determination unit 13, create commentary data on the headset 20.
Is transmitted to the headset 20 by the transmitting / receiving unit 24 shown in FIG.

Here, when creating the commentary data, the guide creating unit 14 uses, based on the position information of each headset 20, the periphery of the headset 20, that is, the usage using the headset 20. Creates commentary data limited to the birdsong within the range that can be heard. In addition,
In the case shown in the figure, the guide creation unit 14
However, the present invention is not limited to this, and one guide creation unit 14 may create commentary data corresponding to all headsets 20. May be prepared, and the commentary data may be prepared for the headset 20 as needed.

At least one headset 20 is provided so that a user of a facility such as a natural park can carry the headset 20, and as shown in FIG. 3, a movable microphone 21, a GPS 22, Further headphones 23
, A transmission / reception unit 24, and a noise cancellation circuit 25.

The movable microphone 21 detects sound around the headset 20 and generates an acoustic signal. The GPS 22 has a known configuration.
The position of the headset 20 is detected by receiving a radio wave from a PS satellite to generate position information.

The headphones 23 provide a commentary voice to the user based on the commentary data from the guide creation unit 14. The transmission / reception unit 24 receives the sound signal from the movable microphone 21 and the G signal.
The position information from the PS 22 is transmitted to the sound source separation / sound source localization unit 12.
, And receives commentary data from the guide creation unit 14.

Further, the noise canceling circuit 25
Is such that the user using the headset 20 does not disturb the commentary sound from the headphones 23,
Cancel noise.

The voice guide system 10 according to the embodiment of the present invention is configured as described above. As shown in the flowchart of FIG. 4, a head is provided to each user based on the birdsong in a facility such as a natural park. Set 20 provides the commentary.

First, in FIG. 4, in step ST1, each fixed microphone 11a,
.. And the movable microphone 2 of each headset 20
1 detects a bird's cry in a facility such as a natural park and sends an acoustic signal to the sound source separation / localization unit 12. Here, the position of each fixed microphone 11a, 11b is
It is input to the sound source separation and sound source localization unit 12 in advance,
The position of the movable microphone 21 of each headset 20 is known when positional information of the headset 20 by the GPS is input to the sound source separation / sound source localization unit 12.

Next, in step ST 2, the sound source separation / sound source localization unit 12 is based on sound signals from the fixed microphones 11 a, 11 b,... Of the microphone array 11 and the movable microphone 21 of each headset 20. The sound source separation unit 12a performs sound source separation by a mathematical solution using a general microphone array 11, and performs a sound source separation using IPD and IID by a rejection pass filter 12b. By performing sound source separation by independent component analysis, positional information (absolute coordinate positions) of the birds that emitted the singing sound as the sound source is detected, and the singing sound of each bird is separated. Then, the sound source separation / sound source localization unit 12 outputs the position information (absolute coordinate position) of the bird and the call of the bird to the determination unit 13 together with the position information of each headset 20.

Subsequently, in step ST3, the determination section 13
Based on the bird position information (absolute coordinate position) and the bird squeal input from the sound source separation / sound source localization unit 12, the bird squeal, and the position information of each headset 20, the type discriminator 13a derives the type database 13c from the bird squash. To identify the type of bird. Then, the type determination unit 13a transmits the type information and position information (absolute coordinate position) of the bird to the guide creation unit 14
And sends the bird's cry and the type information to the detailed determining unit 13b.

Thus, in step ST4, the detail discriminating unit 13b makes a detailed discrimination of the bird using the detailed database 13d based on the bird's call and the type information.
The detailed information of the bird is output to the guide creating unit 14.

Then, in step ST5, the guide creating section 14 sends the position information (absolute coordinate position) of the bird type information, detailed information and position information (absolute coordinate position) from the discriminating section 13 to each head. Each headset 2 for each set 20
0 based on the positional information by the GPS 22 and converts the relative coordinate position of the bird's positional information to the relative coordinate position, creates commentary data on the headset 20 based on the type information and the detailed information, and transmits the data to the headset by a transmitting unit (not shown). Send to set 20.

Thus, in step ST6, each headset 20 receives the commentary data created by the guide creation unit 14 by the transmission / reception unit 24, performs noise cancellation by the noise cancellation circuit 25, and then cancels the headphones 23. Provides the user with a commentary voice. Therefore, the user can listen to the comment based on the relative coordinate position with respect to the bird to be observed from the user's position by the commentary sound heard from the headphones 23, and can easily find the bird and at that time. It is possible to grasp the situation of the bird by the call.

As described above, according to the voice guidance system 10 according to the embodiment of the present invention, the audio signals from the fixed microphones 11a, 11b,. The sound source separation and sound source localization unit 12 performs sound source separation and sound source localization on the bird's cry from the acoustic signal from the movable microphone 21, and the discrimination unit 13 discriminates the type and detail of the bird from the bird's cry. , A comment corresponding to the position of the headset 20 can be provided to the headset 20 of each user. that time,
By performing sound source separation and sound source localization with reference to the sound signal from the movable microphone 21 of each headset 20,
More accurate sound source localization for the position of each user can be performed.

In the above-described embodiment, the voice guidance system based on the singing of a bird has been described. However, it is apparent that the present invention can be applied to a voice guiding system based on the singing of an animal other than a bird. is there.

[0043]

As described above, according to the present invention,
Each fixed microphone of the microphone array and the movable microphone of each headset collect the sounds of animals and birds in the premises such as natural parks, and the sound source separation and sound source localization unit The sound source is separated into absolute coordinate positions and sound data for each sound source. Then, the discriminating unit specifies the type of animal or the like that squeaked for each sound source from the acoustic data of each sound source separated by the sound source separation / localization unit, and the guide creating unit determines the type of this animal or the like. To create commentary data corresponding to the position information of each headset, and the output unit outputs the commentary data to the headphones of the headset. This allows the user to listen to the commentary flowing from the headphones of the headset carried by the user, thereby obtaining the commentary on the animal, bird, etc. that made the cry, and the relative coordinate position of the animal, bird, etc. , The animal, the bird, and the like can be easily found. Therefore, according to the present invention, there is provided a voice guidance system with an extremely excellent cry which provides a user with an explanation of the animal or bird based on the cry of the animal or bird.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an electric configuration of an embodiment of a voice guidance system based on bird calls according to the present invention.

FIG. 2 is a schematic perspective view showing the overall configuration of the voice guide system of FIG.

FIG. 3 is a block diagram showing a configuration of a headset in the voice guide system of FIG. 1;

FIG. 4 is a flowchart showing an operation of the voice guide system of FIG. 1;

[Explanation of symbols]

 Reference Signs List 10 Voice guide system by birdsong 11 Microphone array 11a, 11b,. Type database 13d Detailed database 14 Guide creation unit 20 Headset 21 Movable microphone 22 GPS 23 Headphone 24 Transmission / reception unit

Continuation of front page (72) Inventor Hiroaki Kitano 2-18-3, Nishikosenba-cho, Kawagoe-shi, Saitama F-term (reference) 5D015 AA06 KK04 5D045 AB30

Claims (7)

[Claims] 1. A microphone array composed of a plurality of fixed microphones appropriately arranged on the site of a facility such as a natural park, and at least one head composed of a GPS, a movable microphone, and headphones carried by a user of the facility. A sound source separation / sound source localization unit for performing sound source localization and sound data separation for each sound source from sound signals from each fixed microphone of the microphone array and the movable microphone of each headset, and the sound source separation A discriminator that specifies the type of animal or the like that squeals from the sound data for each sound source separated by the sound source localization unit, and the absolute coordinate position of the sound source localized by the sound source separation and sound source localization unit is determined by each headset. Is converted into a relative coordinate position based on the positional information by GPS, and the type of the animal or the like specified by the determination unit is Create a description data related Ddosetto, characterized in that it includes a guide creation unit that outputs to the headphone of the headset, a voice guide system according to cry. 2. The sound source separation / sound source localization unit includes a reception unit that receives position information by GPS from each headset and an acoustic signal by a movable microphone, and the guide creation unit transmits commentary data. A transmitting unit, wherein each of the headsets transmits position information by GPS and an acoustic signal by a movable microphone to the receiving unit, and includes a transmitting and receiving unit that receives commentary data from the transmitting unit. The voice guidance system according to claim 1, characterized in that it is characterized by: 3. The sound source separation and sound source localization unit performs sound source separation by a mathematical solution using a general microphone array based on acoustic signals from each fixed microphone and each movable microphone. 3. The voice guidance system based on a call according to claim 1 or 2. 4. The voice guidance system according to claim 1, wherein the sound source separation / sound source localization unit performs sound source separation by using a direction pass filter. 5. The sound source separation / sound source localization unit further comprises:
The sound guide system according to any one of claims 1 to 4, wherein sound source separation is performed by independent component analysis. 6. The method according to claim 1, wherein the determination unit refers to a type database including sounds of various animals and the like, and specifies the type of the animals and the like from the sounds of the animals and the like.
The voice guidance system according to any one of claims 1 to 5. 7. The method according to claim 1, wherein the discriminating unit performs detailed discrimination such as sex discrimination of animals and the like and situation discrimination based on the kind of the animals and the like and further referring to various detailed databases. 7. The voice guide system according to any one of items 1 to 6.