JPS58223188A - Plosive recognition equipment - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

DETAILED DESCRIPTION OF THE INVENTION The present invention relates to a plosive sound recognition device for recognizing plosive sounds.

In recent years, research into speech recognition devices has become active, and some devices have been put into practical use and are now on the market. Expectations are increasing as the most natural means of communication between humans and computers, which continue to advance rapidly.

However, a device that can correctly recognize the utterances of any speaker has not been obtained, and it is particularly difficult to detect and classify irregular consonants, and it is also very difficult to reliably detect and classify plosive consonants.

Furthermore, the conventional method requires a large number of arithmetic operations including multiplication and division, such as calculating a feature vector from the outputs of a large number of bandpass filters or calculating the bias of one frequency.

An object of the present invention is to provide a plosive recognition device that reliably detects and classifies plosive consonants of any speaker. Another object of the present invention is to provide a plosive recognition device that does not require multiplication and division in the plosive recognition unit and has simple arithmetic processing.

Hereinafter, one embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram of a plosive recognition device according to an embodiment of the present invention. In the figure, 1 is an audio wave detector;
For example, 02, which is a low-noise close-talk type microphone, is an exhalation flow rate detector, such as a hot wire flowmeter sensor, etc., and when in use, it is placed in front of the oral cavity to detect the exhalation flow rate. 3
is a laryngeal vibration detector, such as a vibration pickup, which is attached to the larynx near the vocal cords using medical double-sided tape or the like to detect laryngeal vibration. 4 is a palate contact detector that detects contact information between the tongue and the hard palate, and an example of its shape is shown in FIG. The palate contact detector 4 has a plurality of electrodes 41L arranged, and when used, it can detect the state of contact between the tongue and the hard palate by attaching it to the hard palate in the oral cavity.

FIGS. 3(a) to 3(d) schematically show patterns of the state of contact between the tongue and the hard palate, and the hatched areas indicate the contact areas. The figure (IL) shows a pattern typically seen in /S, Z/ utterances, and the figure (b) shows /i, j, f/.
The pattern seen when uttering words such as (0) in the same figure is /l,
Patterns seen when uttering d, n/, etc., in the same figure ((1
) is a pattern typically seen when /r/ is uttered.

Reference numeral 6 denotes a voice wave intensity detector, and 1 is, for example, a detection and smoothing circuit, which extracts the envelope of the voice wave. 6 is a laryngeal vibration intensity detector, for example, a detection smoothing circuit, which extracts the envelope of laryngeal vibration; 07 is a temporary storage unit for detection information; Expiratory flow rate information that is the output of the detector 2, laryngeal vibration intensity information that is the output of the intensity detector 6, and palate contact information that is the output of the palate contact detector 4 are temporarily stored. Reference numeral 8 denotes a plosive sound recognition section that recognizes plosive sounds based on information in the temporary storage section, which will be explained in more detail below with reference to FIG.

In FIG. 4, reference numeral 81 denotes a sound interval search unit, which searches for an interval with a sound based on the sound wave intensity information (a) in the temporary storage unit 7. Reference numeral 082 denotes a plosive sound inspection unit, which searches for an interval with a sound based on the sound wave intensity information (a) in the temporary storage unit 7. If the sound is a plosive sound, it is checked based on the expiratory flow rate information in the temporary storage section 7. Reference numeral 83 denotes a contact pattern inspection unit which detects /l, d/ and /K, P, g among plosives based on the palate contact information in the temporary storage unit 7.
, b / and perform a classification check.

Reference numeral 84 denotes a first voiced sound testing unit, which tests /l, (1/ based on the laryngeal vibration intensity information (c) in the temporary storage unit 7) and recognizes and classifies /1/ and /d/. 86 is the second voiced sound test section, which tests p, g, b/ on / based on the laryngeal vibration intensity information section (c) /k, p/
It is classified into two types: /g and b/. 86 is a first expiratory flow rate test section, which detects /k based on the expiratory flow rate information (b).
, p/ is inspected and /ni/ and /p/ are recognized and classified. Reference numeral 87 denotes a second expiratory flow rate test section, which tests /g and b/ based on the expiratory flow rate information (b).
Recognize and classify 0 and /b/ The phonemes uttered by the plosive recognition device configured as described above are /l/, /d/, /ni/, and /p/.

It is possible to recognize whether /g/ or /b/ is a plosive, and whether it is silent or non-plosive.

The operation of the plosive recognition unit 8 will be explained below according to the flowchart shown in FIG.

(a) First, search for a sound interval.〇-Condition 1 for the voice wave intensity to be greater than the threshold determined by experiment and duration length according to the voice wave intensity information in the temporary storage unit
For example, if the condition of 8QmSOC or more is satisfied, the section is determined to be a sound section; if the condition is not satisfied, it is recognized as silent.

(Sound interval search unit 81) (b) Before and after the start of the 0-sound interval in which the test is performed to determine whether it is a plosive, the expiratory flow velocity is determined by the expiratory flow rate information in the temporary storage unit 7 to the threshold value and duration determined experimentally. If there is an expiratory flow section that satisfies the conditions for and the rate of change in expiratory flow velocity at the beginning of the expiratory flow section is greater than an experimentally determined threshold, it is recognized as a plosive sound, and in other cases it is recognized as a non-plosive sound.

(Plosive sound inspection unit 82) (0) Next, check the plosive sounds /l, d/, /k, p
It is classified into two categories: , g, and b/. In front of the beginning of the sound section, check the temporary storage unit 70 lid contact information,
Closure contact pattern TDN or R (Fig. 3(C)).

(See (1)) and if the condition for the duration determined by experiment is satisfied, then either /l or d/, and if the condition is not satisfied, then p, g, or b/. .

(Contact pattern inspection unit) ((1) If either /l or d/, /1/
Recognize and /d/. Before and after the start of a voiced section, a section in which the laryngeal vibration intensity satisfies the conditions for the threshold value and duration length determined by experiment is examined based on the laryngeal vibration intensity information in the temporary storage section 7, and that section is designated as a voiced section. do.

Find the time difference between the start of the voiced section and the start of the voiced section, and if the start of the voiced section is ahead of the start of the voiced section by a certain amount of time determined by experiment, for example 2 omsec or more, it is voiced, and otherwise Determined as voiceless sound. Therefore, it is possible to recognize and classify the voiced plosive /d/ and the voiceless plosive /1/.

(Voiced sound inspection unit 84) (If any of p, g, and b/ is found in 617, it is classified into voiced sounds /g, b/ and unvoiced sounds /, and p/. Voiced sounds and unvoiced sounds The determination is made by the voiced sound testing section 8 (d)
Proceed in the same manner as 4).

(Voiced sound test i [5s) (f) If / is either p/, then / is /
and /'p/''.The start of the sound section and the beginning of the expiratory flow section are compared, and the start of the sound section precedes the start of the expiration flow section by a certain amount of time determined experimentally. If so, it is recognized as /ni/, and in other cases, it is recognized as /p/.

(Expiratory flow rate test unit 86) (g) If it is either /g or b/, /g/ and /b/ are recognized. Compare the start of the sound section and the start of the expiratory flow section, and if the start of the sound section precedes the start of the expiration flow section by a certain amount of time determined by experiment, /g/, otherwise is recognized as /b/.

(Expiratory flow rate testing unit 87) As described above, according to this embodiment, a sound interval is searched based on the sound wave intensity information, a plosive is determined based on the expiratory flow rate information, and a plosive is determined based on the palate contact information. plosive /l
, d/ and /, p3g, b/, and then inspected based on the laryngeal vibration intensity information, voiced plosives /d, g, b/ and voiceless plosives /l, p, /Classify. Furthermore, based on the phase difference between the expiratory flow section inspected based on the expiratory flow velocity information and the sound section, the labial plosive sound/p
, b/ and the plosive sounds /k, g/ near the back of the tongue, the uttered phoneme becomes a plosive sound /l/, /(
1/.

It is possible to recognize whether it is /ni/, /p/, /g/, /b/, or whether it is silent or a non-plosive sound.

In this example, p, g, b/ are added to /l, d/ and /.
After performing the two classifications, voiced plosives and voiceless plosives are classified, but after classifying voiced and voiceless sounds,
Contact pattern testing may also be performed.

It is also possible to configure the sound interval search section 81 and each of the inspection sections 82 to 87 to perform test classification without determining the conditions for each duration length, and finally to determine the conditions for the duration length. can.

As described above, the present invention is configured to temporarily store voice intensity information, expiratory flow velocity information, laryngeal vibration intensity information, and palate contact information, and recognize plosive sounds based on this temporarily stored information. It is possible to reliably detect and classify plosive consonants in people, and it is possible to realize a plosive consonant recognition device that requires no multiplication or division in the plosive recognition unit and has simple arithmetic processing, which has a significant effect on speech recognition, etc. It is something.

[Brief explanation of the drawing]

FIG. 1 is a block diagram showing a plosive recognition device according to an embodiment of the present invention, FIG. 2 is a diagram showing an example of the shape of a palate contact detector, and FIGS. 3(a) to (d) are diagrams showing a palate contact detector. FIG. 4 is a block diagram showing a specific example of the plosive recognition section, and FIG. 6 is a flowchart for explaining the operation of the plosive recognition section. 1...Audio wave detector, 2...Expiratory flow rate detector. 3... Laryngeal vibration detector, 4... Palate contact detector. 6...Intensity detector, 6...Intensity detector, End...Temporary storage section, 8......Plosive sound recognition section. Patent applicant Makoto Ishizaka, Director of the Agency of Industrial Science and Technology - 2nd
Figure 3 Figure 1α) l approx. (C+ (dl Figure 5

Claims (1)

[Claims] means for detecting voice waves, means for obtaining voice intensity information from the detected voice waves, means for detecting expiratory flow velocity, means for detecting laryngeal vibrations, and obtaining laryngeal vibration intensity information from the detected laryngeal vibrations. means for detecting contact information between the tongue and the hard palate; a temporary storage section that temporarily stores the voice intensity information, expiratory flow rate information, laryngeal vibration intensity information, and palate contact information; A plosive sound recognition device comprising: a plosive sound recognition unit that recognizes plosive sounds.