JP2005308993A - Learning support system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a learning support system with which influence of a difference in solid difference of a speaker can be reduced and it can be made easy to compare waveforms of a teaching material and a learner's speech. <P>SOLUTION: A waveform display processing part 103 generates a pitch waveform comparison image for comparing teaching material pitch waveform information and learner pitch waveform information. At this point, a waveform display processing part 103 adjusts a pitch waveform display position to absorb the difference between a representative pitch of the speech of the teaching material and a representative pitch of the learner. Further, the waveform display processing part 103 generates a sound pressure waveform comparison image as an image for comparing teaching material sound pressure waveform information and learner sound pressure waveform information. In this case, the waveform display processing part 103 adjusts a sound pressure waveform to absorb the difference between the sound pressure variation width of the speech of the teaching material and sound pressure variation width of the speech of the learner. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a learning support system having a function of extracting and displaying a pitch waveform and a sound pressure waveform from speech.

  Conventionally, a learning support system for language learning using multimedia technology has been proposed (see, for example, Patent Document 1). The conventional learning support system has a display function of a sound pressure waveform and a pitch waveform as a convenient function for visually comparing the voice of the teaching material with the voice of the learner. In this case, a sound pressure waveform and a pitch waveform are extracted from the voice of the teaching material. A sound pressure waveform and a pitch waveform are also extracted from the input voice of the learner. These waveforms are displayed on the screen according to the learner's operation.

  As an example of a conventional learning support system, a sound pressure waveform and a pitch waveform are displayed as follows. First, an audio file of a learning material is read, and a sound pressure waveform of the learning material is displayed in the upper area of the image. Next, the learner utters, the sound is recorded, and the sound pressure waveform of the recorded sound is displayed in the lower area of the image. The range of the portion to be compared is specified for the upper area and the lower area. Next, when a button operation for opening the pitch extraction waveform screen is received, the pitch extraction waveform screen opens. Then, the pitch waveforms in the designated ranges of the teaching material voice and the learner voice are displayed separately in an upper stage and a lower stage.

In the speech learning, the learner uses the above function, looks at the waveform comparison image, compares the waveform of the teaching material with his own waveform, and brings his waveform close to the waveform of the teaching material. Through this kind of learning, you can improve your language skills.
JP 2002-23613 (page 3-4, FIG. 1)

  However, the conventional learning support system has a problem that the waveform comparison image is not easily compared because the waveform comparison image is affected by the individual difference between the speaker of the teaching material and the learner as described below.

  For example, it is assumed that the speaker of the teaching material is louder than the learner. In this case, when the learner speaks normally, the sound pressure waveform differs by the amount of the voice. In order to match the sound pressure waveform of the learner with the sound pressure waveform of the teaching material, the learner must make a loud voice that is different from normal. As a result of paying attention to the loudness of the voice, the effectiveness of the practice may be reduced.

  As shown in the above example, the sound pressure varies depending on the loudness of the speaker's individual voice and also varies depending on the position of the microphone. The pitch has individual differences depending on the gender of the speaker, and also changes depending on the emotional undulation of the speaker. Such individual differences are directly reflected in the sound pressure and pitch waveforms. Therefore, in order for the learner to adjust his / her waveform to the waveform of the teaching material, he / she has to make a voice with a different volume than usual or a voice with a different height. However, this kind of voice adjustment has nothing to do with improving speech. Rather, such practice may result in just simulating utterance features unrelated to speech technology, as explained in the example above.

  In order to absorb the individual differences of speakers as described above, it is also conceivable that the learner adjusts the microphone input volume according to the teaching material. Also, a pitch search frequency band according to gender may be set. However, such setting work must be done every time the teaching material changes, and it requires labor and knowledge of voice, so it was not preferable to request such work from the learner. .

  Conventionally, the waveform of the teaching material and the waveform of the learner are displayed in different areas, and there is a problem that the distance between the two waveforms is long and the comparison is not easy.

  The present invention has been made to solve the above-described problem, and provides a learning support system that can easily compare the learning material and the waveform of the learner's voice by reducing the influence due to the difference in individual differences of the speakers. It is in.

  The learning support system according to the present invention includes learning material pitch acquisition means for acquiring learning material pitch waveform information that is a pitch waveform of a learning material voice, and learner pitch acquisition that acquires learner pitch waveform information that is a pitch waveform of a learner's voice. Means, a pitch waveform comparison image generating means for generating a pitch waveform comparison image for comparing the learning material pitch waveform information and the learner pitch waveform information, and a voice of the teaching material Display position adjusting means for adjusting the pitch waveform display position so as to absorb the difference between the representative pitch and the representative pitch of the learner.

  With this configuration, the pitch waveform display position is adjusted so as to absorb the difference between the representative pitch of the teaching material's voice and the representative pitch of the learner, so that the learner does not force the pitch to match the teaching material. However, it is possible to provide a comparative image drawn at a position where the teaching material and the learner's pitch waveform can be easily compared. Therefore, it is possible to reduce the influence on the difference between individual speakers and to easily compare the teaching material and the voice waveform of the learner.

  In the learning support system of the present invention, the display position adjusting means uses an average value of pitches as the representative pitch. With this configuration, it is possible to provide a comparative image in which the average difference between the teaching material and the learner's pitch is absorbed.

  In the learning support system of the present invention, the pitch waveform comparison image generation unit superimposes the teaching material pitch waveform information and the learner pitch waveform information. This configuration makes it easier to compare the pitch between the teaching material and the learner's voice.

  In the learning support system of the present invention, the pitch waveform comparison image generating means generates a pitch waveform image in real time from the input voice of the learner, and the display position adjusting means is the learner's voice recorded in the past. The display position is adjusted using the representative pitch obtained from the above. With this configuration, the pitch waveform display position can be adjusted in real time.

  In the learning support system of the present invention, the pitch waveform comparison image generating unit generates a pitch waveform image in real time from the input voice of the learner, and the display position adjusting unit is an initial stage of the input voice of the learner. Adjust the display position using the step pitch. Also with this configuration, the pitch waveform display position can be adjusted in real time.

  Further, the learning support system of the present invention is provided in the pitch waveform comparison image generating means, and information indicating a pitch change width is provided in the pitch waveform comparison image for at least one of the teaching material pitch waveform information and the learner pitch waveform information. A change width adding means for adding is provided.

  With this configuration, the learner can easily compare the teaching material and the learner's pitch waveform by paying attention to the pitch change width.

  In the learning support system of the present invention, the change width adding unit adds information indicating the highest pitch and the lowest pitch of the voice to the pitch waveform comparison image. With this configuration, since the highest pitch and the lowest pitch are displayed, it becomes easier to grasp the pitch.

  The learning support system according to another aspect of the present invention includes teaching material sound pressure acquisition means for acquiring teaching material sound pressure waveform information that is a sound pressure waveform of a teaching material voice, and learner sound that is a sound pressure waveform of a learner's voice. Learner sound pressure acquisition means for acquiring pressure waveform information, sound pressure waveform comparison image generation means for generating a sound pressure waveform comparison image for comparing the teaching material sound pressure waveform information and the learner sound pressure waveform information, Waveform adjusting means provided in the sound pressure waveform comparison image generating means for adjusting the sound pressure waveform so as to absorb a difference between the sound pressure change width of the sound of the teaching material and the sound pressure change width of the learner's voice; It has.

  This configuration absorbs the difference between the sound pressure change width of the teaching material's voice and the sound pressure change width of the learner's voice, so that the learner can learn from the teaching material without having to adjust the loudness of the voice to the teaching material. It is possible to provide a comparative image in which the sound pressure waveforms of the person are easily compared. Therefore, it is possible to reduce the influence caused by the difference between individual speakers and to easily compare the teaching material and the voice waveform of the learner.

  In the learning support system of the present invention, the waveform adjusting unit uses a maximum sound pressure and a minimum sound pressure width as the sound pressure change width. With this configuration, it is possible to provide a comparative image that absorbs the difference between the dynamic range of the teaching material and the sound pressure of the learner.

  In the learning support system of the present invention, the sound pressure waveform comparison image generating means superimposes the teaching material sound pressure waveform information and the learner sound pressure waveform information. With this configuration, it is possible to further easily compare the sound pressure of the teaching material and the learner's voice.

  Further, in the learning support system of the present invention, the sound pressure waveform comparison image generating means generates a sound pressure waveform image in real time from the input voice of the learner, and the waveform adjusting means is for the learner recorded in the past. The sound pressure waveform is adjusted using the sound pressure change width obtained from the voice. With this configuration, the sound pressure waveform adjusted in real time can be displayed.

  Further, in the learning support system of the present invention, the sound pressure waveform comparison image generating means generates a sound pressure waveform image in real time from the learner's input voice, and the display position adjusting means is the input learner's voice. The display position is adjusted using the sound pressure at the initial stage. With this configuration, the sound pressure waveform adjusted in real time can be displayed.

  Further, the learning support system of the present invention is provided in the sound pressure waveform comparison image generating means, and at least one of the teaching material sound pressure waveform information and the learner sound pressure waveform information, information indicating a sound pressure change width is obtained as sound. A change width adding means for adding to the pressure waveform comparison image is provided.

  With this configuration, the learner can easily compare the teaching material and the sound pressure waveform of the learner by paying attention to the sound pressure change width.

  In the learning support system of the present invention, the change width adding unit adds information indicating the maximum sound pressure and the minimum sound pressure of the sound to the sound pressure waveform comparison image. With this configuration, since the maximum sound pressure and the minimum sound pressure are displayed, it becomes easier to grasp the sound pressure.

  A learning support system according to another aspect of the present invention includes learning material waveform acquisition means for acquiring learning material waveform information that is a waveform of a speech parameter of a learning material, and learner waveform that acquires learner waveform information that is a waveform of a learner's speech parameter. Provided in the acquisition means, the waveform comparison image generation means for generating a waveform comparison image for comparing the learning material waveform information and the learner waveform information, and the waveform comparison image generation means; Adjusting means for adjusting the waveform image so as to absorb the difference between the representative values of the parameters. The voice parameter is, for example, the above pitch or sound pressure. Also with this configuration, the above-described advantages of the present invention can be obtained, that is, the influence due to the difference between individual speakers can be reduced, and the teaching material and the voice waveform of the learner can be easily compared.

  The speech information processing method of the present invention includes a step of acquiring teaching material pitch waveform information that is a pitch waveform of speech of a teaching material, a step of acquiring learner pitch waveform information that is a pitch waveform of a learner's speech, Generating a pitch waveform comparison image for comparing the learning material pitch waveform information and the learner pitch waveform information; and when generating the pitch waveform comparison image, a representative pitch of the teaching material voice and the learner Adjusting the pitch waveform display position so as to absorb the difference from the representative pitch. This configuration also provides the advantages of the present invention described above.

  The speech information processing method according to another aspect of the present invention includes a step of acquiring teaching material sound pressure waveform information that is a sound pressure waveform of speech of a teaching material, and learner sound pressure waveform information that is a sound pressure waveform of a learner's speech. Obtaining a sound pressure waveform comparison image for comparing the learning material sound pressure waveform information and the learner sound pressure waveform information, and generating the sound pressure waveform comparison image, Adjusting the sound pressure waveform so as to absorb the difference between the sound pressure change width of the voice and the sound pressure change width of the learner's voice. This configuration also provides the advantages of the present invention described above.

  The speech information processing program of the present invention includes a step of acquiring teaching material pitch waveform information which is a pitch waveform of speech of a teaching material, a step of acquiring learner pitch waveform information which is a pitch waveform of a learner's speech, Generating a pitch waveform comparison image for comparing the learning material pitch waveform information and the learner pitch waveform information; and when generating the pitch waveform comparison image, a representative pitch of the teaching material voice and the learner And adjusting the pitch waveform display position so as to absorb the difference from the representative pitch of the computer. This configuration also provides the advantages of the present invention described above.

  Further, the speech information processing program according to another aspect of the present invention includes a step of acquiring teaching material sound pressure waveform information that is a sound pressure waveform of speech of a teaching material, and learner sound pressure waveform information that is a sound pressure waveform of a learner's speech. Obtaining a sound pressure waveform comparison image for comparing the learning material sound pressure waveform information and the learner sound pressure waveform information, and generating the sound pressure waveform comparison image, Adjusting the sound pressure waveform so as to absorb the difference between the sound pressure change width of the voice and the sound pressure change width of the learner's voice. This configuration also provides the advantages of the present invention described above.

  The present invention provides adjustment means for absorbing the difference between the representative pitch of the teaching material voice and the learner voice, so that the learning material and the learner can be connected without the learner forcing the voice pitch to match the teaching material. A comparative image that is easy to compare can be provided. Therefore, it is possible to provide a learning support system that can reduce the influence caused by the difference between individual speakers and can easily compare the teaching material and the voice waveform of the learner.

  Hereinafter, a learning support system according to an embodiment of the present invention will be described with reference to the drawings.

  A learning support system according to an embodiment of the present invention is shown in FIG. In the following description, the sound waveform of the learning material is referred to as a learning material waveform, and the learner's sound waveform is referred to as a learner waveform. As the waveform, a pitch waveform and a sound pressure waveform are used. An image for comparing the teaching material and the learner's waveform is called a waveform comparison image.

  In FIG. 1, a learning support system 1 includes a learner terminal 10 and a server terminal 20, which are connected via a network. Although not shown, a plurality of learner terminals 10 having the same configuration are connected to the network. The learner terminal 10 and the server terminal 20 are configured by computers, and the processing functions of each terminal are realized by the CPU executing a program installed in the computer. The network may be a LAN in a school or the Internet. By operating this system on the Web, a system capable of correcting pronunciation on e-learning can be realized.

  Although not shown, a teacher terminal that controls the server terminal 20 is also connected to the network. The teacher terminal may not be provided, and the server terminal 20 may be directly operated by the teacher.

  As shown in FIG. 1, the learner terminal 10 includes a voice input / output unit 101, a voice extraction calculation processing unit 102, a waveform display processing unit 103, a display unit 104, an authentication processing unit 105, a voice related information storage unit 106, a sound pressure The calculation processing unit 107, the audio teaching material data storage unit 108, the learner audio recording unit 109, and the operation unit 110 are included.

  The voice input / output unit 101 is composed of headphones and a microphone, and has a function of outputting the voice of the teaching material and inputting the voice of the learner.

  The voice extraction calculation processing unit 102 has a calculation function for extracting a pitch from voice, and also has a data input / output control function regarding the voice teaching material data storage unit 108, the voice related information storage unit 106, and the learner voice recording unit 109. The pitch extraction calculation function is configured to perform processing such as FFT or autocorrelation. The pitch is extracted from both the teaching material voice and the learner voice. Further, the voice extraction calculation processing unit 102 supplies the teaching material voice to the headphones of the voice input / output unit 101 and acquires the learner voice input to the microphone of the voice input / output unit 101.

  The sound pressure calculation processing unit 107 calculates the sound pressure from the sound data supplied from the sound extraction calculation processing unit 102. The sound pressure is also calculated from both the teaching material voice and the learner voice. The waveform display processing unit 103 performs processing for displaying a pitch waveform and a sound pressure waveform. The waveform display processing unit 103 generates an image of a pitch waveform using the pitch supplied from the voice extraction calculation processing unit 102, and uses the sound pressure supplied from the sound pressure calculation processing unit 107 to generate sound pressure. Generate a waveform image. The pitch waveform and the sound pressure waveform are displayed on the display unit 104. The display unit 104 includes a display.

  The audio teaching material data storage unit 108 stores audio teaching material data. The voice teaching material data is supplied from the voice teaching data storage unit 204 of the server terminal 20 to the learner terminal 10 and is stored in the voice teaching data storage unit 108 by the voice extraction calculation processing unit 102. The learner voice recording unit 109 stores the learner voice input to the voice input / output unit 101 in the form of an audio file.

  The voice related information storage unit 106 stores information obtained by the learner's past learning (hereinafter referred to as voice related information). Voice related information includes “sound pressure (sound intensity)”, “pitch band (average value, highest value, lowest value)”, “frequency characteristics of vowels and consonants”, “microphone input level”, “learning evaluation results” And the like. These are information for each learner, and are information depending on the use environment. The learning evaluation result is information on the measured value of the difference between the teaching material waveform and the learner waveform. The voice related information is obtained from the server terminal 20 via the authentication processing unit 105 described below, and is written into the voice related information storage unit 106 by the voice extraction calculation processing unit 102. Then, the voice extraction calculation processing unit 102 updates the voice related information so as to reflect the learning using the learner terminal 10.

  The authentication processing unit 105 sends an authentication request to the authentication processing unit 201 of the server terminal 20 and receives an authentication result from the server terminal 20. Then, the authentication processing unit 105 obtains the voice related information of the learner to be authenticated from the server terminal 20 and supplies it to the voice extraction calculation processing unit 102.

  The operation unit 110 includes devices such as a keyboard and a mouse, and inputs various operations of the learner. The learner's instruction is input from the operation unit 110 and transmitted to a related processing unit.

  As described above, the learner terminal 10 is configured by a computer. And the program which implement | achieves said various process part is prepared, and these programs are installed in the computer. Then, the CPU executes the program using a configuration such as a memory, and thereby the learner terminal 10 is realized.

  As shown in the figure, the server terminal 20 includes an authentication processing unit 201, a voice related information database 202, a learner information database 203, and a voice teaching material database 204. The audio teaching material database 204 stores various audio teaching materials. The audio teaching material is distributed to the learner terminal 10 via the network.

  The learner information database 203 stores information about each learner, and the learner information includes a name, a number, an ID for authentication, and a password. Further, the learner information database 203 stores attendance information and learning history information of each learner. The voice related information database 202 stores voice related information of each learner. The contents of the voice related information are as described in relation to the voice related information storage unit 106 of the learner terminal 10.

  The authentication processing unit 201 receives an authentication request from the learner terminal 10, performs an authentication process, and transmits an authentication result to the learner terminal 10. When the authentication is successful, the authentication processing unit 201 provides information stored in the speech related information database 202 and the learner information database 203 to the learner terminal 10.

  The server terminal 20 is also composed of a computer as described above. Programs for realizing the authentication processing unit 201 and other information providing functions are prepared, and these programs are installed in the computer. Then, the CPU executes a program using a configuration such as a memory, thereby realizing the server terminal 20.

  An example of the overall operation of the learning support system 1 will be described. As shown in FIG. 2, an authentication process is performed when the system is activated. When information such as an ID and a password is input to the operation unit 110, an authentication request is sent from the authentication processing unit 105 to the authentication processing unit 201 of the server terminal 20 (S10). The authentication processing unit 201 performs authentication processing with reference to the learner information database 203, and notifies the authentication processing unit 105 of the learner terminal 10 of the authentication result (S12).

  If the authentication is successful, the authentication processing unit 201 of the server terminal 20 transmits the speech related information stored in the speech related information database 202 to the authentication processing unit 105 of the learner terminal 10 (S14). Here, information of the learner who is the authentication target is sent. Then, the voice extraction calculation processing unit 102 acquires voice related information data from the authentication processing unit 105 and stores it in the voice related information storage unit 106 (S16). Furthermore, the voice extraction calculation processing unit 102 reads the voice related information from the voice related information storage unit 106. The read information is used as necessary for processing in the learner terminal 10.

  As an operation example at the time of learning after the authentication process, the server terminal 20 reads out the audio teaching material data stored in the audio teaching material database 204 and supplies it to the learner terminal 10. The voice teaching material data is stored in the voice teaching data storage unit 108 by the voice extraction calculation processing unit 102. The voice extraction calculation processing unit 102 supplies the voice of the teaching material obtained from the voice teaching material data storage unit 108 or the voice teaching material database 204 to the voice input / output unit 101.

  The teaching material voice is output from the voice input / output unit 101, and the learner voice is input to the voice input / output unit 101 and supplied to the voice extraction calculation processing unit 102. The voice extraction calculation processing unit 102 stores the learner voice in the learner voice recording unit 109. In addition, the voice extraction calculation processing unit 102 extracts a pitch from the learner voice. The voice extraction calculation processing unit 102 also extracts the pitch from the teaching material voice. The extracted pitch is sent to the waveform display processing unit 103.

  The waveform display processing unit 103 generates a pitch waveform image. At this time, a waveform comparison image that displays the teaching material and the learner's pitch waveform on one screen is generated. Then, the pitch waveform comparison image is displayed on the display unit 104.

  The learning material and the learner's voice data are supplied from the voice extraction calculation processing unit 102 to the sound pressure calculation processing unit 107. The sound pressure calculation processing unit 107 calculates the sound pressure from the voice. The sound pressure information is also sent to the waveform display processing unit 103, and the waveform display processing unit 103 generates an image of the sound pressure waveform. Similar to the pitch waveform, a waveform comparison image that displays the teaching material and the sound pressure waveform of the learner on one screen is generated. A sound pressure waveform comparison image is also displayed on the display unit 104.

  As processing at the end of the system, as shown in FIG. 3, the voice extraction calculation processing unit 102 reads voice-related information from the voice-related information storage unit 106 and supplies it to the authentication processing unit 105 (S20). The voice related information is sent from the authentication processing unit 105 to the authentication processing unit 201 of the server terminal 20 (S22). Then, the authentication processing unit 201 stores the voice related information data in the voice related information database 202.

  As described above, the learning support system 1 displays the waveform comparison image for comparing the teaching material and the learner's waveform for the sound pressure and the pitch. Thereby, the learner can correct the pronunciation while visually recognizing the difference between the teaching material and his / her pronunciation, and can acquire the utterance technique close to the native speaker.

  Further, in the learning support system 1, voice related information of a plurality of learners is collectively stored in the server terminal 20. The voice related information is provided to the learner terminal 10 in conjunction with the authentication function. That is, at the time of login, the voice related information of the learner who has logged in is downloaded to the learner terminal 10. The learner terminal 10 uses voice related information. The voice related information is used for the above-described waveform display, for example. The voice related information is updated when logging out. For example, the speech-related information of the current learning is compared with the speech-related information of the past learning, and the difference is obtained. This difference information is uploaded to the server terminal 20 and stored.

  Therefore, the learner can perform learning using his / her voice related information, regardless of which learner terminal 10 is used for learning. Equipment setting work according to the characteristics of each learner can be reduced. In addition, since the voice related information is updated, the voice related information can contribute to more accurate voice waveform display.

  In this regard, the conventional system is also provided with a parameter setting function for displaying a waveform in accordance with the learner's voice characteristics. However, it is difficult for the learner to know which parameter is set and how an appropriate waveform that matches the learner's own characteristics can be displayed. Moreover, even if the parameters can be set appropriately, a complicated operation of resetting the parameters every time the learner terminal 10 used on the day changes is required. On the other hand, in the present embodiment, learner-related information is collectively stored in a database and downloaded to the learner terminal 10. The terminal function suitable for the learner can be set using the learner related information, and the learner related information can be reflected when any learner terminal 10 is used.

  FIG. 4 shows the waveform display processing unit 103. The data storage processing unit 1031 acquires the teaching material and information on the pitch waveform of the learner from the voice extraction calculation processing unit 102. Further, the data accumulation processing unit 1031 obtains information on the teaching material and the sound pressure waveform of the learner from the sound pressure calculation processing unit 107. Information on the pitch waveform and the sound pressure waveform is written in the memory 1035. In addition to the sound pressure and pitch band, the data storage processing unit 1031 acquires information such as the frequency characteristics of the vowels and the microphone input level, and writes the information in the memory 1035.

  The waveform display processing unit 103 uses the memory 1035 to generate a waveform image to be displayed on the display unit 104 as described above based on the pitch waveform and sound pressure waveform information acquired by the data storage processing unit 1031. To do. In the waveform display processing unit 103, the pitch extraction waveform drawing position processing unit 1032 performs processing for setting and adjusting the drawing position of the pitch waveform (pitch extraction waveform). The sound pressure waveform drawing position processing unit 1033 performs processing for setting and adjusting the drawing position of the sound pressure waveform. The time axis waveform drawing position processing unit 1034 performs processing for setting and adjusting the drawing position of the pitch waveform and the sound pressure waveform in the time axis direction. By these processing units, the pitch waveform and the sound pressure waveform are deformed in the waveform height direction and the time axis direction.

  In addition, the waveform display processing unit 103 receives a variable speed reproduction setting parameter input to the operation unit 110 by the learner. The variable speed playback setting parameter is a parameter representing the playback speed of the teaching material in the variable speed playback mode. Thereby, a change in the reproduction speed of the learning material is accepted. The variable speed reproduction setting parameter is written in the memory 1035.

  FIG. 5 shows a configuration of the voice extraction calculation processing unit 102. As described above, the voice extraction calculation processing unit 102 acquires the learner voice from the voice input / output unit 101 or the learner voice recording unit 109, and the teaching material voice from the voice teaching material data storage unit 108 and the voice teaching material database 204. To get.

  In the voice extraction calculation processing unit 102, the A / D conversion unit 1021 converts the input voice into digital data. The pitch extraction processing unit 1022 performs analysis processing such as FFT on the audio data to extract pitch waveform information. The pitch is extracted in units of steps. The length of time for one step is preset. The averaging processing unit 1023 performs an averaging process on the pitch waveform to make the pitch waveform smooth. Further, the duration count processing unit 1024 counts the duration of the pitch. Here, the number of steps when the pitch continues is counted.

  The audio data converted by the A / D conversion unit 1021 is also supplied to the sound pressure calculation processing unit 107 and the audio reproduction processing unit 1025. The sound pressure calculation processing unit 107 calculates the sound pressure as described above. The audio reproduction processing unit 1025 performs a process for reproducing audio. The reproduced audio is supplied from the audio reproduction processing unit 1025 to the audio input / output unit 101.

  The audio reproduction processing unit 1025 is supplied with variable speed reproduction setting parameters from the audio extraction calculation processing unit 102. The variable speed reproduction setting parameter is supplied from the operation unit 110 to the waveform display processing unit 103 via the voice extraction calculation processing unit 102. The audio reproduction processing unit 1025 adjusts the reproduction audio speed according to the reproduction speed indicated by the variable speed reproduction setting parameter. As a result, the audio is reproduced at the reproduction speed indicated by the variable speed reproduction parameter.

  The speech extraction calculation processing unit 102 and the waveform display processing unit 103 have been described above. Next, a characteristic configuration regarding the waveform adjustment processing of the present embodiment will be described.

  As described above, the waveform display processing unit 103 generates an image for comparing the learning material and the learner's pitch waveform, and also generates an image for comparing the sound pressure waveforms of both. In the conventional waveform comparison image, the teaching material and the learner's waveform are simply arranged one above the other. However, the conventional waveform comparison image includes individual differences in the pitch and voice volume between the teaching material speaker and the learner, and therefore it is not easy for the learner to compare waveforms. Therefore, in the present embodiment, the waveform is adjusted so as to absorb individual differences as described below. This adjustment function is realized by the pitch extraction waveform drawing position processing unit 1032 and the sound pressure waveform drawing position processing unit 1033 of the waveform display processing unit 103.

(1) Adjustment of pitch waveform In the adjustment of the pitch waveform, a representative pitch of the teaching material voice and a representative pitch of the learner are used. Then, the display position of the pitch waveform is adjusted so as to absorb the difference between the representative pitches of both waveforms. This processing is performed by the pitch extraction waveform drawing position processing unit 1032 of the waveform display processing unit 103. The representative pitch is an average pitch in the present embodiment.

  FIG. 6 shows an example of pitch waveform adjustment processing. The teaching material pitch waveform and the learner pitch waveform before adjustment are shown on the left side of FIG. The learner pitch waveform is a pitch obtained from the recorded voice.

  The pitch extraction waveform drawing position processing unit 1032 calculates a pitch average value of the teaching material pitch waveform and calculates a pitch average value of the learner pitch waveform. The average pitch value may be calculated by another processing function in the previous stage. Then, the waveform image is slid in the pitch height direction (vertical direction in the figure) by the difference in pitch average value. In the example of FIG. 6, the teaching material pitch waveform is slid. Then, as shown on the right side of FIG. 6, the teaching material pitch waveform and the learner pitch waveform are superimposed. The superimposed waveform comparison image is supplied from the waveform display processing unit 103 to the display unit 104 and displayed on the display.

  In the example of the figure, the learner's voice is lower than the speaker of the teaching material. However, in the waveform comparison image, the difference in the pitch of the voice is absorbed, and the teaching material and the learner's waveform are displayed in the same range on the vertical axis (on the frequency), making it easier to compare the two. Yes. Furthermore, the degree of coincidence and the disagreement of the waveform are clarified by superimposing the learning material and the learner's waveform.

  In this embodiment, the teaching material waveform is slid. However, the learner's waveforms may be compared. Moreover, both waveforms may be slid. For example, for each of both waveforms, the waveform position may be adjusted so that the average pitch matches the reference pitch.

  FIG. 7 shows an example of a more preferable display process. In the present embodiment, information indicating the pitch change width of the teaching material waveform is added to the waveform comparison image.

  In FIG. 7, the teaching material pitch waveform is slid and overlapped with the learner pitch waveform as in FIG. Furthermore, a pitch maximum value line and a pitch minimum value line of the teaching material are added on the image. The highest pitch value line is a line that passes the highest pitch value of the teaching material, and the lowest pitch value line is a line that passes the lowest pitch value. Both lines are parallel to the time axis.

  As described above, in the present embodiment, since the highest pitch value and the lowest pitch value are displayed, the learner can make the goal of practice to realize the pitch height difference of the teaching material. In this practice, it is not necessary to pay attention to small differences in the waveform, such as making the outer shape of the waveform the same. For example, in order to make the waveform the same, speaking speed must be aligned with teaching materials. However, if you pay attention to the height difference, you do not have to be so conscious of speed. In this way, since an appropriate target of height difference can be added to the image, improvement in learning motivation and improvement in learning effect can be expected.

  Note that the above-described maximum pitch value and minimum pitch value are automatically calculated by the pitch extraction waveform drawing position processing unit 1032 or another processing function. Then, the highest value line and the lowest value line are automatically displayed.

  The maximum value and the minimum value may be designated by the learner using the operation unit 110. Then, the input maximum value and minimum value may be received, and a line may be added at a position corresponding to the received value. The maximum and minimum values may be set by the teacher using another terminal. Further, the highest value and the next higher value may be displayed in a line. In this way, for example, it is possible to practice specialized in English first accent and second accent.

  In the present embodiment, the horizontal line on the waveform may be configured so that it can be deleted intentionally.

  In the present embodiment, the pitch change width of the teaching material is displayed. On the other hand, a learner's pitch change width may be displayed. Moreover, both pitch change widths may be displayed. Further, the maximum value and the next largest value may be displayed.

  Next, the waveform adjustment when performing real-time display will be described. In the above processing example, the waveform of the recorded voice is mainly adjusted. In the case of real-time display, it is preferable to perform the following processing.

  First, real-time display will be described. In real-time display, when the learner starts speaking and voice input starts, the voice extraction calculation processing unit 102 also starts pitch extraction. The pitch is extracted in units of steps. The length of one step is 10 msec. The pitch of each step is sequentially supplied to the waveform display processing unit 103. In the waveform display processing unit 103, the input pitch is successively added to the pitch waveform image. In this way, the pitch waveform extends on the screen simultaneously with the progress of the learner's voice. Real-time display enhances visual feedback effect. And visual feedback reinforces auditory feedback, which can be expected to improve learning motivation and learning effects.

  In the real-time display, the waveform display processing unit 103 cannot use the pitch average value of the audio data to be displayed. Therefore, the waveform display processing unit 103 reads the learner's pitch average value from the data accumulated in the previous learning. Referring to FIG. 1, the average pitch of the learner is downloaded from the server terminal 20 to the learner terminal 10 as a part of the speech related information and stored in the speech related information storage unit 106. As shown in FIG. 4, the voice related information is stored in the memory 1035.

  Therefore, the display position is adjusted using such a past learning pitch average. That is, the average pitch of the past learning is read, while the average pitch of the teaching material is calculated, and the pitch waveform position is adjusted so as to absorb the difference between these average pitches.

  On the waveform comparison image, for example, the entire teaching material waveform is displayed first. Then, a learner waveform is drawn so as to overlap the teaching material waveform. At this time, a waveform with the adjusted display position is drawn. Since it is a real-time display, the waveform also extends in the time axis direction as the learner progresses. Since the display position is adjusted, the learner's waveform is drawn in the vertical axis direction (pitch height direction) at substantially the same location as the teaching material waveform.

  Next, another preferred waveform adjustment process in real time display will be described. In this adjustment process, the display position is adjusted using the initial pitch of the input learner's voice. The initial pitch becomes the representative pitch and becomes the reference for the waveform slide.

  The initial pitch may be the initial pitch. The initial stage pitch may be, for example, an average value of pitches in a predetermined period. In this case, the drawing of the learner waveform may be delayed until the initial average value is obtained. Even if there is such a delay, if the time is short, a sufficiently satisfactory real-time display is performed.

  Note that the above-described real-time display waveform adjustment may be applied not only to real-time display but also to waveform display using a recorded audio file.

(2) Sound Pressure Waveform Adjustment Next, sound pressure waveform adjustment processing will be described. In the adjustment of the sound pressure waveform, the sound pressure change width of the teaching material voice and the sound pressure change width of the learner's voice are used. Then, the sound pressure waveform is adjusted so as to absorb the difference between the sound pressure change widths of both waveforms. This process is performed by the sound pressure waveform drawing position processing unit 1033 of the waveform display processing unit 103.

  In this embodiment, the sound pressure change width is the width (dynamic range) of the maximum sound pressure and the minimum sound pressure of the sound. The sound pressure waveform drawing position processing unit 1033 calculates the change width of the sound pressure waveform of the teaching material. Then, normalization processing is performed to match the sound pressure change width of the teaching material with the reference change width. At this time, the sound pressure waveform is expanded and contracted in the sound pressure level direction. The sound pressure waveform drawing position processing unit 1033 performs the same normalization process on the learner's sound pressure waveform. Thereby, the sound pressure change width of both waveforms is absorbed.

  FIG. 8 shows an example of sound pressure waveform adjustment processing. In this example, the sound pressure change width of the teaching material waveform is used as a reference width for normalization. Therefore, the teaching material waveform is not deformed. In contrast, the learner's waveform is transformed by normalization. Then, as shown on the right side of FIG. 8, the teaching material and the sound pressure waveform of the learner are superimposed. The superimposed waveform comparison image is supplied from the waveform display processing unit 103 to the display unit 104 and displayed on the display.

  In the example of FIG. 8, since the learner's voice is generally smaller than the teaching material, the learner's sound pressure waveform is extended in the sound pressure level direction (vertical axis direction). As a result, the sound pressure change width is absorbed, and the teaching material and the learner's waveform are displayed in substantially the same range on the vertical axis (in the direction of the sound pressure level), making it easy to compare the two. Furthermore, the degree of coincidence and the disagreement of the waveform are clarified by superimposing the learning material and the learner's waveform.

  In the example of FIG. 8, the learner waveform is deformed. On the other hand, as described above, both the learner waveform and the learning material waveform may be modified, or only the learning material waveform may be modified.

  By the way, with respect to the pitch waveform described above, as shown in FIG. 7, a pitch change width, more specifically, a pitch maximum value and a minimum value are added to the waveform comparison image. The same processing is suitably performed for the sound pressure waveform, that is, the maximum sound pressure value and the minimum sound pressure value are added to the image of FIG. Similarly to FIG. 7, a line may be drawn to the maximum value and the minimum value. The learner can make the goal of learning to realize the sound pressure difference (sound pressure level width) of the teaching material.

  In this regard, it is considered that the sound pressure waveform mainly represents the position of stress. Therefore, the practice of mimicking the difference in sound pressure achieves a large difference (sound pressure level width) between a simple utterance point (corresponding to the minimum sound pressure value) and an utterance point where stress is present (corresponding to the maximum sound pressure value). Equivalent to practice. In this practice, it is not necessary to pay attention to small differences in the waveform, such as making the outer shape of the waveform the same. For example, in order to make the waveform the same, speaking speed must be aligned with teaching materials. However, if you focus on the difference in size, you don't have to be so conscious of speed. In this way, since an appropriate target of magnitude difference can be added to the image, improvement in learning motivation and improvement in learning effect can be expected.

  Note that the maximum sound pressure value and the minimum sound pressure value are automatically calculated by the sound pressure waveform drawing position processing unit 1033 or another processing function. Then, the maximum value line and the minimum value line are automatically displayed.

  Further, the maximum value and the minimum value may be designated by the learner using the operation unit 110. Then, the input maximum value and minimum value may be received, and a line may be added at a position corresponding to the received value. The maximum and minimum values may be set by the teacher using another terminal.

  In the present embodiment, the horizontal line on the waveform may be configured so that it can be deleted intentionally.

  In the present embodiment, the sound pressure change width of the teaching material is displayed. On the other hand, a learner's sound pressure change width may be displayed. Further, the sound pressure change width of both may be displayed.

  Next, real-time display will be described. Similar to the description of the pitch waveform, the sound pressure waveform is also suitably adjusted in real time.

  In the real-time display, the waveform display processing unit 103 reads the learner's sound pressure data from the data accumulated in the previous learning. Referring to FIG. 1, the sound pressure data of the learner is downloaded from the server terminal 20 to the learner terminal 10 as a part of the sound related information and stored in the sound related information storage unit 106. As shown in FIG. 4, the voice related information is stored in the memory 1035. Therefore, the sound pressure waveform drawing position processing unit 1033 acquires the learner's sound pressure change width from the past data. A normalization process as shown in FIG. 8 is performed using the sound pressure change width.

  Therefore, on the waveform comparison image, for example, the entire teaching material waveform is displayed first. Then, a learner waveform is drawn so as to overlap the teaching material waveform. At this time, a normalized waveform is drawn. Since it is a real-time display, the waveform also extends in the time axis direction as the learner progresses. And since the difference of the sound pressure change width is absorbed, the learner's waveform is drawn in the vertical axis direction (sound pressure height direction) at substantially the same location as the teaching material waveform.

  Next, real-time display when past sound pressure data is not used will be described. In this case, the display position is adjusted using the sound pressure data at the initial stage of the input voice of the learner. The sound pressure at the initial stage may be a sound pressure for a predetermined period from the start of speaking. Such a dynamic range of the sound pressure at the initial stage is used for normalization. In this case, the drawing of the learner waveform may be delayed until the initial average value is obtained. Even if there is such a delay, if the time is short, a sufficiently satisfactory real-time display is performed.

  Note that the above-described real-time display waveform adjustment may be applied not only to real-time display but also to waveform display using a recorded audio file.

  The learning support system 1 according to the embodiment of the present invention has been described above. According to the learning support system 1 of the present embodiment, the pitch waveform display position is adjusted so as to absorb the difference between the representative pitch of the teaching material voice and the representative pitch of the learner. Without forcibly adjusting the height to the teaching material, it is possible to provide a comparative image drawn at a position where the teaching material and the learner's pitch waveform can be easily compared. Therefore, it is possible to reduce the influence on the difference between individual speakers and to easily compare the teaching material and the voice waveform of the learner.

  Further, according to the present embodiment, by using the average value as a representative pitch, individual differences between the teaching material and the learner can be effectively absorbed.

  Further, according to the present embodiment, the comparison of both waveforms is facilitated by superimposing the teaching material and the learner's waveforms.

  Further, according to the present embodiment, the display position is adjusted using the representative pitch obtained from the voice of the learner recorded in the past, so that the pitch waveform display position can be adjusted in real time.

  Also, according to the present embodiment, the display position is adjusted using the initial pitch of the input learner's voice, so the pitch waveform display position can be adjusted in real time.

  Further, according to the present embodiment, since information indicating the pitch change width is added to the pitch waveform image, the learner can easily compare the teaching material and the learner's pitch by paying attention to the pitch change width.

  In addition, according to the present embodiment, since the information indicating the highest pitch and the lowest pitch is added to the pitch waveform image, it becomes easier to grasp the pitch.

  Further, according to the present embodiment, the difference between the sound pressure change width of the teaching material voice and the sound pressure change width of the learner's voice is also absorbed with respect to the sound pressure waveform. Without forcibly matching the learning material, it is possible to provide a comparative image drawn in such a way that the sound pressure waveforms of the learning material and the learner can be easily compared. Therefore, it is possible to reduce the influence caused by the difference between individual speakers and to easily compare the teaching material and the voice waveform of the learner.

  Further, according to the present embodiment, since the width of the maximum sound pressure and the minimum sound pressure is used as the sound pressure change width, it is possible to provide a suitable comparative image that absorbs the difference in the dynamic range.

  Further, according to the present embodiment, comparison of both waveforms is facilitated by superimposing the teaching material and the sound pressure waveform of the learner.

  Further, according to the present embodiment, the sound pressure waveform is adjusted using the sound pressure change width obtained from the voice of the learner recorded in the past, so that the sound pressure waveform can be adjusted in real time.

  Further, according to the present embodiment, the sound pressure waveform is adjusted using the sound pressure at the initial stage of the input learner's voice, so that the sound pressure waveform can be adjusted in real time.

  In addition, according to the present embodiment, since information indicating the sound pressure change width is added to the sound pressure waveform image, the learner can easily make the sound pressure of the teaching material and the learner by paying attention to the sound pressure change width. Can be compared.

  In addition, according to the present embodiment, since information indicating the maximum sound pressure and the minimum sound pressure is added to the sound pressure waveform image, the sound pressure can be further easily grasped.

  From another viewpoint, the learning support system 1 according to the present embodiment includes a learning material waveform acquisition unit that acquires learning material waveform information that is a waveform of a speech parameter of the learning material, and a learner waveform that is a waveform of the learner's speech parameter. Learner waveform acquisition means for acquiring information, waveform comparison image generation means for generating a waveform comparison image for comparing the teaching material waveform information and the learner waveform information, and the waveform comparison image generation means, Adjusting means for adjusting the waveform image so as to absorb the difference between the teaching material and the representative value of the voice parameter of the learner. The voice parameter is, for example, the above pitch or sound pressure. Also with this configuration, the advantages of the above-described embodiment can be obtained, that is, the influence due to the difference between individual speakers can be reduced, and the teaching material and the voice waveform of the learner can be easily compared.

  In the above embodiment, the learning support system 1 performs both the adjustment of the pitch waveform and the adjustment of the sound pressure waveform. However, some of these processes may be performed within the scope of the present invention.

  Moreover, in said embodiment, the learning assistance system 1 was comprised by the learner terminal 10 and the server terminal 20 which were connected by the network. However, the present invention is not limited to this. For example, the learning support system may be configured by a single computer.

  In the present embodiment, the case where the audio teaching material data storage unit 108 and the audio teaching material database 204 are audio teaching materials has been described. Since this moving picture teaching material also includes sound, it is a sound teaching material, and the voice extracted from the moving picture teaching material (such as MPEG) is also a voice teaching material, and the voice extraction calculation processing unit 102 may perform the voice extraction.

  In addition, this invention is not limited to the above-mentioned embodiment, Of course, those skilled in the art can modify the above-mentioned embodiment within the scope of the present invention.

  As described above, the learning support system according to the present invention can reduce the influence caused by the difference between individual speakers, and can easily compare the waveform of the teaching material and the voice of the learner. It is useful as a learning support system.

The block diagram of the learning assistance system in embodiment of this invention Flow chart when starting the learning support system Flow chart at the end of the learning support system Waveform display processing block diagram Block diagram of voice extraction calculation processing unit The figure which shows the adjustment process of a pitch waveform comparison image The figure which shows the adjustment process of a pitch waveform comparison image The figure which shows the adjustment processing of the sound pressure waveform comparison image

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Learner terminal 20 Server terminal 101 Voice input / output part 102 Voice extraction calculation process part 103 Waveform display process part 104 Display part 105 Authentication process part 106 Voice related information storage part 107 Sound pressure calculation process part 108 Voice teaching material database 109 Learner voice Recording unit 110 operation unit

Claims (21)

Teaching material pitch acquisition means for acquiring teaching material pitch waveform information that is a pitch waveform of audio of the teaching material;
Learner pitch acquisition means for acquiring learner pitch waveform information which is a pitch waveform of a learner's voice;
Pitch waveform comparison image generating means for generating a pitch waveform comparison image for comparing the teaching material pitch waveform information and the learner pitch waveform information;
A display position adjusting means provided in the pitch waveform comparison image generating means, for adjusting a pitch waveform display position so as to absorb a difference between a representative pitch of the learning material voice and a representative pitch of the learner;
A learning support system characterized by comprising   The learning support system according to claim 1, wherein the display position adjusting unit uses an average pitch value as the representative pitch.   The learning support system according to claim 1, wherein the pitch waveform comparison image generation unit superimposes the teaching material pitch waveform information and the learner pitch waveform information. The pitch waveform comparison image generating means generates a pitch waveform image in real time from a learner's input voice,
The learning support system according to claim 1, wherein the display position adjusting unit adjusts the display position by using a representative pitch obtained from a learner's voice recorded in the past. The pitch waveform comparison image generating means generates a pitch waveform image in real time from a learner's input voice,
The learning support system according to claim 1, wherein the display position adjusting unit adjusts the display position by using an initial pitch of the input voice of the learner.   Provided in the pitch waveform comparison image generating means, provided with a change width adding means for adding information indicating a pitch change width to the pitch waveform comparison image with respect to at least one of the teaching material pitch waveform information and the learner pitch waveform information. The learning support system according to claim 1, wherein: Teaching material pitch acquisition means for acquiring teaching material pitch waveform information that is a pitch waveform of audio of the teaching material;
Learner pitch acquisition means for acquiring learner pitch waveform information which is a pitch waveform of a learner's voice;
A pitch comparison image generating means for generating a pitch waveform comparison image for comparing the teaching material pitch waveform information and the learner pitch waveform information;
A change width adding means provided in the pitch comparison image generating means for adding information indicating a pitch change width to the pitch waveform comparison image with respect to at least one of the teaching material pitch waveform information and the learner pitch waveform information;
A learning support system characterized by comprising   The learning support system according to claim 7, wherein the change width adding unit adds information indicating the highest pitch and the lowest pitch to the pitch waveform comparison image. Teaching material sound pressure acquisition means for acquiring teaching material sound pressure waveform information which is a sound pressure waveform of the sound of the teaching material;
Learner sound pressure acquisition means for acquiring learner sound pressure waveform information which is a sound pressure waveform of a learner's voice;
A sound pressure waveform comparison image generating means for generating a sound pressure waveform comparison image for comparing the learning material sound pressure waveform information and the learner sound pressure waveform information;
Waveform adjusting means provided in the sound pressure waveform comparison image generating means for adjusting the sound pressure waveform so as to absorb a difference between the sound pressure change width of the sound of the teaching material and the sound pressure change width of the learner's voice; ,
A learning support system characterized by comprising   The learning support system according to claim 9, wherein the waveform adjusting unit uses a maximum sound pressure range and a minimum sound pressure range as a sound pressure change range.   The learning support system according to claim 9, wherein the sound pressure waveform comparison image generation unit superimposes the teaching material sound pressure waveform information and the learner sound pressure waveform information. The sound pressure waveform comparison image generating means generates a sound pressure waveform image in real time from the input voice of the learner,
The learning support system according to claim 9, wherein the waveform adjusting unit adjusts a sound pressure waveform using a sound pressure change width obtained from a voice of a learner recorded in the past. The sound pressure waveform comparison image generating means generates a sound pressure waveform image in real time from the input voice of the learner,
The learning support system according to claim 9, wherein the display position adjusting unit adjusts the display position by using an initial sound pressure of the input voice of the learner.   Change width adding means provided in the sound pressure waveform comparison image generating means for adding information representing a sound pressure change width to the sound pressure waveform comparison image with respect to at least one of the teaching material sound pressure waveform information and the learner sound pressure waveform information. The learning support system according to claim 9, further comprising: Teaching material sound pressure acquisition means for acquiring teaching material sound pressure waveform information which is a sound pressure waveform of the sound of the teaching material;
Learner sound pressure acquisition means for acquiring learner sound pressure waveform information which is a sound pressure waveform of a learner's voice;
A sound pressure waveform comparison image generating means for generating a sound pressure waveform comparison image for comparing the learning material sound pressure waveform information and the learner sound pressure waveform information;
Change width adding means provided in the sound pressure waveform comparison image generating means for adding information representing a sound pressure change width to the sound pressure waveform comparison image with respect to at least one of the teaching material sound pressure waveform information and the learner sound pressure waveform information. When,
A learning support system characterized by comprising   16. The learning support system according to claim 15, wherein the change width adding unit adds information indicating a maximum sound pressure and a minimum sound pressure of a sound to a sound pressure waveform comparison image. Teaching material waveform acquisition means for acquiring teaching material waveform information which is a waveform of a speech parameter of the teaching material;
Learner waveform acquisition means for acquiring learner waveform information which is a waveform of a learner's voice parameter;
A waveform comparison image generating means for generating a waveform comparison image for comparing the teaching material waveform information and the learner waveform information;
An adjustment means provided in the waveform comparison image generation means, for adjusting a waveform image so as to absorb a difference between representative values of the teaching material and the learner's voice parameter;
A learning support system characterized by comprising Obtaining teaching material pitch waveform information which is a pitch waveform of the teaching material voice;
Acquiring learner pitch waveform information which is a pitch waveform of a learner's voice;
Generating a pitch waveform comparison image for comparing the teaching material pitch waveform information and the learner pitch waveform information;
Adjusting the pitch waveform display position so as to absorb the difference between the representative pitch of the learning material voice and the representative pitch of the learner when generating the pitch waveform comparison image;
A voice information processing method for learning support, characterized by comprising: Obtaining teaching material sound pressure waveform information that is a sound pressure waveform of the sound of the teaching material;
Obtaining learner sound pressure waveform information that is a sound pressure waveform of a learner's voice;
Generating a sound pressure waveform comparison image for comparing the learning material sound pressure waveform information and the learner sound pressure waveform information;
Adjusting the sound pressure waveform so as to absorb the difference between the sound pressure change width of the sound of the teaching material and the sound pressure change width of the learner's voice when generating the sound pressure waveform comparison image;
A voice information processing method for learning support, characterized by comprising: Obtaining teaching material pitch waveform information which is a pitch waveform of the teaching material voice;
Acquiring learner pitch waveform information which is a pitch waveform of a learner's voice;
Generating a pitch waveform comparison image for comparing the teaching material pitch waveform information and the learner pitch waveform information;
Adjusting the pitch waveform display position so as to absorb a difference between a representative pitch of the voice of the teaching material and a representative pitch of the learner when generating the pitch waveform comparison image;
A speech information processing program for learning support, characterized in that a computer is executed. Obtaining teaching material sound pressure waveform information that is a sound pressure waveform of the sound of the teaching material;
Obtaining learner sound pressure waveform information that is a sound pressure waveform of a learner's voice;
Generating a sound pressure waveform comparison image for comparing the learning material sound pressure waveform information and the learner sound pressure waveform information;
Adjusting the sound pressure waveform so as to absorb the difference between the sound pressure change width of the sound of the teaching material and the sound pressure change width of the learner's voice when generating the sound pressure waveform comparison image;
A speech information processing program for learning support, characterized in that a computer is executed.

Images