JPWO2007129392A1 - Aphasic practice support device with main and sub-machines - Google Patents

Abstract

A therapy that spontaneously plays a desired song and restores brain function by singing is not an effective treatment for aphasia. The aphasia practice support device having the main machine and the sub machine according to the present invention can transfer data between the main machine and the sub machine, creates practice menu data suitable for the practitioner, and responds to the picture data of the language card data for each practitioner. The practice voice data is recorded, whether or not the pronunciation is correct is judged, and the practice result is saved to support the language recovery practice.

Description

  The present invention relates to a practice support device composed of a main machine and a secondary machine that supports recovery of aphasia, and in particular, transfers a language recovery practice menu created on the main machine to the secondary machine, and displays a practice menu picture card on the secondary machine. The present invention relates to an apparatus capable of displaying and recording a practitioner's voice corresponding to the picture card, determining whether or not the pronunciation is correct, and storing the determination result in a storage unit of a main unit.

2. Description of the Related Art Conventionally, there are devices that treat brain dysfunction using music therapy, and there are devices that sing songs by generating musical sounds of songs and voices.
In Japanese Patent Application Laid-Open No. 09-047510, the display of the lyrics shown on the display unit using a hand, a part of another body, a mouse, or the like on the display unit displaying the music known to the care recipient. A music therapy device is disclosed in which the switch means activated by pressing the vicinity of the button to sequentially indicate the melody corresponding to the lyrics. This makes it possible to recover the function by allowing the medical care recipient to sound the melody corresponding to the lyrics just by instructing the lyrics that the user is familiar with in the past, voluntarily playing and singing the desired music. It has been shown.

The above-mentioned method is a therapy that spontaneously plays a desired song and restores brain function by singing, so that the part involved in the language function of the cerebrum is impaired, and understanding of the language or It is hard to say that it is effective treatment for aphasia with a loss of the ability to speak. Aphasia is improved little by little by repetitive long-term training for the deficient function. Therefore, it is necessary for the language hearing person to create a program tailored to the symptom and the environment and perform language training. However, because there are few hospitals (or rehabilitation centers) that provide language auditors and language training, hospitals that go to language training are far away, or language training for a long time, many people who have not received language training There is a problem that there is a person at home.
Moreover, language training at hospitals is short, and most of them are practiced at home to make up for the lack of language training. One practice to make up for the lack of language training is to replay and listen to words recorded on a magnetic card and repeat the pronunciation practice, but it is difficult to correct the pronunciation. Therefore, even in an environment where there is no language hearing person, there is a problem of providing a practice support device capable of performing language training similar to the environment where there is a language hearing person.
Furthermore, since the results of the practice at home are difficult for the language hearing person to understand, there is a problem of providing a practice support device that can confirm the practice results later.
Furthermore, in order to make up for the lack of language training, there is a problem of providing a portable practice support device that can be practiced casually outside a hospital or home.
Furthermore, since there are many different types and degrees of aphasia, there is a problem of providing a practice support device that can adjust the amount of language training practice and the difficulty of practice according to the symptoms and degree of the practitioner.
Furthermore, in order to create a practice menu according to the training plan for language training, there is a problem of providing a practice support device that can newly create a language training material using photographs, sounds, or sounds.
The present invention has been made in view of the above-mentioned problems, and is a language for each trainer corresponding to each trainer from a language card database that manages language card data including at least picture data, correct voice data, and word data. Practice data is created by extracting card data to create practice menu data and managing the practice menu data and practice result data in practice menus and practice result databases. A practice menu data transfer means for extracting the corresponding practice menu data and transferring it to a storage medium; extracting the desired practice menu data from the practice menu and the practice result database; Practice screen display means for displaying the picture data; Recording means for recording practice voice data based on language card data for each practitioner, and judgment result display means for comparing the practice voice data with the correct voice data to make a pass / fail judgment and displaying the judgment result The practice results are stored in the practice menu and the practice result database as practice result data including the judgment results and practice progress information from when the language card data for each practice person is displayed until the judgment of the pass / fail is made. A main machine comprising means, a sub-machine practice screen display means for accessing the storage medium storing the practice menu data and displaying at least the picture data of the language card data for each practice person, and for each practice person Sub-unit recording means for recording practice voice data based on language card data, and comparing the practice voice data with the correct voice data The practice menu data created by the main machine by the practice menu data transfer means is stored in the storage medium. The sub-machine practice screen display means accesses the storage medium to display the picture data of the language card data for each trainer, and the sub-recorder records the practice voice data, This is solved by displaying the result of the pass / fail determination by the determination result display means.
Further, the present invention is characterized in that the data regarding the practitioner input by the practitioner information creating means is stored in a practitioner information database managed for each practitioner.
Furthermore, the present invention is characterized in that language card data is newly created by using the picture data or picture data in the picture information database by the language card creating means, and additionally stored in the language card database.
Further, in the present invention, the practice menu creating means creates the practice menu data for the main machine and the auxiliary machine, and the practice menu data transfer means transfers the auxiliary machine data to the storage medium. Features.
Furthermore, in the present invention, the practice result storage means transfers the practice result data of the sub-device stored in the storage medium to the practice menu and the practice result database.
Further, in the present invention, the practice screen display means or the secondary device practice screen display means displays the picture data of the language card data for each trainer, starts recording the practice progress information, and stores the picture data in the picture data. The practice voice is input, and the recording means or the sub-recording means is made to record the practice voice and display the practice voice input level meter.
Further, in the present invention, while the picture data of the language card data for each practicer is displayed by the practice screen display means or the secondary machine practice screen display means, the correct voice data is changed by changing the speech speed. Is output.
Further, in the present invention, the voice data at the beginning of the word data is output while the picture data of the language card data for each trainer is displayed by the practice screen display means or the sub-machine practice screen display means. It is characterized by doing.
Furthermore, in the present invention, the word data is displayed while the picture data of the language card data for each practicer is displayed by the practice screen display means or the sub-equipment practice screen display means. To do.
Furthermore, in the present invention, the practice menu creation means sets the basis for pass / fail judgment of the judgment result display means or the sub-machine judgment result display means according to each practitioner.
Furthermore, in the present invention, the language card database is stored in units of words corresponding to the picture data.
Furthermore, the present invention is characterized in that the practice menu database manages the practice menu data by classifying each practice person.
Further, according to the present invention, the determination result and practice progress information from when the language card data for each trainer is displayed until the determination of pass / fail is made as practice result data, and stored in the former storage medium. Machine practice result storage means, the practice result data is stored in the storage medium by the auxiliary machine practice result storage means, and the practice menu and practice results are stored in the storage medium by the practice result storage means. It is stored in a database.
Further, in the present invention, the practice voice data of the sub-recorder recording means is stored in the storage medium, the pass / fail of the practice voice data of the storage medium is judged by the judgment result display means, The practice menu and the practice result database are stored.
In order to solve the above problems, an aphasia practice support device having a main machine and a sub machine according to the present invention creates practice menu data according to a practitioner with practice menu creation means, and practice menu for the main machine with practice screen display means. The data is extracted, the language card data for each trainer is displayed, and the practice voice data based on the language card data for each trainer is recorded by the recording means. Then, the judgment result display means judges the pass / fail of the practice voice data and displays the judgment result, and the practice result storage means saves the practice result data in the practice menu and the practice result database. Even so, it is possible to support practice similar to language training by a language auditor.
Also, the practice menu data for the secondary device extracted by the practice menu data transfer means is transferred to the storage medium. Then, the language card data for each practicer of the practice menu data of the storage medium is displayed by the secondary machine practice screen display means, and the practice voice data is recorded by the secondary machine recording means. By displaying the result of pass / fail determination by the sub machine determination result display means, the sub machine can practice at a place different from the main machine.
This makes it possible to create practice menu data that adjusts the amount of practice, difficulty of practice content, or basics of pass / fail judgment according to the type and degree of aphasia, and results of pass / fail judgment and recorded practice voice You can check the data and correct your pronunciation correctly, or you can check the results of your practice at home. In addition, since each database is shared between the main machine and the sub machine, it can be managed centrally.
In addition, the language card creation means creates new language card data suitable for the practitioner's symptoms and degree, and additionally stores it in the language card database managed in units of words. The data in can be sorted. This makes it possible to easily extract language card data suitable for the practitioner and create a practice menu.
Furthermore, while displaying the picture data of the language card data for each trainer on the practice screen display means, the correct speech data is output at different speech speeds, the speech data at the beginning of the word data is output, or By displaying word data, it is possible to give a practitioner a hint of a picture card. Thereby, when the word of picture data is not known, the hint according to a situation is acquired and it can practice until it can recognize a word naturally.
Furthermore, since the practice menu and the practice result database are divided for each practitioner and manage the practice menu data and the practice result data, data related to language recovery practice can be aggregated for each practitioner. As a result, the data can be used to grasp the recovery status of aphasia and to create a future practice plan.
Further, the secondary device practice result saving means saves the practice voice data of the secondary device recording means and the practice progress information to the storage medium, whereby the practice result data on the storage medium is stored in the practice menu and the practice result by the practice result saving means. Can be stored in a database. Thereby, the practice result of the secondary machine can be easily reflected in the practice menu and the practice result database.
Further, by saving the practice voice data of the sub-recording means to the storage medium, the judgment result display means can make a pass / fail judgment of the practice voice data of the storage medium. Thereby, practice result data can be acquired using the criteria of the pass / fail judgment of the main machine.

  FIG. 1 (A) is an example of a block diagram of a process for performing language recovery practice of a main machine and a sub machine in an embodiment of the present invention, and FIG. 1 (B) is an embodiment of the present invention. FIG. 2A is a block diagram for explaining another example of the process of taking language recovery practice for the main machine and the sub machine in FIG. 2, and FIG. 2 (A) shows the process of registering the trainer information according to the embodiment of the present invention. FIG. 2 (B) is a block diagram of a process for registering language card data in one embodiment of the present invention, and FIG. 3 (A) is one embodiment of the present invention. FIG. 3B is an example of a diagram illustrating the flow of data between the main unit and the sub unit in FIG. 3, and FIG. 3B is a diagram illustrating the data flow between the main unit and the sub unit in one embodiment of the present invention. FIG. 4 shows an example of a practice menu creation screen of the main machine in one embodiment of the present invention. FIG. 5 is a diagram showing an example of a practice screen of the main machine in one embodiment of the present invention, and FIG. 6 (A) is a sub-screen in one embodiment of the present invention. FIG. 6 (B) is a diagram showing an example of a pass display in the result display area of the sub-device according to the embodiment of the present invention. (C) is a diagram showing an example of a failure display in the result display area of the sub machine in one embodiment of the present invention, FIG. 7 is a language recovery practice of the main machine in one embodiment of the present invention FIG. 8 (A) is a process flow chart for registering the practitioner information in one embodiment of the present invention, and FIG. 8 (B) is one embodiment of the present invention. FIG. 9 is a processing flowchart of registration of language card data in FIG. FIG. 10 is an example of a daily management table in which practice result data in one embodiment of the present invention is displayed in units of one day, and FIG. FIG. 11B is an example of a monthly management table in which practice result data in one embodiment of the present invention is displayed on a monthly basis, and FIG. 11B is a graph showing the monthly management table in one embodiment of the present invention. This is an example.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
First, FIG. 1 (A) is an example of a block diagram of processing for performing language recovery practice of the main machine and the sub machine in one embodiment of the present invention, and FIG. It is a block diagram explaining the example of.
As shown in FIG. 1 (A), the language recovery practice in the aphasia practice support apparatus having the main machine and the secondary machine is performed by the language card database 1, practice menu and practice result database 2, practice menu creation means 10, practice. Main machine 100 comprising menu data transfer means 11, practice screen display means 12, recording means 13, determination result display means 14, practice result storage means 15, sub machine practice screen display means 20, sub machine recording means 21, The sub-machine 200 includes a sub-machine determination result display unit 22 and a sub-machine practice result storage unit 23, and the storage medium 5.
The main machine 100 refers to a computer device used for language recovery practice installed in a language hearing person or a hospital (or rehabilitation center) that conducts language training.
Specifically, it is a dedicated device equipped with means described later, or a personal computer (hereinafter abbreviated as a personal computer) installed with an application having means described later.
The dedicated device or the personal computer includes at least a first input unit, a second input unit, a display unit, a storage unit, a calculation unit, and an output unit. The first input unit is a keyboard, a tablet, a mouse, a finger, a dedicated pen, or the like. The second input unit is a device that converts sound into an electrical signal, and is specifically a microphone. The display unit is a display or a touch panel. The storage unit is a device that stores data and programs in the computer. The arithmetic unit is a central unit that controls each device and each means, and calculates and processes data in a computer. The calculation unit is also a device that executes a program in the storage unit, receives data from the first input unit or storage unit, performs calculation or processing, and outputs the result to the output unit or display unit. The output unit is a device that converts an electrical signal into sound, and specifically, a speaker.
The secondary device 200 refers to a computer device used for portable language recovery practice.
Specifically, it is Personal Digital Assistants (hereinafter abbreviated as PDA) equipped with the means described below. As with the main machine, the PDA includes at least a first input unit (in this case, a finger or a dedicated pen), a second input unit, a display unit (in this case, a touch panel), a storage unit, a calculation unit, and an output unit. And have. The specific control is the same as that of the main engine, and is omitted here.
The language card database 1 is a database that manages language card data used in language recovery practice in units of words. The language card data is obtained by adding sound information and document information to a language card consisting of a picture drawn according to a word or an attached photo and converting it into electronic data.
Specifically, the language card database 1 is a set of language card data numbers, picture data, acceptance reference point data, correct voice data, word data, applied sentence data, category data, and the like. included. The acceptance reference point data is a score that becomes a criterion for acceptance in the pass / fail determination of the determination result display means 14 to be described later, and is accepted if it is below this reference point (or above the reference point). Specifically, speech auditors (for people with disabilities such as words and sounds, and those around them, including doctors, nurses, physical therapists, occupational therapists, educators, and healthcare professionals. A person who provides specialized assistance such as consultation, evaluation, training, and guidance while collaborating) determines the voice of the practitioner in advance, and determines the score that is the basis of the pass based on the correlation of the results . The word data is a word written in hiragana, katakana or kanji according to the picture data. The application sentence data consists of an explanatory sentence of a word corresponding to picture data or an example sentence using the word. An existing illustration or the like may be read by a scanner and converted into electronic data, which may be used as picture data.
The practice menu and practice result database 2 is a database that manages practice menu data created according to the practitioner and practice result data according to the practice menu data. The practice menu data is a set of language card data for each practicer extracted according to the symptom and degree of the practicer. The practice result data is a set of practice voices according to the language card data for each practice person, pronunciation pass / fail judgment results, practice progress information, and the like. Specifically, the practice menu data is a set of practice menu data numbers, the name of the practitioner, the creation date of the practice menu, the language card data for each selected practice person, and the like. The practice result data is a set of practice menu data numbers, practice dates and times, practice audio data, determination results, practice progress information, and the like.
The storage medium 5 is a recording medium for storing practice menu data transferred from the main unit 100 to the sub unit 200, or practice result data and practice audio data transferred from the sub unit 200 to the main unit 100, and is portable. It is a big size. Specifically, a floppy disk, a CD-ROM (Compact Disc Read Only Memory), a memory card, or the like is used as the recording medium.
The practice menu creating means 10 extracts language card data for each trainer according to each trainer from the language card database 1 to create practice menu data, and the created practice menu data is stored in the practice menu and practice result database 2. It is a means to preserve. Specifically, the practice menu data is created separately for the main machine and the sub machine, and a flag for distinguishing them is set.
Further, it is also a means for setting a criterion for pass / fail judgment in a judgment result display means 14 or a sub-machine judgment result display means 22 described later. The criterion for pass / fail judgment is a value that sets a range in which each phoneme of the practice voice data and the correct voice data is judged to be different. Specifically, when the pass / fail judgment criterion is set to 20%, if the degree of difference between the phonemes of the practice voice data and the correct voice data is 20% or more, they are determined to be different phonemes. On the other hand, if the degree of difference of each phoneme is less than 20%, both are determined to be the same phoneme. Here, although the degree of difference is described, the pass / fail determination may be performed using the degree of similarity between the phonemes of the practice voice data and the correct voice data. In addition, the criterion for pass / fail determination is set for each practitioner or for each language card data for each practitioner. However, when the criterion for pass / fail determination is not set, a default value may be automatically set.
The practice menu data transfer means 11 is means for extracting practice menu data for the sub-machine corresponding to the practice content from the practice menu and practice result database 2 and transferring it to the storage medium 5. As a data transfer method, there are a method using wireless or a method using an interface. Specifically, main unit 100 and storage medium 5 (in this case, a memory card) are connected to a memory card reader via an interface (in this case, USB), and the submenu extracted by practice menu data transfer means 11 is connected. Transfer the training menu data for the machine to the memory card and save it.
The practice screen display means 12 extracts practice menu data for a desired main machine from the practice menu and practice result database 2, and the pictorial data of language card data for each trainer included in the practice menu data is displayed on the practice screen. And start recording practice progress information. Then, after receiving a voice input instruction, it is means for starting to input practice voice data based on picture data through a microphone. Specifically, the display of the display unit is a touch panel, and the practitioner touches a desired location on the display with an input unit such as a finger or a dedicated pen to give an instruction. Note that the display of the display unit does not have to be a touch panel. In that case, an input unit such as a keyboard, a tablet, or a mouse may be used.
The recording means 13 is means for recording practice voice data input by the practice screen display means 12 and displaying a level meter of the input voice corresponding to the practice voice data on the practice screen. The recorded practice voice data is saved as practice result data in the practice menu and practice result database 2 by the practice result saving means 15 described later.
The practice voice data recorded by the recording means 13 is output through a speaker when an instruction to reproduce the practice voice data is given. The instruction to reproduce the practice voice data will be described in detail with reference to FIG.
The determination result display means 14 compares the practice voice data recorded by the recording means 13 with the correct voice data included in the language card data, and determines whether the practice voice data is the same as the correct voice data. If it is determined to be the same, a pass is displayed on the practice screen, and if it is determined that it is not, a failure is displayed on the practice screen so that the word is correct and the pronunciation is correct for the practitioner. It is a means to let you know what has been done.
Specifically, the frequency spectrum and level of the practice voice data and correct voice data in the language card data for each trainer (in this case, “Ushi”) are expressed as feature vectors, and each phoneme unit. Compare feature vectors. If the degree of difference between the two is less than the reference value for pass / fail judgment (in this case, 20%), it is determined that the phonemes are the same, and the degree of difference is converted into a numerical value (in this case, the degree of difference of “U”). Is 5, and the difference degree of “shi” is 10.) If the total difference degree of each phoneme (in this case, 5 + 10 = 15) is lower than the score of the acceptance reference point data (in this case, 20) included in the language card data, the score is high. In this case, it is determined as rejected (in this case, 15 <20, so it passes). If it passes, “Good” is displayed on the practice screen, and if it fails, “Let's do a little more” is displayed on the practice screen. Also, convert how many times you have passed into a score (in this case, 3 points if you pass the first time, 2 points if you pass the second time, 1 point if you pass more than the first time), practice menu and practice The result database 2 may be stored as part of the practice result data.
The practice result saving means 15 is means for saving the practice voice data recorded by the recording means 13 and the practice result data of the determination result display means 14 in the practice menu and practice result database 2 as practice result data. Since the practice result data has already been described, it is omitted here.
The secondary device practice screen display means 20 accesses the storage medium 5 in which the practice menu data for the secondary device is stored, and the pictorial data of the language card data for each trainer included in the practice menu data is practiced by the secondary device 200. Display on the screen and start recording practice progress information. Then, after receiving a voice input instruction, it is means for starting to input practice voice data based on picture data through a microphone. Specifically, the display of the display unit is a touch panel, and the practitioner touches a desired location on the display with an input unit such as a finger or a dedicated pen to give an instruction. If the storage medium 5 is not connected, an error may be displayed on the screen.
The secondary machine recording means 21 is a means for recording practice voice data input on the secondary machine practice screen display means 20 and displaying an input voice level meter corresponding to the practice voice data on the practice screen. The recorded practice voice data is saved as practice result data in the storage medium 5 by the sub-machine practice result saving means 23 described later.
Note that the practice voice data recorded by the sub-recording means 21 is output through a speaker when an instruction to reproduce the practice voice data is given. The instruction to reproduce the practice voice data will be described in detail with reference to FIG.
The secondary machine determination result display means 22 compares the practice voice data recorded by the secondary machine recording means 21 with the correct voice data included in the language card data for each practitioner and determines whether the voice data is the same as the correct voice data. To do. If it is determined to be the same, a pass is displayed on the practice screen, and if it is determined that it is not, a failure is displayed on the practice screen so that the word is correct and the pronunciation is correct for the practitioner. It is a means to let you know what has been done. In addition, since it is specifically the same as the determination result display means 14, description is abbreviate | omitted here.
The auxiliary equipment practice result storage means 23 is means for saving the practice voice data recorded by the auxiliary equipment recording means 21 or the practice result data of the auxiliary equipment determination result display means 22 as practice result data in the storage medium 5. . Since the practice result data has already been described, it is omitted here.
FIG. 1 (B) shows another embodiment of language recovery practice, and only the parts different from FIG. 1 (A) will be described.
In addition to recording practice voice data and displaying a level meter of input voice on the practice screen, the secondary machine recording means 21 is a data format in which the recorded practice voice data is processed by the determination result display means 14 (specifically, , WAVE file). The converted practice voice data is saved in the storage medium 5 by the sub-machine practice result saving means 23.
Then, the determination result display means 14 makes a pass / fail determination using the converted practice voice data in the storage medium 5. Thereafter, the practice result storage means 15 performs a process of saving the practice result data in the practice menu and the practice result database 2.
As described above, the practice voice data of the sub machine recording means 21 is stored in the storage medium 5 and the pass / fail judgment is made by the judgment result display means 14, so that even if the practice voice data of the sub machine 200 is used, You may enable it to evaluate using the criterion of determination.
Next, FIG. 2 (A) is a block diagram of processing for registering practitioner information, and FIG. 2 (B) is a block diagram of processing for registering language card data.
As shown in FIG. 2A, the process for registering the practitioner information is composed of the practitioner information database 3 and the practitioner information creating means 16.
The practitioner information database 3 is a database that manages information on practitioners who practice language recovery. Specifically, it is a set of data such as the name of the practitioner, the date of hospitalization, the name of the disease, and the date of starting practice.
The trainer information creating means 16 is means for registering the trainer information for performing the language recovery practice that has been input in the trainer information database 3.
As shown in FIG. 2 (B), the process of registering a language card comprises a language card database 1, a picture information database 4, and a language card creation means 17. Since the language card database 1 has already been described, a description thereof is omitted here.
The picture information database 4 is a database in which picture data or photo data is managed. More specifically, a digital photograph of a photograph taken with a digital camera or a picture read with a scanner is stored.
The language card creation means 17 is a means for newly creating language card data using the picture data or picture data in the picture information database 4 and additionally storing it in the language card database 1. Specifically, picture data or photo data suitable for the practitioner's symptoms and degree is extracted from the picture information database 4, and correct voice data, word data, applied sentence data, category data, etc. are registered in accordance with the extracted data. Create card data.
Next, FIG. 3 (A) is an example of a diagram for explaining the flow of data between the main unit and the sub unit in one embodiment of the present invention, and FIG. 3 (B) shows the flow of data. It is another example of the figure to do. 3 (A) corresponds to FIG. 1 (A), and FIG. 3 (B) corresponds to FIG. 1 (B).
As shown in FIG. 3 (A), first, the practice menu data transfer means 11 extracts practice menu data 30 for a desired sub-machine from the practice menu and practice result database 2 (see arrow (1) in the figure). . The practice menu data transfer means 11 transfers the practice menu data 30 to the storage medium 5 via an interface or wirelessly and stores it (see the arrow (2) in the figure).
Next, language recovery practice processing is executed by the sub-machine 200. Specifically, the secondary device practice screen display means 20 accesses the storage medium 5 to read the practice menu data 30 (see the arrow (3) in the figure), and the pictorial data of the language card data for each trainer is stored in the secondary device. Display on the practice screen. The sub-recorder 21 records practice voice data and displays the input level meter. Then, the sub machine determination result display means 22 determines whether or not the practice voice data is acceptable, and displays the result on the practice screen. Then, the practice result data 31 is saved in the storage medium 5 by the auxiliary machine practice result saving means 23 (see the arrow (4) in the figure).
Finally, practice result data 31 is extracted from the storage medium 5 by the practice result storage means 15 via the interface or wirelessly (see the arrow (5) in the figure). Then, the practice result data 31 is saved in the practice menu of the main machine and the practice result database 2 by the practice result saving means 15 (see arrow (6) in the figure).
FIG. 3 (B) is a diagram for explaining the flow of data in another embodiment of the language recovery practice, and explains a different part (after the arrow in (3) in the figure) from FIG. 3 (A). .
The auxiliary machine 200 executes language recovery practice processing. Specifically, picture data is displayed on the practice screen by the secondary machine practice screen display means 20. The sub recording unit 21 records practice voice data, displays an input level meter, and converts the data format of practice voice data. Then, the secondary machine determination result display means 22 displays the result of the pass / fail judgment, and the secondary machine practice result storage means 23 stores the converted practice voice data 32 in the storage medium 5 (see arrow (4) in the figure). ).
Then, the judgment result display means 14 extracts the converted practice voice data 32 from the storage medium 5 via the interface or wirelessly (see the arrow (5) in the figure), and performs pass / fail judgment. Then, the practice result data 31 is transferred to the practice result storage means 15 (see the arrow (6) in the figure), and the practice result data 31 is saved in the practice menu and the practice result database 2 by the practice result storage means 15 (in the figure). (See arrow in (7)).
Next, FIG. 4 is a diagram showing an example of a practice menu creation screen of the main machine in one embodiment of the present invention.
As shown in FIG. 4, the practice menu creation screen 110 of the main machine is composed of a language card list display area 111, a language card selection area 112, and a practice menu display area 113.
The language card list display area 111 is an area for displaying a list of data in the language card database 1 according to a display method. The display method includes a full list, an alphabetical order, a category order, or a basic order, and these are selected from a pull-down menu. The all list is a method of displaying all the managed data without rearranging. The 50-sound order is a method of displaying a list by rearranging the heads of word data in the order of 50 sounds. By category, word data is sorted and displayed in a list by category (specifically, animal category, plant category, food category, etc.). The basic order is a method in which word data is displayed in a list by rearranging the word data from the most difficult to the most difficult. Here, the case where the display method is in the order of 50 sounds is shown.
The language card selection area 112 is an area where the language card data for each trainer selected from the language card database 1 is moved to the practice menu, and the language card data for each trainer selected from the practice menu is returned to the language card database 1. is there. The pictorial data of the selected language card data for each trainer is displayed in a square frame in the figure.
The practice menu display area 113 is an area for displaying the contents of the created practice menu data. Specifically, the name of the practitioner, the creation date of the practice menu, the language card number of the language card data for each practitioner, and the like are displayed.
Next, FIG. 5 is a diagram showing an example of a practice screen of the main machine in one embodiment of the present invention. Here, an example will be described in which a practice screen is displayed on the display unit of the touch panel, and the practitioner selects “cow” from a plurality of language card data for each practicer.
As shown in FIG. 5, the practice screen 120 of the main machine includes an input and confirmation area 121, a hint acquisition area 122, a language card data selection area 123, a picture data display area 124, an end button, and an ST determination button.
The input and confirmation area 121 instructs the practice screen display means 12 to input practice voice data, instructs the recording means 13 to display the input level meter of the practice voice data, and is recorded by the recording means 13. This is an area for instructing playback of practice voice data. Specifically, it has a speaking button 121a, a level meter display field 121b, and a confirmation button 121c. When the speaking button 121a is pressed, the practice screen display means 12 is instructed to input practice voice data, and the practice voice data is input from the microphone. Then, the recording means 13 displays an input level meter corresponding to the practice voice data in the level meter display field 121b. When the confirmation button 121c is pressed, the practice voice data recorded by the recording unit 13 is reproduced from the speaker. Thereby, the practitioner can confirm his / her pronunciation.
It should be noted that after the picture data is displayed or after obtaining a hint to be described later, the instruction to input practice voice data on the practice screen display means 12 is automatically started without pressing the speaking button 121a. It may be.
The hint acquisition area 122 is an area for giving hints to the practitioner by outputting voice data of the beginning of a word, displaying word data, or outputting correct voice data of a word. It is also an area for outputting an application sentence such as an explanatory sentence of the word of the picture data and an example sentence using the word of the picture data. If it is difficult for the practitioner to listen to the correct audio data output, press the button in the vicinity (in this case, the slow button or the fast button) to press the sound speed without changing the pitch or sound quality. Can be changed.
Specifically, it has an initial button 122a, a character button 122b, a listen button 122c, and an application button 122d, and a hint corresponding to each button can be acquired. The most effective practice method is to acquire hints in the order of the initial button 122a → the character button 122b → the listen button 122c and recognize the word corresponding to the picture card.
The beginning button 122a is a button for outputting speech data of the beginning of the word data corresponding to the language card data for each practitioner (in this case, speech data of “U”) from the speaker.
The character button 122b is a button for displaying word data corresponding to the language card data for each trainer. Specifically, when the character button 122b is pressed once, it is displayed in the square frame area located on the right side of the character button in Kanji or Katakana notation (in this case, “cow”). When the character button 112b is pressed once more, it is displayed in hiragana notation (in this case, “Ushi”). Each time the button is pressed, kanji (or katakana) notation and hiragana notation are repeated.
The listen button 122c is a button for outputting correct voice data corresponding to the language card data for each trainer.
The application button 122d is a button for displaying a list of explanatory sentences and example sentences corresponding to the language card data for each trainer. Specifically, when the application button 122d is pressed, a screen for displaying a list of application sentence data of the language card data for each practice person is developed. The practitioner can select a desired application sentence from the list, and listen to the explanation sentence or example sentence by voice data. Thereby, the practitioner can remember the application sentence in association with the word data. In order to delete the application sentence data list display screen, an end button on the screen may be pressed.
The language card data selection area 123 is an area for displaying a list of language card data for each practicer in practice menu data and selecting desired language card data for each practicer. Specifically, numbers are assigned to the language card data for each practicer in the practice menu data in order from 1, and a list of the numbers is displayed. When there is a lot of language card data for each practitioner, as shown in the figure, a button for moving back and forth may be arranged above the number so that the list of numbers can be scrolled.
The picture data display area 124 is an area for displaying picture data corresponding to the language card data for each trainer. Specifically, a picture of “cow” is displayed as shown. If the picture data display area 124 is clicked with a mouse or a dedicated pen or the like, the picture data that has been displayed may be hidden, and the picture data may be displayed when clicked again. As a result, in the state where the picture data is not displayed, the above-mentioned character button 122b is pushed and the picture data of “cow” is imagined from the displayed word data, or the above-mentioned listen button 122c is pushed and outputted. It is also possible to practice making “cow” picture data imagine from correct audio data.
The end button is a button for ending the language recovery practice.
The ST (abbreviation for Speech Language Healing Therapist) determination button is a button for determining whether the sound is heard or not by listening to the practice voice data recorded by the sound recording means 13 by the language auditor. Specifically, the language hearing person presses the confirmation button 121c in the input and confirmation area 121 to listen to the practice voice data, determines whether or not it is successful, and saves the result. As a result, even if the determination result display means 14 fails, the determination by the language hearing person can pass. The determination result (in this case, a pass) by the language auditor can also be stored in the practice menu and the practice result database 2. It should be noted that the determination result by the language auditor may be stored by overwriting the determination result (in this case, rejected) by the determination result display means 14.
Next, FIG. 6 (A) is a diagram showing an example of the practice screen of the secondary device in one embodiment of the present invention, and FIG. 6 (B) is an example of the pass display in the result display area. FIG. 6C is a diagram showing an example of a failure display in the result display area. Here, an example will be described in which a practice screen is displayed on the display unit of the touch panel, and “cow” is selected from a plurality of language card data for each trainer.
As shown in FIG. 6A, the practice screen 210 of the secondary machine is composed of an input and confirmation area 211, a character button 212, a language card data selection button 213, a picture data display area 214, a result display area 215, and a return button. Composed.
The input and confirmation area 211 instructs the secondary device practice screen display means 20 to input practice voice data, instructs the secondary device recording means 21 to display the input level meter of the practice voice data, This is an area for instructing the recording means 21 to reproduce the recorded practice voice data. Specifically, it has a speaking button 211a, a level meter display field 211b, and a confirmation button 211c. After the speaking button 211a is pressed, the practice voice data is instructed to be input to the secondary device practice screen display means 20, and the practice voice data is inputted from the microphone. In the level meter display field 211b, an input level meter corresponding to the practice voice data recorded by the sub recorder recording means 21 is displayed. After the confirmation button 211c is pressed, the practice voice data recorded by the sub recording unit 21 is reproduced from the speaker. Thereby, the practitioner can confirm his / her pronunciation.
Similar to the main machine, the instruction to input practice voice data on the sub-machine practice screen display means 20 may be automatically started without pressing the speaking button 211a.
The character button 212 is a button for displaying word data corresponding to the language card data for each practice person and giving hints to the practice person. Specifically, when the touch panel is touched once with a finger or a dedicated pen, kanji characters are displayed (in this case, “cow”), and when touched again, hiragana characters (in this case, “ushi”) are displayed. Each time the touch panel is touched, kanji and hiragana are repeatedly displayed.
The language card data selection button 213 is a button for moving the language card data for each trainer displayed to other language card data for each trainer. Specifically, when the left button is pressed once, the previous language card data for each trainer is displayed, and when the right button is pressed once, the language card data for the next trainer is displayed.
The picture data display area 214 is an area for displaying picture data corresponding to the language card data for each trainer. The picture data display area 214 is also a button, and when the touch panel is touched, correct audio data is output. The correct voice data is a voice output of word data corresponding to the picture data. Specifically, a picture of “cow” is displayed in the picture data display area 214 as illustrated. When the area is touched with a finger, correct audio data corresponding to the picture data (in this case, audio data of “Ushi”) is output. If it is difficult to listen to the output sound, the speech speed of the output sound may be changed on the function setting screen of the secondary device. As with the main aircraft, changing the speed of sound does not change the pitch or sound quality.
The result display area 215 is an area for displaying the result of the pass / fail determination. Thereby, the result display area 215 displays pass or fail, and informs the practitioner whether the word is correct and the pronunciation is correct. Specifically, when it is determined to be acceptable, a face as shown in FIG. 6 (B) is displayed, and when it is determined to be unacceptable, a face as shown in FIG. 6 (C). Is displayed. When displaying pass or fail, a sound (in this case, “ping-pong” if it passes or “boo” if it fails) may be output to notify the practitioner.
The return button is a button for ending the language recovery practice.
Although not shown, a head button may be provided in the same manner as the main unit so that voice data of the head of the word data corresponding to the language card data for each trainer may be output.
Next, FIG. 7 is a processing flow diagram of language recovery practice on the main unit side in one embodiment of the present invention.
First, the practice menu creation means 10 extracts language card data for each trainer suitable for the trainee from the language card database 1, and creates practice menu data for the main machine or the sub-machine (step S1). Then, the practice menu data is stored in the practice menu and practice result database 2 (step S2).
Next, it is determined whether to transfer the practice menu data to the storage medium 5 (step S3). When not transferring (No of step S3), the process of step S4 mentioned later is performed. On the other hand, when transferring (Yes in step S3), the practice menu data transfer means 11 selects practice menu data for the sub-machine from the practice menu and practice result database 2 (step S14), and the storage medium 5 (Step S15), and all the processes related to language recovery practice on the main unit side are completed.
Next, practice menu data for a desired main machine is selected from the practice menu and practice result database 2 by the practice screen display means 12 (step S4). Then, the practice screen 120 of the main machine is displayed (see FIG. 5), and desired language card data for each trainer is selected from the list of language card data for each trainer displayed in the language card data selection area 123 (step) S5). In the picture data display area 124 of the practice screen 120, picture data corresponding to the language card data for each practitioner is displayed, and recording of practice progress information is started (step S6).
Next, the following processing is performed in response to pressing of each button on the practice screen 120.
[In case of SW = Hint acquisition processing]
When a desired button in the hint acquisition area 122 is pressed, hint processing corresponding to the button is performed (step S7). Specifically, when the head button 122a is pressed, the voice data of the head of the language data corresponding to the language card data for each trainer is reproduced. When the character button 122b is pressed, the language data of the language card data for each trainer is displayed in kanji or hiragana notation. When the listen button 122c is pressed, correct voice data corresponding to the language card data for each trainer is output. The speaking speed of correct voice data can be increased or decreased according to the listening ability.
Note that after obtaining these hints, the process returns to immediately before step S6, and the practice screen 120 is displayed. The hint may be continuously acquired until the word of the picture data is recognized.
[In the case of SW = application sentence acquisition processing]
When the application button 122d in the hint acquisition area 122 is pressed, a list display screen of application text data is displayed. When a desired application sentence is selected from the list, audio data corresponding to the application sentence is output. The application sentence data selection and the voice data output are repeated until an end instruction is given.
Note that after the end instruction is given, the process returns to immediately before step S6, and the practice screen 120 is displayed.
[In case of SW = speaking process]
When the speaking button 121a in the input and confirmation area 121 is pressed, practice voice data input based on the picture data is started, and the recording means 13 is activated to record practice voice data corresponding to the picture data and practice voice. The data input level meter is displayed (step S9). Then, the determination result display means 14 compares the practice voice data with the correct pronunciation data to determine the pass / fail, and the determination result is displayed on the screen (step S10). Then, the practice result storage means 15 stores the practice result data in the practice menu and the practice result database 2 (step S11). The practice result data is practice audio data recorded between the practice voice data recorded in step S9, the determination result in step S10, and the pass / fail determination process in steps S6 to S10.
Finally, it is determined whether or not to display the next language card data for each trainer on the practice screen 120 (step S12). If the next language card data for each practitioner is to be displayed (Yes in step S12), the process returns to immediately before step S5, and the language recovery practice is continued. On the other hand, when the next language card data for each practitioner is not displayed (No in step S12), it is further determined whether or not the end button of the practice screen 120 has been pressed (step S13). When the end button is not pressed (No in step S13), the process returns to the position immediately before step S5, and the language recovery practice is continued. On the other hand, when the end button is pressed (Yes in step S13), all the processes related to language recovery practice on the main unit side are ended.
Next, FIG. 8 (A) is a flowchart of the process for registering the practitioner information according to the embodiment of the present invention, and FIG. 8 (B) is the process for registering the language card data. FIG.
As shown in FIG. 8A, first, practitioner information such as the name of the practitioner and the onset time is input by the practitioner information creating means 16 (step S21). Then, it is determined whether or not the practitioner information can be registered (step S22). If there is a correction portion (No in step S22), the process returns to the step before step S21 to correct the return data. On the other hand, when registering (Yes in step S22), the practitioner information creating means 16 stores the practitioner information in the practitioner information database 3 (step S23).
Although not shown, the trainer information creating means 16 may also perform processing for correcting or deleting the trainer information registered in the trainer information database.
As shown in FIG. 8B, first, desired picture data is selected from the picture information database 4 by the language card creation means 17 of the main machine (step S31). Then, word data, correct voice data, etc. are set (step S32). Then, it is determined whether or not language card data can be registered (step S33). If there is a correction part (No in step S33), the process returns to the step before step S32 to correct the return data. On the other hand, when registering (Yes in Step S33), the language card creation means 17 stores the language card data in the language card database 1 (Step S34).
Next, FIG. 9 is a processing flow diagram of language recovery practice of the secondary device in one embodiment of the present invention. When performing language recovery practice on the secondary machine, it is necessary to transfer the practice menu data for the secondary machine to the storage medium 5 in advance in the processing of step S14 and step S15 of FIG. is there.
First, the practice menu data for the secondary machine is read from the storage medium 5 by the secondary machine practice screen display means 20 (step S41). Then, the practice screen 210 of the secondary machine is displayed (see FIG. 6A), and desired language card data for each trainer is selected using the language card data selection button 213 (step S42). In the picture data display area 214 of the practice screen 210, picture data corresponding to the language card data for each practitioner is displayed, and recording of practice progress information is started (step S43).
Next, the following processing is performed in response to pressing of each button on the practice screen 210.
[In case of SW = word data acquisition processing]
When the character button 212 is pressed, the word data included in the language card data for each practitioner is displayed in kanji notation or hiragana notation (step S44). In addition, after acquiring word data, a process returns to immediately before step S43 and the practice screen 210 is displayed. The word data may be continuously acquired until the word of the picture data can be recognized.
[In case of SW = voice data acquisition processing]
When a part of the picture data display area 214 is pressed, correct voice data corresponding to the language card data for each trainer is output (step S45). The speaking speed of correct voice data can be increased or decreased according to the listening ability. The speech speed may be set on the secondary device setting screen before the language recovery practice is started.
In addition, after acquiring correct audio | voice data, a process returns to immediately before step S43 and the practice screen 210 is displayed. You may continue acquiring audio | voice data until the word according to correct audio | voice data is recognized.
[In case of SW = speaking process]
When the speaking button 211a in the input and confirmation area 211 is pressed, the practice voice data input based on the picture data is started, the secondary machine recording means 21 is activated, and the practice voice data is recorded according to the picture data, and The practice audio data input level meter is displayed (step S46). Then, the sub-device determination result display means 22 compares the practice voice data with the correct pronunciation data to determine pass / fail, and the determination result is displayed in the result display area 215 of the practice screen 210 (step S47). Then, the practice result data is saved in the storage medium 5 by the auxiliary machine practice result saving means 23 (step S48). The practice result data is the practice voice data recorded in step S46, the judgment result in step S47, or practice progress information performed during the pass / fail judgment process from step S43 to step S47.
Next, it is determined whether or not to display the next language card data for each trainer on the practice screen 210 (step S49). When the next language card data for each practitioner is displayed (Yes in step S49), the process returns to immediately before step S42 and the language recovery practice is continued. On the other hand, when the next language card data for each trainer is not displayed (No in step S49), it is further determined whether or not data is transferred from the storage medium 5 to the main unit (step S50). When transferring (Yes in step S50), the practice result data saved in the storage medium 5 by the practice result saving means 15 is saved in the practice menu and the practice result database 2 (step S51), and the language recovery practice of the secondary machine is performed. Ends. On the other hand, when the transfer is not performed (No in step S50), the practice result data is not reflected on the main machine, and the language recovery practice ends.
Although not shown, in the case of another example of language recovery practice as shown in FIG. 1 (B) or FIG. 3 (B), the practice voice data recorded in step S46 is stored. A process of converting to the data format of the determination result display means 14 is added. In step S48, the converted practice voice data is stored in the storage medium 5. The converted practice voice data is transferred to the determination result display means 14 before the process of step S51, and a pass / fail determination is made using the criteria of the main engine's pass / fail determination to create practice result data. Thereafter, the practice result data is stored in step S51, and the language recovery practice ends.
Hereinafter, the management table using the practice menu data or the practice result data according to the embodiment of the present invention will be described in detail with reference to FIG. 10 to FIG.
First, FIG. 10 is an example of a daily management table in which practice result data is displayed on a daily basis in one embodiment of the present invention.
As shown in FIG. 10, the daily management table is a table in which the name of the practitioner, the date and time of practice, the language card data number and word data for each practitioner, and the practice result data are listed on a daily basis.
Specifically, practice result data is the number of times the listen button was pressed, the number of times the button was pressed slowly at the speech speed of the voice data, the number of times the talk button was pressed, the number of times to pass, the score, and the beginning button The number of times of instructing hiragana notation, the number of times instructing kanji notation are shown. Since each item has been described above, it is omitted here. In the daily management table, the vertical axis represents the language card data for each trainer and the horizontal axis represents the practice result data in a matrix, and the total value of each item is calculated in the last row.
Finally, FIG. 11 (A) is an example of a monthly management table in which practice result data in one embodiment of the present invention is displayed on a monthly basis, and FIG. 11 (B) shows a monthly management table. It is an example represented by a graph.
As shown in FIG. 11 (A), the monthly management table calculates the total value and average number of times of the practice result data of the daily management table described above and displays them in the order of practice date. In the monthly management table, the vertical axis represents the date and time, the horizontal axis represents the practice result data in a matrix, and the total value of each item is calculated in the last row. Since each item has been described above, it is omitted here.
As shown in FIG. 11 (B), the data in the monthly management table can be expressed in a form such as a bar graph or a line graph. Specifically, the data of the monthly management table in FIG. 11 (A) is extracted and stored in a storage unit of a dedicated machine or personal computer, a storage medium, or the like. Using the saved monthly management table data and an application capable of creating a graph, a graph as shown in the figure is created. Note that an application capable of creating a graph is installed in advance on a dedicated machine or a personal computer.
1 Language card database
2 Practice menu and practice result database
3 Trainer information database
4 picture information database
5 storage media
10 Practice menu creation means
11 Practice menu data transfer means
12 Practice screen display means
13 Recording means
14 Judgment result display means
15 Practice result storage
16 Trainer information creation means
17 Language card creation means
20 Secondary machine practice screen display means
21 Sub-recording means
22 Sub-machine determination result display means
23 Sub-practice practice result storage
30 Practice menu data
31 Practice result data
32 Practice voice data
100 main engine
110 Practice menu creation screen for main engine
111 Language card list display area
112 Language card selection area
113 Practice menu display area
120 Main aircraft practice screen
121 Input and confirmation area
121a Talk button
121b Level meter display field
121c Confirm button
122 Hint acquisition area
122a Begin button
122b Text button
122c Listen button
122d Application button
123 Language card data selection area
124 picture data display area
200 Secondary machine
210 Practice screen of the secondary machine
211 Input and confirmation area
211a Talk button
211b Level meter display field
211c Confirm button
212 character buttons
213 Language card data selection button
214 Picture data display area
215 Result display area

[Document Name] Description [Title of Invention] Aphasia Practice Support Device with Main Machine and Sub Machine [Technical Field]
[0001]
The present invention relates to a practice support device composed of a main machine and a secondary machine that supports recovery of aphasia, and in particular, transfers a language recovery practice menu created on the main machine to the secondary machine, and displays a practice menu picture card on the secondary machine. The present invention relates to an apparatus capable of displaying and recording a practitioner's voice corresponding to the picture card, determining whether or not the pronunciation is correct, and storing the determination result in a storage unit of a main unit.
[Background]
[0002]
2. Description of the Related Art Conventionally, there are devices that treat brain dysfunction using music therapy, and there are devices that sing songs by generating musical sounds of songs and voices.
[0003]
In Japanese Patent Application Laid-Open No. 09-047510, the display of the lyrics shown on the display unit using a hand, a part of another body, a mouse, or the like on the display unit displaying the music known to the care recipient. A music therapy device is disclosed in which the switch means activated by pressing the vicinity of the button to sequentially indicate the melody corresponding to the lyrics. This makes it possible to recover the function by allowing the medical care recipient to sound the melody corresponding to the lyrics just by instructing the lyrics that the user is familiar with in the past, voluntarily playing and singing the desired music. It has been shown.
[Patent Document 1] Japanese Patent Application Laid-Open No. 09-047510 [Disclosure of the Invention]
[Problems to be solved by the invention]
[0004]
The above-mentioned method is a therapy that spontaneously plays a desired song and restores brain function by singing, so that the part involved in the language function of the cerebrum is impaired, and understanding of the language or It is hard to say that it is effective treatment for aphasia with a loss of the ability to speak. Aphasia is improved little by little by repetitive long-term training for the deficient function. Therefore, it is necessary for the language hearing person to create a program tailored to the symptom and the environment and perform language training. However, because there are few hospitals (or rehabilitation centers) that provide language auditors and language training, hospitals that go to language training are far away, or language training for a long time, many people who have not received language training There is a problem that there is a person at home.
[0005]
Moreover, language training at hospitals is short, and most of them are practiced at home to make up for the lack of language training. One practice to make up for the lack of language training is to replay and listen to words recorded on a magnetic card and repeat the pronunciation practice, but it is difficult to correct the pronunciation. Therefore, even in an environment where there is no language hearing person, there is a problem of providing a practice support device capable of performing language training similar to the environment where there is a language hearing person.
[0006]
Furthermore, since the results of the practice at home are difficult for the language hearing person to understand, there is a problem of providing a practice support device that can confirm the practice results later.
[0007]
Furthermore, in order to make up for the lack of language training, there is a problem of providing a portable practice support device that can be practiced casually outside a hospital or home.
[0008]
Furthermore, since there are many different types and degrees of aphasia, there is a problem of providing a practice support device that can adjust the amount of language training practice and the difficulty of practice according to the symptoms and degree of the practitioner.
[0009]
Furthermore, in order to create a practice menu according to the training plan for language training, there is a problem of providing a practice support device that can newly create a language training material using photographs, sounds, or sounds.
[Means for Solving the Problems]
[0010]
The present invention has been made in view of the above-described problems, and is a main machine and a sub machine that share data of each database via a storage medium, and includes at least picture data, correct audio data, and word data. extracts learner by language card data aphasia corresponding from language card database practitioners of the aphasia to manage language card data creates a practice menu data, manages the practice menu data and training result data training menu and a practice menu creation means for storing the training result database, training menu to be transferred by extracting the practice menu data aphasia in accordance with the practice contents of practitioners of the aphasia from the practice menu and practice result database to the storage medium From the data transfer means, the practice menu and the practice result database, the desired Learning to extract the menu data, and training the screen display means for displaying at least the picture data of the learner by language card data of the aphasia, training speech data learner aphasia based on trainee by language card data of the aphasia Record Record means and said training speech data and the right difference degree or similar degree of the set if not determination Priority determination for each trainee by language card data for the learner or each said aphasia aphasia criteria and audio data determines that it is within the value, the determination result displaying means for displaying the determination result, and the determination result, until the alloy not determination Priority determination from trainee by language card data of the aphasia is displayed is performed as an exercise result data and training course information, and the main machine and a training result storage means for storing the training menu and practice result database, the kneading Access to the storage medium in which the menu data is stored, and sub-machine training screen display means for displaying at least the picture data of the learner by language card data of the aphasia, aphasia based on trainee by language card data of the aphasia Sub-recording means for recording the practice voice data of the practitioner , and whether or not the difference or similarity between the practice voice data and the correct voice data is within a reference value for pass / fail judgment , the consists of a sub-machine that includes a sub-machine determination result displaying means for performing display, and displays the picture data of the learner by language card data of the aphasia the practice menu data in the sub-machine, with respect to the picture data Record the practice voice data of the aphasic practitioner, determine whether the practice voice data is within a reference value for pass / fail judgment, and display the judgment result to display the aphasia This is solved by informing the practitioner of the symptom of the above pass / fail judgment .
[0011]
In the present invention, data relating to practitioners of aphasia input by the learner information creating means and to save the training information database for managing each practice's aphasia.
[0012]
Further, in the present invention, the practice result storage means transfers the practice result data of the secondary device stored in the storage medium to the practice menu and the practice result database, and shares it with the master device and the secondary device. Features.
[0013]
Further, in the present invention, the practice screen display means or the secondary device practice screen display means displays the picture data of the language card data for each aphasic practitioner, starts recording the practice progress information, and The practice voice of the aphasia practitioner based on the data is input, and the recording means or the sub-recording means is made to record the practice voice of the aphasia practice person and display the input level meter of the practice voice. To do.
[0014]
Further, in the present invention, by the practice screen display means or the auxiliary machine training screen display unit, while displaying the picture data of the learner by language card data of the aphasia, the aphasia learner by language card Of the word data corresponding to the data, only the voice data at the beginning of the word data is output as a hint .
[0015]
Further, in the present invention, by the practice screen display means or the auxiliary machine training screen display unit, while displaying the picture data of the learner by language card data of the aphasia, the aphasia learner by language card A hint is displayed for the word data of the data in kanji or kana notation .
[0016]
Further, in the present invention, the practice menu creating means individually sets a reference value for the pass / fail judgment between the practice voice data and the correct voice data by the judgment result display means according to the symptoms and the degree of aphasia of each practice person. It is characterized by setting.
[0017]
Furthermore, in the present invention, the language card database is stored in units of words corresponding to the picture data.
[0018]
Furthermore, in the present invention, the practice menu and the practice result database are classified for each aphasia practitioner, and the practice menu data created according to the symptom and degree of the practitioner is managed. To do.
[0019]
Further, in the present invention, the determination result and the training course information up learner by language card data of the aphasia is the determination of the acceptance from being displayed is performed and exercise result data stored prior Symbol storage medium Sub-practice practice result storage means for storing the practice result data in the storage medium by the sub-machine practice result storage means, and the practice result data stored in the storage medium by the practice result storage means by the practice menu and It is stored in the practice result database.
[0020]
Further, in the present invention, the auxiliary machine record means said training speech data learner of aphasia and stored into the storage medium, the determination result displaying means in the Practice Practice's aphasia the acceptance of voice data of the storage medium It is determined using the reference value set for each language card data for each aphasia with or for each aphasia, and stored in the practice menu and the practice result database by the practice result saving means.
【The invention's effect】
[0021]
In order to solve the above problems, an aphasia practice support device having a main machine and a sub machine according to the present invention creates practice menu data according to a practitioner with practice menu creation means, and practice menu for the main machine with practice screen display means. The data is extracted, the language card data for each trainer is displayed, and the practice voice data based on the language card data for each trainer is recorded by the recording means. Then, the judgment result display means judges the pass / fail of the practice voice data and displays the judgment result, and the practice result storage means saves the practice result data in the practice menu and the practice result database. Even so, it is possible to support practice similar to language training by a language auditor.
[0022]
Also, the practice menu data for the secondary device extracted by the practice menu data transfer means is transferred to the storage medium. Then, the language card data for each practicer of the practice menu data of the storage medium is displayed by the secondary machine practice screen display means, and the practice voice data is recorded by the secondary machine recording means. By displaying the result of pass / fail determination by the sub machine determination result display means, the sub machine can practice at a place different from the main machine.
[0023]
This makes it possible to create practice menu data that adjusts the amount of practice, difficulty of practice content, or criteria for pass / fail judgment according to the type and degree of aphasia, and results of pass / fail judgment and recorded practice voice data You can confirm the correct pronunciation and self-correct the pronunciation, or the language auditor can check the practice results at home. In addition, since each database is shared between the main machine and the sub machine, it can be managed centrally.
[0024]
In addition, the language card creation means creates new language card data suitable for the practitioner's symptoms and degree, and additionally stores it in the language card database managed in units of words. The data in can be sorted. This makes it possible to easily extract language card data suitable for the practitioner and create a practice menu.
[0025]
Furthermore, while displaying the picture data of the language card data for each trainer on the practice screen display means, the correct speech data is output at different speech speeds, the speech data at the beginning of the word data is output, or By displaying word data, it is possible to give a practitioner a hint of a picture card. Thereby, when the word of picture data is not known, the hint according to a situation is acquired and it can practice until it can recognize a word naturally.
[0026]
Furthermore, since the practice menu and the practice result database are divided for each practitioner and manage the practice menu data and the practice result data, data related to language recovery practice can be aggregated for each practitioner. As a result, the data can be used to grasp the recovery status of aphasia and to create a future practice plan.
[0027]
Further, the secondary device practice result saving means saves the practice voice data of the secondary device recording means and the practice progress information to the storage medium, whereby the practice result data on the storage medium is stored in the practice menu and the practice result by the practice result saving means. Can be stored in a database. Thereby, the practice result of the secondary machine can be easily reflected in the practice menu and the practice result database.
[0028]
Further, by saving the practice voice data of the sub-recording means to the storage medium, the judgment result display means can make a pass / fail judgment of the practice voice data of the storage medium. Thereby, practice result data can be acquired using the criteria of the pass / fail judgment of the main machine.
BEST MODE FOR CARRYING OUT THE INVENTION
[0029]
Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0030]
First, FIG. 1 (A) is an example of a block diagram of processing for performing language recovery practice of the main machine and the sub machine in one embodiment of the present invention, and FIG. It is a block diagram explaining the example of.
[0031]
As shown in FIG. 1 (A), the language recovery practice in the aphasia practice support apparatus having the main machine and the secondary machine is performed by the language card database 1, practice menu and practice result database 2, practice menu creation means 10, practice. Main machine 100 comprising menu data transfer means 11, practice screen display means 12, recording means 13, determination result display means 14, practice result storage means 15, sub machine practice screen display means 20, sub machine recording means 21, The sub-machine 200 includes a sub-machine determination result display unit 22 and a sub-machine practice result storage unit 23, and the storage medium 5.
[0032]
The main machine 100 refers to a computer device used for language recovery practice installed in a language hearing person or a hospital (or rehabilitation center) that conducts language training.
[0033]
Specifically, it is a dedicated device equipped with means described later, or a personal computer (hereinafter abbreviated as a personal computer) installed with an application having means described later.
[0034]
The dedicated device or the personal computer includes at least a first input unit, a second input unit, a display unit, a storage unit, a calculation unit, and an output unit. The first input unit is a keyboard, a tablet, a mouse, a finger, a dedicated pen, or the like. The second input unit is a device that converts sound into an electrical signal, and is specifically a microphone. The display unit is a display or a touch panel. The storage unit is a device that stores data and programs in the computer. The arithmetic unit is a central unit that controls each device and each means, and calculates and processes data in a computer. The calculation unit is also a device that executes a program in the storage unit, receives data from the first input unit or storage unit, performs calculation or processing, and outputs the result to the output unit or display unit. The output unit is a device that converts an electrical signal into sound, and specifically, a speaker.
[0035]
The secondary device 200 refers to a computer device used for portable language recovery practice.
[0036]
Specifically, it is Personal Digital Assistants (hereinafter abbreviated as PDA) equipped with the means described below. As with the main machine, the PDA includes at least a first input unit (in this case, a finger or a dedicated pen), a second input unit, a display unit (in this case, a touch panel), a storage unit, a calculation unit, and an output unit. And have. The specific control is the same as that of the main engine, and is omitted here.
[0037]
The language card database 1 is a database that manages language card data used in language recovery practice in units of words. The language card data is obtained by adding sound information and document information to a language card consisting of a picture drawn according to a word or an attached photo and converting it into electronic data.
[0038]
Specifically, the language card database 1 is a set of language card data numbers, picture data, acceptance reference point data, correct voice data, word data, applied sentence data, category data, and the like. included. The acceptance reference point data is a score that becomes a criterion for acceptance in the pass / fail determination of the determination result display means 14 to be described later, and is accepted if it is below this reference point (or above the reference point). Specifically, speech auditors (for people with disabilities such as words and sounds, and those around them, including doctors, nurses, physical therapists, occupational therapists, educators, and healthcare professionals. A person who provides specialized assistance such as consultation, evaluation, training, and guidance while collaborating) determines the voice of the practitioner in advance, and determines the score that will be a criterion for success based on the correlation of the results. The word data is a word written in hiragana, katakana or kanji according to the picture data. The application sentence data consists of an explanatory sentence of a word corresponding to picture data or an example sentence using the word. An existing illustration or the like may be read by a scanner and converted into electronic data, which may be used as picture data.
[0039]
The practice menu and practice result database 2 is a database that manages practice menu data created according to the practitioner and practice result data according to the practice menu data. The practice menu data is a set of language card data for each practicer extracted according to the symptom and degree of the practicer. The practice result data is a set of practice voices according to the language card data for each practice person, pronunciation pass / fail judgment results, practice progress information, and the like. Specifically, the practice menu data is a set of practice menu data numbers, the name of the practitioner, the creation date of the practice menu, the language card data for each selected practice person, and the like. The practice result data is a set of practice menu data numbers, practice dates and times, practice audio data, determination results, practice progress information, and the like.
[0040]
The storage medium 5 is a recording medium for storing practice menu data transferred from the main unit 100 to the sub unit 200, or practice result data and practice audio data transferred from the sub unit 200 to the main unit 100, and is portable. It is a big size. Specifically, a floppy disk, a CD-ROM (Compact Disc Read Only Memory), a memory card, or the like is used as the recording medium.
[0041]
The practice menu creating means 10 extracts language card data for each trainer according to each trainer from the language card database 1 to create practice menu data, and the created practice menu data is stored in the practice menu and practice result database 2. It is a means to preserve. Specifically, the practice menu data is created separately for the main machine and the sub machine, and a flag for distinguishing them is set.
[0042]
Further, it is also a means for setting a criterion for pass / fail judgment in a judgment result display means 14 or a sub-machine judgment result display means 22 described later. The criterion for pass / fail judgment is a value that sets a range in which each phoneme of the practice voice data and the correct voice data is judged to be different. Specifically, when the pass / fail judgment criterion is set to 20%, if the degree of difference between the phonemes of the practice voice data and the correct voice data is 20% or more, they are determined to be different phonemes. On the other hand, if the degree of difference of each phoneme is less than 20%, both are determined to be the same phoneme. Here, although the degree of difference is described, the pass / fail determination may be performed using the degree of similarity between the phonemes of the practice voice data and the correct voice data. In addition, the criterion for pass / fail determination is set for each practitioner or for each language card data for each practitioner. However, when the criterion for pass / fail determination is not set, a default value may be automatically set.
[0043]
The practice menu data transfer means 11 is means for extracting practice menu data for the sub-machine corresponding to the practice content from the practice menu and practice result database 2 and transferring it to the storage medium 5. As a data transfer method, there are a method using wireless or a method using an interface. Specifically, main unit 100 and storage medium 5 (in this case, a memory card) are connected to a memory card reader via an interface (in this case, USB), and the submenu extracted by practice menu data transfer means 11 is connected. Transfer the training menu data for the machine to the memory card and save it.
[0044]
The practice screen display means 12 extracts practice menu data for a desired main machine from the practice menu and practice result database 2, and the pictorial data of language card data for each trainer included in the practice menu data is displayed on the practice screen. And start recording practice progress information. Then, after receiving a voice input instruction, it is means for starting to input practice voice data based on picture data through a microphone. Specifically, the display of the display unit is a touch panel, and the practitioner touches a desired location on the display with an input unit such as a finger or a dedicated pen to give an instruction. Note that the display of the display unit does not have to be a touch panel. In that case, an input unit such as a keyboard, a tablet, or a mouse may be used.
[0045]
The recording means 13 is means for recording practice voice data input by the practice screen display means 12 and displaying a level meter of the input voice corresponding to the practice voice data on the practice screen. The recorded practice voice data is saved as practice result data in the practice menu and practice result database 2 by the practice result saving means 15 described later.
[0046]
The practice voice data recorded by the recording means 13 is output through a speaker when an instruction to reproduce the practice voice data is given. The instruction to reproduce the practice voice data will be described in detail with reference to FIG.
[0047]
The determination result display means 14 compares the practice voice data recorded by the recording means 13 with the correct voice data included in the language card data, and determines whether the practice voice data is the same as the correct voice data. If it is determined to be the same, a pass is displayed on the practice screen, and if it is determined that it is not, a failure is displayed on the practice screen so that the word is correct and the pronunciation is correct for the practitioner. It is a means to let you know what has been done.
[0048]
Specifically, the frequency spectrum and level of the practice voice data and correct voice data in the language card data for each trainer (in this case, “Ushi”) are expressed as feature vectors, and each phoneme unit. Compare feature vectors. If the degree of difference between the two is less than the reference value for pass / fail judgment (in this case, 20%), it is determined that the phonemes are the same, and the degree of difference is converted into a numerical value (in this case, the degree of difference of “U”). Is 5, and the difference degree of “shi” is 10.) If the total difference degree of each phoneme (in this case, 5 + 10 = 15) is lower than the score of the acceptance reference point data (in this case, 20) included in the language card data, the score is high. In this case, it is determined as rejected (in this case, 15 <20, so it passes). If it passes, “Good” is displayed on the practice screen, and if it fails, “Let's do a little more” is displayed on the practice screen. Also, convert how many times you have passed into a score (in this case, 3 points if you pass the first time, 2 points if you pass the second time, 1 point if you pass more than the first time), practice menu and practice The result database 2 may be stored as part of the practice result data.
[0049]
The practice result saving means 15 is means for saving the practice voice data recorded by the recording means 13 and the practice result data of the determination result display means 14 in the practice menu and practice result database 2 as practice result data. Since the practice result data has already been described, it is omitted here.
[0050]
The secondary device practice screen display means 20 accesses the storage medium 5 in which the practice menu data for the secondary device is stored, and the pictorial data of the language card data for each trainer included in the practice menu data is practiced by the secondary device 200. Display on the screen and start recording practice progress information. Then, after receiving a voice input instruction, it is means for starting to input practice voice data based on picture data through a microphone. Specifically, the display of the display unit is a touch panel, and the practitioner touches a desired location on the display with an input unit such as a finger or a dedicated pen to give an instruction. If the storage medium 5 is not connected, an error may be displayed on the screen.
[0051]
The secondary machine recording means 21 is a means for recording practice voice data input on the secondary machine practice screen display means 20 and displaying an input voice level meter corresponding to the practice voice data on the practice screen. The recorded practice voice data is saved as practice result data in the storage medium 5 by the sub-machine practice result saving means 23 described later.
[0052]
Note that the practice voice data recorded by the sub-recording means 21 is output through a speaker when an instruction to reproduce the practice voice data is given. The instruction to reproduce the practice voice data will be described in detail with reference to FIG.
[0053]
The secondary machine determination result display means 22 compares the practice voice data recorded by the secondary machine recording means 21 with the correct voice data included in the language card data for each practitioner and determines whether the voice data is the same as the correct voice data. To do. If it is determined to be the same, a pass is displayed on the practice screen, and if it is determined that it is not, a failure is displayed on the practice screen so that the word is correct and the pronunciation is correct for the practitioner. It is a means to let you know what has been done. In addition, since it is specifically the same as the determination result display means 14, description is abbreviate | omitted here.
[0054]
The auxiliary equipment practice result storage means 23 is means for saving the practice voice data recorded by the auxiliary equipment recording means 21 or the practice result data of the auxiliary equipment determination result display means 22 as practice result data in the storage medium 5. . Since the practice result data has already been described, it is omitted here.
[0055]
FIG. 1 (B) shows another embodiment of language recovery practice, and only the parts different from FIG. 1 (A) will be described.
[0056]
In addition to recording practice voice data and displaying a level meter of input voice on the practice screen, the secondary machine recording means 21 is a data format in which the recorded practice voice data is processed by the determination result display means 14 (specifically, , WAVE file). The converted practice voice data is saved in the storage medium 5 by the sub-machine practice result saving means 23.
[0057]
Then, the determination result display means 14 makes a pass / fail determination using the converted practice voice data in the storage medium 5. Thereafter, the practice result storage means 15 performs a process of saving the practice result data in the practice menu and the practice result database 2.
[0058]
As described above, the practice voice data of the sub machine recording means 21 is stored in the storage medium 5 and the pass / fail judgment is made by the judgment result display means 14, so that even if the practice voice data of the sub machine 200 is used, You may enable it to evaluate using the criterion of determination.
[0059]
Next, FIG. 2 (A) is a block diagram of processing for registering practitioner information, and FIG. 2 (B) is a block diagram of processing for registering language card data.
[0060]
As shown in FIG. 2A, the process for registering the practitioner information is composed of the practitioner information database 3 and the practitioner information creating means 16.
[0061]
The practitioner information database 3 is a database that manages information on practitioners who practice language recovery. Specifically, it is a set of data such as the name of the practitioner, the date of hospitalization, the name of the disease, and the date of starting practice.
[0062]
The trainer information creating means 16 is means for registering the trainer information for performing the language recovery practice that has been input in the trainer information database 3.
[0063]
As shown in FIG. 2 (B), the process of registering a language card comprises a language card database 1, a picture information database 4, and a language card creation means 17. Since the language card database 1 has already been described, a description thereof is omitted here.
[0064]
The picture information database 4 is a database in which picture data or photo data is managed. More specifically, a digital photograph of a photograph taken with a digital camera or a picture read with a scanner is stored.
[0065]
The language card creation means 17 is a means for newly creating language card data using the picture data or picture data in the picture information database 4 and additionally storing it in the language card database 1. Specifically, picture data or photo data suitable for the practitioner's symptoms and degree is extracted from the picture information database 4, and correct voice data, word data, applied sentence data, category data, etc. are registered in accordance with the extracted data. Create card data.
[0066]
Next, FIG. 3 (A) is an example of a diagram for explaining the flow of data between the main unit and the sub unit in one embodiment of the present invention, and FIG. 3 (B) shows the flow of data. It is another example of the figure to do. 3 (A) corresponds to FIG. 1 (A), and FIG. 3 (B) corresponds to FIG. 1 (B).
[0067]
As shown in FIG. 3 (A), first, the practice menu data transfer means 11 extracts practice menu data 30 for a desired sub-machine from the practice menu and practice result database 2 (see arrow (1) in the figure). . The practice menu data transfer means 11 transfers the practice menu data 30 to the storage medium 5 via an interface or wirelessly and stores it (see the arrow (2) in the figure).
[0068]
Next, language recovery practice processing is executed by the sub-machine 200. Specifically, the secondary device practice screen display means 20 accesses the storage medium 5 to read the practice menu data 30 (see the arrow (3) in the figure), and the pictorial data of the language card data for each trainer is stored in the secondary device. Display on the practice screen. The sub-recorder 21 records practice voice data and displays the input level meter. Then, the sub machine determination result display means 22 determines whether or not the practice voice data is acceptable, and displays the result on the practice screen. Then, the practice result data 31 is saved in the storage medium 5 by the auxiliary machine practice result saving means 23 (see the arrow (4) in the figure).
[0069]
Finally, practice result data 31 is extracted from the storage medium 5 by the practice result storage means 15 via the interface or wirelessly (see the arrow (5) in the figure). Then, the practice result data 31 is saved in the practice menu of the main machine and the practice result database 2 by the practice result saving means 15 (see arrow (6) in the figure).
[0070]
FIG. 3 (B) is a diagram for explaining the flow of data in another embodiment of the language recovery practice, and explains a different part (after the arrow in (3) in the figure) from FIG. 3 (A). .
[0071]
The auxiliary machine 200 executes language recovery practice processing. Specifically, picture data is displayed on the practice screen by the secondary machine practice screen display means 20. The sub recording unit 21 records practice voice data, displays an input level meter, and converts the data format of practice voice data. Then, the secondary machine determination result display means 22 displays the result of the pass / fail judgment, and the secondary machine practice result storage means 23 stores the converted practice voice data 32 in the storage medium 5 (see arrow (4) in the figure). ).
[0072]
Then, the judgment result display means 14 extracts the converted practice voice data 32 from the storage medium 5 via the interface or wirelessly (see the arrow (5) in the figure), and performs pass / fail judgment. Then, the practice result data 31 is transferred to the practice result storage means 15 (see the arrow (6) in the figure), and the practice result data 31 is saved in the practice menu and the practice result database 2 by the practice result storage means 15 (in the figure). (See arrow in (7)).
[0073]
Next, FIG. 4 is a diagram showing an example of a practice menu creation screen of the main machine in one embodiment of the present invention.
[0074]
As shown in FIG. 4, the practice menu creation screen 110 of the main machine is composed of a language card list display area 111, a language card selection area 112, and a practice menu display area 113.
[0075]
The language card list display area 111 is an area for displaying a list of data in the language card database 1 according to a display method. The display method includes a full list, an alphabetical order, a category order, or a basic order, and these are selected from a pull-down menu. The all list is a method of displaying all the managed data without rearranging. The 50-sound order is a method of displaying a list by rearranging the heads of word data in the order of 50 sounds. By category, word data is sorted and displayed in a list by category (specifically, animal category, plant category, food category, etc.). The basic order is a method in which word data is displayed in a list by rearranging the word data from the most difficult to the most difficult. Here, the case where the display method is in the order of 50 sounds is shown.
[0076]
The language card selection area 112 is an area where the language card data for each trainer selected from the language card database 1 is moved to the practice menu, and the language card data for each trainer selected from the practice menu is returned to the language card database 1. is there. The pictorial data of the selected language card data for each trainer is displayed in a square frame in the figure.
[0077]
The practice menu display area 113 is an area for displaying the contents of the created practice menu data. Specifically, the name of the practitioner, the creation date of the practice menu, the language card number of the language card data for each practitioner, and the like are displayed.
[0078]
Next, FIG. 5 is a diagram showing an example of a practice screen of the main machine in one embodiment of the present invention. Here, an example will be described in which a practice screen is displayed on the display unit of the touch panel, and the practitioner selects “cow” from a plurality of language card data for each practicer.
[0079]
As shown in FIG. 5, the practice screen 120 of the main machine includes an input and confirmation area 121, a hint acquisition area 122, a language card data selection area 123, a picture data display area 124, an end button, and an ST determination button.
[0080]
The input and confirmation area 121 instructs the practice screen display means 12 to input practice voice data, instructs the recording means 13 to display the input level meter of the practice voice data, and is recorded by the recording means 13. This is an area for instructing playback of practice voice data. Specifically, it has a speaking button 121a, a level meter display field 121b, and a confirmation button 121c. When the speaking button 121a is pressed, the practice screen display means 12 is instructed to input practice voice data, and the practice voice data is input from the microphone. Then, the recording means 13 displays an input level meter corresponding to the practice voice data in the level meter display field 121b. When the confirmation button 121c is pressed, the practice voice data recorded by the recording unit 13 is reproduced from the speaker. Thereby, the practitioner can confirm his / her pronunciation.
[0081]
It should be noted that after the picture data is displayed or after obtaining a hint to be described later, the instruction to input practice voice data on the practice screen display means 12 is automatically started without pressing the speaking button 121a. It may be.
[0082]
The hint acquisition area 122 is an area for giving hints to the practitioner by outputting voice data of the beginning of a word, displaying word data, or outputting correct voice data of a word. It is also an area for outputting an application sentence such as an explanatory sentence of the word of the picture data and an example sentence using the word of the picture data. If it is difficult for the practitioner to listen to the correct audio data output, press the button in the vicinity (in this case, the slow button or the fast button) to press the sound speed without changing the pitch or sound quality. Can be changed.
[0083]
Specifically, it has an initial button 122a, a character button 122b, a listen button 122c, and an application button 122d, and a hint corresponding to each button can be acquired. The most effective practice method is to acquire hints in the order of the initial button 122a → the character button 122b → the listen button 122c and recognize the word corresponding to the picture card.
[0084]
The beginning button 122a is a button for outputting speech data of the beginning of the word data corresponding to the language card data for each practitioner (in this case, speech data of “U”) from the speaker.
[0085]
The character button 122b is a button for displaying word data corresponding to the language card data for each trainer. Specifically, when the character button 122b is pressed once, it is displayed in the square frame area located on the right side of the character button in Kanji or Katakana notation (in this case, “cow”). When the character button 112b is pressed once more, it is displayed in hiragana notation (in this case, “Ushi”). Each time the button is pressed, kanji (or katakana) notation and hiragana notation are repeated.
[0086]
The listen button 122c is a button for outputting correct voice data corresponding to the language card data for each trainer.
[0087]
The application button 122d is a button for displaying a list of explanatory sentences and example sentences corresponding to the language card data for each trainer. Specifically, when the application button 122d is pressed, a screen for displaying a list of application sentence data of the language card data for each practice person is developed. The practitioner can select a desired application sentence from the list, and listen to the explanation sentence or example sentence by voice data. As a result, the practitioner can remember the application sentence in association with the word data. In order to delete the application sentence data list display screen, an end button on the screen may be pressed.
[0088]
The language card data selection area 123 is an area for displaying a list of language card data for each practicer in practice menu data and selecting desired language card data for each practicer. Specifically, numbers are assigned to the language card data for each practicer in the practice menu data in order from 1, and a list of the numbers is displayed. When there is a lot of language card data for each practitioner, as shown in the figure, a button for moving back and forth may be arranged above the number so that the list of numbers can be scrolled.
[0089]
The picture data display area 124 is an area for displaying picture data corresponding to the language card data for each trainer. Specifically, a picture of “cow” is displayed as shown. If the picture data display area 124 is clicked with a mouse or a dedicated pen or the like, the picture data that has been displayed may be hidden, and the picture data may be displayed when clicked again. As a result, in the state where the picture data is not displayed, the above-mentioned character button 122b is pushed and the picture data of “cow” is imagined from the displayed word data, or the above-mentioned listen button 122c is pushed and outputted. It is also possible to practice making “cow” picture data imagine from correct audio data.
[0090]
The end button is a button for ending the language recovery practice.
[0091]
The ST (abbreviation for Speech Language Healing Therapist) determination button is a button for determining whether the sound is heard or not by listening to the practice voice data recorded by the sound recording means 13 by the language auditor. Specifically, the language hearing person presses the confirmation button 121c in the input and confirmation area 121 to listen to the practice voice data, determines whether or not it is successful, and saves the result. As a result, even if the determination result display means 14 fails, the determination by the language hearing person can pass. The determination result (in this case, a pass) by the language auditor can also be stored in the practice menu and the practice result database 2. It should be noted that the determination result by the language auditor may be stored by overwriting the determination result (in this case, rejected) by the determination result display means 14.
[0092]
Next, FIG. 6 (A) is a diagram showing an example of the practice screen of the secondary device in one embodiment of the present invention, and FIG. 6 (B) is an example of the pass display in the result display area. FIG. 6C is a diagram showing an example of a failure display in the result display area. Here, an example will be described in which a practice screen is displayed on the display unit of the touch panel, and “cow” is selected from a plurality of language card data for each trainer.
[0093]
As shown in FIG. 6A, the practice screen 210 of the secondary machine is composed of an input and confirmation area 211, a character button 212, a language card data selection button 213, a picture data display area 214, a result display area 215, and a return button. Composed.
[0094]
The input and confirmation area 211 instructs the secondary device practice screen display means 20 to input practice voice data, instructs the secondary device recording means 21 to display the input level meter of the practice voice data, This is an area for instructing the recording means 21 to reproduce the recorded practice voice data. Specifically, it has a speaking button 211a, a level meter display field 211b, and a confirmation button 211c. After the speaking button 211a is pressed, the practice voice data is instructed to be input to the secondary device practice screen display means 20, and the practice voice data is inputted from the microphone. In the level meter display field 211b, an input level meter corresponding to the practice voice data recorded by the sub recorder recording means 21 is displayed. After the confirmation button 211c is pressed, the practice voice data recorded by the sub recording unit 21 is reproduced from the speaker. Thereby, the practitioner can confirm his / her pronunciation.
[0095]
Similar to the main machine, the instruction to input practice voice data on the sub-machine practice screen display means 20 may be automatically started without pressing the speaking button 211a.
[0096]
The character button 212 is a button for displaying word data corresponding to the language card data for each practice person and giving hints to the practice person. Specifically, when the touch panel is touched once with a finger or a dedicated pen, kanji characters are displayed (in this case, “cow”), and when touched again, hiragana characters (in this case, “ushi”) are displayed. Each time the touch panel is touched, kanji and hiragana are repeatedly displayed.
[0097]
The language card data selection button 213 is a button for moving the language card data for each trainer displayed to other language card data for each trainer. Specifically, when the left button is pressed once, the previous language card data for each trainer is displayed, and when the right button is pressed once, the language card data for the next trainer is displayed.
[0098]
The picture data display area 214 is an area for displaying picture data corresponding to the language card data for each trainer. The picture data display area 214 is also a button, and when the touch panel is touched, correct audio data is output. The correct voice data is a voice output of word data corresponding to the picture data. Specifically, a picture of “cow” is displayed in the picture data display area 214 as illustrated. When the area is touched with a finger, correct audio data corresponding to the picture data (in this case, audio data of “Ushi”) is output. If it is difficult to listen to the output sound, the speech speed of the output sound may be changed on the function setting screen of the secondary device. As with the main aircraft, changing the speed of sound does not change the pitch or sound quality.
[0099]
The result display area 215 is an area for displaying the result of the pass / fail determination. Thereby, the result display area 215 displays pass or fail, and informs the practitioner whether the word is correct and the pronunciation is correct. Specifically, when it is determined to be acceptable, a face as shown in FIG. 6 (B) is displayed, and when it is determined to be unacceptable, a face as shown in FIG. 6 (C). Is displayed. When displaying pass or fail, a sound (in this case, “ping-pong” if it passes or “boo” if it fails) may be output to notify the practitioner.
[0100]
The return button is a button for ending the language recovery practice.
[0101]
Although not shown, a head button may be provided in the same manner as the main unit so that voice data of the head of the word data corresponding to the language card data for each trainer may be output.
[0102]
Next, FIG. 7 is a processing flow diagram of language recovery practice on the main unit side in one embodiment of the present invention.
[0103]
First, the practice menu creation means 10 extracts language card data for each trainer suitable for the trainee from the language card database 1, and creates practice menu data for the main machine or the sub-machine (step S1). Then, the practice menu data is stored in the practice menu and practice result database 2 (step S2).
[0104]
Next, it is determined whether to transfer the practice menu data to the storage medium 5 (step S3). When not transferring (No of step S3), the process of step S4 mentioned later is performed. On the other hand, when transferring (Yes in step S3), the practice menu data transfer means 11 selects practice menu data for the sub-machine from the practice menu and practice result database 2 (step S14), and the storage medium 5 (Step S15), and all the processes related to language recovery practice on the main unit side are completed.
[0105]
Next, practice menu data for a desired main machine is selected from the practice menu and practice result database 2 by the practice screen display means 12 (step S4). Then, the practice screen 120 of the main machine is displayed (see FIG. 5), and desired language card data for each trainer is selected from the list of language card data for each trainer displayed in the language card data selection area 123 (step) S5). In the picture data display area 124 of the practice screen 120, picture data corresponding to the language card data for each practitioner is displayed, and recording of practice progress information is started (step S6).
[0106]
Next, the following processing is performed in response to pressing of each button on the practice screen 120.
[0107]
[In case of SW = Hint acquisition processing]
When a desired button in the hint acquisition area 122 is pressed, hint processing corresponding to the button is performed (step S7). Specifically, when the head button 122a is pressed, the voice data of the head of the language data corresponding to the language card data for each trainer is reproduced. When the character button 122b is pressed, the language data of the language card data for each trainer is displayed in kanji or hiragana notation. When the listen button 122c is pressed, correct voice data corresponding to the language card data for each trainer is output. The speaking speed of correct voice data can be increased or decreased according to the listening ability.
[0108]
Note that after obtaining these hints, the process returns to immediately before step S6, and the practice screen 120 is displayed. The hint may be continuously acquired until the word of the picture data is recognized.
[0109]
[In the case of SW = application sentence acquisition processing]
When the application button 122d in the hint acquisition area 122 is pressed, a list display screen of application text data is displayed. When a desired application sentence is selected from the list, audio data corresponding to the application sentence is output. The application sentence data selection and the voice data output are repeated until an end instruction is given.
[0110]
Note that after the end instruction is given, the process returns to immediately before step S6, and the practice screen 120 is displayed.
[0111]
[In case of SW = speaking process]
When the speaking button 121a in the input and confirmation area 121 is pressed, practice voice data input based on the picture data is started, and the recording means 13 is activated to record practice voice data corresponding to the picture data and practice voice. The data input level meter is displayed (step S9). Then, the determination result display means 14 compares the practice voice data with the correct pronunciation data to determine the pass / fail, and the determination result is displayed on the screen (step S10). Then, the practice result storage means 15 stores the practice result data in the practice menu and the practice result database 2 (step S11). The practice result data is practice audio data recorded between the practice voice data recorded in step S9, the determination result in step S10, and the pass / fail determination process in steps S6 to S10.
[0112]
Finally, it is determined whether or not to display the next language card data for each trainer on the practice screen 120 (step S12). If the next language card data for each practitioner is to be displayed (Yes in step S12), the process returns to immediately before step S5, and the language recovery practice is continued. On the other hand, when the next language card data for each practitioner is not displayed (No in step S12), it is further determined whether or not the end button of the practice screen 120 has been pressed (step S13). When the end button is not pressed (No in step S13), the process returns to the position immediately before step S5, and the language recovery practice is continued. On the other hand, when the end button is pressed (Yes in step S13), all the processes related to language recovery practice on the main unit side are ended.
[0113]
Next, FIG. 8 (A) is a flowchart of the process for registering the practitioner information according to the embodiment of the present invention, and FIG. 8 (B) is the process for registering the language card data. FIG.
[0114]
As shown in FIG. 8A, first, practitioner information such as the name of the practitioner and the onset time is input by the practitioner information creating means 16 (step S21). Then, it is determined whether or not the practitioner information can be registered (step S22). If there is a correction portion (No in step S22), the process returns to the step before step S21 to correct the return data. On the other hand, when registering (Yes in step S22), the practitioner information creating means 16 stores the practitioner information in the practitioner information database 3 (step S23).
[0115]
Although not shown, the trainer information creating means 16 may also perform processing for correcting or deleting the trainer information registered in the trainer information database.
[0116]
As shown in FIG. 8B, first, desired picture data is selected from the picture information database 4 by the language card creation means 17 of the main machine (step S31). Then, word data, correct voice data, etc. are set (step S32). Then, it is determined whether or not language card data can be registered (step S33). If there is a correction part (No in step S33), the process returns to the step before step S32 to correct the return data. On the other hand, when registering (Yes in Step S33), the language card creation means 17 stores the language card data in the language card database 1 (Step S34).
[0117]
Next, FIG. 9 is a processing flow diagram of language recovery practice of the secondary device in one embodiment of the present invention. When performing language recovery practice on the secondary machine, it is necessary to transfer the practice menu data for the secondary machine to the storage medium 5 in advance in the processing of step S14 and step S15 of FIG. is there.
[0118]
First, the practice menu data for the secondary machine is read from the storage medium 5 by the secondary machine practice screen display means 20 (step S41). Then, the practice screen 210 of the secondary machine is displayed (see FIG. 6A), and desired language card data for each trainer is selected using the language card data selection button 213 (step S42). In the picture data display area 214 of the practice screen 210, picture data corresponding to the language card data for each practitioner is displayed, and recording of practice progress information is started (step S43).
[0119]
Next, the following processing is performed in response to pressing of each button on the practice screen 210.
[0120]
[In case of SW = word data acquisition processing]
When the character button 212 is pressed, the word data included in the language card data for each practitioner is displayed in kanji notation or hiragana notation (step S44). In addition, after acquiring word data, a process returns to immediately before step S43 and the practice screen 210 is displayed. The word data may be continuously acquired until the word of the picture data can be recognized.
[0121]
[In case of SW = voice data acquisition processing]
When a part of the picture data display area 214 is pressed, correct voice data corresponding to the language card data for each trainer is output (step S45). The speaking speed of correct voice data can be increased or decreased according to the listening ability. The speech speed may be set on the secondary device setting screen before the language recovery practice is started.
[0122]
In addition, after acquiring correct audio | voice data, a process returns to immediately before step S43 and the practice screen 210 is displayed. You may continue acquiring audio | voice data until the word according to correct audio | voice data is recognized.
[0123]
[In case of SW = speaking process]
When the speaking button 211a in the input and confirmation area 211 is pressed, the practice voice data input based on the picture data is started, the secondary machine recording means 21 is activated, and the practice voice data is recorded according to the picture data, and The practice audio data input level meter is displayed (step S46). Then, the sub-device determination result display means 22 compares the practice voice data with the correct pronunciation data to determine pass / fail, and the determination result is displayed in the result display area 215 of the practice screen 210 (step S47). Then, the practice result data is saved in the storage medium 5 by the auxiliary machine practice result saving means 23 (step S48). The practice result data is the practice voice data recorded in step S46, the judgment result in step S47, or practice progress information performed during the pass / fail judgment process from step S43 to step S47.
[0124]
Next, it is determined whether or not to display the next language card data for each trainer on the practice screen 210 (step S49). When the next language card data for each practitioner is displayed (Yes in step S49), the process returns to immediately before step S42 and the language recovery practice is continued. On the other hand, when the next language card data for each trainer is not displayed (No in step S49), it is further determined whether or not data is transferred from the storage medium 5 to the main unit (step S50). When transferring (Yes in step S50), the practice result data saved in the storage medium 5 by the practice result saving means 15 is saved in the practice menu and the practice result database 2 (step S51), and the language recovery practice of the secondary machine is performed. Ends. On the other hand, when the transfer is not performed (No in step S50), the practice result data is not reflected on the main machine, and the language recovery practice ends.
[0125]
Although not shown, in the case of another example of language recovery practice as shown in FIG. 1 (B) or FIG. 3 (B), the practice voice data recorded in step S46 is stored. A process of converting to the data format of the determination result display means 14 is added. In step S48, the converted practice voice data is stored in the storage medium 5. The converted practice voice data is transferred to the determination result display means 14 before the process of step S51, and a pass / fail determination is made using the criteria of the main engine's pass / fail determination to create practice result data. Thereafter, the practice result data is stored in step S51, and the language recovery practice ends.
[0126]
Hereinafter, the management table using the practice menu data or the practice result data according to the embodiment of the present invention will be described in detail with reference to FIG. 10 to FIG.
[0127]
First, FIG. 10 is an example of a daily management table in which practice result data is displayed on a daily basis in one embodiment of the present invention.
[0128]
As shown in FIG. 10, the daily management table is a table in which the name of the practitioner, the date and time of practice, the language card data number and word data for each practitioner, and the practice result data are listed on a daily basis.
[0129]
Specifically, practice result data is the number of times the listen button was pressed, the number of times the button was pressed slowly at the speech speed of the voice data, the number of times the talk button was pressed, the number of times to pass, the score, and the beginning button The number of times of instructing hiragana notation, the number of times instructing kanji notation are shown. Since each item has been described above, it is omitted here. In the daily management table, the vertical axis represents the language card data for each trainer and the horizontal axis represents the practice result data in a matrix, and the total value of each item is calculated in the last row.
[0130]
Finally, FIG. 11 (A) is an example of a monthly management table in which practice result data in one embodiment of the present invention is displayed on a monthly basis, and FIG. 11 (B) shows a monthly management table. It is an example represented by a graph.
[0131]
As shown in FIG. 11 (A), the monthly management table calculates the total value and average number of times of the practice result data of the daily management table described above and displays them in the order of practice date. In the monthly management table, the vertical axis represents the date and time, the horizontal axis represents the practice result data in a matrix, and the total value of each item is calculated in the last row. Since each item has been described above, it is omitted here.
[0132]
As shown in FIG. 11 (B), the data in the monthly management table can be expressed in a form such as a bar graph or a line graph. Specifically, the data of the monthly management table of FIG. 11 (A) is extracted and stored in a storage unit, a storage medium or the like of a dedicated machine or a personal computer. Using the saved monthly management table data and an application capable of creating a graph, a graph as shown in the figure is created. Note that an application capable of creating a graph is installed in advance on a dedicated machine or a personal computer.
[Brief description of the drawings]
[0133]
FIG. 1 (A) is an example of a block diagram of a process for performing language recovery practice of a main machine and a sub machine in an embodiment of the present invention, and FIG. 1 (B) is a diagram of the present invention. it is a block diagram illustrating another example of intends rows language recovery practice the main unit and the sub-machine processing in the embodiment.
FIG. 2 (A) is a block diagram of a process for registering practitioner information according to one embodiment of the present invention, and FIG. 2 (B) is a diagram according to one embodiment of the present invention. It is a block diagram of the process which registers language card data.
FIG. 3 (A) is an example of a diagram for explaining the flow of data between the main unit and the sub unit in one embodiment of the present invention, and FIG. 3 (B) is an example of the present invention. It is another example of the figure explaining the flow of the data between the main machine in an embodiment, and a submachine.
FIG. 4 is a diagram showing an example of a practice menu creation screen of the main machine in one embodiment of the present invention.
FIG. 5 is a diagram showing an example of a practice screen of the main machine in one embodiment of the present invention.
FIG. 6 (A) is a diagram showing an example of a practice screen of a sub-machine in one embodiment of the present invention, and FIG. 6 (B) is a diagram in one embodiment of the present invention. It is the figure showing an example of the pass display of the result display area of a submachine, and FIG. 6 (C) is a figure showing an example of the failure display of the result display area of the submachine in one embodiment of this invention It is.
FIG. 7 is a processing flow diagram of language recovery practice of the main engine in an embodiment of the present invention.
FIG. 8 (A) is a process flow diagram for registering the trainee information in one embodiment of the present invention, and FIG. 8 (B) is a language card in one embodiment of the present invention. It is a processing flow figure of registration of data.
FIG. 9 is a processing flow diagram of language recovery practice of a sub-machine according to one embodiment of the present invention.
FIG. 10 is an example of a daily management table displaying practice result data in one day unit according to one embodiment of the present invention.
FIG. 11 (A) is an example of a monthly management table in which practice result data is displayed on a monthly basis in one embodiment of the present invention, and FIG. 11 (B) is an example of the present invention. It is an example which represented the monthly management table in embodiment with the graph.
[Explanation of symbols]
[0134]
DESCRIPTION OF SYMBOLS 1 Language card database 2 Practice menu and practice result database 3 Trainer information database 4 Picture information database 10 Practice menu creation means 11 Practice screen display means 12 Recording means 13 Judgment result display means 14 Practice result storage means 15 Practice person information creation means 16 Language card creation means 100 Practice menu creation screen 110 Practice screen

[General power of attorney number] 0304144

Claims (14)

Practice menu data is created by extracting language card data for each trainer according to each trainer from a language card database that manages language card data consisting of at least picture data, correct voice data, and word data. And a practice menu for managing practice result data and a practice menu creating means for storing the practice result data in a practice result database;
Practice menu data transfer means for extracting the practice menu data corresponding to the practice content from the practice menu and practice result database and transferring it to a storage medium;
The practice screen display means for extracting the desired practice menu data from the practice menu and the practice result database, and displaying at least the picture data of the language card data for each practice person,
Recording means for recording practice voice data based on the language card data for each trainer,
A judgment result display means for comparing the practice voice data and the correct voice data to determine pass / fail and displaying the determination result;
Practice result storage means for storing the judgment result and practice progress information from when the language card data for each trainer is displayed until the judgment of pass / fail is made as practice result data in the practice menu and the practice result database. A main machine equipped with
Sub-machine practice screen display means for accessing the storage medium storing the practice menu data and displaying at least the picture data of the language card data for each practice person,
Sub-unit recording means for recording practice voice data based on the language card data for each trainer,
Comparing the practice voice data and the correct voice data to determine pass / fail, and comprising a secondary machine equipped with secondary machine determination result display means for displaying the determination result,
The practice menu data transfer means transfers the practice menu data created by the main unit to the storage medium, and the sub-machine practice screen display means accesses the storage medium and the pictorial data of the language card data for each trainer. , Recording the practice voice data with the sub-machine recording means, and displaying the result of pass / fail determination with the sub-machine determination result display means. 2. The aphasia practice having a main machine and a secondary machine according to claim 1, wherein data relating to the practitioner input by the practitioner information creating means is stored in a practitioner information database managed for each practitioner. Support device. The main unit according to claim 1, wherein language card data is newly created by using the picture data or picture data in the picture information database by the language card creating means, and is additionally stored in the language card database. Aphasic practice support device with a secondary machine. The practice menu creating means creates the practice menu data for a main machine and a sub machine, and the practice menu data transfer means transfers the sub machine data to the storage medium. An aphasia practice support device having the main machine and the sub machine according to item 1. 2. The main machine and the sub machine according to claim 1, wherein the practice result storage means transfers the practice result data of the sub machine saved in the storage medium to the practice menu and the practice result database. An aphasia practice support device having The practice screen display means or the secondary device practice screen display means displays the picture data of the language card data for each trainer, starts recording the practice progress information, and inputs practice sound based on the picture data. 2. The aphasia practice having a main machine and a sub machine according to claim 1, wherein the recording means or the sub machine recording means records the practice voice and displays an input level meter of the practice voice. Support device. While displaying the picture data of the language card data for each trainer by the practice screen display unit or the sub-device practice screen display unit, the correct voice data is output by changing the speech speed. An aphasia practice support device comprising the main machine and the sub machine according to claim 1. Voice data at the beginning of the word data is output while the picture data of the language card data for each trainer is displayed by the practice screen display means or the sub-machine practice screen display means. An aphasia practice support device comprising the main machine and the sub machine according to claim 1. The word data is displayed while the picture data of the language card data for each trainer is displayed by the practice screen display means or the sub-equipment practice screen display means. An aphasia practice support device having a main machine and a sub machine having the main machine and the sub machine described in the paragraph. 2. The main machine according to claim 1, wherein the practice menu creating unit sets a criterion for pass / fail determination of the determination result display unit or the sub-device determination result display unit according to each practitioner. Aphasia practice support device with a secondary machine. 2. The aphasia practice support apparatus having a main machine and a sub machine according to claim 1, wherein the language card database is stored in units of words corresponding to the picture data. 2. The aphasia practice support apparatus having a main machine and a sub machine according to claim 1, wherein the practice menu database manages the practice menu data separately for each trainer. Sub-equipment practice result storage means for storing the determination result and practice progress information from when the language card data for each trainer is displayed until the determination of pass / fail is made into practice result data; The practice result data is stored in the storage medium by the sub-equipment practice result saving means, and the practice result data in the storage medium is saved in the practice menu and the practice result database by the practice result saving means. An aphasia practice support device comprising the main machine and the sub machine according to claim 1. The practice voice data of the sub-recording means is stored in the storage medium, the judgment result display means determines whether the practice voice data of the storage medium is acceptable, and the practice result storage means is the practice menu and the practice result. The aphasia practice support apparatus having a main machine and a sub machine according to claim 1, wherein the aphasia practice support apparatus is stored in a database.

Images