JP3956115B2 - Utterance language learning device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an utterance type language learning device that can determine an action from a learner's movement in a room, utter an expression (example sentence) corresponding to the action in a specific language, and perform language learning. About.
[0002]
[Prior art]
For example, various methods are conventionally used for language learning, such as when a Japanese learns conversations in other languages such as English. More specifically, the language learning text is divided into multiple levels from beginners to advanced students, and at each level, the names of various articles are listed for the language to be learned, walking, sitting, Examples of various behavioral aspects such as sleeping, etc., classifying various scenes in life such as listening to the road, shopping, riding on vehicles, etc., and illustrating typical words used in the scenes, Furthermore, various example sentences are shown.
[0003]
Moreover, in learning these conversations, in addition to the above text, a teacher's voice is recorded on a cassette tape, and learning is performed along the text while listening to it. In addition, students are taught along the teacher's curriculum while facing the teacher like an English conversation school.
[0004]
[Problems to be solved by the invention]
Each of the various language learning methods described above can be carried out according to some text and curriculum, and while systematic learning is possible, the language is used by learners, especially in conversational learning. It is necessary to learn while imagining the situation, and for those who learn, imagination is required in addition to language learning ability. For this reason, the learning effect differs depending on the difference in the learner's social experience and imagination. In particular, the range of imagination is narrow because children do not have much experience, and appropriate learning is not possible with such learning methods. Often not done.
[0005]
In addition, there is also a method in which a means for supplementing a learner's imagination using video is used, such as a learning method performed by exemplifying a situation where the words are actually used on a television or a video tape. However, because it is not the state that the learner is actually experiencing, it is not always possible to feel the words with the body, and in this case, too, learning must be done while imagining that you are on the spot In addition, since only predetermined words according to the text as described above are used, it is not possible to know words of various modes according to the situation, and there is a limit to such a learning method. .
[0006]
In addition, when learning English conversation while talking with a teacher, you should learn as close as possible to the state in which the language is used by forming a scene where the English is used with the teacher. Is done. However, even this method does not necessarily match the actual scene, and it must be learned while imagining that it is in such a scene. Moreover, since such a learning method requires a teacher who forms the scene, the learner has no choice but to go to the school where the teacher is located or have the teacher come to the school. Therefore, this learning takes a lot of time or costs a lot.
[0007]
The present invention has been made in order to solve such problems, and the object of the present invention is to allow the learner to speak directly with his / her own actions at any time without the help of others such as teachers. It is an object to provide an utterance type language learning device that can learn and perform effective language learning.
[0008]
[Means for Solving the Problems]
In order to achieve the above object, an utterance type language learning device according to the present invention has, as a basic configuration, an action determination device that detects a learner's body movement in a living room and determines the learner's behavior; A language learning processing device that outputs language learning data related to a learner's behavior based on the behavior determined by the behavior determination device, and a speech processing device that utters the output data of the language learning processing device. Get .
[0009]
this In the utterance type language learning device, the behavior determination device performs three-dimensional position measurement on an instrument held by the learner or a learner's body (a specific part or a plurality of places such as a hand), The movement of the spatial position of the learner's body is detected, and the behavior of the learner is determined in accordance with the movement of the device held by the learner or the spatial position of the learner's body. For example, a motion capture system that captures movement using a light reflector attached to a part of the learner's body can be used.
[0010]
Further, the behavior determination device here performs three-dimensional position measurement by a signal from a signal transmitter attached to the instrument operated by the learner, detects the movement of the spatial position of the instrument operated by the learner, It is good also as what judges a learner's action corresponding to the motion of the spatial position of the appliance which the learner who detected detects.
[0011]
Similarly, the behavior determination device performs three-dimensional position measurement on a predetermined part of the learner's body, detects a movement of the spatial position of the predetermined part, and detects the movement of the spatial position of the predetermined part of the learner. Correspondingly, the learner's behavior may be determined.
[0012]
In addition, the behavior determination device Characteristically, Transmitting and receiving signals with signal transmitters attached to instruments held by learners or signal receivers attached to instruments held by learners, and signal transmitters or receivers placed in living rooms Thus, the movement of the spatial position of the appliance is detected, and the behavior of the learner is determined in response to the movement of the spatial location of the appliance.
[0013]
In addition, the behavior determination device performs a three-dimensional position measurement on the instrument held by the learner or the learner's body, detects a movement of a spatial position of the instrument held by the learner or the learner's body, and the detection The learner can also be configured to determine the learner's behavior in response to the movement of the instrument held by the learner or the spatial position of the learner's body.
[0014]
Also, this In the utterance type language learning device, the behavior determination device uses the signal received by the receiver that receives the signal transmitted from the signal transmitter attached to the instrument operated by the learner at a plurality of locations in the room, of the instrument. The movement of the spatial position is detected, and the behavior of the learner can be determined in response to the movement of the spatial position of the appliance.
[0015]
this In the utterance type language learning device, the behavior determination device uses the signal received by the receiver that receives the signal transmitted from the signal transmitter attached to the learner's body at a plurality of locations in the room, to determine the body of the learner. The movement of the spatial position of the learner is detected, and the behavior of the learner can be determined in response to the movement of the spatial position of the learner's body.
[0016]
Another feature is that In the utterance type language learning device of the present invention, the behavior determination device is attached to the first signal transmitted from the first signal transmitter attached to the learner's body and the instrument held by the learner. The movement of the spatial position of the learner's body and instrument is detected by a signal received by a receiver that receives the second signal transmitted from the second signal transmitter at a plurality of locations in the room. Yes, the learner's behavior can be determined in accordance with the movement of the learner's body and the spatial position of the appliance.
[0017]
this In the utterance type language learning device, the language learning processing device includes a learning level setting unit for setting the learning level of the learner, Based on the behavior pattern of the determination result from the behavior determination device, according to the learning level set in the learning level setting unit, the example sentence stored in advance in each learning level in the behavior / example sentence database is searched to obtain the learning level. Output combined example sentences as language learning data Can be.
[0018]
this In the utterance type language learning device, the language learning processing device includes a language dictionary of a plurality of languages and a learning language selection instruction unit, Based on the behavior pattern of the determination result from the behavior determination device, search the stored example sentence in the action / example sentence database, and translate the searched example sentence into the language to be learned instructed by the learning language selection instruction unit As language learning data based on the language dictionary Can be output.
[0019]
Also, this In the utterance type language learning device, the behavior determination device is A state in which the spatial position of the instrument is the same for a predetermined time The language learning processing device Output the same learning data as the language learning data output immediately before Can be.
[0020]
Also, this In the utterance type language learning device, the behavior determination device is A state in which the spatial position of the instrument is the same for a predetermined time The language learning processing device Based on the language dictionary, the language example data of the language output data output immediately before is translated into the language of the native language set in advance according to the learner. Can be output.
[0021]
Also, this In the utterance type language learning device, the behavior determination device is A state in which the spatial position of the instrument is the same for a predetermined time The language learning processing device Example sentences of language learning data output just before Can be registered.
[0022]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a system configuration of a block showing the main functions of an utterance type language learning apparatus according to the present invention and their relationship. In FIG. 1, 1 is a three-dimensional position measurement device, 2 is a behavior determination device, 3 is a language learning processing device, 4 is a speech processing device, 6 is a first ultrasonic receiver, and 7 is a second ultrasonic reception. , 8 is a third ultrasonic receiver, 9 is a three-dimensional position measurement unit, 10 is a movement / behavior database, 13 is a learning level setting unit, 14 is an example sentence formation unit for language learning, 15 is a dictionary search unit, 16 Is a specific language translation unit, 17 is a level setting instruction unit, 18 is an action / example sentence database, 19 is a language dictionary database, 20 is a learning language selection instruction unit, and 21 is a speaker.
[0023]
The overall system configuration includes ultrasonic receivers 6, 7, and 8 installed at a plurality of locations in the room and a three-dimensional position measuring unit 9 that measures a three-dimensional position using received signals from the ultrasonic receiver. 3D position measuring device 1, behavior determination device for determining learner's behavior from movement of 3D position measured on instrument held by learner or part of learner's body (predetermined part of body such as hand) 2. A system composed of a language learning processing device 3 that generates and outputs example sentences according to action determination, and a speech processing unit 4 for uttering example sentences.
[0024]
For example, as shown in FIG. 2, the three-dimensional position measuring apparatus 1 includes ultrasonic receivers 6, 7, and 8 installed in a plurality of locations on the ceiling of a living room, and the ultrasonic receivers 6, 7, and 8. And a three-dimensional position measuring unit 9 that measures a three-dimensional position by a received signal. The signals received by the ultrasonic receivers 6, 7, and 8 here are signals transmitted from a signal transmitter 30 attached to a part of the learner's hand or the learner's body. . As will be described later, when a plurality of signal transmitters (30, 31, 32) are provided, the ultrasonic frequencies transmitted from the respective signal transmitters are differentiated or distinguished from each other. Include information to distinguish each. When the signals transmitted by the signal transmitter are received by the three ultrasonic receivers 6, 7, and 8, for example, the three-dimensional position is measured from the phase difference of the received signals. The measurement of the three-dimensional position is performed at a predetermined time interval (for example, about 50 times per second). By continuously measuring the change in the three-dimensional position, a series of movements of the three-dimensional position ( Time-series data of three-dimensional coordinate values) is measured.
[0025]
As shown in FIG. 2, for example, when the learner 5 raises the cup placed on the table, the signals transmitted from the signal transmitter 30 attached to the cup are both ultrasonic receivers 6. , 7, 8 and processed by the three-dimensional position measurement unit 9, a series of movements of the measured three-dimensional position (time-series data of the three-dimensional position) is input to the behavior determination device 2. The behavior determination device 2 determines the movement of the cup from the time-series data of the three-dimensional position continuously input from the three-dimensional position measurement unit 9 at predetermined time intervals. For example, the learner 5 is placed on the table. Determine that you have taken action to lift the cup.
[0026]
That is, as shown in FIG. 7, the coordinate values of the three-dimensional space of the surface of the table placed in the room are registered in advance, and the space area (coordinate values) of the surface position of the three-dimensional space of this table is registered. It is determined that the position (coordinate value) of the cup has entered the region of the spatial position above it, and it is determined that the learner 5 has acted to lift the cup placed on the table. At this time, for example, as shown in FIG. 3, if the signal from the signal transmitter 31 attached to the wrist (finger) of the learner 5 is received, the three-dimensional position of the wrist is By approaching the three-dimensional position of the cup and determining that both the three-dimensional position of the wrist and the three-dimensional position of the cup are in the same spatial region, the learner 5 puts the cup placed on the table more accurately. It can be determined that a lifting action has occurred. As will be described later, the determination process of the learner's action by the action determination device 2 is based on the data (coordinate value) of the movement and the action based on the data (coordinate value) of the three-dimensional space. Since it is stored in the behavior database 10, this data is referred to (FIG. 8).
[0027]
The action determination result thus determined is assigned a determination identification code, is output from the action determination device 2, and is input to the language learning processing device 3. For example, if a learner's action is walking, sitting, pointing to something, holding something, etc., the learner's hand (such as a cup) or the learner's body Are determined as respective action patterns from the time-series data of the movement of a part (wrist) of the three-dimensional position.
[0028]
When the behavior of the learner is determined as a behavior pattern by the processing of the behavior determination device 2, the language learning processing device 3 applies the behavior of the learner and related objects (instruments) in accordance with the behavior pattern. For related example sentences, a process for outputting words for language learning is performed. In the illustrated embodiment, the language learning processing device 3 includes a learning level setting unit 13, a language learning example sentence forming unit 14, a dictionary search unit 15, and a specific language translation unit 16 as main function units.
[0029]
The learning level setting unit 13 performs setting according to the learning level of the learner who uses the language learning processing device 3 by operating a learning level setting operation unit 17 provided outside the device. In the behavior determination device 2, even if the behavior pattern determination of the learner 5 is the same, the form of the example sentence for language learning to be output can be changed according to the level of the learner. As a result, for example, as shown in FIG. 2, when it is determined that the learner 5 has lifted the coffee cup on the table, in the language learning device 3, when the learning level is set to the beginner level, By performing the process described later, for example, the words “This is a cup” and “You are watching the cup” are finally spoken in the language you are learning, such as English or French. In addition, when the intermediate level is set, a relatively complicated example sentence such as “You are sitting on a chair and lifting a cup on the table” is uttered.
[0030]
In the language learning example sentence formation unit 14, based on the behavior pattern of the determination result from the behavior determination device 2 input to the language learning processing device 3, and in accordance with the learning level set by the learning level setting unit 13. , Form example sentences to be output. In forming the example sentence, as shown in FIG. 9, various example sentences stored in advance in the behavior / example sentence database 18 for each learning level are used to retrieve the example sentence that matches the level as described above. By doing.
[0031]
After the example sentence to be output is determined, the specific language translation unit 16 performs translation into a specific language such as English or French, which is the language to be learned, instructed by the learning language selection instruction unit 20. At the time of this translation, the dictionary search unit 15 searches the data stored in the language dictionary database 19 for the example sentence formed by the language learning example sentence forming unit 14 and for the language specified by the learning language selection instruction unit 20. While doing. As described above, the translated example sentence is converted into speech by the speech processing apparatus 4 and output from the speaker 21.
[0032]
By describing such a series of processes, for example, corresponding to the example of FIG. 2, the process proceeds according to a process as illustrated as an example of the language learning process in the right column of FIG. When the learner 5 takes an action such as picking up a coffee cup on the table, the learner's 5 action is composed of a plurality of signal receivers (6, 7, 8) and a three-dimensional position measuring unit 9. Is detected as time-series data of the three-dimensional position coordinate value by the three-dimensional position measuring device 1, and is stored in the movement / behavior database 10 in the behavior determination device 2, The action is determined and an action pattern is output.
[0033]
Next, based on the output action pattern, the language learning processing device 3 searches for an example of the action and object (equipment) accumulated according to the learning level, and translates it into a predetermined language. Next, the voice processed by the voice processing device 4 is output from the speaker 21 as, for example, “This is a cup. You are looking at a cup.”. Thereby, the learner can hear and understand the example sentence with an actual feeling of the English for the action he / she has performed, and can improve the learning effect. Further, in the above-described embodiment, it is possible to learn a desired language using the same device by preparing a dictionary of languages of many countries in advance.
[0034]
By using such a language learning device, in addition to the example shown in FIG. 2, for example, as shown in FIG. 3, even when the learner 5 is sitting on a chair, Detected as time-series data (motion) of three-dimensional position coordinate values by a three-dimensional position measuring device 1 constituted by a signal receiver (6, 7, 8) and a three-dimensional position measuring unit 9, and moves in the action determination device 2 The action pattern is determined from the movement of the learner 5 with reference to the data stored in the action database 10.
[0035]
When the language learning device 3 is at a beginner level and the learning language is set to English, the speaker 21 automatically utters “You sat down on the seat!”. Also, as shown in FIG. 4, when the learner 5 is walking (behavior pattern) can be determined by the time-series data (coordinate values) of the three-dimensional position, “You are walking!” Is uttered. In addition, as shown in FIG. 5, when the learner 5 holds the TV remote control and determines that the switch is turned on (not shown, the TV 5 is turned on by a separately provided sensor). In this case, it is possible to say "You turned on the television!" Furthermore, when the learner determines the action of moving to the bed as shown in FIG. 6, he / she utters “You want to bed!”. The determination of such an action pattern is that the spatial position of the bed is registered in advance as a three-dimensional coordinate value, and the coordinate value of the three-dimensional position of a part of the body of the learner 5 has approached the bed. Is done.
[0036]
Further, in the behavior determination device 2, when it is determined that the learner's behavior has been stopped for a while, the pronunciation is repeated again as necessary, and the similar behavior is taken as necessary. If the learner is Japanese, it can be pronounced in the learner's native language such as Japanese. Also, for example, when a learner operates a language learning device (for example, by operating a remote controller) and inputs that the previous word could not be understood, the same re-pronunciation and native language are used. It is also possible to repeat the pronunciation of the sound.
[0037]
In addition, when such an action is taken that the learner cannot understand, or when an input to that effect is made, the learner tends to have difficulty in understanding such a word, and this word is registered in the memory. After that, when the same action is taken, efficient learning can be performed such as preferentially outputting the registered words. Furthermore, if necessary, the words output from the speakers can be displayed on a separate display device.
[0038]
In the embodiment shown in FIG. 1, the language learning processing device 3 includes a language dictionary database 19 of a plurality of languages, and an example of performing translation into a specific language selected by the learning language selection instruction unit 20 is shown. For example, when this language learning device is dedicated to learning English, the language dictionary database 19 may include only an English dictionary database, and the learning language selection instruction unit 20 may be omitted.
[0039]
In addition, as the action determination device 2, the signal transmitter attached to the instrument held by the learner and the signal receiver placed in the living room, or the signal reception of the instrument held by the learner is held. The movement of the spatial position of the appliance may be detected by the signal transmission / reception processing by the combination of the machine and the signal transmitter placed in the room, and the spatial position of the appliance in that case It may be possible to determine the behavior of the learner in response to the movement.
[0040]
Specifically, the behavior determination device 2 is a three-dimensional position measuring device such as an ultrasonic type, a magnetic type, or an optical type, a device that detects a motion such as an acceleration sensor, a switch, a contact sensor, an IC tag, or the like. By using a device that can detect a change, the movement of the learner's body, the movement of the spatial position of the instrument, and the change may be detected. That is, in this case, what is necessary is just to be able to determine the learner's behavior corresponding to the movement or change in the spatial position of the learner's body or instrument.
[0041]
In the description of the above-described embodiment, the behavior determination device 2 measures the spatial position by the three-dimensional position measurement device 1, but instead of this, a signal transmitter attached to the learner's body or the learner The movement of the spatial position of the learner's body may be detected by transmission / reception of a signal by a signal receiver attached to the body and a signal transmitter or signal receiver placed in the room. In that case, the behavior determination device 2 determines the behavior of the learner in response to the movement of the spatial position of the learner's body.
[0042]
In addition, when the motion capture system is used instead of the measurement of the spatial position (three-dimensional position) by the ultrasonic transmitter / receiver as the action determination device 2, the learner's hand or the learner's body is measured with the three-dimensional position measurement. And the movement of the spatial position of the device held by the learner or the learner's body can be detected. Therefore, the learner's action can be determined corresponding to the movement of the spatial position of the appliance or the learner's body that the detected learner has.
[0043]
In addition, as described above, it is possible to detect a change in position such as a three-dimensional position measuring device such as an ultrasonic type, a magnetic type, or an optical type, a device that detects a motion such as an acceleration sensor, a switch, a contact sensor, or an IC tag. By using these devices, attaching them to the body of the learner's hand or the learner, and detecting signals with the receiving device or transmitting device provided on the ceiling, wall surface, etc. of the living room, Detects movements of the learner's hand and the spatial position of the learner's body by performing signal transmission / reception processing between them, and the detected learner's hand and the learner's body spatial position It is also possible to determine the learner's behavior in response to the movement of. Thereby, a learner's action can be determined with high precision.
[0044]
The behavior determination device 2 transmits and receives signals by a signal transmitter or signal receiver attached to a learner's hand or a learner's body, and a signal transmitter or signal receiver placed in a living room. It may be used to determine the learner's movement. In that case, the learner's behavior can be determined in accordance with the movement of the instrument held by the learner or the spatial position of the learner's body.
[0045]
In addition, the behavior determination device 2 moves the spatial position of the appliance by a signal received by a receiver that receives signals transmitted from a signal transmitter attached to the appliance operated by the learner at a plurality of locations in the room. It is good also as what detects a learner's action corresponding to the motion of the spatial position of an instrument. Thus, the behavior determination device 2 can be variously modified.
[0046]
【The invention's effect】
Since the present invention is configured as described above, the learner's behavior is determined, the words related to the behavior are uttered, and the learner can directly speak directly on the body without the help of other people such as a teacher. Can understand effective language learning.
[Brief description of the drawings]
BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a diagram showing a system configuration by a block showing the main functions of an utterance type language learning apparatus according to the present invention and their relationship.
FIG. 2 is a schematic diagram showing a learning mode using a language learning device according to the present invention.
FIG. 3 is a schematic diagram showing another aspect of learning using the language learning device according to the present invention.
FIG. 4 is a schematic diagram showing another aspect of learning using the language learning device according to the present invention.
FIG. 5 is a schematic diagram showing another mode of learning using the language learning device according to the present invention.
FIG. 6 is a schematic diagram showing another mode of learning using the language learning device according to the present invention.
FIG. 7 is a diagram schematically illustrating the operation of the behavior determination device according to the present invention.
FIG. 8 is a diagram for explaining a specific example of a motion / behavior database of the behavior determination apparatus according to the present invention.
FIG. 9 is a diagram illustrating a specific example of an action / example sentence database of the language learning device according to the present invention.
[Explanation of symbols]
1 ... 3D position measuring device,
2 ... Action determination device,
3. Language learning processing device,
4 ... voice processing device,
5 ... Learner
6 ... first ultrasonic receiver,
7: Second ultrasonic receiver,
8 ... Third ultrasonic receiver,
9 ... 3D position measurement unit,
10 ... Movement / Behavior Database,
13 ... Learning level setting section,
14 ... Language learning example sentence formation part,
15 ... Dictionary search section,
16 ... specific language translation department,
17 ... Level setting instruction section,
18 ... Behavior / Example sentence database,
19 ... Language dictionary database,
20 ... Learning language selection instruction section,
21 ... Speaker
30, 31, 32 ... Signal transmitter

Claims (7)

An action determination device for detecting the movement of the learner's body in the room and determining the learner's action;
A language learning processing device that outputs language learning data related to a learner's behavior according to the behavior determined by the behavior determination device;
An utterance type language learning device comprising: a speech processing device that synthesizes language learning data of the language learning processing device;
The behavior determination device includes a signal transmitter attached to an instrument held by a learner or a signal receiver attached to an instrument held by a learner, and a signal transmitter or signal placed in a living room. An utterance type language learning apparatus for detecting movement of a spatial position of the appliance by transmitting and receiving a signal by a receiver, and determining a learner's action corresponding to the movement of the spatial position of the appliance. . An action determination device for detecting the movement of the learner's body in the room and determining the learner's action;
A language learning processing device that outputs language learning data related to a learner's behavior according to the behavior determined by the behavior determination device;
An utterance type language learning device comprising: a speech processing device that synthesizes language learning data of the language learning processing device;
The behavior determination device transmits a first signal transmitted from a first signal transmitter attached to a learner's body and a second signal transmitter attached to an instrument held by the learner. The movement of spatial positions of the learner's body and equipment is detected by signals received by receivers that receive the second signal thus obtained at a plurality of locations in the room, and the learner's body and equipment The utterance type language learning device according to claim 1, wherein the behavior of the learner is determined in accordance with the movement of the spatial position. The language learning processing device includes a learning level setting unit for setting a learner's learning level,
Based on the behavior pattern of the determination result from the behavior determination device, according to the learning level set by the learning level setting unit, searches for an example sentence stored in advance in the behavior / example sentence database for each learning level, The utterance type language learning apparatus according to claim 1, wherein an example sentence adapted to is output as language learning data. The language learning processing device includes a language dictionary of a plurality of languages and a learning language selection instruction unit,
Based on the action pattern of the determination result from the action determination device, the stored example sentence is searched in the action / example sentence database, and the searched example sentence is designated as the language to be learned instructed by the learning language selection instruction unit. The utterance type language learning apparatus according to claim 1, wherein the translation is performed based on the language dictionary and output as language learning data. When the behavior determination device determines a state in which the spatial position of the appliance is the same position for a predetermined time,
The utterance type language learning device according to claim 1, wherein the language learning processing device outputs the same learning data as the language learning data output immediately before. When the behavior determination device determines a state in which the spatial position of the appliance is the same position for a predetermined time,
The language learning processing device translates an example sentence of the language learning data output immediately before according to a learner into a native language set in advance based on a language dictionary, and outputs it as language learning data The utterance type language learning apparatus according to claim 1, wherein: When the behavior determination device determines a state in which the spatial position of the appliance is the same position for a predetermined time,
3. The utterance type language learning device according to claim 1, wherein the language learning processing device registers an example sentence of language learning data output immediately before.

Images