JPH04348382A - Information processor and english conversation learning system using the same - Google Patents

Abstract

PURPOSE:To save the storage space of a moving picture data storage means by reading moving picture data of a next step according to selection information and projecting them on a projection means. CONSTITUTION:Optional information in branch information is selected by using an input means 16 and then the moving picture data 12 in the next step are read out of the moving picture data storage means 13 and projected on the projection means 15. The selection information on the moving picture data is stored in a search information storage means 14 and after a scenario is completed, the same scenario is reproduced according to the selection information. Learners learn English conversations of courseware individually normally through student computers 210, 220, and 230. Further, the learners who have conversation ability of certain level by the individual learning make a two-way communication with an instructor computer 240 by using hot-line functions provided to the student computers 210, 220, and 230 to have direct communication learning with a native instructor.

Description

[Detailed description of the invention]

0001

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an educational information processing device compatible with multimedia.

0002

2. Description of the Related Art Educational equipment using computers (hereinafter referred to as CAI equipment) has been attracting attention. The reason for this is that by taking advantage of the features of computers, it becomes possible to provide individualized education and experience-based education, which would be difficult in group education.

[0003] Since such CAI devices advance learning in an interactive manner, it is possible to select a curriculum that suits one's own progress. In other words, you can repeat the parts you don't understand as many times as you like, and you can skip the parts you fully understand. In this way, by using CAI equipment, it becomes possible to perform optimal learning on a schedule that matches the individual's progress. In particular, with the recent spread of computers, CAI equipment has begun to be used in many schools and companies.

0004

[Problems to be Solved by the Invention] Incidentally, recent information processing devices have increasingly large capacities of memory and disk devices, and are now able to handle not only text data and still images, but also information such as audio data and video data. It has become. Consideration has begun to be given to the use of audio data and video data in CAI devices as well. Among these data, audio data has become easier to handle due to increased capacity of hard disk drives. For example, e-mail systems that transfer voice data from a student's computer to a teacher's computer are already in practical use. However, since the amount of video data is much larger than that of audio data, it cannot be handled satisfactorily even with a large capacity video disc device, CD-ROM, or the like. In particular, with CAI equipment, it is necessary to create a number of optimal curriculums tailored to each individual's level and progress. In this way, the amount of video data that must be prepared for each curriculum becomes extremely large, which poses a problem.

[0005] An object of the present invention is to solve such problems.

[0006]

[Means for Solving the Problems] In order to solve the above problems, the information processing device of the present invention is divided into groups for each step that constitutes a scenario, and can be combined to create several scenarios. A part of the video data includes branch information for moving to the next step, a video data storage means storing the video data, a projection means for projecting the video data, and branch information included in the video data. An input means for selecting arbitrary information from among them and inputting the selected information; a search information storage means for storing the selection information input from the input means; and a search information storage means for storing the selection information input from the input means. The video data of the step is read out from the video data storage means and projected on the projection means, or the selection information stored in the search information storage means is read out and the video data of the next step is read out from the video data storage means based on this selection information. and control means for projecting the image onto the projection means.

[0007]

According to the information processing apparatus of the present invention, branch information for proceeding to the next step is displayed in part of the moving image data displayed on the display means based on a command from the control means. When arbitrary information is selected from this branch information using the input means, the control means issues a command to proceed to the next step based on this selection information. In response to this command, moving image data for the next step is read out from the moving image data storage means and displayed on the projection means. When the selection is completed up to the last step in this way, the total is 1
The book scenario is completed. Further, since the selection information of this image data is stored in the search information storage means, the same scenario can be reproduced based on this selection information at any time after the scenario is completed.

[0008]

DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to FIGS. 1 to 5 of the accompanying drawings.

FIG. 1 is a block diagram showing an information processing apparatus according to an embodiment of the present invention. This information processing device can create several scenarios by being combined with the CPU 11, which is a control means, and stores video data 12 grouped by steps constituting the scenario, and this video data 12 and audio data. A video disk device 13 which is a moving image data storage means, a storage device 14 which is a search information storage means in which the order of searching the moving image data 12 is stored, and a display device 15 which is a projection means for projecting the moving image data 12. It is composed of an input means 16 for selecting arbitrary information from branch information for moving to the next step included in a part of the video data 12 and inputting this selection information, and a speaker 19 for outputting audio data. be done. A keyboard 17 and a mouse 18 are used as the input means 16. The video disc device 13 also includes a laser disc device or a C
A D-ROM device is used.

Next, FIGS. 1, 2(a)(b) and 3(
The operation of this embodiment will be explained using a). In this embodiment, the display device 15 is
The moving image data 21 of the first step is projected. This video data 21 is a short story in English of approximately 3 minutes, and at the end of the story, branch information 22 for selecting the video data for the second step is displayed over the video data 21 (see Figure 2 (a)). ). This branch information 22 is the question "May I help you?" and 3
``check in reserve''
ion? ”, “need room”, “belie
ve have reservation”. The video disc device 13 is prepared with second step video data with different story developments corresponding to each selection. Further, at the same time as the branch information 22 is displayed, the speaker device 19 outputs the question and the choices by voice. When, for example, "need room" is input from the keyboard 17 as an answer to this question, the moving image data 23 corresponding to the selection option is selected from among the plurality of second step moving image data and projected on the display device 15. In the second step, a short story in English is also developed. The story of this second step is continuous with the story of the first step. Then, at the end of the story of the second step, branch information 24 for selecting the video data of the third step is displayed superimposed on the video data 23 (FIG. 2(b)
reference). This branch information 24 is based on the question "on cre
dit card? ” and three choices “travel
ler's check", "cash", "yes
”. If, for example, "traveller's check" is selected as an answer to this question, the video data 25 of the third step is projected on the display device 15 (see FIG. 3(a)). When the video data up to the third step is selected in this way, an English conversation scenario with a complete story is completed. The selection information of the selected moving image data is stored in the storage device 14 at the same time as the answer is input from the keyboard 17. After the scenario is completed, the selection information in the storage device 14 can be used to automatically sequentially project the moving image data selected at each step. Specifically, when a re-execution request is input from the keyboard 17, the control device 11 is activated by this input signal. The control device 11 reads the selection information from the storage device 14 and controls the video disc device 1 according to the order of the selection information.
The video data of No. 3 is sequentially projected onto the display device 15.

Next, the structure of moving image data stored in the video disk device 13 will be explained using FIGS. 4 and 5.

FIG. 4 is a flowchart of processing of moving image data that can be selected for each step. In this example, 7
Video data 101 to 107 of the book are used. Dividing it into steps, the first step is video data 101, and the second step is video data 102 to 105.
However, in the third step, video data 106 to 107
are used respectively. In this example, video data 1
By changing the combinations of 01 to 107, a total of seven scenarios can be created. In this embodiment, a scenario is constructed from video data of three steps, but by increasing the number of steps, dozens of scenarios can be created.

Video data 101 to 107 are stored in a video disk device 13 shown in FIG. In this embodiment, the storage method is devised to shorten the disk access time. In other words, if certain video data has already been stored, the video data to be stored next will be selected if there is continuous video data in the same step; otherwise, the next video data that can be selected will be selected. It is selected from the video data of the steps. in particular,
From the first step, moving image data with consecutive stories (moving image data 101→102→105→106) are selected in order and stored in the video disc device 13. After the final step has been stored, the process returns to the first step, and the unstored video data (video data 103, 107, 104) are stored in order from the first step. By adjusting the storage order, the probability that adjacent video data on the disk will be selected in sequence increases, and the access time for each video data is reduced.

Next, the features of this embodiment will be described. A feature of this embodiment is that the storage space of the video disc device 13 required for storing moving image data can be significantly reduced. In other words, even though it appears that video data for dozens of scenarios is stored, what is actually stored is only multiple video data that has been broken up into pieces for each step. With the configuration of this embodiment, video data for dozens of scenarios with a large amount of data can be created by combining multiple pieces of video data with a small amount of data.
The storage space on the video disc device 13 is significantly reduced.

Next, an embodiment of an English conversation learning system using the information processing apparatus of the present invention will be described with reference to FIGS. 6 and 7 of the accompanying drawings.

FIG. 6 is a block diagram of an English conversation learning system according to an embodiment of the present invention. The English conversation learning system of this embodiment is comprised of student computers 210, 220, and 230, which are the aforementioned information processing devices, and an instructor computer 240 connected to each student computer by a line. The student computers 210 to 230 are installed in soundproof rooms 211 and 221 equipped with independent soundproofing equipment.
231. In addition, student computer 2
10 to 230 have a built-in CAI program for individually learning English conversation using the video data described above. Furthermore, the student computers 210 to 230 include
A video camera 21 serves as a video and audio input/output means.
2, 222, 232 and headphones with microphone 213, 2
23 and 233 are provided, and the hotline function described later is performed using these input/output means. Similarly,
The instructor's computer 240 is also equipped with a video camera 241 and headphones with a microphone 242 as video and audio input/output means. Note that although headphones with microphones 213, 223, 233, and 242 are used in this embodiment, microphones and speakers may be used separately.

Next, the processing of the English conversation learning system of this embodiment will be explained using the schematic diagram of FIG. First, the learner selects, for example, from among multiple student computers.
Select student computer 210 and take a seat in front of student computer 210 in soundproof room 211. and,
Start the student computer 210 and use the built-in CA
Execute the I program. This CAI program is an English conversation courseware with multiple scenarios mentioned above, and provides practical English conversation necessary for daily life and business in a foreign country.
It can be learned as a visual and auditory simulation. The learner uses the student computer 210
You can acquire a certain level of conversational skills by holding English conversation lessons tailored to your level. Unlike lessons with foreign instructors, English conversation learning using this CAI program is based on the student computer 210.
Even the most nervous people can learn in a relaxed manner, as the other person is the other person. Additionally, the same lesson can be reviewed over and over again, making it an ideal learning method for beginners. Furthermore, since the student computer 210 is installed in a soundproof room 211, students can give speaking lessons out loud without worrying about anyone.
You can steadily acquire conversational skills.

[0018] Once a certain level of conversational ability has been acquired through individual learning through the CAI program,
The learner can use the hotline function provided in the student computer 210 to perform two-way communication with the instructor computer 240. This hotline function is
This is provided as a control program stored in the storage device of the student computer 210. However, this function does not necessarily need to be realized by software, and may be realized by firmware or hardware. Here, the hotline function refers to a function that enables communication between a specific student computer and the instructor computer by calling the instructor computer 240 using an access button provided on the student computer 210. When communication is enabled, audio data and image data can be transferred in both directions between a specific student computer and the instructor's computer, allowing English conversation lessons with a foreign instructor to be held in a manner similar to a videophone call. In this state,
On the monitor screen of the student computer 210, a window screen 215 of a video of a foreign instructor is displayed, superimposed on the window screen 214 of the English conversation learning using the CAI program that has been conducted so far. The video displayed on the window screen 215 is an image captured by the video camera 241 and transferred in real time. At the same time, the foreign instructor's voice data is also collected by the microphone-equipped headphones 241 and sent to the learner's microphone-equipped headphones 213. Also, on the monitor screen of the instructor computer 240,
The learner's face is shown. In this way, with access from the learner's side, they can interact directly with a foreign instructor on the monitor screen and give lessons at any time, making CAI
You can conduct English conversation learning that focuses on communication, which is one rank higher than individual learning through a program. Note that since all student computers are equipped with a hotline function, the instructor computer 240 can be called from any student computer. Further, there may be a plurality of instructor computers, and in this case, a specific instructor computer can be selected and called from the student computers.

[0019] In this way, the English conversation system of this embodiment is
First, as a first step, individual learning using the CAI program is performed using the student computer 210. In the second stage, when students have acquired a certain level of conversational ability, they will begin learning English conversation by mainly communicating with foreign instructors using the hotline function. Learners can achieve more effective English conversation learning by choosing between these two types of learning formats at their own pace.

Next, another embodiment of an English conversation learning system using the information processing apparatus of the present invention will be described with reference to FIGS. 8 to 10 of the accompanying drawings. FIG. 8 is a configuration diagram showing an information processing apparatus according to an embodiment of the present invention. This information processing device differs from the embodiment shown in FIG.
6, the storage device 304 is equipped with a video camera 309 and a microphone 310, and in addition to its role as a search information storage device, the storage device 304 also functions as a character data storage device, a detailed information storage device, an audio data storage device, and a graphic data storage device. It is said that it has the role of Here, the character data storage means stores character data of conversation sentences corresponding to the video data, and the detailed information storage means stores detailed information such as translations of the character data and grammatical notes. There is. Further, the audio data storage means stores audio data of conversation sentences corresponding to the video data.
The graphic data storage means stores graphic data such as a cross-sectional view of the oral cavity and phonetic symbols. Since this embodiment has such various functions, the following effects and features can be obtained.

[0021] First, the moving image data and the conversation text can be displayed in a superimposed manner on the display device 305. Specifically, the superimposed display function provided in the CPU 301, which is a control means, displays the moving image data read from the video disc device 303 and the character data read from the storage device 304, which is a character data storage means. They are superimposed and displayed on the display device 305 as if they were subtitles for a movie. The character data read from the storage device 304 corresponds to the video data, and character data corresponding to all conversations in the video data can be displayed. It is also possible to display only the keywords of the conversation in the video data.

[0022] Second, when the learner specifies a specific sentence in the conversation using the mouse, the corresponding moving image can be displayed on the display device 305. Specifically, desired character data stored in the storage device 304 is read out and displayed on the display device 305 using a character data display function provided in the CPU 301 . The learner then operates the mouse 308 to move the cursor mark displayed on the display device 305 over specific character data and clicks a button on the mouse 308. By this click, CPU301
The designated video display function provided in the system is activated, and video data corresponding to the designated character data is read from the video disc device 303 and displayed on the display device 305.

Third, by specifying a portion of a conversational sentence with the mouse, detailed information such as the corresponding translated sentence and grammatical notes can be displayed. Specifically, desired character data stored in the storage device 304 is read out and displayed on the display device 305 using a character data display function provided in the CPU 301 . The learner then operates the mouse 308 to move the cursor mark displayed on the display device 305 over specific character data and clicks a button on the mouse 308. By this click, a detailed information display function provided in the CPU 301 is activated, and detailed information such as translations and grammatical notes of the video data corresponding to the specified character data is read from the storage device 304 and displayed on the display. It is displayed on the device 305. By displaying this detailed information, the learner can immediately resolve any questions that arise during CAI learning.

Fourthly, by specifying a portion of a conversation using the mouse, the corresponding audio data can be output. Specifically, desired character data stored in the storage device 304 is read out and displayed on the display device 305 using a character data display function provided in the CPU 301 . The learner then operates the mouse 308 to move the cursor mark displayed on the display device 305 over specific character data and clicks a button on the mouse 308. By this click, a specified audio output function provided in the CPU 301 is activated, and audio data corresponding to the specified character data is read from the storage means 304 and output from the speaker 311. In addition, as an application example, instead of the character data corresponding to the conversation text in the video, a plurality of English words with similar pronunciations are displayed on the display device 305, and one of these English words is specified with the mouse 308. By doing so, this sound can also be output from the speaker 311. Additionally, the learner's voice can be recorded and compared with native speaker voice data stored in storage device 304. These functions allow you to practice speaking English words efficiently.

Fifth, by specifying a phonetic symbol on the display screen as shown in FIG. 9 with the mouse, the corresponding audio data can be output. in particular,
A graphic data display function provided in the CPU 301 reads desired graphic data stored in the storage device 304 and displays it on the display device 305. The learner then operates the mouse 308 to display the cursor mark 40 displayed on the display device 305.
1 over a specific phonetic symbol and click the button on the mouse 308. By this click, CP
The designated audio output function provided in U301 is activated, and the audio data corresponding to the designated phonetic symbol is stored in the storage means 30.
4 and output from the speaker 311. In addition to the phonetic symbols, the graphic data displayed by the graphic data display function includes
There is a list of words that have the same pronunciation as the specified phonetic symbol, and a cross-sectional diagram of the oral cavity.

Sixthly, when the learner inputs voice data, he/she can do so while looking at the voice input screen as shown in FIG. Specifically, by the character data display function provided in the CPU 301, the storage device 304
The desired character data stored in is read out and displayed on the conversation display section 402 of the display device 305. The speaking speed display function provided in the CPU 301 can display the speaking speed during vocal practice as an increasing speed of the bar graph 403. This bar graph 403
By practicing your pronunciation at an increasing speed, you can speak at the same speed as a native speaker. Furthermore, the rate of increase of this bar graph 403 can be switched to, for example, three levels, and can be set to suit one's own conversation pace. In this embodiment, the increasing speed is switched by pointing the cursor mark 401 at icons 404 to 406 displaying rabbits, turtles, and snails. The increasing speed of the bar graph 403 becomes faster in the order of rabbit, tortoise, and snail. In addition to the bar graph 403, a voice input promotion flag 407 that resembles a traffic light is displayed on the voice input screen of this embodiment. The learner can time the input by speaking into the microphone 310 while the traffic light is green.

Seventhly, it has a function of providing a blank field in a part of a conversation sentence and visually performing a test of filling in the blank field using the mouse 308. Specifically, a conversation sentence with a blank field and a plurality of English words are displayed on the display device 305, and the learner selects a word that fits the blank field from among these English words, and then uses the selected word. This is a function that allows you to dynamically move to a blank field using the mouse.

Note that this embodiment can be used not only as an English conversation learning system but also as an employee training device for training salesmen.

[0029]

As described above in detail, the information processing apparatus of the present invention can create dozens of scenarios by combining a plurality of moving image data. Therefore, the storage space in the video data storage means can be significantly reduced.

[0030]Moreover, the moving image data storage means stores moving image data in the order of access frequency. By changing the storage order, the probability that adjacent video data will be read out in sequence increases, and the access time for each video data is reduced.

[Brief explanation of drawings]

FIG. 1 is a configuration diagram showing an information processing device that is an embodiment of the present invention.

FIG. 2 is a conceptual diagram showing the operation of the present invention.

FIG. 3 is a conceptual diagram showing the operation of the present invention.

FIG. 4 is a flowchart showing the processing of the present invention.

FIG. 5 is a conceptual diagram showing the structure of moving image data stored in a video disc device.

FIG. 6 is a configuration diagram of an English conversation learning system according to an embodiment of the present invention.

FIG. 7 is a schematic diagram showing the processing of the English conversation learning system of this embodiment.

FIG. 8 is a configuration diagram showing an information processing device according to an embodiment of the present invention.

FIG. 9 is a conceptual diagram showing a display example of a phonetic symbol display screen.

FIG. 10 is a conceptual diagram showing a display example of a voice input screen.

[Explanation of symbols]

11...Control device 12...Video data 13...Video disc device 14...Storage device 15...Display device 16...Input device 17...Keyboard 18...Mouse 19...Speaker

Claims (9)

[Claims] [Claim 1] Video data that is grouped by steps that make up a scenario, can be combined to create several scenarios, and part of which includes branch information for moving to the next step. , a video data storage means in which the video data is stored, a projection device for projecting the video data, and an input means for selecting arbitrary information from branch information included in the video data and inputting the selected information. , a search information storage means storing selection information input from the input means; and a search information storage means for reading out the video data of the next step from the video data storage means based on the selection information input from the input means, and displaying the video data for the projection. control means for displaying the moving image data on the moving image data storage means, or reading selection information stored in the search information storage means and reading out the moving image data of the next step from the moving image data storage means based on the selection information and displaying the moving image data on the projection means; An information processing device comprising: 2. A plurality of information processing apparatuses according to claim 1 having video and audio input/output means; and at least one or more information processing apparatuses having video and audio input/output means connected by a line to the information processing apparatuses. and an instructor's computer, and the control means of the information processing device is equipped with a hotline function for performing two-way communication with the instructor's computer using video and audio input/output means. English conversation learning system. 3. The English conversation learning system according to claim 2, wherein the information processing devices are provided in independent soundproof rooms. 4. Character data storage means storing character data of a conversation sentence corresponding to the video data, and the control means stores the video data read from the video data storage means and the character data read from the character data storage means. 2. The information processing apparatus according to claim 1, further comprising a superimposed display function for displaying superimposed character data on said projection means. 5. Character data storage means in which character data of a conversation sentence corresponding to the video data is stored, and a cursor mark displayed on the projection means to move a cursor mark to point to a predetermined area so as to correspond to this area. an instruction input means for inputting data; the control means has a character data display function for reading desired character data from the character data storage means and projecting it on the projection means; A specified moving image display function is provided for reading out corresponding moving image data from the moving image data storage means and projecting it on the projection means by specifying specific character data among the character data displayed on the screen using the instruction input means. 2. The information processing apparatus according to claim 1, further comprising: an information processing apparatus; [Claim 6] A character data storage means in which character data of a conversation sentence corresponding to the video data is stored, and a detailed information storage means in which detailed information such as translations of the character data and grammatical notes are stored. , an instruction input means for inputting data corresponding to a predetermined area by moving a cursor mark displayed on the projection means to point to a predetermined area; a character data display function for reading character data and projecting it on the projection means; and specifying specific character data among the character data projected on the projection means by the character data display function with an instruction input means,
Claim 1 further comprising a detailed information display function for reading out detailed information such as translations of specified character data and grammatical notes from the detailed information storage means and projecting the same on the projection means. The information processing device described. 7. A character data storage means storing character data of a conversation sentence corresponding to the video data, an audio data storage means storing audio data of a conversation sentence corresponding to the video data, and outputting the audio data. an audio output means for
instruction input means for inputting data corresponding to a predetermined area by moving a cursor mark displayed on the projection means to point to a predetermined area; a character data display function that reads out character data and projects it on the projection means; and a character data display function that reads out character data and projects it on the projection means; and by specifying specific character data among the character data projected on the projection means by the character data display function with an instruction input means. 2. The information processing apparatus according to claim 1, further comprising a designated audio output function for reading audio data from said audio data storage means and outputting the audio data using said audio outputting means. 8. Graphic data storage means storing graphic data such as an oral cross-sectional view and phonetic symbols; audio data storage means storing audio data corresponding to the graphic data of the phonetic symbols; and an instruction input means for inputting data corresponding to a predetermined area by moving a cursor mark displayed on the projection means to point to a predetermined area; a graphic data display function for reading desired graphic data from a graphic data storage means and projecting it on the projection means; and an instruction input means for specifying a specific phonetic symbol among the phonetic symbols projected on the projection means by the graphic data display function. 2. The information processing apparatus according to claim 1, further comprising a designated audio output function for reading out corresponding audio data from the audio data storage means and outputting the same using the audio outputting means upon designation. . 9. Character data storage means storing character data of a conversation sentence corresponding to video data, voice input means for performing voice input, and voice storage means for storing voice data input by the voice input means. data storage means, the control means has a character data display function for reading desired character data from the character data storage means and projecting it on the projection means; 2. The information processing apparatus according to claim 1, further comprising a speaking speed display function that displays a speaking speed as a bar graph when practicing speaking along with character data.