JP2003316245A - Method for supporting storage and language learning, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method for supporting a storage for supporting that a multiplicity is stored or a language is learned in a short period of time by using a computer, or to provide a method for supporting language learning. <P>SOLUTION: The method for supporting the storage or the language learning by using the computer or the method for supporting the language learning comprises: an image display step of displaying the image indicating contents to be stored or learned at the left side of the display screen of the computer for a predetermined time; and a character display step of displaying character data of language information related to the image displayed in the image display step at the right side of the display screen of the computer. Thus, many images and character data are sequentially displayed by repeating the above two steps, and the storage or the language learning of a person using the computer is supported. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for supporting memory of a computer user using a computer, a method for supporting language learning, and a computer program thereof.

[0002]

2. Description of the Related Art Conventionally, there has been a flash card as a tool used for language learning. For example,
How to use by writing the spelling of English words on cardboard about 10 cm high and 25 cm long, and letting the English teacher instantly show the card to students and let the students pronounce it. It was being done. There were also teaching materials for children to learn languages, in which pictures and words were written on the same card and played like a karuta.

On the other hand, the inventor of the present application was
The application for "Voice data generation method, voice data reproduction method, recording medium" filed on the date is published as Patent Publication 2001-182298. The audio data generation method disclosed therein is a method for generating audio data for rapid listening, which performs digital processing on original audio data by using a computer to generate audio data for rapid listening, wherein the original audio data is predetermined. A block sampling step of generating a large number of blocks having the same length by sampling at a sampling frequency, and an attenuation processing step of applying attenuation processing to each end of adjacent portions of the blocks sampled by the block sampling step. ,
An adjacent block superimposing step of superimposing the ends of the adjacent blocks that have been attenuated in the attenuating step. Here, the word “quick listening” is also considered to be a common name that means to reproduce and listen to audio data faster than normal speed, but the inventor and the applicant of the present application may be different from a third party. Since it is also a registered trademark that is registered, it will be referred to as “fast-listening” in this specification.

When reproducing the audio data generated by the above-described audio data generation method, a natural sound at a normal speed (sound of waves, chirping of birds, babbling of streams, etc.)
It is disclosed in the above-mentioned publication that it is effective to superimpose the above.

[0005]

DISCLOSURE OF THE INVENTION Problems to be Solved by the Invention
We thought that the flash card could be made easier to use by using a computer system, and a memory support method could be provided.
Furthermore, the inventor of the present application applies a result of cerebral physiology as described in "Brain Mechanism" (edited by Makoto Iwata) published by Natsume Co., Ltd. I realized that there are ways to use the screen.

[Mechanism of the brain] 74
A brief summary of what is written on page 81 through page 81 is given below. Roughly speaking, it describes the difference between the roles of the left and right cerebral cortices and the principle of cross control. The right and left are reversed in the brain and body, the information on the left visual field is received by the right hemisphere of the brain, and the information on the right visual field is received by the left hemisphere of the brain. Image processing is introduced. Although many experimental examples are mentioned, it is explained that an instantaneous presentation method, which is an experiment method in which an image is shown to a subject with a length of 0.1 seconds or less, is used.

The inventor of the present application has realized that by incorporating the above-described results of the rapid sound hearing system and the cerebral physiology, it is possible to provide a method for assisting in memorizing a lot of things in a short time. It is an object of the present invention to provide a memory support method for supporting the storage of many things in a short time using a computer.

[0008]

Means for Solving the Problems In order to solve the above problems, a memory support method according to the present invention is a memory support method for supporting memory using a computer, wherein an image showing contents to be stored is displayed on the computer. Image display step for displaying for a predetermined time on the left side of the display screen, and character display step for displaying character data of language information associated with the image displayed in the image display step for a predetermined time on the right side of the display screen of the computer. By repeating the above two steps, a large number of image and character data are displayed one after another to assist the memory of a person who uses the computer.

A memory support method for supporting storage by using a computer, comprising: an image display step of displaying an image showing contents to be stored on a left side of a display screen of the computer for a predetermined time; and an image display step. The character display step of displaying the character data of the language information associated with the displayed image on the right side of the display screen of the computer for a predetermined time, and reproducing the sound produced by pronouncing the character data displayed in the character display step. A voice reproducing step, and by repeating the above three steps, a large number of image and character data are displayed one after another, and the voice is reproduced to support the memory of a person who uses the computer. is there.

Further, in the above-mentioned memory support method, the cycle of displaying the image in the image displaying step and the length of the displaying time, the timing of displaying the character data in the character displaying step and the displaying time of the character data are set. The method further includes a time axis setting step in which a person who uses the computer adjusts the length, and after the person who uses the computer sets the time axis in the time axis setting step, the image is displayed according to the set conditions. The image display in the display step and the character display in the character display step may be executed.

According to a fourth aspect of the present invention, in the memory support method according to the second aspect, a cycle of displaying an image in the image displaying step and a length of time to display the image are displayed in the character displaying step. The computer further includes a time axis setting step in which a person who uses the computer adjusts the timing of displaying the character data, the length of time to display the character data, and the timing of reproducing the voice in the voice reproducing step. After setting by the person in the time axis setting step, the image display in the image display step, the character display in the character display step, and the voice reproduction in the voice reproduction step are executed according to the set conditions. is there.

The invention described in claim 5 is the memory support method according to claim 2, wherein a voice reproduction speed adjustment for adjusting a voice reproduction speed in the voice reproduction step is performed by a person who uses the computer. After further adjusting the sound reproduction speed adjusting step by the person using the computer, the sound reproducing in the sound reproducing step is executed according to the adjusted condition.

The invention described in claim 6 is the memory support method according to claim 1 or 2, wherein the spatial expansion of displaying an image in the image displaying step and the character The display step further includes a spatial superimposition rate setting step in which a person who uses the computer adjusts the degree of overlap with the spatial spread of displaying the character data, and the person who uses the computer sets the spatial superimposition rate. After the setting in step, the image display in the image display step and the character display in the character display step are executed according to the set conditions.

According to a seventh aspect of the present invention, in the memory support method according to the fifth aspect, the natural sound or the music is reproduced at a normal speed by superimposing the speed reproduction on the sound reproduction. It is something to play.

The invention described in claim 8 is the storage support method according to claim 1 or 2, wherein the plurality of image data have a database structure, and are synonyms, The method further includes an extraction step of extracting a classification according to categories such as antonyms, grades, and types.
The above repeated display is executed for the group of image data extracted in the extracting step.

The invention described in claim 9 reproduces a natural sound or music when the invention described in claim 1 is executed. The invention described in claim 10 is for causing a computer to execute the memory support method described in any one of claims 1, 2, 3, 4, 5, 6, 7, 8 or 9.

The computer is a personal digital assistant (P
DA), a game machine, or the like.

Further, the invention of the memory support method can be applied to a language learning support method.

[0019]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 48 is a block diagram showing an embodiment of a computer used to implement the memory support method or language learning support method of the present invention. A read only memory (ROM) 11, a random access memory (RAM) 12, a video RAM 13, a hard disk drive (HDD) 20, a CD-ROM drive (CD) are connected to a bus connected to a central processing unit (CPU) 10.
D) 21 is connected. Furthermore, the video RAM 13
The display device 23 is connected to. This computer can use, for example, a well-known Windows (registered trademark of Microsoft Corporation, USA) machine. The CD-ROM drive 21 is used not only for setting up a program but also for reading a music CD for playing background music when executing the present invention.

Next, a hard copy of an actual screen when a program for realizing the memory support method or language learning support method according to the present invention is executed will be described with reference to FIGS. 1 to 14. In this specification, the name of this program is tentatively called a flip card.

FIG. 1 is an initial screen displayed when the program is started. A button for selecting teaching materials is provided in the upper left of the screen. When no teaching material is selected, it is necessary to select the teaching material only by pressing this teaching material selection button. Now, the last time is already "vehicle"
Since the teaching material with the name is selected and the history is taken over, the learning will be performed using the "norimono" that was the previous memory training or language learning as the teaching material without selecting a new teaching material. The "Settings" button in the upper right is a button for setting display parameters such as image display cycle (turning cycle), image display time, text display timing, and text display time length (text deletion timing). The setting screen is displayed by pressing the button. Regarding these settings, the setting conditions can be registered for some combinations. Nine combinations of “setting 1” to “setting 9” have already been registered (can be customized), and “setting 5” is currently selected. "Setting 5" was used the last time this program was executed, so it is taken over and displayed. If the same settings as the previous time are acceptable, you can start without pressing the "Set" button. A slider is provided in the part where "overlap" is displayed, and the computer user grasps and drags this slider using a pointing device such as a mouse to display the left and right screens (displayed on the left side of the screen). It is possible to adjust the degree of overlap (superimposition ratio) between the image of the image displayed on the screen and the image of the language text displayed on the right side of the screen. When the mouse is placed on this pointer, the numerical value (superimposition rate) of the overlapping state is displayed as a numerical pop-up. The current setting is a 30% superposition rate. The slider has a superposition rate of zero percent at the leftmost position and has a superposition rate of 100 percent at the rightmost position.
If the superimposition ratio is zero percent, the image image is displayed on the left side of the screen with a width of about half the entire screen width. If the superimposition rate is 100%, the image will be displayed in the center of the screen with a width substantially the same as the entire screen width.

Below the “Overlap” slider, “BG
An "M" button is provided. Currently, "BGM" (background music) is not selected at all. For example, you can choose the sound of streams, the sound of waves, the natural sounds of chirping birds, baroque music, or music such as Mozart. BGM is considered to be effective in creating an environment in which alpha waves are easily generated from the brain. This is because it is considered to be efficient if memory and language learning are performed while emitting alpha waves in a relaxed state. To the right of the "BGM" button, select "Standard", "Double speed",
"3rd speed", "4th speed", "5th speed", "6th speed", "7th speed",
A radio button labeled "8th speed" is provided.
Also, "Japanese", "Korean", "Chinese", "Russian", "English", "French", "German", "Spanish", "Portuguese", "Greek", etc. There is also a radio button to select the language of. Not only can the language associated with the image be displayed in text, but the voice that pronounces it can be played back.
Then, the voice is stored in association with the image as voice data that is pronounced in not only Japanese but also several kinds of languages. If you were playing a sound that was pronounced at standard speed, you would be restricted by the length of playback of that sound, and you could limit the speed of turning the page (shortening the screen display cycle). . It is also known as an empirical rule that listening to voice at a speed of 3 times or 4 times can improve the function of the brain. Therefore, in order to make it possible to increase the turning speed (to shorten the screen display cycle) and to improve the function of the brain both visually and audibly, in this program, the audio data is played in fast forward playback. Since storing each fast-forward voice data will increase the amount of data,
Only the voice data of the standard speed is stored, and the fast-forwarding data (fast sound listening data) can be generated each time (the above-mentioned “voice data generating method, voice data reproducing method, recording medium” Patent Publication 2001- 282298). Regarding the generation of the high-speed sound data, it is possible to pre-read the high-speed sound data generation program so as not to interfere with the execution of the flip card. That is, in the screen immediately after the start shown in FIG.
At the stage when "fast" or "Japanese" is selected, the generation of fast-listening data is executed for a group of voice data, and when the preparation is completed, the flip card is started. be able to.

A “start” button and a “close” button are provided on the screen immediately after the start shown in FIG. By pressing the "Start" button, execution of the flip card is started (at this time, wait for the completion of the work of generating the high-speed listening data for a series of data, if necessary, as described above, and then execute the operation of the flip card. When you want to finish the program of the flip card, click the "Close" button to finish.

FIG. 2 is a hard copy of the setting screen displayed by pressing the above-mentioned setting button. Sliders are provided for each of the four display parameters of "display cycle", "image display", "text display", and "text deletion", and a computer operator (uses a flip card to actually perform memory training and language learning. Although it may be the user himself who learns, since it may be set by the teacher of the cram school or the guardian of the home instead of himself, it is the operator here.) Grasping the slider with a mouse etc., Various settings are made by dragging. First,
The "display cycle" is a cycle for displaying an image (image image), and is set to 0.5 seconds in the illustrated example.
The shorter this cycle, the faster the turning speed. For example, it is possible to select a short cycle of 0,3 seconds. Now, when the display cycle is set to 0.5 seconds, the length of the horizontally long strip in the next "image display", "text display", and "text deletion" indicates 0.5 seconds. The slider for "image display" sets how long the image is displayed after the image is displayed from the beginning of each cycle. Therefore, it can be said that the timing of erasing the image is set at the position of the slider. The slider for "text display" sets the timing to start displaying language text information on the right side of the screen. It is preferable that the text display be started after the image display is finished and there is a moment when nothing is displayed. By setting the slider of "text deletion", the timing of the end of the text display and thus the time length of the text display is set. At the bottom of the screen in FIG. 2, a setting number selection list screen is displayed. Here, when the downward triangle is pressed, other settings (setting 1, setting 3, setting 4, etc.) are displayed, and when a desired setting number is selected, the display parameters set by the setting number are displayed respectively. . When the "Set" button is pressed, the setting contents are stored in association with the setting number and the process returns.
Pressing the “Cancel” button returns without changing the display parameters.

FIG. 3 is a hard copy showing the image of the “double-decker bus” displayed on the left side of the screen. In this example, the overlapping ratio of the left and right screens is 30%.

FIG. 4 is a hard copy showing a state in which character data of “double-decker bus” is displayed on the right side of the screen. In this example, the superimposition ratio of the left and right screens is 30%. Also, Japanese is selected as the language.

FIG. 5 is a hard copy showing a state in which the “horse carriage” image is displayed on the left side of the screen. In this example, the superimposition ratio of the left and right screens is zero percent.

FIG. 6 is a hard copy showing a state in which the character data of “horse carriage” is displayed on the right side of the screen.
In this example, the superimposition ratio of the left and right screens is zero percent. Also, Japanese is selected as the language.

FIG. 7 is a hard copy showing a state where the “Jeep” image is displayed on the left side of the screen. In this example, the superimposition ratio of the left and right screens is 100%.

FIG. 8 is a hard copy showing a state in which the character data of “Jeep” is displayed on the right side of the screen. In this example, the superimposition ratio of the left and right screens is 100%. Also, Japanese is selected as the language.

FIG. 9 is a hard copy showing a state where the image of “Scooter” is displayed on the left side of the screen.
In this example, the superimposition ratio of the left and right screens is 71%.

FIG. 10 is a hard copy showing a state in which the character data of “scooter” is displayed on the right side of the screen. In this example, the superimposition ratio of the left and right screens is 71%. Also, Japanese is selected as the language.

FIG. 11 is a hard copy showing a state in which the image of “van” is displayed on the left side of the screen. In this example, the overlapping ratio of the left and right screens is 16%.

FIG. 12 is a hard copy showing a state in which the character data of “bang” is displayed on the right side of the screen. In this example, the overlapping ratio of the left and right screens is 16%. Also, Japanese is selected as the language.

FIG. 13 is a hard copy showing a state in which the image of the “cable car” is displayed on the left side of the screen. In this example, the superimposition ratio of the left and right screens is 82%.

FIG. 14 is a hard copy showing a state in which the character data of “cable car” is displayed on the right side of the screen. In this example, the superimposition ratio of the left and right screens is 82%. Also, Japanese is selected as the language.

FIG. 15 is a flowchart when the program “flip card” of the present invention is running.
About "type of teaching material", "turning speed", "natural sound of background (background music)", "speed of fast sound", "language type", "overlap (image and character superimposition rate)" After initial setup, the program can be started. When starting from the second time, if you can keep the previous setting, you can restart without resetting. Start the program by pressing the "Start" button. At the start, first of all, the learning material data and display parameters are acquired. Then, when the BGM (or natural sound) reproduction is selected, the BGM reproduction is started. Then flip over the cards. Applicable image data,
The character data and voice data associated with it are read out, and image display, character display, and voice reproduction are executed according to the setting of display parameters. It is determined whether or not the image data is the last one, and if it is the last one, the process ends. If it is not the last, it is judged whether or not the setting is changed, and if not, the next card is turned over. When the settings are changed, new parameters are acquired, the next card is turned over, and display and playback are executed according to the new conditions.

FIG. 16 is a flowchart when the user sets various conditions. "Selecting the type of teaching material", "Selecting the turning speed (image display cycle)",
The user successively sets the "selection of natural background sound (BGM)", "speed of fast sound", and "overlap degree (superimposition rate)". The setting method is a method such as dragging a slider with a mouse or selecting from a list.

FIG. 17 is a time chart when the voice data of the overtone sound is shorter than the cycle of the turning speed.
The reproduction of the natural sound (BGM) continues to be executed regardless of the turning speed (image display cycle). Turning speed (image display cycle) is, for example, 0.3 seconds, 0.5
The cycle is set by the operator of the computer, such as seconds and 0.8 seconds, and is displayed as Tturn here. As a general rule, since the images turn over one after another with Tturn as the cycle, it can be said to be the turning speed.
As shown in FIG. 17, when the display of images, the display of characters, and the reproduction of voice are completed by the end of Tturn, the process proceeds in principle. However, the display of the image and the display of the characters are made without any problems in the setting so that the display ends by the end of Tturn, but the sound reproduction is only performed when Tturn is short or the double speed is not so fast, In the case where it takes time, it is conceivable that the audio reproduction may not be completed by the end of Tturn. Such exception handling is shown in FIG.

FIG. 18 is a time chart when the voice data of the overtone sound is longer than the cycle of the turning speed.
In this case, the function of the program automatically extends the cycle of turning speed. In other words, wait for the end of audio playback and then turn to the next page (start displaying the next image data).
Move on to.

FIG. 19 is a conceptual diagram for explaining the memory support method or language learning support method of the present invention. As described above, the left brain is the part that controls language processing, the right brain is the part that controls image processing, and that there is a left-right cross between the body and the brain. Further, the inventor of the present invention considers that the brain has a part controlling the actual consciousness (ground brain) and a part controlling the subconsciousness (celestial brain). Then, it was proposed that the above-mentioned patent publication 2001-228298 can perform training that overcomes the barrier between the actual consciousness and the subconsciousness by listening to the fast sound (listening to the fast sound and the natural sound in an overlapping manner). In the present invention, the inventor of the present invention believes that by using the program of this flip card in addition to the high-speed listening, it is possible to train the usage of the brain having an organic relationship between the left and right brains. .

FIG. 20 is a conceptual diagram for explaining the association of image data, character data, and voice data used in the memory support method or language learning support method of the present invention. Image data such as mountains and flowers has a number of types of classification codes and has a structure that allows easy retrieval. The classification code is data such as a serial number (serial number), a large classification (attribute), a middle classification (attribute), and a small classification (attribute). Further, the image is associated with text information in multiple languages such as Chinese, Korean, Japanese, English, Russian, and French. The classification code is used to collect similar items, or to associate and collect antonyms, synonyms, synonyms, grades, levels, and types. More specifically, for example, the first
As a classification, the natural world, substances, children, couples, lives, families,
Marriage, occupation, media, business, politics, science, etc.
There are about 160 categories. As the second classification, about 16 classifications such as mountains, seas, rivers, and flowers in the natural world, and 1 classification of chemicals, stones, woods, plastics, etc. for substances.
There are about 6 categories. The third classification is grammatical, and classifications such as adjectives, adverbs, example sentences, and short sentences are provided. As the language text, not only simple words but also sentences such as short sentences and example sentences can be set. The fourth classification is classified according to grade, and includes infants, elementary schools, junior high schools, high schools, universities, and the general public. The fifth classification is by global language, and is level 1, level 2, level 3, level 4, level 5, level 6 ,. ． ． , Level 12, etc. are provided.

FIG. 21 is a screen for selecting a music CD to which music (or natural sound) to be played at the same time is fixed when the memory support method or language learning support method of the present invention is executed. If no selectable music CD is found, or if there is a CD but it is not a music CD, the message "No music CD" is displayed as shown in the figure. Buttons such as "all-track repeat", "one-track repeat", and "shuffle PLAY" are displayed in a non-clickable state here.

FIG. 22 is a screen for selecting music (or natural sound) to be played at the same time when the memory support method or language learning support method of the present invention is executed. A music CD is found, and a correct music CD is found. If, the number of songs (the number of tracks) stored therein is displayed. In FIG. 22, it is displayed that there are 20 songs. To play all the songs on the CD, press the "Play" button in this state to execute the all songs repeat.

FIG. 23 is a screen for selecting music (or natural sound) to be played simultaneously when executing the memory support method or language learning support method of the present invention.
By clicking an inverted triangular button on the screen showing that the songs are stored, the 20 songs are displayed and a window for making them selectable is opened. To specify the track to be played, select the track from the song selection list.

FIG. 24 is a screen for selecting music (or natural sound) to be played at the same time when executing the memory support method or language learning support method of the present invention. A certain track 3 is selected. In this state, the "1 song repeat" button is clickable. To play in single-track repeat, select a track, press "1-track repeat", and then press the "Play" button.

FIG. 25 is a screen for selecting music (or natural sound) to be played at the same time when executing the memory support method or language learning support method of the present invention. In this screen, all 20 songs are randomly selected. This shows the case where the "shuffle button" to be played is clicked to play. "Shuffle" for shuffle play (random play)
After pressing the button, press the "Play" button.

FIG. 26 is a diagram showing files constituting a program of the memory support method or language learning support method of the present invention. When the flip card system of the present invention and the setup of image data are completed, a folder called “ClipArts” is provided as a folder for storing image data and audio data. Below that, there are folders called "Dobutsu" and "Norimono".
Further, a "voice" folder is provided in the lower level thereof to store voice data, and a "double speed" folder is provided in the lower level to store double speed voice data.

FIG. 27 is a screen when the program of the memory support method or language learning support method of the present invention is activated. In this example, the superimposition ratio between the display of image data and the display of character data is 100%. The teaching material selection button is a button for selecting a teaching material list to be displayed. The "teaching material title" display is a button for displaying the title of the selected teaching material list. The “setting” selection box is a box for selecting parameters such as a display cycle. "Configuration"
The button is a button for changing the setting of the display parameter. The "overlap" slider is a slider for changing the overlap (%) of the image and the text. The "start" button is a button for starting the display of the flip card.
The "BGM" button is a button for selecting CD music played by BGM. "BGM number" is the current BG
This is a number for displaying the track number of M. The selection of "standard speed, double speed, 3 speed, 4 speed, 5 speed, 6 speed, 7 speed, 8 speed" changes the reproduction speed of the flip card voice.
The "close" button is a button for ending the flip card system.

Next, setting of the teaching material will be described with reference to FIGS. 28 to 30. FIG. 28 is a hard copy showing a state in which the teaching material setting screen is opened. To add an image, first press the "Add" button. Then "open"
A screen will appear and a new image will be added to the image list after the selected one. In this example, “track” is added after “scooter”. Gif, jp for image files
You can specify g, bmp format images.

FIG. 29 is a hard copy showing a window for opening a file of the teaching material list. This is to select a new teaching material list file to open. ***. lst format file. The file name becomes the teaching material title name.

FIG. 30 is an explanatory diagram of a teaching material setting screen. On this screen, image data can be called, text data related to it can be input, and voice data can be associated. The "Open" button is a button for opening an existing teaching material list. The "new creation" button is a button for creating a new teaching material list. "Teaching material title"
Indicates the name of the teaching material. The "Save As" button displays the teaching material list with a different name. The "Back" button
This button returns to the main screen. The "add" button is a button for adding an image to the image list. The "Delete" button deletes the specified image from the list.
The "Up" button advances the order of specified images by one. The "Down" button moves down the order of the specified image by one. When the flip card system is started for the first time, the teaching material name is not set, so after completing the image file setup, click the "Open" teaching material setting button to open "ClipArts.lst" in the directory where ClipArts was expanded. Open the file and set the teaching materials.

Next, the display parameters will be described with reference to FIG. FIG. 32 is a hard copy of a setting screen for setting the display cycle, image display time, text display time, text erasing timing, and the like. The "display cycle" slider sets the time cycle for displaying one flip card. The shortest period is 0.3 seconds. The "Image display" slider displays 100 times the time set in the display cycle.
Considered as%, set the time to display the image in%. The "text display" slider is a slider that sets the time point at which the display of text is started in%. . The time when the voice starts is the same. The "Delete text" slider
Set the time to erase the text in%. However, the text is displayed as long as the voice continues. Therefore, the time for displaying the text depends on the length of the reproduction time of the audio data. The "setting number" selection list is a list for selecting a number for setting a parameter. The “setting” button is a button for setting a parameter in correspondence with a setting number.
The "Cancel" button is a button for returning to the main screen without changing the parameters.

FIG. 33 is an initial screen for setting up a program for executing the storage support method of the present invention on a computer. Open the CD-ROM that stores the flip card program and double-click setup.exe to start it. This initial screen opens. Click the "OK" button to start setup.

FIG. 34 is a screen for changing the setup directory. To change the setup directory, click the "Change directory" button. After setting the directory, press the setup button to execute setup.

FIG. 35 is a screen for setting a program group name at the time of setup. This is to select a group to register the flip card system.

FIG. 36 is a screen for notifying the completion of setup. When this screen is displayed, the setup of the program is completed, so the process for installing the image data is started.

FIG. 31 shows an image data installation screen. Set the image and audio data used in the flip card system. Select "Start" menu, "Programs", "Flip Card", "Install Image Data" to start installation.

FIG. 37 is a screen showing a starting method when the program is started. Launch the program by selecting the flip card from the "Start" menu.

FIG. 38 is a screen showing a method of uninstalling a program. When deleting or upgrading the flip card system, uninstall the old flip card system. Open the control panel, open Add / Remove Programs, select "Flip Card" from the application list, and click the "Add / Remove" button to uninstall.

FIG. 39 is a screen showing the setting conditions of setting 1. In this example, the display cycle is 0.4 seconds. Display the image for the first 20 percent or so, erase it and wait a moment before displaying the text. And
The text is displayed and erased only for about 10% of the cycle.

FIG. 40 is a screen showing the setting conditions of setting 2. In this example, the display cycle is 0.5 seconds, the first 20% or so of the time image is displayed, and the text is displayed for about 40% of the cycle after erasing the image.

FIG. 41 is a screen showing the setting conditions of the setting 3. In this example, the display cycle is 0.3 seconds. The image display is about 50% of the cycle, and the text display is provided about 40% of the cycle so as to overlap with the image display time.

FIG. 42 is a screen showing the setting conditions of the setting 4. In this example, the display cycle is 1.8 seconds. The image display is about 5% of the cycle, and the text display is about 50% of the cycle. This is an example of displaying the text after deleting the image and waiting a while.

FIG. 43 is a screen showing the setting conditions of setting 5. In this example, the display cycle is 2.9 seconds. Image display is performed for about 60% of the cycle, and text display is performed for about 20% of the cycle.

FIG. 44 is a screen showing the setting conditions of the setting 6. In this example, the cycle is 2.6 seconds, the image display is about 50% of the cycle, and the text display is only a moment.

FIG. 45 is a screen showing the setting conditions of the setting 7. In this example, the cycle is 0.5 seconds, the image display is 50% of the cycle, and the text display is 20% of the cycle.

FIG. 46 is a screen showing the setting conditions of setting 8. In this example, the cycle is 0.5 seconds, the image display is 10% of the cycle, and the text display is only a moment.

FIG. 47 is a screen showing the setting conditions of the setting 9. In this example, the cycle is 1 second, the image display is 30% of the cycle, and the text display is 20% of the cycle.
Although these setting examples are provided by default,
It can be changed by the operator. Also, the settings can be changed according to the familiarity and progress of the user who actually uses this system.

[0070]

Embodiments In the above-described embodiments, the computer used is a so-called Windows (registered trademark of Microsoft Corporation in the United States) machine, but a personal digital assistant (PDA) can also be used. It is also possible to use a so-called video game machine. Also, a modified embodiment using a portable video game machine is possible. In that case, you may not be able to use a music CD as background music, but mpg
It is possible to use it in other formats such as 3.
When using a Windows (registered trademark of Microsoft Corporation in the United States) machine, a computer user can add an image by himself, store text data and audio data in association with it, and customize and grow the image database. Easy to do,
When using game machines, such customization features may be limited.

Further, in the above-described embodiment, images of animals and vehicles have been taken as an example, but the present invention can be used not only for the names of concrete objects but also for language learning of abstract concepts. In addition, even in a language that expresses a concept that should not be limited to one image, it is possible to carry out multilingual learning through a certain characteristic image image. Conventionally, it is customary to use a dictionary for language learning, but the dictionary is premised on paraphrasing a language. With this memory support method and language learning support method, it is possible to perform multilingual learning centered on images rather than paraphrases of languages, and it is possible to perform efficient learning that is not biased to the left brain.

[0072]

EFFECTS OF THE INVENTION Since the present invention is configured as described above, it enables memory activities that are not biased to the left hemisphere and the right hemisphere of the brain, and language learning is performed on both the left and right brains and the subconscious and explicit consciousness. It becomes possible to use memory to learn memory and learn languages.

[Brief description of drawings]

FIG. 1 is an initial screen displayed when a program is activated.

FIG. 2 is a hard copy of a setting screen displayed by pressing a setting button.

FIG. 3 is a hard copy showing a state in which an image of “double-decker bus” is displayed on the left side of the screen. In this example, the overlapping ratio of the left and right screens is 30%.

FIG. 4 is a hard copy showing a state in which character data of “double-decker bus” is displayed on the right side of the screen. In this example, the superimposition ratio of the left and right screens is 30%. Also, Japanese is selected as the language.

FIG. 5 is a hard copy showing a state in which an image of “horse carriage” is displayed on the left side of the screen. In this example, the superimposition ratio of the left and right screens is zero percent.

FIG. 6 is a hard copy showing a state in which character data of “horse carriage” is displayed on the right side of the screen. In this example, the superimposition ratio of the left and right screens is zero percent. Also, Japanese is selected as the language.

FIG. 7 is a hard copy showing a state where a “Jeep” image is displayed on the left side of the screen. In this example, the superimposition ratio of the left and right screens is 100%.

FIG. 8 is a hard copy showing a state in which character data of “Jeep” is displayed on the right side of the screen. In this example, the superimposition ratio of the left and right screens is 100%. Also,
Japanese is selected as the language.

FIG. 9 is a hard copy showing a state where the image of “Scooter” is displayed on the left side of the screen. In this example, the superimposition ratio of the left and right screens is 71%.

FIG. 10 is a hard copy showing a state in which character data of “scooter” is displayed on the right side of the screen. In this example, the superimposition ratio of the left and right screens is 71%. Also, Japanese is selected as the language.

FIG. 11 is a hard copy showing a state in which an image of “van” is displayed on the left side of the screen. In this example, the overlapping ratio of the left and right screens is 16%.

FIG. 12 is a hard copy showing a state in which character data of “bang” is displayed on the right side of the screen. In this example, the overlapping ratio of the left and right screens is 16%. Also, Japanese is selected as the language.

FIG. 13 is a hard copy showing a state in which an image of “cable car” is displayed on the left side of the screen. In this example, the superimposition ratio of the left and right screens is 82%.

FIG. 14 is a hard copy showing a state in which character data of “cable car” is displayed on the right side of the screen. In this example, the superimposition ratio of the left and right screens is 82%.
Also, Japanese is selected as the language.

FIG. 15 is a flowchart when the program of the present invention is running.

FIG. 16 is a flowchart when a user sets various conditions.

FIG. 17 is a time chart when voice data of overspeed sound is shorter than a cycle of turning speed.

FIG. 18 is a time chart when voice data of overspeed sound is longer than a cycle of turning speed. In this case, the function of the program automatically extends the cycle of turning speed.

FIG. 19 is a conceptual diagram illustrating a memory support method or language learning support method of the present invention.

FIG. 20 is a conceptual diagram illustrating association of image data, character data, and voice data used in the memory support method or language learning support method of the present invention.

FIG. 21 is a screen for selecting a music CD having music (or natural sound) fixed at the same time when the memory support method or language learning support method of the present invention is executed. If no selectable music CD is found, or if there is a music CD
If not, "I don't have a music CD" as shown.
Is displayed.

FIG. 22 is a screen for selecting music (or natural sound) to be played at the same time when the memory support method or the language learning support method of the present invention is executed, and the screen is stored when a music CD is found. The number of songs is displayed. In the figure, 2
It is displayed that there are 0 songs.

FIG. 23 is a screen for selecting music (or natural sound) to be played at the same time when the memory support method or language learning support method of the present invention is executed, showing that 20 songs are stored in a music CD. By clicking the inverted triangle button on the screen shown, the 20 songs are displayed and a window for making them selectable is opened.

FIG. 24 is a screen for selecting music (or natural sound) to be played at the same time when the memory support method or the language learning support method of the present invention is executed, and is track 3 which is music of 2 minutes and 47 seconds. Indicates a selected state. In this state, the "1 song repeat" button is clickable.

FIG. 25 is a screen for selecting music (or natural sound) to be played simultaneously when the memory support method or language learning support method of the present invention is executed. This screen shows a case where all 20 songs are played at random by clicking the "shuffle button".

FIG. 26 is a diagram showing files constituting a program of the memory support method or language learning support method of the present invention. As a folder for storing image data and audio data, click "Cl
A folder called "ipArts" is provided. Below that, folders called "Doubutsu" and "Norimono" are provided, and "Voice" is further below.
A folder is provided to store voice data, and a “double speed” folder is provided under the folder to store double speed voice data.

FIG. 27 is a screen when the program of the memory support method or language learning support method of the present invention is activated. In this example, the superimposition ratio between the display of image data and the display of character data is 1
It is set to 00 percent.

FIG. 28 is a hard copy showing a state in which the teaching material setting screen is opened.

FIG. 29 is a hard copy displaying a window for opening a file of a teaching material list.

FIG. 30 is an explanatory diagram of a teaching material setting screen. On this screen, image data can be called, text data related to it can be input, and voice data can be associated.

FIG. 31 is an image data installation screen.

FIG. 32 is a hard copy of a setting screen for setting a display cycle, an image display time, a text display time, a text erasing timing and the like.

FIG. 33 is an initial screen for setting up a program for executing the storage support method of the present invention on a computer.

FIG. 34 is a screen for changing the setup directory.

FIG. 35 is a screen for setting a program group name at the time of setup.

FIG. 36 is a screen for notifying the completion of setup.

FIG. 37 is a screen showing a starting method when the program is started.

FIG. 38 is a screen showing a method of uninstalling a program.

FIG. 39 is a screen showing setting conditions of setting 1.

FIG. 40 is a screen showing setting conditions of setting 2;

FIG. 41 is a screen showing setting conditions of setting 3;

FIG. 42 is a screen showing setting conditions of setting 4;

FIG. 43 is a screen showing setting conditions of setting 5;

FIG. 44 is a screen showing setting conditions of setting 6;

FIG. 45 is a screen showing setting conditions of setting 7.

FIG. 46 is a screen showing setting conditions of setting 8;

FIG. 47 is a screen showing setting conditions of setting 9.

FIG. 48 is a block diagram showing a hardware configuration example of a computer used when implementing the storage support method of the present invention.

[Explanation of symbols]

10 CPU 11 ROM 12 RAM 13 Video RAM 20 HDD 21 CDD 23 Display

[Procedure amendment]

[Submission date] April 23, 2002 (2002.4.2)
3)

[Procedure Amendment 1]

[Document name to be corrected] Drawing

[Correction target item name] All drawings

[Correction method] Change

[Correction content]

[Figure 1]

[Fig. 2]

[Figure 3]

[Figure 4]

[Figure 5]

FIG. 21

FIG. 22

FIG. 23

FIG. 24

FIG. 25

FIG. 31

FIG. 48

[Figure 6]

[Figure 7]

[Figure 8]

[Figure 9]

[Figure 10]

FIG. 17

FIG. 11

[Fig. 12]

[Fig. 13]

FIG. 14

FIG. 18

FIG. 26

FIG. 15

FIG. 16

FIG. 27

FIG. 29

FIG. 33

FIG. 19

FIG. 20

FIG. 28

FIG. 35

FIG. 30

FIG. 32

FIG. 34

FIG. 36

FIG. 37

FIG. 38

FIG. 39

FIG. 40

FIG. 41

FIG. 42

FIG. 43

FIG. 44

FIG. 45

FIG. 46

FIG. 47

Claims (24)

[Claims] 1. A storage support method for supporting storage using a computer, comprising: an image display step of displaying an image showing contents to be stored on a left side of a display screen of the computer for a predetermined time; A character display step of displaying character data of language information associated with the displayed image on the right side of the display screen of the computer for a predetermined time. By repeating the above two steps, a large number of images and characters are displayed. A memory support method for displaying data one after another to assist the memory of a person who uses the computer. 2. A storage support method for supporting storage using a computer, comprising: an image display step of displaying an image showing contents to be stored on the left side of the display screen of the computer for a predetermined time; and the image display step. The character display step of displaying the character data of the language information associated with the displayed image on the right side of the display screen of the computer for a predetermined time, and reproducing the voice that pronounces the character data displayed in the character display step. A voice assisting step, and by repeating the above three steps, a large number of image and character data are displayed one after another, and voice is played back to assist the memory of a person who uses the computer. Method. 3. The memory support method according to claim 1, wherein a cycle of displaying an image in the image displaying step and a length of time to display the image, and a step of displaying in the character displaying step. The method further comprises a time axis setting step in which a person who uses the computer adjusts the timing of displaying the character data and the length of time to display the character data, and the person who uses the computer sets the time axis setting step in the time axis setting step. After that, the memory support method in which the image display in the image display step and the character display in the character display step are executed according to the set conditions. 4. The storage support method according to claim 2, wherein a cycle of displaying an image in the image displaying step and a length of time for displaying the image, a timing of displaying character data in the character displaying step, and The method further comprises a time axis setting step in which a person who uses the computer adjusts the length of time to be displayed and the timing of reproducing the voice in the voice reproducing step, and the person who uses the computer has the time axis setting step. In the storage support method, after the setting, the image display in the image display step, the character display in the character display step, and the voice reproduction in the voice reproduction step are executed according to the set conditions. 5. The memory support method according to claim 2, further comprising a voice reproduction speed adjusting step in which a person who uses the computer adjusts a speed of reproducing the voice in the voice reproducing step, A storage support method in which, after a person using the computer makes an adjustment in the voice reproduction speed adjusting step, the voice reproduction in the voice reproducing step is executed according to the adjusted condition. 6. The memory support method according to claim 1, wherein the image display step includes a spatial spread for displaying an image, and the character display step displays character data. After further setting a spatial superimposition rate setting step in which a person who uses the computer adjusts the degree of overlap with the spatial spread to be displayed, the person who uses the computer sets the spatial superimposition rate in the spatial superimposition rate setting step. Is a storage support method in which image display in the image display step and character display in the character display step are executed according to the set conditions. 7. The memory support method according to claim 5, wherein natural sound or music is reproduced at a normal speed in superposition with the speed-adjusted voice reproduction in the voice reproduction step. 8. The memory support method according to claim 1, wherein the plurality of image data have a database structure, and are synonyms, opposite words, grades, and types. A storage support method further comprising an extraction step of cutting out a classification into categories such as different ones, and executing the above-mentioned repeated display for a group of image data extracted in the extraction step. 9. The memory support method according to claim 1, wherein a natural sound or music is reproduced when the memory support method is executed. 10. A language learning support method for supporting language learning using a computer, comprising: an image display step of displaying an image showing contents to be learned on a left side of a display screen of the computer for a predetermined time; A character display step of displaying character data of language information associated with the image displayed in step for a predetermined time on the right side of the display screen of the computer, and repeating the above two steps to obtain a large number of images. And a language learning support method for displaying character data one after another to support language learning of a person using the computer. 11. A language learning support method for supporting language learning using a computer, comprising: an image display step of displaying an image showing contents to be learned on the left side of a display screen of the computer for a predetermined time. A character display step of displaying the character data of the language information associated with the image displayed in the step on the right side of the display screen of the computer for a predetermined time, and a voice that pronounces the character data displayed in the character display step. A voice reproduction step of reproducing, and by repeating the above three steps, a large number of images and character data are displayed one after another and the sound is reproduced to support the language learning of the person using the computer. Language learning support method. 12. The language learning support method according to claim 10, wherein the period for displaying an image in the image displaying step, the length of time for displaying the image, and the character displaying step Further includes a time axis setting step in which a person who uses the computer adjusts the timing of displaying the character data and the length of time to display the character data, and the person who uses the computer sets in the time axis setting step. After that, the language learning support method wherein the image display in the image display step and the character display in the character display step are executed according to the set conditions. 13. The method for supporting language learning according to claim 11, wherein a cycle of displaying an image and a length of time for displaying the image in the image displaying step, and a timing of displaying character data in the character displaying step. And a time axis setting step in which the person who uses the computer adjusts the length of time to be displayed and the timing of reproducing the voice in the voice reproducing step, and the person who uses the computer sets the time axis. In the language learning support method, after the setting in step, the image display in the image display step, the character display in the character display step, and the voice reproduction in the voice reproduction step are executed according to the set conditions. 14. The language learning support method according to claim 11, further comprising a voice reproduction speed adjusting step in which a person who uses the computer adjusts a speed of reproducing the voice in the voice reproducing step. A language learning support method in which a person who uses the computer makes an adjustment in the voice reproduction speed adjusting step, and then performs a voice reproduction in the voice reproducing step according to the adjusted condition. 15. The language learning support method according to claim 10, wherein the image display step comprises a spatial expansion of displaying an image, and the character display step comprises character data. Further comprising a spatial superimposition rate setting step in which a person who uses the computer adjusts the degree of overlap with the spatial spread that displays, and the person who uses the computer sets in the spatial superimposition rate setting step. After that, the language learning support method in which the image display in the image display step and the character display in the character display step are executed according to the set conditions. 16. The language learning support method according to claim 14, wherein a natural sound or music is reproduced at a normal speed by superimposing it on the voice reproduction whose speed is adjusted in the voice reproduction step. . 17. The language learning support method according to claim 10, wherein the plurality of image data have a database structure for each language, and are synonyms, antonyms, A language learning support method further comprising an extraction step of cutting out a classification into categories such as grades and types, and performing the above-described repeated display of a group of image data extracted in the extraction step. 18. The language learning support method according to claim 10, wherein natural sound or music is reproduced when the language learning support method is executed. 19. The method according to claim 1, 2, 3, 4, 5, 6, 7,
A computer program for causing a computer to execute the memory support method described in any one of 8 and 9. 20. Claims 1, 2, 3, 4, 5, 6, 7,
The storage support method according to any one of 8 and 9, wherein the computer is any one of a personal digital assistant (PDA), a game machine, and the like. 21. Claims 10, 11, 12, 13, 1
A computer program for causing a computer to execute the language learning support method described in any one of 4, 15, 16, 17 and 18. 22. Claims 10, 11, 12, 13, 1
The language learning support method according to any one of 4, 15, 16, 17 or 18, wherein the computer is composed of any one of a personal digital assistant (PDA), a game machine and the like. . 23. Claims 1, 2, 3, 4, 5, 6, 7,
8. The memory support method according to any one of 8 and 9, further comprising an image data modification step in which the user executes modification such as addition, modification, or deletion of image data, and the user advances the memory. According to the method, a memory support method capable of modifying image data. 24. Claims 10, 11, 12, 13, 1
The language learning support method according to any one of 4, 15, 16, 17 or 18, further comprising adding image data,
A language learning support method further comprising an image data modification step in which a user executes modification such as change or deletion, and allows the user to modify the image data as the language learning progresses.