JP4985714B2 - Voice display output control device and voice display output control processing program - Google Patents

Description

The present invention also relates voice, text, audio display output controller for data synchronization with the output of an image, and audio display output control processing program.

  2. Description of the Related Art Conventionally, for example, there is a language learning device that outputs language speech and displays its mouth shape.

  In this language learning apparatus, voice information of a native language user and mouth-shaped image data are recorded in a sample data memory in advance by a microphone and a camera. Then, the learner's voice information and mouth-shaped image data are recorded by the microphone and the camera, and the waveforms of the respective voice information of the learner and the native language user recorded in advance in the sample data memory and Corresponding image data of each corresponding mouth shape is displayed in a chart format.

  Thereby, it is intended to clearly analyze and display the difference in language pronunciation between the native language user and the learner (see, for example, Patent Document 1).

JP 2001-318592 A

  Using such a conventional language learning device, it is possible to know the voice of the native language user who is a model and its mouth image, but the accent of each language is mainly the voice of the accent part. However, there is a problem that the timing of accents in each learning language is difficult to understand because there is no clear difference in the mouth image itself.

The present invention has been made in view of the above problems, in the display of a synchronized image to the audio output, the audio display output control device it is possible to represent the timing of the accent clearly, and audio display output control an object of the present invention is to provide a treatment program.

In the voice display output control apparatus according to claim 1 of the present invention, the word storage means stores the correct accented phonetic symbol and the phonetic symbol with error accent of each word in association with each other, and stores the correct and incorrect accent selection means. If you select one of the correct accented phonetic symbols and error accented phonetic symbols for each word, the voice display output control means will respond to the selected correct accented phonetic symbol or error accented phonetic symbol. while outputting the sound audio, and the case where sound sound corresponding to the correct accented phonetic symbol is output, the face image in different display forms in the case where the sound sounds corresponding error accented phonetic symbols are output is displayed, the audio display output control means, including a face image to be displayed Is the portion of the mouth is characterized in that in synchronization with the sound sound output Ru is displayed by changing the image of the mouth type corresponding to the pronunciation speech.

According to this, when either the correct accented phonetic symbol or the error accented phonetic symbol is selected for each word, the pronunciation sound corresponding to the selected correct accented phonetic symbol or the error accented phonetic symbol is selected. Can be output , and the face image can be displayed in different display forms when the pronunciation sound corresponding to the correct accent is output and when the pronunciation sound corresponding to the error accent is output. In this case, the mouth portion included in the displayed image is changed to a mouth-shaped image corresponding to the pronunciation sound and displayed, so the change of the mouth-shaped image corresponding to the pronunciation sound is confirmed. However, you can learn accents more effectively by vision and hearing.

The voice display output control device according to claim 2 of the present invention is the voice display output control device according to claim 1, and further, when the phonetic sound is output, the accented phonetic symbol by the accent detecting means. The accent is detected, and the image displayed by the control of the audio display output control means is changed in synchronization with the detection of the accent by the image change display control means.

According to this, when the pronunciation sound of the word is output, the accent in the accented phonetic symbol of the corresponding word is detected, and the image is changed in synchronization with the detection of the accent. The timing of the accent can be confirmed visually, and the timing of the accent can be learned effectively .

The voice display output control apparatus according to claim 3 of the present invention is the voice display output control apparatus according to claim 1 or 2 , wherein the correct accented phonetic symbol associated with each word by the correct / incorrect accent display control means. The phonetic symbols with error accents can be displayed side by side, and the correct phonetic symbols with correct accents and the phonetic symbols with error accents displayed side by side under the control of the correct / incorrect accent display control means can be selected by the phonetic symbol selection means.

According to this, since the correct accented phonetic symbol and the error accented phonetic symbol are displayed side by side and one of the displayed accented phonetic symbols is selected, the correct accented phonetic symbol and It is possible to effectively learn correct / incorrect accents by visually comparing and confirming phonetic symbols with error accents.

As described above, according to the audio output equipment according to claim 1 of the present invention, by selecting one of or different correct accented phonetic symbols or the error accented phonetic words, on one of the selected While the phonetic voice corresponding to the correct accented phonetic or the error accented phonetic symbol can be output, the phonetic voice corresponding to the correct accent is output and the phonetic audio corresponding to the error accent is output And face images can be displayed in different display forms. In this case, the mouth portion included in the displayed image is changed to a mouth-shaped image corresponding to the pronunciation sound and displayed, so the change of the mouth-shaped image corresponding to the pronunciation sound is confirmed. However, you can learn accents more effectively by vision and hearing.

According to the voice display output control device according to claim 2 of the present invention, when the pronunciation sound of the word is output, the accent in the accented phonetic symbol of the corresponding word is detected, and in synchronization with the detection of the accent Since the image is changed, the accent timing can be confirmed visually as well as the voice, and the accent timing can be learned effectively .

According to the voice display output control device of the present invention , the correct accented phonetic symbol and the error accented phonetic symbol are displayed side by side, and one of the accented phonetic symbols is selected from the displayed ones. Thus, correct correct accented phonetic symbols and erroneous accented phonetic symbols can be visually compared and confirmed to effectively learn correct and incorrect accents.

Therefore, the present invention can provide a display of a synchronized image to the audio output, the audio display output control device it is possible to represent the timing of the accent clearly, and the audio display output control processing program.

The block diagram which shows the structure of the electronic circuit of the portable apparatus 10 which concerns on embodiment of the audio | voice display output control apparatus (image display control apparatus) of this invention. It is a figure which shows the link data for synchronous reproduction | regeneration about one headword "low" among the dictionary databases 12b memorize | stored in the memory 12 of the said portable apparatus 10, The figure (A) shows each file No. and storage destination address. FIG. 4B shows the text data “low” stored according to the text file No., and FIG. 4C shows the text characters and phonetic symbols stored according to the text mouth synchronization file No. The figure which shows a mouth type number. The figure which shows the character image data 12d memorize | stored in the memory 12 of the said portable apparatus 10, and is selectively used by a user setting for the synchronous display of the pronunciation mouth type | mold image in the search for a dictionary word. Mouth image areas (X1, Y1, X2, Y2) of character images (12d: No1 to No3) stored in the memory 12 of the portable device 10 for the synchronous display of pronunciation mouth type images in the dictionary word search The figure which shows the audio | voice separate mouth image data 12e synthesize | combined and displayed. The figure which shows the time code file 12f23 (12i) of the file No23 matched with the headword "low" in the dictionary time code file 12f stored in the memory 12 of the said portable apparatus 10. FIG. The figure which matches and shows the command code | cord | chord of the various commands described in the dictionary time code file 12fn (refer FIG. 5) of the said portable apparatus 10, and the command content analyzed based on the parameter data. The flowchart which shows the main process according to the dictionary processing program 12a of the said portable device 10. 4 is a flowchart showing a headword synchronized reproduction process associated with a main process of the mobile device 10. The flowchart which shows the text corresponding | compatible mouth display process performed by interruption according to the highlight display of each entry word character accompanying the entry word synchronous reproduction | regeneration process of the said portable device. The figure which shows the setting display state of the character image for synchronous reproduction accompanying the character setting process in the main process of the said portable device. The figure which shows the search word display screen G2 accompanying the word search process in the main process of the said portable device. With the synchronous reproduction process in the search term search process of the portable device 10, the search word display window W1 and the pronunciation window display window W2 displayed on the search search word display screen G2 in the setting state of the character image No3. FIG. 6A is a diagram showing the setting display states of the headword character display window W1 and the pronunciation-mouth-type display window W2 for the search headword display screen G2, FIG. Is a diagram showing a change state of the headword character display window W1 synchronized with the output of the pronunciation voice and the pronunciation type display window W2 not corresponding to the accent, and FIG. The figure which shows the change state of the display window W1 and the sounding mouth type | mold display window W2 corresponding to an accent. With the synchronous reproduction process in the search term search process of the portable device 10, the search word display window W1 and the pronunciation window display window W2 displayed on the search search word display screen G2 in the setting state of the character image No1. FIG. 6A is a diagram showing the setting display states of the headword character display window W1 and the pronunciation-mouth-type display window W2 for the search headword display screen G2, FIG. FIG. 7 is a diagram showing a change state of a headword character display window W1 and a pronunciation mouth type display window W2 in synchronization with the output of the pronunciation sound. The figure which shows the search headword display screen G2 at the time of using the English-Japanese dictionary which recorded the pronunciation form of the US / UK two countries with the headword search process in the main process of the said portable device. The headword character display window W1 and the pronunciation window displayed on the search headword display screen G2 when the American pronunciation [US] is designated in accordance with the synchronized playback processing in the headword search processing of the portable device 10. FIG. 6A is a diagram showing the display state of the type display window W2, and FIG. 6A is a diagram showing the setting display state of the headword character display window W1 and the pronunciation type display window W2 for the search headword display screen G2. FIG. 5B is a diagram showing a change state of the headword character display window W1 and the pronunciation window display window W2 synchronized with the output of the American pronunciation sound. The headword character display window W1 and the pronunciation window displayed on the search headword display screen G2 when English pronunciation [English] is designated in accordance with the synchronized playback processing in the headword search processing of the portable device 10. FIG. 6A is a diagram showing the display state of the type display window W2, and FIG. 6A is a diagram showing the setting display state of the headword character display window W1 and the pronunciation type display window W2 for the search headword display screen G2. FIG. (B) is a diagram showing a change state of the headword character display window W1 and the pronunciation opening type display window W2 synchronized with the output of the English pronunciation sound. It is a figure which shows the operation display state at the time of selecting an incorrect answer with the accent test process of the said portable apparatus 10, The figure (A) is a figure which shows the accent test question display screen G3, The figure (B) is a question subject. The figure which shows the setting display state of the headword character display window W1 and the pronunciation type display window W2 for the headword display screen G2 of FIG. The figure which shows the change state of the display window W1 and the sound emission port type display window W2. It is a figure which shows the operation display state at the time of selecting the correct answer with the accent test process of the said portable apparatus 10, The figure (A) is a figure which shows the accent test question display screen G3, The figure (B) is a question subject. The figure which shows the setting display state of the headword character display window W1 and the pronunciation type display window W2 with respect to the headword display screen G2, The figure (C) is the headword character display synchronized with the output of the pronunciation sound of a correct accent. The figure which shows the change state of the window W1 and the sound emission port type display window W2. The flowchart which shows the word-synchronization reproduction | regeneration processing of 2nd Embodiment of the said portable device. 10 is a flowchart showing a headword synchronized reproduction process of the third embodiment of the mobile device 10;

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a configuration of an electronic circuit of a portable device 10 according to an embodiment of an audio display output control device (image display control device) of the present invention.

  This portable device (PDA: personal digital assistants) 10 is configured by a computer that reads a program recorded on various recording media or a program transmitted by communication and whose operation is controlled by the read program. The electronic circuit includes a CPU (central processing unit) 11.

  The CPU 11 is a PDA control program stored in advance in the FLASH memory 12A in the memory 12, or a PDA control program read from the external recording medium 13 such as a ROM card into the memory 12 via the recording medium reading unit 14, or the Internet. The operation of each part of the circuit is controlled in accordance with the PDA control program read into the memory 12 from the other computer terminal (30) on the communication network N such as The stored PDA control program is input on the communication network N received by an input signal corresponding to a user operation from the input unit 17a composed of switches and keys and the coordinate input device 17b composed of a mouse and a tablet, or to the power transmission control unit 15. Communication from other computer terminals (30) No., or the external communication device that is received via the communication unit 16 by the short-range wireless connection or a wired connection using Bluetooth (R) (PC: personal computer) is activated in response to the communication signal from 20.

  The CPU 11 is connected to the memory 12, the recording medium reading unit 14, the power transmission control unit 15, the communication unit 16, the input unit 17a, and the coordinate input device 17b. Are connected to a sound input unit 19a for inputting a sound, a stereo sound output unit 19b for outputting sound with left and right channel speakers L and R, and the like.

  The CPU 11 has a built-in timer for processing time counting.

  The memory 12 of the portable device 10 includes a FLASH memory (EEP-ROM) 12A and a RAM 12B.

  The FLASH memory (EEP-ROM) 12A has network communication for data communication with each computer terminal (30) on the communication network N via the system program that controls the overall operation of the portable device 10 and the power transmission control unit 15. In addition to storing programs, external device communication programs for data communication with an external communication device (PC) 20 via the communication unit 16, schedule management programs, address management programs, and dictionary search and search For synchronized playback of various data such as speech, text, and face images (including mouth-shaped composite images) corresponding to headwords, setting the type of the face image (character), and testing the headword accent Various PDA control programs such as the dictionary processing program 12a are stored.

  Further, the FLASH memory (EEP-ROM) 12A further includes a dictionary database 12b (see FIG. 2), dictionary voice data 12c, character image data 12d (see FIG. 3), and voice separate mouth (type) image data 12e (FIG. 4). And a dictionary time code file 12f (see FIGS. 5 and 6) are stored.

  As the dictionary database 12b, data of various dictionaries such as an English-Japanese dictionary, a Japanese-English dictionary, a national language dictionary, and the like are stored. As shown in FIG. Time code file No and storage destination address for easy synchronized playback of audio, text, and images, HTML file No and storage destination address for setting an image playback window, Text file No and storage destination address, No. and storage address of text mouth synchronization file that associates each character, phonetic symbol, mouth type number of text, No and storage address of sound file that is voice data, data number and storage address of dictionary contents, Each is linked and stored.

  In each embodiment, for phonetic symbols described in the specification, it is difficult to input formal phonetic symbols, so similar characters are substituted, and formal phonetic symbols are described on the drawings.

  FIG. 2 is a diagram showing synchronous reproduction link data for one headword “low” in the dictionary database 12b stored in the memory 12 of the portable device 10, and FIG. A table showing storage destination addresses, FIG. 5B shows the text data “low” stored according to the text file No., and FIG. 4C shows text characters stored according to the text mouth synchronization file No. , Phonetic symbols, mouth type numbers.

  As the dictionary voice data 12c, voice data for pronunciation for each headword in the dictionary database 12b is stored in association with the sound file No. and the address.

  FIG. 3 is a diagram showing character image data 12d that is stored in the memory 12 of the portable device 10 and that is selectively used by user settings for synchronous display of pronunciation-portable images in a dictionary search for a dictionary.

  In this embodiment, three types of character images (face images) No1 to No3 are prepared as the character image data 12d, and each character image No1, No2, No3 has a combined rectangular area of its mouth-shaped image. Mouth image area data (X1, Y1, X2, Y2) for designating as coordinates of two diagonal points are stored in association with each other.

  The three types of character images (face images) No1 to No3 are further accented face images No1 'to No3' (for expressing pronunciation emphasis at the timing of the accent of the found word searched in the dictionary. 12 (C) (2) and FIG. 13 (B) (2)) are stored, and further, American character images No1US to No3US when American or English pronunciation sounds are designated (see FIG. 15). And English character images No1UK to No3UK (see FIG. 16), and accent face images No1US ′ to No3US ′ (see FIG. 15B (2)) and No1UK ′ to No3UK ′ (FIG. 16B (2) Reference) is stored.

  FIG. 4 is stored in the memory 12 of the portable device 10 and is used for the synchronous display of the pronunciation mouth type images in the dictionary word search, the mouth image areas (X1, Y1, X2) of the character images (12d: No1 to No3). , Y2) is a diagram showing voice-specific mouth image data 12e synthesized and displayed.

  As the mouth-specific mouth image data 12e, mouth-shaped images 12e1, 12e2,... Associated with each phonetic symbol required for pronunciation of all headwords stored in the dictionary database 12b are the mouth number No. It is stored in association with n.

  Further, the dictionary time code file 12f stored in the memory 12 of the portable device 10 is used for synchronous reproduction of voice / text / face images (including mouth-shaped composite images) corresponding to the searched words in the dictionary. This command file (see Fig. 5) is prepared not for every headword but for each headword that has the same number of characters, number of phonetic symbols, and pronunciation timing, and is compressed and encrypted using a predetermined algorithm. Has been.

  FIG. 5 is a diagram showing a time code file 12f23 (12i) of the file No. 23 associated with the headword “low” in the dictionary time code file 12f stored in the memory 12 of the portable device 10.

  In the time code file 12fn, a time code for performing command processing for synchronously reproducing various data (speech, text, and images) at a reference processing unit time (for example, 25 ms) at a predetermined time interval described and set as header information H in advance. Each time code is a reference number or a specified numerical value for associating a command code indicating an instruction with data contents (text file / sound file / image file etc.) related to the command. It is comprised by the combination with the parameter data which consists of.

  For example, the file playback time by the time code file 12f23 of the headword “low” shown in FIG. 5 is 1 second after a playback process consisting of a time code of 40 steps when a preset reference processing unit time is 25 ms. Become.

  FIG. 6 is a diagram in which command codes of various commands described in the dictionary time code file 12fn (see FIG. 5) of the portable device 10 are associated with instruction contents to be analyzed based on parameter data thereof.

  Commands used for the time code file 12fn include standard commands and extended commands. The standard commands include LT (i-th text load). VD (i-th text phrase display). BL (Character counter reset / i-th phrase block designation). HN (no highlight, character counter count up). HL (up to i-th character, character count). LS (1 line scrolling / character counter count up). DH (i-th HTML file display). DI (i-th image file display). PS (i-th sound file play). CS (Clear All File). PP (pause for basic time i seconds). FN (end of processing). There are NP (invalid) commands.

  Further, in the RAM 12B in the memory 12, a search word memory 12g in which a search word associated with the search processing of the dictionary database 12b is read and stored according to the search word number corresponds to the searched search word. Dictionary data memory 12h, in which dictionary data such as meaning contents to be read is read out from the dictionary database 12b according to the dictionary data number and stored, and voice / text / image synchronization corresponding to the searched entry A reproduction time code file 12fn (see FIG. 5) for reproduction is read out from the dictionary time code file 12f according to the time code file No in the dictionary database 12b, decompressed, decoded and stored. A memory 12i is prepared.

  Further, in the RAM 12B in the memory 12, HTML files for setting the text / image synchronous reproduction windows W1 and W2 (see FIGS. 12 and 13) on the headword search screen G2 are stored in the dictionary database. A synchronization HTML file memory 12j that is read from and stored in accordance with the HTML file No. 12b, and a text file memory for synchronization in which the search headword text data is read from the dictionary database 12b and stored in accordance with the text file No. 12k, synchronization sound file memory 12m in which the pronunciation sound data of the search headword is read out from the dictionary sound data 12c and stored according to the sound file No in the dictionary database 12b, and the pronunciation image of the search headword Character image set by user for display A synchronization image file memory 12n that is read out from the character image data 12d (see FIG. 3) and stored, and a mouth that indicates a composition area of the mouth image in the character image stored in the synchronization image file memory 12n Mouth image area memory 12p in which image area data (X1, Y1; X2, Y2) are stored, and voice / text according to time code file 12fn corresponding to the search headword stored in time code file memory 12i An image expansion buffer 12q or the like is prepared in which a character image to be synchronized and a mouth image are expanded and synthesized and stored.

  That is, the entry word searched by activating the dictionary processing program 12a stored in the FLASH memory 12A of the portable device (PDA) 10 is “low”, and in the dictionary time code file 12f corresponding to this The time code file 12f read from and stored in the reproduction time code file memory 12i is, for example, the time code file 12f23 shown in FIG. 5, and the third command code “ When “DI” and parameter data “00” are read, this command “DI” is the i-th image file display command, and is stored in the synchronization image file 12n linked from the parameter data i = 00. The character image 12dn is read and displayed.

  When the fourth command code “PS” and parameter data “00” are read in accordance with the command processing for each set processing unit time, this command “PS” is the i-th sound file playback command. The audio data 12cn stored in the synchronization sound file 12m linked from the parameter data i = 00 is read and output.

  When the sixth command code “VD” and parameter data “00” are read in accordance with the command processing for each set processing unit time, this command “VD” is the i-th text phrase display command. According to the parameter data i = 00, the 0th clause of the text (in this case, the text file “low” of the search word stored in the synchronization text file memory 12k is displayed.

  Further, when the ninth command code “NP” and parameter data “00” are read in accordance with the command processing for each set processing unit time, this command “NP” is an invalid instruction, and therefore the current file output State is maintained.

  The detailed operation of the synchronized playback of pronunciation speech / text / image (mouth-shaped image) corresponding to the search word based on the time code file 12f23 (12i) having the file contents shown in FIG. 5 will be described later. I will explain it again.

  Next, various operations performed by the mobile device 10 having the above-described configuration will be described.

  FIG. 7 is a flowchart showing main processing according to the dictionary processing program 12a of the portable device 10.

  FIG. 8 is a flowchart showing a headword synchronized reproduction process accompanying the main process of the portable device 10.

  FIG. 9 is a flowchart showing a text corresponding mouth display process executed by interruption in accordance with the highlight display of each entry word character accompanying the entry synchronized playback process of the portable device 10.

  FIG. 10 is a diagram showing a setting display state of the character image for synchronous reproduction accompanying the character setting process in the main process of the portable device 10.

  When the character image setting mode is switched by operating the “setting” key 17a1 and the cursor key 17a2 of the input unit 17a (step S1 → S2), for example, three types of character image data 12d1 (No1) stored in the FLASH memory 12A ), 12d2 (No2), 12d3 (No3) [see FIG. 3] are read and displayed on the display unit 18 as a character image list selection screen G1, as shown in FIG. 10 (step S3).

  In this character image list selection screen G1, the selection frame X of each character image is moved by the operation of the cursor key 17a3 to select a user desired character image (for example, 12d3 (No 3)). When the selection of the character image is detected by the determination operation using the (voice) key 17a4 (step S4), the character image 12dn detected by the selection is read out and stored in the synchronization image file memory 12n in the RAM 12B. (Step S5). Mouth image area data (X1, Y1; X2, Y2) indicating the synthesized area of the mouth-shaped image of the character image 12dn that has been selected and detected is also read out and transferred to the mouth image area memory 12p in the RAM 12B. (Step S6).

  Thus, the character image to be synthesized with the mouth-shaped image to be displayed in synchronization with the pronunciation sound of the headword is selected and set along with the headword search.

  FIG. 11 is a diagram showing a search word entry display screen G2 accompanying the word search process in the main process of the portable device 10.

  For example, in order to perform a headword search based on dictionary data of an English-Japanese dictionary stored in the dictionary database 12b, after setting the English-Japanese dictionary search mode by operating the "English-Japanese" key 17a5 of the input unit 17a, the search target Is entered (for example, “low”) (steps S 7 → S 8), a plurality of headwords that match and match the input headword are searched from the dictionary data of the English-Japanese dictionary. Then, it is read out and displayed on the display unit 18 as a list of search terms (not shown) (step S9).

  In this search headword list screen, the headword (in this case, “low”) that matches the search target headword input by the user is selected and designated by the cursor key, and the “translation / decision (voice)” key 17a4 Is operated (step S10), the selected and detected headword "low" is stored in the headword memory 12g in the RAM 12B, and the pronunciation / part of speech / corresponding to the headword "low" is stored. Dictionary data such as meaning contents is read out and stored in the entry word corresponding dictionary data memory 12h in the RAM 12B, and displayed on the display unit 18 as a search entry display screen G2 as shown in FIG. S11).

  Here, for the headword “low” displayed in the search, the pronunciation voice is output, and at the same time, the character, phonetic symbol and pronunciation mouth image of the headword are synchronously displayed. When the “/ decision (voice)” key 17a4 is operated (step S12), the process proceeds to the synchronous reproduction process in FIG. 8 (step SA).

  FIG. 12 shows a headword character display window W1 displayed on the search headword display screen G2 in the setting state of the character image No3 in accordance with the synchronous reproduction processing in the headword search processing of the portable device 10 and the pronunciation type. It is a figure which shows the display state of the display window W2, The figure (A) is a figure which shows the setting display state of the headword character display window W1 and the pronunciation type display window W2 with respect to the search headword display screen G2. (B) is a diagram showing a change state of the headword character display window W1 synchronized with the output of the pronunciation sound and the pronunciation type display window W2 not corresponding to the accent, and FIG. It is a figure which shows the change state of the spoken word display window W1 and the pronunciation opening type | mold display window W2 corresponding to an accent.

  When the synchronous reproduction process (step SA) in FIG. 8 is started in accordance with the operation of the “translation / decision (voice)” key 17a4 in the state where the search headword display screen G2 is displayed, Initialization processing such as clear processing of each work area is performed (step A1). First, the synchronous reproduction link data (refer to FIG. 2) for the current search term “low” stored in the dictionary database 12b is stored. Based on the headword search screen G2, the HTML file for setting the synchronous playback windows W1 and W2 (see FIG. 12) of the text / image is read according to the HTML file No3 and written to the synchronization HTML file memory 12j. It is. In addition, the text data “low (with phonetic symbol)” of the search headword is read according to the text file No 4222 and written into the synchronization text file memory 12k. Further, the pronunciation voice data of the search headword is read according to the sound file No 4222 and written into the synchronization sound file memory 12m (step A2).

  It should be noted that the character image (in this case, 12d3 (No 3)) set by the user for displaying the search headline pronunciation image is already stored in the character image data 12d (see FIG. 3) in accordance with step S5 accompanying the character setting process. It is read from the inside and written to the synchronization image file memory 12n, and the mouth image area data (X1, Y1; X2, Y2), which is the pronunciation mouth type image composition area in the character image 12d3 (No3), is also set in the character setting. According to step S6 accompanying the process, it has already been written in the mouth image area memory 12p.

  Then, from the time code file 12fn for synchronized playback of encrypted voice / text / image corresponding to various headwords stored as the dictionary time code file 12f in the FLASH memory 12A, the current search headword The time code file 12f23 (see FIG. 5) corresponding to “low” is decoded and read according to the time code file No23 described in the synchronous reproduction link data (see FIG. 2), and the time in the RAM 12B is read. It is transferred and stored in the code file memory 12i (step A3).

  In this way, the setting of reading various files for synchronous reproduction of the pronunciation voice / text / speaking mouth type image corresponding to the search headword “low” into the RAM 12B and the time code file 12f23 for synchronous reproduction of these files. When the transfer setting to the RAM 12B is completed, the processing unit time (for example, 25 ms) by the CPU 11 of the time code file (CAS file) 12f23 (see FIG. 5) stored in the time code file memory 12i is the header of the time code file 12f23. Information H is set (step A4).

  A read pointer is set at the head of the time code file 12f23 stored in the time code file memory 12i, and at the top of various files written in the synchronization file memories 12j, 12k, 12m, and 12n. Is set (step A5), and a timer for timing the reproduction processing timing of each synchronous file is started (step A6).

  In step A6, when the processing timer is started, the read pointer set in step A5 is set every processing unit time (25 ms) corresponding to the current time code file 12f23 set in step A4. The command code and parameter data of the time code file 12f23 (see FIG. 5) at the initial position are read (step A7).

  Then, it is determined whether or not the command code read from the time code file 12f23 (see FIG. 5) is “FN” (step A8). If “FN” is determined, the synchronization is performed at that time. A reproduction process stop process is instructed (step A8 → A9).

  On the other hand, when it is determined that the command code read from the time code file 12f23 (see FIG. 5) is not “FN”, processing corresponding to the content of the command code (see FIG. 6) is executed. (Step A10).

  When it is determined that the time measured by the timer has reached the next processing unit time (25 ms), the read pointer for the time code file 12f23 (see FIG. 5) stored in the RAM 12B moves to the next position. Set (step A11 → A12), and the process from reading the command code and its parameter data in the time code file 12f23 (see FIG. 5) at the position of the read pointer in step A7 is repeated (steps A12 → A7 to A10). .

  Here, the synchronized playback output operation of the pronunciation voice / text / speech mouth type image file based on the time code file 12f23 of the search word “low” shown in FIG. 5 will be described in detail.

  That is, the time code file 12f23 is a command process executed every (reference) processing unit time (for example, 25 ms) preset in the header H. First, the time code file 12f23 (see FIG. 5). When the first command code “CS” (clear all file) and its parameter data “00” are read out, an instruction to clear the output of all the files is given, and the output of the text / audio / image file is cleared ( Step A10).

  When the second command code “DH” (i-th HTML file display) and its parameter data “00” are read, synchronization in the RAM 12B is performed according to the parameter data (i = 0) read together with the command code DH. The headword text / image frame data of the HTML data is read from the HTML file memory 12j, and the text / image is synchronized on the headword search screen G2 with respect to the display unit 18 as shown in FIG. Playback windows W1 and W2 are set (step A10).

  When the third command code “DI” (i-th image file display) and its parameter data “00” are read, synchronization in the RAM 12B is performed according to the parameter data (i = 0) read together with the command code DI. The character image 12d (No. 3 in this case) set and stored in the character setting process (steps S2 to S6) is read from the image file memory 12n, and as shown in FIG. The image is displayed in the synchronized playback window W2 for the image set in the HTML file on the screen G2 (step A10).

  When the fourth command code “PS” (i-th sound file play) and its parameter data “00” are read, synchronization in the RAM 12B is performed according to the parameter data (i = 0) read together with the command code PS. The pronunciation sound data corresponding to the search headword “low” set and stored in the step A2 is read from the sound file memory 12m, and the sound output from the stereo sound output unit 19b is started (step A10). .

  When the fifth command code “LT” (i-th text load) and its parameter data “00” are read, the synchronization data in the RAM 12B is read according to the parameter data (i = 0) read together with the command code LT. Text data “l”, “o”, “w” (including phonetic symbols) corresponding to the search headword “low” set and stored in step A2 is specified in the text file memory 12k (step A10). ).

  When the sixth command code “VD” (i-th text phrase display) and its parameter data “00” are read, the fifth command is determined according to the parameter data (i = 0) read together with the command code VD. The text data “l”, “o”, “w” (including phonetic symbols) specified according to the code “LT” is read out, and as shown in FIG. Are displayed in the text synchronized playback window W1 (step A10).

  When the seventh command code “BL” (character counter reset / i-th clause block designation) and its parameter data “00” are read, the character of the search term “low” being displayed in the text synchronous playback window W1 The counter is reset (step A10).

  When the eighth command code “HL” (highlight / character count up to i-th character) and its parameter data “01” are read, the parameter data (i = 1) read together with the command code HL is read. Then, as shown in FIG. 12A, the first character “l” in the search headword “low” (including phonetic symbols) displayed in the text synchronous playback window W1 and the pronunciation corresponding thereto. Up to the symbol, highlight (identification) display HL by color change display, reverse display, underline display, etc. is performed, and the character counter counts up to the second character and the corresponding phonetic symbol (step A10).

  At the time of highlight (identification) display for each character of the search headword “low” and its corresponding phonetic symbol by the time code file 12f23, the text corresponding mouth display processing in FIG. 9 is interrupted.

  That is, when the character “l” of the search headword “low” that is highlighted (identified) HL this time is detected (step B1), the pronunciation type image corresponding to the detected character “l” is converted into the dictionary. According to the mouth number “36” corresponding to the text “l” indicated by the text mouth synchronization file (see FIG. 2C) in the database 12b, the pronunciation mouth type is selected from the speech-specific mouth image data 12e (see FIG. 4). It is read out as image 12e2 (No36) (step B2). Then, the pronunciation type image 12e2 (No36) for the character “l” of the search headword “low” displayed in this highlight (identification) is shown in FIG. 12 (A) (FIG. 12 (B) (1)). As shown, the mouth image area memory 12p in the RAM 12B stores the mouth image composition area of the character image 12d (No 3) displayed in the image synchronized playback window W2 on the headword search screen G2. Are synthesized and displayed according to the mouth image area (X1, Y1; X2, Y2) (step B3).

  Here, it is determined whether or not there is an accent mark for the phonetic symbol of the current highlight (identification) display text “l” indicated by the text mouth synchronization file (see FIG. 2C) (step B4). In the case of the phonetic symbol [l] of the highlight (identification) display text “l”, it is determined that there is no accent mark, so that the character image 12d (No 3) is kept displayed as its normal face image. (Step B4 → B5).

  If it is determined that there is an accent mark, the character image 12d (No. 3) is changed to an accent face image No. 3 ′ (see FIGS. 12C and 12) for pronunciation emphasis expression. (Step B4 → B6).

  Then, the output timing of pronunciation sound data corresponding to the search headword “low” started to be output from the stereo sound output unit 19b according to the fourth command code “PS”, and the processing unit by the time code file 12f23 Since the time code file 12f23 is created in association with the identification display timing for each character of the search headword “low” corresponding to the time (25 ms), the search headword “low” is created. In the case of the identification display of the first character “l” and the synthesizing display of the sound mouth image 12e (No. 36), the pronunciation sound that reads out the corresponding phonetic symbol is synchronously output.

  As a result, the identification display of the first character “l” of the search headword “low”, the synthesis display of the pronunciation mouth image 12e3 (No36) to the set character image 12d (No3), and the output of the pronunciation sound Are performed synchronously.

  When the ninth command code “NP” is read out, the character image and text data synchronous display screen corresponding to the current search headword “low” and the synchronized output state of the pronunciation voice data are maintained.

  Thereafter, in accordance with the twelfth command code “HL” and the thirty-fifth command code “HL”, as shown in FIGS. 12 (C) (2) and 12 (C) (3), in the text synchronous playback window W1, The text data “low” of the search headword and its phonetic symbol are sequentially high, such as the second character “o” and the phonetic symbol [o], the third character “w” and the phonetic symbol [u]. The light (identification) display HL is displayed (step A10). At the same time, in the image synchronous reproduction window W2, the mouth image area (X1, Y1; X2, Y2) of the set character image 12d (No3) is synthesized in accordance with the mouth display processing corresponding to the text in FIG. The phonetic mouth type image also corresponds to the mouth mouth type file 12e (No8) corresponding to the mouth number 8 and the sounding mouth type image 12e (No8) corresponding to the mouth number 8 in accordance with the text mouth synchronization file (see FIG. ) Are read out from the voice-specific mouth image 12e, and are sequentially synthesized and displayed synchronously (steps B1 to B3).

  Furthermore, the pronunciation sound data of the search headword “low” output from the stereo sound output unit 19b in response to the fourth command code “PS” is also highlighted (identification) of the text “low” and its pronunciation symbol. ) The sound of reading out the display part is sequentially output synchronously.

  It should be noted that each sound mouth type image 12e (No36) by the text corresponding mouth display processing synchronized with the highlight (identification) display HL for each character “l”, “o”, “w” of the search headword “low”. In the composite switching display (steps B1 to B5) for the set character image 12d (No3) of 12e (No9) → 12e (No8), as shown in FIG. "And the phonetic symbol image 12e (No. 9) in combination with the highlight (identification) display HL of the phonetic symbol, it is determined that the phonetic symbol of the highlight (identification) display text" o "has an accent mark. Therefore, as shown in FIG. 12C (2), the character image 12d (No 3) at this time is changed to the accent face image No 3 ′ for pronunciation emphasis expression and displayed (S -Up B4 → B6).

  That is, when the combined display of the highlight (identification) display HL synchronized with the output of the pronunciation speech for the accent character “o” of the search headword “Low” shown in FIG. The normal set character (face) image 12d (No. 3) shown in FIG. 12 (B) (2), which is the composition destination of the mouth image 12e (No. 9), is shown in FIG. 12 (C) (2). For example, since the face image 12d (No 3 ′) corresponding to an accent representing a state of strong pronunciation due to sweating of the head or heels of the mouth is displayed, the user can pronounce the search sound word “Low” and its sound The utterance timing and the corresponding portions of the letters “L”, “o”, “w” and their phonetic symbols, as well as the phonetic mouth type images 12e (No36 → No9 → No8) can be easily learned by their respective synchronized playback. Not, the speech emphasizes timing will be able to learn in real depending on the accent.

  FIG. 13 shows a headword character display window W1 and a pronunciation type that are displayed on the search headword display screen G2 in the setting state of the character image No1 in accordance with the synchronized playback processing in the headword search processing of the portable device 10. It is a figure which shows the display state of the display window W2, The figure (A) is a figure which shows the setting display state of the headword character display window W1 and the pronunciation type display window W2 with respect to the search headword display screen G2. (B) is a figure which shows the change state of the headword character display window W1 and the pronunciation window display window W2 which synchronized with the output of the pronunciation sound.

  That is, in the character setting process in steps S1 to S6 in FIG. 7, the animation style is selected from the three types of character image data 12d (No1), 12d (No2), 12c (No3) [see FIG. 3] stored in advance. In the state in which the character image 12d (No1) is selected and set, the headword search processing and synchronous playback processing for the headword “low” to be searched are performed as in Steps S7 to SA, and the text correspondence in FIG. When the mouth display processing is performed, as shown in FIG. 13A and FIG. 13B, the search word “window” on the search word display window W1 for the search word display screen G2 is displayed. "Low" and the highlight (identification) display HL synchronized with the sound output of the phonetic symbols are sequentially performed. Accordingly, the sound output type display window W2 uses the animated character image 12d (No. 1) set in the character setting process (steps S1 to S6) as a basic face image and outputs the sound output and text ( Each of the sound source type images 12e (No. 36 → No. 9 → No. 8) synchronized with the highlight display HL (including phonetic symbols) is sequentially switched and combined and displayed.

  Then, as shown in FIG. 13 (B) (2), the pronunciation mouth type image 12e accompanying the highlight (identification) display HL of the second character “o” of the search headword “low” and its pronunciation symbol. When (No9) is compositely displayed, it is determined that there is an accent mark in the phonetic symbol of the highlight (identification) display text “o”, so that the animation character image 12d (No1) at this time is pronounced emphasis expression The accent face image No1 ′ is changed to be displayed (step B4 → B6).

  That is, the highlight (identification) display synchronized with the output of the pronunciation voice for the accent character “o” of the search headword “Low” when the anime-like character image 12d (No1) shown in FIG. 13 is selected and set. When switching and displaying the HL and the pronunciation mouth image 12e (No9), the normal animation character (face) image 12d (No1), which is the composition destination of the mouth image 12e (No9), is, for example, sweating of the head. Or the accent-corresponding face image 12d (No1 ') representing a state of strong pronunciation due to body shake, the user can pronounce the search headline "Low", its utterance timing, and each character. Corresponding portions of “L”, “o”, “w” and their phonetic symbols, as well as each phonetic mouth type image 12e (No36 → No9 → No8), for their respective synchronized playback Ri easily not only be learning, the speech emphasizes timing will be able to learn in real depending on the accent.

  In the synchronous reproduction process of the text, pronunciation sound, and pronunciation mouth image associated with the headword search described with reference to FIGS. 11 to 13, the contents of the English-Japanese dictionary data stored in advance as the dictionary database 12b are: Although the case where the content corresponds only to the pronunciation of one American country has been described, for example, as described with reference to FIGS. 14 to 16, the content of English-Japanese dictionary data stored in advance as the dictionary database 12b If the phonetic content has content corresponding to the pronunciation of two countries, American and English, specify the pronunciation form of either one of the American or British languages and use the text, pronunciation, and pronunciation Mouth-shaped image synchronous reproduction processing may be performed.

  FIG. 14 is a diagram showing a search headword display screen G2 when an English-Japanese dictionary containing pronunciation forms of two countries of the United States / UK is used in the headword search process in the main process of the mobile device 10. .

  In order to search for a word based on dictionary data of an English-Japanese dictionary that records pronunciation forms of, for example, two countries of the US / UK stored in the dictionary database 12b, the “English-Japanese” key 17a5 of the input unit 17a is operated. After the search mode of the English-Japanese dictionary is set, when a search word (for example, “law”) is input (step S7 → S8), a plurality of matching words and matching characters at the head are entered. The headwords are retrieved from the dictionary data of the English-Japanese dictionary and read out, and displayed on the display unit 18 as a list of search headwords (not shown) (step S9).

  On this search headword list screen, the headword (in this case, “laugh”) that matches the search target headword input by the user is selected and instructed by the cursor key, and the “translation / decision (voice)” key 17a4. Is operated (step S10), the selected and detected headword “laugh” is stored in the headword memory 12g in the RAM 12B, and the US / UK corresponding to the headword “laugh” is stored. Dictionary data such as pronunciation / parts of speech / meaning contents of the two countries is read out and stored in the dictionary data memory 12h corresponding to the entry word in the RAM 12B. As shown in FIG. 14, the display unit is displayed as the search entry display screen G2. 18 (step S11).

  Here, at the same time as outputting the pronunciation sound of either the American pronunciation [laef] or the English pronunciation [la: f] of the headword “laugh” displayed in the search, In order to synchronize and display the headword characters, phonetic symbols and pronunciation mouth images corresponding to the US dialect or English dialect identifier [US] displayed in the dictionary data on the search headword display screen G2 When either [English] is specified (step S11a) and the “translation / decision (voice)” key 17a4 is operated (step S12), the process proceeds to the synchronous reproduction process in FIG. 8 (step SA). ).

  FIG. 15 shows a headword character display window W1 displayed on the search headword display screen G2 when the American pronunciation [US] is designated in accordance with the synchronized playback processing in the headword search processing of the portable device 10. FIG. 6A shows the display state of the pronunciation window type display window W2, and FIG. 9A shows the setting display state of the word entry character display window W1 and the pronunciation window type display window W2 with respect to the search word entry display screen G2. FIG. 6B is a diagram showing a change state of the headword character display window W1 and the pronunciation-mouth type display window W2 synchronized with the output of the American pronunciation sound.

  That is, either the US dialect or the English dialect identifier [US] or [English] displayed in the dictionary data on the search headword display screen G2 is designated, and the process proceeds to the synchronous playback process in FIG. Then, in step A2 of the synchronous reproduction process, for example, when the US dialect identifier [US] is designated, it corresponds to the animation character image 12d (No1) set in advance in the character setting process (steps S2 to S6). Then, the American character image 12d (No1US) is read and transferred to the synchronization image file memory 12n in the RAM 12B. At the same time, based on the link data for synchronous reproduction (see FIG. 2) for the current search headword “laugh” stored in the dictionary database 12b, the text / image is synchronously reproduced on the headword search screen G2. An HTML file for setting the windows W1 and W2 (see FIG. 15) is read according to the HTML file No and written to the synchronization HTML file memory 12j. In addition, the text data “search (with the American dialect phonetic symbol)” of the search headword is read according to the text file No and written into the synchronization text file memory 12k. In addition, pronunciation voice data of the American dialect of the search headword is read according to the sound file No and written into the sound file memory for synchronization 12m (step A2).

  Then, from the time code file 12fn for synchronized playback of encrypted voice / text / image corresponding to various headwords stored as the dictionary time code file 12f in the FLASH memory 12A, the current search headword The time code file 12fn (see FIG. 5) corresponding to “law” is decoded and decoded according to the time code file No described in the synchronous reproduction link data (see FIG. 2), and the time in the RAM 12B is read. It is transferred and stored in the code file memory 12i (step A3).

  In the case where the synchronized playback processing of the pronunciation voice / word word character / speech mouth image according to the time code file 12fn corresponding to the search word “laugh” is the search word “low” already described. In the same manner as described above, when the reproduction process corresponding to each command code in steps A7 to A12 and the text corresponding mouth display process in FIG. 9 are started, the text synchronized reproduction window W1 on the search word display screen G2 includes The phonetic symbol of the US dialect is displayed together with the search headword “laugh”, and the character synchronization image for American English designed to have, for example, the US flag F in the image-synchronized playback window W2 12d (No1US) is displayed as the target image for the mouth image synthesis.

  As a result, in synchronism with the output of the pronunciation of the American dialect of the search headword “law”, as shown in FIGS. 15 (B) (1) to (3), the text synchronous playback window W1 The word “laugh” and the highlight (identification) display HL from the first character of the phonetic symbol are sequentially displayed, and in the image synchronous reproduction window W2, the mouth of the character image 12d (No1US) is used as a base. For the image area (X1, Y1; X2, Y2), the sound mouth type image 12e (Non1 → Non2 → Non3) corresponding to the mouth number of each phonetic symbol is read out from the mouth image data 12e according to sound and switched sequentially. It is synthesized and displayed.

  In this case as well, according to the same text corresponding mouth display process, the highlight (identification) display HL synchronized with the output of the pronunciation sound for the accent character “au” of the search headword “Laugh”, the pronunciation type image 12e At the time of switching composition display of (Non2), the American character (face) image 12d (No1US), which is the composition destination of the mouth image 12e (Non2), is pronounced strongly by, for example, sweating of the head or shaking of the body. Since the face image 12d (No1US ') corresponding to the accent representing the state is displayed, the user can pronounce the pronunciation voice of the US dialect of the search headword “Laugh”, its utterance timing, and each letter “L” “au” “ gh "and the corresponding part of the phonetic symbol, and further each of the phonetic mouth type images 12e (Non1-> Non2-> Non3) Not only can be easily learned by the raw, the speech emphasizes timing will be able to learn in the real according to the US dialect accent.

  FIG. 16 shows a headword character display window W1 displayed on the search headword display screen G2 when English pronunciation [English] is designated in accordance with the synchronized playback processing in the headword search processing of the portable device 10. FIG. 6A shows the display state of the pronunciation window type display window W2, and FIG. 9A shows the setting display state of the word entry character display window W1 and the pronunciation window type display window W2 with respect to the search word entry display screen G2. FIG. 4B is a diagram showing a change state of the headword character display window W1 and the pronunciation type display window W2 synchronized with the output of the English pronunciation sound.

  That is, among the dialect identifiers [US] or [English] displayed in the dictionary data on the search word display screen G2 shown in FIG. 14, for example, the English dialect identifier [English] is designated. When the process proceeds to the synchronized playback process (step SA) in FIG. 8 (step S11a), in step A2 of the synchronized playback process, the animation character image preset in the character setting process (steps S2 to S6). The English character image 12d (No1UK) is read in correspondence with 12d (No1) and transferred to the synchronization image file memory 12n in the RAM 12B. At the same time, based on the link data for synchronous reproduction (see FIG. 2) for the current search headword “laugh” stored in the dictionary database 12b, the text / image is synchronously reproduced on the headword search screen G2. The HTML file for setting the windows W1 and W2 (see FIG. 16) is read according to the HTML file No and written to the synchronization HTML file memory 12j. In addition, the text data “search (with English dialect phonetic symbols)” of the search headword is read according to the text file No. and written into the synchronization text file memory 12k. Also, the pronunciation voice data of the English dialect of the search headword is read according to the sound file No and written into the sound file memory for synchronization 12m (step A2).

  Then, from the time code file 12fn for synchronized playback of encrypted voice / text / image corresponding to various headwords stored as the dictionary time code file 12f in the FLASH memory 12A, the current search headword The time code file 12fn (see FIG. 5) corresponding to “law” is decoded and decoded according to the time code file No described in the synchronous reproduction link data (see FIG. 2), and the time in the RAM 12B is read. It is transferred and stored in the code file memory 12i (step A3).

  In the case where the synchronized playback processing of the pronunciation voice / word word character / speech mouth image according to the time code file 12fn corresponding to the search word “laugh” is the search word “low” already described. In the same manner as described above, when the reproduction process corresponding to each command code in steps A7 to A12 and the text corresponding mouth display process in FIG. 9 are started, the text synchronized reproduction window W1 on the search word display screen G2 includes The phonetic symbol of the English dialect is displayed together with the search headline “laugh”, and the image synchronized playback window W2 has a design that has a walking stick M2 wearing, for example, a British cap M1 with a set anime-like character image. An English character image 12d (No1UK) is displayed as a target image for mouth-shaped image synthesis.

  As a result, in synchronization with the pronunciation voice output of the English dialect of the search headword “law”, as shown in FIGS. 16 (B) (1) to (3), the text synchronous playback window W1 The word “laugh” and the highlight (identification) display HL from the first character of the phonetic symbol are sequentially displayed, and in the image synchronous reproduction window W2, the English character image 12d (No1UK) is used as a base. For the image area (X1, Y1; X2, Y2), the sound mouth type image 12e (Non1 → Non2 → Non3) corresponding to the mouth number of each phonetic symbol is read out from the mouth image data 12e according to sound and switched sequentially. It is synthesized and displayed.

  In this case as well, according to the same text corresponding mouth display process, the highlight (identification) display HL synchronized with the output of the pronunciation sound for the accent character “au” of the search headword “Laugh”, the pronunciation type image 12e At the time of switching composition display of (Non2), the English character (face) image 12d (No1UK), which is the composition destination of the mouth image 12e (Non2), is pronounced strongly by, for example, sweating of the head or shaking of the body. Since the face image 12d (No1UK ') corresponding to the accent representing the state is displayed, the user can pronounce the pronunciation of the English dialect of the search headword "Laugh", its utterance timing, and the letters "L", "au", " gh "and the corresponding part of the phonetic symbol, and further each of the phonetic mouth type images 12e (Non1-> Non2-> Non3) Not only can be easily learned by the raw, the speech emphasizes timing will be able to learn in real depending on the accent of the British dialect.

  Next, with reference to the main process of the mobile device 10 having the above-described configuration, for example, an accent test process capable of performing a test for applying a correct / incorrect answer of an English word accent will be described.

  FIG. 17 is a diagram showing an operation display state when an incorrect answer is selected in accordance with the accent test process of the mobile device 10, and FIG. 17A shows an accent test question display screen G3, and FIG. Is a diagram showing the setting display state of the headword character display window W1 and the pronunciation window display window W2 with respect to the headword display screen G2 of the subject, and FIG. It is a figure which shows the change state of the outgoing character display window W1 and the pronunciation window type display window W2.

  FIG. 18 is a diagram showing an operation display state when a correct answer is selected in accordance with the accent test process of the mobile device 10, where FIG. 18A shows an accent test question display screen G3, and FIG. The figure which shows the setting display state of the headword character display window W1 and the pronunciation window type display window W2 with respect to the headword display screen G2 of a question subject, The figure (C) is the headword synchronized with the output of the pronunciation sound of a correct answer accent. It is a figure which shows the change state of the word character display window W1 and the pronunciation window type display window W2.

  That is, when the “accent test” key 17a6 in the input unit 17a is operated to set the accent test mode (step S13), a found word is randomly selected from the dictionary data stored in advance in the dictionary database 12c. (Step S14), as shown in FIG. 17 (A), for the randomly selected word “low”, a correct accent phonetic symbol with an accent in the “o” part and an incorrect accent with an accent in the “u” part. An accent test question display screen G3 with the phonetic symbols as selection items Et / Ef is displayed on the display unit 18 (step S15).

  In this accent test question display screen G3, when the selection frame X is moved by operating the cursor key 17a2, and a selection item Ef having a phonetic symbol with an incorrect accent is selected and detected (step S16), the character setting process ( In step S2 to S6), the character image and its related image (in this case, the anime-like character image 12d (No1) and its accent corresponding image (No1 ')) that have been selected and set in advance as the synthesis destination of the pronunciation mouth type image are For example, the yellow normal color is changed to the blue character image (No1BL) (No1BL ′) (steps S17 → S18).

  At the same time, the phonetic voice data read out from the dictionary voice data 12c corresponding to the question word “low” is corrected to voice data corresponding to the phonetic symbol of the erroneous accent selected by the user (step S19). ).

  Then, the question word “low” is stored in the headword memory 12g in the RAM 12B, and dictionary data such as pronunciation / part of speech / semantic content corresponding to the headword “low” is read out and stored in the RAM 12B. It is stored in the entry word corresponding dictionary data memory 12h and displayed on the display unit 18 as a search entry word display screen G2 corresponding to the question word as shown in FIG. 17B (step S20).

  Here, for the accented question word “low” selected by the user, at the same time that the pronunciation sound is output, the character of the found word, the pronunciation symbol, and the mouth-shaped image of the pronunciation are displayed in synchronization. When the “translation / decision (voice)” key 17a4 is operated (step S21), the process proceeds to the synchronous reproduction process in FIG. 8 (step SA).

  Then, in step A2 of the synchronous reproduction process, the animation character image 12d (No1BL) changed to blue according to the user selection of the wrong accent is read out and transferred to the synchronization image file memory 12n in the RAM 12B. The At the same time, based on the synchronous reproduction link data (see FIG. 2) for the current question word “low” stored in the dictionary database 12b, for synchronous reproduction of text and images on the search word display screen G2. An HTML file for setting the windows W1 and W2 (see FIG. 17B) is read according to the HTML file No and written to the synchronization HTML file memory 12j. Also, the text data “low (with error pronunciation symbol)” of the question word is read and written in the synchronization text file memory 12k. Further, the pronunciation sound data corrected according to the error accent of the question word is read and written into the synchronization sound file memory 12m (step A2).

  Then, the current question word “low” is selected from the timecode file 12fn for synchronized playback of encrypted voice / text / image corresponding to various headwords stored as a dictionary timecode file 12f in the FLASH memory 12A. The time code file 12fn (see FIG. 5) corresponding to “” is decoded and decoded in accordance with the time code file No described in the synchronous reproduction link data (see FIG. 2), and the time code file in the RAM 12B is read out. It is transferred to the memory 12i and stored (step A3).

  Then, the synchronized playback processing of the pronunciation sound, the headword character, and the pronunciation mouth type image of the error accent according to the time code file 12fn corresponding to the question word “low” is performed for the search headword “low” already described. As in the case, the process is started by the reproduction process corresponding to each command code in steps A7 to A12 and the text corresponding mouth display process in FIG. Then, as shown in FIG. 17 (B), in the synchronized text reproduction window W1 (Ef) on the search word display screen G2, the accented phonetic symbol by the user selection is displayed together with the question word “low”. In addition, in the image synchronized playback window W2, the animation-like character image 12d (No1BL) whose color is changed to blue by the user selection of the error accent is displayed as a target image for mouth-shaped image synthesis.

  As a result, in synchronism with the sound output of the wrong accent corresponding to the question word “low”, as shown in FIGS. 17 (C) (1) to (3), the text synchronized playback window W1 (Ef) Then, the highlight (identification) display HL from the question word “low” and the head character of the incorrect phonetic symbol is sequentially performed, and in the image synchronous reproduction window W2, the blue color is changed by the selection of the incorrect accent. On the basis of the anime-like character image 12d (No1BL), for the mouth image area (X1, Y1; X2, Y2), the pronunciation mouth type image 12e (No36 → No9 → No8) corresponding to the mouth number of each phonetic symbol. It is read out from the voice-specific mouth image data 12e, sequentially switched and synthesized and displayed.

  In this case as well, according to the same text corresponding mouth display process, the highlight (identification) display HL synchronized with the output of the pronunciation sound for the erroneous accent character “u” of the found word “Low”, the pronunciation type image When switching and displaying 12e (No8), the blue-colored animated character (face) image 12d (No1BL), which is the composition destination of the mouth image 12e (No8), is caused by, for example, sweating of the head or shaking of the body. Since it is changed and displayed in the accent-corresponding blue face image 12d (No1BL ') expressing the state of strong pronunciation, the user can pronounce the wrong accent pronunciation voice of the question word "Low", its wrong utterance timing, and each correspondence So that the pronunciation mouth type image 12e (No36 → No9 → No8) to be clearly learned can be learned as an erroneous accent. That.

  On the other hand, as shown in FIG. 18A, when the selection frame X is moved by operating the cursor key 17a2 on the accent test question display screen G3, for example, the selection item Et having a correct phonetic symbol is selected and detected. (Step S16) The process proceeds to the synchronous reproduction process in FIG. 8 without performing the blue color changing process (Step S18) of the character image 12d (No1) or the pronunciation sound correcting process (Step S19) according to the error accent. (Step S17 → SA).

  Then, as described above with reference to FIG. 13, the synchronized reproduction of the pronunciation voice / text / speech mouth type image corresponding to the search word “low” in the state where the animation character image 12e (No. 1) is set. In the same manner as the processing, as shown in FIG. 18B, in the text synchronized playback window W1 (Et) on the search word display screen G2, the correct accent pronunciation by the user selection together with the question word “low” is displayed. A symbol is displayed, and an animation-like character image 12d (No. 1) of a normal color as set in advance is displayed as a target image for mouth-shaped image synthesis in the image synchronous reproduction window W2.

  Thus, in synchronism with the sound output of the correct accent corresponding to the question word “low”, as shown in FIGS. 18 (C) (1) to (3), in the text synchronized playback window W1 (Et), Highlight (identification) display HL from the first word of the question word “low” and its correct phonetic symbol is sequentially performed, and in the image synchronous reproduction window W2, an animation character image of a normal color as set in advance. On the basis of 12d (No1), for the mouth image area (X1, Y1; X2, Y2), the sound mouth type image 12e (No36 → No9 → No8) corresponding to the mouth number of each phonetic symbol is the voice-specific mouth image. The data 12e is read out, sequentially switched and combined and displayed.

  In this case as well, according to the same text corresponding mouth display processing, the highlight (identification) display HL synchronized with the output of the pronunciation sound for the correct accent character “o” of the found word “Low”, the pronunciation type image 12e. When switching and displaying (No9), the animated character (face) image 12d (No1), which is the composition destination of the mouth-shaped image 12e (No9), is pronounced strongly by, for example, sweating of the head or shaking of the body. Since the face image 12d (No1 ') corresponding to the accent representing the state is changed and displayed, the user can pronounce the correct accent pronunciation voice of the question word "Low", its correct utterance timing, and each corresponding pronunciation mouth image 12e (No36). → No9 → No8) can be clearly learned.

  Therefore, according to the synchronized playback function of the pronunciation speech / text / speech mouth type image accompanying the search for the headword by the mobile device 10 of the first embodiment having the above-described configuration, the search word “low” is input. When the dictionary data corresponding to the search headword is searched and displayed as the search headword display screen G2, when the “translation / decision (voice)” key 17a4 is operated, the search headword “low” is displayed. In accordance with the time code file 12f23, the search headword “low” and its phonetic symbol highlight (identification) display HL in the synchronized text playback window W1 in synchronization with the pronunciation sound output from the stereo sound output unit 19b. In the image synchronized playback window W2, the mouth image area (X1) is set based on the character image 12d (No. 3) set in advance. Y1; X2, Y2), the pronunciation type images 12e (No36 → No9 → No8) corresponding to the mouth numbers of the phonetic symbols are read out from the voice-specific mouth image data 12e, sequentially switched and combined and displayed. The

  In addition, when the highlight (identification) display HL synchronized with the output of the pronunciation sound for the accent character “o” of the search headline “Low” and the combined speech display of the pronunciation mouth type image 12e (No9), An accent-corresponding face image 12d (No3 ') representing a state in which the character (face) image 12d (No3), which is the synthesis destination of the image 12e (No9), is pronounced strongly by, for example, sweating of the head or shaking of the mouth Therefore, the user can pronounce the pronunciation sound of the search word “Low”, its utterance timing, the corresponding part of each of the characters “L”, “o”, “w” and their pronunciation symbols, and each sound mouth type image. 12e (No36 → No9 → No8) can be easily learned by the respective synchronized playback, and the timing for emphasizing the voice according to the accent can be learned realistically. It becomes possible way.

  Furthermore, according to the synchronized playback function of pronunciation voice / text / speaking mouth type image accompanying the search for the headword by the mobile device 10 of the first embodiment having the above-described configuration, for example, a dictionary database having phonetic symbols of the US dialect and the English dialect When the headword search is performed based on 12b, as shown in FIG. 15 or FIG. 16, the US sound [US] or the English sound [English] is designated and the “translation / decision (voice)” key 17a4 is set. When operated, in synchronization with the specified pronunciation sound of the US or English sound, the search headword “rough” and the highlighted (identification) display of the US sound or English phonetic symbol in the text synchronized playback window W1. HL is sequentially performed, and in the image synchronous reproduction window W2, a preset character image 12d (No1) is used for expressing the US sound (No1US) or for expressing the English sound (No1UK). For the mouth image area (X1, Y1; X2, Y2), the sound source type image 12e (Non1-> Non2-> Non3) corresponding to the mouth number of each phonetic symbol of English or English sound is displayed for each voice. Since it is read out from the mouth image data 12e, and is sequentially switched and synthesized, it is displayed as a pronunciation of the American dialect corresponding to the search headword and its pronunciation symbol / speaking type and pronunciation of the English dialect and its pronunciation symbol.・ Learning can be clearly distinguished from pronunciation type.

  Further, according to the synchronized playback function of pronunciation speech / text / speech mouth type image accompanying the search for the entry word by the portable device 10 of the first embodiment having the above-described configuration, each found word recorded in the dictionary database 12b When the correct accent phonetic symbol and the wrong accent phonetic symbol are included, and the “accent test” key 17a6 is operated as shown in FIGS. 17 and 18, the randomly selected found word “low” is displayed. A correct accent phonetic symbol and a wrong accent phonetic symbol are displayed as an accent test question display screen G3. When a correct accented phonetic symbol is selected, each of the pronunciation mouth type images 12e (No36 → No9 → No8) based on the normal set character image 12d (No1) in synchronization with the correct pronunciation voice output. When the phonetic symbol of the wrong accent is selected and each of the phonetic symbols is selected based on the character image 12d (No1BL) whose color is changed in blue in synchronization with the erroneous phonetic sound output. The combined display of images 12e (No36 → No9 → No8) is performed, and the character image 12e (No1) (No1BL) as the mouth-shaped image composite base is accent-compatible even when the correct and incorrect accent parts are reproduced. Since the character image 12e (No1 ') (No1BL') is displayed in a modified manner, correct access of various words is possible. And pronunciation cement, and pronunciation wrong accent, it becomes possible to clearly learn the synchronous reproduction of the audio-text image corresponding to the respective.

  In the first embodiment, the synchronized live reprocessing of the pronunciation speech / text (with pronunciation symbols) / speech mouth type image corresponding to the search headword is performed by the synchronized playback processing according to the time code file 12f. Pronunciation type corresponding to the phonetic symbol corresponding to the identification display character by the text corresponding mouth display processing executed by interruption in accordance with the sequential identification display of the text characters synchronized with each other and the sequential identification display of each character As described in the second embodiment, various phonetic symbols including phonetic symbols with accent symbols and their respective phonetic voice data and phonetic face images are stored in advance. A plurality of sets are stored in association with each other, and as the headword characters to be reproduced are highlighted in order from the top, the phonetic symbols of the highlighted characters are sequentially It may be configured to perform display output and the face image data pronunciation audio data correlated.

(Second Embodiment)
FIG. 19 is a flowchart showing a headword synchronized reproduction process of the mobile device 10 according to the second embodiment.

  That is, in the mobile device 10 according to the second embodiment, various phonetic symbols including accented phonetic symbols, their respective phonetic voice data, and phonetic voice data corresponding to the various phonetic symbols. A plurality of pronunciation face images composed of mouth portions and facial expressions of different forms are stored in the memory 12 in advance.

  For example, an arbitrary headword “low” is input and searched for an English-Japanese dictionary stored in advance as the dictionary database 12b, and displayed as a search headword display screen G2 as shown in FIG. When the “translation / decision (speech)” key 17a4 is operated in order to perform the synchronized reproduction of the pronunciation voice and the pronunciation face image, the synchronous reproduction process of the second embodiment shown in FIG. 19 is started. The

  When the synchronous playback process of the second embodiment is started, as shown in FIG. 12 or FIG. 13, the text synchronous playback window W1 is first opened on the search word display screen G2, and the search word search is started. The characters “low” and the phonetic symbols are highlighted and displayed HL from the top in the order of their pronunciation (step C1). Then, the phonetic symbol of the found character that has been highlighted and displayed HL is read (step C2), and it is determined whether or not it has an accent symbol (step C3).

  Here, as shown in FIG. 12 (B) (1) or FIG. 13 (B) (1), the phonetic symbol of the character “l” in the found word “low” highlighted HL this time is without an accent symbol. In some cases, unaccented pronunciation voice data corresponding to the phonetic symbol stored in advance in the memory 12 is read out and output from the stereo voice output unit 19b (steps C3 → C4). The accented pronunciation face image is read and displayed on the image synchronous reproduction window W2 (step C5).

  Then, the character “o” next to the currently searched search term “low” is read (step C 6 → C 7), and the process returns to step C 1 again. As shown in FIG. 13B (2), the emphasis identification display HL is displayed together with the phonetic symbol (step C1).

  When it is determined that the phonetic symbol of the character “o” in the found word “low” highlighted HL this time has an accent symbol (steps C2 and C3), it is stored in the memory 12 in advance. Accented phonetic voice data corresponding to the phonetic symbol is read out and output from the stereo voice output unit 19b (step C3 → C8), and FIG. 12 (C) (2) or FIG. 13 (B) ( As shown in 2), a pronunciation face image expressed with an accent by, for example, sweating of the head or shaking of the body is read out and displayed in the image synchronous reproduction window W2 (step C9).

  Therefore, even in the case of the portable device 10 according to the second embodiment, the output of the pronunciation sound and the pronunciation face image associated with the highlight (identification) display HL of the accent character “o” of the search headword “Low” are displayed. At the time of display, since the pronunciation face image is displayed as an accent-corresponding face image expressing a state of strong pronunciation due to sweating of the head or shaking of the body based on the accented phonetic symbol, the user can In addition to being able to easily learn each sound “L”, “o”, “w” of the search headword “Low” and pronunciation sounds, and each pronunciation face image by their corresponding outputs, they can also speak according to the accent. The part to emphasize can be learned realistically.

  In the second embodiment, various phonetic symbols including accented phonetic symbols stored in advance in the memory 12, their respective phonetic voice data, and phonetic voice data corresponding to the various phonetic symbols. For the pronunciation face image consisting of mouth parts and facial expressions of different forms corresponding to, the output of the pronunciation speech associated with the accented phonetic symbol is set larger than the pronunciation speech associated with the accentless phonetic symbol, The opening degree of the mouth portion of the pronunciation face image associated with the accented phonetic symbol is set larger than the opening degree of the mouth portion of the pronunciation face image associated with the accented phonetic symbol. Further, the facial expression in the face image is set such that the facial expression of the pronunciation face image associated with the accented phonetic symbol is more emphasized than the facial expression of the pronunciation face image associated with the accentless pronunciation symbol.

  In the second embodiment, various phonetic symbols including accented phonetic symbols, their respective phonetic speech data, and different forms of mouth corresponding to the phonetic speech data corresponding to the various phonetic symbols. Pre-recorded pronunciation face images consisting of parts and facial expressions, highlight each character of the search headword in the order of its pronunciation, and read out and output the pronunciation sound associated with the pronunciation symbol, Although the corresponding pronunciation face image is read and displayed, as described in the next third embodiment, the pronunciation sound of the entry word corresponding to each entry word in the dictionary database 12b The pronunciation face image is stored in combination, and the pronunciation voice and the pronunciation face image are read and output along with the character display of the search headword. Determining an accent moiety by detecting the Le, may be configured to change control to the mouth and facial expressions of the form a different display form of the sound face image.

(Third embodiment)
FIG. 20 is a flowchart showing a headword synchronized reproduction process of the mobile device 10 according to the third embodiment.

  That is, in the mobile device 10 according to the third embodiment, the pronunciation sound and the pronunciation face image of the entry word are stored in combination in advance corresponding to each entry word in each dictionary data of the dictionary database 12b.

  For example, an arbitrary headword “low” is input and searched for an English-Japanese dictionary stored in advance as the dictionary database 12b, and displayed as a search headword display screen G2 as shown in FIG. In this state, when the “translation / decision (voice)” key 17a4 is operated so as to perform the synchronized reproduction of the pronunciation sound and the pronunciation face image, the synchronous reproduction process of the third embodiment shown in FIG. 20 is started. The

  When the synchronous playback process of the third embodiment is started, as shown in FIG. 12 or FIG. 13, the text synchronous playback window W1 is first opened on the search word display screen G2, and the search word search is started. Each character of “low” is highlighted and displayed HL from the top in the order of pronunciation (step D1). Then, the pronunciation sound data of the portion corresponding to the found character that has been highlighted and displayed HL is read (step D2) and output from the stereo sound output unit 19b (step D3).

  Here, for example, whether the signal (waveform) level of the pronunciation sound data of the portion corresponding to the character “l” in the found word “low” highlighted HL this time is a sound signal level (accent portion) of a certain value or more. If it is determined (step D4) and it is determined that it is not higher than a certain audio signal level, that is, it is not an accent part, a pronunciation face image stored in association with the search word is read out. Then, it is displayed as it is on the image synchronous reproduction window W2 (step D5).

  Then, the character “o” next to the currently searched search word “low” is read (step D6 → D7), and the process returns to the process from step D1 again, and the highlight identification display HL is displayed (step D1). ).

  Then, the pronunciation sound data of the portion corresponding to the found character “o” that has been highlighted and displayed this time is displayed (step D2), output from the stereo sound output unit 19b (step D3), and the highlighted display. It is determined whether or not the signal (waveform) level of the pronunciation sound data of the portion corresponding to the word character “o” subjected to the HL is a sound signal level (accent portion) of a predetermined value or more (step D4).

  Here, when it is determined that the sound signal level is equal to or higher than a certain audio signal level, that is, an accent portion, the pronunciation face image stored in association with the search headword is read and the face image is The face image is controlled to be changed to a face image with a large opening degree and a strong expression (for example, FIG. 12 (B) (2) → FIG. 12 (C) (2)), and is displayed in the image synchronous reproduction window W2 ( Step D4 → D8).

  If the sound signal waveform level of the pronunciation sound is determined to be a certain value or more and is determined to be an accent part, the display color of the highlighted search word is further changed or added. Or it is good also as a structure which changes and displays in the form which shows that it is a character of an accent part by changing a character font.

  Therefore, even in the case of the mobile device 10 according to the third embodiment, the output of the pronunciation sound and the pronunciation face image associated with the highlight (identification) display HL of the accent character “o” of the search headword “Low” are displayed. At the time of display, based on the sound signal level at that time being equal to or higher than a certain value, the sound generation face image is changed and displayed, for example, as an accent-corresponding face image with a large mouth opening and a strong expression. Therefore, the user not only can easily learn the characters “L”, “o”, “w” of the search headword “Low”, their pronunciation sounds, and also the pronunciation face images by their corresponding outputs. This makes it possible to learn realistically the part that emphasizes the utterance according to the accent.

  In the description of the synchronized playback function for each character (text), pronunciation sound, and pronunciation face image (including pronunciation mouth image) of the search headword in each of the embodiments, the accent of the headword exists in one place. In the case where the accent of the search word is present in two places, the first accent and the second accent, the accent-corresponding pronunciation face image (corresponding pronunciation mouth to be displayed) corresponding to each accent portion is described. The type image) may be displayed in different forms depending on, for example, the size of the opening of the mouth, the strength of the facial expression, or the like depending on whether the first accent or the second accent.

  Note that each processing method by the portable device 10 described in each embodiment, that is, main processing according to the dictionary processing program 12a in the first embodiment shown in the flowchart of FIG. 7, the main shown in the flowchart of FIG. Entry-synchronized playback process associated with the process, text-corresponding mouth display process executed by interruption in accordance with the highlight display of each entry word associated with the entry-synchronized playback process shown in the flowchart of FIG. 9, FIG. Each method such as the headword synchronized playback process in the second embodiment shown in the flowchart of FIG. 20 and the headword synchronized playback process in the third embodiment shown in the flowchart of FIG. 20 can be executed by the computer. Programs include memory cards (ROM cards, RAM cards, DATA / CARD, etc.), magnetic disks (floppy disks, hard disks, etc.). De disks, etc.), optical disk (CD-ROM, DVD, etc.) can be distributed and stored in the external recording medium 13 such as a semiconductor memory. Various computer terminals having a communication function with the communication network (Internet) N read the program stored in the external recording medium 13 into the memory 12 by the recording medium reading unit 14, and the operation is performed by the read program. By being controlled, a synchronized reproduction function of each character (text), pronunciation sound, and pronunciation face image (including pronunciation mouth type image) corresponding to the search headword described in each embodiment is realized, and the method described above A similar process can be executed.

  The program data for realizing each of the above methods can be transmitted on a communication network (Internet) N in the form of a program code, and the above-mentioned data can be transmitted from a computer terminal connected to the communication network (Internet) N. It is also possible to capture the program data and realize a synchronized reproduction function of each character (text), pronunciation sound, and pronunciation face image (including pronunciation mouth image) corresponding to the search headword described above.

  Note that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention at the stage of implementation. Further, each of the embodiments includes inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in each embodiment, or some constituent requirements are combined, the problem described in the column of the problem to be solved by the invention can be solved, When the effects described in the column of the effect of the invention can be obtained, a configuration in which these constituent elements are deleted or combined can be extracted as an invention.

10 ... Mobile device 11 ... CPU
12 ... Memory 12A ... FLASH memory 12B ... RAM
12a ... Dictionary processing program 12b ... Dictionary database 12c ... Dictionary voice data 12d ... Character image data 12d (No. n) ... Set character image 12d (No. n ') ... Accent corresponding face image 12d (No. nUS) ... For American English Set character image 12d (No. nUS ') ... American accent-corresponding face image 12d (No. nUK) ... English set character image 12d (No. nUK') ... English accent-corresponding face image 12d (No. nBL) ... Blue change setting character image 12d (No. nBL ') ... Accent-corresponding blue face image 12e ... Voice-specific mouth image data 12f ... Dictionary time code file 12g ... Yomi word data memory 12h ... Yomi word correspondence dictionary data memory 12i ... Time code file No23
12j ... HTML file memory for synchronization 12k ... Text file memory for synchronization 12m ... Sound file memory for synchronization 12n ... Image file memory for synchronization 12p ... Mouth image area memory 12q ... Image expansion buffer 13 ... External recording medium 14 ... Recording medium reading unit DESCRIPTION OF SYMBOLS 15 ... Electric transmission control part 16 ... Communication part 17a ... Input part 17b ... Coordinate input device 18 ... Display part 19a ... Audio | voice input part 19b ... Stereo audio | voice output part 20 ... Communication apparatus (home PC)
30 ... Web server N ... Communication network (Internet)
X ... selection frame H ... header information G1 of time code table ... character image list selection screen G2 ... headword search screen G3 ... accent test question display screen W1 ... headword character display window (text synchronous playback window)
W2… Speaking mouth type display window (window for synchronized playback of images)
HL ... Highlight (identification) display Et ... Correct accent selection item Ef ... Error accent selection item

Claims (4)

A word storage means for storing a correct accented phonetic symbol and an error accented phonetic symbol for each of the plurality of words in association with each other;
Correct / incorrect accent selection means for selecting one of the correct accented phonetic symbols and error accented phonetic symbols for each word stored in the word storage means;
When one of the accented phonetic symbols is selected by the correct / incorrect accent selection means, the selected phonetic symbol with correct accent or the phonetic symbol corresponding to the error accented phonetic symbol is output, while the correct accented pronunciation is output. Voice display output control means for displaying a face image in a different display form when a pronunciation sound corresponding to a symbol is output and when a pronunciation sound corresponding to a pronunciation symbol with an error accent is output ,
The voice display output control means changes the mouth portion included in the displayed face image to a mouth-shaped image corresponding to the pronunciation sound and displays the mouth portion in synchronization with the output sound sound. audio display output control apparatus comprising: a display control unit. An accent detection means for detecting an accent in the accented phonetic symbol when a pronunciation sound is output under the control of the voice display output control means;
Image change display control means for changing the face image displayed by the control of the voice display output control means in synchronization with the detection of the accent by the accent detection means;
The voice display output control device according to claim 1, further comprising: Correct correct / incorrect accent display control means for displaying a correct accented phonetic symbol and a correct accented phonetic symbol associated with each word stored in the word storage means,
The correct / incorrect accent selection means includes pronunciation symbol selection means for selecting either a correct accented phonetic symbol and a correct accented phonetic symbol displayed side by side under the control of the correct / incorrect accent display control means. The voice display output control device according to claim 1. An audio display output control processing program for controlling a computer of an electronic device to output sound and an image,
The computer,
The correct accented phonetic symbol and the correct accented phonetic symbol for each word stored in the word storage means that stores the correct accented phonetic symbol and the error accented phonetic symbol for each word in association with each other. Correct / incorrect accent selection means for selecting either one,
When one of the accented phonetic symbols is selected by the correct / incorrect accent selection means, the selected phonetic symbol with correct accent or the phonetic symbol corresponding to the error accented phonetic symbol is output, while the correct accented pronunciation is output. Function as voice display output control means for displaying a face image in a different display form when the pronunciation sound corresponding to the symbol is output and when the pronunciation sound corresponding to the pronunciation symbol with an error accent is output ,
The voice display output control means changes the mouth portion included in the displayed face image to a mouth-shaped image corresponding to the pronunciation sound and displays the mouth portion in synchronization with the output sound sound. A computer-readable audio display output control processing program adapted to function as display control means .

Images