JP6295531B2 - Audio output control apparatus, electronic device, and audio output control program - Google Patents

Description

  The present invention relates to an audio output control device, an electronic device, and an audio output control program.

Conventionally, a device capable of outputting sound is used for learning such as language.
In the technical field of such devices, in recent years, as a technique for improving the word learning efficiency, a technique for sequentially outputting a certain Japanese word and an English word corresponding to the word has been proposed (for example, a patent). Reference 1).

Japanese Patent No. 5168239

  However, according to the technique described in Patent Document 1, Japanese words and English words are output in a predetermined order regardless of the user's learning achievement level. Words requiring attention (words of interest) such as high-difficult words and important words that are not understood are also output in the same manner, and learning efficiency is low.

  The subject of this invention is providing the audio | voice output control apparatus, electronic device, and audio | voice output control program which can improve learning efficiency at the time of learning using audio | voice output.

The invention according to claim 1 is an audio output control apparatus,
Its header, and the audio output control means for voice output audio output data corresponding to a plurality of pairs of the description of the title,
User evaluation input means for inputting a user evaluation related to the level of difficulty or attention level for any of the plurality of sets based on a user operation;
A user evaluation input by the user evaluation input means, and look out Rating storage means stores an association and set by the user evaluation is input,
Sound output data changing means for changing the output order or volume of the plurality of sets in the sound output data according to the user evaluation stored by the found user evaluation storage means;
The first change to turn off the audio output of the description or reduce the output volume for the group determined that the difficulty level or the attention level indicated by the user evaluation stored by the found user evaluation storage unit is low, or the audio Voice output data changing means for performing a second change in which the output order of the heading and the description in the output data is reversed and the voice output of the heading is turned off or the output volume is reduced ;
It is characterized by providing.

  ADVANTAGE OF THE INVENTION According to this invention, the learning efficiency at the time of learning using an audio | voice output can be improved.

(A) is a top view which shows schematic structure of an audio | voice output apparatus, (b) is an external view which shows schematic structure of an electronic dictionary. It is a block diagram which shows the function structure of an audio | voice output apparatus. It is a flowchart which shows the flow of an audio | voice output control process. It is a conceptual diagram for demonstrating music data and lyrics data preparation processing. It is a conceptual diagram for demonstrating the synthetic | combination process of music data and lyrics data. It is a flowchart which shows the flow of an output data change process (1). It is a flowchart which shows the flow of an output data change process (2). It is a flowchart which shows the flow of an output data change process (3). It is a flowchart which shows the flow of an output data change process (4). It is a figure which shows the operation example of an audio | voice output control process. It is a figure which shows the operation example of an audio | voice output control process. It is a figure which shows the operation example of an audio | voice output control process. It is a figure which shows the operation example of an audio | voice output control process. It is a figure which shows the operation example of an audio | voice output control process. It is a figure which shows the operation example of an audio | voice output control process.

  Hereinafter, an example of an embodiment in which an audio output control device according to the present invention is applied to an audio output device that is a portable electronic device will be described in detail with reference to the accompanying drawings. However, the scope of the invention is not limited to the illustrated examples.

[1.1 External configuration]
FIG. 1 is a plan view of an audio output device 1 which is a portable electronic device.
As shown in this figure, the audio output device 1 includes a display 10, a card slot 12, a speaker 13, a microphone 14, and a key group 2.

  The display 10 is a part that displays various data such as characters and codes according to the operation of the key group 2 by the user, and is configured by an LCD (Liquid Crystal Display), an ELD (Electronic Luminescence Display), or the like. The display 10 may be formed integrally with a so-called touch panel and can accept operations such as handwriting input.

  The card slot 12 is a part to which an external information storage medium 12a (see FIG. 2) storing various information is attached and detached.

  The speaker 13 is a part that outputs sound according to the operation of the key group 2 by the user, and the microphone 14 is a part that captures sound from the outside. In the present embodiment, the speaker 13 is formed in the form of an earphone, but may be formed in other forms such as a headphone.

  The key group 2 has various keys that receive operations for operating the audio output device 1 from the user. Specifically, the key group 2 includes a reproduction key 2a, a stop key 2b, a volume key 2c, and the like.

  The reproduction key 2a is a key used when reproducing music, and the stop key 2b is a key used when stopping music. The volume key 2c is a key used when changing the output volume of audio. The volume key 2c is also used when a user evaluation is input for the content that is output in the audio output control process (see FIG. 3) described later. "Or" x "can be entered. The degree of difficulty or the attention level is used as the content of the user evaluation. For example, when the meaning of an English word that is a headline is remembered, or when it can be easily understood with a simple English word, a user evaluation of “◯” is input as the difficulty level is low. When a difficult English word does not know or cannot be remembered, a user evaluation of “X” is input as the difficulty level is high. Also, in the case of an important word often used in a test or the like, a user evaluation of “×” is input as a high degree of attention (attention required).

[1.2 Internal structure]
Next, the internal configuration of the audio output device 1 will be described. FIG. 2 is a block diagram showing the internal configuration of the audio output device 1.

  As shown in this figure, the audio output device 1 includes a display unit 40, an audio output unit 60, an input unit 30, a communication unit 50, a recording medium reading unit 70, a CPU (Central Processing Unit) 20, and a storage unit 80. Each unit is configured to be connected to each other via a bus so that data communication is possible.

  The display unit 40 includes the display 10 described above, and displays various information on the display 10 based on a display signal input from the CPU 20.

  The audio output unit 60 includes the speaker 13 described above, and causes the speaker 13 to reproduce audio data based on the audio output signal input from the CPU 20.

  The input unit 30 includes the key group 2 and the microphone 14 described above, and outputs a pressed key and a signal corresponding to the input voice to the CPU 20.

  The communication unit 50 can be connected to the network N, thereby enabling communication with an external device connected to the network N, for example, the server N1. The server N1 stores song data 820, memorization data 840, and the like. Note that the music data 820 and the memorization data 840 have the same data structure as the music data 820 and the memorization data 840 in the storage unit 80, which will be described later.

  The recording medium reading unit 70 includes the above-described card slot 12, and reads information from the external information storage medium 12a mounted in the card slot 12 or records information in the external information storage medium 12a. It has become.

  Here, the music data 820, the memorization data 840, etc. are stored in the external information storage medium 12a. Note that the music data 820 and the memorization data 840 have the same data structure as the music data 820 and the memorization data 840 in the storage unit 80, which will be described later.

  The CPU 20 executes processing based on a predetermined program in accordance with an input instruction, performs an instruction to each functional unit, data transfer, and the like, and comprehensively controls the audio output device 1. . Specifically, the CPU 20 reads various programs stored in the storage unit 80 in accordance with an operation signal or the like input from the input unit 30, and executes processing according to the program. Then, the CPU 20 temporarily stores the processing result in the storage unit 80 and causes the display unit 40 to output the processing result as appropriate.

  The storage unit 80 is a memory that stores programs and data for realizing various functions of the audio output device 1 and functions as a work area of the CPU 20. In the present embodiment, the storage unit 80 includes an audio output control program 81 according to the present invention, a song data group 82, song generation data 83, a memorization data group 84, and a melody-added memorization data group 86. And a user evaluation table 85 and the like.

  The audio output control program 81 is a program for causing the CPU 20 to execute audio output control processing (see FIG. 3) described later. In the present embodiment, the audio output control program 81 includes a music generation module 811 for generating music data 820 corresponding to a user-specified genre, tempo, etc., and each sound (each of the music data 820). A lyrics allocating module 812 is provided for allocating lyrics for (beats).

  The song data group 82 has a plurality of song data 820. The song data 820 is data about the accompaniment of the song.

  The song generation data 83 includes chord progression data and rhythm patterns for each music genre, a melody generation algorithm, a modulation algorithm, a variable speed algorithm, and the like. The song generation data 83 is used to create and adjust song data 820 in song data / lyric data creation processing (see FIG. 4) described later.

The memorization data group 84 has a plurality of memorization data 840.
The memorization book data 840 stores a plurality of sets in which headings are associated with descriptions of the headings. Here, for example, a combination of an English word or phrase and a Japanese translation thereof may be used as a combination of the headline and the explanation thereof, or the historical case name and the year when the case occurred. (Or, the matching of the current year) may be used, or a pair of an old word and its modern translation may be used.

The melody-added memorization book data group 86 has a plurality of melody-added memorization book data 860.
The memorandum data 860 with melody is data created by a voice output control process (see FIG. 3) described later, and includes song data 820, lyrics data 861, and volume / display size data 862.

  Of these, the song data 820 may be song data 820 included in advance in the song data group 82, or song data 820 newly created by song data / lyrics data creation processing (see FIG. 4) described later. There may be. In the present embodiment, the song data 820 in the memorandum data 860 with melody includes position data of the chorus portion in the song.

  The lyric data 861 is text data created from the contents of the memorization data 840 by a music data / lyrics data creation process (see FIG. 4), which will be described later, and includes the heading of the memorization data 840 and a character string of explanation. Has been.

  Volume / display size data 862 is data indicating the output volume and display size of each headline included in the lyrics data 861 and each description, and is associated with each headline and each description.

  The user evaluation table 85 uses a volume key 2c to evaluate a user (for the present embodiment, “◯”) for a combination of a headline that is output in a voice output control process (see FIG. 3) described later and a description thereof. Or “×”) is input, the user evaluation is associated with this set and stored for each memorization data 840. Here, in the present embodiment, whether or not the user understands the combination of the headline output and the description is used as the user evaluation. When the user understands the combination, the user evaluation is performed. “○” is input as “,” and “x” is input as user evaluation when the user does not understand the set. The above-described user evaluation table 85 stores user evaluations in association with only one of the headings and explanations included in the set, so that user evaluation is performed for the set including the headings or description. The information may be stored in association with each other.

[1.3 Operation]
Next, the operation of the audio output device 1 will be described with reference to the drawings.
FIG. 3 is a flowchart showing the flow of the audio output control process that the CPU 20 reads out and executes the audio output control program 81.

  As shown in this figure, in the audio output control process, first, the CPU 20 determines whether or not a user operation for creating the memorized note data with melody 860 is performed (step S1).

  If it is determined in step S1 that a user operation has been performed to create the memorandum data 860 with melody (step S1; Yes), the CPU 20 stores the memorization data group in the storage unit 80 based on the user operation. 84, the server N1, and any of the memorization data 840 in the external information storage medium 12a is designated as designated memorization data 840S (step S2).

  Next, the CPU 20 designates the genre and tempo of the music based on the user operation (step S3). In this step S3, the user may specify any song data group 820 in the storage unit 80, the server N1, or the external information storage medium 12a by inputting a song name.

  Next, the CPU 20 designates terms for adjusting the number of sounds (number of beats) and the number of characters (step S4). Here, the term for adjusting the number of sounds (beats) and the number of characters is the heading or explanation for the number of sounds (beats) of the phrase when outputting the heading or explanation in accordance with the phrase of the song. This is a word or phrase added to the headline or explanation when the number of characters is small. As such terms, for example, “−”, “−”, “−Yone”, and the like can be used.

Next, the CPU 20 performs song data / lyric data creation processing (step S5).
Specifically, as shown in FIG. 4, in this song data / lyrics data creation process, the CPU 20 creates song data 820 using the song creation data 83 and the song creation module 811 and allocates lyrics. Using the module 812, for each sound (each beat) of each phrase in the song data, each set of headings and each character of the description in the specified memorization data 840S is assigned in order, and the lyric data 861 is created as text data .

  More specifically, in this song data / lyric data creation processing, the CPU 20 creates the song data 820 and the lyrics data 861 while feeding back the composition content by the song generation module 811 and the allocation content by the lyrics allocation module 812. I do. Further, in this song data / lyrics data creation process, the CPU 20 sequentially assigns each heading and description character to each sound (each beat) in accordance with the storing order of the heading and description pair in the specified memorized data 840S. . In this song data / lyrics data creation process, the CPU 20 designates such headings and explanations in step S4 when the number of characters in the headings and explanations is smaller than the number of sounds (beats) of the phrases. Add adjustment terminology. Further, in this song data / lyrics data creation process, the CPU 20 associates each heading and each description in the lyrics data 861 with the output volume and display size of the heading or description, and sets the volume / display size data 862. create. Note that the output volume and display size associated at this time are all the default output volume and display size.

  When the user designates any song data 820 in the song data group 82 in the above-described step S3, the CPU 20 does not create the song data 820 in the song data / lyrics data creation process in this step S5. In addition, for each sound (each beat) of each phrase in the designated song data 820, each set of headings and explanation characters in the specified memorization data 840S is assigned in order to create lyrics data 861 as text data. .

  When the above song data / lyric data creation processing is completed, the CPU 20 next determines whether or not a user operation for auditioning the created song data 820 and lyrics data 861 is performed as shown in FIG. (Step S11).

  If it is determined in step S11 that the user operation for previewing the song data 820 and the lyrics data 861 is not performed (step S11; No), the CPU 20 performs the song data 820 and lyrics data created in step S5. 861 and the volume / display size data 862 are collectively stored in the storage unit 80 as memorized note data 860 with melody (step S14), and then the process proceeds to step S1 described above.

  If it is determined in step S11 that the user operation for previewing the song data 820 and the lyrics data 861 has been performed (step S11; Yes), the CPU 20 performs the song data 820 and the lyrics data created in step S5. The composite output processing with the 861 is performed (step S12).

  Specifically, as shown in FIG. 5, in this composite output process, the CPU 20 first matches the playback timing of each sound (each beat) of the song data 820 and the voice output timing of each character of the lyrics data 861. The song data 820 and the lyrics data 861 are mixed (step T1).

  Next, while reproducing the song data 820, the CPU 20 creates voice data for each character from the text data of the lyrics data 861 by a voice synthesis process (Text To Speech process), and each character of the voice data is converted into the song data. Audio is output on the 820 melody (step T2). As a result, a plurality of sets of headings (and adjustment terms) and explanations (and adjustment terms) in the lyrics data 861 are output in audio according to the music to be played. In this embodiment, at this time, the CPU 20 performs audio output while adjusting the volume according to the output volume (here, the default output volume) of each heading and each description in the volume / display size data 862, Based on the display size of each headline and each description (here, the default display size), the headline and the character string of the description output in sound are displayed on the display 10.

  Next, the CPU 20 adjusts the tempo of the song data 820 based on the user operation (step T3), adjusts the key of the song data 820 (step T4), and ends the composite output process.

  When the above composite output processing is completed, the CPU 20 next determines whether or not a user operation for recreating the song data 820 and the lyrics data 861 is performed as shown in FIG. 3 (step S13). When it is determined that it has been performed (step S13; Yes), the process proceeds to the above-described step S3, whereas when it is determined that it is not performed (step S13; No), the process proceeds to the above-described step S14.

  When it is determined in step S1 that the user operation for creating the memorized note data with melody 860 is not performed (step S1; No), the CPU 20 stores the created memorized note data with melody 860. It is determined whether or not a user operation for learning is performed (step S21).

  If it is determined in step S21 that the user operation for learning is not performed using the memorandum data 860 with melody created (step S21; No), the CPU 20 proceeds to another process.

  When it is determined in step S21 that a user operation for learning is performed using the memorized note data with melody 860 that has been created (step S21; Yes), the CPU 20 adds a melody based on the user operation. Any memorandum data 860 with melody in the memorandum data group 86 is designated as memorization data 860S with designated melody (step S22).

  Next, the CPU 20 selects one of the audio output data changing methods “1” to “4” according to the user evaluation (“◯” or “×”) for the combination of the headline and the description based on the user operation. Designate (step S23).

  Here, in the audio output data changing method “1”, the output volume and display size of the explanation in the group where the user evaluation is “◯” is set to 0 (sound output and display is turned off), and the user evaluation is “x”. This is a method of increasing the output volume and display size of the explanation in the group (see FIG. 6). In addition, the change method “2” reverses the output order of the headline and the description in the group whose user evaluation is “O”, sets the output volume and display size of the headline to 0 (turns off the audio output and display), This is a method of increasing the output volume and display size of the explanation in the group where the user evaluation is “x” (see FIG. 7). Also, the change method “3” is a method of moving the output order of the group with the user evaluation “◯” to the rear side of the song and moving the output order of the group with the user evaluation “x” to the front side of the song. (See FIG. 8). Also, in the change method “4”, the output order of the group with the user evaluation “◯” is moved to a portion other than the chorus of the song, and the output order of the group with the user evaluation “x” is moved to the chorus portion of the song. It is a method (refer FIG. 9).

  Next, the CPU 20 starts the composition output process of the song data 820 and the lyrics data 861 in the memorized note data with designated melody 860S in the same manner as in the above-described step S12 (step S24), and at the top of the lyrics data 861 A pair of headings is detected and set as a designated heading (step S31). In the composite output process started in step S24, the CPU 20 outputs each heading and explanation output volume in the volume / display size data 862 (here, default output volume or output data changing process described later (FIG. 6 to FIG. 6)). The sound is output while adjusting the volume according to the output volume after the change (see FIG. 9), and the display size of each heading and each description in the volume / display size data 862 (here, the default display size or the output described later) Based on the display size after the change by the data change process), the headline and the character string of the explanation that are output in sound are displayed on the display 10.

  Next, the CPU 20 determines whether or not a user evaluation (“◯” or “×” in the present embodiment) is input to the combination of the specified headline and the description that are output as voice by the synthesis output process. If it is determined (step S32) and it is determined that it is not input (step S32; No), the process proceeds to step S34 described later.

  If it is determined in step S32 that the user evaluation has been input for the combination of the specified headline and description that are output as voice (step S32; Yes), the CPU 20 stores the memorization data with the specified melody 860S. The input user evaluation is stored in the user evaluation table 85 in association with the corresponding memorization data 840 and the set including the designated heading (step S33).

  Next, the CPU 20 determines whether or not the audio output of the set including the designated heading has been completed (step S34), and when it is determined that it has not ended (step S34; No), the process proceeds to the above-described step S32. To do.

  If it is determined in step S34 that the audio output of the set including the specified headline has been completed (step S34; Yes), the CPU 20 determines whether or not the next set of headlines exists in the lyrics data 861. (Step S35).

  If it is determined in step S35 that the next set of headings exists in the lyrics data 861 (step S35; Yes), the CPU 20 resets the next heading as a designated heading (step S36), and then The process proceeds to step S32.

  If it is determined in step S35 that the next set of headings does not exist in the lyrics data 861 (step S35; No), the CPU 20 selects one of the audio output data changing methods “1” to “4”. After performing the output data changing processes (1) to (4) according to the changing method specified in S23 (step S38), the process proceeds to the above-described step S1.

  Specifically, when the audio output data changing method “1” is designated in step S23, as shown in FIG. 6, in the output data changing process (1), the CPU 20 first determines from the user evaluation table 85 as follows. The user evaluation is read for each set of memorization data 840 corresponding to the specified melody-added memorization data 860S, in other words, each set of headings and explanations in the lyrics data 861 of the specified melody-added memorization data 860S (step U1).

  Next, the CPU 20 designates the heading of the lyric data 861 in the memorized book data with designated melody 860S as the designated heading (step U2), and determines whether or not the user evaluation for the set of designated headings is “◯”. (Step U3).

  If it is determined in step U3 that the user evaluation for the set of designated headings is “◯” (step U3; Yes), the CPU 20 outputs the output volume and the display size of the explanation (and terms for adjustment) of the designated headings. After changing the volume / display size data 862 (step U4) so as to become “0” (so that audio output and display are turned off), the process proceeds to step U11 described later. In step U4, the CPU 20 may change the volume / display size data 862 so that the output volume and the display size are reduced.

  When it is determined in step U3 that the user evaluation for the specified headline set is not “◯” (step U3; No), the CPU 20 determines whether or not the user evaluation for the specified headline set is “x”. Determine (step U5).

  If it is determined in step U5 that the user evaluation for the set of designated headings is “x” (step U5; Yes), the CPU 20 outputs the output volume and the display size of the explanation (and terms for adjustment) of the designated headings. After the volume / display size data 862 is changed so as to increase (step U6), the process proceeds to step U11 described later.

  On the other hand, when it is determined in step U5 that the user evaluation for the specified heading group is not “x”, that is, when the user evaluation is not input (step U5; No), the CPU 20 in the memorization data with specified melody 860S. It is determined whether or not the next headline exists in the lyrics data 861 (step U11).

  If it is determined in step U11 that the next set of headings exists in the lyrics data 861 (step U11; Yes), the CPU 20 resets the next heading as a designated heading (step U12), and then The process proceeds to step U3.

  If it is determined in step U11 that the next set of headings does not exist in the lyrics data 861 (step U11; No), the CPU 20 updates the memorized note data 860 with melody and stores it in the storage unit 80 ( Step U13), the output data change process (1) is terminated.

  If the audio output data changing method “2” is designated in step S23, as shown in FIG. 7, in the output data changing process (2), the CPU 20 first adds a designated melody from the user evaluation table 85. The user evaluation is read for each set of memorization data 840S corresponding to the memorization data 860S, in other words, each set of headings and explanations in the lyrics data 861 of the memorization data 860S with designated melody (step U21).

  Next, the CPU 20 designates the heading at the head of the lyrics data 861 in the memorized book data with designated melody 860S as the designated heading (step U22), and determines whether or not the user evaluation for the set of designated headings is “◯”. (Step U23).

  If it is determined in step U23 that the user evaluation for the set of designated headings is “◯” (step U23; Yes), the CPU 20 returns the lyrics data so that the output order of the designated headings and their descriptions is reversed. 861 is changed (step U25), and when the number of headlines and explanation characters is small with respect to the number of sounds (beats) of the phrase in the music data 820, creation of the memorization data 860S with designated melody for the headings and explanation Sometimes, the lyrics data 861 is further changed by adding the adjustment term specified in step S4 (step U26).

  Next, the CPU 20 changes the volume / display size data 862 so that the output volume and display size of the designated heading (and the term for adjustment) become “0” (so that audio output and display are turned off) ( Step U27), the process proceeds to Step U31 described later. In step U27, the CPU 20 may change the volume / display size data 862 so that the output volume and the display size are reduced.

  If it is determined in step U23 that the user evaluation for the specified headline set is not “◯” (step U23; No), the CPU 20 determines whether the user evaluation for the specified headline set is “x”. Determine (step U28).

  If it is determined in step U28 that the user evaluation for the set of designated headings is “x” (step U28; Yes), the CPU 20 outputs the output volume and display size of the description (and terms for adjustment) of the designated headings. After the volume / display size data 862 is changed so as to increase (step U29), the process proceeds to step U31 described later.

  On the other hand, when it is determined in step U28 that the user evaluation for the specified heading group is not “x”, that is, when the user evaluation is not input (step U28; No), the CPU 20 stores the specified melodies with the specified melody data 860S. It is determined whether or not the next headline exists in the lyrics data 861 (step U31).

  If it is determined in step U31 that the next set of headings exists in the lyrics data 861 (step U31; Yes), the CPU 20 resets the next heading as a designated heading (step U32), and then The process proceeds to step U23.

  If it is determined in step U31 that the next set of headings does not exist in the lyrics data 861 (step U31; No), the CPU 20 updates the memorized note data with melody 860 and stores it in the storage unit 80 ( Step U33), the output data change process (2) is terminated.

  If the audio output data changing method “3” is designated in step S23, the CPU 20 first adds the designated melody from the user evaluation table 85 in the output data changing process (3) as shown in FIG. The user evaluation is read for each set of memorization data 840S corresponding to the memorization data 860S, in other words, each set of headings and explanations in the lyrics data 861 of the memorization data 860S with designated melody (step U41).

  Next, the CPU 20 designates the heading of the lyric data 861 in the memorized book data with designated melody 860S as the designated heading (step U42), and determines whether or not the user evaluation for the set of designated headings is “◯”. (Step U43).

  If it is determined in step U43 that the user evaluation for the set of designated headings is “◯” (step U43; Yes), the CPU 20 moves the output order of the set of designated headings and explanations to the back of the song. The lyric data 861 is changed (step U44), and when the number of characters in the heading or explanation is small with respect to the number of sounds (beats) of the phrase in the music data 820, the memorization book with the designated melody for the heading or explanation After the lyric data 861 is further changed by adding the adjustment term specified in step S4 described above when the data 860S is created (step U45), the process proceeds to step U51 described later.

  When it is determined in step U43 that the user evaluation for the specified headline set is not “◯” (step U43; No), the CPU 20 determines whether the user evaluation for the specified headline set is “x”. Determine (step U48).

  If it is determined in step U48 that the user evaluation for the set of designated headings is “x” (step U48; Yes), the CPU 20 moves the output order of the set of designated headings and explanations to the front side of the song. After changing the lyrics data 861 (step U49), the process proceeds to step U45 described above.

  On the other hand, when it is determined in step U48 that the user evaluation for the designated heading group is not “x”, that is, when the user evaluation is not input (step U48; No), the CPU 20 in the memorization data with designated melody 860S. It is determined whether or not the next headline exists in the lyrics data 861 (step U51).

  If it is determined in step U51 that the next set of headings exists in the lyrics data 861 (step U51; Yes), the CPU 20 resets the next heading as a designated heading (step U52), and then The process proceeds to step U43.

  If it is determined in step U51 that the next set of headings does not exist in the lyrics data 861 (step U51; No), the CPU 20 updates the memorized note data 860 with melody and stores it in the storage unit 80 ( Step U53), the output data change process (3) is terminated.

  If the audio output data changing method “4” is designated in step S23, as shown in FIG. 9, first in the output data changing process (4), the CPU 20 adds the designated melody from the user evaluation table 85. The user evaluation is read for each set of memorization data 840S corresponding to the memorization data 860S, in other words, each set of headings and explanations in the lyrics data 861 of the memorization data 860S with designated melody (step U61).

  Next, the CPU 20 designates the heading of the lyric data 861 in the memorized note data with designated melody 860S as a designated heading (step U62), and determines whether or not the user evaluation for the set of designated headings is “x”. (Step U63).

  If it is determined in step U63 that the user evaluation for the set of designated headings is “x” (step U63; Yes), the CPU 20 returns the lyrics so that the set of designated headings and explanations is moved to the chorus portion of the song. When the data 861 is changed (step U64) and the number of characters in the headline or explanation is small with respect to the number of sounds (beats) of the phrase in the music data 820, the specified melody-added memorization data 860S for the headline or explanation is changed. The lyrics data 861 is further changed by adding the adjustment term specified in step S4 described above at the time of creation (step U65), and then the process proceeds to step U71 described later.

  When it is determined in step U63 that the user evaluation for the specified headline set is not “x” (step U63; No), the CPU 20 determines whether the user evaluation for the specified headline set is “◯”. Determination is made (step U68).

  If it is determined in step U68 that the user evaluation for the set of designated headings is “◯” (step U68; Yes), the CPU 20 moves the set of designated headings and explanations to a portion other than the chorus of the song. After changing the lyrics data 861 (step U69), the process proceeds to step U65 described above.

  On the other hand, when it is determined in step U68 that the user evaluation for the specified heading group is not “◯”, that is, when the user evaluation is not input (step U68; No), the CPU 20 stores the specified melodies with the specified melody data 860S. It is determined whether or not the next headline exists in the lyrics data 861 (step U71).

  If it is determined in step U71 that the next set of headings exists in the lyrics data 861 (step U71; Yes), the CPU 20 resets the next heading as a designated heading (step U72), and then The process proceeds to step U63.

  If it is determined in step U71 that the next set of headings does not exist in the lyrics data 861 (step U71; No), the CPU 20 updates the memorized note data with melody 860 and stores it in the storage unit 80 ( Step U73), the output data change process (4) is terminated.

[1.4 Operation example]
Next, the operation of the audio output device 1 described above will be specifically described with reference to the drawings.

[1.4.1 Operation example (1)]
First, the user performs a user operation for learning using the created memorandum data 860 with melody (step S21; Yes), and any one of the memorandum data 860 with melody in the memorization data group 86 with melody. After specifying as the memorization book data with designated melody 860S (step S22), when the voice output data changing method “1” is designated (step S23), the song data 820 and the lyrics data 861 in the memorization book data with designated melody 860S are set. The composite output process is started (step S24). In this operation example, the volume / display size data 862 stores the default output volume and display size as the output volume and display size of each heading and description.

  Next, the heading “aphorism” of the first set in the lyrics data 861 is detected and set as the designated heading (step S31), and as shown in FIG. In addition, a set of the specified heading “aphorism” and the adjustment term “ha” in the lyrics data 861 and the explanation “Kagen” and the adjustment term “da” is output as audio at the default output volume, and the default display is displayed. The size is displayed (step T2). In this operation example, among the character strings in the figure, a character string that is output as a sound at the default output volume is displayed in a balloon without being surrounded by a frame.

  At this time, when the user inputs the user evaluation “x” for the set of the designated heading “aphorism” and the explanation “Kakugen” that are output as voice (step S32; Yes), the memorization data with designated melody 860S is stored. The input user evaluation “x” is stored in the user evaluation table 85 in association with the corresponding memorization data 840 and the set including the designated heading “aphorism” (step S33).

  Next, when the audio output of the set including the designated heading “aphorism” is completed (step S34; Yes), it is determined that the next set of heading “apiece” exists in the lyrics data 861 (step S35; Yes). The heading “apiece” is reset as the designated heading (step S36).

  Next, as shown in FIG. 10 (b), the designated heading “apiece” in the lyric data 861 and the adjustment term “Noimi” and the explanation “My name” are displayed in accordance with the music to be reproduced by the composite output process. Are output at the default output volume and displayed at the default display size (step T2).

  At this time, when the user inputs a user evaluation “O” to the set of the designated heading “apiece” and the explanation “name meini” that are output as voice (step S32; Yes), the memorization data with designated melody 860S is stored. The input user evaluation “◯” is stored in the user evaluation table 85 in association with the corresponding memorization data 840 and the set including the designated heading “apiece” (step S33).

  Thereafter, in the same manner, each combination of the headline (and the term for adjustment) and the explanation (and the term for adjustment) in the lyrics data 861 in accordance with the music to be reproduced is set to the default output volume by the composite output process. When the user inputs a user evaluation for the set of headings and explanations that are output by voice and displayed in the default display size (step T2) and output by voice (step S32; Yes), the memorization data with designated melody 860S. The inputted user evaluation is stored in the user evaluation table 85 in association with the memorization book data 840 corresponding to and the group including the heading (step S33).

  If it is determined that the next set of headings does not exist in the lyrics data 861 (step S35; No), an output data change process (1) is performed (step S38).

  In the output data change process (1), first, the heading “aphorism” of the lyrics data 861 in the memorized note data 860S with designated melody is designated as the designated heading (step U2), and the user for the set of the designated heading “aphorism” It is determined that the evaluation is “×” (step U5; Yes), and the volume / display size data 862 is changed so that the output volume and the display size of the explanation “Kagen” of the designated heading “aphorism” are increased ( Step U6). In this operation example, the volume / display size data 862 is changed so that the output volume and the display size also increase for the designated heading “aphorism” at this time.

  Next, it is determined that the next set of headings “apiece” is present in the lyrics data 861 (step U11; Yes), and the next heading “apiece” is reset as a designated heading (step U12). It is determined that the user evaluation for the set of the heading “apiece” is “◯” (step U3; Yes), and the output volume and display size of the explanation “namely” of the designated heading “apiece” are set to “0” ( The volume / display size data 862 is changed (so that the sound output and display are turned off) (step U4).

  Thereafter, in the same manner, among the pairs in the lyrics data 861, the group whose user evaluation is “◯” is such that the output volume and display size of the description are “0” (sound output and display are turned off). The volume / display size data 862 is changed (step U4), and the volume / display size data 862 is changed so that the output volume and the display size of the headline and description are increased for the group with the user evaluation “X” (step U4). U6).

  If it is determined that the next set of headings does not exist in the lyrics data 861 (step U11; No), the melodic note data 860 with melody is updated and stored in the storage unit 80 (step U13).

  Next, the user again performs a user operation for learning using the created memorized note data with melody 860 (step S21; Yes), and uses the same memorized note data with melody 860 as the specified memorized note data with melody 860S. After the designation (step S22), when any one of the audio output data changing methods “1” to “4” is designated (step S23), the composition of the song data 820 and the lyric data 861 in the memorized note data with designated melody 860S is synthesized. The output process is started (step S24).

  Next, the heading “aphorism” of the first set in the lyric data 861 is detected and set as a designated heading (step S31), and as shown in FIG. In addition, a combination of the specified heading “aphorism” and the adjustment term “ha” in the lyrics data 861 and the explanation “Kagen” and the adjustment term “da” is output at a high output volume, and is displayed in a large display size. It is displayed (step T2). In this operation example, among the character strings in the figure, a character string that is output at a high output volume is displayed in a balloon surrounded by a rounded rectangular frame and displayed in a large display size. A character string is displayed in bold in the display 10.

  Next, when the audio output of the set including the designated heading “aphorism” is completed (step S34; Yes), it is determined that the next set of heading “apiece” exists in the lyrics data 861 (step S35; Yes). The heading “apiece” is reset as the designated heading (step S36).

  Next, as shown in FIG. 11B, the designated heading “apiece” in the lyric data 861 and the adjustment term “Noimi” are voiced at the default output volume according to the music to be played back by the composite output process. Is output and displayed in the default display size, and the explanation “namely” is output as audio with the output volume “0” (not output), and displayed with the display size “0” (not displayed) (step T2). . In this example of operation, the character string output at the output volume “0” among the character strings in the figure is displayed in the balloon as a blank space with a rectangular frame that is not rounded, and the display size “ A character string displayed as “0” is displayed as a blank in the display 10.

[1.4.2 Operation example (2)]
First, the user performs a user operation for learning using the created memorandum data 860 with melody (step S21; Yes), and any one of the memorandum data 860 with melody in the memorization data group 86 with melody. After designating as specified melodies with specified melody 860S (step S22), when the voice output data changing method “2” is specified (step S23), the song data 820 and lyrics data 861 in the specified melodies with specified melody 860S are set. The composite output process is started (step S24).

  Next, as shown in FIG. 10 described above, the user inputs a user evaluation “×” for the set of the heading “aphorism” and the explanation “Kakugen” that are output as voice (step S32; Yes), and the heading. When the user inputs the user evaluation “◯” for the set of “apiece” and the explanation “namely” (step S32; Yes), if it is determined that the next set of headings does not exist in the lyrics data 861 ( Step S35; No), an output data change process (2) is performed.

  In this output data change process (2), first, the heading “aphorism” of the lyrics data 861 in the memorized note data 860S with designated melody is designated as the designated heading (step U22), and the user for the set of the designated heading “aphorism” It is determined that the evaluation is “x” (step U28; Yes), and the volume / display size data 862 is changed so that the output volume and the display size of the explanation “Kagen” of the designated heading “aphorism” are increased ( Step U29). In this operation example, the volume / display size data 862 is changed so that the output volume and the display size also increase for the designated heading “aphorism” at this time.

  Next, it is determined that the next set of headings “apiece” is present in the lyrics data 861 (step U31; Yes), and the next heading “apiece” is reset as the designated heading (step U32). It is determined that the user evaluation for the set of the heading “apiece” is “◯” (step U23; Yes), and the lyrics data 861 so that the output order of the designated heading “apiece” and its explanation “name” is reversed. Is changed (step U25), and the words “ha” and “da” for adjustment specified in step S4 above are added to the heading “apiece” and the explanation “name meini” to further change the lyrics data 861. (Step U26). Next, the volume / display size data 862 is changed so that the output volume and display size of the designated heading “apiece” become “0” (so that audio output and display are turned off) (step U27).

  When it is determined that the next set of headings does not exist in the lyrics data 861 (step U31; No), the memorized note data with melody 860 is updated and stored in the storage unit 80 (step U33).

  Next, the user again performs a user operation for learning using the created memorized note data with melody 860 (step S21; Yes), and uses the same memorized note data with melody 860 as memorized note data with designated melody 860S. After the designation (step S22), when the voice output data changing method “2” is designated (step S23), the composition output process of the song data 820 and the lyric data 861 in the memorization data with designated melody 860S is started ( Step S24).

  Next, the heading “aphorism” of the first set in the lyrics data 861 is detected and set as the designated heading (step S31), and as shown in FIG. In addition, a combination of the specified heading “aphorism” and the adjustment term “ha” in the lyrics data 861 and the explanation “Kagen” and the adjustment term “da” is output at a high output volume, and is displayed in a large display size. It is displayed (step T2).

  At this time, when the user inputs a user evaluation “◯” for the set of the designated heading “aphorism” and the explanation “Kakugen” that are output as voice (step S32; Yes), the memorization data with designated melody 860S is stored. The input user evaluation “◯” is stored in the user evaluation table 85 in association with the corresponding memorization data 840 and the set including the designated heading “aphorism” (step S33).

  Next, when the audio output of the set including the designated heading “aphorism” is completed (step S34; Yes), it is determined that the next set of heading “apiece” exists in the lyrics data 861 (step S35; Yes). The heading “apiece” is reset as the designated heading (step S36).

  Next, as shown in FIG. 12B, the combined output process defaults to the description “name” of the designated heading “apiece” in the lyrics data 861 and the adjustment term “ha” in accordance with the music to be played. Is output at the default output size, the specified heading “apiece” is output at the output volume “0” (no audio output), and is displayed at the display size “0” (not displayed) (Step T2).

  At this time, when the user inputs a user evaluation “x” for the set of the designated heading “apiece” and the explanation “name meini” that are output as voice (step S32; Yes), the memorized note data with designated melody 860S is input. The input user evaluation “x” is stored in the user evaluation table 85 in association with the corresponding memorization data 840 and the set including the designated heading “apiece” (step S33).

  Next, when it is determined that the next set of headings does not exist in the lyrics data 861 (step S35; No), an output data change process (2) is performed.

  In this output data change process (2), first, the heading “aphorism” of the lyrics data 861 in the memorized note data 860S with designated melody is designated as the designated heading (step U22), and the user for the set of the designated heading “aphorism” It is determined that the evaluation is “◯” (step U23; Yes), and the lyric data 861 is changed so that the output order of the designated heading “aphorism” and the explanation “Kakugen” is reversed (step U25). The adjustment term “to what” specified in step S4 is added to the description “Kakugen” to further change the lyrics data 861 (step U26). Next, the volume / display size data 862 is changed so that the output volume and display size of the designated heading “aphorism” become “0” (so that audio output and display are turned off) (step U27).

  Next, it is determined that the next set of headings “apiece” is present in the lyrics data 861 (step U31; Yes), and the next heading “apiece” is reset as the designated heading (step U32). It is determined that the user evaluation for the set of the heading “apiece” is “×” (step U28; Yes), and the volume and display are increased so that the output volume and display size of the explanation “namely” of the designated heading “apiece” are increased. The size data 862 is changed (step U29). In this operation example, the volume / display size data 862 is changed so that the output volume and the display size are also increased for the designated heading “apiece” at this time.

  When it is determined that the next set of headings does not exist in the lyrics data 861 (step U31; No), the memorized note data with melody 860 is updated and stored in the storage unit 80 (step U33).

  Next, the user again performs a user operation for learning using the created memorized note data with melody 860 (step S21; Yes), and uses the same memorized note data with melody 860 as the specified memorized note data with melody 860S. After the designation (step S22), when any one of the audio output data changing methods “1” to “4” is designated (step S23), the composition of the song data 820 and the lyric data 861 in the memorized note data with designated melody 860S is synthesized. The output process is started (step S24).

  Next, the heading “aphorism” of the first set in the lyric data 861 is detected and set as the designated heading (step S31). As shown in FIG. At the same time, the explanation of the designated heading “aphorism” in the lyric data 861 and the adjustment term “to” are output at the default output volume, displayed at the default display size, and the designated heading “aphorism” is displayed. Audio is output at output volume “0” (no audio output), and is displayed (not displayed) at display size “0” (step T2).

  Next, when the audio output of the set including the designated heading “aphorism” is completed (step S34; Yes), it is determined that the next set of heading “apiece” exists in the lyrics data 861 (step S35; Yes). The heading “apiece” is reset as the designated heading (step S36).

  Next, as shown in FIG. 13 (b), the combination of the designated heading “apiece” and the explanation “name” in the lyrics data 861 is output at a high output volume in accordance with the music to be reproduced by the composite output process. Is displayed in a large display size (step T2).

[1.4.3 Operation example (3)]
First, the user performs a user operation for learning using the created memorandum data 860 with melody (step S21; Yes), and any one of the memorandum data 860 with melody in the memorization data group 86 with melody. After specifying as the memorization book data with designated melody 860S (step S22), when the change method “3” of the audio output data is designated (step S23), the song data 820 and the lyrics data 861 in the memorization book data with the designated melody 860S are specified. The composite output process is started (step S24).

  Next, the heading “grain” of the first set in the lyric data 861 is detected and set as a designated heading (step S31), and as shown in FIG. A set of the specified heading “grain” in the lyric data 861 and the adjustment term “ha” and the explanation “kokutsutsu” is output at the default output volume in accordance with the tune data at the top of the song), and the default display is displayed. The size is displayed (step T2). However, in the operation example (3) and the operation example (4) described later, the display 10 is not shown in the drawing.

  Next, when the audio output of the set including the designated headline “grain” is completed (step S34; Yes), it is determined that the next set of headline “hatch” exists in the lyrics data 861 (step S35; Yes). The heading “hatch” is reset as the designated heading (step S36).

  Next, a combination of the designated heading “hatch” in the lyric data 861 and the adjustment term “ha” and the explanation “incubate” in accordance with the music to be played (here, the head portion of the music) by the composite output process. Is output at the default output volume and displayed at the default display size (step T2).

  At this time, when the user inputs a user evaluation “O” to the set of the designated heading “hatch” and the explanation “had” that is output as a voice (step S32; Yes), the memorization data with designated melody 860S is stored. The input user evaluation “◯” is stored in the user evaluation table 85 in association with the corresponding memorization data 840 and the group including the designated heading “hatch” (step S33).

  Thereafter, in the same manner, each combination of the headline (and the term for adjustment) and the explanation (and the term for adjustment) in the lyrics data 861 in accordance with the music to be reproduced is set to the default output volume by the composite output process. Audio is output and displayed with a default display size (step T2).

  Then, a combination of the designated heading “import” and the adjustment term “ha” in the lyric data 861 and the explanation “import” is set in accordance with the music to be reproduced (here, the end portion of the music) by the composite output process. When audio is output at the default output volume and displayed at the default display size (step T2), when the user inputs a user evaluation “x” for this group (step S32; Yes), memorization with a specified melody is performed. The input user evaluation “x” is stored in the user evaluation table 85 in association with the memorized book data 840 corresponding to the book data 860S and the set including the designated heading “import” (step S33).

  If it is determined that the next set of headings does not exist in the lyrics data 861 (step S35; No), an output data change process (3) is performed (step S38).

  In the output data changing process (3), first, the heading “grain” of the lyrics data 861 in the memorized data with designated melody 860S is designated as the designated heading (step U42), and the user for the set of the designated heading “grain” It is determined that the evaluation is not “x”, that is, the user evaluation is not input (step U48; No), and it is determined that the next heading “hatch” exists in the lyrics data 861 in the memorized note data with specified melody 860S ( Step U51; Yes), the next heading “hatch” is reset as the designated heading (step U52).

  Next, it is determined that the user evaluation for the set of the specified headline “hatch” is “◯” (step U43; Yes), and the output order of the set of the specified headline “hatch” and the description “hatch” is the rear side of the song The lyrics data 861 is changed to be moved to (step U44).

  Next, it is determined that the next heading “palace”,... Exists in the lyrics data 861 in the memorized note data with designated melody 860S (step U51; Yes), and the next heading is reset as the designated heading (step U52), it is determined that the user evaluation for the set of designated headings “palace”,... Is not “x”, that is, the user evaluation is not input (step U48; No).

  Next, it is determined that the next headline “import” exists in the lyrics data 861 in the memorized note data with designated melody 860S (step U51; Yes), and the next heading “import” is reset as the designated headline ( In step U52), it is determined that the user evaluation for the set of the specified headline “import” is “×” (step U48; Yes), and the output order of the set of the specified headline “import” and the description “import” is The lyrics data 861 is changed so as to be moved to the front side (step U49).

  Next, it is determined that the next heading “sword”,... Exists in the lyrics data 861 in the memorized note data with designated melody 860S (step U51; Yes), and the next heading is reset as the designated heading (step U52), it is determined that the user evaluation for the combination of the designated heading “sword”,... Is not “x”, that is, the user evaluation is not input (step U48; No).

  If it is determined that the next set of headings does not exist in the lyrics data 861 (step U51; No), the memorized note data with melody 860 is updated and stored in the storage unit 80 (step U53).

  Next, the user again performs a user operation for learning using the created memorized note data with melody 860 (step S21; Yes), and uses the same memorized note data with melody 860 as the specified memorized note data with melody 860S. After the designation (step S22), when any one of the audio output data changing methods “1” to “4” is designated (step S23), the composition of the song data 820 and the lyric data 861 in the memorized note data with designated melody 860S is synthesized. The output process is started (step S24).

  Next, the heading “import” of the first set in the lyric data 861 is detected and set as a designated heading (step S31), and as shown in FIG. In this case, a set of the specified heading “import” and the adjustment term “ha” in the lyric data 861 and the explanation “import” is output at the default output volume in accordance with the song's first part), and the default display is displayed. The size is displayed (step T2).

  Next, when the audio output of the set including the designated headline “import” is completed (step S34; Yes), it is determined that the next set of headline “grain” exists in the lyrics data 861 (step S35; Yes). The heading “grain” is reset as the designated heading (step S36).

  Next, a combination of the designated heading “grain” in the lyric data 861 and the adjustment term “ha” and the explanation “kokutsutsu” in accordance with the music to be reproduced (here, the first part of the music) by the composite output processing. Is output at the default output volume and displayed at the default display size (step T2).

  Thereafter, in the same manner, each combination of the headline (and the term for adjustment) and the explanation (and the term for adjustment) in the lyrics data 861 in accordance with the music to be reproduced is set to the default output volume by the composite output process. After the sound is output and displayed in the default display size (step T2), the designated heading “hatch” in the lyrics data 861 and the adjustment term “ha” are matched to the music to be played back (here, the last part of the music). And a description “having hatched” are output as audio at the default output volume and displayed at the default display size (step T2).

[1.4.4 Operation example (4)]
First, the user performs a user operation for learning using the created memorandum data 860 with melody (step S21; Yes), and any one of the memorandum data 860 with melody in the memorization data group 86 with melody. After specifying as the memorization data 860S with designated melody (step S22), when the change method “4” of the audio output data is designated (step S23), the song data 820 and the lyrics data 861 in the memorization data 860S with the specified melody The composite output process is started (step S24).

  Next, the heading “grain” of the first set in the lyric data 861 is detected and set as a designated heading (step S31), and as shown in FIG. Here, the default output volume is a set of the specified heading “grain” in the lyric data 861 and the adjustment term “ha” and the explanation “kokutsutsu” in accordance with the A melody portion (other than rust) of the song. Audio is output and displayed with a default display size (step T2).

  Next, when the audio output of the set including the designated headline “grain” is completed (step S34; Yes), it is determined that the next set of headline “hatch” exists in the lyrics data 861 (step S35; Yes). The heading “hatch” is reset as the designated heading (step S36).

  Next, in accordance with the composition output process, the designated heading “hatch” in the lyrics data 861 and the adjustment term “ha” are explained in accordance with the music to be reproduced (here, the A melody part (part other than rust) of the music). A group “having hatched” is output as audio at the default output volume and displayed at the default display size (step T2).

  At this time, when the user inputs a user evaluation “x” for the set of the designated heading “hatch” and the explanation “had” that is output as a voice (step S32; Yes), the memorization data with designated melody 860S is stored. The input user evaluation “x” is stored in the user evaluation table 85 in association with the corresponding memorization data 840 and the set including the designated heading “hatch” (step S33).

  Thereafter, in the same manner, each combination of the headline (and the term for adjustment) and the explanation (and the term for adjustment) in the lyrics data 861 in accordance with the music to be reproduced is set to the default output volume by the composite output process. Audio is output and displayed with a default display size (step T2).

  Then, a combination of the designated heading “import” and the adjustment term “ha” in the lyric data 861 and the explanation “import” in accordance with the music to be reproduced (here, the chorus portion of the music) by the composite output process. When audio is output at the default output volume and displayed at the default display size (step T2), when the user inputs a user evaluation “◯” for this group (step S32; Yes), memorization with a specified melody is performed. The input user evaluation “◯” is stored in the user evaluation table 85 in association with the memorized book data 840 corresponding to the book data 860S and the set including the designated heading “import” (step S33).

  If it is determined that the next set of headings does not exist in the lyrics data 861 (step S35; No), an output data change process (4) is performed (step S38).

  In this output data change process (4), first, the heading “grain” of the lyrics data 861 in the memorized note data with specified melody 860S is designated as the designated heading (step U62), and the user for the set of the designated heading “grain” It is determined that the evaluation is not “◯”, that is, the user evaluation is not input (step U68; No), and it is determined that the next heading “hatch” exists in the lyrics data 861 in the memorized note data with specified melody 860S ( Step U71; Yes), the next heading “hatch” is reset as the designated heading (step U52).

  Next, it is determined that the user evaluation for the set of the specified headline “hatch” is “×” (step U63; Yes), and the output order of the set of the specified headline “hatch” and the description “hatch” is the chorus part of the song The lyrics data 861 is changed to be moved to (step U64).

  Next, it is determined that the next heading “palace”,... Exists in the lyrics data 861 in the memorized note data with designated melody 860S (step U71; Yes), and the next heading is reset as the designated heading (step U72), it is determined that the user evaluation for the set of designated headings “palace”,... Is not “◯”, that is, the user evaluation has not been entered (step U68; No).

  Next, it is determined that the next heading “import” exists in the lyrics data 861 in the memorized note data with designated melody 860S (step U71; Yes), and the next heading “import” is reset as the designated heading ( In step U72), it is determined that the user evaluation for the set of the specified headline “import” is “◯” (step U68; Yes), and the output order of the set of the specified headline “import” and the description “import” is The lyrics data 861 is changed so as to be moved to a part other than the chorus (step U69).

  Next, it is determined that the next heading “sword”,... Exists in the lyrics data 861 in the memorized note data with designated melody 860S (step U71; Yes), and the next heading is reset as the designated heading (step U72), it is determined that the user evaluation for the set of designated headings “sword”,... Is not “◯”, that is, the user evaluation is not input (step U68; No).

  If it is determined that the next set of headings does not exist in the lyrics data 861 (step U71; No), the memorized note data with melody 860 is updated and stored in the storage unit 80 (step U73).

  Next, the user again performs a user operation for learning using the created memorized note data with melody 860 (step S21; Yes), and uses the same memorized note data with melody 860 as the specified memorized note data with melody 860S. After the designation (step S22), when any one of the audio output data changing methods “1” to “4” is designated (step S23), the composition of the song data 820 and the lyric data 861 in the memorized note data with designated melody 860S is synthesized. The output process is started (step S24).

  Next, the heading “import” of the first set in the lyric data 861 is detected and set as a designated heading (step S31), and as shown in FIG. In this case, a set of the specified heading “import” in the lyrics data 861 and the adjustment term “ha” and the explanation “import” is output at the default output volume in accordance with the A melody portion of the song, The display size is displayed (step T2).

  Next, when the audio output of the set including the designated headline “import” is completed (step S34; Yes), it is determined that the next set of headline “grain” exists in the lyrics data 861 (step S35; Yes). The heading “grain” is reset as the designated heading (step S36).

  Next, by the composite output process, the designated heading “grain” in the lyric data 861 and the adjustment term “ha” and the explanation “Kokutsuki” are matched with the music to be reproduced (here, the A melody portion of the music). The set is audio-output at the default output volume and displayed at the default display size (step T2).

  Thereafter, in the same manner, each combination of the headline (and the term for adjustment) and the explanation (and the term for adjustment) in the lyrics data 861 in accordance with the music to be reproduced is set to the default output volume by the composite output process. After the sound is output and displayed in the default display size (step T2), the designated heading “hatch” and the adjustment term “ha” in the lyrics data 861 are matched to the music to be played (here, the chorus part of the music). And a description “having hatched” are output as audio at the default output volume and displayed at the default display size (step T2).

  According to the audio output device 1 described above, when the user evaluation is input for any of the headings and explanations as shown in steps S32 to S38 of FIG. 3, FIG. 6 to FIG. The input user evaluation and the group to which this user evaluation is input are stored in association with each other, and a plurality of sets of audio output data are changed according to the stored user evaluation. Thus, a plurality of sets of audio output data of the heading and description are changed. Therefore, the learning efficiency when learning using the voice output can be increased.

  Further, as shown in FIGS. 8 to 9 and FIGS. 14 to 15 and the like, the audio output order of the group associated with the user evaluation is changed among the plurality of groups in accordance with the user evaluation. Therefore, it is possible to reliably improve the learning efficiency when learning using voice output.

  In addition, as shown in FIG. 7 and FIGS. 12 to 13 and the like, the audio output order of the heading and the description in the group associated with the user evaluation is reversed according to the user evaluation, and the heading The volume of the audio output is reduced or the volume is reduced to zero, so that the learning efficiency when learning using the audio output can be reliably increased.

  In addition, as shown in FIG. 6 and FIGS. 10 to 11 and the like, according to the user evaluation, the volume of the audio output of at least one of the heading and the description in the group associated with the user evaluation is changed. The learning efficiency when learning using speech output can be reliably increased.

  Also, as shown in step S24 of FIG. 3, FIG. 10 to FIG. 15 and the like, a plurality of sets of headings and explanations are output according to the music to be played back. And a set of explanations can be learned. Therefore, the learning efficiency when learning using voice output can be further increased.

  The embodiments to which the present invention can be applied are not limited to the above-described embodiments, and can be appropriately changed without departing from the spirit of the present invention.

  For example, the audio output control device according to the present invention has been described as the audio output device 1, but those to which the present invention can be applied are not limited to such products, but are mobile phones, personal computers, PDAs (Personal Digital Assistants), The present invention can be applied to all electronic devices such as game machines, and is particularly preferably applied to an electronic dictionary 1A as shown in FIG. Also, the audio output control program 81 according to the present invention may be stored in the external information storage medium 12a that is detachable from the audio output device 1.

  In the above description, “-ha” and “-is” for adjusting the number of sounds are added to the heading and explanation, and then the text data of the lyrics data 861 is subjected to speech synthesis processing (Text To Speech processing) for one character. Voice data is created one by one, each character of the voice data is put on the melody of the music data 820, voice output data is generated, and a set of headings and explanations are voiced according to the music data. On the other hand, each audio data of a set of headings and explanations is stored in advance, and the output order of the plurality of sets is changed according to user evaluation by changing the volume or order of the headings and explanations. Alternatively, the volume may be changed. In this way, the present invention can be easily realized without the need for processing such as speech synthesis or tone number adjustment.

  Moreover, although it demonstrated as inputting user evaluation via the key group 2, you may input via a microphone, the audio | voice output apparatus 1 is equipped with the three-dimensional acceleration sensor, and the audio | voice output apparatus 1 is provided. The user evaluation of “◯” may be input by swinging vertically, and the user evaluation of “×” may be input by shaking horizontally.

  Moreover, although it demonstrated as a user evaluation being input with respect to the group of the headline and description which were sound-outputted as lyrics according to a music, the memorization data 840 is displayed and displayed irrespective of sound output. The user evaluation may be input for the combination of the headline and the explanation.

As mentioned above, although several embodiment of this invention was described, the scope of the present invention is not limited to the above-mentioned embodiment, The range of the invention described in the claim is equal to the equivalent range. Including.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
Audio output control means for outputting audio output data corresponding to a plurality of sets of headings and descriptions of the headings;
User evaluation input means for inputting a user evaluation for any of the plurality of sets based on a user operation;
A found user evaluation storage means for storing the user evaluation input by the user evaluation input means and the set in which the user evaluation is input;
Sound output data changing means for changing the output order or volume of the plurality of sets in the sound output data according to the user evaluation stored by the found user evaluation storage means;
An audio output control device comprising:
<Claim 2>
The sound output control device according to claim 1,
The user evaluation input means includes:
The difficulty level or the attention level for a set of headings and explanations that are voice output by the voice output control means is input as the user evaluation,
The voice output data changing means is
According to the user evaluation stored by the found user evaluation storage unit, the audio output order of the set associated with the user evaluation is changed in the plurality of sets to update the audio output data. Voice output control device.
<Claim 3>
The sound output control device according to claim 1,
The user evaluation input means includes:
The difficulty level or the attention level for a set of headings and explanations that are voice output by the voice output control means is input as the user evaluation,
The voice output data changing means is
In accordance with the user evaluation stored by the found user evaluation storage means, the order of voice output of the heading and description in the group associated with the user evaluation is reversed, and the sound output volume of the heading is reduced. Alternatively, the audio output control device is characterized in that the audio output data is updated with the volume set to zero.
<Claim 4>
In the audio output control device according to any one of claims 1 to 3,
Audio output data generating means for generating audio output data corresponding to a plurality of sets of headings and descriptions of the headings;
A song playback means for playing back a song,
The audio output control means includes
An audio output control device that outputs a plurality of sets generated by the audio output data generation means in accordance with the music reproduced by the music reproduction means.
<Claim 5>
The sound output control device according to claim 1,
The user evaluation input means includes:
The difficulty level or the attention level for a set of headings and explanations that are voice output by the voice output control means is input as the user evaluation,
The voice output data changing means is
According to the user evaluation stored by the found user evaluation storage means, the sound output data is updated by changing the volume of the sound output of at least one of the headline and the description in the group associated with the user evaluation. A voice output control device.
<Claim 6>
In the electronic device which has an audio output control device according to any one of claims 1 to 5,
An electronic apparatus comprising sound output means for outputting sound output data whose sound output is controlled by the sound output control means to the outside.
<Claim 7>
An audio output control function for causing a computer to output audio output data corresponding to a plurality of combinations of a heading and a description of the heading;
A user evaluation input function for inputting a user evaluation for any of the plurality of sets based on a user operation;
A found user evaluation storage function for storing the user evaluation input by the user evaluation input function and the group in which the user evaluation is input in association with each other in a storage unit;
A voice output data change function for changing the output order or volume of the plurality of sets in the voice output data according to the user evaluation stored by the found user evaluation storage function;
An audio output control program characterized by realizing the above.

1 Audio output device 20 CPU
30 Input unit 81 Audio output control program 85 User evaluation table

Claims (10)

Its header, and the audio output control means for voice output audio output data corresponding to a plurality of pairs of the description of the title,
User evaluation input means for inputting a user evaluation related to the level of difficulty or attention level for any of the plurality of sets based on a user operation;
A user evaluation input by the user evaluation input means, and look out Rating storage means stores an association and set by the user evaluation is input,
The first change to turn off the audio output of the description or reduce the output volume for the group determined that the difficulty level or the attention level indicated by the user evaluation stored by the found user evaluation storage unit is low, or the audio Voice output data changing means for performing a second change in which the output order of the heading and the description in the output data is reversed and the voice output of the heading is turned off or the output volume is reduced ;
An audio output control device comprising: The audio output control apparatus according to claim 1,
The voice output data changing means performs a third change to increase the output volume of the explanation for a group determined to have a high degree of difficulty or attention indicated by the user evaluation. . The audio output control apparatus according to claim 1,
  The voice output data changing means is
  An audio output control device that performs a fourth change in which the output order in the plurality of sets is moved to the rear side for a group determined to have a low difficulty level or attention level indicated by the user evaluation. . The audio output control device according to claim 3,
  The voice output data changing means is
  An audio output control apparatus that performs a fifth change in which the output order of the plurality of sets is moved to the front side for a group determined to have a high degree of difficulty or attention indicated by the user evaluation. In the audio output control device according to any one of claims 1 to 4 ,
And strings of the title, and the audio output data generating means for generating an audio output data corresponding to a plurality of sets of the string description of the title,
A song playback means for playing back a song,
The audio output control means includes
An audio output control apparatus that outputs audio output data corresponding to a plurality of sets generated by the audio output data generation means in accordance with the music reproduced by the music reproduction means. The audio output control device according to claim 5,
The sound output data generating means generates sound output data corresponding to a combination of the heading and the description of the heading in accordance with the phrase of the music reproduced by the music reproducing means. When the number of characters in the heading or the description of the heading is small, an audio output control is generated by adding a term for adjustment to the character string of the heading or the description of the heading. apparatus. In the audio output control device according to any one of claims 1 to 6 ,
The user evaluation input means includes:
Audio output control apparatus characterized by inputting a difficulty level or degree of attention for the set of headlines and description are audio output, as the user evaluation by the audio output control unit. In the electronic device which has an audio output control device according to any one of claims 1 to 7 ,
An electronic apparatus comprising sound output means for outputting sound output data whose sound output is controlled by the sound output control means to the outside. The audio output control device
  Processing for outputting audio output data corresponding to a plurality of sets of a heading and a description of the heading;
  Based on a user operation, for any of the plurality of sets, a process of inputting a user evaluation related to the level of difficulty or attention;
  A process of storing the input user evaluation and the group in which the user evaluation is input in association with each other;
  The first change in which the audio output in the description is turned off or the output volume is reduced for the group determined that the difficulty level or the attention level indicated by the stored user evaluation is low, or the heading in the audio output data and the A process of performing a second change that reverses the output order with the description and turns off the audio output of the heading or reduces the output volume;
The voice output control method characterized by performing. Computer
  Audio output control means for outputting audio output data corresponding to a plurality of sets of headings and descriptions of the headings;
  User evaluation input means for inputting a user evaluation related to the level of difficulty or attention level for any of the plurality of sets based on a user operation;
  A found user evaluation storage means for storing the user evaluation input by the user evaluation input means and the set in which the user evaluation is input;
  The first change to turn off the audio output of the description or reduce the output volume for the group determined that the difficulty level or the attention level indicated by the user evaluation stored by the found user evaluation storage unit is low, or the audio Voice output data changing means for performing a second change in which the output order of the heading and the description in the output data is reversed and the voice output of the heading is turned off or the output volume is reduced;
A voice output control program characterized by being made to function.

Images