TWI383317B - Audio playing apparatus with an interactive function and method thereof - Google Patents

Description

Audio playback device with interactive function and interactive method thereof

The present invention relates to an audio playback device with interactive functions and an interactive method thereof, and more particularly to an audio playback device that can ask a user and an interactive method thereof.

At present, many audio playback devices have the functions of telling stories, playing texts, and playing music. These stories, texts or music are pre-recorded audio files stored in the storage unit. The format of these files is generally AAC, AC-3, ATRAC3plus, MP3, WMA9, etc. Users can only pass the "next", The "previous", "pause", "play" and other methods control the playback of audio. Therefore, in the process of playing the audio file, there is no function to interact with the user, such as asking the user.

In view of this, it is necessary to provide an audio playback device with interactive functions and an interactive method thereof.

The interactive audio playback device includes a storage unit, an input unit, an audio decoding unit and an audio output unit. The storage unit stores at least one interactive data and a prompt voice library, and each interactive data includes a main audio. At least one question audio and a control message, the prompt voice library records at least one prompt voice, the control information includes a main control information and a problem control information corresponding to the question audio one-to-one, the main control information record has the main The audio acquisition mode, the problem control information definition has its corresponding problem audio acquisition mode and the next problem audio control information acquisition manner; the audio playback device further includes a playback control The module is configured to obtain control information of the interactive data when playing the interactive data, and obtain the main audio according to the main audio acquiring manner recorded in the main control information and the method for obtaining the problem audio recorded in the problem control information. a problem audio, the main audio and the problem audio are decoded by the audio decoding unit, and output by the audio output unit; a prompting module is configured to select a prompt voice from the prompt voice library, and pass the audio decoding unit After being decoded, the audio output unit outputs; a problem connection module is configured to obtain the next problem control information from the method for acquiring the next problem control information of the problem control information, and the playback control module obtains the corresponding problem audio. Play.

In the interactive method of the interactive audio playback device, the audio playback device provides a storage unit, where the storage unit stores at least one interactive data and a prompt voice, each interactive data includes a primary audio, at least one question. Audio and a control information, the prompt voice library records at least one prompt voice, the control information includes a main control information and a problem control information corresponding to the problem audio one by one, the main control information record has the main audio acquisition mode, The problem control information defines a method for acquiring the corresponding problem audio and a method for acquiring the next question audio control information; the method includes: obtaining an interactive data from the storage unit, thereby obtaining control information of the interactive data, and according to the control information The main audio is obtained by acquiring the main audio; the main audio is transmitted to an audio decoding unit for decoding, and then played by an audio output unit; the first problem control information is acquired; and the problem audio is played, the specific steps are: according to the problem The audio recording method of the problem recorded in the control information is corresponding. Audio problem, the problem is transmitted to the audio decoding unit decoding the audio, and then Playing by the audio output unit; selecting a prompt voice from the prompt voice library, and decoding by the audio decoding unit, outputting by the audio output unit; and obtaining the next problem control information from the problem control information Get the next problem control information and then perform the steps to play the problem audio.

Compared with the prior art, the interactive audio playing device and the interactive method thereof of the present invention ask a user after playing a piece of audio, and then randomly obtain a prompt voice including an answer from a preset voice library, and according to the Instructing the correctness of the voice to give an indication not only allows the user to add an understanding and impression to the played audio, but also creates an interaction between the user and the audio playback device, which increases the interest.

Please refer to FIG. 1 , which is a structural diagram of a function module of an audio playback device with an interactive function (hereinafter referred to as an audio playback device) in the first embodiment. The audio playback device 10 includes a storage unit 11, a central processing unit 12, an audio decoding unit 13, an audio output unit 14, an input unit 15, and a pointing device 16. The audio playback device 10 can interact with the user after playing a piece of audio, such as playing the question audio corresponding to the piece of audio, and asking the user questions. At least one interactive material 20 and a prompt voice library 24 are stored in the storage unit 11 of the audio playback device 10. Each interactive material 20 (shown in Figures 2 and 3) includes a control message 21, a main audio 22 and at least one question audio 23. The main audio 22 can be a story, a text, a piece of music or other audio. Each question audio 23 is some audio set for the content of the main audio 22 for interacting with the user. The prompt voice library 24 includes at least one prompt voice, each prompt The voice is a voice prompting the user to answer, and each prompt voice represents a prompt answer, which may be the correct answer or the wrong answer, as shown in FIG. 5, which is a schematic diagram of the prompt voice library 24.

The interactive data has two structures. The first structure is as shown in FIG. 2, each interactive data is a file, the control information 21, a main audio 22, a plurality of question audios 23, and data corresponding to each question audio. The library 24 forms part of the file, respectively. The main audio 22 and each of the question audios 23 have an audio head information that records information related to the main audio/question audio, such as the play duration, the encoding format, and the version number.

The second structure of the interactive data is shown in FIG. 3. The control information 21 of each interactive material, the main audio 22, each question audio 23, and the prompt voice library 24 corresponding to each question are stored in separate files.

In the two interactive data structures shown in FIG. 2 and FIG. 3, the format of the control information 21 is basically the same. The control information 21 includes a main control information 211 and problem control information 212 corresponding to the interactive question audio. The main control information 211 records the main audio acquisition mode. In the interactive data structure shown in FIG. 2, the main audio acquisition mode records the displacement value of the main audio 22 in the audio file, and the interactive data shown in FIG. The main audio acquisition mode in the structure is to record the file name of the main audio 22. The problem control information 212 records the acquisition mode of the corresponding question audio 23 (hereinafter referred to as the problem audio acquisition mode), a connection information (ie, the acquisition method of the next problem control information), and the correct answer of the corresponding question audio 23, as shown in FIG. Show.

The central processing unit 12 includes a play control module 121, a prompt module 122, a prompt determination module 123, an indication module 124, and a problem connection. The module 125 is connected.

The play control module 121 is configured to obtain control information of the interactive data when playing the interactive data, and obtain the main audio 22 and the control according to the main audio acquisition manner recorded in the main control information 211 of the control information 21 The problem audio acquisition mode recorded in the problem control information 212 of the information 21 acquires the corresponding question audio 23, and the main audio 22 and the question audio 23 are decoded by the audio decoding unit 13, and then output by the audio output unit 14.

The prompt module 122 is configured to randomly select a prompt voice from the prompt voice library 24, and after being decoded by the audio decoding unit 13, output by the audio output unit 14.

The prompt determination module 124 is configured to compare the prompt answer represented by the randomly selected prompt voice with the correct answer recorded in the problem control information, and determine that the prompt voice is a correct prompt or an error prompt. For example, if the correct answer recorded in the question control information 212 is "Yes" and the prompt answer indicated by the prompt voice is "No", the prompt is an error prompt; if the correct answer recorded in the problem control information 212 is " Yes, and the prompt for the voice indication is "Yes", then the prompt is a correct prompt.

The indication module 124 is configured to control an indication that the pointing device makes a correct prompt when the prompt is a correct prompt, and when the prompt is an error prompt, control the pointing device to make an indication of an error prompt. In the present invention, the pointing device 16 can be a voice device or an LED light or the like.

The problem connection module 125 is configured to determine, after the indication module 124 indicates, the next problem control recorded in the connection information of the problem control information. Whether the acquisition method of the information is a preset value, if it is a preset value, the playback of the interactive data is ended, and if it is not a preset value, the playback control module 121 is notified according to the next problem recorded in the connection information. Control the way information is obtained to obtain the next problem control information.

Referring to FIG. 6, a flowchart of a method of interacting with the audio playback device in the first embodiment is shown. First, when the interactive data is started to be played, the playback control module 121 obtains the control information 21 of the interactive data, and acquires the main audio 22 according to the acquisition manner of the main control information 211 of the control information 21 (step S601).

The playback control module 121 transmits the main audio 23 to the audio decoding unit 13 for decoding, and then plays by the audio output unit 14 (step S602).

After the main audio is played, the play control module 121 acquires the first question control information 212, and obtains the corresponding question audio 23 according to the question audio acquisition mode of the problem control information 212 (step S603).

The audio decoding unit 13 decodes the question audio 23 and then plays by the audio output unit 14 (step S604).

The prompting module 122 randomly selects a prompt voice from the prompt voice library 24, and after being decoded by the audio decoding unit 13, is output by the audio output unit 14 (step S605).

The prompt determination module 124 is configured to compare the answer represented by the randomly selected prompt voice with the correct answer recorded in the problem control information, and determine that the prompt voice is a correct prompt or an error prompt. (Step S606).

When the voice prompt is determined to be a correct prompt, the indication module 124 controls the indication device 16 to make an indication of a correct prompt. When the user's prompt is determined to be an error prompt, the indication module 124 controls the indication device 16 to make an error prompt. An indication (step S607).

After the indication module 124 makes an indication, the question connection module 125 acquires the next problem control information from the connection information in the problem control information 212 (step S608).

The problem connection module 125 determines whether the acquired acquisition method of the next problem control information is a preset value (step S609). If it is a preset value, the operation ends.

If not a preset value, the playback control module 121 acquires the next problem control information 212 according to the acquisition method of the next problem control information, and obtains the corresponding problem audio according to the problem audio acquisition mode of the next problem control information 212. 23. The flow jumps to step S604 (step S610).

As shown in FIG. 7, it is a functional block diagram of the audio playback device with interactive function in the second embodiment. In the second embodiment, the central processing unit 12 of the audio playback device further includes a response receiving module 126 and a response determining module 127, and the response receiving module 126 is configured to receive and identify the input unit 15 The input signal determines the response to the audio of the question. The input unit 15 can be a button, a touch sensor, or a sound input device such as a microphone or the like. In the present invention, if the input unit 15 is a button, a button corresponding to each of the user's various responses may be defined, such as a "yes" response button and a button indicating that the user has made a "no" response; if the input unit 15 is a voice input Device, can be defined to represent the user The various responses correspond to voices, such as voices indicating that the user made a "yes" response and voices indicating that the user made a "no" response.

The response determining module 127 is configured to compare the response with the correct answer recorded in the problem control information 212 to determine whether the response is a correct response or an error response. For example, if the correct answer recorded in the question control information 212 is "Yes" and the response receiving module 126 recognizes that the user's response is "No", the response is an error response; if the problem control information 212 is recorded The correct answer is "No", and the response receiving module 126 recognizes that the user's response is "No", then the response is a correct response.

The indication module 124 is configured to generate a determination result according to the judgment of the prompt determination module 124 and the response determination module 127, and the instruction indication device 16 makes an indication according to the determination result, where there are four determination results, the first type In response to the prompting determination module 124 determining that the prompting voice is a correct prompt, the response determining module 127 determines that the user's response is a correct response; the second is that the prompting determining module 124 determines that the prompting voice is a correct prompt, and the response determining module 127 determines the user's The response is an error response; the third is that the prompt determination module 124 determines that the prompt voice is an error prompt, the response determination module 127 determines that the user response is a correct response; and the fourth is that the prompt determination module 124 determines that the prompt voice is an error prompt. The response judgment module 127 determines that the user's response is an error response. The indication module 124 controls the pointing device 16 to make different indications according to different determination results. Here, the audio playback device is taken as an example of a toy. If the determination result is the first type, the indication module 124 controls the indication device 16 to make a nod. If the determination result is the second type, the indication is The module 124 controls the indication device 16 to make an instruction to shake the head. If the determination result is the third type, the result indicates that the device controls the indication of the nose extension. If the determination result is the fourth type, the indication module 124 controls the indication device 16 to make an indication of blinking.

Referring to FIG. 8, a flowchart of a method of interacting with the audio playback device in the second embodiment is applied. Steps S801-S806 in this embodiment are the same as steps S601-S606 of the method of interacting with the audio playback apparatus in the first embodiment, and are not described herein again. The response receiving module 126 then receives and recognizes the response of the user according to the question through the input unit 15 (step S807).

The response determining module 127 compares the identified user's response with the correct answer recorded in the correct answer of the problem control information, and determines whether the user's response is consistent with the correct answer recorded in the correct answer of the problem control information. , the user's response is a correct response, and if not, the user's response is an error response (step S808).

The indication module 124 combines the determinations of the prompt determination module 124 and the response determination module 127 to generate a determination result (step S809).

The indication module 124 instructs to control the response of the pointing device to the user according to the determination result (step S810).

After making the indication, the question connection module 125 obtains the next question control information from the connection information in the question control information 212 (step 811).

The problem connection module 125 determines whether the acquired acquisition method of the next problem control information is a preset value (step S812). If it is a preset value, the operation ends.

If not a preset value, the playback control module 121 acquires the next problem control information 212 according to the acquisition method of the next problem control information, and obtains the corresponding problem audio according to the problem audio acquisition mode of the next problem control information 212. 23. The flow jumps to step S804 (step S813).

11‧‧‧ storage unit

12‧‧‧Central Processing Unit

13‧‧‧Audio decoding unit

14‧‧‧Audio output unit

15‧‧‧Input unit

16‧‧‧ indicating device

20‧‧‧Interactive materials

21‧‧‧Control information

22‧‧‧Main audio

23‧‧‧Question audio

24‧‧‧Prompt speech library

211‧‧‧Master Control Information

212‧‧‧ Problem Control Information

121‧‧‧Playback Control Module

122‧‧‧ prompt module

123‧‧‧ prompt judgment module

124‧‧‧Indicating module

125‧‧‧ Problem connection module

126‧‧‧Response receiving module

127‧‧‧Response judgment module

1 is a structural diagram of a functional module of an audio playback device having an interactive function in a first embodiment; FIG. 2 is a schematic diagram of a first structure of interactive data; and FIG. 3 is a schematic diagram of a second structure of interactive data; 4 is a schematic diagram of the prompt speech library; FIG. 5 is a schematic diagram of the problem control information; FIG. 6 is a flowchart of an interaction method between the application and the audio playback apparatus in the first embodiment; FIG. 7 is an audio playback device with an interactive function. The functional module structure diagram in the second embodiment; and FIG. 8 is a flowchart of the interaction method between the application and the audio playback device in the second embodiment.

11‧‧‧ storage unit

12‧‧‧Central Processing Unit

13‧‧‧Audio decoding unit

14‧‧‧Audio output unit

15‧‧‧Input unit

16‧‧‧ indicating device

20‧‧‧Interactive materials

24‧‧‧Prompt speech library

121‧‧‧Playback Control Module

122‧‧‧ prompt module

123‧‧‧ prompt judgment module

124‧‧‧Indicating module

125‧‧‧ Problem connection module

Claims (12)

An audio playback device with an interactive function, comprising a storage unit, an input unit, an audio decoding unit and an audio output unit, wherein the storage unit stores at least one interactive data and at least one prompt voice library, each An interactive data includes a control information, a main audio, and at least one question audio, the prompt voice library records at least one prompt voice, the control information includes a main control information and problem control information corresponding to the question audio one by one, The main control information record has the main audio acquisition mode, and the problem control information defines the acquisition mode of the corresponding problem audio and the acquisition method of the next question audio control information; a play control module is configured to play the interactive data Obtaining control information of the interactive data, and acquiring main audio and problem audio according to the main audio acquisition manner recorded in the main control information and the method for obtaining the problem audio recorded in the problem control information, where the main audio and the problem audio are After the audio decoding unit performs decoding, it is output by the audio output unit; The module is configured to randomly select a prompt voice from the prompt voice library, and after being decoded by the audio decoding unit, output by the audio output unit; and a question connection module for using the next problem control information The method for obtaining the problem control information acquires the next problem control information, and the playback control module acquires the corresponding question audio for playing. The audio playback device with interactive function according to claim 1, wherein the problem control information further records a correct answer of the question audio, the prompt voice includes a prompt answer, and the audio playback device further includes The prompt determination module and an indication module are configured to compare the prompt answer represented by the prompt voice with the correct answer recorded in the problem control information, and determine that the prompt voice is a correct prompt or an error prompt. The indication module is configured to control an indication device to make a correct prompt when the prompt determination module determines that the prompt voice is a correct prompt, and control the pointing device when the prompt determination module determines that the prompt voice is an error prompt An indication of the error message. The audio playback device with interactive function according to claim 1, wherein the problem control information further records a correct answer of the question audio, the prompt voice includes a prompt answer, and the audio playback device further includes a prompt a judging module, a response receiving module, a response judging module and an indicating module; the prompt judging module is configured to compare the prompt answer indicated by the prompt voice with a correct answer recorded in the problem control information The prompt voice is a correct prompt or an error prompt; the response receiving module is configured to receive and identify a response generated by an input unit, compare the response with a correct answer recorded in the problem control information, and determine that the response is correct Response or error response; the indication module is configured to generate a determination result in conjunction with the judgment of the prompt determination module and the response determination module, and control the indication device to make an indication according to the determination result. For example, the audio playback device with interactive function described in claim 3, wherein the combination of the prompt determination module and the response determination module determines that there are four types of determination results, and the first type is a prompt determination module to determine a prompt. The prompt in the voice is a correct prompt, the response judgment module determines that the user's response is a correct response; the second is that the prompt determination module determines that the prompt in the prompt voice is a correct prompt, and the response judgment module determines that the user's response is an error response; Three kinds of prompt judgment modules determine that the answer in the prompt voice is an error prompt, back It should be judged that the module judges that the user's response is a correct response; the fourth is that the prompt judgment module determines that the answer in the prompt voice is an error prompt, and the response judgment module determines that the user's response is an error response. The interactive audio playback device of claim 1, wherein each of the interactive data is a file, and the main audio acquisition mode and the audio acquisition mode of the problem are main audio and problem audio in interactive data. The displacement value in . The audio playback device with interactive function according to claim 1, wherein the main audio, each question audio and control information of each interactive data are stored in an independent file, and the main audio acquisition mode and The audio acquisition method of this problem is the file name of the main audio and problem audio. An interactive method for an audio playback device, the audio playback device provides a storage unit, the storage unit stores at least one interactive data and a prompt voice library, each interactive data includes a main audio, at least one question audio, and a control Information, the prompt voice library records at least one prompt voice, the control information includes a main control information and a problem control information corresponding to the problem audio one by one, the main control information record has the main audio acquisition mode, the problem control information The method for obtaining the audio of the corresponding problem and the method for obtaining the audio control information of the next question are defined; the method comprises: obtaining an interactive data from the storage unit, thereby obtaining control information of the interactive data, and according to the control information The main audio acquisition mode acquires the main audio; the main audio is transmitted to an audio decoding unit for decoding, and then played by an audio output unit; the first problem control information is acquired; and the problem audio is played, the specific steps are: controlling according to the problem Information record The problem audio acquisition method takes the corresponding question audio, transmits the problem audio to the audio decoding unit, and then plays by the audio output unit; randomly selects a prompt voice from the prompt voice library, and passes the audio decoding unit After decoding, the audio output unit outputs; the next problem control information is acquired from the acquisition method of the next problem control information of the problem control information, and then the step of playing the problem audio is performed. The interactive method applied to the audio playback device according to claim 7, wherein the problem control information further records a correct answer of the question audio, the prompt voice represents a prompt answer, and the method further comprises the steps of: After prompting the voice output, comparing the prompt answer included in the prompt voice with the correct answer recorded in the problem control information, determining that the answer in the prompt voice is a correct prompt or an error prompt; when determining that the prompt voice is a correct prompt, controlling one The indication device makes an indication of a correct prompt, and when the prompt voice is an error prompt, controls the indication device to make an indication of an error prompt. An interactive method applied to an audio playback device according to claim 7, wherein the problem control information further records a correct answer of the question audio, the prompt voice represents a prompt answer, and the method further comprises the step of: prompting The prompt answer included in the voice is compared with the correct answer recorded in the problem control information, and the answer in the prompt voice is judged to be a correct prompt or an error prompt; the response to the audio of the question is received and recognized; and the response is controlled with the problem The correct answer recorded in the information is compared, and the response is determined to be a correct response or an incorrect response; combining the prompt voice as a correct prompt or an error prompt and the response is correct A judgment result should be made or an error response, and a judgment result is generated, and the instruction means is instructed to make an instruction according to the judgment result. The interactive method applied to the audio playback device according to claim 9, wherein the judgment result has four types, the first one is that the prompt voice is a correct prompt, and the user response is a correct response; The prompt voice is the correct prompt, the user's response is the wrong response; the third is the prompt voice is the error prompt, the user's response is the correct response; the fourth is the prompt voice is the error prompt, and the user response is the wrong response. The interactive method applied to the audio playback device according to claim 7, wherein each of the interactive materials is a file, the main audio acquisition mode, the audio acquisition mode of the problem, and the acquisition manner of the prompt voice library. The displacement value of the main audio, question audio, and prompt voice library in the interactive data. The interactive method applied to the audio playback device according to claim 7, wherein the main audio of each interactive material, each question audio, control information, and each prompt voice library are stored in separate files. The main audio acquisition mode, the audio acquisition mode of the problem, and the file name of each prompt voice library as the main audio, the question audio, and the prompt voice library.