KR100357243B1 - Method for studying in multi-channel palying device using select output audio and caption data and Device for emplementing it - Google Patents

Abstract

The present invention relates to audio output data and audio output data stored in stereo or more channels in a device having a function of reproducing digital files and caption data stored in at least two channels, such as a language learner or karaoke device. The present invention relates to the use of audio signal output channel selection to enhance the learning effect of language, lyrics, etc. by selectively outputting the caption data. The digital signal reproduces the audio signal stored in two channels (R, L), A reproduction apparatus for displaying a caption signal synchronized with an output of the audio signal, comprising: a first step of inspecting an operation mode at the time of reproduction currently set when an operation on signal for reproducing an audio signal from a user is input; A second outputting audio signal preset for each channel (R, L) when the mode is a normal channel output And the third step of reproducing and outputting the audio signal to the right channel if the operation mode is set to the right (R) channel output, and the audio signal to the left channel if the operation mode is set to the left (L) channel output. And reproducing and outputting the fourth step. The method of the present invention can also be extended to multichannel digital files as well.

Description

Method for studying in multi-channel palying device using select output audio and caption data and Device for emplementing it}

The present invention relates to audio output data and audio output data stored in stereo or more channels in a device having a function of reproducing digital files and caption data stored in at least two channels, such as a language learner or karaoke device. The present invention relates to a learning method using an audio signal output channel selection capable of enhancing the learning effect such as language and lyrics by selectively outputting synchronized caption data.

Due to the development of digital signal processing technology, various products using digital audio signals have been produced and sold. Products such as MP3 players, language learners using digital audio files, and karaoke are widely used. These products include caption data that can display text as well as audio signals such as normal voice, song lyrics or accompaniment (including background music in a movie). Or, singing in karaoke machines, etc. is helping to acquire lyrics.

However, in the conventional language learner, since the listener has only the function of repeatedly listening to and repeating the contents of the audio signal output through the speaker (or earphones, which are mainly used in portable devices), it does not allow various situations of direct conversation parties. We could not do effective speech learning.

Also, in the case of karaoke machines, since the song lyrics and accompaniment are output at the same time, if the song lyrics are not learned, you can easily sing along with the accompaniment by looking at the characters displayed on the screen, but basically you need to know the song. There is a blind spot. Also, in order to sing a new song to accompaniment, you must first listen to the singer's song and become familiar with it. Therefore, there is a need for a song learning method including a device capable of selectively outputting a singer's voice by integrating existing audio and karaoke devices.

According to the present invention, in a device having a function of reproducing digital files and outputting caption data, such as a language learner or a karaoke device, the audio output data stored in stereo or multiple channels and caption data synchronized with the audio output data are selectively selected. The purpose of the present invention is to provide a learning method using output channel selection of audio and caption data that can enhance the learning effect by outputting.

The learning method of the present invention for achieving the above object, the first step of checking the operation mode at the time of playback currently set by the control unit 20 when the operating temperature signal for the reproduction of the audio signal from the keypad 80 and If the operation mode is a normal channel output, the control unit 20 controls the decoder 30 to output a predetermined audio signal for each channel (R, L), and the operation mode is the right (R A third step of outputting an audio signal to the right channel by controlling the decoder 30 in the control unit 20, and the control unit 20 if the operation mode is set to the left channel output. And a fourth step of controlling the decoder 30 at 20 to output the audio signal to the left channel.

In addition, the learning device of the present invention, when the operation temperature signal for reproducing the audio signal is input from the keypad 80, the control unit 20 checks the operation mode at the time of playback currently set, and if the operation mode is normal, the control unit 20 Control the decoder 30 to output a preset audio signal for each channel (R, L), and if the operation mode is set to the right (R) channel, the control unit 20 controls the decoder 30 When the audio signal is reproduced and output to the right channel and the operation mode is set to the left (L) channel, the controller 20 controls the decoder 30 to reproduce and output the audio signal to the left channel. It is characterized by. The method and apparatus of the present invention can also be extended to multichannel digital files as well.

1 is a partial block diagram of a stereo playback apparatus conventionally used;

2 is a partial block diagram of a conventional multi-channel playback apparatus;

3 is a flowchart illustrating the method of the present invention applied to a stereo channel;

4 is another flow diagram illustrating the method of the present invention applied to multiple channels;

5 is a block diagram of a personal computer on which the method of the present invention is implemented.

<Explanation of symbols for the main parts of the drawings>

10: memory 20: control part

30: decoder 40, 42: DAC

50,52: Speaker 60: Screen driver

70: display device 80: keypad

90: (external) interface

Hereinafter, a learning method using output channel selection of audio and caption data of the present invention will be described in detail with reference to the accompanying drawings.

The present invention implements a function of selectively turning on / off a song, lyrics or accompaniment of a speaker of a digital language learner or a singer in a karaoke device, thereby allowing a user to directly perform a role of a speaker of a school material or a singer of a karaoke. It is an effective way to learn a language and a song lyrics. In addition, in the present invention, the caption data synchronized with the audio data displayed on the screen can also be selectively turned on / off to enable more effective learning. The caption data may be one or a combination of text data, image data, and video data.

The method of the present invention can be carried out in a device having a reproduction function and a caption display function for simultaneously reproducing stereo or more channels conventionally used (hereinafter referred to as "reproducing device"). 1 and 2 show an example of a conventionally used playback apparatus, and show a stereo channel system and a multi-channel system, respectively. In practice, the stereo method uses only two channels in a multi-channel method. It is assumed that the audio reproducing apparatus is built in a conventional language learner or karaoke apparatus, and a screen display apparatus displaying caption data or character data is also built in.

First, the operating states of the stereo channel and multi-channel playback apparatus of FIGS. 1 and 2 will be briefly described, and the method of the present invention will be described with reference to this.

The configuration of the playback apparatus in which the method of the present invention is performed is briefly described as follows. The playback device includes a controller 10 having an external data storage memory 10, a (external) interface 90 for transmitting and receiving data with an external device, a user input keypad 80, and a program for driving the entire device ( 20), a decoder 30 for demodulating a digital audio signal, a DAC 40 for outputting through at least a stereo multi-channel speaker for converting a signal modulated by the decoder 30 into an analog signal, and a caption It can be seen that it includes a screen drive device 60 for driving the screen display device 70 for displaying data.

The memory 10 is a storage means for storing after receiving the digital audio file data from the outside. The stored audio file is reproduced in accordance with a control signal from the user. The storage of the audio file may be stored in advance in the initial sale state and manufactured, or may be transmitted and stored from an external device such as a computer through the external interface 90 after the manufacture of the playback device. The external interface 90 is described later. Caption data is also stored in the memory 10 and used to output caption data at the time of reproduction. The memory 10 may be configured using, for example, a nonvolatile memory such as a flash memory or an optical disk such as a DVD, and other types of storage means may be apparent. It is apparent that the memory 10 may be built in the reproducing apparatus or may be configured to be removable.

The keypad 80 is for inputting a command for playing an audio file. The keypad 80 includes a plurality of keys such as a recording key, a playback key, and a mode selection key, so that a user inputs a required command. The keypad 80 is provided with a play function key, a repeat play key, a function key for mode selection (normal output, left and right channel output) of the digital audio file. The control signal input from the user via the keypad 80 is input to the controller 20.

The control unit 20 is composed of a microcomputer, the program and data necessary for operating the playback and caption display function is embedded therein. In addition, the control unit 20 is connected to an interface 90 for connecting to an external device for transmitting a digital audio file from the outside. In addition, a program for outputting the caption data synchronized with the output of the audio signal through the screen display device 70 is embedded.

The interface 90 provides data through a printer port (parallel port), serial port of a computer, or a wired connection such as USB (Universal Serial Bus), Firewire (IEEE 1394), and a wireless connection method such as IrD (Infra Red) or bluetooth. It can be configured in various ways to transmit.

The control unit 20 is also connected to a decoder 30 for demodulating the digital audio signal. The decoder 30 demodulates and outputs an audio signal recorded and stored in multiple channels, and may be configured by using a chip capable of reproducing various multichannel digital audio signals such as, for example, AAC and AC-3.

Since the digital audio signal demodulated in the decoder 30 is a digital signal, it is output after being modulated into an analog audio signal in the DAC 40 again. The output signal is output through the speakers 50 and 52 assigned to each channel to exhibit a predetermined sound mixing effect.

Although only two speakers are shown in FIG. 1, it is obvious that this can be expanded or reduced depending on the number of channels allocated to the decoder 30. In FIG. 2, a plurality of speakers are connected by a multi-channel method. In addition, it is obvious that the method of the present invention can also be applied to the case of using a conventional headphone or earphone instead of using a speaker, which also belongs to the claims of the present invention.

Reference numeral 60 denotes a caption screen driving apparatus that operates according to a control signal of the controller 20, and 70 denotes a screen display apparatus that is operated by the screen driving apparatus to display caption data. The display device may be, for example, a display device such as an LCD or a CRT. When an audio signal is reproduced, the controller 20 outputs caption data synchronized with the audio signal through the screen display device 70. Therefore, the audio signal is output through the speaker and the caption data synchronized with the audio signal is output through the screen display device 70. The user can learn while watching and listening to the audio signal and the caption data.

The caption data is divided based on the size of the caption data to be displayed on the display device 70 at a time. Each block of caption data is synchronized with the audio signal in advance to the beginning of the caption data (character or image type) block. It has location information of corresponding audio signal.

The controller 20 outputs caption data to the screen display device 70 in synchronization with the audio signal based on the positional information. That is, the controller monitors the audio data information currently being reproduced, compares the position information value of the next caption data to be output, and outputs the caption data to the screen display device 70 at the instant of synchronization.

In the method of the present invention applied to the device having the above configuration, if the operation on signal for reproducing the audio signal is input from the keypad 80, the step of checking the operation mode at the time of playback currently set in the control unit 20 If the operation mode is normal, the control unit 20 controls the decoder 30 to output a preset audio signal for each channel (R, L), and if the operation mode is set to the right (R) channel, The control unit 20 controls the decoder 30 to reproduce and output the audio signal through the right channel, and when the operation mode is set to the left (L) channel, the control unit 20 controls the decoder 30 to the left. And reproducing and outputting an audio signal through a channel.

For convenience of use, as shown in FIG. 1, it is assumed that the digital audio file is a stereotype file recorded using two channels. However, it is clear that in the multi-channel recording method, a more detailed function selection mode can be set to control each recording channel. In stereo channels, only normal, left, and right channel playback are possible, and in multiple channels, the number of selectable channels increases.

The user selects one of the normal mode, the left channel output mode, and the right channel output mode by using a function key provided in the keypad 80. In the state in which the function mode is selected, the user selects the language learning data or the song of the karaoke and presses the play mode on the keypad 80, which is inputted to the controller 20. At the same time as the reproduction, the caption data is also displayed through the screen display device 70 in synchronization with the audio signal.

The control unit 20 first detects the setting state of the operation mode before operating in the regeneration mode. It is stored in the internal memory elements (RAM, ROM) of the control unit 20, and is called when needed. As a result of the reading of the operation mode, when it is determined that the operation mode is normal, the control unit 20 outputs a control signal to the decoder 30 so as to reproduce the corresponding audio file, and simultaneously outputs the left and right channel signals through the speakers 50 and 52. It works. Therefore, the left and right channel signals are simultaneously output from the speakers 50 and 52. At the same time, since the caption data synchronized with the audio signal is displayed through the screen display device 70, the user can learn by listening to the audio signal while viewing the caption data.

On the other hand, if the operation mode is found to be the left channel output mode or the right channel output mode, the control unit 20 outputs a control signal to the decoder 30 to reproduce only the channel signal. The decoder 30 demodulates and outputs only a channel signal set among the input signals, and the output digital audio signal is modulated into an analog signal in the DAC 40 and then only through a speaker 50 or 52 connected for output of the corresponding signal. Is output.

An example of such an output state is as follows.

In the case of the language learner, it is assumed that two speakers, A and B, store their conversations in separate channels (left and right channels). When the user memorizes the dialogue of the speaker A for language learning and talks to the speaker B, the user sets the operation mode to turn on the channel where the dialogue of the speaker B is stored and to turn off the channel on which the dialogue of the speaker A is recorded.

If the player is operated while the operation mode is set in this way, the channel to which the speaker A is output is always muted. The user can practice while watching the text or caption data memorizing the dialogue corresponding to the speaker A in the silent state. Since no caption data is specified, the caption data is output and displayed normally as before. However, it is obvious that caption data can also be selectively output.

The method of the present invention can also be configured to output the selected channel simultaneously to the set channel and the set channel. In other words, when only one channel signal is reproduced by channel selection, the channel for reproducing the remaining channel signal remains stopped and only one speaker is used. There is a sense of presence because the audio signal is output through only the speaker. However, in this case, the audio signal is input through one speaker or earphone, so long-term listening causes a loss of sound balance, which causes problems in learning.

Therefore, when one channel is set and all channel play modes are selected again, assuming that the selected channel is the right channel R, for example, when all channel play modes are selected, the control unit 20 controls the DAC 42. ), So that the right channel (R) signal is simultaneously output from the one speaker 50 and the two speakers 52. Therefore, when using speakers or headphones, it is possible to balance the sound to give hearing comfort. This method is shown in the flowchart of FIG. 3.

FIG. 4 illustrates a method of the present invention in the case of multi-channels, and extends a stereo system to determine whether to select each channel, and also includes a function of simultaneously playing a selected channel signal through all speakers. have.

As described above, after the user learns the dialogue of the speaker A, the user may learn by turning off the dialogue section of the speaker B and turning on the dialogue section of the speaker A in order to learn the dialogue of the speaker B again. At this time, caption data can also be selectively set.

Although the above description has been made using two channels, it is possible to efficiently use the language learning by learning the metabolism of a plurality of speakers A, B, C, D, ... using a plurality of channels.

Also, if the method is applied to karaoke, a singer's song and accompaniment are recorded on each channel using a two-channel recording method. In this case, the song and accompaniment are each mono. If you want to process the song and accompaniment in stereo, you can achieve this by using a recording / playback technique of at least four channels.

If you play two channels at the same time, the song and accompaniment of the singer can come out and you can easily sing and learn. Also, after acquiring a certain song, turn off and play the channel with the singer's song, and only the accompaniment plays. Therefore, while listening to this accompaniment, you can sing and sing like a singer. After learning the song perfectly, you can play all the channels and sing along with the feeling of singing like a singer. At this time, caption data can be selectively output and used to learn lyrics. In addition, by using a multi-channel playback method of two or more channels, chorus or duet songs other than a singer's song or accompaniment are recorded and selectively played.

The method of the present invention can be applied not only to the reproduction of the audio signal but also to the display of the caption data as described above. In other words, by selectively displaying the caption data in association with the audio signal, the difficulty (on / off depending on the degree of memorization) can be adjusted according to the learner's learning progress. When the learner memorizes the conversation, it is possible to finally turn off all caption data to stop displaying the characters, and display only the same sequence as the talkers A, B, etc., and allow the learner to memorize the conversation.

In the present invention also the learning device to have only such a function as follows; When the operation temperature signal for reproducing the audio signal is input from the keypad 80, the controller 20 checks the operation mode at the time of reproduction currently set, and if the operation mode is normal, the controller 20 controls the decoder 30. Outputs audio signals preset for each channel (R, L), and if the operation mode is set to the right (R) channel, the control unit 20 controls the decoder 30 to reproduce the audio signal to the right channel. If the output mode is set to the left (L) channel, the controller 20 controls the decoder 30 so that the user can select the audio signal to reproduce the audio signal to the left channel. Such dedicated devices may also be included in the scope of the present invention.

In the case of having such a structure, a screen display device is added to output not only the speaker for outputting the audio signal but also the caption data synchronized with the audio signal, thereby outputting not only the audio signal but also the caption data. Can be associated with the output of the audio signal.

Furthermore, it can be configured to turn on / off the caption data itself synchronized with the audio signal. In other words, the caption data can be selectively turned on or off according to the user's learning progress, difficulty, and personal preference. This can be configured by setting a function on a specific key of the keypad 80 in which the function key is installed. In other words, the caption data output can be selectively selected as with the output selection of the audio signal.

The present invention can be implemented not only in a language learner or karaoke apparatus having the above configuration, but also in a conventional personal computer. FIG. 5 is a diagram illustrating a schematic structure of a conventional personal computer, which may implement the role of the decoder 30 programmatically in CPU + MB as compared with FIGS. 1 and 2. In addition, the reproduction of the audio signal may be implemented through a sound card and a speaker, and the display device may be implemented using a graphic card and a monitor. In addition, the storage of digital files can be used as HDDs, CDs, etc., so they have equivalent features similar to language learning devices or karaoke devices. Accordingly, the method of the present invention can be easily implemented in a conventional personal computer. In addition, in the learning apparatus of the present invention, a CD or DVD is used as a storage medium in place of the storage / reading memory 10 shown in FIG. It is possible. At this time, since the CD or DVD is a simple storage medium, if a player capable of reading data from the storage medium is built in at the same time, the storage / reading function of the audio signal can be performed like the memory 10. In this way, the user can acquire new learning contents in accordance with the learning progress by exchanging a CD or DVD. Such a learning device has an advantage that it can be easily applied and implemented in a conventional CD player or DVD player. Since the configuration of a CD or DVD player is well known in the art, detailed description of the structure is omitted. The audio signal read out by the CD or DVD player is processed by the control unit 20.

As described above, the present invention improves the learning effect by repetition in the language learner by selectively outputting output data stored in stereo or multiple channels in a device having a digital file playing function such as a language learner or a karaoke device. To practice singing effectively.

Claims (14)

Demodulating the digital audio signal, the memory 10 for storing / reading the digital audio signal, the keypad 80 for the operation mode or the execution command or the character input, the controller 20 having a program for driving the entire apparatus, and the like. Decoder 30, a DAC 40 converts the demodulated signal from the decoder 30 to an analog signal and outputs through the speaker in two channels, and the operation state and caption under the control of the controller 20 In the learning method using a playback device including a screen drive device 60 for driving a screen display device 70 for displaying data, A first step of inspecting an operation mode at the time of reproduction currently set by the controller 20 when an operation on signal for reproducing an audio signal is input from the keypad 80; The controller 20 reads audio signals preset for each of the right and left channels R and L from the memory 10 for reproduction, and controls the decoder 30 when the operation mode is a normal channel output. A second step of outputting to play through each channel; A third step of outputting the audio signal set for the right channel by controlling the decoder 30 in the control unit 20 if the operation mode is set to the right channel output; and And a fourth step of outputting the audio signal set for the left channel by controlling the decoder 30 in the control unit 20 when the operation mode is set to the left channel output. Learning method using signal output channel selection. The method of claim 1, At the time of reproducing each selected channel output signal in the third and / or fourth steps, the selected channel output signal is simultaneously output through two channels (R, L) by simultaneously outputting the selected channel output through an unselected channel. Learning method using an audio signal output channel selection, characterized in that the output at the same time. The method according to claim 1 or 2, The caption data corresponding to the output of the audio signal is displayed through the screen display device 70 of the playback apparatus, and the output of the caption data is output in synchronization with the audio output of the selected channel output. Learning method using channel selection. The method of claim 3, And caption data displayed in synchronization with the audio signal output by the user selectively on / off according to learning progress, difficulty, and personal preference. The method of claim 1, The digital audio signal is transmitted from an external server and updated and stored in the memory 10, and wired and IrD (Infra-) such as a printer port (parallel port), serial port, USB (Universal Serial Bus), or Firewire (IEEE 1394), etc. Red Data) or a learning method using the audio signal output channel selection, characterized in that the transmission using a wireless connection interface 90 such as bluetooth. The method of claim 5, And a means for storing the digital audio signal is included in a reproducing apparatus and is a nonvolatile memory such as a flash memory or a storage means such as a CD or a DVD. Demodulating the digital audio signal, the memory 10 for storing / reading the digital audio signal, the keypad 80 for the operation mode or the execution command or the character input, the controller 20 having a program for driving the entire apparatus, and the like. Decoder 30, the DAC 40 converts the signal demodulated by the decoder 30 to an analog signal and outputs through three or more channels through a speaker, and the control by the control unit 20 In the learning method using the playback device comprising a screen drive device 60 for driving the screen display device 70 for displaying the state and caption data, A first step of checking, by the controller 20, an operation mode at the time of reproduction currently set, when an operation temperature signal for reproducing an audio signal from a user is input; The control unit 20 reads an audio signal preset for each channel for reproduction from the memory 10, and outputs to play through each channel by controlling the decoder 30 when the operation mode is a normal channel output. The second step, And a third step of outputting only the signal for the corresponding channel by controlling the decoder 30 in the control unit 20 when the operation mode is set to a channel output of a specific channel. Learning method using choice. The method of claim 7, wherein When reproducing each selected channel output signal in the third step, the selected channel output is simultaneously output through the unselected channel so that one or more selected channel output signals are simultaneously output through the remaining channels. Learning method using channel selection. The method of claim 8, The caption data corresponding to the output of the audio signal is displayed on the display screen of the playback device, and the output of the caption data is output in synchronization with the audio output of the selected channel output. Learning method. The method of claim 9, And caption data displayed in synchronization with the audio signal output by the user selectively on / off according to learning progress, difficulty, and personal preference. Demodulating the digital audio signal, the memory 10 for storing / reading the digital audio signal, the keypad 80 for the operation mode or the execution command or the character input, the controller 20 having a program for driving the entire apparatus, and the like. Decoder 30, a DAC 40 converts the signal modulated by the decoder 30 into an analog signal and outputs it through two speakers through a speaker, and the status display and caption under the control of the controller 20 In the playback apparatus comprising a screen drive device 60 for driving the screen display device 70 for displaying data, When the operation temperature signal for reproducing the audio signal is input from the keypad 80, the control unit 20 checks the operation mode at the time of reproduction currently set. If the operation mode is normal, the control unit 20 operates the decoder 30. Control to output a preset audio signal for each channel (R, L), and if the operation mode is set to the right (R) channel, the control unit 20 controls the decoder 30 to control the audio set for the right channel Reproducing and outputting a signal, and if the operation mode is set to the left (L) channel, the control unit 20 controls the decoder 30 to reproduce and output the audio signal set for the left channel. Learning device using output channel selection. The method of claim 11, The caption data corresponding to the output of the audio signal is displayed on the display screen of the learning apparatus, and the output of the caption data is output in synchronization with the audio output of the selected channel output. Learning device used. The method of claim 12, And caption data output in synchronization with the audio signal by the user selectively turning on / off according to learning progress, difficulty, and personal preference. The method of claim 11, The digital audio signal storage / reading memory 10 may be replaced by a CD or DVD storing a digital audio signal and a CD or DVD player that reads and outputs a digital audio signal stored in the CD or DVD. Learning device using audio signal output channel selection.