KR100548604B1 - Image display device having language learning function and learning method thereof - Google Patents

Abstract

The present invention sets the language learning condition desired by the user using only the received broadcast signal, thereby allowing the user to proceed with language learning more efficiently.

That is, by using audio signals and digital captions included in the received digital broadcasting signal, the user can listen to the desired number of times in the desired language through the audio signal, and use the digital caption to select the desired language. In addition to displaying the text, the user may input his / her voice through an external voice input medium and proceed to the next learning depending on whether the voice matches the voice included in the audio signal.

Therefore, the present invention has the advantage that it can be used without additional language materials because it can proceed to learn and listen to foreign languages using multi-language support and voice recognition techniques of digital broadcasting, and the user directly inputs his or her own voice. According to the results of the analysis, the learning of speaking can be performed, and in addition to improving the listening ability, there is an effect of improving the speaking ability at the same time.

Language Learning / Video Display

Description

Display device having language study function and method for studying of the same}

1 is a block diagram illustrating an image display apparatus having a language learning function according to the related art.

2 is a block diagram illustrating an image display device having a language learning function according to the present invention.

3 is a flowchart illustrating a learning method of an image display device having a language learning function according to the present invention.

4 is a diagram illustrating a setting menu of a video display device having a language learning function and a screen according to the present invention;

Explanation of symbols for main parts of the drawings

20: TP decoder 30: memory

40: Video Decoder 50: Caption Engine

60: audio decoder 70: video signal processing unit

80: video display device 90: speaker

100: control unit 110: voice input unit

110a: Microphone 110b: A / D Converter

120: voice discrimination unit

The present invention relates to an image display device, and more particularly, to an image display device having a language learning function and a learning method thereof, which enable language learning to be performed under a learning condition desired by a user without a separate playback medium using a received broadcast signal. will be.

In general, the video display device is TV, and the general TV is widely used in almost all homes now, and mainly aims to broadcast various programs such as life information, entertainment, news, sports, and so on, from infants to the elderly, students, office workers, housewives. You can watch regardless of age or class.

In addition, as the most popular multimedia medium among the rapidly developing multimedia devices, the effect of concentrating all members watching TV on one medium is excellent.

Therefore, the user's desire for TV is also increasing in line with the modernization of multimedia, so that multi-functional TVs with various additional functions in addition to basic TV viewing, for example, TVs with built-in learning functions, are being developed. The possibilities are endless.

In addition, in recent years, TV technology has been developed, and thus, a method of transmitting broadcast signals has been developed, and accordingly, interest in digital TV using a digital transmission method has increased.

 Such digital TVs can be used to learn foreign languages using digital broadcasting without the need for a separate language textbook. As digital broadcasting can transmit multiple broadcasts through one physical channel, one physical ( Each virtual channel in a physical channel may have one video stream and multiple audio streams, and a caption function may also support multiple languages.

Here, the caption function is a function of displaying a composite video blanking signal (CVBS), that is, a composite video signal including a series of additional information or text information synchronized with voice for the hearing impaired, through a series of signal processing.

Hereinafter, an image display apparatus having a language learning function according to the related art will be described with reference to the accompanying drawings.

1 is a block diagram illustrating an image display apparatus having a language learning function according to the related art.

As shown in FIG. 1, an image display device having a language learning function according to the related art is inputted according to a control unit 10 for outputting a control signal according to a user's request command and a control signal of the control unit 10. The TP decoder 20 receives the transport packet stream form of the video signal into video, caption, and audio streams, and stores the video, caption, and audio separated from the TP decoder 20, and the controller 10 Memory 30 for retransmitting to the TP decoder 20, a video decoder 40 for receiving and decoding the video PES separated from the TP decoder 20, and the TP decoder 20 A caption engine 50 for receiving the caption data separated by the input signal) and converting the caption data into a letter shape, an audio decoder 60 for receiving and decoding the audio PES separated by the TP decoder 20, and the video decoder 40. And cap An image signal processor 70 for receiving an image signal and a caption output from the engine 50 and processing the same as a displayable signal, and an image display device 80 for displaying the image signal processed by the image signal processor 70. And a left and right speaker 90 for outputting an audio signal decoded by the audio decoder 60.

Referring to the operation of the image display device having a language learning function according to the prior art configured as described above are as follows.

When a user inputs a command through a user interface (not shown), the controller 10 detects this and outputs a corresponding control signal. That is, the user may store the desired image and sound in the memory 30, or may output the image and sound stored in the memory 30 and use it as a function of language learning.

Accordingly, the controller 10 receives the video and audio stored in the memory 30 and divides the video and audio into the video and audio through the TP decoder 20, and the separated video packetized elementary stream (PES) is the video decoder. 40 is decoded into a video signal, the separated caption data is input to the caption engine 50 to set the language, font, size, color, etc. to be used for caption display, and the separated audio PES is The audio signal is input to the audio decoder 60 and converted into a voice signal output through the left and right speakers 90.

The converted video signal and caption data are input to the video signal processor 70 and converted into a video signal displayable on the video display device 80.

In the image display device which performs the above operation, when the user selects the language learning function, the image, the caption, and the sound stored in the memory 30 are processed and output on the image display device 80. The language learning is performed by referring to the caption and the voice corresponding to the image displayed on the image display device 80.

However, the image display device having a language learning function according to the related art has a problem of not being able to improve speaking ability in learning a language because the learning is mainly made by unilaterally outputting images, captions, and voices.

SUMMARY OF THE INVENTION The present invention has been made to solve such a problem, and an object thereof is to enable a viewer to directly compare a user's voice with a native language while listening to a foreign language using an audio signal of a digital broadcast and viewing the original text using a digital caption.
In addition, the purpose of the viewer to improve the listening ability and speaking ability in the language learning at the same time.

In order to achieve the above object, an image display device having a language learning function according to the present invention includes a TP decoder which receives an input transport stream and separates the video, caption, and audio, and the video packet separated from the TP decoder. A video decoder that receives the input and decodes the video signal, a caption engine that receives the caption data separated by the TP decoder and sets the caption data according to a display condition, and an audio decoder that receives the audio packet separated by the TP decoder and decodes the audio signal. In the image display device including a key input unit for setting the language, language learning conditions desired by the user, a voice input unit for receiving the user's voice, the audio signal input through the voice input unit and output from the audio decoder Voice board to judge whether or not the same voice signal is input simultaneously Selectively control the video, audio and caption output through the video, audio decoder and caption engine according to the language learning setting conditions selected by the user through the key input unit, and listen learning and It is characterized by including a control unit for outputting a control signal for learning progress, such as repetitive learning or the next sentence movement according to the speech learning.

Preferably, the voice input unit comprises a microphone for directly receiving and amplifying and outputting a voice, and an A / D converter for converting a voice signal input through the microphone into a digital voice signal and inputting the voice signal to the voice discriminator. There is this.

More preferably, the voice discriminating unit converts the audio signal output from the audio decoder and the voice signal input through the voice input unit into a frequency domain, and compares each frequency coefficient to determine whether the audio signal is matched.

In the method of learning an image display device having a language learning function according to the present invention for achieving the above object, in a video display device having a video / audio decoder, a caption engine, a voice input unit and a voice discriminating unit, a user may select a language learning menu. And determining whether to output subtitles generated by the caption engine simultaneously with the video and audio signals decoded by the video / audio decoder according to whether or not the subtitle display is set in the set language learning menu. There is a characteristic comprising the step of proceeding, and the step of proceeding to learn speaking when the listening learning is completed.

Preferably, the setting of the language learning menu is characterized by setting a language to be output in the listening learning and speaking learning, the subtitle language, whether to display the caption, and the number of output repetitions.

More preferably, the listening learning may include outputting a video and audio as many times as the caption display if the user has set the caption display, and presetting only the video and audio if the user has not set the caption display. It is a step of outputting the number of times.

More preferably, the step of learning to speak comprises: performing a diary for a preset number of times through the voice input unit when the listening learning is completed; and if the reading is not completed for the preset number of times through the voice input unit. Determining whether or not the input voice matches audio data output through the audio decoder, and completes a diary for the preset number of times or outputs the voice input through the voice input unit and the audio decoder. If the audio data is matched, it moves to the next sentence listening learning step.

Hereinafter, an image display device having a language learning function and a learning method thereof according to the present invention will be described in detail with reference to the accompanying drawings.

2 is a block diagram showing an image display apparatus having a language learning function according to the present invention, FIG. 3 is a flow chart showing a learning method of an image display apparatus having a language learning function according to the present invention, and FIG. 2 is a diagram illustrating a screen and a learning screen according to a learning menu setting of an image display device having a language learning function according to the present invention.

As shown in FIG. 2, an image display device having a language learning function according to the present invention receives an input transport packet stream (TP stream) and separates the video PES, caption data, and audio PES, respectively. A TP decoder 20, a memory 30 for storing video, captions and audio signals input through the TP decoder 20, and a video PES separated from the TP decoder 20 are received as video signals. A video decoder 40 for decoding, a caption engine 50 for setting a language, font, size and color to be used for caption display by receiving caption data separated by the TP decoder 20, and the TP decoder. An audio decoder 60 for receiving the audio PES separated in 20 and decoding the audio signal, and an image signal and caption data output from the video decoder 40 and the caption engine 50 are received. An image signal processor 70 for signal processing into a signal displayable on a screen, an image display device 80 for displaying an image and a caption processed by the image signal processor 70, and the audio decoder 60 A speaker 90 for outputting a decoded audio signal, a voice input unit 110 for receiving a user's voice, an audio signal output through the audio decoder 60, and an output through the voice input unit 110. The voice discriminating unit 120 outputs the control unit 100 to determine whether the voice data match with the voice data, and controls the user to proceed with the corresponding listening and speaking learning according to the language learning menu setting. A control unit 100 for outputting a control signal for learning progress such as repetitive learning or moving to the next sentence according to the listening learning and speaking learning according to the determination result of 120). It consists

The voice input unit 110 includes a microphone 110a for directly receiving a user's voice, an A / D converter 110b for converting a voice signal input through the microphone 110a into a digital signal, and the audio decoder. And a voice discriminating unit 120 that determines whether or not the audio signal outputted through 60 matches the audio signal inputted through the A / D converter 110b.

Referring to the operation of the image display device having a language learning function according to the present invention configured as described above are as follows.

First, an image display device having a language learning function according to the present invention is a device for receiving and displaying a digital broadcast signal, and implementing a language learning function using a multi-language service and digital caption which are advantages of digital broadcasting. Appliance.

The video, audio, and various data of the digital broadcast are transmitted in the form of a digital signal, and the digital signal of the digital broadcast is called a transport stream. The TS consists of a 188 byte packet. One packet is called a TP (Transport Packet). In addition, the TP is composed of a video packetized elementary stream (PES), an audio PES, and caption data.

The TP decoder 20 separates the TP into video, audio, and caption data, respectively, and is input to the video decoder 40, the caption engine 50, and the audio decoder 60, respectively, to the video signal, the caption, and the audio signal. Decoded and output.

If a video, caption, and audio signal desired by the user exists in the video, caption, and audio signal input through the TP decoder 20, the memory 30 stores the video, caption, and audio signal in the memory 30.

In this signal, the video signal and caption data are input to the video signal processing unit 70, processed and output as a displayable signal on the video display device 80, and decoded by the audio decoder 60. Is output through the speaker 90.

In addition, the user can always set the language learning environment desired for the language learning. That is, as shown in FIG. 4, the audio language, the subtitle language (caption), the caption display, and the number of repetitions may be arbitrarily set according to the listening learning and the speaking learning.

Therefore, when the user selects a language learning command, the controller 100 receives the input, outputs the corresponding video and audio pre-stored in the memory 30, and selectively outputs the caption.

That is, when the user selects the caption menu, the caption data separated by the TP demux 20 is input to the caption engine 50, and the language, font, size, The output is converted according to the color.

The video signal processing unit 70 converts the video signal output from the video decoder 40 to a format supported by the video display device 80 and at the same time matches the caption set by the caption engine 50. The video signal output from the video decoder 40 and the caption data output from the caption engine 50 are mixed.

In addition, when the user selects a language learning command, the listening learning is performed while listening to the caption displayed on the image display device 80 and the audio signal output through the speaker 90 according to the subtitle display, audio language, etc. selected by the user. can do.

In performing the listening learning, the caption may be repeatedly displayed through the image display device 80 as many times as the user sets, and repeatedly output through the speaker 90 as many times as the user sets.

In this way, when the listening learning is finished as much as the user wants, the next section proceeds to speaking learning. That is, while the user views the caption output through the video display device 80, the user may pronounce the same through the microphone 110a at the same speed as that of the native speaker output through the speaker 90. Can be.

Then, the voice input through the microphone 110a is converted into a digital voice signal through the A / D converter 110b, and the voice discriminator 120 is output through the audio decoder 60. It is determined whether the voice of the user and the voice of the user input through the A / D converter 110b are the same.

In addition, the determination result of the voice determination unit 120 is input to the control unit 100 to determine whether to continue speaking learning or to proceed to the next sentence.

The learning method of the image display device having the language learning function according to the present invention configured as described above will be described in more detail with reference to FIG. 3.

In the method of learning an image display device having a language learning function, referring to FIG. 3, first, it is determined whether a user selects a language learning menu (S11).

Subsequently, the determination result (S11), if the language learning menu is selected, it is determined whether the caption display is set (S12).

As a result of the determination (S12), if the user has set the caption display, and outputs the video and audio a predetermined number of times with the caption display (S13).

If listening is performed a predetermined number of times, the process moves to the speaking step. If listening is not performed for the preset number of times, the process returns to the step S13 (S14 to S15).

Subsequently, when the user moves to the speaking step, the user reads a predetermined number of times through the microphone (S16).

When the reading is completed a predetermined number of times, the reading proceeds to the listening learning step of the next sentence (S17 to S18).

On the other hand, if the reading has not been performed a predetermined number of times, it is determined whether or not the user matches voice and audio data input directly through the microphone, and if it matches, the process enters the step S18. To enter (S19).

In addition, if the user does not set the caption display, the determination result (S12) outputs only the video and audio a predetermined number of times (S20).

When the listening is completed for the preset number of times, the process enters the speaking step S15. If the listening is not completed for the preset number of times, the listening learning is continuously performed.

In addition, if the user does not select the language learning menu, the determination result (S11) displays the input image. If the user does not command the power-off, the process returns to step S11 and repeats all the above steps (S22 to S23). .

As described above, the learning method of the image display apparatus having the language learning function according to the present invention proceeds in the order of listening learning and speaking learning. First, in the case of listening learning, if the caption display is set, the caption is displayed in the set caption language. And outputs video and audio. If subtitle display is not set, only video and audio are displayed without subtitle display.

Then, the user listens to the preset number of repetitions and proceeds to the speech learning step. In the speech learning step, a user first reads a caption text through a predetermined number of times through the microphone 110a while displaying a caption and displaying an image.

That is, the user continuously reads a predetermined number of repetitions and continuously checks whether the voice is the same as that of the native speaker output through the audio decoder 60 to determine whether to move to the next sentence learning step.

Accordingly, an image display device having a language learning function according to the present invention may allow a viewer to listen to a plurality of languages while viewing the same image, and to allow subtitles to be viewed in different languages, such as a digital TV.

 As described above, an image display device having a language learning function and a learning method thereof according to the present invention have the following effects.

First, it is possible to use a multi-language support and speech recognition technique of digital broadcasting to listen and speak a foreign language, so there is an advantage that it can be used without additional language materials.

Second, in the existing listening learning, the user can input the voice through the microphone directly and proceed with the speaking learning according to whether the original pronunciation, there is an advantage to improve the speaking ability in addition to the listening ability. .

Third, because the user can proceed to the listening and speaking learning at the same time through the image display device that was used in the usual, two effects can be obtained with one product.

Claims (7)

A TP decoder that receives an input transport stream and separates the video, caption, and audio into a video, a video decoder that receives a video packet separated from the TP decoder, and decodes the video packet into a video signal; and caption data separated from the TP decoder. In a video display device having a caption engine that receives the input and set according to the display conditions, and an audio decoder that receives the audio packet separated from the TP decoder and decodes it into a voice signal, A key input unit for setting a language and language learning condition desired by a user; A voice input unit for receiving a voice of a user; A voice discriminating unit configured to simultaneously receive and match a voice signal input through the voice input unit and a voice signal output from the audio decoder; And, The video, audio, and caption output are selectively controlled through the video, audio decoder, and caption engine according to the language learning setting condition selected by the user through the key input unit, and the listening and speaking learning is performed according to the determination result of the voice discriminator. And a control unit for outputting a control signal for learning progress such as repetitive learning or next sentence movement. The method of claim 1, The voice input unit A microphone for directly receiving and amplifying and outputting voice, And an A / D converter for converting the voice signal input through the microphone into a digital voice signal and inputting the voice signal to the voice discriminator. The method of claim 1, The voice discriminating unit converts an audio signal output from the audio decoder and an audio signal input through the voice input unit into a frequency domain, and compares each frequency coefficient to determine a match. Display device. In the language learning method of a video display device having a video / audio decoder, a caption engine, a voice input unit and a voice discrimination unit, Setting a language learning menu by a user; Determining whether to output subtitles generated through the caption engine simultaneously with the video and audio signals decoded by the video / audio decoder according to whether or not the subtitle display is set in the set language learning menu and performing a listening learning; And, The language learning method of the image display device comprising the step of proceeding the speech learning when the listening learning is completed. The method of claim 4, wherein Setting the language learning menu is The language learning method of the image display device having a language learning function, characterized in that the step of setting the language to be output in the listening learning and speech learning, subtitle language, whether subtitle display and output repetition frequency. The method of claim 4, wherein The listening learning step is Outputting the video and audio a predetermined number of times together with the caption display if the user has set the caption display; If the user does not set the caption display, the step of outputting only the image and the voice only a predetermined number of times, the language learning method of a video display device having a language learning function, characterized in that the step. The method of claim 4, wherein The step of learning to speak Performing a diary for a preset number of times through the voice input unit when the listening learning is completed; Determining whether the voice inputted through the voice input unit and the audio data outputted through the audio decoder match if the reading is not completed the predetermined number of times; Completion of the diary by the predetermined number of times, or if the audio input through the audio input unit and the audio data output through the audio decoder is the language learning function comprising the step of moving to the next sentence listening learning step Learning method of an image display device having a.

Images