WO2015090182A1

WO2015090182A1 - Multi-information synchronization code learning device and method

Info

Publication number: WO2015090182A1
Application number: PCT/CN2014/093937
Authority: WO
Inventors: 王佑夫; 杨海; 张灼坤
Original assignee: 深圳环球维尔安科技有限公司
Priority date: 2013-12-17
Filing date: 2014-12-16
Publication date: 2015-06-25
Also published as: CN103680231A; CN103680231B

Abstract

A multi-information synchronization code learning device, comprising: an audio input unit (2) which is used for inputting two segments of corresponding voice signals; an audio processing unit (11) which is used for conducting alignment arrangement processing on midpoints of two ends of each of two voice segments and recording the two segments of voice signals into a left-channel voice and a right-channel voice respectively; and an audio output unit (3) which comprises a left-channel earphone and a right-channel earphone for respectively receiving the left-channel voice and the right-channel voice, and conducting synchronous output on the left-channel earphone and the right-channel earphone. The present invention uses two ears of a user as two relatively independent systems to simultaneously receive two groups of voice data needing to be correspondingly learnt, and forms a common code in the brain memory of the user; and when corresponding signals enter the brain again, the signals can be directly recognized as information which has been recognized already without experiencing a translation process between Chinese and English or an association process of a thing which has been recognized, so that a learning process is completed, thereby greatly improving our learning and memory effect of much knowledge undoubtedly. Also disclosed is a multi-information synchronization code learning method.

Description

Multi-information synchronous coding learning device and method

[Technical Field]

The present invention relates to the field of language learning methods, and in particular, to a multi-information synchronous coding learning apparatus and method.

【Background technique】

As a doctor, in the study of the principle of binocular imaging, the inventor noticed that the image signals received by the left and right eyeballs of the human body are different, but through the retina, optic nerve, and optic chiasm, the external image visual information is passed through the visual cells, bipolar cells, and horizontal cells. And ganglion cells, and the optic nerve is transmitted to the lateral geniculate body in a "serial" information pattern for decoding into a "lattice" form and then transmitted by visual radiation to different functional areas of the primary visual cortex, and finally to the corresponding division of labor in the advanced area. Regional delivery, integrated in different cortical areas to produce a complete understanding of visual information. Therefore, the image we feel and store in the brain is an integrated image of the image information formed by the bilateral eyeballs. The visual field, the stereoscopic effect of the object, and the distance judgment are all more complete than the single-eye image. By the same principle, the acoustic information receiving and processing modes of the bilateral ears of the human body are the same as the receiving and processing modes of the visual image information. The process heard by the human ear can be simply seen by the vibration of the machine, causing the opening of the channel of the ear canal, and the integration of the vibration into an electrical signal through the auditory center ultimately allows us to hum, bird, or Hear in the form of human language.

At present, although there is a mode of applying video plus audio to enhance the learning method of foreign languages, it is not possible to have both a native language plus a foreign language or a mode in which two foreign languages and video images are input together. Studies have shown that the human brain's understanding and memory of things is based on the sensory organ's formation of information on the shape, sound, and touch of external things, and the information is stored in the corresponding parts of the brain to complete the memory. When the information generated by the new stimulus is the same as the memory information in the brain, the stimulus forms a reverberant reflection, suggesting that this is something that we already know. In the process of growth and learning, human beings continue to expand and deepen their understanding of surrounding things and knowledge.

[Summary of the Invention]

The object of the present invention is to overcome the deficiencies in the prior art and to provide a multi-information synchronous coding learning device and method for improving learning and memory effects.

The object of the invention is achieved in this way:

Providing a multi-information synchronous coding learning device, comprising a central processing unit, an audio input unit, an audio output unit, a storage unit and a control panel;

The audio input unit is configured to input two corresponding speech signals of a source language and a target language;

The central processing unit includes an audio processing unit, and the audio processing unit is configured to perform alignment processing on the midpoints of the two segments of the voice segment, and record the voice signal of the source language (or the target language) to form a left channel voice. Recording the voice signal of the target language (or source language) to form a right channel voice, and the processed two segments of the voice signal are transmitted to the storage unit;

The audio output unit includes left and right channel headphones, the left channel headphones receive left channel speech through the left channel, the right channel headphones receive right channel speech through the right channel, and the left and right channel headphones are synchronized for output. of;

The operation panel is composed of an operation keyboard and/or an operation touch screen, and is connected to the central processor for controlling input and output of a source language and a target language.

The device further includes a video and picture input unit and a display unit, wherein the video and picture input unit and the display unit are connected to the central processor for inputting and displaying pictures, videos, and videos corresponding to the voice signal. subtitle.

The device further includes a text input device, and the text input device is connected to the central processor for inputting text data;

The central processing unit further includes a text processing unit, the text processing unit is connected to the storage unit, and compares the text data by using left and right channel voices (corresponding source language and target language) stored in the storage unit. And comparing the two corresponding left and right channel voices (corresponding source language and target language) to the audio output unit for output.

In the above device, the text input device includes a letter button, a touch screen tablet, and a scanner.

The above device further includes a voice input device, wherein the voice input device is a microphone, and is connected to the central processor for inputting a voice signal in real time;

The central processing unit further includes a voice processing unit, the voice processing unit is connected to the storage unit, and uses the left and right channel voices (corresponding source language and target language) stored in the storage unit to record the voice recorded in real time. The signals are compared, and the corresponding two corresponding left and right channel voices (corresponding source language and target language) are sent to the audio output unit for output.

In the above device, the audio output unit further includes a target language playing horn for separately performing sound amplification playing on the target language in the two pieces of left and right channel voices obtained by the comparison; the input and output modes include wired And wireless transmission.

The learning device of the present invention can be applied to mobile phones and various playback and display devices to have learning, translation and conversation functions.

A multi-information synchronous coding learning method is also provided, which includes the following steps

S1, the voice signal of the source language and the voice signal of the target language corresponding thereto are segmented and input through the audio input unit, and the segmented source language voice signal and the voice signal of the target language are input one by one;

S2. The audio processing unit respectively processes the two-segment-corresponding speech signals, so that the midpoints of the two-to-one-corresponding speech signals are aligned and recorded, and one of the speech signals is recorded to form a left-channel speech, and another A voice signal is recorded to form a right channel voice, and the processed two corresponding voice signals are stored in the storage unit;

S3, then the audio output unit extracts the voice signal in the storage unit, so that the left channel voice is input to the left channel earphone through the left channel, the right channel voice is input to the right channel earphone through the right channel, and finally the left and right channel earphones Synchronous output.

S4. Synchronize the subtitles, videos, and pictures corresponding to the source language through the display unit and the audio output unit.

Further, the steps S2 and S3 further include steps

S201, collecting text data or instant voice signal through a text input device or a voice input device, The word processing unit or the voice processing unit compares the text data or the instant voice signal by using left and right channel voices (corresponding source language and target language) stored in the storage unit, and compares the two corresponding segments. The channel voice (the corresponding source language and target language) is sent to the audio output unit for output.

Further, the target language is a translation, interpretation or description of the source language.

Compared with the prior art, the beneficial effects of the present invention are: simultaneously receiving two sets of voice data corresponding to learning by two ears of the user as two relatively independent systems, and integrating a different cortical area of the brain to form a common information. (For example, the Chinese "Good Morning" and the English "good morning" code are stored in the brain to form a common code in the user's brain memory. When the Chinese or English "Good Morning" enters the human ear again. And when it reaches the corresponding area of the cerebral cortex, it can be directly recognized by the brain as the already known information without going through a process of translation between Chinese and English or a process of recognizing things, thus completing the learning process. Undoubtedly greatly improved our learning and memory effects for a lot of knowledge; in addition, the corresponding pictures, videos and subtitles were added to form a multi-dimensional learning code to complete the learning process, further improving the learning and memory effects; Text input device and voice input device for inputting text data and instant input voice Number, and the data in the storage unit contrast, comparison of the two groups to obtain the corresponding speech signal broadcast simultaneously, and thus play a translator, the phone will effect.

[Description of the Drawings]

Figure 1 is a schematic view of the structure of the present invention;

Figure 2 is a schematic view 2 of the structure of the present invention;

3 is a schematic diagram of a process of arranging the midpoints of the source language and the target language according to the present invention;

Figure 4 is a flow chart of the playback of the present invention.

【detailed description】

The present invention is further described below in conjunction with the accompanying drawings and specific embodiments.

As shown in FIG. 1, a multi-information synchronous coding learning apparatus of the present invention comprises a central processing unit 1, an audio input unit 2, an audio output unit 3, a storage unit 4, and a control panel 9.

The audio input unit 2 includes a source language input unit 21 and a target language input unit 22 for inputting two corresponding speech signals of a source language and a target language; wherein one segment of the speech signal is the source language and the other segment corresponds to a speech signal target language, the target language is a translation, interpretation or description of the source language, and the speech signals of the source language and the target language may be a native language and a first foreign language, a first foreign language and a second foreign language, a telegram and a translation, and a digital Name (such as a person, an organization and phone number, password number and corresponding language), calculations and results (such as the square of 2 and result 4), etc., when applied in the field of dance, gymnastics, diving, etc., can also The voice signal of the source language is music, and the voice signal of the target language is required for action.

The central processing unit 1 includes an audio processing unit 11, as shown in FIG. 3, the audio processing unit 11 is configured to perform alignment processing on the midpoints of the two segments of the speech segment, and to source the language (or target language). The voice signal is recorded to form a left channel voice, the voice signal of the target language (or source language) is recorded to form a right channel voice, and the processed two voice signals are transmitted to the storage unit 4 for storage.

The audio output unit 3 includes left and

right channel headphones

31, 32, and the left channel earphone 31 receives left channel speech through a left channel for playing a voice signal of a source language (or a target language); The channel earphone 32 receives the right channel voice through the right channel for playing the voice signal of the target language (or source language), and the left and right channel headphones are synchronized for output.

The operation panel 9 is composed of an operation keyboard 91 and/or an operation touch screen 92, and is connected to the central processing unit for controlling input and output of a source language and a target language, and various input and output to the following. The device performs control operations; the modes of input and output include wired and wireless transmission.

For specific use, for example, a Chinese speech signal and a translated English speech signal are input through the audio input unit 2, and then the audio processing unit 11 performs alignment of the midpoints of the two Chinese and English speech signals. Processing, and recording the Chinese voice signal into left channel voice, the English voice signal is recorded into the right channel voice, and finally the Chinese voice signal is synchronously played through the right channel earphone through the left channel earphone and the English voice signal. Go out, pass Chinese and English respectively The user's left and right ears receive.

The above learning device uses two ears of the user as two relatively independent systems to simultaneously receive two sets of voice data that need to be learned correspondingly, and integrates different cortical areas of the brain to form a common information (such as Chinese "Good Morning" and The English "good morning" code is stored in the brain to form a common code in the user's brain memory. When the Chinese or English "Good Morning" enters the human ear again and reaches the corresponding area of the cerebral cortex. Immediately, the brain can directly recognize the information that has already been recognized without experiencing a process of translation between Chinese and English or a process of association with known things, thus completing the learning process, which undoubtedly greatly enhances our knowledge. Learning and memory effects.

The learning device of the present invention further includes a video and picture input unit 5 and a display unit 6, and the video and picture input unit 5 and the display unit 6 are connected to the central processing unit 1 for inputting and displaying the voice signal. Corresponding pictures, videos and subtitles; as shown in Fig. 4, on the basis of the relatively independent learning system formed by the two ears, the corresponding pictures, videos and subtitles are added to form a multi-dimensional learning code, thereby completing the learning process. Further improve the effect of learning and memory.

Further, as shown in FIG. 2, the present invention further includes a text input device 7 such as a letter button, a touch screen tablet, and a scanner, and a voice input device 8 such as a microphone, and the text input device 7 and the voice input device 8 and the center. The processor 1 is connected for inputting text data and instantaneously inputting a voice signal; the central processing unit 1 further includes a text processing unit 12 and a voice processing unit 13, the text processing unit 12 and the voice processing unit 13 and the storage unit 4 connection, using the left and right channel voice stored in the storage unit 4 (for the corresponding source language and target language, including Chinese and foreign language translation data) to compare the text data and the instant input voice signal, and compare the obtained Two corresponding speech signals (two corresponding speech signals corresponding to the source language and the target language, such as Chinese and foreign languages) are sent to the audio output unit 3 for synchronous playback, and the user's ears respectively receive synchronous translation. Information, you can understand the meaning of the language spoken by the other party, play a role in translation; when the user talks or uses the handwritten mode, through The text input device or the voice input device inputs the text data or instantly inputs the voice signal (source language), and compares the text data or the instant recorded voice signal (source language) with the data in the storage unit, and obtains two corresponding correspondences. The source language and the speech signal of the target language are synchronized The earphone is played, and the target language is broadcasted by the target language playing speaker 33, thereby functioning as a translator and a conversation machine.

The invention also provides a multi-information synchronous coding learning method, which comprises the following steps

S1, the voice signal of the source language and the voice signal of the target language corresponding thereto are segmented and input through the audio input unit, and the segmented source language voice signal and the voice signal of the target language are input one by one; The target language is the translation, interpretation or description of the source language. The source language and its corresponding target language can be the native language and the first foreign language, the first foreign language and the second foreign language, the telegram and the translation, the number and the name (such as someone, somebody). The organization and telephone number, the password number and the corresponding language) operations and results (such as the square of 2 and the result 4), etc., when applied in the field of dance, gymnastics, diving, etc., the source language can be the music in the project The target language is the requirements of the action essentials, which enables the learners to meet the standard requirements faster.

S2: The audio processing unit 11 respectively processes the two-segment-one corresponding speech signals, so that the midpoints of the two-segment-corresponding speech signals are arranged and recorded, as shown in FIG. 3, and one of the speech signals is recorded. The left channel voice is recorded, and another segment of the voice signal is recorded to form a right channel voice, and the processed two corresponding segments of the voice signal are stored in the storage unit 4.

S3, then the audio output unit 3 extracts the voice signal in the storage unit, so that the left channel voice is input to the left channel earphone 31 through the left channel, and the right channel voice is input to the right channel earphone 32 through the right channel, and finally left The channel headphones 31 and the right channel headphones 32 perform synchronous output.

S4. Synchronize the subtitles, videos, and pictures corresponding to the source language through the audio signals of the display unit and the audio output unit.

Further, when the method is applied to the synchronous translation and the conversation machine, the steps S2 and S3 further include a step S201, collecting text data or an instant voice signal through a text input device or a voice input device, and the word processing unit or the voice. The processing unit compares the text data or the instant voice signal by using the left and right channel voices stored in the storage unit (including the corresponding source language and the target language, including Chinese and foreign language translation data), and compares the two segments. Corresponding language signals (such as two speech signals corresponding to Chinese and foreign languages) are sent to the audio output unit for synchronous playback, and the user's ears are respectively After receiving the Chinese information in English and synchronous translation, you can understand the meaning of the language spoken by the other party and play the role of translation. When the user talks or uses the handwritten mode, input text data through the text input device or voice input device. Or immediately input the voice signal (source language), and compare the text data or the instant recorded voice signal (source language) with the data in the storage unit, and obtain two sets of corresponding source language and target language voice signals for synchronization. The earphone is played, and the target language is broadcasted by the target language playing speaker 33, thereby functioning as a translator and a conversation machine.

The above embodiments may be modified and modified as appropriate by those skilled in the art in light of the above disclosure. Therefore, the invention is not limited to the specific embodiments disclosed and described herein, and the modifications and variations of the invention are intended to fall within the scope of the appended claims. In addition, although specific terms are used in the specification, these terms are merely for convenience of description and do not limit the invention.

Claims

A multi-information synchronous coding learning device, comprising: a central processing unit, an audio input unit, an audio output unit, a storage unit and a control panel;

The audio input unit is configured to input two corresponding speech signals of a source language and a target language;

The central processing unit includes an audio processing unit, and the audio processing unit is configured to perform alignment processing on the midpoints of the two segments of the voice segment, and record the voice signal of the source language (or the target language) to form a left channel voice. Recording the voice signal of the target language (or source language) to form a right channel voice, and the processed two segments of the voice signal are transmitted to the storage unit;

The audio output unit includes left and right channel headphones, the left channel headphones receive left channel speech through the left channel, the right channel headphones receive right channel speech through the right channel, and the left and right channel headphones are synchronized for output. of;

The control panel is composed of an operation keyboard and/or an operation touch screen, and is connected to the central processor for controlling input and output of a source language and a target language.
The multi-information synchronous coding learning device according to claim 1, further comprising a video and picture input unit and a display unit, wherein the video and picture input unit and the display unit are connected to the central processor for input. And displaying pictures, videos, and subtitles corresponding to the voice signal.
The multi-information synchronous coding learning device according to claim 1 or 2, further comprising: a text input device, wherein the text input device is connected to the central processor for inputting text data;

The central processing unit further includes a text processing unit, the text processing unit is connected to the storage unit, and compares the text data by using left and right channel voices (corresponding source language and target language) stored in the storage unit. And comparing the two corresponding left and right channel voices (corresponding source language and target language) to the audio output unit for output.
The multi-information synchronous coding learning apparatus according to claim 3, wherein said text input device comprises a letter button, a touch screen tablet, and a scanner.
The multi-information synchronous coding learning device according to claim 1 or 2, further comprising a voice input device, wherein the voice input device is a microphone, and is connected to the central processor for inputting a voice signal in real time;

The central processing unit further includes a voice processing unit, the voice processing unit is connected to the storage unit, and uses the left and right channel voices (corresponding source language and target language) stored in the storage unit to record the voice recorded in real time. The signals are compared, and the corresponding two corresponding left and right channel voices (corresponding source language and target language) are sent to the audio output unit for output.
The multi-information synchronous coding learning apparatus according to claim 5, wherein the audio output unit further comprises a target language playing horn for separately targeting the target language in the two pieces of left and right channel voices obtained by the comparison. Performing amplifying play; the modes of input and output include wired and wireless transmission.
A multi-information synchronous coding learning method, comprising: the following steps

S1, the voice signal of the source language and the voice signal of the target language corresponding thereto are segmented and input through the audio input unit, and the segmented source language voice signal and the voice signal of the target language are input one by one;

S2. The audio processing unit respectively processes the two-segment-corresponding speech signals, so that the midpoints of the two-to-one-corresponding speech signals are aligned and recorded, and one of the speech signals is recorded to form a left-channel speech, and another A voice signal is recorded to form a right channel voice, and the processed two corresponding voice signals are stored in the storage unit;

S3, then the audio output unit extracts the voice signal in the storage unit, so that the left channel voice is input to the left channel earphone through the left channel, and the right channel voice is input to the right channel earphone through the right channel, and finally the left and right sounds The headphones are synchronized.
The multi-information synchronous coding learning method according to claim 7, further comprising the step

S4. Synchronize the subtitles, videos, and pictures corresponding to the source language through the display unit and the audio output unit.
The multi-information synchronous coding learning method according to claim 7 or 8, wherein the step S2 and S3 further comprise steps

S201: Collect text data or an instant voice signal by using a text input device or a voice input device, and the word processing unit or the voice processing unit uses the left and right channel voices (corresponding source language and target language) stored in the storage unit to the text data. Or the instant voice signal is compared, and the corresponding two corresponding left and right channel voices (corresponding source language and target language) are sent to the audio output unit for output.
The multi-information synchronous coding learning method according to claim 7, wherein the target language is a translation, interpretation or description of the source language.