TWI486925B - A speech learning device and method - Google Patents
A speech learning device and method Download PDFInfo
- Publication number
- TWI486925B TWI486925B TW102133811A TW102133811A TWI486925B TW I486925 B TWI486925 B TW I486925B TW 102133811 A TW102133811 A TW 102133811A TW 102133811 A TW102133811 A TW 102133811A TW I486925 B TWI486925 B TW I486925B
- Authority
- TW
- Taiwan
- Prior art keywords
- language learning
- learning device
- database
- unit
- image
- Prior art date
Links
Description
本發明係關於一種語言學習裝置與方法，特別係一種可攜式語言學習裝置。The present invention relates to a language learning device and method, and more particularly to a portable language learning device.
輔助語言學習的多媒體裝置一直是產業上熱門的發展領域，不僅可以應用在失語症醫療服務，也可以應用在教育事業、甚至旅遊業等。在臨床的語言治療服務上，目前僅可由語言治療師進行一對一或團體治療。然而這些方式都必須到院才能接受治療，但對於目前治療師人力不足之情況下，將會造成極大的不便。而在居家當中，雖可由錄音帶/錄音筆等錄音設備錄下語言提示句，使患者可在家反覆聽取練習，但這些語言提示句都是固定的，缺少了對環境中物品的互動學習之功能，尚有改良的空間。在教育事業上，若語言學習可以和生活週遭環境建立互動關係，將可以對學習與記憶產生極大的幫助，而這也是錄音帶/錄音筆等設備無法提供的。在旅遊上，常有博物館導覽人員人力不足之問題，若能藉由一種多媒體裝置讓旅客與環境產生互動，透過多媒體裝置代替導覽人力，旅客藉由多媒體裝置語想要觀賞的物品互動後由該裝置發出該物 品的介紹，將減少許多成本與不便，因此極需要本發明。The multimedia device for assisting language learning has always been a hot development field in the industry. It can be applied not only to aphasia medical services, but also to education and even tourism. In clinical language therapy services, one-on-one or group therapy is currently only available to speech therapists. However, these methods must be admitted to the hospital for treatment, but it will cause great inconvenience to the current shortage of therapists. In the home, although the language prompts can be recorded by recording equipment such as audio tapes/recording pens, so that patients can listen to the exercises at home, but these language prompts are fixed, lacking the function of interactive learning of objects in the environment. There is still room for improvement. In education, if language learning can interact with the environment around you, it will be of great help to learning and memory, which is not available with tapes/recorders. In tourism, there is often a shortage of manpower for museum guides. If a multimedia device is used to allow visitors to interact with the environment, the multimedia device can be used instead of the guided manpower. Is emitted by the device The introduction of the product will reduce many costs and inconveniences, and thus the present invention is highly desirable.
本發明之目的係在提供一種本發明係有關於一種語言學習裝置，包括：一攝影單元，係擷取一影像信號、一處理單元，係與一資料庫連結、一顯示單元，係設置於該語言學習裝置上、以及一收發音單元，係設置於該語言學習裝置上，其中，該處理單元係依據該影像信號自該資料庫中擷取一與影像信號相關之信息，並控制該顯示單元與該收發音單元播放該信息，俾能提供對環境中物品的互動與學習之功能。The present invention is directed to a language learning device, comprising: a camera unit that captures an image signal, a processing unit, and a database, and a display unit. The language learning device and the receiving unit are disposed on the language learning device, wherein the processing unit extracts information related to the image signal from the database according to the image signal, and controls the display unit Playing the information with the receiving unit can provide functions for interaction and learning of items in the environment.
本發明之另一目的係在提供一種語言學習方法，包括：(A)提供一電子裝置，該電子裝置係包括一攝影單元、一處理單元、一顯示單元、以及一收發音單元；(B)使用該電子裝置擷取一影像信號，該處理單元係依據該影像信號自一資料庫中擷取一與影像信號相關之信息；以及(C)該處理單元控制該顯示單元與該收發音單元播放該信息。Another object of the present invention is to provide a language learning method, comprising: (A) providing an electronic device, the electronic device comprising a photographing unit, a processing unit, a display unit, and a receiving unit; (B) Using the electronic device to capture an image signal, the processing unit extracts information related to the image signal from a database according to the image signal; and (C) the processing unit controls the display unit to play with the receiving unit The information.
本發明之語言學習裝置中所使用之資料庫無限制，較佳為資料庫內建於該語言學習裝置中，或一雲端資料庫、一遠端伺服器。更佳為該資料庫係為一記憶體單元。The database used in the language learning device of the present invention is not limited. Preferably, the database is built in the language learning device, or a cloud database and a remote server. More preferably, the database is a memory unit.
本發明之語言學習裝置中所使用之影像信號無特殊之限制，較佳為影像信號係為一物體之影像信號，且該物體上係具有一標籤。本發明之語言學習裝置中之標 籤較佳為一二維條碼、或為一RFID標籤。本發明之語言學習裝置中之二維條碼較佳係為一QR碼。本發明之語言學習裝置中所使用之信息無特殊之限制，較佳為該信息係包含一語音信息、及一影像信息。本發明之語言學習裝置中所使用之語音信息無特殊之限制，較佳為該語音信息包含對該影像信號之一輔助描述語句。本發明之語言學習裝置較佳為具有可擴充性。The image signal used in the language learning device of the present invention is not particularly limited. Preferably, the image signal is an image signal of an object, and the object has a label thereon. The standard in the language learning device of the present invention The signature is preferably a two-dimensional barcode or an RFID tag. The two-dimensional barcode in the language learning device of the present invention is preferably a QR code. The information used in the language learning device of the present invention is not particularly limited, and preferably the information includes a voice message and an image information. The speech information used in the language learning device of the present invention is not particularly limited, and preferably the speech information includes an auxiliary description sentence for one of the image signals. The language learning device of the present invention is preferably scalable.
(1)‧‧‧語言學習裝置(1) ‧ ‧ language learning device
(100)‧‧‧處理單元(100)‧‧‧Processing unit
(110)‧‧‧攝影單元(110)‧‧‧Photographic unit
(121)‧‧‧顯示單元(121)‧‧‧Display unit
(122)‧‧‧收發音單元(122)‧‧‧Accepting unit
(130)‧‧‧啟動裝置(130) ‧‧‧Starting device
(310)‧‧‧輔助描述語句(310) ‧‧‧Auxiliary Description Statement
圖1係本發明語言學習裝置之示意圖。1 is a schematic diagram of a language learning device of the present invention.
圖2係本發明語言學習之流程圖。2 is a flow chart of language learning of the present invention.
圖3係本發明語言學習之實施態樣示意圖。FIG. 3 is a schematic diagram of an implementation of the language learning of the present invention.
圖4係本發明裝置資料庫擴充之示意流程圖。Figure 4 is a schematic flow chart of the expansion of the device database of the present invention.
圖1為本發明語言學習裝置(1)之示意圖，該裝置包括處理單元(100)、攝影單元(110)、顯示單元(121)、收發音單元(122)以及啟動裝置(130)，該處理單元(100)係置於該裝置內部並與一資料庫(圖未顯示)連結，並依據該攝影單元(110)所擷取的影像信號自該資料庫中擷取與該影像信號相關之信息，並控制該顯示單元(121)與該收發音單元(122)播放該信息。其中，該資料庫可以係該裝置內部的記憶體單元，也可以係遠端資料庫或雲端資料庫等外部資料庫，但不限於此。該資料庫之資料可被擴充，例如置於裝置內部的資料庫可透過網際網路下載來更新資料內容，但不限 於網路，只要是能更新的方式皆屬本發明的實施態樣。另外，該影像信號係為一物體之影像信號，該物體上可具有一標籤使該處理單元利用該標籤進行物體辨識，但不限於此。1 is a schematic diagram of a language learning device (1) of the present invention, which includes a processing unit (100), a photographing unit (110), a display unit (121), a receiving unit (122), and a starting device (130). The unit (100) is disposed inside the device and is coupled to a database (not shown), and extracts information related to the image signal from the database according to the image signal captured by the camera unit (110). And controlling the display unit (121) and the receiving unit (122) to play the information. The database may be a memory unit inside the device, or may be an external database such as a remote database or a cloud database, but is not limited thereto. The data of the database can be expanded. For example, the database placed inside the device can be updated through the Internet to update the data content, but not limited to In the network, any manner that can be updated is an embodiment of the present invention. In addition, the image signal is an image signal of an object, and the object may have a label thereon, so that the processing unit uses the label to perform object recognition, but is not limited thereto.
圖2為本發明語言學習之流程圖，請一併參照圖1。開始學習流程後，依照步驟S210該裝置的啟動裝置(130)被開啟，並透過處理單元(100)進行步驟S220使該裝置的攝影單元(110)取得影像信號，之後進行步驟S230，辨識該影像，並進行步驟S240與資料庫資料進行比對，該辨識可以如先前所述係利用該物體上之標籤來與資料庫中相對應的物體資料標籤進行比對來確認是何種物體，也可以是使用常見的影像辨識方法直接對物體本身進行辨識，而非透過標籤，例如二值化分析、特徵比對等方式。其中，該標籤可以是二維條碼、RFID標籤，也可以是QR碼，但不限於此，只要可作為辨識用的標籤皆是本發明的實施態樣。當辨識完成後，再從資料庫中找出該物體的資料訊息。之後進行步驟S251或S252，將資料庫中該物體的資料訊息傳送至控制該顯示單元(121)或該收發音單元(122)，來播放該訊息。其中該訊息可以是影像訊息或語音訊息。之後可再進行步驟S260，該收發音單元(122)接收一語音信號，並進行步驟S270，該處理單元(100)將該語音信號傳送至資料庫。2 is a flow chart of language learning according to the present invention. Please refer to FIG. 1 together. After the learning process is started, the device (130) of the device is turned on according to step S210, and the image capturing unit (110) of the device acquires the image signal through the processing unit (100), and then proceeds to step S230 to identify the image. And performing step S240 to compare with the database data, the identification may use the label on the object to compare with the corresponding object data label in the database to confirm which object is, as described above, or It is a common image recognition method to directly identify the object itself, rather than through the label, such as binarization analysis, feature comparison and so on. The label may be a two-dimensional barcode, an RFID tag, or a QR code, but is not limited thereto, and any label that can be used for identification is an embodiment of the present invention. When the identification is completed, the data information of the object is found out from the database. Then, in step S251 or S252, the data message of the object in the database is transmitted to the display unit (121) or the receiving unit (122) to play the message. The message can be an image message or a voice message. Then, step S260 may be further performed, the receiving unit (122) receives a voice signal, and proceeds to step S270, and the processing unit (100) transmits the voice signal to the database.
圖3為本發明之一實施態樣示意圖，請一併參照圖1與圖2。當裝置(1)的使用者於環境中發現一物體時， 在此實施例裡，該物體為貼有QR碼標籤的一杯子，該使用者開啟該裝置(1)並拍攝該杯子使該裝置的的攝影單元(110)取得了杯子的影像信號，處理單元(100)利用該影像中的QR碼與資料庫中各物體的QR碼進行比對，當比對完成確定該物體為杯子後，處理單元(100)控制該顯示單元(121)或該收發音單元(122)將資料庫中杯子的訊息播放，如圖3所示，該顯示單元(121)會在畫面中呈現杯子的多媒體影像，該收發音單元(122)會播放杯子的語音資料訊息，藉此刺激使用者之視、聽覺。其中該語音資料訊息可以是分層階段聯想的提示語句，例如對該影像信號之一輔助描述語句(310)，如圖3所示「這是一個…杯子，這是一個用來裝水喝水…的杯子，喝水時都用杯子」之語句(310)，藉此讓使用者腦部建立對欲辨識物體在命名上之關聯性。在該訊息播放後，使用者可以利用該收發音單元(122)記錄自身練習發音的聲音信號，該處理單元(100)可將該聲音信號傳送至該資料庫，進行儲存或是比對，藉此可以得知發音標準與否，達到練習的效果。FIG. 3 is a schematic view of an embodiment of the present invention. Please refer to FIG. 1 and FIG. 2 together. When the user of the device (1) finds an object in the environment, In this embodiment, the object is a cup with a QR code label attached, the user turns on the device (1) and photographs the cup so that the camera unit (110) of the device obtains the image signal of the cup, the processing unit (100) using the QR code in the image to compare with the QR code of each object in the database, and after the comparison is completed to determine that the object is a cup, the processing unit (100) controls the display unit (121) or the received sound. The unit (122) plays the message of the cup in the database. As shown in FIG. 3, the display unit (121) presents the multimedia image of the cup in the screen, and the receiving unit (122) plays the voice information of the cup. This stimulates the user's vision and hearing. The voice data message may be a prompt statement associated with the layered stage, for example, a description of the image signal (310), as shown in FIG. 3, "This is a cup, which is used to hold water and drink water. The cup of ..., the cup is used in the statement of water (310), so that the user's brain establishes the relevance of the name of the object to be identified. After the message is played, the user can use the receiving unit (122) to record the sound signal of the practice pronunciation, and the processing unit (100) can transmit the sound signal to the database for storage or comparison. This can be used to know the pronunciation standard or not, to achieve the effect of the exercise.
本發明的另一個實施態樣，係不使用標籤而直接以影像辨識方法對物體本身進行辨識。首先，當裝置(1)的使用者於環境中發現一物體時，在此實施例裡，該物體為一杯子，該使用者開啟該裝置(1)並拍攝該杯子使該裝置的的攝影單元(110)取得了杯子的影像信號，處理單元(100)對該影像信號直接進行影像辨識處理，該辨識可藉由一演算法，該演算法與二值化分析、特徵比對等方式相關，當 辨識完成確定該物體為杯子後，處理單元(100)從資料庫中找出杯子的資料訊息，處理單元(100)接著控制該顯示單元(121)或該收發音單元(122)將資料庫中杯子的訊息播放，該顯示單元(121)會在畫面中呈現杯子的多媒體影像，該收發音單元(122)會播放杯子的語音資料訊息，藉此刺激使用者之視、聽覺。其中該語音資料訊息可以是分層階段聯想的提示語句，例如對該影像信號之一輔助描述語句(310)，如圖3所示「這是一個…杯子，這是一個用來裝水喝水…的杯子，喝水時都用杯子」之語句(310)，藉此讓使用者腦部建立對欲辨識物體在命名上之關聯性。在該訊息播放後，使用者可以利用該收發音單元(122)記錄自身練習發音的聲音信號，該處理單元(100)可將該聲音信號傳送至該資料庫，進行儲存或是比對，藉此可以得知發音標準與否，達到練習的效果。In another embodiment of the present invention, the object itself is directly identified by an image recognition method without using a label. First, when the user of the device (1) finds an object in the environment, in this embodiment, the object is a cup, the user turns on the device (1) and photographs the cup to make the camera unit of the device (110) obtaining the image signal of the cup, and the processing unit (100) directly performs image recognition processing on the image signal, and the identification may be related to the method of binarization analysis and feature comparison by using an algorithm. when After the identification is completed and the object is determined to be a cup, the processing unit (100) finds the data information of the cup from the database, and the processing unit (100) then controls the display unit (121) or the receiving unit (122) to be in the database. The message of the cup is played, and the display unit (121) presents the multimedia image of the cup in the screen, and the receiving unit (122) plays the voice data message of the cup, thereby stimulating the user's view and hearing. The voice data message may be a prompt statement associated with the layered stage, for example, a description of the image signal (310), as shown in FIG. 3, "This is a cup, which is used to hold water and drink water. The cup of ..., the cup is used in the statement of water (310), so that the user's brain establishes the relevance of the name of the object to be identified. After the message is played, the user can use the receiving unit (122) to record the sound signal of the practice pronunciation, and the processing unit (100) can transmit the sound signal to the database for storage or comparison. This can be used to know the pronunciation standard or not, to achieve the effect of the exercise.
此外，該裝置(1)的資料庫內容係可以被擴充，如圖4該裝置(1)擴充示意流程圖所示，該裝置(1)可由網路下載擴充套件，將套件中的語音檔、圖形、文字儲存於資料庫中，並可輸出該等語音檔的對應標籤，在一實施例裡該輸出可為列印出該標籤，使用者便可將該標籤貼於物體上，遂可進行利用標籤辨識該物件。In addition, the library content of the device (1) can be expanded, as shown in the schematic flow chart of the device (1) in FIG. 4, the device (1) can download the expansion kit from the network, and the voice file in the suite, The graphic and the text are stored in the database, and the corresponding label of the voice file can be output. In an embodiment, the output can print the label, and the user can attach the label to the object. The object is identified by a tag.
因此，藉由上述說明可知本發明可以讓使用者與環境產生互動，當失語症患者在週遭環境中遇到想要學習的物體便可以藉由本裝置進行互動而練習該物體的發音，而一般語言學習上也可以透過與週遭環境互動增加學習效 果，另外在旅遊上，博物館也可以透過此裝置減少導覽人力的成本，並讓旅客可以更方便的獲得想要知道的展覽介紹與訊息。此外本發明可以產生階段性之輔助描述語句，可以幫助使用者在記憶上的幫助，而提高學習的效率。另外，本發明可隨時擴充資料庫的內容，藉此使學習的資源更加豐富。Therefore, it can be seen from the above description that the present invention can allow the user to interact with the environment. When aphasia patients encounter an object to be learned in the surrounding environment, the device can be interacted by the device to practice the pronunciation of the object, and general language learning. You can also increase your learning effectiveness by interacting with your surroundings. In addition, in tourism, museums can also reduce the cost of guiding manpower through this device, and make it easier for passengers to get the exhibition introduction and information they want to know. In addition, the invention can generate a step-by-step auxiliary description sentence, which can help the user to help in memory and improve the learning efficiency. In addition, the present invention can expand the contents of the database at any time, thereby enriching the resources for learning.
上述實施例僅係為了方便說明而舉例而已，本發明所主張之權利範圍自應以申請專利範圍所述為準，而非僅限於上述實施例。The above-mentioned embodiments are merely examples for convenience of description, and the scope of the claims is intended to be limited to the above embodiments.
(1)‧‧‧語言學習裝置(1) ‧ ‧ language learning device
(100)‧‧‧處理單元(100)‧‧‧Processing unit
(110)‧‧‧攝影單元(110)‧‧‧Photographic unit
(121)‧‧‧顯示單元(121)‧‧‧Display unit
(122)‧‧‧收發音單元(122)‧‧‧Accepting unit
(130)‧‧‧啟動裝置(130) ‧‧‧Starting device
Claims (17)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW102133811A TWI486925B (en) | 2013-09-18 | 2013-09-18 | A speech learning device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW102133811A TWI486925B (en) | 2013-09-18 | 2013-09-18 | A speech learning device and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201513061A TW201513061A (en) | 2015-04-01 |
| TWI486925B true TWI486925B (en) | 2015-06-01 |
Family
ID=53437213
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW102133811A TWI486925B (en) | 2013-09-18 | 2013-09-18 | A speech learning device and method |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI486925B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6726486B2 (en) * | 2000-09-28 | 2004-04-27 | Scientific Learning Corp. | Method and apparatus for automated training of language learning skills |
| TWM341359U (en) * | 2007-12-27 | 2008-09-21 | Taipei Nat University Of The Arts | Interactive learning device using wireless sensing network |
| TW201101200A (en) * | 2009-06-26 | 2011-01-01 | Ming-Chang Wu | Object sensing and prompting system |
| TW201102981A (en) * | 2009-07-14 | 2011-01-16 | Chin-Yu Chen | Multimedia play/record controlling method and a language learning assistant device |
| TW201229801A (en) * | 2011-01-04 | 2012-07-16 | Ming-Chang Wu | Portable interactive system and the interactive method therefore |
-
2013
- 2013-09-18 TW TW102133811A patent/TWI486925B/en not_active IP Right Cessation
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6726486B2 (en) * | 2000-09-28 | 2004-04-27 | Scientific Learning Corp. | Method and apparatus for automated training of language learning skills |
| TWM341359U (en) * | 2007-12-27 | 2008-09-21 | Taipei Nat University Of The Arts | Interactive learning device using wireless sensing network |
| TW201101200A (en) * | 2009-06-26 | 2011-01-01 | Ming-Chang Wu | Object sensing and prompting system |
| TW201102981A (en) * | 2009-07-14 | 2011-01-16 | Chin-Yu Chen | Multimedia play/record controlling method and a language learning assistant device |
| TW201229801A (en) * | 2011-01-04 | 2012-07-16 | Ming-Chang Wu | Portable interactive system and the interactive method therefore |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201513061A (en) | 2015-04-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107071542B (en) | Video clip playing method and device | |
| WO2020237855A1 (en) | Sound separation method and apparatus, and computer readable storage medium | |
| US11232790B2 (en) | Control method for human-computer interaction device, human-computer interaction device and human-computer interaction system | |
| WO2013168732A1 (en) | Electronic device | |
| TW201104644A (en) | Interactive information system, interactive information method, and computer readable medium thereof | |
| JP2018534649A (en) | Method and apparatus for automatically capturing an object, and storage medium | |
| EP3866160A1 (en) | Electronic device and control method thereof | |
| WO2019033663A1 (en) | Video teaching interaction method and apparatus, device, and storage medium | |
| JP2012128378A (en) | Foreign language learning method based on stimulation of long-term memory | |
| CN108012173A (en) | A kind of content identification method, device, equipment and computer-readable storage medium | |
| US9525841B2 (en) | Imaging device for associating image data with shooting condition information | |
| CN111601145A (en) | Content display method, device and equipment based on live broadcast and storage medium | |
| JP2011508321A5 (en) | ||
| CN109817244A (en) | Oral evaluation method, apparatus, equipment and storage medium | |
| Arakeri et al. | Assistive technology for the visually impaired using computer vision | |
| WO2021174144A1 (en) | Systems and methods for interactive, multimodal book reading | |
| US20190108772A1 (en) | Method and apparatus for multilingual interactive self-learning | |
| CN110223365A (en) | A kind of notes generation method, system, device and computer readable storage medium | |
| CN103594086B (en) | Speech processing system, device and method | |
| CN108881996A (en) | Generate and show method, apparatus, equipment and the medium of the sequence of multi-media segment | |
| TWI486925B (en) | A speech learning device and method | |
| WO2020228349A1 (en) | Virtual news anchor system based on air imaging and implementation method therefor | |
| JP7130290B2 (en) | information extractor | |
| KR101408722B1 (en) | smart device with Play App for play of Textbook Information using Code recognition pen possible Bluetooth communication. | |
| JPWO2015178014A1 (en) | Learning support system, learning support server, learning support method, and learning support program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MM4A | Annulment or lapse of patent due to non-payment of fees |