TW200937278A - Assisted reading system and method utilizing identification label and augmented reality - Google Patents

Assisted reading system and method utilizing identification label and augmented reality Download PDF

Info

Publication number
TW200937278A
TW200937278A TW97107164A TW97107164A TW200937278A TW 200937278 A TW200937278 A TW 200937278A TW 97107164 A TW97107164 A TW 97107164A TW 97107164 A TW97107164 A TW 97107164A TW 200937278 A TW200937278 A TW 200937278A
Authority
TW
Taiwan
Prior art keywords
reading
handheld
format
data
hand
Prior art date
Application number
TW97107164A
Other languages
Chinese (zh)
Inventor
Tsung-Yu Liu
yu-ling Chu
Original Assignee
Tsung-Yu Liu
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsung-Yu Liu filed Critical Tsung-Yu Liu
Priority to TW97107164A priority Critical patent/TW200937278A/en
Publication of TW200937278A publication Critical patent/TW200937278A/en

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to an assisted reading system and method utilizing identification label and handheld augmented reality. The system includes a book having many identification labels, a handheld device having a reader, and a server. The method includes steps of: a user reading the identification label on the book through the reader of the handheld device to read identification label data of the identification label; the handheld device can process the information in the identification label or download information via a wireless area network; the information are played by the handheld device automatically so that the user can watch and listen the multimedia content.

Description

200937278 九、發明說明: '【發明名稱】 應用識別標藏鱼撼眚接 &车姓^ ,, 與興擴增實境的手持式閱讀輔助系統與方法 【發明摘要】 e 參 輔助藏與擴增實境的手持式閱讀 含及具有一讀取器的-手持式裝置,而該方法包 : 一使用者利用該手持式震置之該讀取器對該 識別標籤進行讀取,而讀取到記錄於該識別 3中的-識別標籤資料;1¾手持式裝置根據該識別 育料並直接處理成多媒體數位内以自伺服器下載多媒體 數位内容,該多媒體數位内容為即時影像、立體虛擬物件、 語音與文字所構成之多媒體,並透過手持式裝置的顯示卷 與音效單元播方出纟’使得該使用者能對 容進行觀;t m讀取m ^ 5 200937278 【發明所屬之技術領域】 本案係為一種應用識別標籤與擴增實境的手持式閱許 輔助系統與方法,尤指在一平面書籍閱讀系統中可=利用" 手持式裝置將書籍中之識別標籤之内容資料加以處理而呈 現出影像、音效、文字與立體虛擬物件等說明資料之系統 【先前技術】 〇 隨著現代數位科技、行動運算技術與資訊傳播技術的 曰益進步’現代人對於數位科技產品的使用是愈來愈普 遍,同時,無論是無線網路連線或是電信業者所&供二^ 動電話上網功能,都能夠讓使用者能很方便地藉由相關的 行動運算裝置,例如:筆記型電腦、手機或行動電話、個 人數位助理(Personal Digital Assistant,簡稱為 PDa)等, 而能夠很快速地得知相關的通知信息或是可以對所需的資 訊進行即時查詢。 ’ φ 當筆記型電腦、個人數位助理這類的行動裝置的内部 設計有無線網路卡時,或該等裝置可另外再連接一外接式 無線網路卡時,則該等裝置便可以和所在地點的無線區域 網路(Wireless Local Area Network,簡稱為 WLAN)進行網 路信號連線,而能夠讓使用者也能於室外進行網際網路的 劉覽或網路資料的查詢;此外,有的手機或行動電話也具 備有上網的功能,然而其連線的方式則是透過電信業者之 通信系統來提供上網的服務,其應用方式以目前的第三代 (Third Generation,簡稱為3G)無線通信技術為例,使用者 不僅能利用手機或行動電話來傳輸聲音,還能夠進行影像 或多種規格的數據傳輸,而能夠達到上網或是進行其他寬 6 200937278 頻多媒體的無線應用功能。 進一步來說,在數位化與行動化的環境之下,使用者 除了能夠很方便和很快速地獲知、接收或查詢相關的信息 與資料之外’使用者同時也能夠隨時隨地來吸收新知與資 sfl ’因此’這樣的行動應用概念已經隨著個人數位行動裝 置的普遍使用在不斷建構充實下,逐漸地在學校與公共空 ,中發展了起來。在這樣以行動裝置為基礎所發展出來的 資Λ應用方式,使得擷取資訊與知識的過程不會再只是侷 Ο ❹ 限於傳統的教室裡進行,我們便能夠創造出一個可以隨時 隨地棟取資訊與知識的環境。 舉例來說,自然科學是個著重觀察自然事物,從中發 現自然運行真理的課程,學習者除了於平面書籍内閱讀到 文字與圖片的内容,若能在真實的環境中親自看到生物體 影像或聽到生物體的聲音,亦是相當重要的學習過程。因 傳統平面教科書所能呈現的内容就相對的比較受限,而且 無法展示高趣味化的内容,因此國内目前的方法之一是建 構數位學習系統,由學習者使用一台電腦,自伺服器上下 載學習的資源。因此藉由這樣的辅助學習方式,學習者便 月b隨時隨地下載多媒體影音及虛擬實境的輔助學習内容, 而讓學習者能夠很快地擷取資訊與吸收知識。另一種 則為直接透過瀏覽隨書附贈之影音光碟來進行輔助學習"。 巧統則藉由可攜式頭戴顯示器顯示虛擬實境的 稀助學習内容。 承上所述,本案之目的便是在於結合識別標藏、無 網路、擴增實境與行動計算技術為基礎,i同時應用了、諸 位助:(PDA)、PDA手機或行動電話等;類的手 的系統與方*,使得閱讀㈣的方式也可真貝^ 7 200937278 情境與更具互動性的環境裡進行,以得到高真實性的 果,增進知識的了解與資訊的獲得。如此不但會帶來新 •資訊擷取觀念’同時也能夠促進感測元件、無線網路、多 媒體與行動科技等產業的發展。 【發明内容】 ❹ 本發明之目的在於提供一種應用識別標籤與擴增 的手持式閱讀輔助系統與方法,使用者於閲讀書籍 系統能提供混合實景與虛擬物件的擴增實境 Reality,AR)的方式來輔助獲得資訊與了解知識。 閲讀=面書籍、雜諸或文件時,能利用手持式裝置 別標籤進行讀取其内涵的資訊,並做進一步的處理,以^ 過手持式裝置呈現或播放多媒體影像、聲音、文 =讓由無線網路來和伺服器進行連線二 以下載其他更多資料進行資訊的擷取與知 本案係為一種手持式閱讀辅助系統,包一 書籍或文件,該平面書籍戋文件抓署 每個識別標籤中記錄個識別標籤,而於200937278 IX. Description of invention: '[Name of invention] Hand-held reading aid system and method for identifying and identifying fish 撼眚 && car surname ^ , , and Xing augmented reality [Abstract] e 参 辅助 辅助 辅助The augmented handheld reading includes a handheld device having a reader, and the method package: a user reads the identification tag by using the handheld shocked reader, and reads Up to the identification tag data recorded in the identification 3; the handheld device is directly processed into a multimedia digit according to the identification and is downloaded into the multimedia digit to download the multimedia digital content from the server, the multimedia digital content is an instant image, a stereo virtual object, The multimedia composed of voice and text, and through the display volume of the handheld device and the sound unit broadcast party 'to enable the user to view the content; tm read m ^ 5 200937278 [Technical field of the invention] A hand-held reading aid system and method for identifying labels and augmented reality applications, especially in a flat book reading system, using a "handheld device A system for identifying information such as images, sound effects, texts, and stereoscopic virtual objects, which is processed by the contents of the identification label. [Prior Art] 〇 With the advancement of modern digital technology, mobile computing technology and information dissemination technology, modern people The use of digital technology products is becoming more and more common. At the same time, whether it is a wireless network connection or a telecom operator's/secondary phone Internet access function, users can easily use related actions. An arithmetic device, such as a notebook computer, a mobile phone or a mobile phone, or a Personal Digital Assistant (PDA), can quickly learn related notification information or can instantly query the required information. . ' φ When a mobile device such as a notebook computer or personal digital assistant is designed with a wireless network card, or if the device can be connected to an external wireless network card, then the device can be located The wireless local area network (Wireless Local Area Network, WLAN for short) is used for network signal connection, and allows users to conduct Internet browsing or network data query outdoors; Mobile phones or mobile phones also have the function of accessing the Internet. However, the way to connect is to provide Internet access services through the communication system of the telecom operators. The application method is the current third generation (Third Generation, 3G) wireless communication. For example, the user can not only use the mobile phone or mobile phone to transmit sound, but also can carry out image or multiple data transmission, and can reach the Internet or perform other wireless functions of the 200937278 frequency multimedia. Further, in the digital and mobile environment, users can not only know, receive or query relevant information and materials very conveniently and quickly, but users can also absorb new knowledge and resources anytime and anywhere. The concept of action application such as sfl 'so' has been gradually developed in the school and public space with the continuous use of the universal use of personal digital mobile devices. In this way of using mobile devices based on mobile devices, the process of capturing information and knowledge is no longer just a matter of Ο 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统 传统The environment with knowledge. For example, the natural sciences are a course that focuses on observing natural things and discovering the truth of natural operation. In addition to reading the contents of texts and pictures in a flat book, learners can see the images or hear them in real life. The sound of living things is also a very important learning process. Because traditional flat textbooks can be relatively limited in content and cannot display highly interesting content, one of the current methods in China is to construct a digital learning system. Learners use a computer and self-server. Download the resources for learning. Therefore, with such an auxiliary learning method, the learner can download multimedia audio-visual and virtual reality auxiliary learning content anytime and anywhere, so that the learner can quickly acquire information and absorb knowledge. The other is to assist in learning directly by browsing the audio-visual CD that comes with the book. Qiao Tong displays the virtual reality of the lean learning content through the portable head-mounted display. As stated above, the purpose of this case is based on the combination of identification, no network, augmented reality and mobile computing technology. i has also applied, (PDA), PDA mobile phones or mobile phones; The system of the hands of the class and the side*, so that the way of reading (4) can also be carried out in the context of a more interactive environment, in order to obtain high authenticity, to enhance knowledge and access to information. This will not only bring new information to the market, but also promote the development of sensing components, wireless networks, multimedia and mobile technology. SUMMARY OF THE INVENTION The object of the present invention is to provide a handheld reading aid system and method for applying an identification tag and an augmentation. The user can provide augmented reality Reality (AR) of the mixed reality and virtual objects in the reading book system. Ways to help get information and learn about it. When reading = books, miscellaneous documents or documents, you can use the handheld device to read the information of the connotation and perform further processing to present or play the multimedia image, sound, text = let by the handheld device The wireless network is connected to the server to download other more information for information retrieval and knowledge. The system is a handheld reading assistant system, which includes a book or a document. An identification tag is recorded in the tag, and

Si 一 使”進行使用,該手持式閲讀輔助裝置 識別標籤中的資料,並加以處 卡字和虛擬物件或播放聲音,或進 別標藏資料經由一無線 ί二經由該!線網路而和該手持式閱 ^的資料下# 線’使^該使用者能將該飼服器 上的貝料下載至該手持式閱讀輔 本案另-方面係為一種手持式閱讀;π 手持式閱㈣助系統上’該手持式閱讀輔助系統包含 8 200937278 有:設置有多個識別標籤的一平面書籍或文件具有一讀 取器的-手持式閲讀輔助裝置以及一飼服器,而言亥方法包 •含步驟如下:_使用者利用該手持式閱讀輔助裝置之該讀 取器對該平面書籍或文件之該識別標籤進行讀取,而讀取 到記錄於該識別標籤中的一識別標籤資料;該手持式閱讀 輔助裝置根據該識別標籤資料加以處理後呈現多媒體影 像、文字或擴增實境物件於該手持式閱讀輔助裝置上,並 透過該手,式閱讀輔助裝置播放出聲音,或進一步能根據 該識別標籤資料經由一無線網路與伺服器進行連線;以及 二伺服器,可經由該無線網路而和該手持式閱讀輔助裝置 凡成彼此之連線,使得該使用者能將該伺服器上的說明資 料下載至該手持式閱讀輔助裝置中,以進行進一步的資料 擷取與呈現。 根據上述構想,其中該手持式閱讀輔助裝置可為該使 用者所使用的一手機、一行動電話或一個人數位助理。 根據上述構想,其中該平面書籍可為一雜誌、一技術 報告或一手冊文件,而於該一平面書籍、一雜誌、一技術 報告或一手冊文件上係存在多個識別標籤。 ^ 根據上述構想,其中該識別標籤可為一二維條碼標 ® 籤、一個圖型標記標籤或一無線射頻識別電子標籤。τ 根據上述構想,其中該識別標籤資料包含有一展現書 籍内容的影像、文字、圖片、聲音和擴增實境物件等的^ 明資料,或一伺服器於網際網路上之連線位址資訊與一網 際網路資源位址資訊。 一、 ^ 根據上述構想,其中該手持式閱讀輔助裝置可以讀取 β玄硪別標籤内之資料,並進一步處理該識別標籤資料,而 將影像、文字、圖片、聲音、虛擬物件展現或播放聲音在 該手持式閱讀輔助裝置上。 根據上述構想,其中該識別標籤資料之格式可為影像 9 200937278 =檔:格式、文字播格式、擴增實 式、網際網路資;格式、祠服器位址資料格 時,in’其十該識別標籤資料之格式為影像檔 影像。°觀看该手持式閱讀輔助裝置上的顯示器展現Once the Si is used, the handheld reading aid recognizes the data in the tag, and places the card and the virtual object or the playing sound, or enters the tagged data via the wireless network via the wireless network. The hand-held reading data under the #线' enables the user to download the bedding on the feeding device to the handheld reading assistant, and the other is a hand-held reading; π hand-held reading (four) On the system, the handheld reading aid system includes 8 200937278. There is a flat book or document with multiple identification tags with a reader-handheld reading aid and a feeding device. The method includes the following steps: the user reads the identification label of the plane book or the document by using the reader of the handheld reading auxiliary device, and reads an identification label data recorded in the identification label; The handheld reading aid device processes the multimedia image, the text or the augmented reality object on the handheld reading aid device according to the identification label data, and reads through the hand The reading auxiliary device plays the sound, or can further connect to the server via the wireless network according to the identification tag data; and the second server can communicate with the handheld reading auxiliary device via the wireless network The connection enables the user to download the description data on the server to the handheld reading aid for further data capture and presentation. According to the above concept, the handheld read assist device may be A mobile phone, a mobile phone or a number of assistants used by the user. According to the above concept, the flat book can be a magazine, a technical report or a manual document, and the flat book, a magazine, a technical report Or a plurality of identification tags are present on a manual file. ^ According to the above concept, the identification tag may be a two-dimensional bar code label, a pattern label label or a radio frequency identification electronic tag. τ According to the above concept, The identification tag data includes an image, text, picture, sound, and augmented reality showing the contents of the book. Information such as a piece of information, or a server's connection address information on the Internet and an Internet resource address information. 1. According to the above concept, the handheld reading aid can read β Xuan Identifying the information in the tag and further processing the identification tag data, and displaying or playing the image, text, picture, sound, virtual object on the handheld reading aid device. According to the above concept, the identification tag data The format can be image 9 200937278 = file: format, text format, augmented real, internet resources; format, server address data, in' ten of the identification tag data format is image file image ° Watch the display on the handheld reading aid

Ο 柃、f5上述構想’其中該識別標籤資料之格式為圖片 子檔或擴增實境物件檔時,使用者可觀看該手持式 :讀輔助震置上的顯示器展現的圖片、文字或擴增實= 根據上述構想,其中該識別標藏資料之格式為聲 時,使用者可聆聽該手持式閱讀輔助裝置上 放的聲音。 j俏双益所播 根據上述構想,其中該識別標籤資料為標籤語言文 播時’而該使用者可利用該手持式閱讀輔助裝置 資料’整合標籤語言文件内所描述的多媒體物件: 出虛擬實境的物件,並同時展現在該手持式閱讀輔助 裝置的顯不器與播放聲音,以進行輔助閱讀。 根據上述構想,其中該識別標籤資料可包含有—_ 網路資源位址資訊,而該方法更包含下列步驟.該網際 閱讀輔助裝置根據該網際網路資源位址值於連線=離持式 將該平面書籍的說明資料加以下載,以進行輔助閱=下’ 【圖式簡單說明】 本案得藉由下列圖式及說明,俾得一更深入之了解 第一圖,係為本案較佳實施例之示意圖。 第二圖,係為本案較佳實施例之流程圖。 200937278 第一圖’係為在本案較佳實施例中的個人數位助理20與伺 服器30之内部功能方塊示意圖。 本案圖式中所包含之各元件列示如下: 手持式閱讀輔助系統1 〇〇 平面書籍10 識別標籤1 1 手持式閱讀輔助裝置20 識別標籤讀取器21 處理器22 © 連接器23 圖像顯示模組24 語音模組2 5 擴增實境顯示模組2 6 多媒體影音與擴增實境物件27 伺服器30 連接器31 處理器32 資料庫33 步驟S0 1〜S 0 6 【實施方式】 清,%第—圖,係為本案較佳實施例之示意圖。由此 丰i:胡i:係設置了一手持式閱讀辅助系統1〇0,而該 系、统100主要可包含了有-平面書籍10、 人置20和一伺服器30。該手持式褒置係可為個 ΐ ϊ Ϊ ΐ (Personal Digital Assistant,PDA) ^ ^ ^ ^ t, 此例中,我們係以一個人數位助理(pDA)2〇 200937278 來代表δ玄手持式閱讀輔助步署, 供給-使用者以進裝置且遠個人數位助理20係提 ' 在此較佳實施例中’我們的目的β亚各丨田杰兄4+ 所提到的識別標籤與擴增實境 、疋 削技術中 •姑站么从! ΠΛ 1 霄特色,而能將該手持式閱讀 輔助系統10 0提供該梓用去_朗& 堂拉昧❹4^ 賣含有多個識別標籤的平面 曰福時,可ΑΛ利用—丰4 认纪Ά 予持式閱靖輔助裝置20產生擴增實境 ===書籍的内容,因此,如第-圖中丄 +面曰藉:頁,有一識別標籤u,我們可於識別 η 上記錄著多媒體影音鱼擴捭本 1ΜΙΛ #署Μ 2 ^ ” 貝兄物件資訊,透過手持式閱 4輔助裝置20所呈現的多媒體 〇助說明,使得使用者可以更瞭解文章内容。 午的輔 而在此較佳實施例中的該手持式閱讀輔助裝置20係 :有-識2標蕺讀取器21 ’且在該平面書籍1〇上係設置 有一識別標籤11 ’該識別標籤丨丨之型式係可為習用的一 二維條碼標籤或是一無線射頻識別(Radi0 Frequency Identification ’ RFID)電子標籤或是一圖形標籤,而在此例 中,我們係使用二維條碼標籤來代表該識別標籤丨丨,因此, 該手持式閱讀輔助裝置2〇之識別標籤讀取器21便是一種 可對二維條碼標籤進行讀取、辨識,並進而可供該手持式 © 閱凟輔助裝置2〇進行解碼與顯示其記錄内容的讀取裝置。 咕參閱第一圖,係為本案較佳實施例之流程圖,並請同 時參閱第一圖、第二圖與第三圖,以說明本案較佳實施例 中其使用者的使用過程。在此例中,該識別標籤丨丨中係記 錄著有一識別標籤資料,而該識別標籤資料若為如上所述 之可提供該使用者進行瞭解與輔助說明之多媒體資訊,使 用者只要將該手持式閱讀輔助裝置2〇之該識別標籤讀取 器2 1對著該平面書籍丨〇之該識別標籤丨丨進行讀取,便能 夠直接將該内建的多媒體影音與擴增實境物件資料進行解 碼、還原與處理’最後透過圖像顯示模組24、語音模組25 12 200937278 與擴增實境顯示模組26,將多媒體影音與擴增實境物件 27顯示於該手持式閱讀辅助裝置2〇上,使得使用者可以 1更瞭解文章内容。(步驟S01至步驟S05)。 承上所述,本案之特徵在於在該識別標籤資料若為一 網際網路資源位址值(Universal Resource Locator,簡稱為 URL)或一伺服器位址值,而當該使用者利用該手持式閱讀 輔助裝置20之該識別標籤讀取器21對該識別標籤丨丨進行 »貝取時’便可以讀取到δ己錄於該識別標籤1 1中的該網際網 路資源位址值或該伺服器位址值,同時,在此例中的該手 ❹ 持式閱讀辅助裝置20係具有網路連線之功能,而透過該手 持式閱讀辅助裝置20所在處之無線區域網路(WLAN),該 手持式閱讀輔助裝置20便能夠利用連接器23和一伺服器^ 的連接器31產生連線;其中,在此實施例,該網際網路資源 位址值係代表著該伺服器30於該網際網路上所記錄著該 使用者所欲作進一步獲知或瞭解的一資料之連線位址,^ 故,當該識別標籤讀取器21讀取到該網際網路資源位址值 時,該手持式閱讀輔助裝置2〇便能根據該網際網路資源位 址值並經由該無線區域網路(评1^八;^)與伺服器3〇進行連線 而能自伺服器30下載多媒體影音與擴增實境物件資料,最 ® 後透過圖像顯示餘24、語音模,組25與擴增實境顯示模 組26,將多媒體影音與擴增實境物件27顯示於該手持 閱讀辅助裝置20上,使得使用者可以更瞭解文章内 = 驟 S06) 。 α ,上所述,我們成功地利用了具有可讀取習用二維條 標籤或無線射頻標籤之讀取器的一手持式裝置,以及供 使用者進行資料下載的一伺服器,來建構出本案之手^ 閱讀輔助系統,從而能夠讓使用者可以在閱讀平 / 文=時,可以觀看與柃聽多媒體影音與擴增實境物件= 不與解說,使得閱讀的過程能更生動與逼真,使 13 200937278 更加了解書籍的内容β 實施例之說明,我們成功地 本案發明得由熟習此技藝之 然皆不脫如附申請專利範圍 疋故,藉由上述本案較佳 _達成了本案發展之主要目的。 人士任施匠思而為諸般修飾, ' 所欲保護者。 【圖式簡單說明】 第一圖係本發明之系統架構 _ 環境。 •肩不輔助閱讀系統的使用 ❹ 第二圖係本發明關於顯示書籍内 第三圖係本發明之軟體程式架構^說明之影像流程圖。 【主要元件符號說明】 手持式閱讀輔助系統100 平面書籍10 識別標籤11 手持式閱讀輔助裝置2〇 識別標籤讀取器21 處理器22 ®連接器23 圖像顯示模組24 語音模組25 擴増實境顯示模組26 多媒體影音與擴增實境物件27 伺服器30 連接器31 14 200937278 處理器32 資料庫33 步驟SOI〜S06Ο 柃, f5 The above concept 'When the format of the identification tag data is a picture sub-file or an augmented reality object file, the user can view the hand-held type: read the picture, text or enlargement of the display on the auxiliary oscillating display According to the above concept, when the format of the identification data is sound, the user can listen to the sound placed on the handheld reading aid. According to the above concept, the identification tag data is a tag language genre 'and the user can use the handheld literary device data' to integrate the multimedia objects described in the tag language file: The object of the environment, and at the same time, the display and playback sound of the handheld reading aid device for auxiliary reading. According to the above concept, the identification tag data may include -_ network resource address information, and the method further comprises the following steps. The internet reading auxiliary device is connected according to the internet resource address value = disconnected Download the description of the flat book for the supplementary reading = lower [Simplified description of the drawing] The following drawings and explanations can be used to obtain a more in-depth understanding of the first figure, which is the preferred implementation of this case. A schematic diagram of an example. The second figure is a flow chart of a preferred embodiment of the present invention. 200937278 The first figure is a block diagram of the internal functions of the personal digital assistant 20 and the servo 30 in the preferred embodiment of the present invention. The components included in the drawings are as follows: Handheld Reading Assist System 1 〇〇 Plane Book 10 Identification Tag 1 1 Handheld Reading Assist Device 20 Identification Tag Reader 21 Processor 22 © Connector 23 Image Display Module 24 Voice Module 2 5 Augmented Reality Display Module 2 6 Multimedia Video and Augmented Reality Object 27 Server 30 Connector 31 Processor 32 Database 33 Step S0 1~S 0 6 [Embodiment] , % - Figure, is a schematic diagram of a preferred embodiment of the present invention. Thus, the i: is provided with a hand-held reading aid system 1〇0, and the system 100 can mainly include a-plane book 10, a person 20 and a server 30. The handheld device can be a Personal Digital Assistant (PDA) ^ ^ ^ ^ t. In this example, we use a number of assistants (pDA) 2〇200937278 to represent the δ 玄 hand-held reading aid. In the preferred embodiment, the target-user and the user-input device and the remote personal digital assistant 20 are in the preferred embodiment. In the boring technique, the squatting station! ΠΛ 1 霄 Features, and the handheld reading aid system 10 can provide the 梓 _ 朗 & 朗 堂 昧❹ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ 含有 含有 含有 含有 含有 含有 含有 含有 含有 含有予 The holding-reading auxiliary device 20 generates the content of the augmented reality === book. Therefore, as in the first picture, the page has an identification tag u, and we can record the multimedia on the identification η. Video and audio fish expansion 1ΜΙΛ #署Μ 2 ^ ” Beixiong object information, through the multimedia help instructions presented by the handheld reading 4 auxiliary device 20, so that users can better understand the content of the article. The hand-held reading assisting device 20 in the embodiment is a type-recognition 2 tag reader 21' and an identification tag 11 is disposed on the plane book 1'. The type of the identification tag can be used. a two-dimensional bar code label or a radio frequency identification (RFID) electronic tag or a graphic tag, and in this case, we use a two-dimensional bar code label to represent the identification tag, therefore, Handheld reading The identification tag reader 21 of the auxiliary device 2 is a type that can read and recognize the two-dimensional bar code tag, and is further provided for reading and displaying the recorded content of the hand-held © reading aid device 2 The first embodiment is a flow chart of a preferred embodiment of the present invention, and please refer to the first, second and third figures at the same time to illustrate the use of the user in the preferred embodiment of the present invention. In this example, the identification tag is recorded with an identification tag data, and if the identification tag data is as described above, the user can provide multimedia information for the user to understand and assist the description, and the user only needs to hold the hand-held device. The identification tag reader 2 1 reads the identification tag 该 of the plane book ,, and can directly perform the built-in multimedia audio and video and the augmented reality object data. Decoding, Restoring, and Processing 'Finally through the image display module 24, the voice module 25 12 200937278 and the augmented reality display module 26, the multimedia audio and augmented reality object 27 is displayed in the handheld The reading aid device 2 allows the user to know more about the content of the article (step S01 to step S05). As described above, the present invention is characterized in that the identification tag data is an internet resource address value. (Universal Resource Locator, abbreviated as URL) or a server address value, and when the user uses the identification tag reader 21 of the handheld reading auxiliary device 20 to perform the selection of the identification tag ' The internet resource address value or the server address value recorded in the identification tag 11 can be read, and the hand-held reading assistant 20 in this example has a network. The function of the line connection, and through the wireless local area network (WLAN) where the handheld reading aid 20 is located, the handheld reading aid 20 can be connected by the connector 23 and the connector 31 of the server. In this embodiment, the Internet resource address value represents a connection address of the data that the server 30 records on the Internet for the user to further learn or know. , ^, therefore, When the identification tag reader 21 reads the internet resource address value, the handheld read assist device 2 can be based on the internet resource address value and via the wireless local area network (1) ^8;^) Connected with the server 3〇 to download multimedia audio and audio and augmented reality object data from the server 30, the most after-image display image 24, voice mode, group 25 and augmented reality The display module 26 displays the multimedia video and augmented reality object 27 on the handheld reading assist device 20 so that the user can know more about the article (step S06). α, above, we successfully used a handheld device with a reader that can read a conventional two-dimensional strip label or radio frequency tag, and a server for users to download data to construct the case. The hand ^ reading aid system, so that users can watch and listen to multimedia video and augmented reality objects when reading Ping / text = no explanation, making the reading process more vivid and realistic, so that 13 200937278 A better understanding of the content of the book β The description of the embodiment, we succeeded in the invention of this case from the familiarity of this skill, as the scope of the patent application, the above-mentioned case is better _ reached the main purpose of the development of the case . The person is arbitrarily adorned with all kinds of modifications, 'the one who wants to protect. BRIEF DESCRIPTION OF THE DRAWINGS The first figure is the system architecture of the present invention _ environment. • Use of the shoulder-inaccessible reading system ❹ The second figure is an image flow diagram of the present invention for displaying the software in the book. [Main component symbol description] Handheld reading aid system 100 Plane book 10 Identification tag 11 Handheld reading aid 2 ID tag reader 21 Processor 22 ® connector 23 Image display module 24 Voice module 25 Environment Display Module 26 Multimedia Video and Amplified Reality Objects 27 Server 30 Connector 31 14 200937278 Processor 32 Library 33 Steps SOI~S06

1515

Claims (1)

200937278 十、申請專利範圍: 【申請專利範圍] ^種手二閱讀輔助系統’包含有: 個該識別標籤中~Γ書藉内有多個識別標籤,而於每 一车姓:錄有一識別標籤資料; 子持式閱讀輔助键w , 手持式閱讀辅助裝置内且有’ ^供一使用者進行使用,該 中的該識別輕鑛次划 有—讀取器,可讀取該識別標籤 M f ^貝;,戎手持式閱讀輔助裝置根據該識別 ❹ ❹ :以處理後呈現多媒體影像、文字或擴增實 土兄物件於έ亥手持式閩诗結# & m 輔助裝置播放出聲音\戈進:上’並透過該手持式閱讀 纟一 戍進一步能根據該識別標籤資料經 由無線網路與伺服器進行連線;以及 裝置- 2::夕:t由該無線網路而和該手持式閱讀輔助 S f ΐ m ii ,使得該使用者能自該伺服器下載說 明貝科至料持式閲讀輔助裝置中,以進行讀取。 2. 如申請專利範圍第1項所述之勃办主& ^,# Φ ^ ^ 4* 所达之數位手持式閱讀輔助系 Li ί式閱讀輔助可為該使用者所使用的-手持 式裝置、一仃動電話或一個人數位助理哭。 中該平面書籍可為一書籍 3. 如申請專利範圍第1項所述 : 雜 Φ钛正;老雜# * am 于持式閱讀輔助系統,其 ==:::Γ ΐ多個識別標藏文::每一個技:^ :標 咸中係存在者欲進一步說明該平面書籍 4. 如申請專利範圍第丨項所述之手持 ^資訊。 中該識別標籤可為-二維條碼標籤 形’其 射頻識別電子標籤。 不鐵或一無線 5. 如申請專利範圍第1項所述之手持 中該識別標籤資料包含有一說明該平面^ =系統,其 訊,而該使用者可利用該手持式閱讀輔』^之相關貝 〜買輞助之該讀取器讀取 16 200937278 該識別標籤後,便能直接將該内建資訊進行讀取、辨識, 並進而可供該手持式閱讀輔助裝置進行解碼,並顯示其内 涵之多媒體影音與擴增實境物件的說明。 6士如申請專利範㈣!項所述之手持式閱讀輔助系統,其 ^亥識別標籤資料可包含有—伺服器位址值或―網際網路 貧源位址值,該伺服器位址值係代表著該伺服器於一網際 網路上之連線位址,而該網際網路資源位址值係代表著該 伺服器於該網際網路I· #料_ #兮· i I β # 一 4丨不』峪上。己錄3 5亥千面書籍所欲進一步說明 之資料位址。 Ο e 7二申1專利範圍…所述之手持式閱讀輔助系統,其 中=持式閱讀輔助裝置可提供使用者於該網際網 仃瀏覽。 = 1項所述之手持式閱讀輔助系統,其 w : 為影像檔格式、聲音檔格式、圓片 :檔二::檔格式、擴增實境物件檔格式、標籤語言文 9 “二1址資料或一網際網路資源位址資料格式。 9.如申睛專利範圍第8項所述之 A φ兮埒昍次刺 > 从1 ^ ^ A閲磺補助系統,其 中3說月貝枓之格式為影像標格式 持式閱讀輔助裝置可播^資料 槽格式時,该手 音的方式呈現說明之=貝料之影音而能夠以影片或聲 10·如申請專利範圍“項所述之手 資料之格式為圖片槽格式或二閱;:助】統,其 式閱讀輔助裝置上之顯示器能 ,手持 提供說明之内容。 王現圖片或文字的方式 11·如申請專利範圍第8項所述之手 中該說明資料之格式為擴增實境物件:::輔其 輔助裝置能夠利用電腦立體繪圖的:夺式閱磧 如申請專利範圍第8項所述:呈二說月之内容。 中該說明資料之格式A;α '閱讀輔助系統,其 巧马祆氟浯5文件檔格式時,手持式閱 17 200937278 讀輔助裝置能夠解譯該標籤語言文件,並進一步的 標籤語言文件所需之影像、文字、圖片、聲音、擴增實境 加以整合並同時呈現說明内容於該手持式 助裝置上。 13·-種手持式閱讀輔助方法,應用在—手持式閱讀輔助系 統上’該手持式閱讀輔助系統包含有 ^ 籤的-平面書籍、具有-讀取器的一手持式m 以及-祠服器,而該方法包含步驟如下:稀助裝置 ❹ ❹ :使用者利用該手持式閱讀輔助裝置之 平面書籍之該識別標籤進行讀取,而讀取; 標籤中的-識別標籤資料; 綠於》玄識別 該手持式閱讀辅助裝置根據該識 以處理後呈頦客碰舯史你 辦貝竹而胄b加 俊至見多媒體影像、文字或擴增實境物件於_丰拄 式閱讀輔助裝置上,並透過今手车 :於該手持 聲音; 更逐過4手持式閱續輔助裝置播放出 線網r二持s置亦可根據該識別標籤資料並經由-益 線網路進订連線而和該飼服器完成彼此之連線;以’、、、 該使,者利用該手持式裝置於連線狀態下將 所記錄著的一說明資料加以下 =° 說明資料進行閲讀。 使侍錢用者能對該 Μ·如申請專利範圍第13項所述之手持 其中續堪別;您次JH A A °賣辅助方法’ :中該識别軚籤資枓包含有一說明該平面書籍内 ,而該使用者可利用該手持式閱讀 = ==藏後,便能直接將該内建資訊進行讀:二 涵之多媒體影音與擴增實境物件的說明資料。顯不其内 15_如申請專利範圍第13項所述之手 其中該識別標籤資料可包含有一伺服器2信賣::方法’ 路資源位址值,而該方法更包含下列步驟:5 —網際網 18 200937278 該手持式閱讀輔助根據該伺服器位址值或網際網路 源位址值於連線狀態下將該說明資料加以下載;以及 該使用者可利用該手持式閱讀輔助裴置對所下 說明資料進行讀取。 16.如申請專利範圍第13項所述之手持式閱讀辅助 =該祠服器係含有-資料庫,可提供該平面書籍的說明 ^如申請專利範圍第U項所述之手持式閱讀輔助方法, 其中忒說明貧料之格式可為影像檔格式' ❹ ❹ 片權格式、文字棺格式、擴增實境物件槽格:匕, 文件標、伺服器位址資料或-網際網路資源位料 18.如申請專利範圍第17項所述之手貝抖格式。 其中該說明資料之格式為影像檔格式:;音 用者可藉由手持式閱讀輔助裝置播放該 :寺」使 了解該平面書籍内容;而該說明資料 =9而能夠 檔格式時,使用者可藉由手持式閱笋鳊 檔格式或文字 資料之圖片或文字而能夠了解該平:裝置顯示該說明 料之格式為擴增實境物件格式檔格=二,資 式閱讀輔助裝置顯示之擴增實境物 I用者可藉由手持 籍内容;該說明資料之格式為標籤组二以了解該平面書 用者可藉由手持式閱讀輔助裝置所;:的格式時,使 片、聲音與擴增實境物件等說明内容二、4像、文字、圖 容;該標籤語言文件亦可為一伺服11 了解該平面書籍内 資源位址值,使用者可藉由手持^ =址值或一網際網路 連結,並自該伺服器下載說明資料至】辅助裝置與伺服器 置中’以了解該平面書籍内容。 δ玄手持式閱讀輔助裝 19200937278 X. The scope of application for patents: [Scope of application for patents] ^The second hand reading aid system' contains: There are multiple identification tags in the identification tag, and each car name: an identification tag is recorded. Data; sub-holding auxiliary button w, in the hand-held reading aid device, and having a ^ ^ for use by a user, the identification light mine is divided into a reader, the identification tag M f ^ can be read ;;,戎Hand-held reading aid device according to the identification ❹ ❹: to process the multimedia image, text or amplify the real brothers in the hand-held 闽 结 # # & & & & & & & & & & & & & : On and through the handheld reading, the connection data can be further connected to the server via the wireless network according to the identification tag data; and the device - 2:: 夕:t is read by the wireless network and the handheld reading The auxiliary S f ΐ m ii enables the user to download from the server the description of the Beco-to-feed reading aid for reading. 2. The digital handheld reading assistant Li ί reading assistant as described in the first paragraph of the patent application scope can be used for the user-handheld Device, a phone call or a number of assistants crying. The book in the plane can be a book 3. As described in the first item of the patent scope: Miscellaneous Φ Titanium; Old Miscellaneous # * am Holding Reader System, ==:::Γ ΐ Multiple Identification Marks Text:: Each skill: ^: The standard of the salty system exists to further explain the plane book 4. Handheld information as described in the scope of the patent application. The identification tag can be a two-dimensional bar code tag type 'its radio frequency identification tag. Not iron or a wireless 5. In the handheld device described in claim 1, the identification tag data includes a description of the plane ^ = system, and the user can use the handheld reading assistant After the reader reads the 16 200937278 identification tag, the built-in information can be directly read, recognized, and then decoded by the handheld reading assistant and its connotation is displayed. Description of multimedia audio and audio and augmented reality objects. 6 scholars apply for a patent (four)! The hand-held reading aid system described in the item may include a server address value or an internet poor source address value, and the server address value represents the server. The connection address on the Internet, and the Internet resource address value represents the server on the Internet I. #料·i I β #一四丨不峪. I have recorded the information address of the 3 5 Hai Qiang books. The hand-held reading aid system described in the Japanese Patent Application Serial No. 1-2, wherein the handheld reading aid device provides the user with a view on the Internet. = Handheld reading aid system as described in item 1, w: image file format, sound file format, wafer: file 2: file format, augmented reality object file format, label language text 9 Data or an Internet resource address data format. 9. A φ 兮埒昍 刺 & 所述 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从 从The format of the image-based format-reading auxiliary device can be used to broadcast the data slot format, and the manner of the hand-sounds can be described as the video of the bedding material and can be used as the film or sound. The format of the data is the picture slot format or the two-reading;: help system, the display on the auxiliary device can be provided, and the content of the description is provided by hand. The way in which Wang Xian pictures or texts 11· The format of the explanatory materials in the hands mentioned in item 8 of the patent application scope is the augmented reality object::: The auxiliary device can use the computer to draw stereoscopically: The scope of the application for patents is as stated in item 8: the content of the second month. In the format of the description data A; α 'reading assistant system, in the format of the 祆 祆 祆 浯 文件 file file format, the hand-held reading 17 200937278 reading aid can interpret the label language file, and further label language files required The image, text, picture, sound, and augmented reality are integrated and simultaneously present the description content on the handheld assist device. 13·- Handheld reading aid method, applied to the handheld reading aid system. The handheld reading aid system includes a --table book, a handheld m with a reader, and a server. And the method comprises the following steps: a thinning device ❹ ❹: the user uses the identification tag of the flat book of the handheld reading auxiliary device to read and read; the tag in the tag identifies the tag data; The hand-held reading aid device is processed according to the knowledge, and after the processing, the hacker touches the history, and you can see the multimedia image, the text or the augmented reality object on the _Fengyu reading auxiliary device, and Through today's handcart: in the hand-held sound; more than 4 hand-held follow-up auxiliary devices to play the outlet network r two holdings can also be based on the identification tag data and through the - benefit line network to connect and The feeding device completes the connection with each other; with ',,,, the user uses the handheld device to read the recorded information in the connected state by adding the following =° description data. Allowing the money-paying user to use the hand-held item described in item 13 of the patent application scope; the JH AA ° selling assistance method': the identification mark 枓 sign contains a description of the book in the plane The user can use the handheld reading === after hiding, the built-in information can be read directly: the description of the multimedia video and the augmented reality object of the second culvert. If the identification label data can include a server 2 transaction:: method 'road resource address value, and the method further includes the following steps: 5 — Internet 18 200937278 The handheld reading aid downloads the description data in a connected state according to the server address value or the internet source address value; and the user can utilize the handheld reading auxiliary device pair The information described below is read. 16. The hand-held reading aid as described in claim 13 of the patent application scope=the server device contains a data library, and the description of the plane book can be provided. ^ The hand-held reading assistant method as described in claim U of the patent scope , where 忒 indicates that the format of the poor material can be the image file format ' ❹ 片 权 格式 、 、 、 、 、 、 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增 扩增18. The hand-shake format described in claim 17 of the patent application. The format of the description data is the image file format: the user can play the "the temple" by the handheld reading aid device to make the content of the flat book understand; and the description data = 9 can be formatted, the user can The flat can be understood by the hand-held reading format or the picture or text of the text data: the device displays the format of the explanatory material as the augmented reality object format file=2, and the amplification of the reading aid display device The user of the physical object I can use the content of the handheld; the format of the description data is the label group 2 to understand that the plane book user can use the format of the handheld reading auxiliary device to make the film, the sound and the expansion Adding physical objects and other descriptions 2, 4 images, texts, and drawings; the tag language file can also be a servo 11 to understand the value of the resource address in the flat book, and the user can hold the ^=address value or an internet Network link, and download the description data from the server to the [assisting device and server centered] to understand the contents of the flat book. δ Xuan hand-held reading aids 19
TW97107164A 2008-02-29 2008-02-29 Assisted reading system and method utilizing identification label and augmented reality TW200937278A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW97107164A TW200937278A (en) 2008-02-29 2008-02-29 Assisted reading system and method utilizing identification label and augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW97107164A TW200937278A (en) 2008-02-29 2008-02-29 Assisted reading system and method utilizing identification label and augmented reality

Publications (1)

Publication Number Publication Date
TW200937278A true TW200937278A (en) 2009-09-01

Family

ID=44867013

Family Applications (1)

Application Number Title Priority Date Filing Date
TW97107164A TW200937278A (en) 2008-02-29 2008-02-29 Assisted reading system and method utilizing identification label and augmented reality

Country Status (1)

Country Link
TW (1) TW200937278A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI423180B (en) * 2009-12-04 2014-01-11 Univ Hungkuang Method and system of recording and broadcasting interactive data
TWI493473B (en) * 2011-12-28 2015-07-21 英特爾股份有限公司 Alternate visual presentations
CN111625092A (en) * 2020-05-18 2020-09-04 广东电网有限责任公司 Archive consulting system, method, computer device and storage medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI423180B (en) * 2009-12-04 2014-01-11 Univ Hungkuang Method and system of recording and broadcasting interactive data
TWI493473B (en) * 2011-12-28 2015-07-21 英特爾股份有限公司 Alternate visual presentations
CN111625092A (en) * 2020-05-18 2020-09-04 广东电网有限责任公司 Archive consulting system, method, computer device and storage medium

Similar Documents

Publication Publication Date Title
US20030024975A1 (en) System and method for authoring and providing information relevant to the physical world
Vazquez et al. Serendipitous language learning in mixed reality
CN102098078A (en) Data transmission apparatus and method
WO2014154097A1 (en) Automatic page content reading-aloud method and device thereof
US20150091823A1 (en) Printed article
KR20210001412A (en) System and method for providing learning service
US20140278961A1 (en) Information processing device and program
CN106789551A (en) Conversation message methods of exhibiting and device
CN104978875A (en) Multi-functional intelligent teaching system
JP2007174227A (en) Motion picture distribution system through two-dimensional bar code seal
JP5374943B2 (en) Content acquisition system
TW200937278A (en) Assisted reading system and method utilizing identification label and augmented reality
CN111859970B (en) Method, apparatus, device and medium for processing information
JP2003319033A (en) Portable communication terminal information input system, portable communication terminal, program therefor, analysis server, and portable communication terminal information input method
JP3253946B2 (en) Information provision / collection system
KR20120006312A (en) Location based augmented reality contents data sharing system and method using mobile device
US20220311527A1 (en) Broadcasting contextual information through modification of audio and video interfaces
TWM413920U (en) Assisted reading system utilizing identification label and augmented reality
EP2300895B1 (en) Associating input with computer based content
JP2005107978A (en) Information retrieving device using information terminal with photographing function and information retrieving method
KR20130113218A (en) A electronic note function system and its operational method thereof
TWM463394U (en) Digital reference book learning system
KR102572028B1 (en) Task automation system and method for ordering wish books
KR20130123032A (en) System and method for providing exhibition service
WO2022210336A2 (en) Broadcasting contextual information through modification of audio and video interfaces