WO2007034486A2 - Dispositif adaptable et systeme permettant de fournir une interface de support lançant un document educatif - Google Patents

Dispositif adaptable et systeme permettant de fournir une interface de support lançant un document educatif Download PDF

Info

Publication number
WO2007034486A2
WO2007034486A2 PCT/IL2006/001109 IL2006001109W WO2007034486A2 WO 2007034486 A2 WO2007034486 A2 WO 2007034486A2 IL 2006001109 W IL2006001109 W IL 2006001109W WO 2007034486 A2 WO2007034486 A2 WO 2007034486A2
Authority
WO
WIPO (PCT)
Prior art keywords
interface
symbols
provides
sheets
sheet
Prior art date
Application number
PCT/IL2006/001109
Other languages
English (en)
Other versions
WO2007034486A3 (fr
Inventor
William Krukowski
Amram Rubin
Original Assignee
Edu-Barkai
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Edu-Barkai filed Critical Edu-Barkai
Publication of WO2007034486A2 publication Critical patent/WO2007034486A2/fr
Publication of WO2007034486A3 publication Critical patent/WO2007034486A3/fr
Priority to IL190374A priority Critical patent/IL190374A0/en

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/062—Combinations of audio and printed presentations, e.g. magnetically striped cards, talking books, magnetic tapes with printed texts thereon
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning

Definitions

  • the present invention relates to the field of assistive educational equipment for users such as students of all ages, including for the visually impaired and blind students. More specifically, the invention relates to a didactic interface device adapted to detect the location of touch of, for example, a user's finger on, e.g., sheets or books.
  • Braille is used, which is solely based on the sense of touch.
  • a device that provides an interface for sheets containing symbols is presented.
  • the device comprises of a sensing layer adjustable at each of the sheets, wherein the device is adapted to determine the position of touch on each of the sheets and to provide a feedback that depends on the position of the touch.
  • the sheets contain one or more symbols that impart content, wherein data representing the symbols and their positions on a sheet, is stored in the device and is modifiable.
  • the device receives the data from one of the following sources: a user of the device, an external computing device, an external database.
  • the feedback depends on the symbol touched at a certain sheet.
  • the feedback is an audio message.
  • the sensing layer comprises one of the following to determine the position of touch: a plurality of capacitance sensors, a plurality of pressure sensors, a plurality of optical sensors.
  • the device comprises an optical character recognition module that enables the device ascribing the sheets to the data stored in the device.
  • the sensing layer provides a processor with information about the coordinates of each symbol.
  • the device comprises a voice recognition module that adapts the device to receive vocal inputs and provides thereof the feedback.
  • the sensing layer is substantially transparent, thereby enabling setting the sensing layer on top of one of the following: a sheet, an electronic display.
  • the device is adapted to identify location of touch on Braille.
  • the device further comprises one or more sensors, wherein the device is adapted to analyze data received from the sensor(s). hi embodiments of the invention, the device is adapted to perform statistics about a performance of a student. In embodiments of the invention, the device is adapted to provide data representing the statistics substantially in real-time to an external computing device.
  • the device further comprises a wizard application for guiding an instructor through the creation of the interactive content of the device according to a given textbook.
  • the wizard application includes the process of analyzing educational material of the textbook in accordance with didactic rules; creating updated content in accordance with the analysis; and updating the content to the device.
  • analyzing of the educational material includes creating hierarchical order of the material; identifying main ideas; and defining of the educational material.
  • the process of creating new updated content includes creating exercises adapted to different levels of the educational materials.
  • Fig. 1 is a schematic illustration of a didactic interface device adapted to detect location of touch on a medium, according to an embodiment of the invention
  • Fig. 2 is a schematic of the didactic interface device adjusted to a sheet of the medium according to an embodiment of the invention
  • Fig. 3 is a schematic illustration of a block diagram of the didactic interface device according to an embodiment of the invention
  • Fig. 4a is a schematic flowchart illustration of a method to implement a wizard application that guides an instructor to organize educational content of a textbook in device
  • Fig. 4b is a schematic flowchart illustration of a method of analyzing educational material, according to an embodiment of the invention.
  • the purpose of the present invention is to provide a didactic interface device (hereinafter referred to as "device") that is mobile and modular and helps improving the learning process of languages, sciences, mathematics and the like for students including the visually impaired.
  • the device may be adjusted at media depicting symbols representing contents. Such media may include, for example, sheets of books, magazines, newspaper and the like, electronic displays such as computer monitors and the like.
  • the device is adapted to stimulate during the learning process a plurality of senses, such as, e.g., sight, hearing and touch, of a student. As a result, his/her attention, ability to learn, comprehend and retain information may be substantially improved.
  • the device may detect tactile pressure applied on a sheet by the student, and produce as a result thereof a suitable audible message, which may have educational content, as will be outlined in detail below.
  • a suitable audible message which may have educational content, as will be outlined in detail below.
  • Methods of the present invention may be implemented by performing or completing manually, automatically, or a combination thereof, selected steps or tasks.
  • the term "method” refers to manners, means, techniques and procedures for accomplishing a given task including, but not limited to, those manners, means, techniques and procedures either known to, or readily developed from known manners, means, techniques and procedures by practitioners of the art to which the invention belongs.
  • the descriptions, examples, methods and materials presented in the claims and the specification are not to be construed as limiting but rather as illustrative only.
  • calculating,” “determining,” “establishing”, “analyzing”, “checking”, or the like may refer to operation(s) and/or process(es) of a computer, a computing platform, a computing system, or other electronic computing device, that manipulate and/or transform data represented as physical (e.g., electronic) quantities within the computer's registers and/or memories into other data similarly represented as physical quantities within the computer's registers and/or memories or other information storage medium that may store instructions to perform operations and/or processes.
  • Any publications, including patents, patent applications and articles, referenced or mentioned in this specification are herein incorporated in their entirety into the specification, to the same extent as if each individual publication was specifically and individually indicated to be incorporated herein.
  • citation or identification of any reference in the description of some embodiments of the invention shall not be construed as an admission that such reference is available as prior art to the present invention.
  • Fig. 1 schematically illustrates a didactic interface device 100 adapted to detect location of touch on a medium 200, according to an embodiment of the invention
  • Fig. 2 schematically illustrates the didactic interface device 100 adjusted to a sheet of medium 200, according to an embodiment of the invention.
  • the didactic interface device hereinafter referred to as "device", 100 may include a sensing layer 110 adapted to detect and/or locate touch of, e.g., the finger of the student, e.g., as known in the art.
  • sensing layer 110 may comprise an array of pressure sensors enabling detection and/or location of pressure because of touch.
  • sensing layer 110 may include one or more capacitance sensors laid out along the horizontal and vertical axis of sensing layer 110. Such capacitance sensors enable locating touch of, e.g., a finger, according to a pattern of capacitance.
  • sensing layer 110 may be implemented with one or more optical sensors that are adapted, for example, to locate, light of a pointing device, such as a laser pointer.
  • Other implementations of sensing layers 110 are possible as, e.g., known in the art.
  • device 100 Upon suitable adjustment of device 100 on a sheet of medium 200, which may be, for example, a book, device 100 is adapted to match data stored in device 100 with location of touch on the sheet. The data may represent information that corresponds to the content depicted on the sheet at said location, as will be outlined below.
  • device 100 may include, in addition to sensing layer 110, a loudspeaker 120, a microphone 130, a processor 140, and a voice recognition module 160, a communication port 170, a display 175 and a storage 180, all of which may be operatively associated with a power supply 150.
  • Storage 180 may store therein data representing, for example, educational content matching educational content of one or media such as books, magazines, sheets, electronic display device and the like.
  • the educational content in the media may be imparted by using symbols such as, e.g., characters, illustrations, words and the like.
  • the data may further represent information about the location of each symbol on the media. Accordingly, when device 100 is suitably adjusted behind, for example, a sheet of media 200, as schematically illustrated in Fig. 1, said device 100 is adapted to identify the word on which the student has pressed on said sheet.
  • processor 140 may run instructions 181 resulting in an application 190 that, inter alia, may sound an audible feedback that corresponds to said word, via loudspeaker 120.
  • device 100 may produce an audible message pronouncing the word “choir” over loudspeaker 120, such that the student will hear the correct pronunciation.
  • loudspeaker 120 is included in device 100.
  • loudspeaker 120 may be connected externally to device 100. It is to be understood that the present invention is not limited to the application of recognizing words on a sheet, as illustrations, letters, numbers and the like, may also be identifiable by application 190.
  • device 100 may be adapted to check whether the student pronounces a word substantially correct and/or whether the student gives the correct answer to a question provided by device 100.
  • processor 140 may run instructions 181 resulting in application 190 that provides, inter alia, the student with a question.
  • the question may be sounded over loudspeaker 120.
  • the student may provide an answer over microphone 130 and application 190 in conjunction with voice recognition module 160 may subsequently process the answer.
  • application 190 may check whether the answer is correct or not and provide the student with a suitable feedback via, e.g., loudspeaker
  • application 190 may sound the sentence:
  • a suitable input device 198 which may be, for example, a keyboard, push buttons, a pointing device, sensing layer 110, and the like.
  • application 190 may perform statistics about the student's performance. For example, application 190 may determine a grade for the student based on the answers received by him/her. Furthermore, the student's statistics, such as the grade, may be sent substantially in real-time, to external computing device 300, where it can be viewed by, e.g., an instructor.
  • application 190 may check in conjunction with voice recognition module 160, whether the student's pronunciation of a word, such as the word "choir", is substantially correct, and provide the student with a suitable feedback.
  • data in storage 180 may be updated, for example, according to content of various books, sheets and the like.
  • storage 180 may initially store data representing content of a first book. Therefore, the student may use device 100 only in conjunction with said first book. However, the student may alter and/or update the data stored in storage 180 with new data representing, for example, content and/or name of a second book, and the like, such that the student may use device 100 in conjunction with said second.
  • Updating storage 180 may be accomplished by connecting device 100 via communication port 170 to, for example, external computing device 300 using a network such as, for example, a wide area network (WAN), local area network (LAN), a global communication network, e.g., the Internet, a wireless communication network such as, for example, a wireless LAN (WLAN) communication network, a wireless virtual private network (VPN), a Bluetooth network, a cellular communication network, for example, a 3rd Generation Partnership Project (3 GPP), such as, for example, a Global System for Mobile communications (GSM) network, a Wideband Code Division Multiple Access (WCDMA) cellular communication network, a Frequency Domain Duplexing (FDD) network, and the like.
  • a network such as, for example, a wide area network (WAN), local area network (LAN), a global communication network, e.g., the Internet, a wireless communication network such as, for example, a wireless LAN (WLAN) communication network, a wireless virtual private network (VPN),
  • External computing device 300 may be, for example, a PDA device that incorporates a wireless communication device, a tablet computer, a server computer, a personal computer, a cellular radio-telephone communication system, a cellular telephone, a Personal Communication Systems (PCS) device, a wireless modem, a wireless communication device, a wireless Access Point (AP), a modem, a transmitter, a receiver, a transceiver, a transmitter-receiver, a wireless communication station, a mobile computer, a notebook computer, a desktop computer, a laptop computer a Personal Digital Assistant (PDA) device, a server and the like.
  • PDA Personal Digital Assistant
  • device 100 does not have to be operatively associated with external computing device 300 in order to be able to provide the student a suitable interface.
  • device 100 may be updated by, e.g., the student, with the new data using input device 198, which may be, for example, a keyboard, a push button, a pointing device and the like.
  • input device 198 may be, for example, a keyboard, a push button, a pointing device and the like.
  • processor 140 may run instructions 181 resulting in an application 190 that enables, inter alia, audible conveyance of a portion or the entire content of, e.g., text of a page, text depicted on a
  • the student may suitably adjust device 100 on a page of media 200.
  • device 100 may impart the student with the content of the page.
  • the present invention may improve the learning process for students suffering of visual impairment, by integrating a Braille recognition module (not shown) into the device.
  • a Braille recognition module (not shown) into the device.
  • device 100 may be suitably positioned behind or in front of a sheet of Braille.
  • the device may identify the location of touch on the Braille and generate a corresponding audible signal and/or message. For example, if the student touches Braille representing the word "choir", application 190 may generate an audible output of the word "choir” via loudspeaker 120.
  • sensing layer 110 may be substantially transparent. Therefore, device 100 may be placed on top of, for example, media depicting symbols. For example, device 100 may be placed on top of an electronic display, a sheet, and the like, and the symbols depicted on said media may still be readable due to sensing layer's 110 substantial transparence. Accordingly, device 100 may be adapted to function as a digital book.
  • application 190 matches data stored in storage 180 with the location of touch on a sheet.
  • information about the location of the sheet e.g., which book, page number and the like has to be taken into account in addition to the touch's location/ coordinates on said particular sheet. Therefore, in some embodiments of the invention, application 190 retrieves data representing the location of the sheet like, e.g., said sheet's page number, name of book and the like, in order to obtain a correct match between a symbol on said sheet and the data in storage 180. This may be accomplished, for example, by entering the name of the book and the page number by, e.g., the student.
  • device 100 may be adapted to determine automatically the exact location of a sheet. For example, device 100 may determine automatically the page number of a particular sheet and/or in which magazine, book and the like said sheet appears. This may be accomplished, for example by tagging, each sheet, book, and the like with a specific ID such as a barcode, an RFID, color code and the like.
  • the ID of each media is stored in storage 180 in, e.g., a look-up-table (LUT), while each ID is ascribed to a certain set of data representing content of the respective media. For example, a first set of data is ascribed to the ID of a first sheet and a second set of data is ascribed to the ID of a second sheet.
  • LUT look-up-table
  • device 100 When the student adjusts device 100 properly on e.g., the first sheet, device 100 is adapted to read said first sheet's ID, and application 190 searches for a matching ID in, e.g., the LUT. If a matching ID is found, application 190 provides feedback using only the first set of symbol data. Similarly, when the student adjust device 100 properly on the second sheet, device 100 reads said second sheet's ID and provides feedback using only the second set of symbol data. It is therefore avoided that, for example, application 190 refers to data of the first sheet, while device 100 is actually adjusted on the second sheet.
  • reading the ID of books, sheets and the like may be accomplished by, e.g., an optical character recognition
  • OCR OCR
  • Processor 140 in conjunction with OCR module 195 may perform instructions 181 resulting in application 190 that, inter alia, reads the ID and looks for a matching ID in storage 180.
  • Application 190 and/or OCR module 195 may utilize various image processing algorithms, e.g., as known in the art.
  • OCR module 195 may utilize a vector algorithm that enables comparison between images captured at different angles.
  • application 190 may provide the student with the information about said book, such that the student can verify that the book was indeed identified correctly by application 190.
  • device 100 may provide the student with information, feedback and the like using voice via loudspeaker 120, display of message on display 175, or any combination thereof.
  • application 190 may receive information about the ID of a book, a page number of a sheet and the like via voice recognition module 160.
  • a user such as, e.g., the student, may speak into microphone 130 the name of a certain book, title of a paper, page number, a book's ID number and the like.
  • the information provided by the student is then processed by voice recognition module 160.
  • Application 190 may use the information processed by voice recognition module 160 in order to determine, which set of data to use to provide a suitable interface to the student.
  • voice recognition module enables 160 enables application 190 to recognize verbal commands spoken by the student and to provide feedback to said commands.
  • This feature may, for example, enable device 100 to recognize the name of the paper, document, or book, as well as to perform functions like, inter alia, "Read”, “Next Page”, and "Off'.
  • voice recognition module 160 enables application 190 to perform voice-editing features. For example, a text recorded by the student may be edited, cut and/or replaced.
  • voice recognition module 160 may enable application 190 to provide the student with, inter alia, a translation of a recorded message.
  • input device 198 enables controlling operating parameters of device 100 such as the audio volume, operating mode ("ON/OFF”) and the like.
  • device 100 may be included in an information kiosk (not shown), which may be located, for example, indoors in a shopping mall, airport terminal, train station, and the like; or outdoors at, for example, a street corner, a bus station and the like.
  • an information kiosk may provide useful information such as, for example, geographic information in form of an audible message because of touch on sensing layer 110.
  • a user which may be for example a blind person, get information about, for example, the nearest coffee shop; a bus station such as bus line; type of shops at each floor of the shopping mall; and the like, by suitably touching sensing layer 110 at the information kiosk.
  • the information may be in the form of an audible message.
  • device 100 may be adapted or may include on or more sensors (not shown) and may analyze data representing, for example, chemical reports, received from said sensor(s).
  • sensing layer 110 may be sensitive enough such that touch on sheets having various thicknesses is registered.
  • various applications such as windows XP, MS-Office and the like, may be uploaded to storage 180.
  • FIG. 4a schematically illustrates a method of a flowchart of a wizard application guiding an instructor to organize educational content of a textbook in device 100.
  • application 190 may provide, inter alia, the application wizard.
  • the wizard application may be provided, for example, by external computing device 300.
  • the wizard application guides the instructor through the creation of interactive content of the device according to a given textbook.
  • the wizard application performs various steps, as indicated hereinafter with reference to boxes 410- 430.
  • the method implemented by the wizard application may include, for example, the step of analyzing educational material of said textbook in accordance with didactic rules.
  • the method implemented by the wizard application may include, for example, the step of creating updated content in accordance with said analysis. Creating updated content may include, for example, creating exercises adapted to different severity levels of the educational materials. As indicated by box 430, the method implemented by the wizard application may include, for example, the step of updating the content to the device 100.
  • Fig. 4b schematically illustrates a method of analyzing educational material, according to an embodiment of the invention.
  • the method of analyzing educational material may include, for example, the step of creating hierarchical order of the material by application 190.
  • the method of analyzing educational material may include, for example, the step of identifying main ideas by application 190.
  • the method of analyzing educational material may include, for example, the step of defining of the educational material by application 190.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Human Computer Interaction (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

La présente invention concerne un dispositif (100) qui fournit une interface pour des feuilles contenant des symboles, ce dispositif (100) comprenant: une couche de détection (110) réglable au niveau de chacune de ces feuilles, ce dispositif (100) étant conçu pour déterminer la position de saisie de chacune de ces feuilles et pour fournir une rétro-information qui dépend de la position de saisie tactile, ces feuilles contenant un ou plusieurs symboles qui lancent un contenu, des données représentant ces symboles et leur position sur une feuille étant stockées dans le dispositif (100) et étant modifiables.
PCT/IL2006/001109 2005-09-22 2006-09-21 Dispositif adaptable et systeme permettant de fournir une interface de support lançant un document educatif WO2007034486A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
IL190374A IL190374A0 (en) 2005-09-22 2008-03-23 Adaptable device and system to provide an interface for media imparting educational material

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US71919005P 2005-09-22 2005-09-22
US60/719,190 2005-09-22

Publications (2)

Publication Number Publication Date
WO2007034486A2 true WO2007034486A2 (fr) 2007-03-29
WO2007034486A3 WO2007034486A3 (fr) 2008-01-24

Family

ID=37889252

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2006/001109 WO2007034486A2 (fr) 2005-09-22 2006-09-21 Dispositif adaptable et systeme permettant de fournir une interface de support lançant un document educatif

Country Status (1)

Country Link
WO (1) WO2007034486A2 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040091842A1 (en) * 2001-03-15 2004-05-13 Carro Fernando Incertis Method and system for accessing interactive multimedia information or services from braille documents
US20050256131A1 (en) * 2002-05-24 2005-11-17 Carl-Fr Coester Pharmaceutical active substance combination and the use thereof

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040091842A1 (en) * 2001-03-15 2004-05-13 Carro Fernando Incertis Method and system for accessing interactive multimedia information or services from braille documents
US20050256131A1 (en) * 2002-05-24 2005-11-17 Carl-Fr Coester Pharmaceutical active substance combination and the use thereof

Also Published As

Publication number Publication date
WO2007034486A3 (fr) 2008-01-24

Similar Documents

Publication Publication Date Title
Pal et al. Assistive technology for vision-impairments: anagenda for the ICTD community
Kadam et al. American sign language interpreter
KR102013616B1 (ko) 빅데이터 기반 언어 학습 장치 및 이를 이용한 언어 학습 방법
WO2014141414A1 (fr) Système de visualisation de processus d'apprentissage et dispositif de traitement de visualisation, et procédé de visualisation
Al-Jarf Blind Saudi Female College Students and Assistive Technologies: A Case Study.
Viner et al. Assistive technology to help students with disabilities
CN113035026B (zh) 一种盲文信息无障碍的视听触感知匹配方法
KR20120006154A (ko) 실감형 외국어 교육 시스템 및 교육방법
Zeinullin et al. Tactile audio responsive intelligent system
KR101333946B1 (ko) 스마트기기를 이용한 드로잉기법 기반의 영어 말하기 학습 기구
KR20150117985A (ko) 멀티미디어 기기를 이용한 동시통역 학습 및 교육 방법
Green et al. Keep it simple: A guide to assistive technologies
Shyyan et al. White paper on common accessibility language for states and assessment vendors
Seegers et al. Special technological possibilities for students with special needs
KR102282307B1 (ko) 영어 학습 시스템 및 그 방법
WO2007034486A2 (fr) Dispositif adaptable et systeme permettant de fournir une interface de support lançant un document educatif
JP2002268529A (ja) 学習支援方法および装置と学習支援プログラム
KR20090008654A (ko) 점자를 이용하여 온라인 학습 서비스를 제공하는 방법,시스템 및 장치
KR101739023B1 (ko) 참여형 언어 학습 서비스 제공 시스템
Sadh Assistive Technology for Students with Visual Impairments: A Resource for Teachers, Parents, and Students
KR102269090B1 (ko) 학습 시스템
WO2016159064A1 (fr) Système d'assistance à l'apprentissage de prise de notes, dispositif d'assistance à l'apprentissage de prise de notes, procédé d'assistance à l'apprentissage de prise de notes, et support d'enregistrement lisible par ordinateur
KR102497994B1 (ko) 티치던트 학습법의 구현을 위한 학습단말기 및 그 제어방법
KR100816378B1 (ko) 대표단어 발음을 이용한 영어발음 학습방법
Ramsamy-Iranah et al. Assistive Technologies: Inclusive Teaching Guidelines for Educators

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 190374

Country of ref document: IL

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06780497

Country of ref document: EP

Kind code of ref document: A2