WO2016165024A1 - Braille instruction system and method - Google Patents

Braille instruction system and method Download PDF

Info

Publication number
WO2016165024A1
WO2016165024A1 PCT/CA2016/050437 CA2016050437W WO2016165024A1 WO 2016165024 A1 WO2016165024 A1 WO 2016165024A1 CA 2016050437 W CA2016050437 W CA 2016050437W WO 2016165024 A1 WO2016165024 A1 WO 2016165024A1
Authority
WO
WIPO (PCT)
Prior art keywords
braille
cell
user
housing
simulator
Prior art date
Application number
PCT/CA2016/050437
Other languages
French (fr)
Inventor
James ANDRADE
Logan MAIER
Isabel NEUFELD
Jenna PEZZACK
Sebastian VILLATE
Rhys BINNIE
Disha PRASHAR
Sean LLOYD
Sammy EMAMIAN
Justin PEZZACK
Lisa ANDRADE
Tony Maier
Vera COTTURO
Original Assignee
Andrade James
Maier Logan
Neufeld Isabel
Pezzack Jenna
Villate Sebastian
Binnie Rhys
Prashar Disha
Lloyd Sean
Emamian Sammy
Pezzack Justin
Andrade Lisa
Tony Maier
Cotturo Vera
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Andrade James, Maier Logan, Neufeld Isabel, Pezzack Jenna, Villate Sebastian, Binnie Rhys, Prashar Disha, Lloyd Sean, Emamian Sammy, Pezzack Justin, Andrade Lisa, Tony Maier, Cotturo Vera filed Critical Andrade James
Publication of WO2016165024A1 publication Critical patent/WO2016165024A1/en

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/02Devices for Braille writing
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001Teaching or communicating with blind persons
    • G09B21/003Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays

Definitions

  • This disclosure relates to a system and method for instructing braille.
  • refreshable braillers to date have generally focused on utilitarian educational needs rather than providing a stimulating and rewarding experience for the user.
  • an instructional system for braille includes a processor enabled device that is configured to function with a
  • the system also includes an incentive delivery device that is operated by the processor enabled device.
  • the system is configured to make learning with braille a self-directed fun and motivated interactive experience.
  • Figure 1 is a schematic perspective view of a processor enabled device and a braille simulator that includes a refreshable braille cell according to an example embodiment.
  • Figure 2 is a schematic view of a processing system that can be applied to the processor enabled device and the braille simulator of Figure 1.
  • Figures 3 and 4 illustrate perspective views of a braille cell of the braille simulator of Figure 1.
  • Figure 5 illustrates a perspective view of multiple braille simulators according to an example embodiment.
  • Figures 6 and 7 are perspective views of an example embodiment of an incentive delivery device according to an example embodiment.
  • FIG. 1 shows an example embodiment of a braille instructional system 100.
  • the system 100 includes a programmable processor enabled user equipment (UE) device 102 and a refreshable braille cell 104 connected by a communications link 106.
  • the programmable UE device 102 may for example be a smart phone, a smart watch, a laptop computer, a desktop computer, a tablet computer or other digital computing device that includes a microprocessor and digital storage that stores instructions for the microprocessor.
  • digital instructions in the form of a braille application (APP) 108 are stored on the UE device 102 that configure the device 102 to perform the functions described herein.
  • APP 108 can be loaded and installed onto the UE device 102 using any number of known methods - for example APP 108 may be downloaded to the UE device 102 through an Internet connection from a remote server.
  • programmable UE device 102 includes user input/output devices such as a touch screen 236, a microphone 110 and a speaker 112.
  • the device 102 also includes one or more short-range
  • communications interfaces such as a USB port 114 and/or a wireless interface 116 such as a BluetoothTM interface.
  • the UE device 102 is paired through short range communications interface 114 or 116 through a wired or wireless communications link 106 with a braille simulator 105 that includes the refreshable braille cell 104.
  • the braille cell 104 is configured to simulate the Marburg Medium bailie specification and includes a housing 118 having a front surface containing six dots 120 arranged as 2 parallel columns each containing three dots 120.
  • Each dot 120 comprises a cylindrical member that is individually driven by a respective actuator 122 (which may for example be a solenoid or servo) such that each dot 120 can be selectively raised from and retracted into the front surface of cell housing 118.
  • the dots 120 can be controlled to provide a tactile sensation on a user's finger tip.
  • Figure 3 illustrates the upper left dot 120 in cell 104 in a raised position with the other 5 dots in retracted positions, which corresponds to the letter "A”
  • Figure 4 illustrates the two top dots 120 in raised positions with the other 4 dots in retracted positions, which corresponds to the letter "B”.
  • cell 104 could have more than or fewer than six dots - for example an eight dot cell could be used in some applications and a four dot cell used in some applications.
  • the actuators 122 of cell 104 are controlled by a suitably programmed intermediate processing system or controller 124 such as a Raspberry PiTM or iOSTM that is part of the braille simulator 105.
  • the controller in turn communicates through communications link 106 with the APP 108 enabled programmable UE device 102.
  • the braille simulator 105 has a housing 140 that houses the braille cell 104, controller 124 and other electronic and physical components of the braille simulator.
  • Figure 2 shows a block diagram representation of a processing system 200 that could, in example embodiments, be used to implement the controller 124 of braille simulator 105.
  • the processing system 200 includes one or more controllers or digital processor units 202, a memory 204, a power source (not shown), one or more wireless communications interfaces 210 (for example one or more of a BluetoothTM interface and a WiFi interface), a wired interface such as a USB interface 212, and user interfaces 220.
  • the user interfaces 220 include various inputs/outputs (I/O) interfaces.
  • the memory 204 may include both transient and non-transient storage elements that store programming and/or instructions for the processor unit 202, including the drivers 206, applications 208 and any other software required for the functionality described herein.
  • the processor system 200 used in braille simulator 105 may, as noted above, incorporate a Raspberry PiTM or iOSTM system, or could be implemented using other suitable components.
  • User interfaces 220 may include some or all of the following : the refreshable braille cell 104, various physical user input button and/or switches 222, an accelerometer 223, one or or proximity motion sensors 224, touch pad 226, audio transducers 226 (speaker and/or microphone), vibration generator 230, air bust generator 232, additional haptic transducers 234, and a screen 236.
  • the user interfaces of the braille simulator 105 are integrated into housing 140.
  • Programmable processor enabled UE device 102A also includes a suitably configured processing system 200.
  • user interfaces 220 may include some or all of the above mentioned interface elements - for example, as noted above, in some embodiments UE device 102 includes a touch screen 236, and audio transducers 226 in the from of speaker 112 and microphone 110.
  • the non-transient storage element stores braille APP 108.
  • APP 108 configures the UE device 102 to provide signals through communications link 106 to cause dots 120 to be selectively lowered and raised to present characters to a person who has a finger placed on the cell 104.
  • the braille simulator 105 incorporating braille cell 104 has a compact design footprint similar to a USB memory stick with communication and power coming from a wired USB connection to UE device 102. This would allow the braille simulator 105 to be plugged into the device 102 and thus provide a fixed reference point for a visually impaired person using the system 100.
  • power for the Braille simulator 105 could be from a rechargeable battery or separate power supply.
  • simulators 105 that incorporate single cells 104 are configured so that they are modular in that they can be connected (snapped) together to create any length of character refreshable display.
  • four simulators 105 (each having a cell 104) cells 104 can be connected inline as shown in Figure 5 so as to be able to display short words for learning such as "feel” or "send". This would allow for the scalability of the system after the alphabet has been learned to move onto words and sentences for example.
  • This design configuration lends itself to being very flexible and portable, thus allowing learning of braille to take place anywhere.
  • each simulator 105 may include physical braille cell interconnect elements 240A/240B that include mating electrical connector plug elements 240A and 240B located on opposite sides of the simulator 105 to allow a physical and electrical signaling connection to a neighboring simulator 105.
  • the controller 124 is configured to detect when a connection is made to another simulator and communicate that information to UE device 102.
  • each simulator 105 is provided with a proximity indicator element 239 on one side surface and a corresponding braille cell proximity detector 238 located on the opposite side surface to permit detection of when a neighboring simulator is aligned .
  • the proximity indicator element 239 is a magnet and the corresponding braille cell proximity detector 238 a magnetic sensor such as a Hall- effect sensor.
  • proximity detectors 238 and indicator elements 239 can include near field communications (NFC) interfaces for use instead of or in combination with magnetic sensors to allow simulator ID
  • NFC near field communications
  • a plurality of simulators 105 have proximity sensors 238 or physical elements 238 such as connectors or contact switches that detect when a simulator 105 is arranged in-line to another simulator, and that information is communicated to UE device 102, enabling UE device 102 to determine how many and which devices are connected in line and then use that information to coordinate the operation of simulators 105 to generate words of a length that correspond to the number of connected cells.
  • multiple cells 104 may be incorporated into a single simulator 105.
  • the cell simulator 105 and cell 104 may be configured so that it can be secured to the user's finger.
  • the cell simulator 105 housing 140 can support a user's hand .
  • the housing 140 is shown as rectangular in Figure 1, the housing can alternatively have a number of different ergonomic configurations.
  • the system 100 also includes a further hardware component in the form of an incentive delivery device 150, and example of which is shown in Figures 6 and 7.
  • the incentive delivery device 150 takes the form of a treasure box that has multiple locked compartments 162 that can be selectively unlocked and opened in response to signals received from programmable UE device 102.
  • incentive delivery device 150 may have six to eight front facing doors 152 that all conceal a respective compartment 162, and a top compartment 154 that is concealed by a lid 158. Compartments 162, 154 may be preloaded with physical rewards 164. Doors 152 and lid 158 are each secured shut by a respective locking mechanism 156 (see Figure 7) that can be selectively actuated in response to signals from device 102 to unlock or open.
  • the locking mechanism 156 see Figure 7
  • locking mechanisms 156 each include a solenoid or servo that is connected to a local controller 154 (which may for example be a suitably programmed controller such as a Raspberry PiTM or iOSTM, and/or could have a a processor system 200) that in turn communicates through a wireless communications link 152 (which may for example be a BluetoothTM link) with the APP 108 enabled programmable UE device 102.
  • a local controller 154 which may for example be a suitably programmed controller such as a Raspberry PiTM or iOSTM, and/or could have a a processor system 200
  • a wireless communications link 152 which may for example be a BluetoothTM link
  • locking mechanisms 156 are electromagnetic mechanisms.
  • the programmable UE device 102, braille simulator 105 and reward incentive device 150 can be combined and configured to make learning braille, or just learning, a self-directed fun and motivated experience especially for but not limited to visually impaired children.
  • the APP 108 configures the UE device 102 to incorporate repetition, reward and fun based on video games while using the braille cell 104 along with the remote unlockable treasure box incentive delivery device 150.
  • the APP 108 is flexible in that it can be installed on a wide range of computer or mobile UE devices such as a tablet.
  • the APP 18 is based on audio input and output utilizing the UE device 102's speakers 112 and microphone 110, as well as USB connection or wireless connection 106 to output a tactile experience for the blind via the single refreshable braille cell 104 and the treasure box incentive device 150.
  • the APP 108 is configured in a modular way such that the learning of braille is made into a game with rewards that keep the user engaged and challenged, such as popular video games, so as to make learning fun.
  • Introductory levels provide for learning the alphabet but the same format can be expanded to other modules for numbers, words, and reading.
  • the treasure box/incentive delivery device 150 can come in different sizes depending on preference or where it will be used and is not mandatory in order to learn braille but enriches the experience of the student in actual tactile feedback and fun, turning learning into more of an adventure game.
  • the delivery device 150 is connected to the APP 108 enabled device 102 via wireless communication link 153 (Bluetooth) and will have either a battery pack (mobile unit) or plug in power supply (stay at home) which will allow the unlocking of drawers and compartments 152 as well as opening of the box lid 154 to reveal actual tactile objects 164 as rewards during the student's quest to learning .
  • the box will have braille on it to identify each of the compartments 162 thus also reinforcing the learning of braille.
  • programmable braille cells 104 are provided on some or all of the compartment doors 152 and lid 154.
  • the system 100 is used to teach the Braille alphabet, Braille Math, Braille music and contractions.
  • the APP 108 is based on an adventure story through which the child learns the braille alphabet by opening secret doors on the delivery system 150, exploring caves and castles where letters reveal themselves.
  • the APP 108 configures the system 102 to teach ABCs by outputting the letter aurally over speaker 112 and tactilely over cell 104 at the same time.
  • the system 102 than tests the child with a random generation of braille characters on cell 104 whereby the child then guesses the correct letter by speaking into the computer microphone 110. Speech to text software resident on the device 102 is then used to verify the child's answer.
  • the child is rewarded with virtual coins for rewards.
  • the device 120 will unlock a virtual reward such as story or a song that the child can listen to over device speaker 112.
  • the computer will unlock physical reward by releasing a door 152 on a toy treasure box 150 to reveal a real toy or tactile item related to the adventure story. This real reward incentive will motivate the child to continue to practice within the learning game and acquire more toy rewards locked in the remaining doors of the treasure box.
  • a parent or teacher prior to commencing the "Treasure Box Braille learning program", a parent or teacher would load the treasure box incentive delivery device 150 with toys 164 related to the story and then lock the device 150.
  • these toys and/or tactile items 164 could be sold in theme packs with each individual software APP 108 or specified adventure. Only the programmable device 102 can unlock the incentive delivery device 150 when learning levels are achieved.
  • Different software games can be sold or otherwise distributed with corresponding theme packs of toys (e.g . : Space Math Adventure, Pirate Adventure ABCs or Fairytale Braille Music Adventure).
  • a princess searches for her lost ring . She looks for the ring in the castle by opening secret virtual doors, and magic jewellery boxes where letters of the alphabet appear to teach the child . Only when the child achieves 1,000 coins through a series of testing, will the princess find her ring . The programmable device 102 will then unlock the treasure box door 152 or 154 to reveal the ring for the child to wear. The learning adventure is brought to life through the tactile reward 164.
  • a number of the input buttons/switches 222 provided on Braille simulator housing 140 each provide a different tactile experience to the user.
  • the housing 140 may include 5 square tactile buttons 222 arranged in a row along a face (for example the front edge face) of the simulator 105, with each button being configured with a different finger contact interface surface to each provide a unique tactile sensation (e.g . : bumpy, fuzzy, concave, convex, etc. ).
  • Physical switches such as lever switches and slider switches could also be provided on housing 140. These switches/buttons 222 allow the child/user to navigate through a storyline provided by the app 108 and adds an element of fun to the learning game (similar to a video gaming console). The user will press a specific button or switch to return to a previous letter, repeat a letter, go to the next letter, answer a test question, or claim a reward.
  • the physical input interfaces on simulator 105 such as the buttons 222 can also provide an
  • Such an alternative way for a user to provide input to the system 100 in addition to voice activation can be particularly useful in the in the case of individuals with speech disorders for whom voice input through microphone 110 may be highly unreliable.
  • the simulator 105 can also feature a motion sensor 224 placed at the top surface of the housing 140 to indicate the presence of a hand on the simulator 105 and when a child's hand is positioned correctly on the simulator 105.
  • the system 100 will generate non-visual signal (for example an audio signal like a bell) to indicate that the child is ready to begin the learning game.
  • the motion sensor 224 can also be integrated into the learning game for an element of fun and learning engagement. For example, in the learning game storyline, Pirate Captain A asks the child to make a swirling motion above the simulator to cast a spell on the dragon to move on to the next letter.
  • the simulator 105 user interfaces 220 include vibration generator 230 and air burst generator 232 to create tactile sensations such as vibrations (like a rumble pack in a gaming console for example) and air bursts.
  • vibrations like a rumble pack in a gaming console for example
  • air bursts air bursts.
  • these tactile stimulations will add a virtual element to the gamification of the software, and can be used to provide rewards and other feedback to the user.
  • UE device 102 configures UE device 102 to present information on display screen 236 in coordination with the outputs and inputs occurring at braille simulator 105.
  • the braille cell 104 physically generates the letter "A" with a single raised dot 120.
  • screen 235 displays a visual
  • representation 302 of the braille cell showing a single highlighted dot and also the actual text letter "A" 304, and an image of an item that begins with the letter "A” such as an apple.
  • Other visuals may include elements of the story/learning game (ie: Pirate Ship or Dragon image). Such features can assist a sighted person to follow the experience of a visually impaired child using the system, as well as provide visual cues for people whose level of impairment still permits some vision.
  • high contrast graphics are used when generating images on screen 236 to facilitate viewing by people with reduced vision
  • the app 108 configures UE device 102 to display information on screen 236 in compliance with the
  • each user interaction step includes simple language text to speech instruction and consistent sound cues for orientation and navigation.
  • An example app 108 described above implemented "The Treasure Box Braille" learning software to teach the Braille alphabet.
  • other learning apps or application add-ons can be introduced and downloaded to the device 102 as developed.
  • the apps/add-ons may be displayed post download the UE devices' app menu and include such topics as Braille math, Braille music and other learning games for the visually impaired (ie : animals of the jungle, space, ocean creatures, etc).
  • the user interfaces 220 of the physical reward dispensing device 150 includes a 3D printer, indicated in Figure 6 as phantom line 305 .
  • a 3D printer 305 could be inside of the
  • "treasure box” device 150 and controlled by UE device 102 to print 3D rewards for the child .
  • the pre-programmed printer rewards will correspond to the learning game (ie: pirate adventure) whereas the child can redeem a pirate's ring or dragon figurine for completing a learning level.
  • the flexibility of 3D technology will be beneficial as future learning apps are added to system 100. Such as, if the child is learning about animals in the jungle, 3D printed animal figurines can be used as rewards.
  • the system 100 also includes a remotely hosted feature that can be accessed by multiple users who can explore the learning game and gain rewards together. Moreover, sighted and blind siblings can play the learning game together as well . Often blind children are isolated in mainstream schools, and so multi-player online versions of the system can connect multiple blind children online which builds their community and social network.
  • simulators 105 can be configured such that a plurality simulators can be arranged in-line to spell words.
  • simulators 105 are enabled for wireless communication through NFC or Bluetooth, for example, and are provided with proximity sensors 238 (which as noted above may include magnetic or other sensors) that enable each simulator 105 to detect when it is arranged in-line with one or more other simulators 105, and communicate that information through communications link 116 to UE device 104.
  • proximity sensors 238 which as noted above may include magnetic or other sensors
  • enabling the simulators 105 to be moved and rearranged can provide additional stimulation to a user.
  • APP 108 may configure UE device 104 to cause the plurality of cells
  • the UE device 104 may audibly instruct the user to arrange the simulators 105 in as many different word-spelling configurations as possible within a given time frame, and provide user feedback for combinations that result in correct words.
  • configurations that facilitate multiple refreshable braille cells 104 to be arranged in-line allows for graduated learning by the user from Level 1 braille to Level 2 braille and so on. Young children who have learned the braille alphabet and basic math can then connect a new multiple refreshable cell device to learn words and possibly short sentences.
  • the system 100 can be expanded to adapt to the child's advancing learning needs.
  • the user interfaces 220 of simulator 105 may also include an acceromoter 223, touch pad 226 and haptic transducers 234.
  • an accelerometer 223 may allow a user to provide input by moving the entire simulator 105.
  • a touch pad 226 on the face of the simulator can also allow for a variety of interactions useful for the user experience.
  • a variety of different haptic transducers 234 may be incorporated into system 100 to provide tactile experiences to the user.
  • a haptic joy stick or control stick could be provided on housing 140 that provides force feedback on a user's hand or finger and also functions as an input device.
  • a wearable arm pad or other device including a haptic feedback matrix or grid could be included with system 100.
  • some or all of the functionality of UE device 102 is incorporated into the braille simulator 105 such that the braille simulator 105 can operate as a standalone device (or in concert with other simulators 105).
  • a braille instructional system comprising a refreshable braille cell having an array of dots that can be selectively actuated to provide tactile feedback to a user.
  • Instructions are stored on a non-transitory medium for configuring a programmable device to interact over a communications link with the braille cell.
  • the instructions configure the device to: cause the braille cell to generate tactile outputs; receive, through a user input interface of the device, user responses that correspond to the tactile outputs; and provide one or more rewards when the received responses meet one or more thresholds.
  • a reward may be in the form of an aural output over a speaker driven by the programmable device.
  • one or more of the rewards comprise virtual coins.
  • the system also includes an incentive delivery device that comprises a plurality of physical compartments that can be selectively opened or unlocked in response to signals from the programmable device, and providing one or more rewards includes causing one or more of the physical compartments to open or unlock.
  • the instructions further configure the programmable device to generate an aural output over a speaker and cause the braille cell to generate a tactile output corresponding to the aural output.
  • the present disclosure is described, at least in part, in terms of methods, a person of ordinary skill in the art will understand that the present disclosure is also directed to the various components for performing at least some of the aspects and features of the described methods, be it by way of hardware components, software or any combination of the two. Accordingly, the technical solution of the present disclosure may be embodied in the form of a software product.
  • a suitable software product may be stored in a pre-recorded storage device or other similar non-volatile or non-transitory computer readable medium, including DVDs, CD-ROMs, USB flash disk, a removable hard disk, or other storage media, for example.
  • the software product includes instructions tangibly stored thereon that enable a processing device (e.g ., a personal computer, a server, or a network device) to execute examples of the methods disclosed herein.
  • systems, devices and processes disclosed and shown herein may comprise a specific number of elements/components
  • the systems, devices and assemblies could be modified to include additional or fewer of such elements/components.
  • any of the elements/components disclosed may be referenced as being singular, the embodiments disclosed herein could be modified to include a plurality of such elements/components.
  • the subject matter described herein intends to cover and embrace all suitable changes in technology.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An instructional system for braille includes a processor enabled device that is configured to function with a refreshable braille cell. In some example embodiments the system also includes an incentive delivery device that is operated by the processor enabled device. In example embodiments the system is configured to make learning with braille a self-directed fun and motivated interactive experience.

Description

BRAILLE INSTRUCTION SYSTEM AND METHOD
This application claims the benefit of and priority to US Provisional Patent Application No. 62/148,469, filed April 16, 2015, the contents of which are incorporated herein by reference.
BACKGROUND
[0001] This disclosure relates to a system and method for instructing braille.
[0002] Sighted children enjoy a myriad of commercial computer learning games; however, there is a lack of such learning games for the blind, even to teach basic reading and math skills. Learning technology lags behind that of mainstream for the blind population. Of 35 million people worldwide who are blind (1.5 million under the age of 21), only 10% can read braille - a literacy crisis exists. Refreshable braillers are cost prohibitive for most families to afford.
Furthermore, refreshable braillers to date have generally focused on utilitarian educational needs rather than providing a stimulating and rewarding experience for the user.
[0003] There is a need for an affordable and engaging refreshable braille device that can be used to instruct children.
SUMMARY
[0004] According to example embodiments, an instructional system for braille includes a processor enabled device that is configured to function with a
refreshable braille cell. In some example embodiments the system also includes an incentive delivery device that is operated by the processor enabled device. In example embodiments the system is configured to make learning with braille a self-directed fun and motivated interactive experience. BRIEF DESCRIPTION OF DRAWINGS
[0005] Reference will now be made, by way of example, to the accompanying drawings which show example embodiments of the present description, and in which :
[0006] Figure 1 is a schematic perspective view of a processor enabled device and a braille simulator that includes a refreshable braille cell according to an example embodiment.
[0007] Figure 2 is a schematic view of a processing system that can be applied to the processor enabled device and the braille simulator of Figure 1.
[0008] Figures 3 and 4 illustrate perspective views of a braille cell of the braille simulator of Figure 1.
[0009] Figure 5 illustrates a perspective view of multiple braille simulators according to an example embodiment.
[0010] Figures 6 and 7 are perspective views of an example embodiment of an incentive delivery device according to an example embodiment.
DETAILED DESCRIPTION
[0011] Example embodiments are presented in this description of a braille instructional system that has been designed by children for use by blind children, however the system could also be used by sighted children and by adults. In this regard, Figure 1 shows an example embodiment of a braille instructional system 100. The system 100 includes a programmable processor enabled user equipment (UE) device 102 and a refreshable braille cell 104 connected by a communications link 106. In an example embodiment, the programmable UE device 102 may for example be a smart phone, a smart watch, a laptop computer, a desktop computer, a tablet computer or other digital computing device that includes a microprocessor and digital storage that stores instructions for the microprocessor. In an example embodiment, digital instructions in the form of a braille application (APP) 108 (see Fig . 2) are stored on the UE device 102 that configure the device 102 to perform the functions described herein. In example embodiments, APP 108 can be loaded and installed onto the UE device 102 using any number of known methods - for example APP 108 may be downloaded to the UE device 102 through an Internet connection from a remote server.
[0012] In an example embodiment, programmable UE device 102 includes user input/output devices such as a touch screen 236, a microphone 110 and a speaker 112. The device 102 also includes one or more short-range
communications interfaces such as a USB port 114 and/or a wireless interface 116 such as a Bluetooth™ interface.
[0013] The UE device 102 is paired through short range communications interface 114 or 116 through a wired or wireless communications link 106 with a braille simulator 105 that includes the refreshable braille cell 104. In the illustrated embodiment the braille cell 104 is configured to simulate the Marburg Medium bailie specification and includes a housing 118 having a front surface containing six dots 120 arranged as 2 parallel columns each containing three dots 120. Each dot 120 comprises a cylindrical member that is individually driven by a respective actuator 122 (which may for example be a solenoid or servo) such that each dot 120 can be selectively raised from and retracted into the front surface of cell housing 118. Thus, the dots 120 can be controlled to provide a tactile sensation on a user's finger tip. By way of example, Figure 3 illustrates the upper left dot 120 in cell 104 in a raised position with the other 5 dots in retracted positions, which corresponds to the letter "A", and Figure 4 illustrates the two top dots 120 in raised positions with the other 4 dots in retracted positions, which corresponds to the letter "B". Although shown as a six dot cell, cell 104 could have more than or fewer than six dots - for example an eight dot cell could be used in some applications and a four dot cell used in some applications. [0014] In one example embodiment, the actuators 122 of cell 104 are controlled by a suitably programmed intermediate processing system or controller 124 such as a Raspberry Pi™ or Arduino™ that is part of the braille simulator 105. The controller in turn communicates through communications link 106 with the APP 108 enabled programmable UE device 102. In one example, the braille simulator 105 has a housing 140 that houses the braille cell 104, controller 124 and other electronic and physical components of the braille simulator. In this regard, Figure 2 shows a block diagram representation of a processing system 200 that could, in example embodiments, be used to implement the controller 124 of braille simulator 105. The processing system 200 includes one or more controllers or digital processor units 202, a memory 204, a power source (not shown), one or more wireless communications interfaces 210 (for example one or more of a Bluetooth™ interface and a WiFi interface), a wired interface such as a USB interface 212, and user interfaces 220. In one embodiment, the user interfaces 220 include various inputs/outputs (I/O) interfaces. The memory 204 may include both transient and non-transient storage elements that store programming and/or instructions for the processor unit 202, including the drivers 206, applications 208 and any other software required for the functionality described herein.
[0015] The processor system 200 used in braille simulator 105 may, as noted above, incorporate a Raspberry Pi™ or Arduino™ system, or could be implemented using other suitable components. User interfaces 220 may include some or all of the following : the refreshable braille cell 104, various physical user input button and/or switches 222, an accelerometer 223, one or or proximity motion sensors 224, touch pad 226, audio transducers 226 (speaker and/or microphone), vibration generator 230, air bust generator 232, additional haptic transducers 234, and a screen 236. Referring to Figure 1, in an example embodiment the user interfaces of the braille simulator 105 are integrated into housing 140. For example, user input buttons 222 may be arranged along a front of the housing 140, and an IR or video proximity motion sensor 224 may be located on the face or upper surface of the housing 140. [0016] Programmable processor enabled UE device 102A also includes a suitably configured processing system 200. In the case of UE device 102, user interfaces 220 may include some or all of the above mentioned interface elements - for example, as noted above, in some embodiments UE device 102 includes a touch screen 236, and audio transducers 226 in the from of speaker 112 and microphone 110. In an example embodiments, the non-transient storage element stores braille APP 108. Among other things, APP 108 configures the UE device 102 to provide signals through communications link 106 to cause dots 120 to be selectively lowered and raised to present characters to a person who has a finger placed on the cell 104.
[0017] In example embodiments the braille simulator 105 incorporating braille cell 104 has a compact design footprint similar to a USB memory stick with communication and power coming from a wired USB connection to UE device 102. This would allow the braille simulator 105 to be plugged into the device 102 and thus provide a fixed reference point for a visually impaired person using the system 100. In the case of as a wireless version (for example Bluetooth), power for the Braille simulator 105 could be from a rechargeable battery or separate power supply.
[0018] In some example embodiments, simulators 105 that incorporate single cells 104 are configured so that they are modular in that they can be connected (snapped) together to create any length of character refreshable display. For example, four simulators 105 (each having a cell 104) cells 104 can be connected inline as shown in Figure 5 so as to be able to display short words for learning such as "feel" or "send". This would allow for the scalability of the system after the alphabet has been learned to move onto words and sentences for example. This design configuration lends itself to being very flexible and portable, thus allowing learning of braille to take place anywhere. [0019] As illustrated in Figure s 1 and 2, in order to facilitate modular connection of multiple simulators 105, in some example embodiments each simulator 105 may include physical braille cell interconnect elements 240A/240B that include mating electrical connector plug elements 240A and 240B located on opposite sides of the simulator 105 to allow a physical and electrical signaling connection to a neighboring simulator 105. In example embodiments, the controller 124 is configured to detect when a connection is made to another simulator and communicate that information to UE device 102. In an example embodiments, rather than or in addition to physical connectors 240A/240B, each simulator 105 is provided with a proximity indicator element 239 on one side surface and a corresponding braille cell proximity detector 238 located on the opposite side surface to permit detection of when a neighboring simulator is aligned . In one example, the proximity indicator element 239 is a magnet and the corresponding braille cell proximity detector 238 a magnetic sensor such as a Hall- effect sensor. In some embodiments, proximity detectors 238 and indicator elements 239 can include near field communications (NFC) interfaces for use instead of or in combination with magnetic sensors to allow simulator ID
information to be exchanged between neighboring simulators and with UE device 102. Accordingly, in at least one example embodiment, a plurality of simulators 105 have proximity sensors 238 or physical elements 238 such as connectors or contact switches that detect when a simulator 105 is arranged in-line to another simulator, and that information is communicated to UE device 102, enabling UE device 102 to determine how many and which devices are connected in line and then use that information to coordinate the operation of simulators 105 to generate words of a length that correspond to the number of connected cells.
[0020] In some embodiments, multiple cells 104 may be incorporated into a single simulator 105.
[0021] In some examples, the cell simulator 105 and cell 104 may be configured so that it can be secured to the user's finger. In some examples such as shown in Figure 1, the cell simulator 105 housing 140 can support a user's hand . Although the housing 140 is shown as rectangular in Figure 1, the housing can alternatively have a number of different ergonomic configurations.
[0022] In example embodiments, the system 100 also includes a further hardware component in the form of an incentive delivery device 150, and example of which is shown in Figures 6 and 7. In the illustrated example, the incentive delivery device 150 takes the form of a treasure box that has multiple locked compartments 162 that can be selectively unlocked and opened in response to signals received from programmable UE device 102. By way of example, incentive delivery device 150 may have six to eight front facing doors 152 that all conceal a respective compartment 162, and a top compartment 154 that is concealed by a lid 158. Compartments 162, 154 may be preloaded with physical rewards 164. Doors 152 and lid 158 are each secured shut by a respective locking mechanism 156 (see Figure 7) that can be selectively actuated in response to signals from device 102 to unlock or open. In one example embodiment, the locking
mechanisms 156 each include a solenoid or servo that is connected to a local controller 154 (which may for example be a suitably programmed controller such as a Raspberry Pi™ or Arduino™, and/or could have a a processor system 200) that in turn communicates through a wireless communications link 152 (which may for example be a Bluetooth™ link) with the APP 108 enabled programmable UE device 102. In some example embodiments, locking mechanisms 156 are electromagnetic mechanisms.
[0023] The programmable UE device 102, braille simulator 105 and reward incentive device 150 can be combined and configured to make learning braille, or just learning, a self-directed fun and motivated experience especially for but not limited to visually impaired children. In some example embodiments the APP 108 configures the UE device 102 to incorporate repetition, reward and fun based on video games while using the braille cell 104 along with the remote unlockable treasure box incentive delivery device 150. The APP 108 is flexible in that it can be installed on a wide range of computer or mobile UE devices such as a tablet. The APP 18 is based on audio input and output utilizing the UE device 102's speakers 112 and microphone 110, as well as USB connection or wireless connection 106 to output a tactile experience for the blind via the single refreshable braille cell 104 and the treasure box incentive device 150.
[0024] In example embodiments, the APP 108 is configured in a modular way such that the learning of braille is made into a game with rewards that keep the user engaged and challenged, such as popular video games, so as to make learning fun. Introductory levels provide for learning the alphabet but the same format can be expanded to other modules for numbers, words, and reading.
[0025] The treasure box/incentive delivery device 150 can come in different sizes depending on preference or where it will be used and is not mandatory in order to learn braille but enriches the experience of the student in actual tactile feedback and fun, turning learning into more of an adventure game. In at least one embodiment, the delivery device 150 is connected to the APP 108 enabled device 102 via wireless communication link 153 (Bluetooth) and will have either a battery pack (mobile unit) or plug in power supply (stay at home) which will allow the unlocking of drawers and compartments 152 as well as opening of the box lid 154 to reveal actual tactile objects 164 as rewards during the student's quest to learning . In example embodiments the box will have braille on it to identify each of the compartments 162 thus also reinforcing the learning of braille. In some examples programmable braille cells 104 are provided on some or all of the compartment doors 152 and lid 154.
[0026] In various embodiments the system 100 is used to teach the Braille alphabet, Braille Math, Braille music and contractions. In one example, the APP 108 is based on an adventure story through which the child learns the braille alphabet by opening secret doors on the delivery system 150, exploring caves and castles where letters reveal themselves. For example, the APP 108 configures the system 102 to teach ABCs by outputting the letter aurally over speaker 112 and tactilely over cell 104 at the same time. The system 102 than tests the child with a random generation of braille characters on cell 104 whereby the child then guesses the correct letter by speaking into the computer microphone 110. Speech to text software resident on the device 102 is then used to verify the child's answer. If correct, the child is rewarded with virtual coins for rewards. Upon successful completion of a series of correct answers, the device 120 will unlock a virtual reward such as story or a song that the child can listen to over device speaker 112. After a period of time, and when the child accumulates a pre-determined number of coins based on learning achievement, the computer will unlock physical reward by releasing a door 152 on a toy treasure box 150 to reveal a real toy or tactile item related to the adventure story. This real reward incentive will motivate the child to continue to practice within the learning game and acquire more toy rewards locked in the remaining doors of the treasure box.
[0027] In example embodiments, prior to commencing the "Treasure Box Braille learning program", a parent or teacher would load the treasure box incentive delivery device 150 with toys 164 related to the story and then lock the device 150. By way of example, these toys and/or tactile items 164 could be sold in theme packs with each individual software APP 108 or specified adventure. Only the programmable device 102 can unlock the incentive delivery device 150 when learning levels are achieved. Different software games can be sold or otherwise distributed with corresponding theme packs of toys (e.g . : Space Math Adventure, Pirate Adventure ABCs or Fairytale Braille Music Adventure).
[0028] By way of example, in one game scenario may be as follows: A princess searches for her lost ring . She looks for the ring in the castle by opening secret virtual doors, and magic jewellery boxes where letters of the alphabet appear to teach the child . Only when the child achieves 1,000 coins through a series of testing, will the princess find her ring . The programmable device 102 will then unlock the treasure box door 152 or 154 to reveal the ring for the child to wear. The learning adventure is brought to life through the tactile reward 164.
[0029] In an example embodiment, a number of the input buttons/switches 222 provided on Braille simulator housing 140 each provide a different tactile experience to the user. For example, the housing 140 may include 5 square tactile buttons 222 arranged in a row along a face ( for example the front edge face) of the simulator 105, with each button being configured with a different finger contact interface surface to each provide a unique tactile sensation (e.g . : bumpy, fuzzy, concave, convex, etc. ). Physical switches such as lever switches and slider switches could also be provided on housing 140. These switches/buttons 222 allow the child/user to navigate through a storyline provided by the app 108 and adds an element of fun to the learning game (similar to a video gaming console). The user will press a specific button or switch to return to a previous letter, repeat a letter, go to the next letter, answer a test question, or claim a reward. The physical input interfaces on simulator 105 such as the buttons 222 can also provide an
alternative way for a user to provide input to the system 100 in addition to voice activation. Such an alternative can be particularly useful in the in the case of individuals with speech disorders for whom voice input through microphone 110 may be highly unreliable.
[0030] In an example embodiment, the simulator 105 can also feature a motion sensor 224 placed at the top surface of the housing 140 to indicate the presence of a hand on the simulator 105 and when a child's hand is positioned correctly on the simulator 105. When the child's hand is in position, the system 100 will generate non-visual signal (for example an audio signal like a bell) to indicate that the child is ready to begin the learning game. The motion sensor 224 can also be integrated into the learning game for an element of fun and learning engagement. For example, in the learning game storyline, Pirate Captain A asks the child to make a swirling motion above the simulator to cast a spell on the dragon to move on to the next letter.
[0031] In example embodiments the simulator 105 user interfaces 220 include vibration generator 230 and air burst generator 232 to create tactile sensations such as vibrations (like a rumble pack in a gaming console for example) and air bursts. When the child progresses through the learning game, these tactile stimulations will add a virtual element to the gamification of the software, and can be used to provide rewards and other feedback to the user.
[0032] Referring to Figure 1, in example embodiments the app 108
configures UE device 102 to present information on display screen 236 in coordination with the outputs and inputs occurring at braille simulator 105. For example, in Figure 1, the braille cell 104 physically generates the letter "A" with a single raised dot 120. At the same time, screen 235 displays a visual
representation 302 of the braille cell showing a single highlighted dot and also the actual text letter "A" 304, and an image of an item that begins with the letter "A" such as an apple. Other visuals may include elements of the story/learning game (ie: Pirate Ship or Dragon image). Such features can assist a sighted person to follow the experience of a visually impaired child using the system, as well as provide visual cues for people whose level of impairment still permits some vision. In this regard, in some examples high contrast graphics are used when generating images on screen 236 to facilitate viewing by people with reduced vision
capabilities.
[0033] For example, in some example embodiments, the app 108 configures UE device 102 to display information on screen 236 in compliance with the
Accessibility for Ontarians with Disabilities Act (AODA). Titles, visuals or icons on the screen 236 are displayed in high contrast (e.g . : black text on yellow
background or black text on white background) and include large font sizes. In some embodiments, each user interaction step includes simple language text to speech instruction and consistent sound cues for orientation and navigation.
[0034] An example app 108 described above implemented "The Treasure Box Braille" learning software to teach the Braille alphabet. In example embodiments other learning apps or application add-ons can be introduced and downloaded to the device 102 as developed. For example, the apps/add-ons may be displayed post download the UE devices' app menu and include such topics as Braille math, Braille music and other learning games for the visually impaired (ie : animals of the jungle, space, ocean creatures, etc).
[0035] In another example embodiment, the user interfaces 220 of the physical reward dispensing device 150 includes a 3D printer, indicated in Figure 6 as phantom line 305 . For example, a 3D printer 305 could be inside of the
"treasure box" device 150 and controlled by UE device 102 to print 3D rewards for the child . The pre-programmed printer rewards will correspond to the learning game (ie: pirate adventure) whereas the child can redeem a pirate's ring or dragon figurine for completing a learning level. The flexibility of 3D technology will be beneficial as future learning apps are added to system 100. Such as, if the child is learning about animals in the jungle, 3D printed animal figurines can be used as rewards.
[0036] In some example embodiments, the system 100 also includes a remotely hosted feature that can be accessed by multiple users who can explore the learning game and gain rewards together. Moreover, sighted and blind siblings can play the learning game together as well . Often blind children are isolated in mainstream schools, and so multi-player online versions of the system can connect multiple blind children online which builds their community and social network.
[0037] As noted above, in some examples, simulators 105 can be configured such that a plurality simulators can be arranged in-line to spell words. In one example, simulators 105 are enabled for wireless communication through NFC or Bluetooth, for example, and are provided with proximity sensors 238 (which as noted above may include magnetic or other sensors) that enable each simulator 105 to detect when it is arranged in-line with one or more other simulators 105, and communicate that information through communications link 116 to UE device 104. In addition to allowing the multiple refreshable braille cells 104 to be arranged in-line to spell a word (which a user can read and then verbally input to the system for confirmation), enabling the simulators 105 to be moved and rearranged can provide additional stimulation to a user. For example, in some embodiments, APP 108 may configure UE device 104 to cause the plurality of cells
104 to randomly each generate a letter from a word, and then output the word audibly through speaker 112. The user can then manually rearrange the simulators
105 (based on "reading" the dots 120 of each cell 104) to form the word, with the UE device 102 detecting when the simulators 105 are correctly arranged, at which time feedback and/or a reward is provided to the user. In some embodiments, the UE device 104 may audibly instruct the user to arrange the simulators 105 in as many different word-spelling configurations as possible within a given time frame, and provide user feedback for combinations that result in correct words.
[0038] Furthermore, configurations that facilitate multiple refreshable braille cells 104 to be arranged in-line allows for graduated learning by the user from Level 1 braille to Level 2 braille and so on. Young children who have learned the braille alphabet and basic math can then connect a new multiple refreshable cell device to learn words and possibly short sentences. In summary, the system 100 can be expanded to adapt to the child's advancing learning needs.
[0039] As noted above, the user interfaces 220 of simulator 105 may also include an acceromoter 223, touch pad 226 and haptic transducers 234. In some example embodiments, an accelerometer 223 may allow a user to provide input by moving the entire simulator 105. A touch pad 226 on the face of the simulator can also allow for a variety of interactions useful for the user experience. A variety of different haptic transducers 234 may be incorporated into system 100 to provide tactile experiences to the user. For example, a haptic joy stick or control stick could be provided on housing 140 that provides force feedback on a user's hand or finger and also functions as an input device. Additionally, a wearable arm pad or other device including a haptic feedback matrix or grid could be included with system 100. [0040] In some example embodiments, some or all of the functionality of UE device 102 is incorporated into the braille simulator 105 such that the braille simulator 105 can operate as a standalone device (or in concert with other simulators 105).
[0041] It will thus be appreciated that in at least one example embodiment, there is provided a braille instructional system comprising a refreshable braille cell having an array of dots that can be selectively actuated to provide tactile feedback to a user. Instructions are stored on a non-transitory medium for configuring a programmable device to interact over a communications link with the braille cell. The instructions configure the device to: cause the braille cell to generate tactile outputs; receive, through a user input interface of the device, user responses that correspond to the tactile outputs; and provide one or more rewards when the received responses meet one or more thresholds. In some applications, a reward may be in the form of an aural output over a speaker driven by the programmable device. In some applications, one or more of the rewards comprise virtual coins. In some applications, the system also includes an incentive delivery device that comprises a plurality of physical compartments that can be selectively opened or unlocked in response to signals from the programmable device, and providing one or more rewards includes causing one or more of the physical compartments to open or unlock. In some applications, the instructions further configure the programmable device to generate an aural output over a speaker and cause the braille cell to generate a tactile output corresponding to the aural output.
[0042] Although the present disclosure describes methods and processes with steps in a certain order, one or more steps of the methods and processes may be omitted or altered as appropriate. One or more steps may take place in an order other than that in which they are described, as appropriate.
[0043] While the present disclosure is described, at least in part, in terms of methods, a person of ordinary skill in the art will understand that the present disclosure is also directed to the various components for performing at least some of the aspects and features of the described methods, be it by way of hardware components, software or any combination of the two. Accordingly, the technical solution of the present disclosure may be embodied in the form of a software product. A suitable software product may be stored in a pre-recorded storage device or other similar non-volatile or non-transitory computer readable medium, including DVDs, CD-ROMs, USB flash disk, a removable hard disk, or other storage media, for example. The software product includes instructions tangibly stored thereon that enable a processing device (e.g ., a personal computer, a server, or a network device) to execute examples of the methods disclosed herein.
[0044] The present disclosure may be embodied in other specific forms without departing from the subject matter of the claims. The described example embodiments are to be considered in all respects as being only illustrative and not restrictive. Selected features from one or more of the above-described
embodiments may be combined to create alternative embodiments not explicitly described, features suitable for such combinations being understood within the scope of this disclosure.
[0045] Also, while the systems, devices and processes disclosed and shown herein may comprise a specific number of elements/components, the systems, devices and assemblies could be modified to include additional or fewer of such elements/components. For example, while any of the elements/components disclosed may be referenced as being singular, the embodiments disclosed herein could be modified to include a plurality of such elements/components. The subject matter described herein intends to cover and embrace all suitable changes in technology.

Claims

Claims
1. A braille instructional system comprising :
a refreshable braille cell comprising an array of dots that can be selectively actuated to provide tactile feedback to a user;
a programmable device for controlling the braille cell;
instructions stored on a non-transitory medium for configuring the programmable device to control the braille cell, the instructions configuring the device to:
cause the braille cell to generate tactile outputs;
receive, through a user input interface of the device, user responses that correspond to the tactile outputs; and
provide one or more rewards when the received responses meet one or more thresholds.
2. The system of claim 1 wherein a plurality of rewards are provided, each reward being associated with a different threshold .
3. The system of claim 1 or 2 wherein one or more of the rewards comprises an aural output over a speaker driven by the programmable device.
4. The system of any one of claims 1 to 3 wherein one or more of the rewards comprises virtual coins.
5. The system of any one of claims 1 to 4 comprising an incentive delivery device that comprises a plurality of physical compartments that can be selectively opened or unlocked in response to signals from the
programmable device, wherein providing one or more rewards comprises causing one or more of the physical compartments to open or unlock.
6. The system of any one of claims 1 to 5 wherein the instructions further configure the programmable device to generate an aural output over a speaker and cause the braille cell to generate a tactile output corresponding to the aural output.
7. The system of any one of claims 1 to 6wherein the programmable device comprises a display screen and is configured to generate a visual output on the display screen that corresponds to the tactile output.
8. The system of any one of claims 1 to 7 wherein the braille cell is located within a housing that comprises a plurality of user input buttons that can each provide input to the programmable device, at least some of the user input buttons each being configured to provide a different tactile experience for a user.
9. The system of any one of claims 1 to 7 wherein the braille cell is located within a housing that houses a motion sensor for detecting motion of a users hand or finger within a region, the programmable device being responsive to information derived from the motion sensor.
10. The system of any one of claims 1 to 7 wherein the braille cell is located within a housing that houses an accelerometer for detecting motion of the housing, the programmable device being responsive to information derived from the accelerometer.
11. The system of any one of claims 1 to 8 further comprising one or more non- visual output devices housed with the braille cell.
12. The system of claim 11 wherein the non-visual output devices comprise one or more of a vibration generator and an airburst generator.
13. The system of any one of claims 1 to 12 comprising a plurality of refreshable braille cells controllable by the programmable device and each comprising an array of dots that can be selectively actuated to provide tactile feedback to the user.
14. The system of claim 13 wherein the braille cells are each housed within a discrete housing such that the braille cells can be separated from each other and rearranged, each braille cell having a local controller responsive to instructions received through a communications channel from the
programmable device.
15. The system of claim 14 wherein the braille cells each comprise a proximity detector for detecting when the braille cell is located in-line with an adjacent braille cell, the programmable device being responsive to signals from the braille cells based on inputs from the proximity detectors to cause a group of the braille cells, when aligned, to collectively generate a braille equivalent of a word .
16. The system of any one of claims 1 to 15 comprising a 3-D printer, wherein the programmable device is configured to cause the 3-D printer to
selectively generate an object as one or more of the rewards.
17. A braille simulator module comprising :
a housing;
a programmable controller located within the housing;
a refreshable braille cell secured within the housing and comprising an array of dots that can be selectively actuated by the controller to provide tactile feedback to a user;
a proximity detector in the housing and connected to the controller to indicate when a further braille simulator is arranged in-line with the housing.
18. The braille simulator of claim 17 in combination with a programmable user equipment (UE) device, the UE device being in communication with the programmable controller to send instructions thereto to control the braille cell and to receive information indicating when the further braille simulator is arranged in-line with the housing, the UE device being configured to coordinate the operation of multiple braille simulators to cause the refreshable braille cells thereof to collectively output a braille word .
19. The braille simulator of claim 17 or 18 wherein the proximity detector
includes one or both of a magnetic sensor and a near filed communication device.
20. A method for instructing braille with a refreshable braille cell comprising an array of dots that can be selectively actuated to provide tactile feedback to a user, comprising :
receiving, at the braille cell, instructions from a programmable UE device to cause the braille cell to generate tactile outputs;
receive, through a user input interface of the UE device, user responses that correspond to the tactile outputs; and
automatically provide one or more rewards when the received responses meet one or more thresholds.
PCT/CA2016/050437 2015-04-16 2016-04-15 Braille instruction system and method WO2016165024A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201562148469P 2015-04-16 2015-04-16
US62/148,469 2015-04-16

Publications (1)

Publication Number Publication Date
WO2016165024A1 true WO2016165024A1 (en) 2016-10-20

Family

ID=57125600

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2016/050437 WO2016165024A1 (en) 2015-04-16 2016-04-15 Braille instruction system and method

Country Status (1)

Country Link
WO (1) WO2016165024A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10169943B2 (en) 2017-04-05 2019-01-01 Hart Intercivic, Inc. Haptic feedback apparatus and method for an election voting system
WO2023175592A1 (en) * 2022-03-18 2023-09-21 Corporación Universitaria Minuto De Dios - Uniminuto Audio-tactile device for reading numbers in the braille and arabic numeral systems

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050084828A1 (en) * 2003-10-21 2005-04-21 The University Of North Carolina At Chapel Hill Apparatus and method for braille instruction
US20060215476A1 (en) * 2005-03-24 2006-09-28 The National Endowment For Science, Technology And The Arts Manipulable interactive devices

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050084828A1 (en) * 2003-10-21 2005-04-21 The University Of North Carolina At Chapel Hill Apparatus and method for braille instruction
US20060215476A1 (en) * 2005-03-24 2006-09-28 The National Endowment For Science, Technology And The Arts Manipulable interactive devices

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10169943B2 (en) 2017-04-05 2019-01-01 Hart Intercivic, Inc. Haptic feedback apparatus and method for an election voting system
WO2023175592A1 (en) * 2022-03-18 2023-09-21 Corporación Universitaria Minuto De Dios - Uniminuto Audio-tactile device for reading numbers in the braille and arabic numeral systems

Similar Documents

Publication Publication Date Title
Eleftheria et al. An innovative augmented reality educational platform using Gamification to enhance lifelong learning and cultural education
US5478240A (en) Educational toy
US20130260886A1 (en) Multi-sensory Learning Game System
Ferreira et al. Game based learning: a case study on designing an educational game for children in developing countries
Pires et al. Learning maths with a tangible user interface: Lessons learned through participatory design with children with visual impairments and their educators
Scharf et al. Tangicons: algorithmic reasoning in a collaborative game for children in kindergarten and first class
Sylla et al. Digital manipulatives as scaffolds for preschoolers’ language development
WO2016165024A1 (en) Braille instruction system and method
Meyers Unique contributions of microcomputers to language intervention with handicapped children
López-Bouzas et al. A gamified environment supported by augmented reality for improving communicative competencies in students with ASD: design and validation
Walia et al. HapTech: Exploring Haptics in Gaming for the Visually Impaired
US20230368700A1 (en) Tactile drawing and writing apparatus for the visually impaired
Koenig Exploring effective educational video game design: The interplay between narrative and game-schema construction
Kukla David Booth: Drama as a way of knowing
Cha et al. My classroom robot: Exploring telepresence for K-12 education in a virtual environment
Charles et al. Using Multiliteracies and Multimodalities to Support Young Children′ s Learning
de Luna Learning as fun: what video games do that classrooms do not
Yabut et al. Empowering elementary schools on learning math: a development of gamified educational mobile application for grade 3 students
Al-Khalifa et al. Basma: An interactive IoT-based plush toy for Arabic-speaking children
Maloku et al. A Mobile Application for School Children Controlled by External Bluetooth Devices.
Ablan et al. Developing Toy Design Criteria for Visually Impaired Children: A New Play Set Design.
Moulana Synergy: Game Design+ Qur'an Memorization
Mirqodirova et al. MATCHING GAMES TO LEARNING PREFERENCES
Andrews Joyful Engagement: Montessori's Common Core Standard.
US20130344462A1 (en) Methods And Devices For Edutainment Specifically Designed To Enhance Math Science And Technology Literacy For Girls Through Gender-Specific Design, Subject Integration And Multiple Learning Modalities

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16779373

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16779373

Country of ref document: EP

Kind code of ref document: A1