TWI768974B - Visually impaired auxiliary device - Google Patents

Abstract

Disclosed is a visually impaired auxiliary device, including a control module, an image capturing module, a lidar sensor, a radar sensor, a driving module, and at least one linear resonance actuator. The driving module makes the at least one linear resonance actuator vibrate according to the signal input from the image capturing module, the lidar sensor, or the radar sensor processed by the control module, and notify a visually impaired user to make an appropriate response.

Description

Visually Impaired Aids

The present invention relates to an aid for the visually impaired, in particular to an intelligent aid for the visually impaired.

In daily life, visually impaired people rely heavily on assistive devices such as guide sticks. However, traditional guide sticks are large and need to touch the ground and objects to perceive obstacles, which often leads to slow movement or influence. Use the road to other passersby.

Therefore, how to solve the above problems and improve the safety of visually impaired people when walking is an important issue when designing assistive devices such as guide sticks for the blind.

In view of this, the inventor of this case proposes a more natural human-computer interaction method, and designs a smart aid for the visually impaired, which interacts with the visually impaired through vibration, hoping to replace or integrate traditional aids.

In view of the above, one aspect of the present disclosure provides an aid for the visually impaired, including: a main body portion having an accommodating space, wherein a portion outside the accommodating space is configured with a control switch and a control module connected to an image capture module, a lidar sensor, at least one on-off switch, an accelerometer sensor, a bluetooth module, and a power supply; a telescopic part, which is physically connected to the main body and can be It is accommodated in the accommodating space of the main body part, wherein an end part far from the main body part has a radar sensor, and the radar sensor is connected with the control module, and wherein the control switch controls the expansion and contraction of the telescopic part telescopic; and a driving module, respectively connecting at least one linear resonance actuator and the control module. The driving module is based on the image capture module, the lidar sensor, the at least one on-off switch, the accelerometer sensor, the radar sensor or the bluetooth processed by the control module The signal input by the bud module causes the at least one linear resonance actuator to vibrate, so as to notify a visually impaired user to make an appropriate response.

The following disclosure provides different embodiments or examples for implementing different features of the provided subject matter. The specific examples of components and arrangements described below are for the purpose of simplifying the present disclosure and are not intended to be limiting; the size and shape of the elements are not limited by the disclosed ranges or values, but may depend on the processing conditions of the elements or the desired characteristic. For example, technical features of the invention are described using cross-sectional illustrations that are schematic illustrations of idealized embodiments. Thus, variations in the shapes of the illustrations due to manufacturing processes and/or tolerances are foreseeable and should not be limited thereto.

Furthermore, spatially relative terms such as "below", "below", "below", "above" and "above" are used to facilitate the description of the elements depicted in the drawings or relationship between features; further, spatially relative terms encompass different orientations of elements in use or operation in addition to the orientation depicted in the illustrations.

FIG. 1 is a schematic diagram of a visually impaired aid according to an embodiment of the present invention. FIG. 2 is a schematic diagram of a hardware structure of a visually impaired aid according to an embodiment of the present invention. First, a visually impaired aid according to an embodiment of the present invention is described as follows.

As shown in FIG. 1 , the visually impaired aid 100 of this embodiment includes a main body portion 104 and a retractable portion 102 . The telescopic portion 102 includes a secondary telescopic portion 102a, a secondary telescopic portion 102b, and a secondary telescopic portion 102c.

As shown in FIG. 1 , the main body portion 104 has an accommodating space inside for accommodating the telescopic portion 102 . Please also refer to FIG. 2 , the part outside the accommodating space is configured with a control module 200 , a control switch 30 , at least an on-off switch 50 , an image capture module 20 a , a lidar Sensor 20b, an accelerometer sensor 210, a Bluetooth module 208, and a power supply 206. In this embodiment, the control module 200 is composed of a motherboard 201 and a microcontroller 202 . Moreover, the control switch 30 , at least one on-off switch 50 , the image capture module 20 a , the lidar sensor 20 b , the accelerometer sensor 210 , the Bluetooth module 208 , and the power supply 206 are all formed with the control module 200 connection, that is, to form a connection with the microcontroller 202 . In this embodiment, the power supply 206 , the accelerometer sensor 210 , and the Bluetooth module 208 are configured on the motherboard 201 . The lidar sensor 20b emits pulsed laser light 20c to detect obstacles in the distance. In addition, at least one on-off switch 50 can set the function of the visually impaired aid 100 . In addition, the image capture module 20a captures the image of the environment and transmits it to the control module 200 for real-time environment construction simulation, wherein the control switch 30 and the at least one on-off switch 50 can be touch sensors. Further is a capacitive touch sensor.

Referring again to FIG. 1 , the telescopic portion 102 is physically connected to the main body portion 104 and can be accommodated in the above-mentioned accommodating space of the main body portion 104 , wherein the secondary telescopic portion 102 a can be accommodated in the secondary telescopic portion 102 b , and 102b can be accommodated in the secondary telescopic portion 102c. In addition, the telescopic action of the telescopic portion 102 is performed by the control switch 30, wherein the control switch 30 controls the telescopic portion 102 to expand and contract through an elastic element such as a spring (not shown in the figure), that is, controls the secondary telescopic portion 102a, The expansion and contraction of the sub-contraction portion 102b and the sub-contraction portion 102c.

As shown in FIGS. 1 and 2 , an end away from the main body portion 104 , that is, the end of the secondary telescopic portion 102 a , has a radar sensor 10 (or “radar” for short), and the radar sensor 10 is connected to the control module. 200 is connected, and transmits the signal to the control module 200. The radar sensor 10 emits high-power electromagnetic waves 10a to detect nearby obstacles on the ground.

As shown in FIG. 2 , a driving module 204 is connected to at least one linear resonance actuator 40a, 40b, 40c, 40d and the control module 200, respectively. In this embodiment, the driving module 204 is a motor driving IC; at least one linear resonance actuator 40a, 40b, 40c, 40d is a vibration motor. The driving module 204 is based on the image capturing module 20a, the lidar sensor 20b, at least one on-off switch 50, the accelerometer sensor 210, the radar sensor 10 or The signal input from the bluetooth module 208 causes at least one linear resonant actuator 40a, 40b, 40c, or 40d to vibrate, so as to notify a visually impaired user to respond appropriately. In this embodiment, at least one on-off switch 50 is a capacitive on-off switch. In other embodiments, at least one on-off switch 50 is a piezoelectric on-off switch or a piezoresistive on-off switch.

Next, please refer to FIG. 2 again, where the hardware structure of the visually impaired aid according to an embodiment of the present invention will be further described.

In this embodiment, the main board 201 and the microcontroller 202 disposed thereon constitute the control module 200 . As mentioned above, in addition to the power supply 206 , the accelerometer sensor 210 , and the Bluetooth module 208 , which can be configured on the motherboard 201 , the driving module 204 is also configured on the motherboard 201 . The power source 206 may be a battery, which supplies power to the motherboard 201 . The rest of the hardware components connected to the control module 200 are as described above and will not be repeated here.

In this embodiment, the image capture module 20a may be a camera lens, which is connected to the microcontroller 202 through the MIPI CSI-2 interface. The lidar sensor 20b and the radar sensor 10 are connected to the microcontroller 202 through a UART or I2C interface. The Bluetooth module 208 and the control switch 30 are connected to the microcontroller 202 through a UART interface. The accelerometer sensor 210 and at least one on-off switch 50 are connected to the microcontroller 202 through the SPI interface. The hardware components input signals to the microcontroller 202 through the respective interfaces, and after being processed by the microcontroller 202, the driving module 204 drives the at least one linear resonant actuator 40a, 40b, 40c, or 40d, so as to Generates a vibrating message for visually impaired users.

Hereinafter, the software architecture of the visually impaired aid according to an embodiment of the present invention will be further described. FIG. 3 is a schematic diagram of a software architecture of a visually impaired aid according to an embodiment of the present invention.

As shown in FIG. 3 , the mobile communication device 302 is paired with the visually impaired aid 100 through the Bluetooth module 208 , and then can be imported into the application programs (APP) of the mobile communication device 302 , such as the obstacle detection application 314 , the navigation application 316 and the waiting app 318 and more. The signals of the mobile communication device 302 , the obstacle detection application 314 , the navigation application 316 , and the waiting application 318 are processed by the calculation and control program 300 to cause the vibration motor 320 to generate vibration information for visually impaired users.

Referring to FIG. 3 again, the visually impaired user passes through the control switch 30 and the pressing force signal 304 of at least one on-off switch 50 will also be processed by the calculation and control program 300 , so as to cause the vibration motor 320 to generate vibration information for the visually impaired. By. In addition, the image signal 308 obtained by the image capturing module 20a and the image depth signal 306 obtained by the lidar sensor 20b will be processed by an image program 310 after the image signal 308 and the image depth signal 306 are processed into a composite 3D image data 312, and sent to the calculation and control program 300 for processing, so as to cause the vibration motor 320 to generate vibration messages to visually impaired users. Here, the vibration motor 320 may be one or a combination of at least one linear resonant actuator 40a, 40b, 40c, 40d.

Next, FIG. 4 is a schematic diagram of a connection between a visually impaired aid and a smart phone according to an embodiment of the present invention. As shown in FIG. 4 , the mobile communication device 302 is a smart phone, which is connected to the visually impaired aid 100 through the Bluetooth module 208 , and manages the visually impaired aid 100 with the navigation application 316 , for example, when a turn needs to be sent. The signal causes at least one linear resonance actuator 40a, 40b, 40c, or 40d of the visually impaired aid 100 to vibrate, prompting the visually impaired user to make a correct response. A single or combined vibration of the at least one linear resonant actuator 40a, 40b, 40c, 40d can be designed with relative meaning.

Referring to FIG. 1 again, for example, at least one linear resonance actuator 40a, 40b, 40c, 40d is disposed at different positions of the main body portion 104 in front, rear, left, right, and right. When the at least one linear resonance actuator 40a vibrates, it means that there is an obstacle in front of it ; When at least one linear resonant actuator 40c vibrates, it can represent an obstacle on the left.

When a visually impaired user takes a bus, it can be linked with the waiting app 318 to give a reminder before the bus arrives at a stop, such as: general information (arrival in N minutes), the visually impaired aid 100 will vibrate and it will be displayed on the mobile APP hint. When the bus is about to arrive at the stop, the visually impaired aid 100 can send out intermittent vibration signals. When the bus has entered the station, the assistant will issue a warning to remind the user to get on the bus. The APP can also provide a boarding bell service. If the visually impaired user needs to get on the bus, they can press at least one on-off switch at the bottom of the visually impaired assistant 100 50. Make an appointment to get on the bus. In the future, it can also be linked with the bus station. After entering the bus station, the bus station will send a signal to inform visually impaired users.

Of course, through at least one linear resonant actuator 40a, 40b, 40c, 40d, the number of vibrations, the duration of the vibration, and the vibration mode can be designed into messages with different meanings to prompt visually impaired users to make appropriate responses . In this way, the visually impaired user can use different applications (APPs) on the mobile communication device 302 together with the visually impaired aid 100 to derive more life assistance besides detecting obstacles, navigating, and waiting for a car. possibility of application.

The above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced. Without departing from the spirit and scope of the technical solutions of the present invention.

10: Radar sensor 10a: High Power Electromagnetic Waves 20a: Image capture module 20b: LiDAR sensor 20c: Pulsed laser light 30: Control switch 50: At least one on-off switch 40a, 40b, 40c, 40d: at least one linear resonant actuator 50: At least one on-off switch 100: Visually Impaired Aids 102: Telescopic part 102a: Secondary telescopic part 102b: Secondary telescopic part 102c: Secondary telescopic part 104: Main body 200: Control Module 201: Motherboard 202: Microcontroller 204: Drive Module 206: Power 208:Bluetooth module 210: Accelerometer Sensor 300: Computing and Control Programs 302: Mobile communication device 304: Press the pressure signal 306: Image depth signal 308: Video signal 310: Video Program 312: Composite 3D image data 314: Obstacle Detection Application 316: Navigation Apps 318: Waiting app 320: Vibration Motor

FIG. 1 is a schematic diagram of a visually impaired aid according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of a hardware structure of a visually impaired aid according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of a software architecture of a visually impaired aid according to an embodiment of the present invention.

FIG. 4 is a schematic diagram of a connection between a visually impaired aid and a smart phone according to an embodiment of the present invention.

10: Radar sensor

10a: High Power Electromagnetic Waves

20a: Image capture module

20b: LiDAR sensor

20c: Pulsed laser light

30: Control switch

50: At least one on-off switch

40a, 40b, 40c, 40d: at least one linear resonant actuator

50: At least one on-off switch

100: Visually Impaired Aids

102: Telescopic part

102a: Secondary telescopic part

102b: Secondary telescopic part

102c: Secondary telescopic part

104: Main body

Claims (7)

A visually impaired aid, comprising: a main body with an accommodating space, wherein the part outside the accommodating space is configured with a control switch, an image capture module connected with a control module, a lidar a sensor, at least one on-off switch, an accelerometer sensor, a bluetooth module, and a power supply; a telescopic part, which is physically connected to the main body part and can be accommodated in the accommodating space of the main body part, One end far from the main body has a radar sensor, and the radar sensor is connected with the control module, and wherein the control switch controls the expansion and contraction of the telescopic part; and a driving module, respectively connected to at least one line A resonant actuator and the control module; wherein, the drive module is based on the image capture module, the lidar sensor, the at least one on-off switch, the acceleration module processed by the control module The signal input by the meter sensor, the radar sensor or the bluetooth module causes the at least one linear resonant actuator to vibrate to notify a visually impaired user to make an appropriate response; wherein the lidar The sensor senses distant obstacles in the environment, and feeds back a signal to the control module, and the control module instructs the drive module to drive the at least one linear resonant actuator according to the signal to generate vibration to remind The visually impaired user responds appropriately; wherein the image capture module captures the image of the environment and transmits it to the control module for real-time environment building simulation. The visually impaired aid as claimed in claim 1, wherein the control module is composed of a motherboard and a microcontroller. The visually impaired aid according to claim 1, wherein the at least one on-off switch is a capacitive on-off switch, a piezoelectric on-off switch or a piezoresistive on-off switch. The visually impaired aid as claimed in claim 1, wherein the control switch controls the expansion and contraction of the telescopic portion through an elastic element. The aid for the visually impaired as claimed in claim 1, wherein the radar sensor senses obstacles on the ground near the environment, and feeds back a signal to the control module, and the control module instructs the control module according to the signal The driving module drives the at least one linear resonance actuator to generate vibration to remind the visually impaired user to make an appropriate response. The visually impaired aid as claimed in claim 1, wherein the at least one on-off switch performs function setting on the visually impaired aid. The visually impaired aid as claimed in claim 1, wherein the visually impaired aid is paired with a mobile communication device through the bluetooth module, and used with at least one APP on the mobile communication device.

Images