US20200372767A1 - Tactile Feedback Guidance Device - Google Patents
Tactile Feedback Guidance Device Download PDFInfo
- Publication number
- US20200372767A1 US20200372767A1 US16/895,616 US202016895616A US2020372767A1 US 20200372767 A1 US20200372767 A1 US 20200372767A1 US 202016895616 A US202016895616 A US 202016895616A US 2020372767 A1 US2020372767 A1 US 2020372767A1
- Authority
- US
- United States
- Prior art keywords
- servo motor
- lidar
- axis
- tactile feedback
- controller
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B6/00—Tactile signalling systems, e.g. personal calling systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/068—Sticks for blind persons
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/166—Mechanical, construction or arrangement details of inertial navigation systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4811—Constructional features, e.g. arrangements of optical elements common to transmitter and receiver
- G01S7/4813—Housing arrangements
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
- A61H2003/063—Walking aids for blind persons with electronic detecting or guiding means with tactile perception
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
- A61H2201/5092—Optical sensor
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C19/00—Gyroscopes; Turn-sensitive devices using vibrating masses; Turn-sensitive devices without moving masses; Measuring angular rate using gyroscopic effects
Definitions
- the present invention relates generally to a tactile feedback guidance device or walking assistant. More specifically, the invention relates to a walking wand which incorporates obstacle recognizing technology and one or more tactile feedback technologies and configurations to provide a walking wand with tactile responsive feedback to obstacles.
- the present invention provides a device and system for assisting an impaired vision user through use of a tactile feedback walking wand.
- the device makes use of one or more sensors, such as a Light Detection and Ranging (“LIDAR”) assembly, to identify objects and obstacles in the range of the walking wand. As obstacles are identified the device responds to such obstacles by providing various tactile (rotational & lateral) responses based on the type, size, and location of the object received.
- LIDAR Light Detection and Ranging
- the present invention provides a tactile responsive guidance device, comprising: a housing having one or more recesses for accommodating one or more components of the device; a LIDAR assembly positioned within the housing at a front end for detecting objects in front of the first end of the housing; a controller; a multi-axis tactile feedback assembly; an Inertial Measurement Unit (IMU) for sensing the current orientation of the device, sensing any changes in movement of the device, and for communicating with the LIDAR assembly and the controller; a power supply for supplying power to the LIDAR assembly, the controller, the multi-axis tactile feedback assembly and the IMU; and the controller receiving signals from the LIDAR assembly and the IMU related to objects identified by the LIDAR, the current position of the device by the IMU; and the controller determines the amount of force to provide to the multi-axis tactile feedback assembly and communicates with the multi-axis tactile feedback assembly to initiate movement along each axis of the multi-axis tactile feedback assembly; and the multi-axis tactile feedback assembly positioned within a first
- the multi-axis tactile feedback assembly can be configured as a three-servo motor cube configuration.
- the three-servo motor cube configuration can be comprised of three rotational servo motors.
- the three-servo motor cube configuration can be comprised of three lateral actuators.
- the three-servo motor cube configuration can be comprised of a first servo motor affixed to a first face of the cube to provide rotation around an X axis, a second servo motor affixed to a second face of the cube to provide rotation around a Y axis, and a third servo motor affixed to a third face of the cube to provide rotation around a Z axis.
- the multi-axis tactile feedback assembly can be a six-servo motor cube configuration.
- the six-servo motor cube configuration can be comprised of three rotational servo motors and three translational servo motors.
- the six-servo motor cube configuration can be comprised of three rotational servo motors and three lateral actuators.
- the present invention also provides a method for providing tactile feedback to a guidance device, the method comprising: receiving a signal from a lidar sensor of an object; determining the position of the device from an IMU of the device; determining movement of the device from the IMU; determining, by the processor, the appropriate force to supply in each of a plurality of axis to a multi-axis tactile feedback assembly; and transmitting a signal to the multi-axis tactile feedback assembly to provide a tactile response.
- the method further comprising the step of determining the appropriate force to supply a first servo motor, a second servo motor, and a third servo motor of the multi-axis tactile feedback assembly configured as a three-servo motor cube.
- the method further comprising the step of determining an appropriate rotation force and direction to supply a first servo motor affixed to a first face of the cube to provide rotation around an X axis, an appropriate rotation force and direction to supply a second servo motor affixed to a second face of the cube to provide rotation around a Y axis, and an appropriate rotation force and direction to supply a third servo motor affixed to a third face of the cube to provide rotation around a Z axis.
- FIG. 1 illustrates an exemplary embodiment of tactile feedback guidance device
- FIG. 2A illustrates an exemplary embodiment of a tactile servo motor configuration
- FIG. 2B illustrates an alternative exemplary embodiment of the tactile servo motor configuration
- FIG. 2C illustrates a six-servo motor configuration
- FIG. 3 illustrates ribs and channels of the tactile feedback walking wand.
- the present invention provides a device and system for assisting an impaired vision individual through use of a tactile feedback walking stick or walking wand.
- the device makes use of one or more sensors to identify objects and obstacles in the range of the walking stick. Those identified obstacles are identified by the device and the device responds to such obstacles by providing various tactile responses based on the type of object, size of the object, and location of the object received.
- the device includes multiple components including a power assembly, one or more servo motors in a logical configuration, an Inertial Measurement Unit (“IMU”), a controller, and a Light Detection and Ranging (“LIDAR”) assembly.
- IMU Inertial Measurement Unit
- LIDAR Light Detection and Ranging
- the present invention provides a tactile walking stick or tactile walking device 100 which is comprised of a housing 102 which houses a power unit 104 , one or more servo motors 106 , a micro controller or MCU 108 , an Inertial Measurement Unit (“IMU”) 110 , and a Light Detection and Ranging (“LIDAR”) unit 120 .
- the power unit 104 provides power to the device 100 including the servo motors 106 , the controller 108 , the IMU 110 , and the LIDAR unit 120 .
- the power unit 104 may consist of one or more power cells or batteries, which may be configured as a single unit or as multiple units throughout the housing 102 .
- the LIDAR unit 120 provides a remote sensing technology that can measure distance of an object by illuminating a target with a light beam (such as a laser light) and analyzing the reflected light that is received back by the LIDAR unit 120 .
- the LIDAR unit may use ultraviolet visible or near infrared light and can target a wide range of materials including non-metallic objects, rocks, rain and many other objects.
- the LIDAR unit can make use of narrow laser beam light which can map physical features with high resolution.
- a LIDAR unit will make use of 600-2000 nanometer lasers as they are relatively inexpensive. However, the unit may use a 1550 nanometer laser since such are eye safe.
- a LIDAR-LITE may be used which uses a 905 nm laser transmitter designated Class 1 for use during all procedures of operation. This means that the laser is safe to look at with the unaided eye. However, it is very advisable to avoid looking into the beam and power the module off when not in use.
- LIDAR technology also has the ability to provide three-dimensional elevation mapping of the terrain which can be used by the assisted walking device 100 to identify changes in elevation on the terrain for which the user is walking.
- the LIDAR unit 120 transmits light or light waves 122 and receives the reflected light to identify objects within the site line or site range of the LIDAR unit and walking range of the assisted walking stick 100 , the reflected light signals which identify the distance of objects and terrain mapping are sent to the controller 108 .
- the controller 108 works with the IMU 110 and the servo motors 106 to identify appropriate activation and movement of the servo motors 106 to provide the appropriate tactile response.
- the IMU 110 helps to determine the amount of inertial movement needed in each coordinate direction which is transmitted to the controller 108 which then controls the servo motors 106 to act accordingly.
- the controller may ideally be a micro controller unit (MCU) which is used to process the signals from the LIDAR unit 120 as well as the IMU 110 .
- the controller's primary function is to control the activation, deactivation, and intensity of each of the servo-motors 106 in the unit 100 based on inputs from the LIDAR 120 and IMU 110 .
- the IMU 110 may contain a gyroscope, accelerometer or a magnetometer in order to sense the device's current orientation and any changes or movement in the walking stick 100 based on the user's movement and use of the device 100 .
- the LIDAR unit 120 identifies an object (through reflected light signals 122 ) to the left of the walking stick 100 , and the walking stick 100 is being moved laterally to the left, the LIDAR unit 120 in conjunction with the IMU 110 would send a signal to the controller (or MCU) 108 .
- the signal would include the relevant data for the MCU 108 to determine the appropriate response.
- the MCU 108 would then provide a signal to the servo motor 106 to provide the correct tactile response.
- the two pieces of time series data fed in parallel into the MCU 108 are: (1) Rotational data where the IMU 110 gyroscope provides the rate of rotation as well as the orientation to the MCU 108 where the MCU 108 then knows how fast or slowly the wand device 100 is moving to the left, (2) acceleration data to capture the acceleration of the device minus gravity, (3) magnetometer data to provide absolute orientation and (4) depth data where the LIDAR 120 provides depth information at a point in time to the MCU 108 .
- the IMU 110 gyroscope While moving the walking stick to the left, the IMU 110 gyroscope would provide a constant angular velocity, but upon hitting the edge of the object, while the angular velocity may be the same (depending on how fast the user is using the wand 100 to scan the surface), the LIDAR 120 would measure an immediate decrease in distance in the case of a sharp-edged object.
- the MCU 108 would combine the information and know that due to a sharp change in distance while moving to the left, that there must be an object to the left.
- the MCU would then signal the servo motor 106 to provide an output result in clockwise rotation in the servo motors 106 along the Z-axis which would provide rotation in the walking stick 100 to the right.
- the controller 108 would then send signals to the servo motors 106 , or to a single server motor to control the rotation, duration, and strength of the tactile feedback to the user.
- the walking stick would then provide a tactile response which directs the user's hand to the right pulling the user away from the wall that the user is close to on the user's left and the left of the walking device 100 .
- the tactile response or the servo motors 106 may be in multiple axis and directions and may include multiple types of responses.
- the device may provide a slight tactile response in the opposite direction of the object such that the user knows they are to steer themselves slightly in the opposite direction.
- the device may both provide a tactile response in the opposite direction or opposite axis of the object but it also may provide a rotational tactile response indicating that the user is to turn quickly and/or stop.
- Another example may be a user walking towards the edge of a subway track, potentially falling into the track.
- the user may not be scanning the walking stick 100 left and right, but holding it still, pointing it in front of him/her, so that the walking stick 100 is pointing in front of him by a few feet (i.e. 3 feet).
- the IMU 110 would maintain constant orientation with zero rotational velocity.
- the LIDAR 120 which previously measured 3 feet would increase to a larger distance (i.e., 10 feet which is the distance to the bottom of the tracks).
- the walking stick 100 would behave by tilting and dipping the front tip of the walking stick downwards, which is achieved through servo clockwise actuation along the X-axis.
- the unit may provide a response with varying intensity levels such that a low intensity level might indicate the user is near, but not close to, an object and a harsh or heavy vibrational response indicates the user is extremely close to an object.
- the servo motor 106 may comprise one or more servo motors in various configurations. Such configurations might include three servo motors with each servo motor along a specific axis (such as the XYZ axis) of the device 100 . In this configuration, the controller 108 can control the intensity of the servo motors in each axis to provide the appropriate tactile response sought based on the observed obstructions.
- an additional configuration is provided which depicts a six-servo motor 106 configuration with the axis of each servo motor representing the six planes of a cube.
- the six-servo motor configuration 106 have the servos contained within the housing of the cube 106 .
- the six-servo configuration will be described in more detail in conjunction with FIG. 2C . Such a configuration would allow greater control and detail of the tactile feedback device within all directions of the device to provide an even greater level of tactile feedback response.
- FIG. 2B an alternative configuration is provided that depicts a three-servo motor cube 106 configuration.
- the three servo motors 204 X, 205 Y, and 206 Z may extend beyond the plane of the cube on the X, Y and Z axis.
- Servo motor 204 X representing rotation of the servo motor along the X axis.
- Servo motor 205 Y represents the rotation of the servo motor along the Y axis.
- Servo motor 206 Z represents the rotation of the servo motor along the Z axis.
- Servo motor 201 X, 202 Y and 203 Z, as seen in FIG. 2C are not required in this second embodiment.
- each servo motor executes a single translational or rotational movement relative to the device.
- the six-servo motor configuration 200 allows motion in six degrees of movement to simulate the entire range of motion in the tactile walking device 100 .
- Servo motor output may be translated in linear actuation or rotational actuation.
- Servo Motor 201 X for example, may be fixed rigidly to one face of the cube or to the housing and allows for translational movement along the X axis.
- Servo motor 202 Y and it corresponding bearing or elements may be fixed to another face of the cube and may provide translational movement along the Y axis.
- Servo motor 203 Z and its corresponding bearings or elements may provide translational movement along the Z axis and may be connected to or along a 3 rd face of the cube.
- Servo Motor 204 X and it corresponding bearings may be mounted on a fourth face or a rectangular frame and is adapted for rotation about a horizontal axis (the X axis).
- Servo Motor 205 Y and its corresponding elements may be mounted or fixed on a fifth face or a rectangular frame and is adapted for rotation about a vertical axis (the Y axis).
- Servo Motor 206 Z and its corresponding elements may be mounted on a 6 th face or on an interior frame and corresponds with a second horizontal axis (the Z axis).
- the servo motor 201 X, 202 Y, and 203 Z may be swapped out for micro linear actuator motors that can operate on their own, affixed to the housing, the servo cube 106 , or internal to the servo cube 106 .
- the linear actuators are capable of providing a push and pull force along their corresponding axes.
- each servo motor 204 X, 205 Y, and 206 Z can use rotation to enable 3 degrees of movement.
- each servo motor 204 X, 205 Y, and 206 Z can also act alone or in combination to counter rotational movement of one of the servo-motors to enable the device to exhibit six degrees of movement (rotational and translational movement along the X, Y, Z axis).
- the rotations are identified as RX, RY and RZ, and correspond to the operation of the servo motor 204 X, 205 Y and 206 Z.
- FIG. 3 provides an additional embodiment of the present invention.
- the tactile walking stick or tactile walking device 300 is comprised of an ergonomic style housing 102 which houses a power unit 104 , one or more servo motors 106 , a micro controller or MCU 108 , an Inertial Measurement Unit (“IMU”) 110 , and a Light Detection and Ranging (“LIDAR”) unit 120 .
- the unit 300 may include or may employ multiple LIDAR units, a LIDAR unit 120 with multiple transmitters and receivers (sensors), or a LIDAR unit 120 using an array for detecting objects and terrain in a wider field or range.
- the housing 102 may be in a molded and comfortable ergonomic design.
- a clam shell style housing 102 may be used and may be molded with walls and ribs 308 which help to form channels 305 and recesses 307 .
- the channels 305 may be used to route connections (i.e. power 306 ) between components.
- the walls and ribs 308 provide recesses 307 and spacing for fitting each component 104 , 106 , 108 , 110 , 120 .
- the servo cube 106 may sit within recess 307 formed by ribs 308 .
- the claim shell housing 102 and recesses 307 would encase the cube 106 so that each face or axis of rotation (see FIGS. 2A and 2B ) has contact with the housing 102 .
- the cube 106 within the recess 307 while still contacting the walls and ribs 308 enable the force exerted by the servo-cube 106 to extend to the housing 102 and thus exert its tactile effect on the user.
Abstract
A tactile or haptic guidance device incorporates a LIDAR assembly and servo motor assembly or linear actuators to provide tactile feedback to the user. The LIDAR assembly determines obstacles in the path of the user and the micro-controller uses the LIDAR data to send a signal to the servo motor assembly or linear actuators, which will cause translational or rotational movement along one or more axes with appropriate amounts of force to provide tactile feedback to the user about objects in their path.
Description
- The present application is a continuation of and claims priority to U.S. patent application Ser. No. 16/560,645 filed Sep. 4, 2019 the content of which is incorporated herein by reference in its entirety; patent application Ser. No. 16/560,645 claims priority to U.S. patent Ser. No. 10/431,056 which was filed on Mar. 8, 2018, the content of which is incorporated herein by reference in its entirety; this application, U.S. patent application Ser. No. 16/560,645, and U.S. patent Ser. No. 10/431,056 claim priority to U.S. Provisional Patent Application No. 62/468,854 filed Mar. 8, 2017, the content of which is incorporated herein by reference in its entirety.
- The present invention relates generally to a tactile feedback guidance device or walking assistant. More specifically, the invention relates to a walking wand which incorporates obstacle recognizing technology and one or more tactile feedback technologies and configurations to provide a walking wand with tactile responsive feedback to obstacles.
- This summary of the invention is provided to introduce concepts in a simplified form that are further described in the detailed description of the invention. This summary is not intended to identify key or essential inventive concepts of the claimed subject.
- The present invention provides a device and system for assisting an impaired vision user through use of a tactile feedback walking wand. The device makes use of one or more sensors, such as a Light Detection and Ranging (“LIDAR”) assembly, to identify objects and obstacles in the range of the walking wand. As obstacles are identified the device responds to such obstacles by providing various tactile (rotational & lateral) responses based on the type, size, and location of the object received.
- The present invention provides a tactile responsive guidance device, comprising: a housing having one or more recesses for accommodating one or more components of the device; a LIDAR assembly positioned within the housing at a front end for detecting objects in front of the first end of the housing; a controller; a multi-axis tactile feedback assembly; an Inertial Measurement Unit (IMU) for sensing the current orientation of the device, sensing any changes in movement of the device, and for communicating with the LIDAR assembly and the controller; a power supply for supplying power to the LIDAR assembly, the controller, the multi-axis tactile feedback assembly and the IMU; and the controller receiving signals from the LIDAR assembly and the IMU related to objects identified by the LIDAR, the current position of the device by the IMU; and the controller determines the amount of force to provide to the multi-axis tactile feedback assembly and communicates with the multi-axis tactile feedback assembly to initiate movement along each axis of the multi-axis tactile feedback assembly; and the multi-axis tactile feedback assembly positioned within a first recess of the one or more recesses, the recess configured to transmit forces exerted by multi-axis tactile feedback assembly to the housing to provide tactile feedback to the user of the device. The multi-axis tactile feedback assembly can be configured as a three-servo motor cube configuration. The three-servo motor cube configuration can be comprised of three rotational servo motors. The three-servo motor cube configuration can be comprised of three lateral actuators. The three-servo motor cube configuration can be comprised of a first servo motor affixed to a first face of the cube to provide rotation around an X axis, a second servo motor affixed to a second face of the cube to provide rotation around a Y axis, and a third servo motor affixed to a third face of the cube to provide rotation around a Z axis. The multi-axis tactile feedback assembly can be a six-servo motor cube configuration. The six-servo motor cube configuration can be comprised of three rotational servo motors and three translational servo motors. The six-servo motor cube configuration can be comprised of three rotational servo motors and three lateral actuators.
- The present invention also provides a method for providing tactile feedback to a guidance device, the method comprising: receiving a signal from a lidar sensor of an object; determining the position of the device from an IMU of the device; determining movement of the device from the IMU; determining, by the processor, the appropriate force to supply in each of a plurality of axis to a multi-axis tactile feedback assembly; and transmitting a signal to the multi-axis tactile feedback assembly to provide a tactile response. The method further comprising the step of determining the appropriate force to supply a first servo motor, a second servo motor, and a third servo motor of the multi-axis tactile feedback assembly configured as a three-servo motor cube. The method further comprising the step of determining an appropriate rotation force and direction to supply a first servo motor affixed to a first face of the cube to provide rotation around an X axis, an appropriate rotation force and direction to supply a second servo motor affixed to a second face of the cube to provide rotation around a Y axis, and an appropriate rotation force and direction to supply a third servo motor affixed to a third face of the cube to provide rotation around a Z axis.
- These and other objects, features, and/or advantages may accrue from various aspects of embodiments of the present invention, as described in more detail below.
- Various exemplary embodiments of this invention will be described in detail, wherein like reference numerals refer to identical or similar components or steps, with reference to the following figures, wherein:
-
FIG. 1 illustrates an exemplary embodiment of tactile feedback guidance device; -
FIG. 2A illustrates an exemplary embodiment of a tactile servo motor configuration; -
FIG. 2B illustrates an alternative exemplary embodiment of the tactile servo motor configuration; -
FIG. 2C illustrates a six-servo motor configuration; and -
FIG. 3 illustrates ribs and channels of the tactile feedback walking wand. - Particular embodiments of the present invention will now be described in greater detail with reference to the figures.
- The present invention provides a device and system for assisting an impaired vision individual through use of a tactile feedback walking stick or walking wand. The device makes use of one or more sensors to identify objects and obstacles in the range of the walking stick. Those identified obstacles are identified by the device and the device responds to such obstacles by providing various tactile responses based on the type of object, size of the object, and location of the object received. The device includes multiple components including a power assembly, one or more servo motors in a logical configuration, an Inertial Measurement Unit (“IMU”), a controller, and a Light Detection and Ranging (“LIDAR”) assembly.
- As shown in
FIG. 1 , the present invention provides a tactile walking stick ortactile walking device 100 which is comprised of ahousing 102 which houses apower unit 104, one ormore servo motors 106, a micro controller orMCU 108, an Inertial Measurement Unit (“IMU”) 110, and a Light Detection and Ranging (“LIDAR”)unit 120. In operation, thepower unit 104 provides power to thedevice 100 including theservo motors 106, thecontroller 108, the IMU 110, and the LIDARunit 120. Thepower unit 104 may consist of one or more power cells or batteries, which may be configured as a single unit or as multiple units throughout thehousing 102. In operation, the LIDARunit 120 provides a remote sensing technology that can measure distance of an object by illuminating a target with a light beam (such as a laser light) and analyzing the reflected light that is received back by the LIDARunit 120. The LIDAR unit may use ultraviolet visible or near infrared light and can target a wide range of materials including non-metallic objects, rocks, rain and many other objects. The LIDAR unit can make use of narrow laser beam light which can map physical features with high resolution. - In a preferred embodiment, a LIDAR unit will make use of 600-2000 nanometer lasers as they are relatively inexpensive. However, the unit may use a 1550 nanometer laser since such are eye safe. In one embodiment, a LIDAR-LITE may be used which uses a 905 nm laser transmitter designated Class 1 for use during all procedures of operation. This means that the laser is safe to look at with the unaided eye. However, it is very advisable to avoid looking into the beam and power the module off when not in use. LIDAR technology also has the ability to provide three-dimensional elevation mapping of the terrain which can be used by the assisted
walking device 100 to identify changes in elevation on the terrain for which the user is walking. - As the LIDAR
unit 120 transmits light orlight waves 122 and receives the reflected light to identify objects within the site line or site range of the LIDAR unit and walking range of the assistedwalking stick 100, the reflected light signals which identify the distance of objects and terrain mapping are sent to thecontroller 108. Thecontroller 108 works with theIMU 110 and theservo motors 106 to identify appropriate activation and movement of theservo motors 106 to provide the appropriate tactile response. Specifically, the IMU 110 helps to determine the amount of inertial movement needed in each coordinate direction which is transmitted to thecontroller 108 which then controls theservo motors 106 to act accordingly. - The controller may ideally be a micro controller unit (MCU) which is used to process the signals from the LIDAR
unit 120 as well as the IMU 110. The controller's primary function is to control the activation, deactivation, and intensity of each of the servo-motors 106 in theunit 100 based on inputs from the LIDAR 120 and IMU 110. The IMU 110 may contain a gyroscope, accelerometer or a magnetometer in order to sense the device's current orientation and any changes or movement in thewalking stick 100 based on the user's movement and use of thedevice 100. - By way of example, if the LIDAR
unit 120 identifies an object (through reflected light signals 122) to the left of thewalking stick 100, and thewalking stick 100 is being moved laterally to the left, the LIDARunit 120 in conjunction with the IMU 110 would send a signal to the controller (or MCU) 108. The signal would include the relevant data for theMCU 108 to determine the appropriate response. TheMCU 108 would then provide a signal to theservo motor 106 to provide the correct tactile response. - In this example, the two pieces of time series data fed in parallel into the
MCU 108 are: (1) Rotational data where theIMU 110 gyroscope provides the rate of rotation as well as the orientation to theMCU 108 where theMCU 108 then knows how fast or slowly thewand device 100 is moving to the left, (2) acceleration data to capture the acceleration of the device minus gravity, (3) magnetometer data to provide absolute orientation and (4) depth data where theLIDAR 120 provides depth information at a point in time to theMCU 108. While moving the walking stick to the left, theIMU 110 gyroscope would provide a constant angular velocity, but upon hitting the edge of the object, while the angular velocity may be the same (depending on how fast the user is using thewand 100 to scan the surface), theLIDAR 120 would measure an immediate decrease in distance in the case of a sharp-edged object. - The
MCU 108 would combine the information and know that due to a sharp change in distance while moving to the left, that there must be an object to the left. The MCU would then signal theservo motor 106 to provide an output result in clockwise rotation in theservo motors 106 along the Z-axis which would provide rotation in thewalking stick 100 to the right. - The
controller 108 would then send signals to theservo motors 106, or to a single server motor to control the rotation, duration, and strength of the tactile feedback to the user. In the event a large object, such as a wall, is identified to the left the walking stick would then provide a tactile response which directs the user's hand to the right pulling the user away from the wall that the user is close to on the user's left and the left of thewalking device 100. The tactile response or theservo motors 106 may be in multiple axis and directions and may include multiple types of responses. For example, if a user is getting close to an object but is not set to run into the object the device may provide a slight tactile response in the opposite direction of the object such that the user knows they are to steer themselves slightly in the opposite direction. However, if the user is headed in a direction such that they will impact an object, the device may both provide a tactile response in the opposite direction or opposite axis of the object but it also may provide a rotational tactile response indicating that the user is to turn quickly and/or stop. - Another example may be a user walking towards the edge of a subway track, potentially falling into the track. In this example, the user may not be scanning the
walking stick 100 left and right, but holding it still, pointing it in front of him/her, so that thewalking stick 100 is pointing in front of him by a few feet (i.e. 3 feet). TheIMU 110 would maintain constant orientation with zero rotational velocity. As the user approaches the edge, theLIDAR 120 which previously measured 3 feet would increase to a larger distance (i.e., 10 feet which is the distance to the bottom of the tracks). In such an instance, thewalking stick 100 would behave by tilting and dipping the front tip of the walking stick downwards, which is achieved through servo clockwise actuation along the X-axis. - Further, in addition to a tactile response being in one or more axis of directions or providing a rotational tactile response, the unit may provide a response with varying intensity levels such that a low intensity level might indicate the user is near, but not close to, an object and a harsh or heavy vibrational response indicates the user is extremely close to an object.
- The
servo motor 106 may comprise one or more servo motors in various configurations. Such configurations might include three servo motors with each servo motor along a specific axis (such as the XYZ axis) of thedevice 100. In this configuration, thecontroller 108 can control the intensity of the servo motors in each axis to provide the appropriate tactile response sought based on the observed obstructions. - As seen in
FIG. 2A , an additional configuration is provided which depicts a six-servo motor 106 configuration with the axis of each servo motor representing the six planes of a cube. The six-servo motor configuration 106 have the servos contained within the housing of thecube 106. The six-servo configuration will be described in more detail in conjunction withFIG. 2C . Such a configuration would allow greater control and detail of the tactile feedback device within all directions of the device to provide an even greater level of tactile feedback response. - As seen in
FIG. 2B , an alternative configuration is provided that depicts a three-servo motor cube 106 configuration. The threeservo motors Servo motor 204X representing rotation of the servo motor along the X axis.Servo motor 205Y represents the rotation of the servo motor along the Y axis.Servo motor 206Z represents the rotation of the servo motor along the Z axis.Servo motor FIG. 2C , are not required in this second embodiment. - In the embodiments depicted in
FIGS. 2A and 2B , each servo motor executes a single translational or rotational movement relative to the device. As seen inFIG. 2C , the six-servo motor configuration 200 allows motion in six degrees of movement to simulate the entire range of motion in thetactile walking device 100. Servo motor output may be translated in linear actuation or rotational actuation.Servo Motor 201X, for example, may be fixed rigidly to one face of the cube or to the housing and allows for translational movement along the X axis.Servo motor 202Y and it corresponding bearing or elements may be fixed to another face of the cube and may provide translational movement along the Y axis.Servo motor 203Z and its corresponding bearings or elements may provide translational movement along the Z axis and may be connected to or along a 3rd face of the cube.Servo Motor 204X and it corresponding bearings may be mounted on a fourth face or a rectangular frame and is adapted for rotation about a horizontal axis (the X axis).Servo Motor 205Y and its corresponding elements may be mounted or fixed on a fifth face or a rectangular frame and is adapted for rotation about a vertical axis (the Y axis).Servo Motor 206Z and its corresponding elements may be mounted on a 6th face or on an interior frame and corresponds with a second horizontal axis (the Z axis). - In an additional configuration, the
servo motor servo cube 106, or internal to theservo cube 106. The linear actuators are capable of providing a push and pull force along their corresponding axes. - In operation, each
servo motor servo motor servo motor -
FIG. 3 , provides an additional embodiment of the present invention. The tactile walking stick ortactile walking device 300 is comprised of anergonomic style housing 102 which houses apower unit 104, one ormore servo motors 106, a micro controller orMCU 108, an Inertial Measurement Unit (“IMU”) 110, and a Light Detection and Ranging (“LIDAR”)unit 120. Theunit 300 may include or may employ multiple LIDAR units, aLIDAR unit 120 with multiple transmitters and receivers (sensors), or aLIDAR unit 120 using an array for detecting objects and terrain in a wider field or range. As mentioned, thehousing 102 may be in a molded and comfortable ergonomic design. - A clam
shell style housing 102 may be used and may be molded with walls andribs 308 which help to formchannels 305 and recesses 307. Thechannels 305 may be used to route connections (i.e. power 306) between components. The walls andribs 308 providerecesses 307 and spacing for fitting eachcomponent servo cube 106 may sit withinrecess 307 formed byribs 308. Theclaim shell housing 102 and recesses 307, would encase thecube 106 so that each face or axis of rotation (seeFIGS. 2A and 2B ) has contact with thehousing 102. Thecube 106 within therecess 307 while still contacting the walls andribs 308 enable the force exerted by the servo-cube 106 to extend to thehousing 102 and thus exert its tactile effect on the user. - The features, structures, or characteristics of the invention described throughout this specification may be combined in any suitable manner in one or more embodiments. For example, the usage of “one embodiment,” “some embodiments,” “preferred embodiment,” “certain embodiments,” or other similar language, throughout this specification refers to the fact that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present invention. Thus, appearances of the phrases “one embodiment,” “some embodiments,” “a preferred embodiment,” “certain embodiments,” or other similar language, throughout this specification do not necessarily all refer to the same group of embodiments, and the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments
- Further, while certain embodiments have been described, these embodiments have been presented by way of example only and are not intended to limit the scope of the present disclosures. Indeed, the novel methods, apparatuses and systems described herein can be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods, apparatuses and systems described herein can be made without departing from the spirit of the present disclosures. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the present disclosures. For example, this technology may be structured for cloud computing whereby a single function is shared and processed in collaboration among a plurality of apparatuses via a network.
Claims (1)
1. A tactile responsive guidance device, comprising:
a. a LIDAR sensor for detecting objects in front of the device;
b. a controller;
c. a three-servo motor cube assembly;
d. an inertial measurement unit for sensing the current orientation of the device, sensing any changes in movement of the device, and for communicating with the controller; and
e. a power supply for supplying power to the LIDAR sensor, the controller, the three-servo motor cube assembly and the inertial measurement unit;
f. wherein the controller receives a LIDAR signal from the LIDAR sensor related to at least one object detected by the LIDAR sensor and a device position signal from the inertial measurement unit;
g. wherein the controller determines the amount of force to provide to the three-servo motor cube assembly and communicates with the three-servo motor cube assembly to initiate movement by the three-servo motor cube assembly; and
h. wherein the three-servo motor cube assembly is configured within the device to provide tactile feedback to the user of the device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/895,616 US20200372767A1 (en) | 2017-03-08 | 2020-06-08 | Tactile Feedback Guidance Device |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762468854P | 2017-03-08 | 2017-03-08 | |
US15/915,875 US10431056B2 (en) | 2017-03-08 | 2018-03-08 | Tactile feedback guidance device |
US16/560,645 US10679474B2 (en) | 2017-03-08 | 2019-09-04 | Tactile feedback guidance device |
US16/895,616 US20200372767A1 (en) | 2017-03-08 | 2020-06-08 | Tactile Feedback Guidance Device |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/560,645 Continuation US10679474B2 (en) | 2017-03-08 | 2019-09-04 | Tactile feedback guidance device |
Publications (1)
Publication Number | Publication Date |
---|---|
US20200372767A1 true US20200372767A1 (en) | 2020-11-26 |
Family
ID=63445470
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/915,875 Expired - Fee Related US10431056B2 (en) | 2017-03-08 | 2018-03-08 | Tactile feedback guidance device |
US16/560,645 Active US10679474B2 (en) | 2017-03-08 | 2019-09-04 | Tactile feedback guidance device |
US16/895,616 Abandoned US20200372767A1 (en) | 2017-03-08 | 2020-06-08 | Tactile Feedback Guidance Device |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/915,875 Expired - Fee Related US10431056B2 (en) | 2017-03-08 | 2018-03-08 | Tactile feedback guidance device |
US16/560,645 Active US10679474B2 (en) | 2017-03-08 | 2019-09-04 | Tactile feedback guidance device |
Country Status (1)
Country | Link |
---|---|
US (3) | US10431056B2 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20230096333A2 (en) * | 2019-09-27 | 2023-03-30 | United States Government As Represented By The Department Of Veterans Affairs | Navigation apparatus |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9389431B2 (en) * | 2011-11-04 | 2016-07-12 | Massachusetts Eye & Ear Infirmary | Contextual image stabilization |
US20170106738A1 (en) * | 2010-01-04 | 2017-04-20 | Carla R. Gillett | Self-Balancing Robot System Comprising Robotic Omniwheel |
US9703002B1 (en) * | 2003-10-04 | 2017-07-11 | SeeScan, Inc. | Utility locator systems and methods |
US10567641B1 (en) * | 2015-01-19 | 2020-02-18 | Devon Rueckner | Gaze-directed photography |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1907086B1 (en) * | 2005-06-27 | 2011-07-20 | Coactive Drive Corporation | Synchronized vibration device for haptic feedback |
CN101505710B (en) * | 2006-08-15 | 2012-08-08 | 皇家飞利浦电子股份有限公司 | Assistance system for visually handicapped persons |
US9410809B2 (en) * | 2011-12-16 | 2016-08-09 | Microsoft Technology Licensing, Llc | Applying a correct factor derivative method for determining an orientation of a portable electronic device based on sense gravitation component linear accelerate filter data obtained |
US20150097719A1 (en) * | 2013-10-03 | 2015-04-09 | Sulon Technologies Inc. | System and method for active reference positioning in an augmented reality environment |
WO2016070268A1 (en) * | 2014-11-04 | 2016-05-12 | iMerciv Inc. | Apparatus and method for detecting objects |
US20170024010A1 (en) * | 2015-07-21 | 2017-01-26 | Apple Inc. | Guidance device for the sensory impaired |
US20170136380A1 (en) * | 2015-11-18 | 2017-05-18 | Matthew Creedican | Smart Toys |
-
2018
- 2018-03-08 US US15/915,875 patent/US10431056B2/en not_active Expired - Fee Related
-
2019
- 2019-09-04 US US16/560,645 patent/US10679474B2/en active Active
-
2020
- 2020-06-08 US US16/895,616 patent/US20200372767A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9703002B1 (en) * | 2003-10-04 | 2017-07-11 | SeeScan, Inc. | Utility locator systems and methods |
US20170106738A1 (en) * | 2010-01-04 | 2017-04-20 | Carla R. Gillett | Self-Balancing Robot System Comprising Robotic Omniwheel |
US9389431B2 (en) * | 2011-11-04 | 2016-07-12 | Massachusetts Eye & Ear Infirmary | Contextual image stabilization |
US10567641B1 (en) * | 2015-01-19 | 2020-02-18 | Devon Rueckner | Gaze-directed photography |
Also Published As
Publication number | Publication date |
---|---|
US10431056B2 (en) | 2019-10-01 |
US20200005606A1 (en) | 2020-01-02 |
US10679474B2 (en) | 2020-06-09 |
US20180261055A1 (en) | 2018-09-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
García Carrillo et al. | Combining stereo vision and inertial navigation system for a quad-rotor UAV | |
JP2020091842A (en) | Orbital planner for transporter | |
Cutler et al. | Lightweight infrared sensing for relative navigation of quadrotors | |
Papoutsidakis et al. | Design of an autonomous robotic vehicle for area mapping and remote monitoring | |
CN106291567A (en) | A kind of laser radar, laser radar system and data processing method | |
US20200372767A1 (en) | Tactile Feedback Guidance Device | |
Tuvshinjargal et al. | Hybrid motion planning method for autonomous robots using kinect based sensor fusion and virtual plane approach in dynamic environments | |
KR102163462B1 (en) | Path-finding Robot and Mapping Method Using It | |
Heppner et al. | Enhancing sensor capabilities of walking robots through cooperative exploration with aerial robots | |
CN110799929B (en) | Display device for computer-mediated reality | |
KR101417431B1 (en) | System for producing 3d space information using lidar sensor | |
KR101061066B1 (en) | Sensor assembly for terrain detecting and autonomous vehicle having the same | |
Wang et al. | What Makes Robots? Sensors, Actuators, and Algorithms | |
JP2014188642A (en) | Robot and robot control method | |
Stegagno et al. | Vision-based autonomous control of a quadrotor UAV using an onboard RGB-D camera and its application to haptic teleoperation | |
Lee et al. | Collision avoidance by the fusion of different beam-width ultrasonic sensors | |
Demetriou | A Survey of Sensors for Localization of Unmanned Ground Vehicles (UGVs). | |
Srinivasan et al. | Multiple sensor fusion in mobile robot localization | |
KR102282802B1 (en) | Object tracking system of multi-axis control type | |
Gageik et al. | Data fusion principles for height control and autonomous landing of a quadrocopter | |
KR100948806B1 (en) | 3d wireless mouse apparatus using intertial navigation system and method of controlling the same | |
KR102652927B1 (en) | A drone for surveying | |
Berg | Navigation of a Mobile Robot with Obstacle Avoidance | |
San Woo et al. | Enhance implementation of flying robot auto-navigation system on FPGA for better performance | |
Ko et al. | A novel 6-degree of freedom man-machine interface using MEMS sensors and computer vsion |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |