GB2578684A - Object detection device - Google Patents

Object detection device Download PDF

Info

Publication number
GB2578684A
GB2578684A GB1913524.3A GB201913524A GB2578684A GB 2578684 A GB2578684 A GB 2578684A GB 201913524 A GB201913524 A GB 201913524A GB 2578684 A GB2578684 A GB 2578684A
Authority
GB
United Kingdom
Prior art keywords
range
signal
mode
processor
operable
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB1913524.3A
Other versions
GB201913524D0 (en
GB2578684B (en
Inventor
Manzouri Shahamat
John Callaway Patrick
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BAE Systems PLC
Original Assignee
BAE Systems PLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BAE Systems PLC filed Critical BAE Systems PLC
Publication of GB201913524D0 publication Critical patent/GB201913524D0/en
Publication of GB2578684A publication Critical patent/GB2578684A/en
Application granted granted Critical
Publication of GB2578684B publication Critical patent/GB2578684B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00Appliances for aiding patients or disabled persons to walk about
    • A61H3/06Walking aids for blind persons
    • A61H3/061Walking aids for blind persons with electronic detecting or guiding means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00Methods or devices for treatment of the eyes; Devices for putting-in contact lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/08Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/89Radar or analogous systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/02Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems using reflection of acoustic waves
    • G01S15/06Systems determining the position data of a target
    • G01S15/42Simultaneous measurement of distance and other co-ordinates
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • G01S15/89Sonar systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00Appliances for aiding patients or disabled persons to walk about
    • A61H3/06Walking aids for blind persons
    • A61H3/061Walking aids for blind persons with electronic detecting or guiding means
    • A61H2003/063Walking aids for blind persons with electronic detecting or guiding means with tactile perception
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/01Constructive details
    • A61H2201/0157Constructive details portable
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/01Constructive details
    • A61H2201/0173Means for preventing injuries
    • A61H2201/0184Means for preventing injuries by raising an alarm
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/16Physical interface with patient
    • A61H2201/1602Physical interface with patient kind of interface, e.g. head rest, knee support or lumbar support
    • A61H2201/1604Head
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/16Physical interface with patient
    • A61H2201/1602Physical interface with patient kind of interface, e.g. head rest, knee support or lumbar support
    • A61H2201/165Wearable interfaces
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50Control means thereof
    • A61H2201/5007Control means thereof computer controlled
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50Control means thereof
    • A61H2201/5023Interfaces to the user
    • A61H2201/5035Several programs selectable
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50Control means thereof
    • A61H2201/5058Sensors or detectors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50Control means thereof
    • A61H2201/5058Sensors or detectors
    • A61H2201/5082Temperature sensors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50Control means thereof
    • A61H2201/5097Control means thereof wireless
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Epidemiology (AREA)
  • Rehabilitation Therapy (AREA)
  • Pain & Pain Management (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Electromagnetism (AREA)
  • Ophthalmology & Optometry (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Vascular Medicine (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Abstract

A wearable or manually portable object-detection device 10 for visually impaired operators comprises a ranging device 2 operable to transmit an outward signal S and receive a return signal formed by reflections off an object. The device further includes a processor 4 in communication with the ranging device and operable to define or acquire a set of angular sectors within a volume, define or acquire a set of range gates within each angular sector and analyse the return to determine which sector and range gate at object lies within. The return signal is converted via a transducer 6 into a vibration signal, the frequency of which is selected according to the sector and range gate in which the object is detected.

Description

OBJECT DETECTION DEVICE
According to the following invention there is provided a wearable or manually portable object-detection device and a method of representing to a visually impaired operator, the range of an object.
People who are blind or who have impaired vision may find it difficult to navigate an environment safely. To improve safety, it is known to provide a walking cane comprising an ultrasound transceiver configured to provide a vibration to the user as proximate objects are detected.
According to a first aspect of the invention there is provided a wearable or manually portable object-detection device for visually impaired operators comprising: a ranging device operable to: transmit an outward signal for propagating onto an object, and receive a return signal formed by reflections of the outward signal off of an object; a processor in communication with the ranging device and operable to: define or acquire a set of angular sectors within a volume: define or acquire a set of range gates within each angular sector; analyse the return signal to determine which sector and range gate an object lies within; and convert the return signal into a vibration signal, the frequency of which is selected according to the sector and range gate in which the object has been detected; and a transducer for generating human-interpretable vibrations from the vibration signal.
The device may be operable in a first mode to scan each of the angular sectors separately such that returns from each may be differentiated.
The device may be operable in a second mode to scan the angular 25 sectors as one.
The first mode may define a first maximum scan range, and the second mode may define a second maximum scan range, wherein the second maximum scan range is greater than the first maximum scan range. -2 -
The device may comprise a switch operably connected to the processor for commuting between the first and second mode. The switch may be operator-controlled.
The device may be configured such that if operating in the second mode, the first mode is periodically activated for a scan period, the periodical activation thereby determining whether a set of switch-to-first criteria are satisfied at the processor, such that the first mode should persist beyond the scan period.
The first set of criteria may be satisfied if the device detects two or more objects in different angular sectors.
The device may be configured such that if operating in the first mode, the second mode is automatically activated at the processor if a set of switch-tosecond criteria are satisfied.
The switch-to-second criteria may be satisfied if only one object is detected across the set of angular sectors.
The device may further comprise an external communications module and an environmental characteristic memory, wherein the external communications module is operable to receive a predetermined signal associated with an environmental characteristic, apply the predetermined signal to the environmental characteristic memory, determine an operational mode associated with that environmental characteristic, and prompt operation of the device in the determined operational mode.
The processor may be further operable to perform change detection for a plurality of range cells and wherein the device is operable in a third mode wherein if return signals from a range cell do not vary above a threshold for a given period, a secondary vibration signal is issued, which differs from the vibration signal otherwise associated with that range cell. The secondary vibration signal could be a null signal where no vibrations were sent. The secondary vibration signal could be a touch-sensation signal such as could be provided by a haptic transducer. -3 -
The device may associates a unique secondary vibration signal for each range cell.
The device may comprise a secondary transducer for issuing the secondary vibration signal.
The ranging device may comprise a plurality of transmitter/receivers, one for each angular sector.
The processor may convert the return signal into the vibration signal such that for each range gate there is assigned a human-interpretable vibration having a unique frequency. The unique frequency of the human-interpretable vibration may be an audible frequency corresponding to a note on a predetermined musical scale.
Consecutive intra-sector range gates may have assigned to them consecutive notes on the musical scale.
Consecutive inter-sector range gates have assigned to them the same 15 note from consecutive octaves.
The device may be operable to define: a first set of contiguous range gates having a first precision level; and a second set of contiguous range gates having a second precision level, the first precision level having more range gates per metre than the second precision level.
So that the invention may be understood, at least one example embodiment thereof will now be described with reference to the following Figures, of which: Figure 1 shows a side elevation of a first embodiment of the invention, as 25 worn by a user; Figure 2 shows a plot of human-interpretable vibration signals for corresponding to range gates in an example embodiment; Figure 3 shows a plan elevation of a further embodiment of the invention, as worn by a user; and -4 -Figures 4a, 4b and 4c show plots of human-interpretable vibration signals for corresponding with range gates in the further embodiment.
Referring to Figure 1, there is shown an object detection device 10 worn by a user. The object detection device has the general form of a pair of glasses at least insofar as it comprises firstly a front section which rests on the user's nose such that the front section is generally in front of the eyes, and secondly a pair of arms, each extending from the front section to rest on an ear. Accordingly, the object detection device 10 moves with the user's head.
The object detection device 10 comprises a ranging device 2, a processor 4, and interface 5, and a transducer 6. The processor 4 is operably connected to the ranging device 2 and the transducer 6.
The ranging device 2 is configured to generate and transmit a physical signal into the ambient environment. Further, the ranging device 2 is configured to receive return signals from the ambient environment, created for example as the transmitted physical signal reflects off of objects in the ambient environment and back to the device 10.
In the present embodiment, the physical signal transmitted into the ambient environment is an acoustic wave S which has an inaudible ultrasonic frequency. This ultrasonic signal is transmitted as a pulse, repeated at a constant and predetermined interval (the Pulse Repetition Frequency -PRF). In the present embodiment, in order to receive signal returns from a range of 0 to 3 m, the PRF is set at between 10 to 60Hz, more particularly between 15 and 25Hz and still more particularly 20 Hz.
The ranging device 2 is configured to radiate the acoustic wave S along a major axis, or bore sight 8.
As shown in Figure 1, the object detection device 10 is arranged such that when worn, the physical signal, here an ultrasonic pulse, is transmitted generally downwards (e.g. so that if the operator defines a direction of gaze, the pulse is transmitted through a boresight 8 inclined at 20° rather than in -5 -alignment with the direction of gaze). This tends to comfortably direct the pulse to areas which are of concern to the operator.
In alternative embodiments, the ranging device 2 can be mounted at the object detection device 10 such that the boresight 8 is generally aligned with the direction the user's face is facing.
As the user moves their head, the section of the ambient environment illuminated by the acoustic wave S moves correspondingly. Various characteristics for the radiation pattern illuminating the volume are contemplated here; however an exemplary pattern would give an effective beam angle relative to the boresight of ±30° azimuth and ±30° elevation. The radiation pattern may be configured to match the field of view of a standard human.
The ranging device 2 is provided with a sensor for detecting return signals from the ambient environment. The sensor is configured to convert the acoustic vibrations from the return signal into an electrical representation of those returns. Electrical representations of the acoustic vibrations are referred to here as the electrical return signal.
The ranging device 2 is operably connected to the processor 4 such that the electrical return signal can be input to the processor 4. An analogue to digital converter (ADC) may be provided between the ranging device 2 sensor and the processor 4 in order to arrange the electrical return signal in a suitable format for the processor 4.
At the processor 4, the electrical return signal is analysed to determine a range for the object which is inferred to have given rise to the return signal.
Further, the processor 4 is configured to define a set of predetermined range gates in the ambient environment, each range gate corresponding to a section of the volume. For example and with reference to Figure 1, a first range gate, AB, is defined at nodes Al, Bl, B'l and All (where Al and Al both sit on a line of constant range, and where B1 and B'l sit on a line of constant range), a second range gate, BC, is defined at nodes B1, C2, Cl and B'1, and so on until the most distant range gate, GH, defined at G1, H1, H'1, and G'1. As -6 -shown in Figure 1, in the present embodiment, seven range gates are defined in this manner.
Moreover, the range gates are not all of the same range-interval (i.e. width between lines of constant range). The four closest-range range gates have the same short range-interval, the next two range gates have the same intermediate range-interval, and the furthest-range range gate has a long range-interval. As such, the processor 4 rasterises the ambient environment such that there are more range gates close to the ranging device 2 than there are at longer range.
With the range of the object determined, and the ambient volume divided into range gates, the processor 4 is configured to identify which range gate the object is present in.
Still further, the processor 4 is configured to, for each of the range gates, assign a unique vibration signal such that this vibration signal can be output by the processor if an object is determined as being present in that range gate.
This assignment or mapping operation may be carried out with reference to a look-up table, or could be performed according to a simple algorithm. Figure 2 shows diagrammatically the relationship used to map the range gates from Figure 1 to unique vibration signals.
In particular, returns from the closest range gate AB (with a range of between 0 and 25cm) are assigned a vibration signal with a 1000 Hz signal; returns from the second closest range gate BC (between 25cm and 50cm) are assigned a vibration signal with a 870Hz signal; returns from the third closest range gate CD (between 50cm and 75cm) are assigned a vibration signal with a 730Hz signal; returns from the fourth closest range gate DE (between 75cm and 100cm) are assigned a vibration signal with a 580Hz signal; returns from the fifth closest range gate EF (between 100cm and 150cm) are assigned a vibration signal with a 420Hz signal; returns from the sixth closest range gate FG (between 150cm and 200cm) are assigned a vibration signal with a 250Hz signal; returns from the seventh closest GH (i.e. furthest) range gate (between 200cm and 300cm) are assigned a vibration signal with a 100Hz signal. Thus -7 -each of the vibration signals has a frequency corresponding to a soundwave in the audible range.
As such, the device is configured so that: the nearest four range gates have the same range interval (25cm) and occupy a combined range gate 5 extending over range R; the next two nearest range gates have the same range interval (50cm) which is greater than the range interval for the nearest four range gates and occupy a combined range gate extending from range R to range 2R; and the farthest range gate has a range interval extending from range 2R to range 3R. Range gates are contiguous. The frequency change 10 between adjacent range gates is approximately constant (varying between 130Hz and 170Hz in the example of Figure 2).
With the range gate in which the object 0 is present having been detected, and with reference to the mapping algorithm, the processor 4 is operable to output a suitably selected vibration signal.
The processor 4 is operably connected to the transducer 6, which in the present example is a bone conducting headphone mounted on a bone structure close to the ear (e.g. the jaw), for issuing audible signals. In alternative embodiments there is provided an in-ear speaker which may be more colloquially referred to as an ear bud or a headphone. The transducer 6 is configured to receive the vibration signal from the processor 4 (a digital to analogue converter may be provided between) and convert the vibration signal into a human-interpretable soundwave/vibration signal. The human-interpretable soundwave/vibration signal has the same frequency as its corresponding vibration signal.
The transducer 6 may comprise, or further comprise, a haptic' transducer (i.e. an actuator for issuing a touch signal to the user) which may act in combination or as an alternative to the audible transducer. Certain range gates may be associated with the transducer providing a haptic vibration signal, in addition or as an alternative to the audible vibration signal. For example the closest range gate AB may, in addition or as an alternative to an audible 1000Hz signal, provide a haptic signal at that frequency. -8 -
By varying the range interval from range gate to range gate like this, whilst keeping constant the frequency change from range gate to range gate, and passing that to the operator as a human-interpretable vibration, the vibration frequency changes monotonically (e.g. as shown here it keeps going up as the range shortens) and the vibration frequency changes increasingly (i.e. for a given range interval, the difference in frequency across that range interval at a closer range will be greater than the difference in frequency across that range interval at a farther range).
In a particular approach to the mapping of ranges onto frequencies, the vibration frequency may vary exponentially with range. For example there may be an exponential decay in frequency with range such as a negative exponential relationship where plotting the range given by mid-point of the range gates against the frequency of the range gates yields a set of points along the line where f oc n-R (where f = frequency, n = a constant, R = range).
Alternatively, the monotonic and increasing relationship may be such that there is an inverse relationship between the frequency and the range, so that plotting the range given by mid-point of the range gates against the frequency of the range gates yields a set of points along the line where f oc Tel (where f frequency, R = range).
In operation a user wearing the object-detection device may find themselves in an environment where there is, for example, an object 0 present (as shown in Figure 1).
With the device 10 activated, the ranging device 2 will transmit an ultrasonic pulse S into the environment which will then propagate in the direction in which the user is facing.
On the illumination of an object 0 by the pulse S, an acoustic return signal will be generated, a component of which propagates back to the ranging device 2.
This acoustic/pulse return is received at the sensor of the ranging device 2, converted into an electrical return signal and relayed to the processor 4 -9 - (perhaps via an ADC). Time of pulse arrival information, relating to the acoustic/pulse return, may be determined at the ranging device 2 and incorporated into the electrical return signal, or may be inferred at the processor 4 from the time of arrival of the electrical return signal.
At the processor 4, the electrical return signal is analysed to determine the range of the object, then the corresponding range gate, and then the corresponding vibration signal for sending to the in-ear speaker 6.
The processor 4 may also perform a change detection operation by referring to a memory at the processor to determine whether the previously transmitted pulse S gave rise to the same finding. If performing a change-detection operation, the analysed returns from each pulse should be stored in the memory at least until the next pulse has been analysed and compared thereto.
Having determined the vibration signal to relay to the transducer 6, this 15 signal is relayed and the transducer 6 outputs an audible waveform at the selected frequency. In the present embodiment, the audible waveform is in the form of a number of pulses at the relevant frequency.
Thus the user will appreciate not only that there is an object present in front of them, but also will be able to infer the range of the object from the 20 frequency of the sound.
Whilst there is no innate association in the mind of the user between the frequency of a sound and the range of an object, the applicant has found that over time the user can build up that association, particularly if a consistent mapping of range gates to frequencies is used.
Moreover, if there is something recognisable about the choice of frequencies, a user can more readily adapt to the system. Thus, in alternative embodiments of the present invention, the frequencies chosen correspond to notes from a recognisable musical scale (for example C Major, western standard scale) where consecutive notes of that scale corresponded with consecutive range gates.
The object-detection device 10 may operable in different modes: An 'internal walk' mode where the sonar pulse is configured to give a maximum range of 2 m, and the human interpretable vibration is in the form of two audible pulses at the relevant frequency per range-gate change detected; An 'external walk' mode where the maximum range is 3m, and the human interpretable vibration is in the form of three audible pulses at the relevant frequency per range-gate change detected; A 'static/work' mode which is as per the 'internal walk' mode but any detections from the closest 0.5 m lead to no either human-interpretable vibration, or a secondary form of human-interpretable vibration (e.g. as may issue from a haptic transducer instead of an audible-signal speaker); and A 'constant' mode which is as per the 'external walk' mode regarding range but where the human-interpretable pulses are audible pulses repeated continuously at 0.5 Hz, the operator thereby receiving the audible signal irrespective of whether there has been a change in a range gate.
The user may switch between these modes using the interface 5 provided (e.g. buttons on the device, voice activation, gesture recognition) which communicates with the processor 4.
In other embodiments, the device 10 may be provided with an external communications module for interfacing with environmental transponders (e.g. GPS, locally placed RF beacons, BluetoothTM stations or WiFiTM stations) which may prompt the device 10 to switch to a particular mode. For example, where the external communications module is for GPS geo-location, the processor be configured to associated a specific location with a specific mode, so that on arriving at a designated static/work area (for example at a cashpoint/ATM) the static/work mode may be prompted.
Referring to Figure 3, a further embodiment of the wearable object detection device 20 is provided. This object detection device 20 is similar to the first embodiment at least in so far as there is an overall device 20 having the general form of glasses, which comprise a processor 24 operably connected between a transducer 27, and a central ranging device 22.
However, the object detection device 20 further comprises a port-side ranging device 21 and a starboard-side ranging device 23. Still further, the object detection device 20 comprises a further transducer 26 for the user's other ear.
As with the first embodiment, the central ranging device 22 is substantially aligned with the direction in which the user faces, and has a boresight shown at C. o The port-side ranging device 21 is inclined in the azimuth to the central ranging device 22 by approximately +45°. The port-side ranging device 22 defines a boresight shown at axis L, which is accordingly inclined to the central boresight 8 by +45° in Figure 3.
The starboard-side ranging device 23 is inclined in the azimuth to the central ranging device 22 by approximately -45°. The starboard-side ranging device 23 defines a boresight shown at axis R, which is accordingly inclined to the central boresight 8 by -45° in Figure 3.
Each ranging device 21, 22, 23, is operable to transmit a respective ultrasound pulse T, U, V along its respective boresight L, 8, R. In the present example, the pulses T, U and V have different pulse frequencies to one another, each has the same PRF of the first embodiment (e.g. 20Hz), and the pulses are emitted in phase with one another.
Given that the radiation patterns of each ranging device are adjacent to one another, each ranging device is configured such that the beam intensity defined by the radiation pattern drops off sharply once it is closer to another ranging device's boresight than its own. Thus the radiation pattern for the central ranging device 22 is substantially contained within the guidelines A2, B2, C2 and D2 and A3, B3, C3 and D3 (C1, C2, D1 and D2 are not shown in Figure 3 but can be inferred from Figure 1).
Each ranging device 21, 22, 23 comprises a sensor for detecting returns from its respective ultrasound pulse T, U, V, and generating a respective electrical return signal. Where each pulse has a distinct frequency, returns from one pulse can be readily distinguished from returns from other pulses.
Each of the ranging devices 21, 22, and 23 are operably connected to the processor 24 so that electrical return signals can be analysed to determine the range of the object and the ranging device which has detected it. (As shown in Figure 3, an object P is located in view of the star-board ranging device 23, pulse V is shown to have propagated beyond object P and so returns from to pulse P (not shown) will have been propagating back to the ranging device 23).
Moreover, to exploit the provision of ranging devices 21, 22, 23 which address a different azimuthal sector of the environment, the processor is configured to compartmentalise/rasterise the environment into range gates that are defined not only by range intervals but also by the azimuthal sectors associated with the respective range detectors. Thus, as can be seen in Figure 3, the processor defines a series of range gates such as those defined by: nodes A1, B1, B2, A2 (AB12); nodes A2, B2, B3, A3 (AB23); or nodes A3, B3, B4, A4 (AB34).
Once the environment is compartmentalised/rasterised according to such a predetermined scheme, the processor 4 can map each range gate onto a predetermined and unique vibration signal, and output the vibration signal associated with the range gate which is determined to have the object within it. In the present embodiment the vibration signal is output from the processor to the dual transducers 26, 27 such that each transducer receives the same signal.
Figures 4a, 4b, and 4c illustrate how the first three range gates are mapped to a frequency for each sector.
In particular, for the central ranging device 22 as shown in Figure 4b: the first (AB23) range gate, in the range interval 0 to R/2, corresponds to a 30 frequency of 2f; the second range gate (not shown in Figure 3), in the range interval R/2 to R, corresponds to a frequency of nf; and the third range gate (not shown in Figure 3), in the range interval R to 2R corresponds to a frequency of mf. 2f > of > mf > f.
Meanwhile, the range gates (AB12, etc.) associated with the port-side ranging device 21 have the same mapping to vibration signals as in the central ranging device 22 but with the frequency doubled (i.e. in the octave above).
Meanwhile, the range gates (AB34, etc.) associated with the starboard-side ranging device 23 have the same mapping to vibration signals as in the central ranging device 22 but with the frequency halved (i.e. in the octave below).
Thus, if an object moves across the user's field of regard from left/port to right/starboard, whilst remaining in the same range interval (e.g. AB), then three notes will be delivered to the user which are in harmony and have the impression of an ascending scale. In embodiments where the frequencies are chosen to represent the notes of a musical scale, these notes will be from an adjacent octave (e.g. C 523Hz, middle C 262 Hz and C 130Hz).
Further, if two objects are present, this can be indicated to the user by providing both of the relevant vibration signals at the same time.
Due to the selection of notes in adjacent octaves for adjacent azimuth sectors, there may prove to be fewer frequencies available to the user as compared with the single-sector ranging device 10 in the Figure 1 embodiment.
Therefore the further embodiment may provide larger range gates (i.e. range gates having a greater range interval) and/or a shorter maximum range.
The further embodiment may be operable in a plurality of different modes.
The first mode may be as already described, where all three of the ranging devices 21, 22, 23 are activated and the volume is compartmentalised additionally into azimuthal sectors.
The second mode may be where only the central ranging device 22 is activated, and the further embodiment therefore operates in a mode equivalent to the first embodiment of the object detection device 10.
In order to facilitate switching between modes, the object detection device 20 may be provided with a toggle switch 25, operably connected to the processor 24, to selectively activate the port and starboard ranging devices 21 and 23.
In alternative embodiments, the object-detection device may be provided with upper and lower range detectors which would provide for further compartmentalisation/rasterization of the volume into elevation sectors.
In alternative embodiments, a single ranging device may be provided which is capable of separately scanning in an azimuth or elevation direction to compartmentalise the volume. For example, the ranging device may be a phased array stepping through boresights in sequence, or a single ranging device mounted on a tip and/or tilt gimbal.
In alternative embodiments, the azimuth sector in which the object is detected could be indicated using a surround sound effect such that: objects associated with the central ranging device 22 could have a common vibration signal sent to each of the transducers 26, 27; objects associated with the port-side ranging device 21 would have a vibration signal sent only or predominantly to the left ear transducer 26; and objects associated with the starboard-side ranging device 23 would have a vibration signal sent only or predominantly to the right ear transducer 27.
In alternative embodiments, the object-detection device could be provided as part of another head-wearable item such as a hat, headband, or mask.
In alternative embodiments, the ranging device may make use of LIDAR instead or in combination with the ultrasound acoustic device described above.
In alternative embodiments of the multi-sector / multi-ranging device configuration, returns from ranging devices could be differentiated by firing each ranging device at a separate time, that is to say sufficiently out of phase such that returns from one ranging device are unlikely to lead to significant intensity returns at a further ranging device whilst that further ranging device is operating to receive returns from its particular pulse.
Typically, the transducer has the form of an earpiece for exciting the air within the operator's ear canal; however in an alternative arrangement, the transducer would be one configured for sending vibrations through the operator's skeletal system to the ear bones, or configured as a haptic device.
The ranging device may be operable in an 'object delineate' mode configured for determining the precise location of an object (e.g. a wallet or smartphone) adjacent to (e.g. lying on) another object (e.g. a table). In an object delineate' mode, a narrow ultrasonic pulse/beam is emitted, the volume is not compartmentalised into range gates (other than as limited by the ranging device 2), and an 'object delineate' audible signal is continually issued to the operator.
The 'object delineate' audible signals are not selected from a register of particular musical notes or predefined scales: it is a continuous mapping of the frequency range to the displacement ranges. The 'object delineate' mode can provide a monotonic and increasing interrelationship between range and frequency.
Whilst using the device 10 in the 'object delineate' mode, the user may for instance be directing the narrow pulses towards a table whilst aiming to locate a wallet lying somewhere on the table.
In order to perceive the range, a continuous audible waveform signal is issued to the operator. Thus as the operator sweeps their head back and forth, variations in the range of the object (e.g. variations in the displacement from the table top) will be converted into varying audible signals. Such audible variations will be smoothly changing as the head is swept over a smooth surface such as an uncluttered table; however if an object such as a wallet lying on the table represents a step-change in range, there will be a clear step step-change in the frequency of the audible signal. Thus the operator will be able to perceive a precise location where a step change in range occurs, and hence infer from this that there is a separate object there. The frequency change of the step-change will also suggest the height off of the table surface which that object stands.
In an alternative device, there is additionally provided a directional sensor for determining the temperature of certain areas of the environment. This directional temperature sensor is operably connected to the processor, and the processor is operable connected to a warning device. The processor can be configured to, if certain temperature criteria are met, activate the warning device to issue a distinct signal to the operator.
In particular the directional sensor could be a non-contact temperature sensor, operating at Infra-Red wavelengths (e.g. a laser temperature sensor). The directional sensor could be mounted to the device 10 at particular position and orientation, so that it senses along a known line of sight and the operator can learn and remember which region of the environment is being analysed. The directional sensor could alternatively be detachable from the device (whilst remaining operably connected to the processor e.g. by RF signalling standards such as standardised under IEEE 802.15.1) and manually pointed to enable the operator to understand their environment in finer detail and/or without swivelling their head.
In particular, the warning device could be the in-ear speaker 6 configured to issue voice signals such as "Warning! Temperature Hazard!".
In particular, the temperature criteria could be the detection of a temperature exceeding a maximum limit. In such cases, the warning device, embodied as an in-ear speaker could issue voice signals such as "Warning! Hot!" or "Warning! [read out measured temperature]!'.
Such an alternative device could facilitate the safe navigation of environments where harmful temperatures may be encountered, or where unpleasant temperatures may be encountered. For example: when in a kitchen, when operating a kettle, or when waiting for a hot beverage to cool to a suitable temperature.
Other temperature sensing devices may be provided as a stand alone device, that is to say as a device 10 without the ranging device 2 and its associated object ranging capability.

Claims (20)

  1. CLAIMS1. A wearable or manually portable object-detection device for visually impaired operators comprising: A ranging device operable to: transmit an outward signal for propagating onto an object, and receive a return signal formed by reflections of the outward signal off of an object; A processor in communication with the ranging device and operable to: Define or acquire a set of angular sectors within a volume: define or acquire a set of range gates within each angular sector; analyse the return signal to determine which sector and range gate an object lies within; and convert the return signal into a vibration signal, the frequency of which is selected according to the sector and range gate in which the object has been detected; and A transducer for generating human-interpretable vibrations from the vibration signal.
  2. 2. A device according to claim 1 wherein the device is operable in a first mode to scan each of the angular sectors separately such that returns from each may be differentiated.
  3. 3. A device according to claim 2, operable in a second mode to scan the 25 angular sectors as one.
  4. 4. A device according to claim 2 wherein the first mode defines a first maximum scan range, and the second mode defines a second maximum scan range, wherein the second maximum scan range is greater than the first maximum scan range.
  5. 5. A device according to claim 3 or 4 comprising a switch operably 5 connected to the processor for commuting between the first and second mode.
  6. 6. A device according to claim 5 wherein the switch is operator-controlled.
  7. 7. A device according to any of claims 5 or 6 configured such that if operating in the second mode, the first mode is periodically activated for a scan period, the periodical activation thereby determining whether a set of switch-tofirst criteria are satisfied at the processor, such that the first mode should persist beyond the scan period.
  8. 8. A device according to claim 7 wherein the first set of criteria are satisfied if the device detects two or more objects in different angular sectors.
  9. 9. A device according to any of claims 5 to 8 configured such that if operating in the first mode, the second mode is automatically activated at the processor if a set of switch-to-second criteria are satisfied.
  10. 10. A device according to claim 9 wherein the switch-to-second criteria are satisfied if only one object is detected across the set of angular sectors.
  11. 11. A device according to any one of claims 3 to 10 further comprising an external communications module and an environmental characteristic memory, wherein the external communications module is operable to receive a predetermined signal associated with an environmental characteristic, apply the predetermined signal to the environmental characteristic memory, thereby determine an operational mode associated with that environmental characteristic, and prompt operation of the device in the determined operational mode.
  12. 12. A device according to any one of the preceding claims, wherein the processor is further operable to perform change detection for a plurality of range cells and wherein the device is operable in a third mode wherein if return signals from a range cell do not vary above a threshold for a given period, a secondary vibration signal is issued, which differs from the vibration signal otherwise associated with that range cell.
  13. 13. A device according to claim 12 wherein the device associates a unique secondary vibration signal for each range cell.
  14. 14. A device according to claim 12 or claim 13 wherein the device comprises a secondary transducer for issuing the secondary vibration signal.
  15. 15. A device according to any one of the preceding claims wherein the ranging device comprises a plurality of transmitter/receivers, one for each angular sector.
  16. 16. A device according to any of the preceding claims wherein the processor converts the return signal into the vibration signal such that for each -20 -range gate there is assigned a human-interpretable vibration having a unique frequency.
  17. 17. A device according to claim 16 wherein the unique frequency of the human-interpretable vibration is an audible frequency corresponding to a note on a predetermined musical scale.
  18. 18. A device according to claim 17 wherein consecutive intra-sector range gates have assigned to them consecutive notes on the musical scale.
  19. 19. A device according to claim 17 or 18 wherein consecutive inter-sector range gates have assigned to them the same note from consecutive octaves.
  20. 20. A device according to any one of the preceding claims operable to 15 define: a first set of contiguous range gates having a first precision level; and a second set of contiguous range gates having a second precision level, the first precision level having more range gates per metre than the second precision level.
GB1913524.3A 2018-09-24 2019-09-19 Object detection device Active GB2578684B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GBGB1815541.6A GB201815541D0 (en) 2018-09-24 2018-09-24 Object detection device

Publications (3)

Publication Number Publication Date
GB201913524D0 GB201913524D0 (en) 2019-11-06
GB2578684A true GB2578684A (en) 2020-05-20
GB2578684B GB2578684B (en) 2021-07-14

Family

ID=64024163

Family Applications (2)

Application Number Title Priority Date Filing Date
GBGB1815541.6A Ceased GB201815541D0 (en) 2018-09-24 2018-09-24 Object detection device
GB1913524.3A Active GB2578684B (en) 2018-09-24 2019-09-19 Object detection device

Family Applications Before (1)

Application Number Title Priority Date Filing Date
GBGB1815541.6A Ceased GB201815541D0 (en) 2018-09-24 2018-09-24 Object detection device

Country Status (1)

Country Link
GB (2) GB201815541D0 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3337839A (en) * 1966-04-27 1967-08-22 Westinghouse Electric Corp Ultrasonic guidance apparatus
US6671226B1 (en) * 2001-06-01 2003-12-30 Arizona Board Of Regents Ultrasonic path guidance for visually impaired
US20080309913A1 (en) * 2007-06-14 2008-12-18 James John Fallon Systems and methods for laser radar imaging for the blind and visually impaired
WO2012090114A1 (en) * 2010-12-26 2012-07-05 Yissum Research Development Company Of The Hebrew University Of Jerusalem Ltd. Infra red based devices for guiding blind and visually impaired persons
US20180108225A1 (en) * 2016-10-17 2018-04-19 At&T Intellectual Property I, Lp. Wearable ultrasonic sensors with haptic signaling for blindside risk detection and notification

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3337839A (en) * 1966-04-27 1967-08-22 Westinghouse Electric Corp Ultrasonic guidance apparatus
US6671226B1 (en) * 2001-06-01 2003-12-30 Arizona Board Of Regents Ultrasonic path guidance for visually impaired
US20080309913A1 (en) * 2007-06-14 2008-12-18 James John Fallon Systems and methods for laser radar imaging for the blind and visually impaired
WO2012090114A1 (en) * 2010-12-26 2012-07-05 Yissum Research Development Company Of The Hebrew University Of Jerusalem Ltd. Infra red based devices for guiding blind and visually impaired persons
US20180108225A1 (en) * 2016-10-17 2018-04-19 At&T Intellectual Property I, Lp. Wearable ultrasonic sensors with haptic signaling for blindside risk detection and notification

Also Published As

Publication number Publication date
GB201815541D0 (en) 2018-11-07
GB201913524D0 (en) 2019-11-06
GB2578684B (en) 2021-07-14

Similar Documents

Publication Publication Date Title
US3172075A (en) Apparatus for furnishing information as to positioning of objects
US6011754A (en) Personal object detector with enhanced stereo imaging capability
US9335412B2 (en) Sonar transducer assembly
US7755744B1 (en) Environment sensor that conveys information about objects in the vicinity of the visually impaired user
US6298010B1 (en) Orientation aid for the blind and the visually disabled
AU2010297524B2 (en) Method and device for measuring a contour of the ground
FI87048B (en) ACOUSTIC SOEKARE.
US20080309913A1 (en) Systems and methods for laser radar imaging for the blind and visually impaired
JP2003523775A (en) Spatial recognition equipment
US20100278012A1 (en) Human echolocation system
Dunai et al. Sensory navigation device for blind people
US8570274B1 (en) Navigation device providing sensory feedback
EP3576427A1 (en) Haptics device for producing directional sound and haptic sensations
JPS62240033A (en) Azimuth measuring system for determining position of bounday layer in human body forming reflection
EP2941019B1 (en) Hearing aid with remote object detection unit
Bhatlawande et al. Way-finding electronic bracelet for visually impaired people
US7054226B1 (en) Method and apparatus for echolocation
Lopes et al. MobiFree: a set of electronic mobility aids for the blind
GB2578683A (en) Object detection device
CN108572367A (en) Sonar unit
RU2225991C2 (en) Navigation sonar to illuminate near situation
GB2578684A (en) Object detection device
JP2022501591A (en) THz measuring device and THz measuring method for detecting defects in the object to be measured
JP2006258591A (en) Infrared guiding system and user guide terminal device
RU93011227A (en) METHOD FOR ACOUSTIC SUBMISSION OF SPATIAL INFORMATION FOR DISABLED USE