EP3446671A1 - Guide stick - Google Patents

Guide stick Download PDF

Info

Publication number
EP3446671A1
EP3446671A1 EP17187553.7A EP17187553A EP3446671A1 EP 3446671 A1 EP3446671 A1 EP 3446671A1 EP 17187553 A EP17187553 A EP 17187553A EP 3446671 A1 EP3446671 A1 EP 3446671A1
Authority
EP
European Patent Office
Prior art keywords
walkway
guide stick
assistive
feature
defect
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP17187553.7A
Other languages
German (de)
French (fr)
Other versions
EP3446671B1 (en
Inventor
Berkin AKSOY
Onur AKDEMIR
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vestel Elektronik Sanayi ve Ticaret AS
Original Assignee
Vestel Elektronik Sanayi ve Ticaret AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vestel Elektronik Sanayi ve Ticaret AS filed Critical Vestel Elektronik Sanayi ve Ticaret AS
Priority to EP17187553.7A priority Critical patent/EP3446671B1/en
Priority to TR2017/12917A priority patent/TR201712917A2/en
Publication of EP3446671A1 publication Critical patent/EP3446671A1/en
Application granted granted Critical
Publication of EP3446671B1 publication Critical patent/EP3446671B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00Appliances for aiding patients or disabled persons to walk about
    • A61H3/06Walking aids for blind persons
    • A61H3/061Walking aids for blind persons with electronic detecting or guiding means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00Appliances for aiding patients or disabled persons to walk about
    • A61H3/06Walking aids for blind persons
    • A61H3/068Sticks for blind persons
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50Control means thereof
    • A61H2201/5007Control means thereof computer controlled
    • A61H2201/501Control means thereof computer controlled connected to external computer devices or networks
    • A61H2201/5015Control means thereof computer controlled connected to external computer devices or networks using specific interfaces or standards, e.g. USB, serial, parallel
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50Control means thereof
    • A61H2201/5058Sensors or detectors
    • A61H2201/5064Position sensors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50Control means thereof
    • A61H2201/5058Sensors or detectors
    • A61H2201/5092Optical sensor

Abstract

There is disclosed a guide stick for blind or partially sighted people. The guide stick comprises a communication device; and at least one sensor for sensing an assistive walkway feature for blind or partially sighted people. The arrangement is such that the communication device is configured to send a notification to a remote apparatus in response to detection by the at least one sensor of a defect with such an assistive walkway feature.

Description

    Technical Field
  • The present disclosure relates to a guide stick for blind or partially sighted persons.
  • Background
  • Guide sticks or canes are used by blind or partially sighted persons to assist them with avoiding hazards or obstacles when walking. They also serve to alert other walkers, drivers etc. that the user of the stick is blind or partially sighted. Typically, such a guide stick or cane is white in colour, which is widely recognised as being representative of a guide stick for blind or partially sighted people.
  • Summary
  • According to a first aspect there is provided a guide stick for blind or partially sighted people, the guide stick comprising: a communication device; and at least one sensor for sensing an assistive walkway feature for blind or partially sighted people; the arrangement being such that the communication device is configured to send a notification to a remote apparatus in response to detection by the at least one sensor of a defect with such an assistive walkway feature.
  • According to an example, the guide stick comprises a GPS device, enabling the guide stick to provide location information of the defect to the remote apparatus.
  • According to an example, the remote apparatus comprises a user equipment.
  • According to an example, the remote apparatus comprises an apparatus or server associated with a department or person responsible for the assistive walkway feature.
  • According to an example, the at least one sensor comprises a colour sensor arranged to detect a walkway feature comprising a coloured line.
  • According to an example, the at least one sensor is comprised at a tip end of the walking stick.
  • According to an example, the defect comprises damage to the assistive walkway feature.
  • According to an example, the defect comprises an absence of the assistive walkway feature.
  • According to an example, the guide stick is configured to distinguish between a valid absence of the assistive walkway feature and an invalid absence of the assistive walkway feature.
  • According to an example, the guide stick is configured to send the notification to a remote apparatus in response to detection of an invalid absence of the assistive walkway feature, and is configured to not send the notification to a remote apparatus in response to detection of a valid absence of the assistive walkway feature
  • According to an example, the communication device comprises a radio frequency communication device.
  • According to an example, the communication device has Bluetooth functionality.
  • According to a second aspect there is provided a system comprising: a user equipment; a remote apparatus; and a guide stick for blind or partially sighted people, the guide stick comprising: a communication device; and at least one sensor for sensing an assistive walkway feature for blind or partially sighted people; the arrangement being such that the communication device is configured to send a notification to the user equipment and/or the remote apparatus in response to detection by the at least one sensor of a defect with such an assistive walkway feature.
  • According to an example, the guide stick comprises a GPS device, and wherein in response to detection by the at least one sensor of a defect with such an assistive walkway feature, the guide stick is configured to send the notification and location information of the defect to the user equipment, the user equipment configured to forward the notification and location information to the remote apparatus.
  • According to an example, in response to detection by the at least one sensor of a defect with such an assistive walkway feature, the guide stick is configured to send the notification of the defect to the user equipment, the user equipment configured to use a GPS device of the user equipment to determine location information of the defect, the user equipment configured to forward the notification and location information to the remote apparatus.
  • Brief Description of the Drawings
  • To assist understanding of the present disclosure and to show how embodiments may be put into effect, reference is made by way of example to the accompanying drawings in which:
    • Figure 1 shows schematically an example of a walkway;
    • Figure 2 shows schematically an example of a system comprising a guide stick.
    Detailed Description
  • The present disclosure has applicability to guide sticks for blind and/or partially sighted persons. Such guide sticks may also be termed guide canes, walking canes, walking sticks etc. Using a known guide cane a user can feel for obstacles in their path by placing or gently waving the cane in front of them as they walk. Some modern guide canes, sometimes referred to as "smart canes", are fitted with an ultrasonic sensor which can sense a distance from an object, and provide feedback to the user.
  • Walkways may be fitted with one or more features for assisting blind or partially sighted people in using the walkway. Such a walkway may be, for example, a pavement or sidewalk, a path, a combined cycle and walkway, a road-crossing, steps or stairs, a ramp, an escalator, a travellator etc. Such an assistive feature may comprise, for example, a coloured line (sometimes referred to as a "blind-line"). The coloured line may be a bright colour such as yellow, orange or red. In some examples the coloured line is designed to contrast with the other sections of the walkway, which may be black or dark grey, for example. Such coloured lines can be useful even for people with significant sight loss, since they may still have sufficient sight to enable them to follow the coloured line. Even for completely blind people these coloured lines can be useful, since guide dogs can be taught to follow them.
  • Such assistive features may also comprise, for example, dimpled or otherwise textured walkway features. A blind or partially sighted person can feel the textured feature on the soles of their feet, e.g. through the soles of their shoes, to ascertain information regarding the walkway feature. For example, a dimpled walkway feature may provide information to a blind or partially sighted person that they are at a crossing, such as a road crossing or a crossing with another walkway. In another example raised lines may indicate to a blind or partially sighted person that they are about to step on to a cycle path or a combined walking and cycle path. The raised lines may be directional, with longitudinal facing lines (i.e. in the direction of the walkway) indicating a cyclist's side of the path, and lateral lines (i.e. in a direction across the path) indicating a walker's side of the walkway or path. These are just some examples of what may constitute an assistive walkway feature, and of course other types (or indeed any combination thereof) may be provided.
  • Such assistive walkway features can help keep a blind or partially sighted person safely on the walkway, for example so that they do not stray off the walkway and on to a road or in to other danger. Such assistive walkway features can also safely guide a walker to or over a road crossing, as well as warning the blind or partially sighted person as they approach the crossing.
  • Such assistive walkway features can become damaged or defective over time, and thus lose their functionality. This can also place users of such assistive features, such as blind or partially sighted people, in danger. Furthermore it may take a long time for the department responsible for maintaining the assistive feature (e.g. a local authority) to become aware of and fix the defect and/or damage. This may mean the assistive walkway feature being further damaged in that time, or at least not functioning properly for that time.
  • Figure 1 is a schematic plan view, showing a blind or partially sighted person 102 walking on a walkway 106. The blind or partially sighted person 102 is carrying a guide stick 104. The walkway 106 comprises an assistive feature 108 for assisting blind or partially sighted people along the walkway. For example the assistive feature 108 may comprise a coloured line, which contrasts in colour with adjacent parts of the walkway 106. The assistive feature 108 comprises a defective or damaged portion 110. The defect may comprise, for example, fading or even complete absence of the assistive feature. This may be due to the assistive feature wearing or fading away over time. The defect may comprise the assistive feature becoming obscured by one or more items. For example leaves may fall on to the assistive feature 108, reducing or eliminating the functionality of the assistive feature.
  • A further assistive walkway feature is shown at 112, comprising a plurality of raised portions or dimples 114. The assistive feature 112 is intended to warn blind or partially sighted people that they are approaching a road or another walkway 118. In this example the assistive feature 112 comprises defective or damaged portion 116. The defect 116 may comprise damage to one or more of the dimples, for example cracking of one or more dimples or absence of part of or complete absence of one or more dimples.
  • Figure 2 shows an example of a guide stick 204 according to an example. The guide stick 204 comprises a handle end 230 and a tip end 232. At or proximate to the tip end there is provided one or more sensors 238. The one or more sensors may comprise, for example, a colour sensor and/or an ultrasound sensor. A colour sensor may be configured to sense colour or colour contrast, and hence be able to sense the presence or absence (or fading) of an assistive feature such as a coloured line on a walkway. An ultrasonic sensor may be able to detect or determine a distance from another object. Therefore an ultrasonic sensor may be able to detect presence or absence (or damage) to a raised feature, such as dimples 114. The guide stick may, in some examples, provide feedback or an alarm to a user when a defect to an assistive feature is sensed. For example, the guide stick may be arranged to vibrate or provide an audible alarm to warn the user that the assistive feature is defective.
  • In this example the guide stick comprises a Global Positioning System (GPS) device 236. The GPS device can record location information of the guide stick 204. Consequently the guide stick 204, using the GPS device 236, can record location information of defects to assistive walkway features.
  • The guide stick 204 also comprises a communication device 234. The communication device 234 may be a radio frequency (RF) communication device. The communication device 234 may comprise a transmitter. The communication device 234 may also comprise a receiver. The communication device 234 may be in the form of a transceiver. The communication device 234 may have Bluetooth® functionality or capability. The communication device 234 enables the guide stick 204 to communicate with one or more remote apparatuses. For example the communication device 234 enables the guide stick 204 to communicate with a user equipment 246 of a user (the user being, for example, a user of the guide stick), as shown on line or communication channel 250. The user equipment may be, for example, a smart phone or tablet of the user. The user equipment 246 will typically comprise memory and processing capability, as well as GPS functionality. The communication device 234 may additionally or alternatively enable the guide stick 204 to communicate with a remote computer 248, as shown on line or communication channel 254. The remote computer 248 may comprise, for example, a computer or server of a department or person responsible for the assistive walkway feature. The department may be, for example, a local authority or a contractor to a local authority.
  • The guide stick 204 comprises a controller, shown schematically at 240. The controller 240 comprises a memory 242 and a processor 244. The controller 240 can, for example, receive and process information from one or more of communication device 234, GPS device 236, and at least one sensor 238. The controller can also control operations of communication device 234, GPS device 236, and at least one sensor 238.
  • The guide stick 204 also comprises a power source 235. The power source 235 may be a battery. In some embodiments the power source 235 comprises a rechargeable battery.
  • The guide stick 204 is configured to notify a person or department responsible when a defect to an assistive walkway feature is detected. For example this may be by means of informing remote apparatus 248. The remote apparatus 248 may be informed by direct communication between the guide stick 204 and remote apparatus 248 (e.g. on line 254), or by indirect communication via user equipment 246 (e.g. on lines 250 and 252).
  • For example, the at least one sensor 238 of the guide stick 204 may detect a defect with an assistive walkway feature. In response to this, the guide stick may use GPS device 236 to record the location of the defect. Notification of the defect, and location information of the defect, can then be provided to remote apparatus 248 on line or communication channel 254.
  • In an alternative example, the guide stick may provide notification of the defect and location information of the defect on line or communication channel 250 to user equipment 246. The user equipment 246 can then forward the defect notification and the location information to remote apparatus 248 on line or communication channel 252. Typically the user equipment 246 will be with or proximate to the user of guide stick 204, meaning that the communication on line 250 can be, for example, by means of Bluetooth communication. This may save power for the guide stick 204, and/or mean that a relatively less powerful and /or less expensive communication device 234 can be utilised since the communication device 234 in such examples does not have to be powerful enough to transmit directly to remote computer 248, which will typically be a much greater distance away than user equipment 246.
  • In some examples the GPS device 236 of the guide stick 204 can be omitted. In such examples the location information of a detected defect may be provided by the user equipment 246. For example, the at least one sensor 238 of the guide stick 204 may detect a defect in an assistive walkway feature. Using communication device 234 the guide stick 204 sends notification of the defect to user equipment 246. The user equipment 246, using its own GPS functionality, then sends the notification of the defect and the location information of the defect the remote apparatus 248. Such examples are applicable where the user equipment is being carried in close proximity to the user (e.g. in the user's pocket or handbag, rucksack etc.), such that the location of the user equipment still provides an accurate location of the defect.
  • Interoperability between the guide stick 204 and the user equipment 246 may be provided by means of an application or "app", which may be downloaded on to and stored at the user equipment 246.
  • According to some examples the guide stick 204 is configured to distinguish between valid (e.g. acceptable) and invalid (e.g. non-acceptable) defects (or possible defects). For example, where the potential defect is absence of a coloured guide line, then the guide stick is configured to determine whether this is an invalid absence, for example that the guide line should be there but has excessively faded or completely worn away, or a valid absence, for example it is the end of the walkway and therefore the guide line has terminated and intentionally proceeds no further. This prevents or reduces instances of false alarms. In some examples location information of correct or valid assistive walkway features is stored in the memory 242 of the guide stick 204, or obtained via user equipment 246. If a potential defect is detected, then a cross-check may be made with the information of correct location information of known walkway features, to determine whether the defect is "valid" or "invalid".
  • Examples may provide defect information of assistive walkway features, such as coloured "blind-lines", to a party responsible for maintenance of the assistive feature and/or walkway. This information may in some examples be provided in "real-time", and give the responsible party an accurate picture of the state of such assistive features at a given location or region. This information may be received by the responsible party far more quickly than depending upon routine or periodic inspection. This can help the responsible party not only fix any problems quickly, but also plan maintenance based upon given locations of the detected defects. This benefits not only users of blind or partially sighted people using the disclosed guide sticks (as shown for example in Figure 2), but also other blind or partially sighted people who rely on such assistive walkway features.
  • It will be understood that the processor or processing system or circuitry referred to herein may in practice be provided by a single chip or integrated circuit or plural chips or integrated circuits, optionally provided as a chipset, an application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), digital signal processor (DSP), graphics processing units (GPUs), etc. The chip or chips may comprise circuitry (as well as possibly firmware) for embodying at least one or more of a data processor or processors and a digital signal processor or processors, which are configurable so as to operate in accordance with the exemplary embodiments. In this regard, the exemplary embodiments may be implemented at least in part by computer software stored in (non-transitory) memory and executable by the processor, or by hardware, or by a combination of tangibly stored software and hardware (and tangibly stored firmware).
  • Reference is made herein to memory for storing data. This may be provided by a single device or by plural devices. Suitable devices include for example a hard disk and non-volatile semiconductor memory.
  • The examples described herein are to be understood as illustrative examples of embodiments of the invention. Further embodiments and examples are envisaged. Any feature described in relation to any one example or embodiment may be used alone or in combination with other features. In addition, any feature described in relation to any one example or embodiment may also be used in combination with one or more features of any other of the examples or embodiments, or any combination of any other of the examples or embodiments. Furthermore, equivalents and modifications not described herein may also be employed within the scope of the invention, which is defined in the claims.

Claims (15)

  1. A guide stick for blind or partially sighted people, the guide stick comprising:
    a communication device; and
    at least one sensor for sensing an assistive walkway feature for blind or partially sighted people;
    the arrangement being such that the communication device is configured to send a notification to a remote apparatus in response to detection by the at least one sensor of a defect with such an assistive walkway feature.
  2. A guide stick according to claim 1, the guide stick comprising a GPS device, enabling the guide stick to provide location information of the defect to the remote apparatus.
  3. A guide stick according to claim 1 or claim 2, the remote apparatus comprising a user equipment.
  4. A guide stick according to any of claims 1 to 3, the remote apparatus comprising an apparatus or server associated with a department or person responsible for the assistive walkway feature.
  5. A guide stick according to any of claims 1 to 4, wherein the at least one sensor comprises a colour sensor arranged to detect a walkway feature comprising a coloured line.
  6. A guide stick according to any of claims 1 to 5, wherein the at least one sensor is comprised at a tip end of the walking stick.
  7. A guide stick according to any of claims 1 to 6, wherein the defect comprises damage to the assistive walkway feature.
  8. A guide stick according to any of claims 1 to 7, wherein the defect comprises an absence of the assistive walkway feature.
  9. A guide stick according to claim 8, wherein the guide stick is configured to distinguish between a valid absence of the assistive walkway feature and an invalid absence of the assistive walkway feature.
  10. A guide stick according to claim 9, wherein the guide stick is configured to send the notification to a remote apparatus in response to detection of an invalid absence of the assistive walkway feature, and is configured to not send the notification to a remote apparatus in response to detection of a valid absence of the assistive walkway feature
  11. A guide stick according to any of claims 1 to 10, the communication device comprising a radio frequency communication device.
  12. A guide stick according to any of claims 1 to 11, the communication device having Bluetooth functionality.
  13. A system comprising:
    a user equipment;
    a remote apparatus; and
    a guide stick for blind or partially sighted people, the guide stick comprising:
    a communication device; and
    at least one sensor for sensing an assistive walkway feature for blind or partially sighted people;
    the arrangement being such that the communication device is configured to send a notification to the user equipment and/or the remote apparatus in response to detection by the at least one sensor of a defect with such an assistive walkway feature.
  14. A system according to claim 13, the guide stick comprising a GPS device, and wherein in response to detection by the at least one sensor of a defect with such an assistive walkway feature, the guide stick configured to send the notification and location information of the defect to the user equipment, the user equipment configured to forward the notification and location information to the remote apparatus.
  15. A system according to claim 13, wherein in response to detection by the at least one sensor of a defect with such an assistive walkway feature, the guide stick configured to send the notification of the defect to the user equipment, the user equipment configured to use a GPS device of the user equipment to determine location information of the defect, the user equipment configured to forward the notification and location information to the remote apparatus.
EP17187553.7A 2017-08-23 2017-08-23 Guide stick Active EP3446671B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP17187553.7A EP3446671B1 (en) 2017-08-23 2017-08-23 Guide stick
TR2017/12917A TR201712917A2 (en) 2017-08-23 2017-08-29 Guide stick.

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP17187553.7A EP3446671B1 (en) 2017-08-23 2017-08-23 Guide stick

Publications (2)

Publication Number Publication Date
EP3446671A1 true EP3446671A1 (en) 2019-02-27
EP3446671B1 EP3446671B1 (en) 2020-08-12

Family

ID=59686883

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17187553.7A Active EP3446671B1 (en) 2017-08-23 2017-08-23 Guide stick

Country Status (2)

Country Link
EP (1) EP3446671B1 (en)
TR (1) TR201712917A2 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19815073A1 (en) * 1998-04-05 1999-10-14 Gfal Sachsen Ev PC audio tactile information system for the blind and those with vision problems
US5973618A (en) * 1996-09-25 1999-10-26 Ellis; Christ G. Intelligent walking stick
US20060129308A1 (en) * 2004-12-10 2006-06-15 Lawrence Kates Management and navigation system for the blind
US20090032590A1 (en) * 2007-08-02 2009-02-05 Hopkins Billy D Location, orientation, product and color identification apparatus, system and method for the blind or visually impaired
WO2015192067A1 (en) * 2014-06-13 2015-12-17 Alibaba Group Holding Limited Method and guide cane for guiding the blind

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5973618A (en) * 1996-09-25 1999-10-26 Ellis; Christ G. Intelligent walking stick
DE19815073A1 (en) * 1998-04-05 1999-10-14 Gfal Sachsen Ev PC audio tactile information system for the blind and those with vision problems
US20060129308A1 (en) * 2004-12-10 2006-06-15 Lawrence Kates Management and navigation system for the blind
US20090032590A1 (en) * 2007-08-02 2009-02-05 Hopkins Billy D Location, orientation, product and color identification apparatus, system and method for the blind or visually impaired
WO2015192067A1 (en) * 2014-06-13 2015-12-17 Alibaba Group Holding Limited Method and guide cane for guiding the blind

Also Published As

Publication number Publication date
EP3446671B1 (en) 2020-08-12
TR201712917A2 (en) 2019-03-21

Similar Documents

Publication Publication Date Title
US20170007459A1 (en) Vision aiding method and apparatus integrated with a camera module and a light sensor
US10251788B1 (en) Assisting the visually impaired
KR101898582B1 (en) A stick for the blind
US7230538B2 (en) Apparatus and method for identifying surrounding environment by means of image processing and for outputting the results
WO2018156549A1 (en) Personal navigation system
US9997033B2 (en) Systems and methods for monitoring use of rail on a footpath
US10733879B2 (en) Roadside device, method of controlling roadside device and non-transitory storage medium
JP2007264732A (en) Pedestrian detector for vehicle
WO2015134045A1 (en) Multisensor system for the blind
JP5530530B2 (en) Vehicle periphery monitoring device
RU2017122948A (en) METHOD OF ASSISTING AT LEAST ONE ONE AFFECTED BY AN ACCIDENT OF A VEHICLE AND AN APPROPRIATE ASSISTANCE SYSTEM
EP3446671B1 (en) Guide stick
TWI592147B (en) Wearable objects around the body detection equipment
KR101349543B1 (en) Apparatus and method for controlling of signal light
JP5082897B2 (en) Type identification unit, automatic ticket gate, and maintenance device
KR102051592B1 (en) Method of protecting pedestrian using vehicle to vehicle communication and black box apparatus using thereof
CN107961144A (en) A kind of electronic blind-guiding system and method
JP5344349B2 (en) Passing time measurement system
TWI691328B (en) Smart aid system for visually impaired
KR20160008931A (en) system of voice guidance
KR20140072955A (en) Smart helmet and helmet image processing system having the same
KR20190101789A (en) Smart Cane for the Blind
JP6402004B2 (en) COMMUNICATION SYSTEM, COMMUNICATION DEVICE, COMMUNICATION METHOD, AND COMMUNICATION PROGRAM
JP7397575B2 (en) Traffic light control device and traffic light control method
JP6288556B2 (en) Pedestrian protection system and pedestrian protection program

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190827

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200302

RIN1 Information on inventor provided before grant (corrected)

Inventor name: AKSOY, BERKIN

Inventor name: AKDEMIR, ONUR

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602017021444

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1300805

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200915

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200812

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201113

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201112

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201112

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1300805

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200812

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201212

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200831

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200823

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200831

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602017021444

Country of ref document: DE

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

26N No opposition filed

Effective date: 20210514

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201012

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200823

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200812

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: TR

Payment date: 20230822

Year of fee payment: 7

Ref country code: GB

Payment date: 20230822

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20230821

Year of fee payment: 7