EP3362766B1 - Guidage de personnes a l'aide de signaux acoustiques - Google Patents

Guidage de personnes a l'aide de signaux acoustiques Download PDF

Info

Publication number
EP3362766B1
EP3362766B1 EP16781365.8A EP16781365A EP3362766B1 EP 3362766 B1 EP3362766 B1 EP 3362766B1 EP 16781365 A EP16781365 A EP 16781365A EP 3362766 B1 EP3362766 B1 EP 3362766B1
Authority
EP
European Patent Office
Prior art keywords
person
mobile device
signal transmitter
signal
current position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP16781365.8A
Other languages
German (de)
English (en)
Other versions
EP3362766A1 (fr
Inventor
Florian Troesch
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inventio AG
Original Assignee
Inventio AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inventio AG filed Critical Inventio AG
Priority to PL16781365T priority Critical patent/PL3362766T3/pl
Publication of EP3362766A1 publication Critical patent/EP3362766A1/fr
Application granted granted Critical
Publication of EP3362766B1 publication Critical patent/EP3362766B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20—Instruments for performing navigational calculations
    • G01C21/206—Instruments for performing navigational calculations specially adapted for indoor navigation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00—Appliances for aiding patients or disabled persons to walk about
    • A61H3/06—Walking aids for blind persons
    • A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00—Appliances for aiding patients or disabled persons to walk about
    • A61H3/06—Walking aids for blind persons
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3629—Guidance using speech or audio output, e.g. text-to-speech
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3652—Guidance using non-audiovisual output, e.g. tactile, haptic or electric stimuli
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/003—Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/006—Teaching or communicating with blind persons using audible presentation of the information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00—Appliances for aiding patients or disabled persons to walk about
    • A61H3/06—Walking aids for blind persons
    • A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
    • A61H2003/063—Walking aids for blind persons with electronic detecting or guiding means with tactile perception
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50—Control means thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50—Control means thereof
    • A61H2201/5007—Control means thereof computer controlled
    • A61H2201/501—Control means thereof computer controlled connected to external computer devices or networks
    • A61H2201/5012—Control means thereof computer controlled connected to external computer devices or networks using the internet
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50—Control means thereof
    • A61H2201/5023—Interfaces to the user
    • A61H2201/5048—Audio interfaces, e.g. voice or music controlled
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50—Control means thereof
    • A61H2201/5058—Sensors or detectors
    • A61H2201/5064—Position sensors

Definitions

  • the technology described herein generally relates to the routing of a person with impaired vision along a path from a source to a destination.
  • Embodiments of the technology relate in particular to a method and a system for routing a person with impaired vision with the aid of spatially distributed signal generators.
  • WO 2010/037839 describes a method for routing a person in a building in which at fixed locations (doors, paths, branches, elevators, etc.) active connected to a computer system or passive connected to any computer system information points are present, each information point its local Position code stores.
  • the person can enter their disability and a destination using a guidance application on their mobile device. If the person comes to the reception area of an information point on the way to the destination, the mobile device receives the position codes of this information point and information for the routing is determined. The information for the routing is communicated to the person visually or acoustically by means of the mobile device.
  • WO 2010/037839 describes a way to route a person, there may be situations in which the communication of the guidance information for the person, especially if the person is almost or completely blind, may not be unique, because the understanding of the guidance information may depend on which direction the person and thus the mobile device are oriented. For example, a "straight ahead" instruction will head in the opposite direction as the person turns 180 degrees.
  • US 2005/0099291 describes a system for the routing of persons whose vision is limited.
  • the system includes a central computer and thereby controllable audio beacons. If a person in this system desires to be routed, they use their mobile phone to enter a destination. The computer then determines the path to the destination, calculates the distances between the audio beacons and controls the audio beacons. A person's position is determined in this system using RFID technology. As additional RFID devices are required, the complexity of the system increases.
  • One aspect of such a technology therefore relates to a method for routing a person in an area where a plurality of signalers are located at fixed locations.
  • a current position of a mobile device carried by the person in the area is determined and a signal generator is determined, which is to be reached next from the current position by the person next.
  • a control command is sent to the detected signal generator, wherein the control command causes the detected signal generator to generate a perceptible signal for the person.
  • the system includes a mobile device that is portable by the individual, a plurality of signalers located at fixed locations in the area, and a processor having processor executable software program for routing.
  • the processor determines a current position of the mobile device in the area, determines a signaler to be reached next from the current position by the person, and sends a control command to the detected signaler, the control command causing the detected signal generator, to generate a perceptible signal for the person.
  • the routing is based on audible acoustic signals that generate the signalers and on which the person can orient. If the person moves along a path towards a destination, the signal transmitter which is next on the way generates an acoustic signal in the direction of which the person can then walk. The acoustic signals are generated in temporal succession to guide the person from switch to switch along the way. In contrast to the above-mentioned prior art, the person does not orientate himself to information that is provided by his mobile device locally is communicated, but by means of generated at distant locations acoustic signals. It therefore does not matter how the person is currently standing or holding the mobile device.
  • blind persons usually have a better-than-average ear.
  • parameters of an acoustic signal eg. For example, volume, type (eg, continuous tone, modulated or pulsed tone), frequency, and duration
  • this property may be taken into account to select an audible signal that is audible to blind people but not distracting to others is uncomfortable.
  • One or more of these parameters may be optimized to facilitate orientation and / or localization; higher notes are z. B. better to locate than deeper tones.
  • the person may determine how certain signals should sound to them. Such a determination can be made using a software application installed on the mobile device.
  • the software application may display on a display a panel that, when in contact with the person, sounds the desired signal on the mobile device or a signal generator.
  • the audible signal may also be a voice message.
  • the time at which the relevant signal generator generates the acoustic signal is determined on the basis of the current location of the person.
  • the location is determined by the person's mobile device receiving the identifier of the signaling device located at that location.
  • the identifier and the location of the signal generator are stored in a data record so that the location can be determined therefrom. Based on the way the person is identified with the determined location of those signal generator, which is to generate the next an audible signal.
  • determining the signaler to be reached next from the current position by the person is performed by the mobile device.
  • the mobile device also executes the transmission of the control command to the detected signal generator.
  • the mobile device thus performs essential functions of the routing. This allows the Use of relatively simple and inexpensive signal generators, for example of Bluetooth beacons.
  • the current position is determined when a first buzzer receives data from the mobile device. If the signal transmitter, which is arranged at a fixed location, receives the data, the current position is set equal to the fixed position of the first signal transmitter. The mobile device is then at or near this switch.
  • the determination of the signal generator, which is to be reached next from the current position by the person is executed by a control device.
  • the sending of the control command to the determined signal generator can be carried out by the control device.
  • the control command may in one embodiment be sent over a network to which the signal transmitters are coupled.
  • the function of the routing can be performed essentially by the mobile device communicating with simple signaling devices or by the control device.
  • the controller communicates with the signalers, which in turn recognize whether the mobile device is in their vicinity.
  • the mobile device acts as a kind of signal generator, which sends out only its ID.
  • further flexibility in the implementation results from the fact that the person can be made in different places target proposals from which they can select one.
  • at least one destination proposal is generated, wherein the at least one destination proposal can be reached from the current position via a route.
  • the target proposal is transmitted to the person using the mobile device.
  • a signal generator which is located at the destination, determined and the control command is sent to the arranged at the destination signal generator to generate there by the signal generator the perceptible signal for the person.
  • the signalers and the mobile device are equipped with Bluetooth technology and communicate with each other by means of this technology.
  • Smartphones are typically already equipped with facilities for this technology, so no special mobile devices are needed for the routing described here.
  • Such smartphones can communicate with Bluetooth enabled signaling devices, so-called beacons.
  • the signal transmitters are arranged in such a way that adjacent signal transmitters or their locations can be reached without an obstacle located therebetween (eg wall, pillar, door, sales booth, etc.). If an obstacle exists, either because avoidance is not feasible or because of a temporary obstacle (eg construction site), a signal generator can be attached to this obstacle. This signaler can alert the person to this obstacle, for example.
  • an obstacle eg wall, pillar, door, sales booth, etc.
  • a signal generator can be attached to this obstacle. This signaler can alert the person to this obstacle, for example.
  • Fig. 1 is a schematic representation of an exemplary situation in a building 1, in which a person 2 moves by means of a route along a path 8 in the direction of a destination.
  • the person skilled in the art recognizes that the technology is not limited to a routing within the building 1, but also in other areas, z. B. outside the building 1 can be used, for example, for a route along streets.
  • the building 1 eg residential building, office and commercial building, hotel, sports arena, airport building, factory
  • the building 1 is thus to be understood as an example of an area in which the path can go.
  • Fig. 1 shows exemplary situation, the person 2, which carries a mobile device 6 with it, on a floor 20 and moves along the path 8.
  • the access 22 is for example a building exterior door through which the building 1, for example, at street level, enter and can be left.
  • Fig. 1 also shows several office or business premises 14, a common room 12, three elevators 10, a floor terminal 16 and a plurality of signal transmitters 4.
  • a lift control 18 also shown is communicatively connected to the elevators 10 and the floor terminal 16 (indicated by a double arrow 19) to control the elevators 10 according to a driving desire.
  • the path 8 can be defined in different ways.
  • the person 2 can z. B. wish to go from one starting point to a (single) destination, possibly on one or more intermediate destinations or places of interest.
  • the person 2 can already enter the desired destination at the starting point on the mobile device 6.
  • the path 8 to the destination is thus established before the person 2 starts walking along the path 8.
  • the route 8 defines the route between the starting point and the destination.
  • the destination and associated map material eg, floor plan, city map, etc.
  • the next signal transmitter 4 lying on the way 8 is determined and caused to generate a signal perceptible for the person 2.
  • an audible audible signal is generated. This procedure repeats itself automatically on each signal transmitter 4 lying on the way 8 and without further intervention of the person 2 until it reaches its destination.
  • the person 2 does not specify a destination. Instead, she can choose a destination at a current location. Based on the current location, the person's technology described here provides 2 possible destinations from which person 2 can select one.
  • the route 8 consists of the route from the current location to the next destination, and the technology described here guides the person 2 along the route 8 to the next destination. If another destination is selected there, a new route 8 is determined.
  • Fig. 2 shows the case mentioned that the person 2 does not specify a destination, by way of example in general form:
  • the person 2 can go from a place A to a place B. Having arrived there, the person 2 has the choice to go to possible and notified places Cl, C2 or C3.
  • the signal generator 4 arranged at the location C3 generates an audible signal which can be heard by the person 2 and which the person 2 can follow.
  • person 2 has the choice to go to location D1 or location D2.
  • Person 2 decides for location D2 (see solid arrow) and signal generator 4 located at location D2 generates an audible acoustic signal which person 2 can follow to location D2.
  • person 2 is from access 22 (location A) in the vicinity of access 22 (location B). There (location B) you have the choice to go either to elevator 10 (location C1), floor terminal 16 (location C2) or office 14 (location C3). Mobile device 6 audibly notifies these options in one embodiment.
  • the office 14 (location C3) the signal generator 4 arranged there generates an audible acoustic signal and the person 2 moves in the direction of the acoustic signal to reach the office 14 (location C3).
  • person 2 has the choice of either going to another office 14 (location D1) or to the common room 12 (location D2). If it selects the common room 12, the signal generator 4 arranged there generates an audible acoustic signal.
  • a similar situation may arise, for example, in a building 1 with several adjacent offices 14 or workplaces or in a shopping center with adjacent shops.
  • the mobile device 2 may display the names of the persons working in the offices 14 or the names of the stores.
  • the person 2 can z. In or in front of an office or shop, which person or business would like to reach them.
  • the signal generator 4 are individually controllable to cause the generation of a signal.
  • each signal generator 4 can be addressed via an individual identifier or address; For example, addressed in one embodiment, the mobile device 6 a control command to the desired signal generator 4.
  • each signal generator 4 with a control device 17 (s. Fig. 3 ), which drives the signal generator 4 either via individual signal lines, a bus system or network.
  • the control device 17 can address a control command to a desired signal generator 4.
  • the control command may be transmitted with a wire-bound signal and / or a radio signal.
  • the respective addressed signal generator 4 generates after receiving the control command, the signal, while possibly adjacent, but not addressed signal generator 4 remain silent.
  • a plurality of signal transmitters 4 can also be activated in order, for example, to generate a running light-like effect in the direction of the path 8.
  • the signal generator 4 are arranged at different locations within the building 1. For example, they may be located at locations that may be frequented by people within the building 1.
  • a signal generator 4 at different locations for. B. the rooms 12, 14, the access 22, in the vicinity of the access 22, the floor terminal 16 and the elevators 10 are arranged.
  • the signal generator 4 can also be arranged generally in the vicinity of these places.
  • the person skilled in the art recognizes that the number of signal transmitters 4 and their arrangement, including a distance to one or more adjacent signal transmitters 4, can be selected, for example, depending on the building situation.
  • adjacent beacons 4 can be arranged so that there are no obstacles in between.
  • the mobile device 6 carrying the person 2 is designed to receive data from a signal generator 4 (for example its identification number or identifier), by means of which a current location of the mobile device 6 is determined.
  • the reception takes place contactless, for example by scanning an optical code (eg QR code, bar code, color code) or establishing a radio connection based on one of the known Near Field Communication (NFC) technologies, Wi-Fi Direct, RFID or Bluetooth.
  • NFC Near Field Communication
  • the mobile device 6 has a device for determining position, for example a device for the global positioning system (GPS).
  • GPS global positioning system
  • a position determination system for buildings also known as an indoor positioning system (IPS)
  • IPS indoor positioning system
  • Such an IPS can be realized by correspondingly arranged local radio cells (eg WLAN nodes).
  • the position is determined using the signal generator 4.
  • the mobile device 6 is a Bluetooth enabled smartphone, and the signal generator 4 are also capable of Bluetooth accordingly.
  • a signal generator 4 is therefore referred to below as a “beacon” or as a “Bluetooth Beacon”.
  • the communication between the mobile device 6 (smartphone) and the beacons is thus carried out according to the Bluetooth standard, z. Bluetooth standard 4.0 (Bluetooth Low Energy (BLE)) or any other Bluetooth standard.
  • BLE Bluetooth Low Energy
  • Such beacons are usually battery-powered transmitters with low power consumption, which permanently emit a unique identification number (identifier) in a short interval of about one second according to a defined transmission protocol.
  • a beacon is addressable, for example by its MAC address (Media Access Control).
  • a beacon to be able to make a communicative connection with the mobile device 6 is in Fig. 1 illustrated by a symbol for a radio transmission.
  • the beacon may generate an audible signal from person 2.
  • This functionality is in Fig. 1 illustrated by a speaker icon.
  • a beacon with these functionalities for example, an Enterprise Beacon the company Onyx Beacon Ltd., Romania, can be used.
  • Such a beacon has a buzzer to generate an audible tone and an adhesive side to position the beacon in a desired location.
  • a speaker or buzzer may also be located separately from the beacon.
  • the speaker or buzzer can be connected to the beacon with a cable or wirelessly.
  • the beacon receives a control command from the mobile device 6, the beacon drives the speaker or buzzer according to the control command.
  • a beacon with a buzzer, or loudspeaker not only transmits the aforementioned identification number, but can also receive a control command addressed to it.
  • the beacon has an electronic circuit for receiving a corresponding radio signal.
  • a control command may cause the beacon to activate the buzzer to generate an audible signal.
  • a Bluetooth enabled smartphone can be used as a kind of beacon, even if it is not a stationary beacon.
  • the smartphone sends out its identifier at regular intervals, which then from another Bluetooth enabled device that is in range can be received.
  • shown terminal 16 may be or include such a Bluetooth enabled device. Similar to the distributed signal transmitters 4, several such Bluetooth-capable devices can be present in the area 1 at fixed locations, which are then also documented in the building plan.
  • the signal transmitters 4 send out their identification numbers, and the mobile device 6 determines the current position from a received identification number and then executes the routing, including the activation of the next signal generator 4.
  • the signal generator 4 communicate exclusively with the mobile device 6.
  • the mobile device 6 serves as a kind of mobile beacon and at least part of the routing function is outside the mobile device 6.
  • Fig. 3 a schematic representation of an exemplary communication system.
  • the communication system shown comprises a plurality of signal generators 4A and the above-mentioned control device 17, which are coupled to a network 11.
  • the person 2 is shown with their mobile device 6 moving along the path 8 and their mobile device 6 is also coupled to the network 11.
  • the network 11 may be provided for a wire-bound communication and / or a radio communication and may include a bus system, a LAN, a WLAN, a mobile radio network and / or the Internet.
  • the network 11 can also be part of an IT infrastructure for so-called cloud computing, which includes, for example, the storage of data in a remote data center, but also the execution of programs that are not installed locally but remotely installed.
  • a specific functionality may be installed in the mobile device 6 or made available via the "cloud”.
  • the signal generator 4A and the control device 17 are accordingly coupled to the network 11 by means of lines or radio links.
  • the in Fig. 3 shown signal generator 4A may not be configured as a beacon. In the in Fig. 3 shown embodiment, the signal generator 4A are therefore only with a symbol for a Speaker shown.
  • the determination of the current position of the mobile device 6 can take place, for example, by means of the GPS function present in the mobile device 6 or an above-mentioned indoor positioning system (IPS).
  • the mobile device 6 is configured to transmit the instantaneous function thus determined to the control device 17, for example by means of the mobile radio network. The control device 17 thus knows where the mobile device 6 is located.
  • the signal generator 4A can also be designed with a radio module (eg as a Bluetooth radio module) which communicates with the mobile device 6.
  • a radio module eg as a Bluetooth radio module
  • the signal generator 4A receives the ID of the mobile device 6 and transmits it in a message via the network 11 to the control device 17.
  • the control device 17 has a processor in which a software program for routing is executable.
  • the message may include an address of the transmitting signal transmitter 4A and / or may be received at a signal input of the control device 17 provided for the transmitting signal transmitter 4A.
  • control device 17 the locations of the individual signal generator 4A are stored. With knowledge of the address and / or the signal input, the control device 17 can identify the transmitting signal transmitter 4A and determine its location. The control device 17 thus knows that the mobile device 6 is located at the transmitting signal transmitter 4A.
  • the controller 17 determines the signal generator 4A, which is the next on the way 8.
  • the control device 17 then sends a control command to this signal generator 4A, either addressed to this or from a signal output, which is set for this signal generator 4A.
  • the signal generator 4A generates the signal.
  • the person skilled in the art recognizes that the technology described here for routing in the mobile device 6 (see FIG. Fig. 1 ) or in the control device (s. Fig. 3 ) can be implemented. In both embodiments, the mobile device 6 is used, which can be configured depending on where the routing is to be implemented.
  • Fig. 4 illustrates a smartphone as an example of a mobile device 6.
  • This is a memory device 38 (memory) and a processor 36 under a display 30 (touch screen) from the outside not visible (therefore indicated by dashed lines) arranged.
  • the Bluetooth function can be activated and deactivated, for example; The latter, for example, for the protection of privacy, because without movements of Bluetooth the movements and whereabouts of the person 2 in the building 1 can not be determined.
  • a software application for the routing of the person 2 can be activated and deactivated. If necessary, the person 2 can activate the Bluetooth function and the software application.
  • the software application may be automatically activated when a beacon is nearby, or always active when the mobile device 10 is turned on.
  • the smartphone as an exemplary mobile device 6 supports the person 2 in the routing. Since the person 2 has poor eyesight or is blind and optical displays on a display 30 of the mobile device 6 from the person 2 u. U. poor or not recognized, the smartphone can be designed specifically for such restrictions.
  • the smartphone can z. B. in terms of hardware and / or software (eg., By means of a software application) be configured for a voice input and voice output, so that the person 2 is guided, for example, with language support through a menu and a desired selection and / or input by her spoken commands can make.
  • the mobile device 6 can recognize a target spoken by the person 2, process it, and generate route guidance information. To illustrate example selections shows Fig. 4 multiple destinations (Destination A, Destination B, Destination C, Other), which are assigned on the display 30 different destination selection fields 32, 34.
  • the mobile device 6 can communicate these goals to the person 2 by voice.
  • a description of an exemplary method for routing is based on Fig. 5 ,
  • the routing is implemented in the mobile device 6, which communicates with the Bluetooth enabled signaling devices 4 (beacons).
  • the exemplary method starts in a step S1 and ends in a step S5.
  • the mobile device 6 and the beacons are part of a system that supports the routing of the person 2 along the path 8.
  • the current position of the mobile device 6 can thus be determined.
  • the mobile device 6 (or a software application for routing (routing application) installed thereon) uses the received identifier of a beacon to determine the location of this beacon and thus also its own location. The determination can either be made locally by the routing application or by an access to a remote database initiated by the routing application.
  • the routing application uses floor plan information and records stored in the mobile device 6 in the storage device 38.
  • Each record stores the location of a beacon along with its identifier.
  • the number of such records corresponds to the number of beacons.
  • the routing app When determined by accessing a remote database, the routing app initiates access to a database by means of a radio link.
  • the identifier is associated with data about a location where this beacon is located.
  • the database may be present in a storage system of a building management system, a storage system of a service provider or a storage system of the elevator control 18.
  • an identification parameter eg telephone number and / or device ID code (Media Access Control (MAC) address) of the mobile device 6 accessing the database can also be transmitted.
  • MAC Media Access Control
  • the instantaneous position of the mobile device 6 can also be determined with the aid of one of the above-mentioned systems GPS and IPS.
  • the routing application places the identified location in relation to the path 8.
  • the mobile device 6 may graphically plot the path 8 on a floor plan. Additionally, it may graph the current location along path 8 on the floor plan. The mobile device 6 can generate a corresponding voice message to communicate this information to the person 8, especially if their eyesight is severely limited.
  • the route guidance app determines which beacon lies closest to the route 8.
  • the routing app generates in a step S4 a control command that causes this beacon to generate an audible signal, for example by means of a buzzer.
  • the nature of the signal can be determined by the person 2 via the routing app so that the person 2 recognizes "their" signal even if several signals are generated in their environment for other routing purposes.
  • the person 2 hears this acoustic signal and can go in the direction of the beacon generating the acoustic signal. This process repeats along the path 8 at each beacon on the path 8 until the person 2 reaches their destination.
  • the audible signal may also include a warning or voice message, for example, to indicate an obstacle.
  • the voice message may u. May also indicate the nature of the obstacle.
  • an obstacle can be permanent or temporary.
  • the person 2 orients himself with the technology described here with the aid of the beacons which generate an acoustic signal.
  • the person skilled in the art recognizes that the person 2 can nevertheless also be transmitted by the mobile device 6 information for routing.
  • this information can be displayed on the display 30, z. B. as text, graphic Symbols (eg, arrows), maps and / or images of locations, by voice or other mechanism, such as by vibrating the mobile device 6.
  • the routing information informs or instructs the person 2, for example, where to go next and / or how big the distance to a next waypoint is.
  • the person 2 can also be told which elevator 10 to use, when to arrive on a particular floor, and / or how long the waiting time for the arrival of an elevator car is.
  • the person skilled in the art also recognizes that the route guidance information of the person 2 is also transmitted by means of so-called smartwatches or other wearables (eg spectacles with display and loudspeaker, possibly in conjunction with technology which enables the function of augmented reality) can.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Epidemiology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Veterinary Medicine (AREA)
  • Pain & Pain Management (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Rehabilitation Therapy (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Claims (14)

  1. Procédé, destiné à guider une personne (2) dans un territoire (1), dans lequel une pluralité de générateurs de signaux (4, 4A) est placée sur des emplacements déterminés, comprenant :
    la détermination d'une position momentanée d'un appareil mobile (6) embarqué par la personne (2) dans le territoire (1),
    la détermination d'un générateur de signaux (4, 4A), qui est censé être atteint à partir de la position momentanée, en tant que celui qui est le plus proche de la personne (2) ; et
    l'émission d'une instruction de commande à l'attention du générateur de signaux (4, 4A) déterminé, l'instruction de commande incitant le générateur de signaux (4, 4A) à générer un signal perceptible par la personne (2),
    caractérisé en ce que la position momentanée est déterminée lorsque l'appareil mobile (6) réceptionne des données de la part d'un premier générateur de signaux (4, 4A), les données qui sont mémorisées dans un ensemble de données d'une base de données, conjointement avec un emplacement du premier générateur de signaux (4, 4A) étant utilisées pour obtenir à partir de l'ensemble de données l'emplacement du premier générateur de signaux (4, 4A).
  2. Procédé selon la revendication 1, lors duquel la détermination du générateur de signaux (4, 4A), qui en partant de la position momentanée est censé être atteint comme étant le plus proche de la personne (2) est réalisée par l'appareil mobile (6).
  3. Procédé selon la revendication 2, lors duquel l'émission de l'instruction de commande à l'attention du générateur de signaux (4, 4A) déterminé est réalisée par l'appareil mobile (6).
  4. Procédé selon l'une quelconque des revendications 1 à 3, lors duquel la position momentanée est déterminée lorsque le premier générateur de signaux (4, 4A) réceptionne des données de la part de l'appareil mobile (6), la position momentanée étant assimilée à l'emplacement fixé du premier générateur de signaux (4, 4A).
  5. Procédé selon la revendication 1, lors duquel la détermination du générateur de signaux (4, 4A), qui à partir de la position momentanée est censé être atteint comme celui étant le plus proche de la personne (2) est réalisée par un système de commande (17).
  6. Procédé selon la revendication 5, lors duquel l'émission de l'instruction de commande à l'attention du générateur de signaux (4, 4A) déterminé est réalisée par le système de commande (17).
  7. Procédé selon l'une quelconque des revendications précédentes, comportant en outre :
    sur la base de la position momentanée, la génération d'au moins un but proposé, via un chemin (8), l'au moins un but proposé étant susceptible d'être atteint via un chemin (8), en partant de la position momentanée,
    la transmission de l'au moins un but proposé à la personne (2), en utilisant l'appareil mobile (6),
    après la sélection de la destination par la personne (2), la détermination d'un générateur de signaux (4, 4A), qui est placé à la destination et
    l'envoi de l'instruction de commande au générateur de signaux (4, 4A) placé à la destination, pour y générer via le générateur de signaux (4, 4A) le signal perceptible par la personne (2).
  8. Procédé selon l'une quelconque des revendications précédentes, lors duquel les générateurs de signaux (4, 4A) et l'appareil mobile (6) sont équipés de la technologie Bluetooth et communiquent entre eux à l'aide de cette technologie.
  9. Procédé selon l'une quelconque des revendications précédentes, lors duquel le signal généré est un signal acoustique.
  10. Système, destiné à guider une personne (2) dans un territoire (1), comprenant :
    un appareil mobile (6), susceptible d'être embarqué par la personne (2) et qui est conçu pour réceptionner des données de la part d'un générateur de signaux (4, 4A) ;
    une pluralité de générateurs de signaux (4, 4A), qui sont placés sur des emplacements fixés dans le territoire (1) et
    un processeur (17, 36), pourvu d'un programme logiciel exécutable dans le processeur (17, 36) pour le guidage, le processeur déterminant en fonctionnement une position momentanée de l'appareil mobile (6) dans le territoire (1),
    déterminant un générateur de signaux (4, 4A) qui en partant de la position momentanée est censé être atteint comme étant celui la plus proche de la personne (2) ; et
    envoyant une instruction de commande au générateur de signaux (4, 4A) déterminé, l'instruction de commande incitant le générateur de signaux (4, 4A) déterminé à générer un signal perceptible par la personne (2)
    caractérisé en ce que la position momentanée est déterminée lorsque l'appareil mobile (6) réceptionne des données de la part d'un premier générateur de signaux (4, 4A), les données qui sont mémorisées dans un ensemble de données d'une base de données, conjointement avec un emplacement du premier générateur de signaux (4, 4A) étant utilisées pour obtenir l'emplacement du premier générateur de signaux (4, 4A) à partir de l'ensemble de données.
  11. Système selon la revendication 10, dans duquel le processeur (36) est placé dans l'appareil mobile (6).
  12. Système selon l'une quelconque des revendications 10, dans lequel le processeur est placé dans un système de commande (17).
  13. Système selon l'une quelconque des revendications 10 à 12, dans lequel les générateurs de signaux (4, 4A) sont équipés d'une technologie Bluetooth.
  14. Système selon l'une quelconque des revendications 10 à 13, dans lequel chaque générateur de signaux (4, 4A) est adressable.
EP16781365.8A 2015-10-16 2016-10-10 Guidage de personnes a l'aide de signaux acoustiques Active EP3362766B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PL16781365T PL3362766T3 (pl) 2015-10-16 2016-10-10 Prowadzenie osób sygnałami dźwiękowymi

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP15190261.6A EP3156765A1 (fr) 2015-10-16 2015-10-16 Guidage de personnes a l'aide de signaux acoustiques
PCT/EP2016/074199 WO2017063992A1 (fr) 2015-10-16 2016-10-10 Guidage de personnes à l'aide de signaux acoustiques

Publications (2)

Publication Number Publication Date
EP3362766A1 EP3362766A1 (fr) 2018-08-22
EP3362766B1 true EP3362766B1 (fr) 2019-08-28

Family

ID=54337143

Family Applications (2)

Application Number Title Priority Date Filing Date
EP15190261.6A Withdrawn EP3156765A1 (fr) 2015-10-16 2015-10-16 Guidage de personnes a l'aide de signaux acoustiques
EP16781365.8A Active EP3362766B1 (fr) 2015-10-16 2016-10-10 Guidage de personnes a l'aide de signaux acoustiques

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP15190261.6A Withdrawn EP3156765A1 (fr) 2015-10-16 2015-10-16 Guidage de personnes a l'aide de signaux acoustiques

Country Status (8)

Country Link
US (1) US10441495B2 (fr)
EP (2) EP3156765A1 (fr)
KR (1) KR102595401B1 (fr)
CN (1) CN108139215B (fr)
AU (1) AU2016339106B2 (fr)
HK (1) HK1249928A1 (fr)
PL (1) PL3362766T3 (fr)
WO (1) WO2017063992A1 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016082875A1 (fr) * 2014-11-26 2016-06-02 Kone Corporation Système de navigation local
DE102017009187A1 (de) 2017-09-30 2019-04-04 Rtb Gmbh & Co. Kg Einrichtung zur Unterstützung der Mobilität sehbehinderter Personen im Straßenverkehr
CN110407043B (zh) * 2018-04-26 2023-01-13 奥的斯电梯公司 用于电梯服务请求的通信
US20210072027A1 (en) * 2019-09-09 2021-03-11 Caci, Inc. - Federal Systems and methods for providing localization and navigation services
CN110478206B (zh) * 2019-09-10 2022-02-15 李少阳 一种智能导盲系统及设备
DE102022000426A1 (de) 2022-02-04 2023-08-10 Rtb Gmbh & Co. Kg Sprechende Bake oder Absperrung
GR20220100657A (el) * 2022-08-08 2024-03-12 Κλεμαν Ελλας - (Kleeman Hellas) Ανωνυμος Βιομηχανικη Εμπορικη Εταιρεια Για Μηχανολογικες Κατασκευες Α.Ε., Μεθοδος και συστημα επικοινωνιας χρηστη και ανελκυστηρα με κωδικα μπραϊγ

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140335897A1 (en) * 2013-05-09 2014-11-13 KERBspace, Inc. Intelligent urban communications portal and methods

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2415071B (en) * 2002-08-06 2006-05-17 Hewlett Packard Development Co Method and arrangement for guiding a user along a target path
CN1685201B (zh) * 2003-02-24 2011-08-17 哈曼贝克自动系统股份有限公司 具有声音路径信息的导航系统
US7039522B2 (en) * 2003-11-12 2006-05-02 Steven Landau System for guiding visually impaired pedestrian using auditory cues
KR20060040013A (ko) * 2004-11-04 2006-05-10 엘지전자 주식회사 네비게이션 시스템에서 주행경로를 음성으로 안내하는 방법
KR20090004252A (ko) * 2007-07-06 2009-01-12 주식회사 엘비씨소프트 보행자 길 안내 시스템 및 방법
PT104120B (pt) 2008-06-30 2010-11-23 Metro Do Porto S A Sistema de orientação, navegação e informação especialmente adaptado para pessoas cegas ou amblíopes
KR100861094B1 (ko) * 2008-07-22 2008-10-01 주식회사 유비즈코아 위치추적 서비스 제공이 가능한 교통약자 안내 시스템 및방법
CH699676B1 (de) 2008-10-02 2015-11-30 Design Ag A Verfahren zur Wegleitung eines Benutzers in einem Gebäude.
WO2010108047A2 (fr) * 2009-03-18 2010-09-23 Intouch Graphics, Inc. Systèmes, procédés et logiciels pour fournir des données d'orientation et de guidage à des voyageurs aveugles
WO2012073698A1 (fr) * 2010-11-30 2012-06-07 インターナショナル・ビジネス・マシーンズ・コーポレーション Procédé, dispositif et programme d'ordinateur pour mapper une direction de mouvement au moyen de son
CN201903350U (zh) * 2010-12-16 2011-07-20 上海博泰悦臻电子设备制造有限公司 导航系统
KR101328121B1 (ko) * 2011-04-12 2013-11-13 휴앤에스(주) 교통약자용 지하철 음성안내 시스템
US8965697B2 (en) * 2011-11-10 2015-02-24 Mitsubishi Electric Corporation Navigation device and method
CN202383520U (zh) * 2011-12-22 2012-08-15 湖南城市学院 声音定位导航装置
EP2733502A1 (fr) 2012-11-15 2014-05-21 James Buchheim Balise de localisation et application radar pour dispositif mobile
EP2977782B1 (fr) * 2014-07-22 2020-11-18 Mitel Networks Corporation Système et procédé de positionnement
US9726746B2 (en) * 2015-03-06 2017-08-08 Sensible Innovations, LLC Audio navigation system for the visually impaired

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140335897A1 (en) * 2013-05-09 2014-11-13 KERBspace, Inc. Intelligent urban communications portal and methods

Also Published As

Publication number Publication date
CN108139215B (zh) 2021-10-15
AU2016339106B2 (en) 2019-09-26
KR20180070584A (ko) 2018-06-26
AU2016339106A1 (en) 2018-05-10
EP3362766A1 (fr) 2018-08-22
KR102595401B1 (ko) 2023-10-27
WO2017063992A1 (fr) 2017-04-20
HK1249928A1 (zh) 2018-11-16
CN108139215A (zh) 2018-06-08
US20180296427A1 (en) 2018-10-18
PL3362766T3 (pl) 2020-03-31
EP3156765A1 (fr) 2017-04-19
US10441495B2 (en) 2019-10-15

Similar Documents

Publication Publication Date Title
EP3362766B1 (fr) Guidage de personnes a l'aide de signaux acoustiques
DE60311443T2 (de) Positionsabhängige Fernüberwachung
DE60117093T2 (de) System zur Kartenbilddarstellung
EP3329475A1 (fr) Évacuation d'immeubles avec un système d'ascenseur
EP3274735B1 (fr) Système et procédé de poursuite du porteur d'une unité de communication mobile
Liao Using a smartphone application to support visually impaired pedestrians at signalized intersection crossings
CN102150190A (zh) 尤其适于盲人或视觉受损者的定向、导航和信息系统
EP2885778B1 (fr) Procédé d'élaboration et d'affichage d'informations d'horaires de transport
AT513140B1 (de) Verfahren zur wegleitung eines benutzers in einem gebäude
KR101154424B1 (ko) 음성 안내 시스템 및 음성 안내 방법
DE102018107737A1 (de) Verfahren zur Auswahl eines autonomen Fahrzeugs bei Verwendung einer Fahrzeugsteuerung
Hyun et al. Smart signage: Technology enhancing indoor location awareness for people with visual impairments
DE60301666T2 (de) Auslöseverfahren und vorrichtung für eine strassenbake
WO2017153143A1 (fr) Présentation d'informations d'orientation par un système d'éclairage
EP3324387A1 (fr) Système et procédé de guidage, en particulier pour personnes malvoyantes
DE102017220756A1 (de) Verfahren zum Navigieren zu einem sicheren Ort mithilfe einer Anwendung eines Endgeräts
AT15963U1 (de) Innenbereich-Navigation mittels Schall
DE102016218534B3 (de) Konzept zum visuellen Leiten einer reisenden Person
DE202005005851U1 (de) Einrichtung zur Informations-Anforderung zur Verwendung in Verkaufseinrichtungen
KR102013707B1 (ko) 교통신호 음성 안내 방법
JP2005215739A (ja) 歩行監視誘導システム
AT16632U1 (de) Verfahren zum Auffinden von Interessenspunkten mittels eines mobilen Gerätes
DE102023130204A1 (de) Adaptives mobiles Vor-Ort-Lautsprechersystem
DE102021201604A1 (de) System zum Bereitstellen kontextsensitiver Dienste
DE10014079A1 (de) Kommunikationseinrichtung, insbesondere zur Hilfeanforderung

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180315

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: G09B 21/00 20060101ALI20190121BHEP

Ipc: G01C 21/20 20060101AFI20190121BHEP

Ipc: H04W 4/02 20180101ALI20190121BHEP

Ipc: G01C 21/36 20060101ALI20190121BHEP

Ipc: A61H 3/06 20060101ALI20190121BHEP

RIC1 Information provided on ipc code assigned before grant

Ipc: H04W 4/02 20180101ALI20190315BHEP

Ipc: G09B 21/00 20060101ALI20190315BHEP

Ipc: G06F 3/16 20060101ALI20190315BHEP

Ipc: G01C 21/36 20060101ALI20190315BHEP

Ipc: G01C 21/20 20060101AFI20190315BHEP

Ipc: A61H 3/06 20060101ALI20190315BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190516

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1172963

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190915

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502016006336

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191230

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191128

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191128

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191228

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191129

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200224

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502016006336

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG2D Information on lapse in contracting state deleted

Ref country code: IS

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191010

26N No opposition filed

Effective date: 20200603

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20191031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191010

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20161010

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20210928

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20211026

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190828

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 1172963

Country of ref document: AT

Kind code of ref document: T

Effective date: 20211010

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20211010

REG Reference to a national code

Ref country code: NL

Ref legal event code: MM

Effective date: 20221101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221101

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231024

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20231026

Year of fee payment: 8

Ref country code: DE

Payment date: 20231027

Year of fee payment: 8

Ref country code: CH

Payment date: 20231102

Year of fee payment: 8