EP2653424B1 - Call registration device of elevator - Google Patents

Call registration device of elevator Download PDF

Info

Publication number
EP2653424B1
EP2653424B1 EP10860801.9A EP10860801A EP2653424B1 EP 2653424 B1 EP2653424 B1 EP 2653424B1 EP 10860801 A EP10860801 A EP 10860801A EP 2653424 B1 EP2653424 B1 EP 2653424B1
Authority
EP
European Patent Office
Prior art keywords
voice
section
call registration
registration
vocabulary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP10860801.9A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2653424A4 (en
EP2653424A1 (en
Inventor
Ayako Nagata
Shinichi Kuroda
Nobukazu Takeuchi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Publication of EP2653424A1 publication Critical patent/EP2653424A1/en
Publication of EP2653424A4 publication Critical patent/EP2653424A4/en
Application granted granted Critical
Publication of EP2653424B1 publication Critical patent/EP2653424B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B66—HOISTING; LIFTING; HAULING
    • B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B1/00—Control systems of elevators in general
    • B66B1/34—Details, e.g. call counting devices, data transmission from car to control system, devices giving information to the control system
    • B66B1/46—Adaptations of switches or switchgear
    • B66B1/468—Call registering systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B66—HOISTING; LIFTING; HAULING
    • B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B1/00—Control systems of elevators in general
    • B66B1/02—Control systems without regulation, i.e. without retroactive action
    • B66B1/06—Control systems without regulation, i.e. without retroactive action electric
    • B66B1/14—Control systems without regulation, i.e. without retroactive action electric with devices, e.g. push-buttons, for indirect control of movements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B66—HOISTING; LIFTING; HAULING
    • B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B2201/00—Aspects of control systems of elevators
    • B66B2201/40—Details of the change of control mode
    • B66B2201/46—Switches or switchgear
    • B66B2201/4607—Call registering systems
    • B66B2201/4615—Wherein the destination is registered before boarding
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B66—HOISTING; LIFTING; HAULING
    • B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B2201/00—Aspects of control systems of elevators
    • B66B2201/40—Details of the change of control mode
    • B66B2201/46—Switches or switchgear
    • B66B2201/4607—Call registering systems
    • B66B2201/4623—Wherein the destination is registered after boarding
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B66—HOISTING; LIFTING; HAULING
    • B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B2201/00—Aspects of control systems of elevators
    • B66B2201/40—Details of the change of control mode
    • B66B2201/46—Switches or switchgear
    • B66B2201/4607—Call registering systems
    • B66B2201/4638—Wherein the call is registered without making physical contact with the elevator system
    • B66B2201/4646—Wherein the call is registered without making physical contact with the elevator system using voice recognition
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B66—HOISTING; LIFTING; HAULING
    • B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B2201/00—Aspects of control systems of elevators
    • B66B2201/40—Details of the change of control mode
    • B66B2201/46—Switches or switchgear
    • B66B2201/4607—Call registering systems
    • B66B2201/4684—Call registering systems for preventing accidental or deliberate misuse

Definitions

  • the present invention relates to a call registration device of an elevator.
  • an elevator which performs car call registrations by button operations
  • car call registrations by button operations are sometimes difficult, for example, in the case where the sense of sight of a user is impaired, a user is carrying luggage or in the case where the elevator is very crowded. Therefore, there has hitherto been known an elevator provided with a voice call registration device which permits call registrations by voice input without requiring manual button operations.
  • a voice spoken by a user is inputted to a voice input section of a microphone and the like, this call registration device of an elevator recognizes the inputted voice and performs a call registration of a destination floor spoken by the user.
  • call registration devices of an elevator which perform call registrations by voice input
  • call registration devices of an elevator which are such that a button for canceling a call registration of each destination floor is provided for each floor (refer to Patent Literature 3, for example).
  • a button for canceling the call registration of the destination floor is provided for each floor.
  • the user can cancel the call registration of the unintended destination floor in question by operating a cancel button corresponding to the unintended destination floor in question.
  • call registration devices of an elevator which perform call registrations by voice input
  • call registration devices of an elevator which are such that in order to prevent wrong registrations by wrong recognition of voices, the number of voice call registrations which become what is called useless calls is counted and in the case where voice call registrations which become useless calls are performed a predetermined number of times or more, the call registrations are canceled (refer to Patent Literature 5, for example).
  • a useless call refers to, for example, what is called a back call (a call registration in which a floor present in a direction reverse to the movement direction of the elevator is a destination floor), a call registration of a floor at which the elevator in question is presently stopped, and the like.
  • Document US 4 558 298 describes an elevator call entry system comprising microphones, oral message recognizing units and voice print recognizing units.
  • a hold unit stores for certain time the most recent one of the speaker recognition parameters. The call to a floor is canceled when the voiceprint of the voice command calling for a call entry to said floor is coincident with data of the voice command calling for its cancellation.
  • Document JP S57 51664 A describes a control device for an elevator.
  • the control device enables registering a call by voice command.
  • the call registration may be held for a predetermined time and the destination call may be corrected.
  • the conventional call registration device of an elevator described in Patent Literature 2 is predicated on that each user performs a call registration using a voice remote control device, and there occurs the problem that this call registration device cannot be applied to an elevator in which such a voice remote control device is not used.
  • Another problem is that some users do not perform their call registrations again when their destination floors have already been registered, and for such users, when an original call registrant cancels the call registration in question, a call registration of a floor at which the users expect the elevator to stop can suddenly be canceled.
  • the present invention has been made to solve such problems as described above and the first object of the invention is to provide a call registration device of an elevator of a simple configuration which can appropriately cancel a call registration by voice input without the wrong cancellation of a call registration which is not intended to be cancelled by wrong voice recognition and the like.
  • the second object of the present invention is to provide a call registration device of an elevator of a simple configuration which can prevent in advance an unnecessary call registration, such as a wrong registration, from being performed during a call registration by voice input.
  • the call registration device of an elevator of the present invention has an advantageous effect of enabling appropriate cancellation of a call registration by voice input using a simple configuration without wrong cancellation of a call registration which is not intended to be cancelled by wrong voice recognition and the like.
  • Figures 1 and 2 relate to Embodiment 1 of the present invention.
  • Figure 1 is a block diagram showing the configuration of the call registration device of an elevator
  • Figure 2 is a flowchart showing the operations of the call registration device of an elevator.
  • reference numeral 1 denotes a voice input section which receives voice input spoken by a user of the elevator.
  • This voice input section 1 is composed of a device which converts sound waves to electrical signals, such as a microphone.
  • the voice input section 1 is installed in a hall of the elevator, which is not shown, and in a place in the car of the elevator, which is not shown, where a user easily inputs voices. Voices inputted to the voice input section 1 are converted to voice signals by the voice input section 1 and are then outputted.
  • the voice signals outputted from the voice input section 1 are inputted to a voice recognition section 2.
  • This voice recognition section 2 performs voice recognition processing by conducting the comparative checking of a voice inputted to the voice input section 1 against voice data which is stored in advance in a storage section 3.
  • the destination registration vocabulary voice data are voice data which are voice signals (voice waveform data) of a destination registration vocabulary representing destination floors of call registration (the destination registration vocabulary is, for example, "first" or “first floor” representing the first floor and “second” or “second floor” representing the second floor. Also, instead of the floor numbers, the destination registration vocabulary may be the floor names, such as "main floor” representing the main floor, and the names of representative facilities present on the floor).
  • the call registration canceling vocabulary voice data are voice data which are voice signals (voice waveform data) of a call registration canceling vocabulary which is a specific vocabulary for canceling a call registration (for example, "cancel" or "deregister”).
  • a vocabulary different from the destination registration vocabulary is set as this call registration canceling vocabulary.
  • the call registration canceling vocabulary is set in such a manner as not to include a vocabulary representing specific floors included in the destination registration vocabulary.
  • the voice recognition section 2 converts a voice signal (analog) from the voice input section 1 into a digital signal by performing analog-digital conversion (AD conversion).
  • a speech zone which is a voice part spoken by the user is cut out of this converted voice signal (digital).
  • voice recognition is performed by making a judgment as to whether or not the voice inputted to the voice input section 1 matches any of the destination registration vocabulary voice data and the call registration canceling vocabulary voice data.
  • Voice recognition results by this voice recognition section 2 are outputted to a voice call registration section 4.
  • the voice inputted to the voice input section 1 was judged to match a destination registration vocabulary
  • information on destination floors represented by the destination registration vocabulary in question is included in the voice recognition results outputted from this voice recognition section 2.
  • the voice inputted to the voice input section 1 was judged to match a call registration canceling vocabulary
  • information to the effect that a voice of the call registration canceling vocabulary was inputted to the voice input section 1 is included in the voice recognition results outputted from this voice recognition section 2.
  • the voice call registration section 4 outputs a call registration request or a call registration canceling request to an elevator control device 5 on the basis of the voice recognition results outputted from the voice recognition section 2.
  • the elevator control device 5 governs the control of the whole operation of the elevator.
  • objects of control by this elevator control device 5 include call registrations and responses to call registrations in an elevator.
  • the voice call registration section 4 outputs a call registration request to the destination floor in question to the elevator control device 5 on the basis of the information on destination floors included in the voice recognition results in question.
  • the elevator control device 5 which has received the call registration request from the voice call registration section 4 performs a call registration of the destination floor designated by the call registration request in question in accordance with the call registration request in question.
  • the voice call registration section 4 outputs the information on destination floors of the outputted call registration request to a notification section 6.
  • This notification section 6 is intended for notifying users of various kinds of information regarding the situation of the elevator, including voice recognition results, call registration results, and cancellation results of call registrations, which will be described later.
  • the notification section 6 is installed in an elevator hall and a car where the voice input section 1 is installed.
  • the notification section 6 is composed of a voice rumbling device, such as a speaker, and an indication device, such as a liquid crystal display. And the notification section 6 can notify users of various kinds of information by making a voice announcement from this voice rumbling device in the case where a voice rumbling device is provided, and by causing an indication device to indicate character information and image information in the case where this indication device is provided.
  • the notification section 6 which has received information regarding the destination floor of a call registration request from the voice call registration section 4, notifies users of voice recognition results by a voice announcement and a screen indication on the basis of this received information.
  • a voice announcement and a character indication are conceivable as specific contents to be notified to users; for example, "X-floor will be registered" (X is a numeral representing a destination floor). From the contents of the notification from the notification section 6, a user can get to know whether or not the destination floor intended by the user has been recognized.
  • the voice recognition section 2 may output a voice recognition result that a voice inputted to the voice input section 1 does not match any of predetermined vocabulary stored in the storage section 3 and is incapable of being recognized.
  • the voice recognition result reveals that the voice is incapable of being recognized, as a matter of course, a call registration is not performed.
  • a message to the effect that voice recognition is impossible may be given by the notification section 6 to the user.
  • information regarding voice recognition results is sent from the voice call registration section 4 to the notification section 6, and the notification section 6 notifies the user of the voice recognition results on the basis of the information from the voice call registration section 4.
  • the configuration may be such that information regarding call registration results is sent from the elevator control device 5, and not from the voice call registration section 4 to the notification section 6, and the notification section 6 notifies the user of the call registration results on the basis of the information from the elevator control device 5.
  • the configuration may be such that after a judgment is made in the elevator control device 5 as to whether or not the destination floor of a call registration request from the voice call registration section 4 is a floor at which the elevator cannot stop and hence a call registration is not permitted for the destination floor, the elevator control device 5 causes the notification section 6 to give a message corresponding to the judgment result to the user.
  • the configuration may be such that in the case where a call registration of the destination floor designated by the call registration request was possible, a registration confirming message (for example, "X-floor will be registered") is given from the notification section 6 and in the case where the destination floor of a call registration request is a floor at which the elevator cannot stop and is incapable of a call registration, a message about the impossibility of a registration (for example, "the registration could not be performed” and "the elevator cannot stop at X-floor” ) is given from the notification section 6.
  • a registration confirming message for example, "X-floor will be registered
  • the voice call registration section 4 On outputting a call registration request to the elevator control device 5, the voice call registration section 4 simultaneously holds the destination floor of the call registration request in question in a registered floor holding section 4a. In addition, on outputting a call registration request to the elevator control device 5, the voice call registration section 4 simultaneously (that is, at the same time with holding the destination floor of the call registration request in question in a registered floor holding section 4a), starts the measurement of the period of time in which a cancellation is possible, which is a predetermined period of time (for example, 2 to 3 seconds). Also within this period of time in which a cancellation is possible, the voice recognition section 2 performs voice recognition processing by conducting the comparative checking of a voice inputted to the voice input section 1 against the voice data stored in advance in the storage section 3.
  • a predetermined period of time for example, 2 to 3 seconds
  • the voice call registration section 4 outputs to the elevator control device 5 a call registration canceling request for canceling a call registration of the destination floor held in the registered floor holding section 4a at that point of time.
  • the elevator control device 5 which has received the call registration canceling request from the voice call registration section 4, cancels the call registration of the destination floor designated by the call registration canceling request in question in accordance with the call registration canceling request in question.
  • the voice call registration section 4 outputs to the notification section 6 the outputted information regarding the destination floor of the call registration canceling request.
  • the notification section 6 which has received the information regarding the destination floor of the call registration canceling request from the voice call registration section 4 notifies the user that the call registration was canceled by a voice announcement and a screen indication on the basis of this received information.
  • a voice announcement and a character indication for example, "the registration of X-floor has been canceled” and "the registration of X-floor has been deleted.” From the notification contents from the notification section 6, the user can get to know whether or not the call registration of the destination floor which was intended by the user to be cancelled has been canceled.
  • the voice call registration section 4 finishes the measurement of the period of time in which a cancellation is possible and erases the destination floor held in the registered floor holding section 4a. Also in the case where the period of time in which a cancellation is possible elapsed without the output of the voice recognition result from the voice recognition section 2 that a voice matching the registration canceling vocabulary is inputted to the voice input section 1, the voice call registration section 4 finishes the measurement of the period of time in which a cancellation is possible and erases the destination floor held in the registered floor holding section 4a.
  • the voice call registration section 4 outputs a call registration request to the elevator control device 5, and the destination floor of the call registration request is held in the registered floor holding section 4a.
  • the registered floor holding section 4a constitutes the destination floor holding section which holds the most up-to-date destination floor of the call registration request outputted from the voice call registration section 4 to the elevator control device 5.
  • the call registration device of an elevator operates in accordance with a series of operations of the flow shown in Figure 2 .
  • Step S1 it is ascertained whether or not there was an input of a voice spoken by a user to the voice input section 1.
  • the flow proceeds to Step S13, where the flow comes to an end.
  • the voice recognition section 2 performs voice recognition by conducting the comparative checking of the voice inputted to the voice input section 1 against the voice data stored in the storage section 3.
  • Step S3 As a result of the voice recognition in Step S2, it is ascertained whether or not the voice inputted to the voice input section 1 matches the destination registration vocabulary and the voice recognition section 2 recognized a destination floor. In the case where the voice inputted to the voice input section 1 did not match the destination registration vocabulary and hence destination floor was not recognized, the flow proceeds to Step S13, where the flow comes to an end. On the other hand, in the case where the voice recognition section 2 recognized a destination floor, the flow proceeds to Step S4.
  • Step S4 on the basis of the voice recognition results in the voice recognition section 2, the voice call registration section 4 outputs to the elevator control device 5 a call registration request to the destination floor recognized in Step S3, and the elevator control device 5 performs a call registration of the destination floor in question. Also, at the same time, the voice call registration section 4 sends information regarding the destination floor in question to the notification section 6, and the notification section 6 performs notification to the effect that "X-floor will be registered" and the like. After that, the flow proceeds to Step S5, where the voice call registration section 4 stores and holds the information on the destination floor of the call registration request outputted to the elevator control device 5 in the registered floor holding section 4a.
  • Step S6 the voice call registration section 4 starts the measurement of the period time in which a cancellation is possible. And in the case where a voice input to the voice input section 1 is performed within this period time in which a cancellation is possible, the flow proceeds from succeeding Step S7 to Step S8, where the voice recognition section 2 performs voice recognition by conducting the comparative checking of the voice inputted to the voice input section 1 against the voice data stored in the storage section 3. In the case where as a result of the voice recognition in Step S8, the voice inputted to the voice input section 1 matches the call registration canceling vocabulary and the voice recognition section 2 recognized the call registration canceling vocabulary (a call registration canceling keyword), the flow proceeds from Step S9 to Step 10.
  • Step S10 the voice call registration section 4 outputs to the elevator control device 5 the call registration canceling request to cancel the call registration of the destination floor held in the registered floor holding section 4a on the basis of the voice recognition results in the voice recognition section 2, and the elevator control device 5 cancels the call registration of the destination floor in question.
  • the voice call registration section 4 sends to the notification section 6 information to the effect that the call registration of the destination floor in question was canceled, and the notification section 6 performs notification to the effect that "X-floor has been canceled" (a cancel response).
  • Step S11 the voice call registration section 4 finishes the measurement of the period of time in which a cancellation is possible and resets the period of time in which a cancellation is possible.
  • Step S12 the voice call registration section 4 erases the information on the destination floor held in the registered floor holding section 4a.
  • Step S13 the flow proceeds to Step S13, where a series of operations of the flow comes to an end.
  • Step S7 there was no voice input to the voice input section 1 within the period of time in which a cancellation is possible, or in the case where although there was a voice input to the voice input section 1 within the period of time in which a cancellation is possible, the voice inputted to the voice input section 1 in Step S9 did not match the call registration canceling vocabulary and the voice recognition section 2 did not recognize the call registration canceling vocabulary, the flow proceeds from these steps to Step S11, where the period of time in which a cancellation is possible is reset and subsequently, the information on the destination floor held in the registered floor holding section 4a is erased (Step S12). Thereafter, the flow proceeds to Step S13, where a series of operations of the flow come to an end.
  • Step S6 upon start of the period of time in which a cancellation is possible, in order to inform users of that call registrations can be canceled, an announcement of starting the period of time in which a cancellation is possible, for example, "please, speak "cancel" for cancelation" may be made from the notification section 6.
  • the call registration in question is determined. Therefore, in the case where the period of time in which a cancellation is possible has elapsed without going through Step S10, it is possible to make an announcement about the determination of a registration, for example, "X-floor has been registered" from the notification section 6 in Step S11 or Step S12.
  • Step S9 it was ascertained only whether or not within the period of time in which a cancellation is possible, a voice matching the call registration canceling vocabulary was inputted to the voice input section 1.
  • the operation maybe such that it is ascertained not only whether or not the inputted voice matches the call registration canceling vocabulary, but also whether or not the inputted voice matches the destination registration vocabulary in the same manner as in Step S3.
  • the operation may be such that it is judged that the user spoke a right destination floor for corrective purposes because the last voice registration was wrong, and after the cancellation of the call registration of the destination floor held in the present registered floor holding section 4a, the flow returns to Step S4, where a call registration of a newly recognized destination floor is performed.
  • the configuration may be such that because it is advisable to keep the call registration of the destination floor held in the present registered floor holding section 4a as it is, the flow returns to Step S4 simply after Steps S11 and S12 are carried out and a call registration of a newly recognized destination floor is performed.
  • both destination registration vocabulary voice data and call registration canceling vocabulary voice data when the door is open and destination registration vocabulary voice data and call registration canceling vocabulary voice data when the door is closed are stored in advance in the storage section 3. And voice data to be used in voice recognition are switched according to the open and closed conditions of the door.
  • Step S1 This concept that only when the door of the car is open, a call registration and a cancellation of a call registration by voice input are accepted, means that specifically, in the flow of Figure 2 , the ascertainment in Step S1 is started after the door of the car became fully open. And the door closing is started after a lapse of a time during which the time necessary for a call registration by voice input (for example, 10 seconds) can be sufficiently ensured.
  • the time from the full opening of the door of the car to the start of door closing is set at a period of time which is at least longer than a total of the time necessary for making an announcement of starting the period of time in which a cancellation is possible and a predetermined period of time in which a cancellation is possible.
  • the notification section 6 is composed of a voice rumbling device, such as a speaker, and an indication device, such as a liquid crystal display
  • a call registration button installed in the car as part of this notification section 6. That is, when a voice is inputted and a destination floor is recognized by the voice recognition section 2, for example, by causing the registration button of the destination floor in question to blink, it is possible to inform the user of the fact that the destination floor has been recognized. This blinking of the call registration button continues until the period of time in which a cancellation is possible elapses.
  • the call registration button in question is caused to go out. And in the case where the period of time in which a cancellation is possible has elapsed and a call registration has been determined, the call registration button in question is caused to light up.
  • the most up-to-date destination floor of a call registration request outputted from the voice call registration section is held by the registered floor holding section which is the destination floor holding section and a predetermined call registration canceling keyword is spoken within the period of time in which a cancellation is possible after a call registration, whereby it is possible to cancel a call registration performed immediately before that. For this reason, call registrations which other users have already registered are prevented from being wrongly canceled and it is possible to appropriately cancel call registrations by voice input.
  • a keyword not including words representing destination floors is used as a call registration canceling keyword spoken at the time of a cancellation. For this reason, a call registration which becomes an object of cancellation is not wrongly recognized and hence there is no possibility that a call registration of a destination floor which is not intended to be cancelled is wrongly canceled.
  • Figures 3 and 4 relate to Embodiment 2 of the present invention.
  • Figure 3 is a block diagram showing the configuration of the call registration device of an elevator
  • Figure 4 is a flowchart showing the operations of the call registration device of an elevator.
  • Embodiment 2 described here is provided with an elevator information obtaining section which obtains information and the like regarding floors at which the elevator can stop from the elevator control device and a registration possibility judgment section which judges whether or not a call registration of a destination floor recognized by the voice recognition section is possible, on the basis of the information obtained by the elevator information obtaining section from the elevator control device. And even in the case where a call registration is judged to be possible by the registration possibility judgment section, a call registration request is not immediately outputted to the elevator control device, but instead the call registration request is held in the voice call registration section as a provisional registration. It is ensured that when the period of time in which a cancellation is possible has elapsed without the cancellation of this provisional registration, the call registration request is outputted to the elevator control device.
  • an elevator information obtaining section 7 shown in Figure 3 obtains information regarding floors at which an elevator can stop from an elevator control device 5. And this elevator information obtaining section 7 outputs the obtained information regarding floors at which an elevator can stop to a registration possibility judgment section 8.
  • the registration possibility judgment section 8 outputs a provisional call registration request to a voice call registration section 4 on the basis of voice recognition results outputted from the voice recognition section 2.
  • this registration possibility judgment section 8 makes a judgment as to whether or not a call registration of the destination floor represented by the destination registration vocabulary in question is possible. And the information regarding the floors at which an elevator can stop obtained by the elevator information obtaining section 7 is used in this judgment. And the judgment results on the possibility of the call registration of the destination floor recognized by the voice recognition section 2 are outputted to the notification section 6 together with the information on the destination floor in question.
  • the notification section 6 gives a response message indicating that the registration is acceptable (for example, "X-floor will be registered") to the user if a call registration of the destination floor recognized by the voice recognition section 2 is possible. If a call registration of the destination floor recognized by the voice recognition section 2 is impossible, the notification section 6 gives a response message indicating that the registration is unacceptable (for example, "X-floor cannot be registered”) to the user. In this manner, from the notification contents from the notification section 6, the user can get to know whether or not the destination floor spoken by the user has been rightly recognized and is a floor capable of being registered (a floor at which the elevator can stop).
  • the notification section 6 gives a response message indicating that the registration is acceptable (for example, "X-floor will be registered") to the user if a call registration of the destination floor recognized by the voice recognition section 2 is possible. If a call registration of the destination floor recognized by the voice recognition section 2 is impossible, the notification section 6 gives a response message indicating that the registration is unacceptable (for example, "X-floor cannot be registered
  • the registration possibility judgment section 8 judges that a call registration of the destination floor recognized by the voice recognition section 2 is possible, the registration possibility judgment section 8 outputs a provisional call registration request to the destination floor in question to the voice call registration section 4.
  • the voice call registration section 4 which has received this provisional call registration request performs a provisional call registration to the destination floor in question by storing the destination floor of the provisional call registration request in question in a provisional call storage section 4b. And at the same time, the voice call registration section 4 starts the measurement of the period of time in which a cancellation is possible, which is a predetermined period of time (for example, 2 to 3 seconds).
  • the voice call registration section 4 cancels the provisional call registration by erasing the destination floor information held by the provisional call storage section 4b.
  • a message for example, "the registration of X-floor has been canceled" and "the registration of X-floor has been deleted” is given to the user by the notification section 6.
  • the provisional call registration is determined at the point of time when the period of time in which a cancellation is possible has elapsed. That is, the voice call registration section 4 outputs the call registration request to the destination floor held by the provisional call storage section 4b to the elevator control device 5.
  • the elevator control device 5 which has received the call registration request from the voice call registration section 4 performs a call registration of the destination floor designated by the call registration request in question in accordance with the call registration request in question.
  • the voice call registration section 4 erases the destination floor information stored in the provisional call storage section 4b.
  • the voice call registration section 4 obtains the information on the destination floor recognized in the voice recognition section 2 from the provisional call registration request outputted from the registration possibility judgment section 8.
  • the provisional call storage section 4b constitutes the destination floor holding section which holds the most up-to-date destination floor obtained by the voice call registration section 4.
  • the registration possibility judgment section 8 and the voice call registration section 4 may be integrated into one.
  • the elevator information obtaining section 7 and the registration possibility judgment section 8 are provided, and a provisional call registration is performed in the voice call registration section 4 after a judgment is made as to whether or not it is possible to perform a call registration of the destination floor recognized by the voice recognition section 2.
  • a provisional call registration is performed in the voice call registration section 4 after a judgment is made as to whether or not it is possible to perform a call registration of the destination floor recognized by the voice recognition section 2.
  • the configuration may be such that the elevator information obtaining section 7 and the registration possibility judgment section 8 are provided and after a judgment is made as to whether or not it is possible to perform a call registration of the destination floor recognized by the voice recognition section 2, the voice call registration section 4 outputs to the elevator control device 5 a call registration request for which it was judged that a call registration is possible.
  • the configuration may be such that the elevator information obtaining section 7 obtains also the information regarding the destination floor of the call registration which has already been registered from the elevator control device 5 and the registration possibility judgment section 8 makes a judgment that a registration is impossible for a call registration in which the same floor as the destination floor of the call registration which has already been registered is a destination floor. By doing this, even when a call registration in which the same floor is a destination floor has already been performed by other users, it is possible to prevent call registrations performed by other users from being wrongly canceled.
  • the call registration device of an elevator operates in accordance with a series of operations of the flow shown in Figure 4 .
  • Step S21 the elevator information obtaining section 7 obtains information regarding floors at which the elevator can stop from the elevator control device 5. Because succeeding Steps S22 to S24 are the same as Steps S1 to S3 in the flowchart of Figure 2 of Embodiment 1, descriptions thereof are omitted. In the case where in Step S24 the voice inputted to the voice input section 1 matches the destination registration vocabulary and the voice recognition section 2 recognized the destination floor, the flow proceeds to Step S25.
  • Step S25 on the basis of the information regarding floors at which the elevator can stop, which is obtained by the elevator information obtaining section 7, the registration possibility judgment section 8 makes a judgment as to whether or not the destination floor recognized by the voice recognition section 2 (represented as X-floor) is a floor for which a call registration is possible.
  • the flow proceeds to Step S26.
  • Step S26 after giving a response message indicating that the registration is unacceptable (for example, "X-floor cannot be registered") to the user from the notification section 6, the flow proceeds to Step S37, where a series of operations of the flow comes to an end.
  • Step S25 the destination floor recognized by the voice recognition section 2 (X-floor) was judged by the registration possibility judgment section 8 to be a floor for which a call registration is possible
  • the flow proceeds to Step S27.
  • the registration possibility judgment section 8 outputs a provisional call registration request to the destination floor recognized by the voice recognition section 2 to the voice call registration section 4.
  • the registration possibility judgment section 8 sends information regarding the destination floor in question to the notification section 6, and the notification section 6 gives a response message indicating that the registration is acceptable, such as "X-floor will be registered.”
  • Step S28 the voice call registration section 4 stores the destination floor of the provisional call registration request outputted from the registration possibility judgment section 8 in Step S27 in the provisional call storage section 4b, thereby performing a provisional call registration to the destination floor in question.
  • Step S29 the voice call registration section 4 starts the measurement of the period of time in which a cancellation is possible. And in the case where within this period of time in which a cancellation is possible there was a voice input to the voice input section 1, the flow proceeds from succeeding Step S30 to Step S31, where the voice recognition section 2 performs voice recognition by conducting the comparative checking of the voice inputted to the voice input section 1 against the voice data stored in the storage section 3.
  • Step S31 the voice inputted to the voice input section 1 matches the call registration canceling vocabulary and the voice recognition section 2 recognized the call registration canceling vocabulary (a call registration canceling keyword), the flow proceeds from Step S32 to Step S33.
  • Step S33 the voice call registration section 4 sends to notification section 6 information to the effect that the provisional call registration to the destination floor stored in the provisional call storage section 4b was canceled, and the notification section 6 performs notification (a cancel response to a provisional call) of for example, "X-floor has been canceled.”
  • Step S35 the voice call registration section 4 resets the period of time in which a cancellation is possible by finishing the measurement of the period of time in which a cancellation is possible.
  • Step S36 the voice call registration section 4 erases the information on the destination floor stored and held in the provisional call storage section 4b.
  • Step S34 in the case where in Step S30 there was no voice input to the voice input section 1 within the period of time in which a cancellation is possible or in the case where although there was a voice input to the voice input section 1 within the period of time in which a cancellation is possible, in Step S32 the voice inputted to the voice input section 1 did not match the call registration canceling vocabulary and hence the voice recognition section 2 did not recognize the call registration canceling vocabulary.
  • Step S34 the voice call registration section 4 determines the provisional call registration and outputs the call registration request to the destination floor held in the provisional call storage section 4b to the elevator control device 5.
  • the elevator control device 5 which has received the call registration request from the voice call registration section 4 performs a call registration of the destination floor designated by the call registration request in question in accordance with the call registration request in question.
  • Step S35 the period of time in which a cancellation is possible is reset and moreover the information on the destination floor held in the registered floor holding section 4a is erased (Step S36). Thereafter, the flow proceeds to Step S37, where a series of operations of the flow comes to an end.
  • the same effect as in Embodiment 1 can be produced and, in addition to this, the call registration of the destination floor in question is held in a condition of a provisional call registration until the lapse of the period of time in which a cancellation is possible, when the call registration of the destination floor recognized immediately before that can be canceled. And only after the period of time in which a cancellation is possible has elapsed, the provisional call registration in question is determined and a call registration request is outputted to the elevator control device. For this reason, even when a provisional call registration is canceled during the period of time in which a cancellation is possible, this has no effect on the call registration registered in the elevator control device. Therefore, with a simple configuration it is possible to prevent in advance unnecessary call registrations, such as wrong registrations, from being performed during call registration by voice input. Furthermore, it is possible to more positively prevent call registrations already registered by other users from being wrongly canceled.
  • the present invention can be used in a call registration device of an elevator in which call registration is performed by voice recognition using a voice input section which receives the input of voices spoken by elevator users.

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Indicating And Signalling Devices For Elevators (AREA)
  • Elevator Control (AREA)
EP10860801.9A 2010-12-14 2010-12-14 Call registration device of elevator Active EP2653424B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2010/072444 WO2012081082A1 (ja) 2010-12-14 2010-12-14 エレベータの呼び登録装置

Publications (3)

Publication Number Publication Date
EP2653424A1 EP2653424A1 (en) 2013-10-23
EP2653424A4 EP2653424A4 (en) 2018-02-21
EP2653424B1 true EP2653424B1 (en) 2019-08-07

Family

ID=46244211

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10860801.9A Active EP2653424B1 (en) 2010-12-14 2010-12-14 Call registration device of elevator

Country Status (5)

Country Link
EP (1) EP2653424B1 (ja)
JP (1) JP5626362B2 (ja)
KR (1) KR101537456B1 (ja)
CN (1) CN103221325B (ja)
WO (1) WO2012081082A1 (ja)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6079478B2 (ja) * 2013-06-28 2017-02-15 三菱電機株式会社 乗場の呼び登録装置
DE112013007347B4 (de) 2013-08-21 2022-02-24 Mitsubishi Electric Corporation Aufzugsteuervorrichtung
JP2015107867A (ja) * 2013-12-05 2015-06-11 三菱電機株式会社 エレベータの音声呼び登録装置
CN107000963A (zh) 2014-11-13 2017-08-01 奥的斯电梯公司 电梯控制系统覆盖系统
CN105668361A (zh) * 2016-03-24 2016-06-15 安庆市德创机电产品设计有限公司 一种电梯楼层按钮开关纠正组件
CN106335823B (zh) * 2016-10-20 2019-08-30 深圳市元征科技股份有限公司 一种通过语音控制电梯的方法及电梯控制设备
JP6633231B2 (ja) * 2017-02-06 2020-01-22 三菱電機株式会社 エレベータの制御装置および制御方法
CN107601190B (zh) * 2017-08-29 2019-05-17 日立楼宇技术（广州）有限公司 一种语音召梯方法及装置
WO2019069450A1 (ja) * 2017-10-06 2019-04-11 三菱電機株式会社 エレベータ
CN108190664A (zh) * 2018-02-28 2018-06-22 杨俊� 一种语音识别系统
KR102155364B1 (ko) * 2018-04-04 2020-09-11 주식회사 오아앤테크 엘리베이터 제어 장치 및 방법, 이를 위한 프로그램을 기록한 기록 매체
CN109534117B (zh) * 2018-12-26 2020-10-16 福州快科电梯工业有限公司 空间立体交互式电梯呼梯装置及工作方法
US20200307951A1 (en) * 2019-03-25 2020-10-01 Otis Elevator Company Processing multiple elevator service requests
CN110950201A (zh) * 2020-02-26 2020-04-03 菱王电梯股份有限公司 一种基于语音比对的呼梯登记方法及其呼梯登记装置
CN111477225B (zh) * 2020-03-26 2021-04-30 北京声智科技有限公司 语音控制方法、装置、电子设备及存储介质
CN111470385A (zh) * 2020-04-14 2020-07-31 苏州德奥电梯有限公司 一种电梯系统
CN112820271A (zh) * 2021-01-09 2021-05-18 江苏威尔曼科技有限公司 一种带有智能识别的语音呼梯系统
CN112850391A (zh) * 2021-01-09 2021-05-28 江苏威尔曼科技有限公司 一种电梯语音呼梯登记装置
JP7167261B1 (ja) 2021-07-01 2022-11-08 東芝エレベータ株式会社 エレベータシステム
KR102582344B1 (ko) 2021-07-05 2023-09-26 현대엘리베이터주식회사 음성 인식 엘리베이터 호출 시스템 및 방법

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5661279A (en) 1979-10-23 1981-05-26 Tokyo Shibaura Electric Co Calling register for elevator
JPS5751664A (en) * 1980-09-11 1982-03-26 Mitsubishi Electric Corp Controller for elevator
JPS58162470A (ja) * 1982-03-24 1983-09-27 三菱電機株式会社 エレベ−タの呼び登録装置
JPS6310073A (ja) 1986-06-27 1988-01-16 Shin Meiwa Ind Co Ltd 溶断装置
JPH0331176A (ja) * 1989-06-29 1991-02-08 Toshiba Corp エレベータの情報入力装置
JPH0395082A (ja) * 1989-09-07 1991-04-19 Toshiba Corp エレベータ制御装置
KR960022220A (ko) * 1994-12-09 1996-07-18 박규직 음성인식에 따른 엘리베이터 운행제어방법
JPH08268658A (ja) * 1995-03-29 1996-10-15 Fujitec Co Ltd エレベータの制御装置
JPH08268653A (ja) * 1995-03-29 1996-10-15 Fujitec Co Ltd エレベータの制御装置
JPH09255243A (ja) 1996-03-18 1997-09-30 Tatsuhiko Sumi 音声作動エレベータ−
US5952626A (en) 1998-07-07 1999-09-14 Otis Elevator Company Individual elevator call changing
KR20010009970A (ko) * 1999-07-15 2001-02-05 백영문 음성/화상 데이터에 의한 엘리베이터의 제어방법 및 장치
JP2002220167A (ja) * 2001-01-24 2002-08-06 Mitsubishi Electric Corp エレベータの制御装置
JP2007186280A (ja) * 2006-01-11 2007-07-26 Kuma Lift Gijutsu Kenkyusho:Kk エレベータの昇降制御装置
US8678142B2 (en) * 2008-10-03 2014-03-25 Mitsubishi Electric Corporation Destination floor registration device of elevator, having voice input
JP5452067B2 (ja) * 2009-04-27 2014-03-26 三菱電機株式会社 エレベータ呼び登録装置
JP5402219B2 (ja) * 2009-04-28 2014-01-29 三菱電機株式会社 エレベータの呼び登録装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
WO2012081082A1 (ja) 2012-06-21
JPWO2012081082A1 (ja) 2014-05-22
EP2653424A4 (en) 2018-02-21
KR20130101118A (ko) 2013-09-12
KR101537456B1 (ko) 2015-07-16
CN103221325A (zh) 2013-07-24
EP2653424A1 (en) 2013-10-23
JP5626362B2 (ja) 2014-11-19
CN103221325B (zh) 2015-06-17

Similar Documents

Publication Publication Date Title
EP2653424B1 (en) Call registration device of elevator
JP5987201B2 (ja) エレベータ制御装置
US9384733B2 (en) Call registration device for elevator
US8438028B2 (en) Nametag confusability determination
JP5569534B2 (ja) エレベータの呼び登録装置
US20160111090A1 (en) Hybridized automatic speech recognition
JP5534103B2 (ja) エレベータの行先階登録装置
CN104692198A (zh) 电梯语音呼梯登记装置
JP5668838B2 (ja) エレベータの呼び登録装置
JP5423884B2 (ja) エレベーターの呼び登録装置
JP2018116206A (ja) 音声認識装置、音声認識方法及び音声認識システム
JP6422365B2 (ja) エレベータの音声呼び登録装置およびエレベータの音声呼び登録方法
JP2015171940A (ja) エレベータ制御装置
JP2013160877A (ja) エレベータの音声認識装置および音声認識方法
JPH11109987A (ja) 音声認識装置
WO2021044569A1 (ja) 音声認識補助装置および音声認識補助方法
JP2007286198A (ja) 音声合成出力装置
JP2010230994A (ja) 受付装置
WO2013161050A1 (ja) エレベータの行先登録装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20130409

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602010060497

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: B66B0001140000

Ipc: B66B0001460000

RA4 Supplementary search report drawn up and despatched (corrected)

Effective date: 20180124

RIC1 Information provided on ipc code assigned before grant

Ipc: B66B 1/46 20060101AFI20180118BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190405

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1163541

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190815

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010060497

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190807

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191107

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191107

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191209

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1163541

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191207

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191108

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200224

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602010060497

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG2D Information on lapse in contracting state deleted

Ref country code: IS

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20200603

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20191231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20191214

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191214

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191214

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191214

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20101214

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190807

REG Reference to a national code

Ref country code: DE

Ref legal event code: R084

Ref document number: 602010060497

Country of ref document: DE

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230512

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231031

Year of fee payment: 14