EP4558434A1 - Method for controlling an elevator - Google Patents
Method for controlling an elevatorInfo
- Publication number
- EP4558434A1 EP4558434A1 EP23742051.8A EP23742051A EP4558434A1 EP 4558434 A1 EP4558434 A1 EP 4558434A1 EP 23742051 A EP23742051 A EP 23742051A EP 4558434 A1 EP4558434 A1 EP 4558434A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- car
- cars
- elevator
- new call
- list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B1/00—Control systems of elevators in general
- B66B1/24—Control systems with regulation, i.e. with retroactive action, for influencing travelling speed, acceleration, or deceleration
- B66B1/2408—Control systems with regulation, i.e. with retroactive action, for influencing travelling speed, acceleration, or deceleration where the allocation of a call to an elevator car is of importance, i.e. by means of a supervisory or group controller
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B1/00—Control systems of elevators in general
- B66B1/02—Control systems without regulation, i.e. without retroactive action
- B66B1/06—Control systems without regulation, i.e. without retroactive action electric
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B1/00—Control systems of elevators in general
- B66B1/34—Details, e.g. call counting devices, data transmission from car to control system, devices giving information to the control system
- B66B1/3492—Position or motion detectors or driving means for the detector
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B2201/00—Aspects of control systems of elevators
- B66B2201/20—Details of the evaluation method for the allocation of a call to an elevator car
- B66B2201/231—Sequential evaluation of plurality of criteria
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B2201/00—Aspects of control systems of elevators
- B66B2201/30—Details of the elevator system configuration
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B2201/00—Aspects of control systems of elevators
- B66B2201/40—Details of the change of control mode
- B66B2201/403—Details of the change of control mode by real-time traffic data
Definitions
- the invention relates to a method for controlling an elevator.
- the invention further relates to an elevator, as well as to an elevator controller, a computer program and a computer- readable medium for carrying out the method.
- An elevator may comprise different cars for transporting people and/or objects along different vertical axes or shafts between different floors of a building. Given a list of calls indicating desired floors of the building, the controller of the elevator needs to be able to assign each call to one of the cars and determine the order of the floors at which the cars should stop to fulfil the assigned calls in an efficient manner. This may also be referred to as trip scheduling.
- a machine-learning model may be utilised to make better control decisions.
- Such models are usually trained using reinforcement learning, where actions of a simulated elevator (“agent”) are evaluated with rewards and an algorithm that controls the agent (e.g. in the form of an artificial neural network) is optimised according to the rewards so that future control decisions are better than past control decisions.
- Another objective of the invention may be to provide a corresponding elevator, a corresponding elevator controller, a corresponding computer program and a corresponding computer-readable medium.
- the list of eligible cars may be used as a filter for filtering the output of the artificial neural network.
- Such filtering may also be referred to as masking. This significantly improves the accuracy of the method compared to elevator group control algorithms that lack such masking.
- the rule(s) may be based on predefined and/or known parameters (as opposed, for example, to a machine-learning model with hidden parameters).
- the input data may encode the sensor data in a format specifically adapted to the artificial neural network, e.g. in the form of a vector. It is also possible that the input data is identical to the sensor data. In this case, the sensor system may be adapted to provide the sensor data as the input data in a format specifically adapted to the artificial neural network.
- the input data may be input into one, two or more than two artificial neural networks, e.g. into one artificial neural network for each car, to generate the output value(s).
- the input data may be an observation vector with different components, such as the number of the floor on or near which each car is currently located (e.g. “0”, “1”, “2”), t
- the number of the floor on or near which each car is currently located e.g. “0”, “1”, “2”
- qc CL1 rrcnt moving direction of each car e.g. “up”, “down”, “stopped”
- the occupancy of each car e.g. “full”, “not full”
- the current calls assigned to each car e.g. “full”, “not full”
- a simple approach to encode the calls for one car may be to combine the following three components.
- All landing operating panel (LOP) calls assigned to the car may be provided as origindestination tuples and aggregated into one (two-dimensional) origin-destination matrix. The matrix may then be transformed into a first vector of length n 2 , with n being the number of floors of the building.
- LOP calls include especially the information about the origin floor and additionally about the destination floor. Such LOP calls are often named as destination calls.
- All new LOP calls, which are to be assigned to the car, may be transformed into a second vector of length n 2 in the same way as described under 1).
- All car operating panel (COP) calls from the car may be directly stored in a third vector of length n, since there is no need to remember the origin for COP calls.
- the first vector, the second vector and the third vector of all cars may then be concatenated to form the observation vector.
- the output values may be values from a discrete and/or continuous value range.
- the output values may be Q-values and/or bid values.
- the output values may also be percentages between 0 and 1 or Boolean values.
- a second aspect of the invention relates to an elevator controller comprising a processor configured to carry out the method described above and below.
- An elevator controller is a special data processing device, designed and programmed to control an elevator.
- the elevator controller may comprise an elevator group controller and a car controller.
- the elevator controller may include hardware and/or software modules.
- the elevator controller may comprise a memory and one or more data communication interfaces for data communication with peripheral devices, e. g sensors, sensor systems or actuators of an elevator
- a third aspect of the invention relates to an elevator.
- the elevator comprises: at least two different cars arranged to be movable along different vertical axes between different floors of a building; a sensor system adapted to provide sensor data indicative of a current state of the elevator, wherein the sensor data includes a current position of each car with respect to the floors, a list of current calls assigned to the cars and a new call to be assigned to one of the cars, wherein each call indicates a desired floor of the building; the elevator controller described above and below.
- the cars may be arranged to be movable along different shafts of the building.
- each car may be arranged to be movable in its own shaft.
- FIG. 1 Further aspects of the invention relate to a computer program comprising instructions which, when the program is executed by a processor, cause the processor to carry out the method described above and below, as well as to a computer-readable medium in which the computer program is stored.
- the computer-readable medium may be a volatile or non-volatile data storage device.
- the computer-readable medium may be a hard drive, a USB (universal serial bus) storage device, a RAM (random-access memory), a ROM (read-only memory), an EPROM (erasable programmable read-only memory), an EEPROM (electrically erasable programmable read-only memory), a flash memory or a combination of at least two of these examples.
- the computer-readable medium may also be a data communication network for downloading program code, such as the Internet or a cloud.
- Embodiments of the invention may be regarded as based on the ideas and findings described below without limiting the invention.
- the following steps may be performed for each car to generate the list of eligible cars: assigning the new call to the car; simulating a movement of the car to fulfil the new call depending on the current position of the car and the current calls assigned to the car; analysing the movement to determine whether the car complies with the at least one rule; if the car complies with the at least one rule, adding the car to the list of eligible cars.
- assigning the new call to the car simulating a movement of the car to fulfil the new call depending on the current position of the car and the current calls assigned to the car
- analysing the movement to determine whether the car complies with the at least one rule; if the car complies with the at least one rule, adding the car to the list of eligible cars.
- the movement may be simulated according to a (known) control logic for controlling the car independently of any other car of the elevator.
- a control logic for controlling the car independently of any other car of the elevator.
- Such a single-car control logic may be, for example, a selective collective logic or a down collective logic.
- the control logic may be based on known rules and/or known parameters.
- the control logic it is also possible for the control logic to include a machinelearning model with hidden, i.e. unknown parameters, such as an artificial neural network. It is possible that the same control logic is used to both simulate the movement of a car and generate control commands for actually controlling the car.
- the at least one rule may specify a preferred moving direction for each car.
- a car may be added to the list of eligible cars only if it moves in the preferred moving direction when fulfilling the new call.
- the at least one rule may specify a maximum number of calls that can be assigned to each car.
- a car may be added to the list of eligible cars only if the number of calls assigned to the car when it fulfils the new call does not exceed its maximum number of calls.
- the selected car may be the eligible car corresponding to the highest output value, e.g. the highest Q-value.
- the selected car may be the eligible car corresponding to the lowest output value, e.g. the lowest bid value.
- the artificial neural network may have been trained using training data generated by simulating an environment in which different cars of an elevator move along different vertical axes between different floors of a building in reaction to calls indicating desired floors of the building.
- the environment may be seen as a computer-calculated space the elevator, as a virtual agent, takes actions in.
- the environment may have the same and/or similar characteristics as the real elevator and/or the real building in which the real elevator is installed.
- the simulation of the environment may comprise the following components: elevator simulation, traffic simulation, interaction between elevator simulation and traffic simulation.
- the elevator simulation may be configured with at least one of the following parameters: maximum velocity, acceleration, door opening time, door closing time, minimum door open time, car capacity.
- the traffic simulation may be performed according to a specific traffic pattern that determines a local and/or temporal distribution of calls to be fulfilled by the elevator. For example, as mentioned above, each call may be characterised by a unique ID, a timestamp, an origin floor and a destination floor. The traffic pattern may be varied during simulation.
- the simulation of the interaction between the elevator and the calls i.e. the passengers
- the simulation of the interaction between the elevator and the calls may be configured with parameters such as a waiting time (i.e. the time a passenger waits before entering the car), a travelling time (i.e. the time a passenger travels before leaving the car) or a destination time (i.e. the overall time it takes to fulfil a call).
- the agent e.g. an elevator group controller
- the agent may be configured to receive an observation of the environment in each simulation step and execute an action depending on the observation, e.g. assign a new call to one of the cars and, optionally, control the car accordingly.
- the environment may update its state and emit an observation of its updated state together with a reward that is used to train the agent to improve its actions at future simulation steps.
- the reward may be positive, negative or zero.
- a positive reward value may indicate a “more useful” action
- a negative reward value may indicate a “less useful” action.
- the reward may be calculated in regular time intervals or only in certain situations, e.g. when a transition of the environment from a current state to a next state is observed.
- the state of the environment may be seen as a combination of both an elevator state and a traffic state.
- the elevator state may be defined, for example, by at least one of the following parameters: a current floor of each car, a current moving direction of each car, a current door status (opened, moving, closed) of each car, a current number of passengers inside each car, the next reachable floors of each car.
- the traffic state may be defined, for example, by at least one of the following parameters: active calls from and/or to each floor, a current number of passengers inside each car, a current number of passengers waiting on each floor.
- the actions may be selected with a certain degree of randomness during training, e.g. by using an epsilon-greedy algorithm.
- the degree of randomness may be varied, in particular reduced, as the training progresses.
- the method may further comprise generating a control command to cause the selected car to fulfil the new call.
- the control command may be generated to control a movement of the selected car along one of the vertical axes, e.g. along a shaft of the building.
- the control command may be generated considering the other calls assigned to the selected car. Examples for such a control command are “go up”, “go down”, “go to floor X” or “go to the next floor”.
- the control command may also cause the selected car to close and/or open its door(s) and/or to fulfil the other calls assigned to it.
- generating the control command may comprise: receiving additional input data including the current position of the selected car and a list of all calls assigned to the selected car, including the new call; inputting the additional input data into an additional artificial neural network trained to convert the additional input data into at least one additional output value indicating a possible control command from a set of possible control commands for controlling the selected car; selecting one of the possible control commands as the control command using the at least one additional output value; applying the control command to cause the selected car to fulfil the new call.
- different artificial neural networks may be used to assign the new call to one of the cars and control the selected car to which the new call has been assigned. This significantly improves the accuracy and/or efficiency of the method.
- the additional artificial neural network may be configured to calculate one output value, e.g. one Q-value, for each possible control command.
- the control command may be the possible control command corresponding to the highest output value, e.g. the highest Q-value.
- the additional artificial neural network may have been trained using training data generated by simulating an environment in which at least one car of an elevator moves between different floors of a building in reaction to calls indicating desired floors of the building.
- the environment may have the same and/or similar characteristics as the real elevator and/or the real building in which the real elevator is installed.
- the environment may include only one car.
- the additional artificial neural network may have been trained in a similar manner as described above.
- the agent e.g. an elevator car controller, may be configured to execute actions in the environment by applying control commands for controlling a single car of the elevator (instead of assigning new calls to different cars of the elevator).
- the processor of the elevator controller may be configured to carry out the method of the first aspect of the invention according to an embodiment where a control command is generated.
- the elevator may further comprise an actuator system adapted to control the cars according to control commands generated by the elevator controller.
- Fig. 1 shows an elevator according to an embodiment of the invention.
- Fig. 2 shows an elevator group controller of an elevator controller according to an embodiment of the invention.
- Fig. 3 shows a car controller of an elevator controller according to an embodiment of the invention.
- FIG. 1 shows an elevator 1 installed in a building 3 with multiple floors 5 and multiple shafts that interconnect the floors 5, here a first shaft 7a, a second shaft 7b and a third shaft 7c.
- the elevator 1 comprises multiple cars to transport passengers 8 between the floors 5, here a first car 9a arranged to be movable along the first shaft 7a, a second car 9b arranged to be movable along the second shaft 7b and a third car 9c arranged to be movable along the third shaft 7c.
- the elevator 1 further comprises an actuator system 11 adapted to control a movement of each car 9a, 9b, 9c.
- the actuator system 11 includes one electric drive (“M”) for each car 9a, 9b, 9c.
- the elevator 1 comprises a sensor system 12 adapted to provide sensor data 13 including a current position 15 (see Figs. 2, 3) of each car 9a, 9b, 9c with respect to the floors 5, a list 17 (see Fig. 2) of current calls assigned to the cars 9a, 9b, 9c and a new call 19 (see Figs. 2, 3) to be assigned to one of the cars 9a, 9b, 9c.
- a sensor system 12 adapted to provide sensor data 13 including a current position 15 (see Figs. 2, 3) of each car 9a, 9b, 9c with respect to the floors 5, a list 17 (see Fig. 2) of current calls assigned to the cars 9a, 9b, 9c and a new call 19 (see Figs. 2, 3) to be assigned to one of the cars 9a, 9b, 9c.
- the elevator controller 21 includes a group controller 23 (see Fig. 2) configured to assign the new call 19 to one of the cars 9a, 9b, 9c, as well as three car controllers 25 (see Fig. 3), wherein each car controller 25 is configured to generate a control command 22 for one of the cars 9a, 9b, 9c, i.e. the corresponding electric drive. It is possible for the car controllers 25 to generate their control commands 22 independently of each other.
- the elevator controller 21 comprises a processor 27 and a memory 29.
- the processor 27 may be configured to carry out the following method by executing a computer program stored in the memory 29.
- the list 33 of eligible cars and the output values 39 are input into a car selection module 41 that determines a selected car 43 from the eligible cars depending on the output value 39 assigned to each item in the list 33.
- the car 9a is the item with the highest output value 39 and is thus determined as the selected car 43.
- the new call 19 is assigned to the selected car 43 in a call assignment module 45.
- the car controller 25 of the selected car 43 additionally generates a control command 22 that causes the actuator system 11, i.e. the electric drive of the selected car 43, to move the selected car 43 in such a way that it fulfils the new call 19.
- the final layer of the neural network 37 may generate n output values 39, e.g. Q-values.
- the car selection module 41 may then determine the car with the highest Q-value as the selected car 43.
- the selected car 43 may follow a single-car logic, such as a selective collective logic or a down collective logic, to satisfy the calls assigned to it.
- the singlecar logic may be based on a set of known rules and/or implemented as an artificial neural network (see below).
- the new call 19 may be delayed for a certain period of time.
- the following two rules may be used to evaluate the simulated movement.
- Wrong direction A new call cannot be assigned to a car if the car moves in a direction opposite to a preferred moving direction to fulfil the new call.
- Full car A new call cannot be assigned to a car if the car, when fulfilling the new call, exceeds a maximum number of calls that can be assigned to it. In other words, a new passenger is unable to enter the car at the origin floor specified by the new call if the car is full.
- the car controller 25 may be configured to estimate the control command 22 for the selected car 43 using an additional artificial neural network 47, which may have been trained in a similar manner as the neural network 37, i.e. using a reinforcement learning algorithm, to convert additional input data 49, which includes the current position 15 of the selected car 43 and a list 51 of all calls currently assigned to the selected car 43, including the new call 19, into a set of additional output values 53, wherein each additional output value 53 indicates a control command from a set of possible control commands for controlling the selected car 43.
- the additional input data 49 may have been generated using the sensor data 13 and/or the input data 14.
- the additional output values 53 may then be input into a command selection module 55 that selects the possible control command corresponding to the highest additional output value 53 as the control command 22 and applies the control command 22 to the actuator system 11.
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Elevator Control (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP22185609 | 2022-07-19 | ||
| PCT/EP2023/069415 WO2024017746A1 (en) | 2022-07-19 | 2023-07-13 | Method for controlling an elevator |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4558434A1 true EP4558434A1 (en) | 2025-05-28 |
Family
ID=82655234
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23742051.8A Pending EP4558434A1 (en) | 2022-07-19 | 2023-07-13 | Method for controlling an elevator |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20250171271A1 (en) |
| EP (1) | EP4558434A1 (en) |
| CN (1) | CN119486958A (en) |
| AU (1) | AU2023309742A1 (en) |
| WO (1) | WO2024017746A1 (en) |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5767461A (en) | 1995-02-16 | 1998-06-16 | Fujitec Co., Ltd. | Elevator group supervisory control system |
| WO2005092762A1 (en) | 2004-03-26 | 2005-10-06 | Mitsubishi Denki Kabushiki Kaisha | Elevator group control system |
| WO2008142785A1 (en) | 2007-05-23 | 2008-11-27 | Mitsubishi Electric Corporation | Group management controller of elevator |
-
2023
- 2023-07-13 EP EP23742051.8A patent/EP4558434A1/en active Pending
- 2023-07-13 WO PCT/EP2023/069415 patent/WO2024017746A1/en not_active Ceased
- 2023-07-13 CN CN202380054619.8A patent/CN119486958A/en active Pending
- 2023-07-13 AU AU2023309742A patent/AU2023309742A1/en active Pending
- 2023-07-13 US US18/993,626 patent/US20250171271A1/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024017746A1 (en) | 2024-01-25 |
| US20250171271A1 (en) | 2025-05-29 |
| CN119486958A (en) | 2025-02-18 |
| AU2023309742A1 (en) | 2025-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Jin et al. | An intelligent control system for traffic lights with simulation-based evaluation | |
| Pepyne et al. | Optimal dispatching control for elevator systems during uppeak traffic | |
| US6315082B2 (en) | Elevator group supervisory control system employing scanning for simplified performance simulation | |
| JP2573715B2 (en) | Elevator control device | |
| US20250171271A1 (en) | Method for controlling an elevator | |
| WO2024017747A1 (en) | Method for training an artificial neural network to estimate control commands for controlling an elevator | |
| US20250171270A1 (en) | Method for training multiple artificial neural networks to assign calls to cars of an elevator | |
| US20260008650A1 (en) | Method for controlling an elevator | |
| CN119990179A (en) | A robot motion control method and system applicable to multiple scenarios | |
| HK40116352A (en) | Method for controlling an elevator | |
| JPH0449183A (en) | Elevator control device | |
| Hamdi et al. | Prioritised A* search in real-time elevator dispatching | |
| US7591347B2 (en) | Control method and system for elevator | |
| HK40117382A (en) | Method for training multiple artificial neural networks to assign calls to cars of an elevator | |
| KR102136022B1 (en) | Reinforcement learning based elevator control apparatus | |
| JPH0331173A (en) | Group management control device for elevator | |
| Imrak | Artificial neural networks application in duplex/triplex elevator group control system | |
| JP7294480B1 (en) | Learning device, reasoning device and elevator group control device | |
| CN110127464B (en) | Multi-objective elevator dispatching system and method based on dynamic optimization | |
| HK40120669A (en) | Method for controlling an elevator | |
| Erdem Imrak et al. | Determination of the next stopping floor in elevator traffic control by means of neural networks | |
| JP3714343B2 (en) | Elevator group management simple simulator and elevator group management device | |
| JP6776174B2 (en) | Elevator user movement prediction method and elevator user movement prediction device | |
| Cortés et al. | A State of the Art on the most relevant patents in vertical transportation in buildings | |
| Yu et al. | Multi-car elevator system using genetic network programming for high-rise building |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20250113 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |