WO2022194374A1

WO2022194374A1 - A monitoring system and a monitoring method for an elevator system

Info

Publication number: WO2022194374A1
Application number: PCT/EP2021/056944
Authority: WO
Inventors: Mari Zakrzewski; Otto Pekander
Original assignee: Kone Corporation
Priority date: 2021-03-18
Filing date: 2021-03-18
Publication date: 2022-09-22

Abstract

The invention relates to a monitoring system (100) for an elevator system (200). The monitoring system (100) comprising: a sensor device (110) for providing sensor data from inside an elevator car (202) of the elevator system (200), an optical imaging device (120) for providing image data from inside the elevator car (202), and a control unit (130). The control unit (130) may be configured to: obtain sensor data from the sensor device (110), detect based on the obtained sensor data that the elevator car (202) is empty of passengers, and activate the optical imaging device (120) for providing the image data from inside the elevator car (20) in response to the detection that the elevator car (202) is empty of the passengers. The invention relates also to a monitoring method for an elevator system (200).

Description

A monitoring system and a monitoring method for an elevator system TECHNICAL FIELD

The invention concerns in general the technical field of elevator systems. Es pecially the invention concerns monitoring of elevator systems.

BACKGROUND

Typically, a remote monitoring unit, e.g. a service center or a cloud server, may receive continuously, i.e. around the clock, information from one or more ele vator systems. For example, the remote monitoring unit may receive fault codes from the one or more elevator systems and generate automatic service needs, based on the received fault codes, e.g. to maintenance personnel. Al ternatively, the remote monitoring unit may perform one or more remote maintenance operations of the elevator system, in response receiving the fault codes from the elevator system. However, in order to be able to perform the one or more remote maintenance operations it needs to be verified that an el evator car of the elevator system is empty of passengers and load. This verifi cation may be performed based on images captured by an optical imaging de vice, e.g. camera or video camera, from inside the elevator car. However, a lo cal processing of the optical images is very laborious and thus costly. Also, a constant providing of the optical images to the remote monitoring unit may be costly. Furthermore, capturing the optical images from inside the elevator car may violate the privacy protection of the passengers.

Thus, there is a need to develop solution to improve at least partly monitoring of elevator systems.

SUMMARY

The following presents a simplified summary in order to provide basic under standing of some aspects of various invention embodiments. The summary is not an extensive overview of the invention. It is neither intended to identify key or critical elements of the invention nor to delineate the scope of the invention. The following summary merely presents some concepts of the invention in a simplified form as a prelude to a more detailed description of exemplifying em bodiments of the invention. An objective of the invention is to present a monitoring system and a monitor ing method for an elevator system. Another objective of the invention is that the monitoring system and the monitoring method for an elevator system im prove at least partly monitoring of elevator systems.

The objectives of the invention are reached by a monitoring system and a monitoring method as defined by the respective independent claims.

According to a first aspect, a monitoring system for an elevator system is pro vided, wherein the monitoring system comprises: a sensor device for providing sensor data from inside an elevator car of the elevator system, an optical imag ing device for providing image data from inside the elevator car, and a control unit configured to: obtain sensor data from the sensor device, detect based on the obtained sensor data that the elevator car is empty of passengers, and ac tivate the optical imaging device for providing the image data from inside the elevator car in response to the detection that the elevator car is empty of the passengers.

The control unit may further be configured to detect that an elevator door of the elevator car is in a closed state before the activation of the optical imaging de vice.

Alternatively or in addition, the control unit may be configured to obtain the sensor data from the sensor device in response to a detection of a need for monitoring the elevator system.

Alternatively or in addition, in response to obtaining the image data from the optical imaging device, the control unit may further be configured to define based on the obtained image data whether the elevator car is empty of load.

In response to definition that the elevator car is empty of the load, the control unit may further be configured to activate a remote connection from a remote monitoring unit to the elevator system.

The monitoring system may further comprise the remote monitoring unit con figured to execute at least one remote control operation of the elevator system via the remote connection.

The remote monitoring unit may further be configured to obtain and monitor el evator related data representing at least one operation parameter of the eleva- tor system during the at least one remote control operation of the elevator sys tem.

The remote monitoring unit may be configured to obtain the elevator related data from the control unit or from a wireless data acquisition device having a contact to elevator control signals of the elevator system.

Alternatively or in addition, the remote monitoring unit may further be config ured to: generate at least one maintenance need in response to a detection of at least one malfunction of the elevator system based on the elevator related data; or deactivate the remote connection, if no malfunctions of the elevator system are detected based on the elevator related data.

Alternatively or in addition, in response to obtaining the image data from the optical imaging device, the control unit may be configured to detect based on the obtained image data at least one malfunction of the elevator car, a clean ing need of the elevator car, and/or detect based on the obtained image data at least object inside the elevator car.

The sensor device may be one of the following: a radar-based sensor device, a passive infrared sensor (PIR sensor) device, Time-of-flight (TOF) camera, or a thermographic camera.

The control unit may be implemented as a part of an elevator control system, as a separate unit arranged to the elevator system and being independent of the elevator control system, or as an external unit being external to the eleva tor system.

The optical imaging device may be a camera or a video camera.

According to a second aspect, a monitoring method for an elevator system is provided, wherein the method comprising: obtaining, by a control unit, from a sensor device sensor data from inside an elevator car of the elevator system; detecting, by the control unit, based on the obtained sensor data that the ele vator car is empty of passengers; and activating, by the control unit, an optical imaging device for providing image data from inside the elevator car.

The monitoring method may further comprise detecting that an elevator door of the elevator car is in a closed state before the activating the optical imaging device. Alternatively or in addition, the obtaining the sensor data from the sensor de vice may be performed in response to a detection of a need for monitoring the elevator system.

Alternatively or in addition, the monitoring method may further comprise in re sponse to obtaining the image data from the optical imaging device (120), de fining, by the control unit, based on the obtained image data whether the ele vator car is empty of load.

The monitoring method may further comprise activating, by the control unit, a remote connection from a remote monitoring unit to the elevator system, in re sponse to the defining that the elevator car is empty of the load.

The monitoring method may further comprise executing, by the remote moni toring unit, at least one remote control operation of the elevator system via the remote connection.

The monitoring method may further comprise obtaining and monitoring, by the remote monitoring unit, elevator related data representing at least one opera tion parameter of the elevator system during the at least one remote control operation of the elevator system.

The remote monitoring unit may obtain the elevator related data from the con trol unit or from a wireless data acquisition device having a contact to elevator control signals of the elevator system.

Alternatively or in addition, the monitoring method may further comprise: gen erating, by the remote monitoring unit, at least one maintenance need in re sponse to a detection of at least one malfunction of the elevator system based on the elevator related data; or deactivating, by the remote monitoring unit, the remote connection, if no malfunctions of the elevator system are detected based on the elevator related data.

Alternatively or in addition, the monitoring method may further comprise in re sponse to obtaining the image data from the optical imaging device, detecting, by the control unit, based on the obtained image data at least one malfunction of the elevator car, a cleaning need of the elevator car, and/or detect based on the obtained image data at least object inside the elevator car. The sensor device may be one of the following: a radar-based sensor device, a passive infrared sensor (PIR sensor) device, Time-of-flight (TOF) camera, or a thermographic camera.

The control unit may be implemented as a part of an elevator control system, a separate unit arranged to the elevator system and being independent of the elevator control system, or as an external unit being external to the elevator system.

The optical imaging device may be a camera or a video camera.

Various exemplifying and non-limiting embodiments of the invention both as to constructions and to methods of operation, together with additional objects and advantages thereof, will be best understood from the following description of specific exemplifying and non-limiting embodiments when read in connection with the accompanying drawings.

The verbs “to comprise” and “to include” are used in this document as open limitations that neither exclude nor require the existence of unrecited features. The features recited in dependent claims are mutually freely combinable un less otherwise explicitly stated. Furthermore, it is to be understood that the use of “a” or “an”, i.e. a singular form, throughout this document does not exclude a plurality.

BRIEF DESCRIPTION OF FIGURES

The embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings.

Figure 1 illustrates schematically an example of a monitoring system according to the invention.

Figures 2A-2C illustrate schematically examples of an elevator system in which embodiments of a monitoring system according to the invention may be im plemented.

Figure 3 illustrates schematically example locations of a sensor device and an optical imaging device according to the invention inside an elevator car. Figure 4 illustrates schematically an example of a method according to the in vention.

Figure 5 illustrates schematically another example of a method according to the invention.

Figure 6 illustrates schematically yet another example of a method according to the invention.

Figure 7 illustrates schematically yet another example of a method according to the invention.

Figure 8 illustrates schematically an example of components of a control unit according to the invention.

DESCRIPTION OF THE EXEMPLIFYING EMBODIMENTS

Figure 1 illustrates schematically an example of a monitoring system 100 ac cording to the invention for an elevator system 200. The monitoring system 100 may comprise a sensor device 110, an optical imaging device 120, and a control unit 130. The sensor device 110 and the optical imaging device 120 are communicatively coupled to the control unit 130. The sensor device 110 is configured to provide sensor data from inside an elevator car 202 of the eleva tor system 200 and the optical imaging device 120 is configured to provide im age data from inside the elevator car 202 as will be described later in this ap plication. The sensor device 110 and the optical imaging device 120 may be communicatively coupled to the control unit 130. The communication to and from the control unit 130 may be based on one or more known communication technologies, either wireless or wired, so that the communication between the control unit 130 and any other entity may be established as described throughout this application. The implementation of the control unit 130 may be done as a stand-alone unit or as a distributed control environment between a plurality of stand-alone units providing distributed controlling resource.

The monitoring system 100 may further comprise a remote monitoring unit 140 or be associated with the remote monitoring unit 140. The remote monitoring unit 140 may be located on-site, i.e. at the elevator system 200, or off-site, i.e. external to the elevator system 200. The remote monitoring unit 140 may be e.g. a cloud server, a service center, a maintenance center, or a data center. The remote monitoring unit 140 may receive fault codes from the elevator sys tem 200 and generate, service needs e.g. maintenance orders, based on the received fault codes, for example to at least one maintenance person. The control unit 130 and the remote monitoring unit 140 are communicatively cou pled to each other. The communication between the control unit 130 and the remote monitoring unit 140 may be based on one or more known communica tion technologies, either wired or wireless.

Figures 2A-2C illustrate schematically examples of the elevator system 200 in which different embodiments of the monitoring system 100 according to the in vention may be implemented for monitoring the elevator system 200. For sake of clarity the connections between the control unit 130 and the sensor device 110 and the optical imaging device 120 are not shown in the examples of Fig ures 2A-2C. The elevator system 200 comprises at least one elevator car 202 configured to travel between a plurality of floors 206a-206n along a respective elevator shaft 204 and an elevator control system, e.g. an elevator control unit, 205. The elevator system 200 of the examples of Figures 2A-2C comprises one elevator car 202 travelling along one elevator shaft 204, however the ele vator system 200 may also comprise an elevator group, i.e. group of two or more elevator cars 202 each travelling along a separate elevator shaft 204 configured to operate as a unit serving the same floors 206a-206n. The eleva tor control system 205 may be configured to control the operation of the eleva tor system 200. The elevator control system 205 may reside e.g. in a machine room (for sake of the clarity not shown in Figures 2A-2C) or in one of the land ings 206a-206n of the elevator system 200. The elevator system 200 may fur ther comprise one or more other known elevator related entities, e.g. hoisting system, user interface devices, safety circuit and devices, elevator door sys tem, etc., which are not shown in Figures 2A-2C for sake of clarity.

The control unit 130 may be implemented as a part of the elevator control sys tem 205. Alternatively, the control unit 130 may be implemented as a separate unit arranged to the elevator system 200 and being independent of the eleva tor control system 205. Alternatively, the control unit 130 may be implemented as an external unit being external to the elevator system 200, i.e. an external control unit. In the example of Figure 2A the control unit 130 is implemented as the part of the elevator control system 100. In the example of Figure 2B the control unit 130 is implemented as the separate unit arranged to the elevator system 200. In the example of Figure 2C the control unit 130 is implemented as the external unit. The control unit 130 implemented as the separate unit may be arranged to the elevator system 200 so that the control unit 130 is in dependent of the elevator control system 205. The control unit 130 implement ed as the separate unit may be arranged for example to the elevator car 202. Preferably, the control unit 130 implemented as the separate unit may be ar ranged to a rooftop of the elevator car 202 as illustrated in the example of Fig ure 2B. The implementation of the control unit 130 as the separate unit may be preferable for example in implementations where there is no access to a com munication interface of the control system 205 of the elevator system 200, e.g. if the elevator system 200 is a third party elevator system. The control unit 130 implemented as the external unit may be for example a cloud server as illus trated in Figure 2C.

The control unit 130 implemented as the part of the elevator control system 205 may be configured to obtain elevator system related data from the elevator system 200. The control unit 130 implemented as the separate unit may be configured to obtain the elevator system related data indirectly. The control unit 130 implemented as the separate unit is not able to communicate with the control system 205 of the elevator system 200, i.e. there is no access to the communication interface of the control system 205 of the elevator system 200, and thus the control unit 130 implemented as the separate unit cannot obtain the elevator system related data directly from the elevator system 200. Flow- ever, the control unit 130 implemented as the separate unit may comprise one or more sensors 208 configured to obtain the elevator system related data. The one or more sensors 208 of the control unit 130 implemented as the sepa rate unit may be internal and/or external to the separate unit. In the Example of Figure 2B the one or more sensor 208 of the control unit 130 implemented as the separate unit are internal sensors, but the control unit 130 may alternative ly or in addition comprise one or more external sensors. The one or more sen sors 208 of the of the control unit 130 implemented as the separate unit may comprise for example, but are not limited to, at least one accelerometer, at least one magnetometer, at least one gyroscope, at least one inclinometer, at least one pressure sensor, at least one temperature sensor, at least one hu midity sensor, and/or at least one microphone. The one or more external sen sors 208 may be communicatively coupled to the monitoring unit 130. The con trol unit 130 implemented as the external unit may be configured to obtain the elevator system related data from the elevator control system 205 e.g. via at least one modem device 210. The at least one modem device 210 may have either wired or wireless connection to the elevator control system 205. Alterna tively or in addition, the control unit 130 implemented as the external unit may be configured to obtain the elevator system related data indirectly from the el evator system 200 e.g. via a separate unit 212 arranged to the elevator system 200 and/or via a wireless data acquisition device 214 having a contact to ele vator control signals of the elevator system 200. This may be preferable for example in implementations where there is no access to the communication in terface of the control system 205 of the elevator system 200, e.g. if the eleva tor system 200 is a third party elevator system. The separate unit 212 arranged to the elevator system e.g. to the elevator car 202, may comprise one or more internal and/or external sensors arranged to the elevator system 200 and con figured to obtain the elevator system related data (for sake of clarity the one or more internal and/or external sensors are not show in the example of Figure 2C). The wireless data acquisition device 214, e.g. a data transfer unit (DTU), may be capable to obtain and the elevator related data of the elevator system 200 and transfer the obtained elevator related data of the elevator system 200 to the control unit 130 implemented as the external unit via a wireless commu nication network. Alternatively or in addition, the control unit 130 implemented as the external unit may be configured to obtain the elevator system related data via one or more wireless sensor devices 216 having a wireless connec tion to the control unit 130 implemented as the external unit and arranged to the elevator system 200 for obtaining the elevator related data. The wireless connection between the one or more wireless sensor devices and the control unit 130 implemented as the external control unit may be for example, but is not limited to, 5G. In the example of Figure 2C one wireless sensor device is arranged to the elevator car 202, but invention is not limited to that and there may also be more than one wireless sensor device 216 arranged to other loca tions within the elevator system 200. Although, in the example of Figure 2C all the above-described different example options to obtain the elevator system related data by the control unit 130 implemented as the external unit are shown, the control unit 130 implemented as the external unit may use one or more of these above-described different example options to obtain the elevator system related data.

The sensor device 110 may be such a sensor device that is capable to provide sensor data from inside the elevator car 202 from which passengers of the el- evator car 202 cannot be identified. In other words, the sensor data provided by the sensor device 110 may be in a form from which the passengers cannot be identified. This enables that the privacy protection of the passengers is not violated. The sensor device 110 may be one of the following: a radar-based sensor device, a passive infrared sensor (PIR sensor) device, Time-of-flight (TOF) camera, or a thermographic camera. The use of the radar-based sensor device 110 to provide the sensor data from inside the elevator car 202 enables an improved privacy of the passengers. Alternatively or in addition, the radar- based sensor device 110 does not require cleaning, which reduces the maintenance costs.

The sensor device 110 may be arranged to the elevator car 202, e.g. so that the provided sensor data covers the inside of the elevator car 202. The sensor device 110 may for example be arranged to an interior surface the elevator car, e.g. to a wall or a ceiling of the elevator car 202. The sensor device 110 may preferably arranged in a height direction, i.e. vertical direction, substantial ly close to the ceiling of the elevator car 202. This may enable a larger cover age of the sensor data in order to cover the inside of the elevator car 202 with the obtained sensor data. The sensor device 110 may preferably be arranged to a back wall 302 of the elevator car 202, a back corner of the elevator car 202, or to the ceiling of the elevator car 202 substantially at the location of the back wall 302 of the elevator car 202. Alternatively or in addition, the sensor device 110 may for example be arranged, e.g. hidden, behind the interior sur face of the elevator car 202 enabling that the sensor device 110 does not af fect the elevator car interior design. Alternatively, the sensor device 110 may for example be arranged even behind an outer surface of the elevator car 202. In these cases, depending on the type of the sensor device 110 an opening may be arranged to the surface(s) of the elevator car 202 to enable that sensor device 110 may provide the sensor data from inside the elevator car 202. Al ternatively in addition, the sensor device 110 may preferably arranged to the elevator car 202 so that the sensor device 110 is directed towards an elevator door 304 of the elevator car 202. In other words, the sensor device 110 may preferably be arranged to the elevator car 202 so that the provided sensor data covers also the elevator door 304 of the elevator car 202. This enables that a state of the elevator door 304 may be detected by using the obtained sensor data as will be described later in this application. The elevator door 304 may be a center opening elevator door comprising two door leaves, i.e. panels. Al- ternatively, the elevator door 304 may be a left or right opening elevator door comprising one door leaf.

The sensor data provided with the radar-based sensor device 110 may com prise e.g. radar data representing reflected radar signals from inside the eleva tor car 202. The radar data may comprise e.g. locations of reflection points of radar signals in a three-dimensional (3D) space for each time instant, i.e. a 3D- matrix for each time instant comprising values of reflected radar signals, e.g. an amplitude and a phase of the reflected radar signals, from each distance, each elevation angle value, and each azimuth angle value. The sensor data provided with the PIR sensor device may comprise e.g. motion data represent ing motion of at least one passenger and/or a detection of the motion of the at least one passenger inside the elevator car 202. The sensor data provided with the TOF camera 110 may comprise e.g. depth image data from inside the elevator car 202. The sensor data provided with the thermographic camera may comprise e.g. thermographic a thermographic image data from inside the elevator car 202.

The optical imaging device 120 may be for example a camera, a video camera, or any other optical instrument capable of providing optical image data from in side the elevator car 202. The optical imaging device 120 may be arranged to the elevator car 202, e.g. so that the provided image data covers the inside of the elevator car 202. The optical imaging device 120 may for example be ar ranged to an interior surface the elevator car, e.g. to a wall or a ceiling of the elevator car 202. Alternatively, the optical imaging device 120 may for example be arranged, e.g. hidden, behind the interior surface of the elevator car 202 or even behind the outer surface of the elevator car 202. In that case an opening is arranged to the surface(s) of the elevator car 202 to enable that the optical imaging device 120 may provide the image data from inside the elevator car 202. The optical imaging device 120 may preferably arranged in a height direc tion, i.e. vertical direction, substantially close to the ceiling of the elevator car 202. This may enable a larger coverage of the image data in order to cover the inside of the elevator car 202 with the provided image data.

Figure 3 illustrates schematically non-limiting example locations of the sensor device 110 and the optical imaging device 120 inside the elevator car 202. Figure 3 illustrates a top view of the interior of the elevator car 202. In the ex ample of Figure 3 the sensor device 110 and the optical imaging device 120 are arranged to the back wall 302 of the elevator car 202, i.e. i.e. the wall be ing opposite to the elevator door 304 of the elevator car 202, next to each oth er. However, the invention is not limited to that and the sensor device 110 and the optical imaging device 120 may be arranged to other locations inside the elevator car 202 as discussed above. In the example of Figure 3 the sensor device 110 and the optical imaging device 120 are arranged next to each oth er. However, the invention is not limited to that and the sensor device 110 and the optical imaging device 120 may also be arranged e.g. on different sides of the elevator car 202. In the example of Figure 3 the elevator door 304 is the center opening elevator door comprising two door leaves. However, the inven tion is not limited to that and the elevator door 304 may also be the left or right opening elevator door comprising one door leaf as described above.

The control unit 130 is configured to obtain from the sensor device 110 sensor data from inside the elevator car 202. According to an example, the control unit 130 may obtain the sensor data from the sensor device 110 in response to a detection of a need for monitoring the elevator system 200. In other words, the obtaining the sensor data from the sensor device 110 may be triggered by the detection of the need for monitoring the elevator system 200. The detection of the need for monitoring the elevator system 200 may comprise for example, but is not limited to, a detection of at least one fault or defect of the elevator system 200, and/or a detection of a need for remote controlling of the elevator system 200. The need of the monitoring the elevator system 200 may be de tected for example based on obtained elevator system related data and/or by receiving a user input. Alternatively, the control unit 130 may obtain the sensor data from the sensor device 110 for example according to a predefined sched ule, e.g. a predefined maintenance schedule, a predefined test schedule, etc..

The control unit 130 is further configured to detect based on the obtained sen sor data that the elevator car 202 is empty of passengers, i.e. human objects. In other words, the control unit 130 is further configured to detect based on the obtained sensor data that there are no passengers inside the elevator car 202. In response to the detection that the elevator car 202 is empty of the passen gers, the control unit 130 is configured to activate the optical imaging device 120 for providing the image data from inside the elevator car 202. In other words, the control unit 130 is capable to activate the optical imaging device 120 for providing the image data representing the interior of the elevator car 202 only after detecting based on the obtained sensor data from the sensor device 110 that the elevator car that the elevator car 202 is empty of the pas sengers. On the other hand, if the control unit 130 detects based on the ob tained sensor data from inside the elevator cart 202 that at least one passen ger resides inside the elevator car 202, the control unit 130 is not allowed to activate the optical imaging device 120 for providing the image data from in side the elevator car 202. This improves the privacy protection and/or ano nymity of the passengers of the elevator car 202. The activating the optical im aging device 120 for providing the image data from inside the elevator car 202 may comprise turning on the optical image device 120, starting the providing, by the optical imaging device 120, the image data from inside the elevator car 202, and/or starting transfer of the image data from the optical image device 120 to the control unit 130, i.e. obtaining, by the control unit 130, the image da ta from the optical imaging device 120.

The control unit 130 may be further configured to detect that the elevator door 304 of the elevator car 202 is in a closed state before the activation of the opti cal imaging device 120 for obtaining the image data. This improves further the privacy protection and/or anonymity of the passengers of the elevator car 202, because the passengers cannot enter the elevator car 202 during the obtaining of the image data, when the elevator door 304 is in the closed state. The de tection of the closed state of the elevator door 304 of the elevator car 202 may be based for example on the sensor data obtained from the sensor device 110 or door state data obtained from the elevator system 200. Especially, in case the control unit 130 is implemented as the separate unit and/or as the external unit, the detection of the closed state of the elevator door 304 of the elevator car 202 may be based on the sensor data obtained from the sensor device 110. Especially, in case the control unit 130 is implemented as the part of the elevator control system 205, the control unit 130 may obtain the door state da ta from the elevator system 200.

Alternatively or in addition, according to an example in response to obtaining the image data from the optical imaging device 120, the control unit 130 may be configured to detect based on the obtained image data at least one mal function of the elevator car 202. The at least one malfunction of the elevator car 202 may for example be a faulty light, damaged interior surface, etc.. Alter natively or in addition, in response to obtaining the image data from the optical imaging device 120, the control unit 130 may be configured to detect based on the obtained image data a cleaning need of the elevator car 202. Alternatively or in addition, in response to obtaining the image data from the optical imaging device 120, the control unit 130 may be configured to detect based on the ob tained image data at least object inside the elevator car 202. In addition to the detecting the at least one object inside the elevator car 202, the control unit 130 may be configured further to identify the at least one object detected in side the elevator car 202.

Alternatively or in addition, according to an example in response to obtaining the image data from the optical imaging device 120, the control unit 130 may further be configured to define based on the obtained image data whether the elevator car 202 is empty of load, e.g. objects other than passengers of the el evator car 202, i.e. non-living objects. In other words, in response to obtaining the image data from the optical imaging device 120, the control unit 130 may further be configured to define based on the obtained image data whether there is load inside the elevator car 202 or not. According to an example, in re sponse to the definition that the elevator car 202 is empty of the load, the con trol unit 130 may further be configured to activate a remote connection from the remote monitoring unit 140 to the elevator system 200. In response to acti vating the remote connection, the remote monitoring unit 140 may be config ured to execute at least one remote control operation of the elevator system 200 via the remote connection. The at least one remote control operation of the elevator system 200 may comprise at last one test drive of the elevator car 202, generating at least one remote elevator call, and/or at least one remote maintenance operation of the elevator system 200.

According to an example, in response to activating the remote connection the remote monitoring unit 140 may further be configured to obtain and monitor el evator related data representing at least one operation parameter of the eleva tor system 200 during the at least one remote control operation of the elevator system 200. The remote monitoring unit 140 may obtain the elevator related data from the control unit 130 or from a wireless data acquisition device having a contact to elevator control signals of the elevator system 200 similarly as dis cussed above in the context of the wireless data acquisition device 214 via which the control unit 130 implemented as the external unit may be configured to obtain the elevator system related data. The wireless data acquisition de vice, e.g. a data transfer unit (DTU), is capable to obtain and the elevator re lated data of the elevator system 200 and transfer the obtained elevator relat- ed data of the elevator system 200 to the remote monitoring unit 140 via wire less communication network.

According to an example, the remote monitoring unit 140 may further be con figured to generate at least one maintenance need in response to a detection of at least one malfunction of the elevator system 200 based on the elevator related data. The at least one maintenance need may be generated for exam ple to at least one maintenance person. Alternatively, the remote monitoring unit 140 may further be configured to deactivate the remote connection to the elevator system 200, if no malfunctions of the elevator system 200 are detect ed based on the elevator related data.

Above the invention is defined mainly by referring to the monitoring system 100 according to the invention. Next the invention will be described referring to a monitoring method for the elevator system 200 with the monitoring system 100 according to the invention as described above. Figure 4 schematically il lustrates an example of the method according to the invention.

At a step 410, the control unit 130 obtains from the sensor device 110 the sen sor data from inside the elevator car 202. According to an example, the control unit 130 may obtain the sensor data from the sensor device 110 in response to a detection of a need for monitoring the elevator system 200. In other words, the obtaining the sensor data from the sensor device 110 may be triggered by the detection of the need for monitoring the elevator system 200. The need for monitoring the elevator system 200 may comprise for example, but is not lim ited to, a detection of at least one fault or defect of the elevator system 200, and/or a need for remote controlling of the elevator system 200. The need of the monitoring the elevator system 200 may be detected for example based on obtained elevator system related data and/or by receiving a user input. Alter natively, the control unit 130 may obtain the sensor data from the sensor de vice 110 for example according to a predefined schedule, e.g. a predefined maintenance schedule, a predefined test schedule, etc..

At a step 420, the control unit 130 detects based on the obtained sensor data that the elevator car 202 is empty of passengers, i.e. human objects. In other words, at the step 420 the control unit 130 detects based on the obtained sen sor data that there are no passengers inside the elevator car 202. At a step 430 the control unit 130 activates the optical imaging device 120 for providing the image data from inside the elevator car 202, in response to the detecting that the elevator car 202 is empty of the passengers at the step 420. In other words, the control unit 130 is capable to activate optical imaging device for providing the image data representing the interior of the elevator car 202 only after detecting based on the obtained sensor data from the sensor device 110 that the elevator car that the elevator car 202 is empty of the passengers. On the other hand, if the control unit 130 detects based on the obtained sensor data that at least one passenger resides inside the elevator car 202, the con trol unit 130 is not allowed to activate the optical imaging device 120 for provid ing the image data from inside the elevator car 202. This improves the privacy protection and/or anonymity of the passengers of the elevator car 202. The ac tivating the optical imaging device 120 for obtaining the image data from inside the elevator car 202 may comprise turning on the optical image device 120, starting the providing, by the optical imaging device 120, the image data from inside the elevator car 202, and/or starting transfer of the image data from the optical image device 120 to the control unit 130, i.e. obtaining, by the control unit 130, the image data from the optical imaging device 120.

Figure 5 schematically illustrates another example of the method according to the invention. In the method according to the example of Figure 5 the control unit 130 may further detect at a step 510 that the elevator door 304 of the ele vator car 202 is in a closed state before the activation of the optical imaging device 120 for obtaining the image data at the step 430. This improves further the privacy protection and/or anonymity of the passengers of the elevator car 202, because the passengers cannot enter the elevator car 202 during the ob taining of the image data, when the elevator door 304 is in the closed state. The detection of the closed state of the elevator door 304 of the elevator car 202 may be based for example on the sensor data obtained from the sensor device 110 or on door state data obtained from the elevator system 200, as discussed above. In the example of Figure 5 the detection at the step 510 that the elevator door 304 of the elevator car 202 is in the closed state is performed after the detection that the elevator car 202 is empty of the passengers at the step 420. Flowever, the detection at the step 510 that the elevator door 304 of the elevator car 202 is in the closed state may also be performed before the detection that the elevator car 202 is empty of the passengers at the step 420.

Figure 6 schematically illustrates yet another example of the method according to the invention. In the method according to the example of Figure 6 the control unit 130 may alternatively or in addition in response to obtaining the image da ta from the optical imaging device 120 at the step 430 detect based on the ob tained image data at least one malfunction of the elevator car 202, a cleaning need of the elevator car 202, and/or at least one object inside the elevator car 202 at a step 610. The at least one malfunction of the elevator car 202 at the step 610 may for example be a faulty light, damaged interior surface, etc.. In addition to the detecting the at least one object inside the elevator car 202 at the step 610, the control unit 130 may further identify the at least one object detected inside the elevator car 202.

Figure 7 schematically illustrates yet another example of the method according to the invention. In the method according to the example of Figure 7, the con trol unit 130 may alternatively or in addition in response to obtaining the image data from the optical imaging device 120 at the step 430 define based on the obtained image data whether the elevator car 202 is empty of load, e.g. ob jects other than passengers of the elevator car 202, i.e. non-living objects, at a step 710. In other words, in response to obtaining the image data from the op tical imaging device 120, the control unit 130 may detect based on the ob tained sensor data whether there is load inside the elevator car 202 or not. At a step 720 in response to a definition that the elevator car 202 is empty of the load, the control unit 130 may further activate a remote connection from the remote monitoring unit 140 to the elevator system 200. At a step 730 in re sponse to activating the remote connection, the remote monitoring unit 140 may execute at least one remote control operation of the elevator system 200 via the remote connection. The at least one remote control operation of the el evator system 200 may comprise at last one test drive of the elevator car 202, generating at least one remote elevator call, and/or at least one remote maintenance operation of the elevator system 200.

According to an example, in response to activating the remote connection by the control unit 130 at the step 730, the remote monitoring unit 140 may further obtain and monitor elevator related data representing at least one operation parameter of the elevator system 200 during the at least one remote control operation of the elevator system 200. The remote monitoring unit 140 may ob tain the elevator related data from the control unit 130 or from the wireless da ta acquisition device having the contact to the elevator control signals of the elevator system 200 as discussed above. At a step 750, the remote monitoring unit 140 may further generate at least one maintenance need in response to a detection of at least one malfunction of the elevator system 200 based on the elevator related data at a step 740. The at least one maintenance need may be generated for example to at least one maintenance person. Alternatively, at a step 760 the remote monitoring unit 140 may further deactivate the remote connection to the elevator system 200, if no malfunctions of the elevator system 200 are detected based on the elevator related data at the step 740.

Figure 8 schematically illustrates an example of components of the control unit 130 according to the invention. The control unit 130 may comprise a pro cessing unit 810 comprising one or more processors, a memory unit 820 com prising one or more memories, a communication interface unit 830 comprising one or more communication devices, and possibly a user interface (Ul) unit 840. The mentioned elements may be communicatively coupled to each other with e.g. an internal bus. The memory unit 820 may store and maintain por tions of a computer program (code) 825 and any other data, e.g. the obtained sensor data, the obtained image data, and/or obtained elevator related data. The computer program 825 may comprise instructions which, when the com puter program 825 is executed by the processing unit 810 of the control unit 130 may cause the processing unit 810, and thus control unit 130 to carry out desired tasks, e.g. the operations of the control unit 130 and/or at least some of the method steps described above. The processing unit 810 may thus be ar ranged to access the memory unit 820 and retrieve and store any information therefrom and thereto. For sake of clarity, the processor herein refers to any unit suitable for processing information and control the operation of control unit 130, among other tasks. The operations may also be implemented with a mi crocontroller solution with embedded software. Similarly, the memory unit 820 is not limited to a certain type of memory only, but any memory type suitable for storing the described pieces of information may be applied in the context of the present invention. The communication unit 830 provides communication in terface for communication with any other unit, e.g. the sensor device 110, the optical imaging device 120, the remote monitoring unit 140, and/or any other units. The communication unit 830 may comprise one or more communication devices e.g. at least one radio transceiver, at least one antenna, at least one communication port, etc. The user interface unit 840 may comprise one or more input/output (I/O) devices, such as buttons, keyboard, touch screen, mi- crophone, loudspeaker, display and so on, for receiving user input and output ting information. The computer program 825 may be a computer program product that may be comprised in a tangible non-volatile (non-transitory) com puter-readable medium bearing the computer program code 825 embodied therein for use with a computer, i.e. the control unit 130.

The specific examples provided in the description given above should not be construed as limiting the applicability and/or the interpretation of the appended claims. Lists and groups of examples provided in the description given above are not exhaustive unless otherwise explicitly stated.

Claims

1. A monitoring system (100) for an elevator system (200), the monitoring system (100) comprising: a sensor device (110) for providing sensor data from inside an elevator car (202) of the elevator system (200), an optical imaging device (120) for providing image data from inside the eleva tor car (202), and a control unit (130) configured to: obtain sensor data from the sensor device (110), detect based on the obtained sensor data that the elevator car (202) is empty of passengers, and activate the optical imaging device (120) for providing the image data from inside the elevator car (202) in response to the detection that the elevator car (202) is empty of the passengers.

2. The monitoring system (100) according to claim 1, wherein the control unit (130) is further configured to detect that an elevator door (304) of the ele vator car (202) is in a closed state before the activation of the optical imaging device (120).

3. The monitoring system (100) according to any of the preceding claims, wherein the control unit (130) is configured to obtain the sensor data from the sensor device (110) in response to a detection of a need for monitoring the el evator system (200).

4. The monitoring system (100) according to any of the preceding claims, wherein in response to obtaining the image data from the optical imaging de- vice (120), the control unit (130) is further configured to define based on the obtained image data whether the elevator car is empty of load.

5. The monitoring system (100) according to claim 4, wherein in response to definition that the elevator car (202) is empty of the load, the control unit (130) is further configured to activate a remote connection from a remote monitoring unit (140) to the elevator system (200).

6. The monitoring system (100) according to claim 5, further comprising the remote monitoring unit (140) configured to execute at least one remote control operation of the elevator system (200) via the remote connection.

7. The monitoring system (100) according to claim 6, wherein the remote monitoring unit (140) is further configured to obtain and monitor elevator relat ed data representing at least one operation parameter of the elevator system (200) during the at least one remote control operation of the elevator system (200).

8. The monitoring system (100) according to claim 7, wherein the remote monitoring unit (140) is configured to obtain the elevator related data from the control unit or from a wireless data acquisition device having a contact to ele vator control signals of the elevator system (200).

9. The monitoring system (100) according to claim 7 or 8, wherein the re mote monitoring unit (140) is further configured to: generate at least one maintenance need in response to a detection of at least one malfunction of the elevator system (200) based on the elevator related da ta, or deactivate the remote connection, if no malfunctions of the elevator system (200) are detected based on the elevator related data.

10. The monitoring system (100) according to any of the preceding claims, wherein in response to obtaining the image data from the optical imaging de vice (120), the control unit (130) is configured to detect based on the obtained image data at least one malfunction of the elevator car (202), a cleaning need of the elevator car (202), and/or detect based on the obtained image data at least object inside the elevator car (202).

11. The monitoring system (100) according to any of the preceding claims, wherein the sensor device (110) is one of the following: a radar-based sensor device, a passive infrared sensor (PIR sensor) device, Time-of-flight (TOF) camera, or a thermographic camera.

12. The monitoring system (100) according to any of the preceding claims, wherein the control unit (130) is implemented as a part of an elevator control system (205), as a separate unit arranged to the elevator system (200) and be- ing independent of the elevator control system (205), or as an external unit be ing external to the elevator system (200).

13. The monitoring system (100) according to any of the preceding claims, wherein the optical imaging device (120) is a camera or a video camera.

14. A monitoring method for an elevator system (200), the method compris ing: obtaining (410), by a control unit (130), from a sensor device (110) sensor data from inside an elevator car (202) of the elevator system (200), detecting (420), by the control unit (130), based on the obtained sensor data that the elevator car (202) is empty of passengers, and activating (430), by the control unit (130), an optical imaging device (120) for providing image data from inside the elevator car (202).

15. The monitoring method according to claim 14 further comprising detect ing (510) that an elevator door (304) of the elevator car (202) is in a closed state before the activating the optical imaging device (120).

16. The monitoring method according to claim 14 or 15, wherein the obtain ing (410) the sensor data from the sensor device (110) is performed in re sponse to a detection of a need for monitoring the elevator system (200).

17. The monitoring method according to any of claims 14 to 16, further com prising in response to obtaining the image data from the optical imaging device (120), defining (710), by the control unit (130), based on the obtained image data whether the elevator car (202) is empty of load.

18. The monitoring method according to claim 17, further comprising activat ing (720), by the control unit (130), a remote connection from a remote moni toring unit (140) to the elevator system (200), in response to the defining that the elevator car (202) is empty of the load.

19. The monitoring method according to claim 18, further comprising execut ing (730), by the remote monitoring unit (140), at least one remote control op eration of the elevator system (200) via the remote connection.

20. The monitoring method according to claim 19, further comprising obtain ing and monitoring, by the remote monitoring unit (140), elevator related data representing at least one operation parameter of the elevator system (200) during the at least one remote control operation of the elevator system (200).

21. The monitoring method according to claim 20, wherein the remote moni toring unit (140) obtains the elevator related data from the control unit (130) or from a wireless data acquisition device having a contact to elevator control signals of the elevator system (200).

22. The monitoring method according to claim 20 or 21 , further comprising: generating (750), by the remote monitoring unit (140), at least one mainte nance need in response to a detection (740) of at least one malfunction of the elevator system (200) based on the elevator related data, or deactivating (760), by the remote monitoring unit (140), the remote connection, if no malfunctions of the elevator system (200) are detected (740) based on the elevator related data.

23. The monitoring method according to any of claims 14 to 22, further com prising in response to obtaining the image data from the optical imaging device (120), detecting, by the control unit (130), based on the obtained image data at least one malfunction of the elevator car (202), a cleaning need of the elevator car (202), and/or detect based on the obtained image data at least object in side the elevator car (202).

24. The monitoring method according to any of claims 14 to 23, wherein the sensor device (110) is one of the following: a radar-based sensor device, a passive infrared sensor (PIR sensor) device, Time-of-flight (TOF) camera, or a thermographic camera.

25. The monitoring system (100) according to any of claims 14 to 24, wherein the control unit (130) is implemented as a part of an elevator control system (205), a separate unit arranged to the elevator system (200) and being inde pendent of the elevator control system (205), or as an external unit being ex ternal to the elevator system (200).

26. The monitoring method according to any of claims 14 to 25, wherein the optical imaging device (120) is a camera or a video camera.