An elevator system with an anonymous imaging solution and a method for providing an anonymous imaging solution of an elevator system
TECHNICAL FIELD
The invention concerns in general the technical field of elevator systems. Especially the invention concerns imaging solutions of the elevator systems.
BACKGROUND
Typically, elevator systems may comprise one or more optical camera -based solutions. However, the optical camera-based solutions may cause privacy issues. For example, emergency phone solutions may be based on using cameras and/or video streaming, which do not ensure the privacy of passengers entrapped inside elevator cars of the elevator systems and a rescue service operator, when the emergency calls are generated by the entrapped passengers to the rescue service operator.
Moreover, cameras inside the elevator cars may be prone to cyber-attacks and hacking. Privacy aspects are becoming more and more important due to the legislative progress in the recent years across the world, e.g. in EU, in North America, and in China. New legislations will make it harder for non-government related companies to install cameras in certain elevators. However, technologies that do preserve privacy are not affected. In addition to legislative progress, the passengers may also be more sensible about digital surveillance and data collection issues.
Therefore, there is a need to develop further solutions for imaging -based solutions of elevator systems.
SUMMARY
The following presents a simplified summary in order to provide basic understanding of some aspects of various invention embodiments. The summary is not an extensive overview of the invention. It is neither intended to identify key or critical elements of the invention nor to delineate the scope of the invention. The following summary merely presents some concepts of the invention in a simplified form as a prelude to a more detailed description of exemplifying embodiments of the invention.
An objective of the invention is to present an elevator system and a method for providing an anonymous imaging solution of an elevator system. Another objective of the invention is that the elevator system and the method for providing an anonymous imaging solution of an elevator system enables anonymous imaging solutions of the elevator system.
The objectives of the invention are reached by an elevator system and a method as defined by the respective independent claims.
According to a first aspect, an elevator system is provided, wherein the elevator system comprises: at least one elevator car configured to travel along a respective at least one elevator shaft, at least one imaging device arranged inside the at least one elevator car and configured to provide image data from inside the elevator car, and an elevator control system configured to control the at least one imaging device to be in an anonymous mode by default, wherein in the anonymous mode features identifying a passenger are not recognizable from the image data provided by the at least one imaging device.
At least one imaging device of the at least one imaging device may be a part of an emergency phone solution.
Alternatively or in addition, at least one imaging device of the at least one imaging device may be a part of a sign language -based user interface solution.
The at least one imaging device may comprise at least one optical imaging device configured to provide optical image data as the image data.
The at least one optical imaging device may comprise a processing part, wherein in the anonymous mode of the at least one optical imaging device the processing part of the at least one optical imaging device may be configured to process the optical image data so that the features identifying the passenger are not recognizable from the optical image data.
Alternatively or in addition, the at least one imaging device may comprise at least one time of flight (ToF) sensor device configured to provide depth image data as the image data.
The elevator control system may further be configured to control the at least one imaging device operating in the anonymous mode to switch to a non- anonymous mode in response to receiving consent data indicating a consent
from the passenger to switch to the non-anonymous mode, wherein in the non- anonymous mode the features identifying the passenger may be recognizable from the image data provided by the at least one imaging device operating in the non-anonymous mode.
Alternatively or in addition, the at least one imaging device may comprise at least one radar device configured to provide radar data as the image data.
According to a second aspect, a method for providing an anonymous imaging solution of an elevator system is provided, wherein the method comprises controlling at least one imaging device arranged inside at least one elevator car of the elevator system to be in an anonymous mode by default, wherein in the anonymous mode features identifying a passenger are not recognizable from the image data provided by the at least one imaging device.
At least one imaging device of the at least one imaging device may be a part of an emergency phone solution.
Alternatively or in addition, at least one imaging device of the at least one imaging device may be a part of a sign language -based user interface solution.
The at least one imaging device may comprise at least one optical imaging device configured to provide optical image data as the image data.
The method may comprise processing in the anonymous mode of the at least one optical imaging device the optical image data so that the features identifying the passenger are not recognizable from the optical image data.
Alternatively or in addition, the at least one imaging device may comprise at least one time of flight (ToF) sensor device configured to provide depth image data as the image data.
The method may further comprise controlling the at least one imaging device operating in the anonymous mode to switch to a non-anonymous mode in response to receiving consent data indicating a consent from the passenger to switch to the non-anonymous mode, wherein in the non-anonymous mode the features identifying the passenger may be recognizable from the image data provided by the at least one imaging device operating in the non-anonymous mode.
Alternatively or in addition, the at least one imaging device may comprise at least one radar device configured to provide radar data as the image data.
Various exemplifying and non-limiting embodiments of the invention both as to constructions and to methods of operation, together with additional objects and advantages thereof, will be best understood from the following description of specific exemplifying and non-limiting embodiments when read in connection with the accompanying drawings.
The verbs “to comprise” and “to include” are used in this document as open limitations that neither exclude nor require the existence of unrecited features. The features recited in dependent claims are mutually freely combinable unless otherwise explicitly stated. Furthermore, it is to be understood that the use of “a” or “an”, i.e. a singular form, throughout this document does not exclude a plurality.
BRIEF DESCRIPTION OF FIGURES
The embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings.
Figure 1A illustrates schematically an example elevator system.
Figure 1 B illustrates schematically example implementations of at least one imaging device inside an elevator car.
Figure 2 illustrates schematically an example of an emergency phone solution.
Figure 3 illustrates schematically an example of a sign language -based user interface solution.
Figure 4 illustrates schematically an example of an occupancy detection solution.
Figure 5 illustrates schematically an example of a method for providing an anonymous imaging solution of an elevator system.
Figure 6A illustrates schematically a non-limiting example of image data provided by an example imaging device operating in an anonymous mode.
Figure 6B illustrates schematically another non-limiting example of image data provided by an example imaging device operating in the anonymous mode.
Figure 7 illustrates schematically an example of components of an elevator control system.
DESCRIPTION OF THE EXEMPLIFYING EMBODIMENTS
Figure 1A illustrates schematically an example elevator system 100. The elevator system 100 comprises at least one elevator car 102 configured to travel along a respective at least one elevator shaft 104 between a plurality of landings, i.e. floors. The elevator system 100 of the example of Figure 1A comprises one elevator car 102 travelling along one elevator shaft 104, however the elevator system 100 may also comprise an elevator group, i.e. group of two or more elevator cars 102 each travelling along a separate elevator shaft 104 configured to operate as a unit serving the same landings. The elevator system 100 further comprises an elevator control system 108. The elevator control system 108 may comprise an elevator controller and/or one or more other local controllers, e.g. add-on installation controllers. The elevator control system 108 may be configured to control the operation of the elevator system 100 at least in part. The elevator control system 108 may for example reside in a machine room (for sake of the clarity not shown in Figure 1 A) and/or in one of the landings of the elevator system 100 (for sake of the clarity not shown in Figure 1 A). The elevator system 100 further comprises at least one imaging device 110a, 110b. The at least one imaging device 110a, 110b is arranged inside the at least one elevator car 102 and is configured to provide image data from inside the elevator car 102. The at least one imaging device 110a, 110b may be communicatively coupled to the elevator control system 108. The communication between the at least one imaging device 110a, 110b and the elevator control system 108 may be based on one or more known communication technologies, either wired or wireless. The elevator system 100 may further comprise one or more other known elevator related entities, e.g. hoisting system, user interface devices, safety circuit and devices, elevator brakes, elevator doors, etc., which are not shown in Figure 1 A for sake of clarity.
Figure 1 B illustrates schematically example implementations of the at least one imaging device 110a, 110b inside an elevator car 102 belonging to the at least one elevator car 102 of the elevator system 100. The at least one imaging de-
vice 110a, 110b may be arranged anywhere inside the elevator car 102 so that the at least one imaging device 110a, 110b may provide the image data from inside the elevator car 102. In other words, the at least one imaging device 110a, 110b may be arranged (e.g. placed) at different placements inside the elevator car 102 so that the at least one imaging device 110a, 110b may acquire the image data of the interior of the elevator car 102. The placement of the at least one imaging device 110a, 110b inside the at least one elevator car 102 may for example depend on the application of the at least one imaging device 110a, 110b. In the example of Figure 1 B only two non-limiting example placements of the at least one imaging device 110a, 110b inside the elevator car 102 are illustrated. In the example of Figure 1 B the elevator system comprises a first imaging device 110a and a second imaging device 110b, wherein the first imaging device 110a and the second imaging device 110b belong to the at least one imaging device 110a, 110b of the elevator system 100. In the example of Figure 1 B the first imaging device 110a is arranged to a user interface device 112 of the elevator system 100, e.g. a human machine interface (HMI) device. Alternatively or in addition, at least one imaging device belonging to the at least one imaging device 110a, 110b may be arranged in a vicinity of the user interface device 112. The user interface device 112 may for example be a car operation panel (COP) used for generating elevator commands, e.g. elevator car calls, and/or emergency calls, etc., via user interaction. Alternatively, the user interface 112 may be a separate emergency call unit used for generating emergency calls. The user interface device 112 may further comprise one or more other input/output (I/O) devices, such as buttons, keyboard, touch screen, microphone, loudspeaker, display and so on, for receiving user input and outputting information. For sake of clarity the one or more other I/O devices of the user interface device 112 are not shown in Figure 1 B. In the example of Figure 1 B the second imaging device 110b is arranged to a ceiling 114 of the elevator car 102 close to an upper back corner of the elevator car 102.
According to an example, the at least one imaging device 110a, 110b may comprise at least one optical imaging device, e.g. an camera. The at least one optical imaging device may be configured to provide optical image data as the image data. The image data provided by the at least one optical imaging device may comprise one or more images and/or video image comprising a plurality of consecutive images, i.e. frames. The at least one optical imaging de-
vice may comprise a processing part for processing the optical image data provided by the at least one optical imaging device. According to another example, the at least one imaging device 110a, 110b may alternatively or in addition comprise at least one radar device. The at least one radar device may be configured to provide radar data as the image data. According to yet another example, the at least one imaging device 110a, 110b may alternatively or in addition comprise at least one time of flight (ToF) sensor device. The at least one ToF sensor device may be configured to provide depth image data as the image data. The depth image data may comprise three-dimensional (3D) depth data. For example, the depth data may comprise a depth map or a point cloud data.
The at least one imaging device 110a, 110b may be used in different applications in the elevator system 100. Next some examples of the different applications of the at least one imaging device 110a, 110b in the elevator system 100 are discussed. However, the at least one imaging device 110a, 110b may also be used in any other applications in the elevator system 100. According to an example, at least one imaging device 110a, 110b of the at least one imaging device 110a, 110b may be implemented as a part of an emergency phone solution (i.e. system) 200 of the elevator system 100. Figure 2 illustrates schematically an example of the emergency phone solution 200. For example, the first imaging device 110a of the example of Figure 1 B may be used in the emergency phone solution implementation of the at least one imaging device 110a, 110b of the elevator system 100. The emergency phone solution 200 may further comprise an audio system 202 and an external entity 204. The audio system 202 may for example comprise one or more input/output (I/O) devices, e.g. a microphone and/or a loudspeaker. The one or more I/O devices of the user interface device 112 may be used as the one or more I/O devices of the audio system of the emergency phone solution 200. The external entity 204 may for example be a service center, a maintenance center, and/or a control center. The external center 204 may be communicatively coupled to the elevator system 100, e.g. to the elevator control system 108. The communication between the external center 204 and the elevator system 100 may be based on one or more known communication technologies, either wired or wireless. The image data provided by the at least one imaging device 110a, 110b being the part of the emergency phone solution 200 and/or the audio data provided by the audio system of the emergency phone solution 200 may be
communicated to the external entity 204 via the elevator control system 108. Similarly, the audio data may be provided from the external entity to the audio system of the emergency phone solution via the elevator control system 108.
According to another example, at least one imaging device 110a, 110b of the at least one imaging device 110a, 110b may alternatively or in addition be implemented as a part of a sign language -based user interface solution 300 of the elevator system 100. Figure 3 illustrates schematically an example of the sign language -based user interface solution 300. For example, the first imaging device 110a of the example of Figure 1 B may be used in the sign language -based user interface solution implementation of the at least one imaging device 110a, 110b of the elevator system 100. The sign language -based user interface solution may for example be used to provide sign language commands to the elevator control system 108 for controlling the operating the elevator system 100, e.g. to control the movement of the at least one elevator car 102 along the respective elevator shaft 104. For example, one or more elevator calls, e.g. elevator car calls, and/or emergency calls may be generated based on the sign language commands performed by at least one passenger 116 of the at least one elevator car 102. In the sign language -based user interface solution 300 implementation of the at least one imaging device 110a, 110b, the at least one imaging device 110a, 110b may be selected so that the resolution of the at least one imaging device 110a, 110b enables that the hand signs are recognizable. Also, the distance between the hand of the passenger 116 using the sign language and the at least one imaging device 110a, 110b may have an effect on the resolution. The larger the distance the distance between the hand and the at least one imaging device 110a, 110b is the larger the resolution needs to be.
According to yet another example, the least one imaging device 110a, 110b of the at least one imaging device 110a, 110b may alternatively or in addition be implemented as a part of an occupancy detection solution 400 of the elevator system 100. Figure 4 illustrates schematically an example of the occupancy detection solution 400. The occupancy detection solution 400 may further comprise a computing unit 402, which may comprise the elevator control system 108 and/or any other computing unit(s). For example, the at least one imaging device 110a, 110b of the elevator system 100 may be configured to obtain occupancy status data representing occupancy status of the elevator car 102. The occupancy status of the elevator car 102 may for example be empty
(i.e. empty of objects, e.g. passengers 116 or other objects) or occupied (i.e. at least one object, e.g. at least one passenger 116 and/or any other object, is inside the elevator car 102). The occupancy status data obtained by the at least one imaging device 110a, 110b may be provided to the computing unit 402 to be used for detecting the occupancy status of the elevator car 102. For example, the second imaging device 110b of the example of Figure 1 B may be used the occupancy detection solution implementation of the at least one imaging device 110a, 110b of the elevator system 100.
Next an example of a method for providing an anonymous imaging solution of the elevator system 100 is described by referring to Figure 5. Figure 5 schematically illustrates the method as a flow chart.
At a step 510, the elevator control system 108 controls the at least one imaging device 110a, 110b to be in an anonymous mode by default. In other words, the anonymous mode is the default operation mode of the at least one imaging device 110a, 110b. In the anonymous mode of the at least one imaging device 110a, 110b features identifying a passenger 116 are not recognizable from the image data 600 provided by the at least one imaging device 110a, 110b. The features identifying the passenger 116 may for example comprise one or more facial features or any other features of the passenger 116 that may be considered personal information or used to identify the passenger 116. Figure 6A illustrates schematically a non-limiting example of the image data 600 provided by an example imaging device 110a, 110b of the elevator system 100. In the example of Figure 6A the image data 600 comprises a depth image of a face of a passenger 116, wherein the depth image data may be provided by a ToF sensor device being the example imaging device 110a, 110b. From the image data 600 of the example of Figure 6A the features identifying the passenger 116 are not recognizable. The image data 600 of the example of Figure 6A may for example, but not limited to, be used in the emergency phone solution implementation of the at least one imaging device 110a, 110b. Figure 6B illustrates schematically another non-limiting example of the image data provided by an example imaging device 110a, 110b of the elevator system 100. In the example of Figure 6B the image data 600 comprises a set of depth images 600a, 600b of a passenger 116, wherein the depth image data may be provided by a ToF sensor device being the example imaging device 110a, 110b. From the image data 600 of the example of Figure 6B the features identifying the passenger 116 are not recognizable, but hand signs performed by the pas-
senger 116 are recognizable. The resolution of the example ToF sensor device used to provide the depth images 600a, 600b of the example image data 600 was HQVGA (Half Quarter Video Graphics Array) 224x172 (38K) pixels and the distance between the ToF sensor device and the hand of the passenger 116 was less than 50 centimeters. The image data 600 of the example of Figure 6B may for example, but not limited to, be used in the sign language - based user interface solution implementation of the at least one imaging device 110a, 110b.
According to an example, if the at least one imaging device 110a, 110b is the optical imaging device, the processing part of the at least one optical imaging device may process the optical image data, when the optical imaging device is in the anonymous mode, so that the features identifying the passenger 116 are not recognizable from the optical image data. The processing of the optical image data may for example comprise blurring. The processing part may be configured to blur the optical image data at least partly. For example, the processing part may apply the blurring only to portions of the image data in which the features identifying the passenger 116 may be detected. Alternatively, the processing part may apply the blurring to entire optical image data.
At a step 520, the elevator control system 108 may obtain the image data provided by the at least one imaging device 110a, 110b operating in the anonymous mode, i.e. anonymous image data. The obtaining of the anonymous image data may depend on the application, in which the at least one imaging device 110a, 110b is used. According to an example, in the emergency phone solution 200 implementation of the at least one imaging device 110a, 110b, the anonymous image data may be obtained from the at least one imaging device 110a, 110b operating in the anonymous mode in response to a generation of an emergency call, e.g. via the elevator user interface device 112, by a passenger 116. In other words, in the emergency phone solution 200 implementation of the at least one imaging device 110a, 110b, the generation of the emergency call may trigger the obtaining of the anonymous mage data from the at least one imaging device operating in the anonymous mode. According to another example, in the sign language -based user interface solution 300 implementation of the at least one imaging device 110a, 110b, the anonymous image data may for example be obtained from the at least one imaging device 110a, 110b operating in the anonymous mode in response to an activation of the sign language command use. The sign language command use may be
activated, when necessary. For example, the sign language command use may be activated in response to activation of the emergency phone solution and/or via a user interaction by the passenger 116. According to another example, in the occupancy detection solution 400 implementation of the at least one imaging device 110a, 110b, the anonymous image data may for example be obtained from the at least one imaging device 110a, 110b operating in the anonymous mode continuously or in response to an activation of the occupancy detection, e.g. in response to receiving a request to obtain the occupancy data.
At a step 530, the elevator control system 108 may further receive consent data indicating a consent from the passenger 116 to switch from the anonymous mode to a non-anonymous mode. In the non-anonymous mode, the features identifying the passenger 116 are recognizable from the image data provided by an imaging device 110a, 110b operating in the non-anonymous mode. According to an example, the consent data may be generated via a user interaction by the passenger 116 e.g. via the user interface device 112. The user interaction may for example comprise touch-based interaction, button pressingbased interaction, gestures-based interaction, sign language -based interaction, speech-based interaction, and/or a smart device -based interaction, etc.. According to another example, in case of the emergency phone solution implementation of the at least one imaging device 110a, 110b, in response to receiving the emergency call, the external unit 204 may generate a consent request to the passenger 116 via the user interface device 112 and in response to the consent request the consent data may be generated via a user interaction by the passenger 116, e.g. via the user interface device 112, similarly as discussed above.
At a step 540, the elevator control system 108 may further control at least one imaging device 110a, 110b operating, i.e. being, in the anonymous mode to switch to the non-anonymous mode in response to receiving the consent data indicating the consent from the passenger 116 to switch to the non-anonymous mode at the step 530. Each imaging device 110a, 110b being an optical imaging device or a ToF sensor device may be switched from the anonymous mode to the non-anonymous mode. According to an example, in the non-anonymous mode of an optical imaging device, the optical image data may for example be provided without the above discussed processing of the optical image data by the processing part, e.g. the optical image data may be provided without the
blurring, so that the features identifying the passenger 116 are recognizable from the optical image data provided by the optical imaging device operating in the non-anonymous mode. According to another example, in the non- anonymous mode of a ToF sensor device, the resolution of ToF sensor device may for example be improved in comparison to the resolution of the ToF sensor device operating in the anonymous mode so that the features identifying the passenger 116 are recognizable from the depth data provided by the ToF sensor device operating in the non-anonymous mode. After switching the at least one imaging device to the non-anonymous mode, the elevator control system 108 may obtain the image data provided by the at least one imaging device 110a, 110b operating in the non-anonymous mode, i.e. non-anonymous image data.
According to an example, when a ToF sensor device is used as a part of the emergency phone solution 200 to provide the anonymous image data, instead of controlling the ToF sensor device to switch to the non-anonymous mode, the elevator control system 108 may control at least one other imaging device 110a, 110b (e.g. being an optical imaging device) to switch to the non- anonymous mode, in response to receiving the consent data indicating the consent from the passenger 116 to switch to the non-anonymous mode, and to provide the non-anonymous image data.
Figure 7 illustrates schematically an example of components of the elevator control system 108. The elevator control system 108 may comprise a processing unit 710 comprising one or more processors, a memory unit 720 comprising one or more memories, a communication unit 730 comprising one or more communication devices, and possibly a user interface (III) unit 740. The mentioned elements may be communicatively coupled to each other with e.g. an internal bus. The memory unit 720 may store and maintain portions of a computer program (code) 725, the obtained image data, and any other data. The computer program 725 may comprise instructions which, when the computer program 725 is executed by the processing unit 710 of the elevator control system 108 may cause the processing unit 710, and thus the elevator control system 108 to carry out desired tasks, e.g. one or more of the method steps described above described above. The processing unit 710 may thus be arranged to access the memory unit 720 and retrieve and store any information therefrom and thereto. For sake of clarity, the processor herein refers to any unit suitable for processing information and control the operation of the el-
evator control system 108, among other tasks. The operations may also be implemented with a microcontroller solution with embedded software. Similarly, the memory unit 720 is not limited to a certain type of memory only, but any memory type suitable for storing the described pieces of information may be applied in the context of the present invention. The communication unit 730 provides one or more communication interfaces for communication with any other unit, e.g. the at least one imaging device 110a, 110b, one or more databases, or with any other unit. The user interface unit 740 may comprise one or more input/output (I/O) devices, such as buttons, keyboard, touch screen, mi- crophone, loudspeaker, display and so on, for receiving user input and outputting information. The computer program 725 may be a computer program product that may be comprised in a tangible nonvolatile (non-transitory) computer-readable medium bearing the computer program code 725 embodied therein for use with a computer, i.e. the elevator control system 108. The specific examples provided in the description given above should not be construed as limiting the applicability and/or the interpretation of the appended claims. Lists and groups of examples provided in the description given above are not exhaustive unless otherwise explicitly stated.