JP6795266B1 - Elevator user detection system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To notify that a user is detected without requiring a special device. An elevator user detection system according to an embodiment includes an image pickup means, a detection means, a door opening / closing control means, and a notification means. The imaging means captures a predetermined range including the door from the car to the landing. The detection means detects a user or an object by using an image taken by the image pickup means. The door opening / closing control means controls the opening / closing operation of the door based on the detection result of the detection means. The notification means notifies that a user or an object has been detected by the detection means through an operation button related to the opening / closing operation of the door. [Selection diagram] Fig. 1

Description

An embodiment of the present invention relates to an elevator user detection system.

Normally, when the elevator car arrives at the landing and opens the door, the door closes and departs after a predetermined time has passed. At that time, since the elevator user does not know when the car will close, he / she may hit the door in the middle of closing when he / she gets on the car from the landing. In order to avoid such a collision of the door at the time of boarding, there is a system that detects a user who gets in the car by using an image taken by a camera and reflects the detection result in the door opening / closing control.

Here, for example, an infrared sensor used for an automatic door has a narrow detection range and does not react unless the user comes near the door. On the other hand, in the case of a camera, the detection range is wide, the user can be detected from a place away from the door, and the opening / closing control of the door is also executed early before the user approaches the door.

International Publication No. 2007/129402 Japanese Unexamined Patent Publication No. 2014-185019

As described above, in the user detection system using a camera, the user is detected before the user approaches the door, and the detection result is reflected in the door opening / closing control. For this reason, the user in the car must press the door open button to wait for the user to board the vehicle or press the door close button to forcibly close the door without knowing that the door has been opened by camera detection. There is.

In addition, the user at the landing may not know that the door is open by camera detection, and may rush in or try to maintain the door open by pressing the landing call button (up / down button).

In addition, for example, there is a method of installing a display device or the like near the door to notify that the user has been detected. However, it is necessary to separately install a special device for notification, which is not preferable in terms of cost and aesthetics.

The problem to be solved by the present invention is to be able to notify that the user has been detected without the need for a special device, and as a result, prevent unnecessary button operations and allow the user to board safely. It is to provide an elevator user detection system that can be used.

The elevator user detection system according to the embodiment includes an image pickup means, a detection means, a door opening / closing control means, and a notification means. The imaging means captures a predetermined range including the door from the car to the landing. The detection means detects a user or an object by using an image taken by the image pickup means. The door opening / closing control means controls the opening / closing operation of the door based on the detection result of the detection means. The notification means notifies that a user or an object has been detected by the detection means through an operation button related to the opening / closing operation of the door.

FIG. 1 is a diagram showing a configuration of an elevator user detection system according to the first embodiment. FIG. 2 is a diagram showing an example of a photographed image of the camera in the same embodiment. FIG. 3 is a diagram for explaining a coordinate system in real space in the same embodiment. FIG. 4 is a diagram showing a configuration of a portion around the entrance / exit in the car according to the same embodiment. FIG. 5 is a diagram showing the configuration of the landing in the same embodiment. FIG. 6 is a diagram for explaining unnecessary button operations in the car according to the same embodiment. FIG. 7 is a flowchart showing a user detection process when the door of the user detection system according to the same embodiment is opened. FIG. 8 is a diagram showing a state in which the captured images in the same embodiment are divided into blocks. FIG. 9 is a flowchart showing the operation of the notification process in the same embodiment. FIG. 10 is a diagram showing the state of the operation panel in the car due to user detection, FIG. 10A is the state of the operation panel before user detection, and FIG. 10B is the operation after user detection. It shows the state of the board. FIG. 11 is a flowchart showing the notification process in the second embodiment. FIG. 12 is a diagram showing a change in the state of the operation panel in the car due to user detection in the second embodiment, and FIG. 12A is a state of the operation panel before user detection, FIG. 12B. Indicates the state of the operation panel after user detection. FIG. 13 is a diagram showing a state change of the operation panel of the landing due to user detection in the third embodiment, FIG. 13 (a) is a state of the operation panel before user detection, and FIG. 13 (b) is a use. It shows the state of the operation panel after the person is detected. FIG. 14 is a diagram showing a configuration of a touch panel type operation panel according to the fourth embodiment. FIG. 15 is a flowchart showing a notification process according to the fourth embodiment. FIG. 16 is a diagram showing a state of the operation panel after user detection in the fourth embodiment. FIG. 17 is a diagram showing a state of the operation panel after user detection as another example in the fourth embodiment. FIG. 18 is a flowchart showing a notification process according to the fifth embodiment. FIG. 19 is a diagram showing a stereo camera as an example of the imaging means. FIG. 20 is a diagram showing a TOF camera as an example of an imaging means.

Hereinafter, embodiments will be described with reference to the drawings.
The disclosure is merely an example, and the invention is not limited by the contents described in the following embodiments. Modifications that can be easily conceived by those skilled in the art are naturally included in the scope of disclosure. In order to clarify the explanation, in the drawings, the size, shape, etc. of each part may be changed with respect to the actual embodiment and represented schematically. In a plurality of drawings, the corresponding elements may be given the same reference numbers and detailed description may be omitted.

(First Embodiment)
FIG. 1 is a diagram showing a configuration of an elevator user detection system according to the first embodiment. Although the description will be given using one car as an example, the same configuration is used for a plurality of cars.

A camera 12 is installed above the doorway of the car 11. Specifically, the camera 12 is installed in the curtain plate 11a covering the upper part of the entrance / exit of the car 11 with the lens portion tilted directly downward, or on the landing 15 side or the inside of the car 11 by a predetermined angle. ..

The camera 12 is a small surveillance camera such as an in-vehicle camera, has a wide-angle lens or a fisheye lens, and can continuously capture images of several frames (for example, 30 frames / second) per second. The camera 12 is activated when the car 11 arrives at the landing 15 on each floor, and takes a picture including the vicinity of the car door 13.

The shooting range at this time is adjusted to L1 + L2 (L1 >> L2). L1 is a shooting range on the landing side, and has a predetermined distance from the car door 13 toward the landing 15. L2 is a photographing range on the car side, and has a predetermined distance from the car door 13 toward the back of the car. Note that L1 and L2 are ranges in the depth direction, and the range in the width direction (direction orthogonal to the depth direction) is at least larger than the width of the car 11.

At the landing 15 on each floor, a landing door 14 is openably and closably installed at the arrival port of the car 11. The landing door 14 engages with the car door 13 when the car 11 arrives to open and close. The power source (door motor) is on the car 11 side, and the landing door 14 only opens and closes following the car door 13. In the following description, it is assumed that the landing door 14 is also open when the car door 13 is open, and the landing door 14 is also closed when the car door 13 is closed.

Each image (video) continuously captured by the camera 12 is analyzed and processed in real time by the image processing device 20. Although the image processing device 20 is taken out from the car 11 for convenience in FIG. 1, the image processing device 20 is actually housed in the curtain plate 11a together with the camera 12.

The image processing device 20 is provided with a storage unit 21 and a detection unit 22. The storage unit 21 has a buffer area for sequentially storing images taken by the camera 12 and temporarily storing data necessary for processing of the detection unit 22. It should be noted that the storage unit 21 may store an image that has undergone processing such as distortion correction, enlargement / reduction, and partial cropping as preprocessing for the captured image.

The detection unit 22 detects a user near the car door 13 by using the captured image of the camera 12. When the detection unit 22 is functionally divided, it is composed of a detection area setting unit 22a and a detection processing unit 22b.

The detection area setting unit 22a sets the detection area E1 described later on the captured image of the camera 12. The detection processing unit 22b detects the presence or absence of a user or an object based on the image in the detection area E1 set by the detection area setting unit 22a. The "thing" referred to here includes, for example, a user's clothes and luggage, and a moving body such as a wheelchair. The car control device 30 may have some or all of the functions of the image processing device 20.

The car control device 30 controls the operation of various devices (destination floor buttons, lighting, etc.) installed in the car 11. Further, the car control device 30 includes a door opening / closing control unit 31, a notification unit 32, and an operation control unit 33.

The door opening / closing control unit 31 controls the opening / closing operation of the car door 13 when the car 11 arrives at the landing 15. Specifically, the door opening / closing control unit 31 opens the car door 13 when the car 11 arrives at the landing 15, and closes the door after a predetermined time has elapsed. However, if the user is detected by the detection processing unit 22b during the door closing operation, the door opening / closing control unit 31 prohibits the door closing operation of the car door 13 and reopens the car door 13. And keep the door open.

The notification unit 32 notifies the detection state of the user or the object by the detection unit 22 through the operation buttons related to the opening / closing operation of the car door 13. The "operation button related to the opening / closing operation of the car door 13" is an operation button used when the user opens / closes the car door 13. Specifically, the operation buttons include a door open button 46, a door close button 47 (see FIG. 4) provided in the car 11 described later, and landing call buttons 51 and 52 provided in the landing 15. (See FIG. 5).

Normally, these operation buttons have a lighting function and are turned off when the user is not operating the buttons. The notification unit 32 notifies that the detection operation is in progress by lighting or blinking the operation button set for notification among these operation buttons. The term "during detection operation" as used herein means that the camera 12 detects a user or an object in the detection area E1 shown in FIG. 2 and the car door 13 is in the door opening operation.

The operation control unit 33 locks the operation of the door closing button 47 when a user or an object is detected by the detection unit 22. "Locking the operation of the door closing button 47" means invalidating the door closing instruction by operating the door closing button 47. That is, when the user or an object is detected, the car door 13 is in the open state. At this time, it is preferable to lock the operation of the door closing button 47 so that the user in the car 11 does not close the door without permission.

FIG. 2 is a diagram showing an example of a captured image of the camera 12. E1 in the figure represents a detection area. In the example of FIG. 2, a two-door double-door type car 11 is taken as an example.

The car door 13 has two door panels 13a and 13b that move in opposite directions on the sill 13c. The same applies to the landing door 14, which has two door panels 14a and 14b that move in opposite directions on the sill 14c. The door panels 14a and 14b of the landing door 14 move in the door opening / closing direction together with the door panels 13a and 13b of the car door 13.

The camera 12 is installed above the doorway of the car 11. Therefore, when the car 11 opens at the landing 15, a predetermined range (L1) on the landing side and a predetermined range (L2) in the car are photographed. Of these, a detection area E1 for detecting a user riding in the car 11 is set in a predetermined range (L1) on the landing side.

In the real space, the detection area E1 has a distance of L3 from the center of the entrance (frontage) toward the landing direction (L3 ≦ the shooting range L1 on the landing side). The width W1 of the detection area E1 when fully opened is set to a distance equal to or greater than the width W0 of the entrance / exit (frontage). The shape of the detection area E1 may be rectangular, or may be trapezoidal including sills 13c and 14c and excluding blind spots of the three-sided frames 17a and 17b, as shown by diagonal lines in FIG. Further, the sizes of the detection area E1 in the vertical direction (Y direction) and the horizontal direction (X direction) may be fixed or dynamically changed according to the opening / closing operation of the car door 13. Is also good.

As shown in FIG. 3, the camera 12 has an X-axis in a horizontal direction with the car door 13 provided at the entrance / exit of the car 11, and a direction from the center of the car door 13 to the landing 15 (perpendicular to the car door 13). An image is taken with the direction) as the Y-axis and the height direction of the car 11 as the Z-axis. In each image taken by the camera 12, by comparing the portion of the detection area E1 in block units, the foot position of the user moving in the direction of the landing 15 from the center of the car door 13, that is, in the Y-axis direction. Detect movement.

FIG. 4 is a diagram showing a configuration of a portion around the entrance / exit in the car 11.
A car door 13 is provided at the entrance and exit of the car 11 so as to be openable and closable. In the example of FIG. 4, a two-door double-door type car door 13 is shown, and the two door panels 13a and 13b constituting the car door 13 open and close in opposite directions along the frontage direction (horizontal direction). To do. The "frontage" is the same as the entrance / exit of the car 11.

Front pillars 41a and 41b are provided on both sides of the doorway of the car 11, and surround the doorway of the car 11 together with the curtain plate 11a. The "front pillar" is also referred to as an entrance / exit pillar or an entrance / exit frame, and a door pocket for accommodating the car door 13 is generally provided on the back side. In the example of FIG. 2, when the car door 13 is opened, one door panel 13a is housed in a door pocket 42a provided on the back side of the front pillar 41a, and the other door panel 13b is provided on the back side of the front pillar 41b. It is stored in the door pocket 42b.

A display 43, an operation panel 44, and a speaker 48 are installed on one or both of the front columns 41a and 41b. In the example of FIG. 4, the speaker 48 is installed on the front pillar 41a, the display 43 and the operation panel 44 are installed on the front pillar 41b. In addition to the destination floor button 45 corresponding to each floor, the operation panel 44 is provided with a door open button 46 for instructing door opening and a door closing button 47 for instructing door closing.

Here, the camera 12 is installed in the central portion of the curtain plate 11a above the doorway of the car 11. When the car 11 opens at the landing 15 on an arbitrary floor, the camera 12 captures a predetermined range (L1) on the landing side and a predetermined range (L2) in the car (see FIG. 2).

FIG. 5 is a diagram showing the configuration of the landing 15.
At the landing 15 on each floor, a landing door 14 is provided at the arrival port of the car 11 so as to be openable and closable. In the example of FIG. 5, a double door double door type landing door 14 is shown. Upon arrival of the car 11, the two door panels 14a and 14b constituting the landing door 14 engage with the door panels 13a and 14b of the car door 13 shown in FIG. 4 to open and close.

Three-sided frames 17a, 17b, and 17c are provided around the landing door 14 (left and right and upper part). An operation panel 53 having landing call buttons 51 and 52 is installed on at least one of the three-sided frames 17a and 17b. The landing call button 51 is used as an upward button that is operated when the user goes upstairs. The landing call button 52 is used as a down button that is operated when the user goes downstairs. The three-sided frame 17c is provided with an indicator 54 for displaying the current position of the car 11 and a hall lantern 55 for displaying the arrival and driving direction of the car 11.

In this system, a camera 12 installed in the car 11 is used to detect a user coming from the landing 15 toward the car 11, and the car door 13 stands by with the door open. As a result, the user can get on smoothly without worrying about closing the door. Here, the user detection using the camera 12 has an advantage that the detection range is wider than that of, for example, an infrared sensor, and the user can be detected earlier from a position away from the car door 13. However, since the user does not know when the detection is made, the door open button 46 or the door close button 47 may be operated.

That is, as shown in FIG. 6, for example, when the user A is approaching the car 11, the user B in the car 11 does not know that the user B is detected by the camera 12. The door open button 46 may be pressed to maintain the door open state. Alternatively, when the user B does not notice the existence of the user A, the door closing button 47 may be pressed to accelerate the door closing. Since the user detection by the camera 12 is basically prioritized, the door open state is maintained even if the door close button 47 is pressed. However, there is also a system in which the door can be closed by enabling the operation of the door closing button 47 in the car 11 even when the user A is detected by the camera 12. In the case of such a system, the user A thinks that the car 11 is in the open state and gets on the car. Therefore, when the door is suddenly closed by a manual operation in the car 11, the door (car) is used. It is dangerous to collide with the door 13 and the landing door 14) or get caught.

The operation of this embodiment will be described in detail below.
FIG. 7 is a flowchart showing a user detection process when the door is opened in this system.

When the car 11 arrives at the landing 15 on an arbitrary floor (Yes in step S11), the car control device 30 opens the car door 13 and waits for a user to board the car 11 (step S12).

At this time, the camera 12 installed at the upper part of the doorway of the car 11 captures a predetermined range (L1) on the landing side and a predetermined range (L2) in the car at a predetermined frame rate (for example, 30 frames / sec). The image processing device 20 acquires images taken by the camera 12 in chronological order, and while sequentially storing these images in the storage unit 21 (step S13), executes the following user detection processing in real time. (Step S14). As preprocessing for the captured image, distortion correction, enlargement / reduction, and partial cropping of the image may be performed.

The user detection process is executed by the detection processing unit 22b of the detection unit 22 provided in the image processing device 20. It is assumed that the detection area E1 shown in FIG. 2 is set in advance by the detection area setting unit 22a of the detection unit 22 on the captured image of the camera 12. The detection processing unit 22b extracts an image in the detection area E1 from a plurality of captured images obtained by the camera 12 in time series, and detects the presence or absence of a user or an object based on these images.

Specifically, as shown in FIG. 8, the detection processing unit 22b divides the captured image into a matrix in units of predetermined blocks, and pays attention to the moving blocks among these blocks to be a user or an object. Detects the presence or absence of.

A grid of Wblocks on each side of the original image is called a "block". In the example of FIG. 8, the vertical and horizontal lengths of the blocks are the same, but the vertical and horizontal lengths may be different. Further, the block may have a uniform size over the entire image, or may have a non-uniform size such as shortening the vertical (Y direction) length toward the upper part of the image.

The detection processing unit 22b reads out each image held in the storage unit 21 one by one in chronological order, and calculates the average luminance value of these images for each block. At that time, the average luminance value for each block calculated when the first image is input as the initial value is held in the first buffer area (not shown) in the storage unit 21.

When the second and subsequent images are obtained, the detection processing unit 22b detects the average luminance value for each block of the current image and the average luminance value for each block of the previous image held in the first buffer area. Compare with. As a result, when there is a block having a brightness difference equal to or larger than a preset threshold value in the current image, the detection processing unit 22b determines the block as a moving block. Upon determining the presence or absence of motion with respect to the current image, the detection processing unit 22b holds the average luminance value for each block of the image in the first buffer area for comparison with the next image. After that, in the same manner, the detection processing unit 22b repeats determining the presence or absence of movement while comparing the brightness values of each image in block units in chronological order.

The detection processing unit 22b checks whether or not there is a moving block in the image in the detection area E1. As a result, if there is a moving block in the image in the detection area E1, the detection processing unit 22b determines that a person or an object exists in the detection area E1.

When the presence of a user or an object is detected in the detection area E1 when the car 11 is opened by such a method (Yes in step S15), the user from the image processing device 20 to the car control device 30. A detection signal is output. By receiving this user detection signal, the door open / close control unit 31 of the car control device 30 prohibits the door closing operation of the car door 13 and maintains the door open state (step S16).

Specifically, when the car door 13 is fully opened, the door opening / closing control unit 31 starts counting the door opening time, and closes the door when a predetermined door opening duration T1 (for example, 1 minute) is counted. I do. When the user is detected during this period and the user detection signal is sent, the door opening / closing control unit 31 stops the counting operation and clears the counting value. As a result, the door open state of the car door 13 is maintained during the door opening duration T1.

If a new user is detected during this period, the count value is cleared again, and the door open state of the car door 13 is maintained during the door opening duration T1. However, if the user comes many times during the door opening duration T1, the car door 13 cannot be closed forever. Therefore, an allowable time Tx (for example, 3 minutes) is provided. It is preferable to forcibly close the car door 13 when the permissible time Tx has elapsed.

Here, when the presence of a user or an object is detected in the detection area E1 in step S15, the user in the car 11 is detected through an operation button related to the opening / closing operation of the car door 13. It is notified that it is in operation (step S17). In the first embodiment, the door open button 46 is used as the "operation button related to the opening / closing operation of the car door 13", and the lighting or blinking of the door opening button 46 notifies that the detection operation is in progress. ..

The notification process in step S17 will be described in detail.
FIG. 9 is a flowchart showing the operation of the notification process. This notification process is executed by the notification unit 32 provided in the car control device 30.

First, the notification unit 32 sets the notification time Ta (step S21). The notification time Ta may be a predetermined fixed time (for example, 5 seconds). Further, the notification time Ta may be set in consideration of the opening / closing operation time of the car door 13.

The "opening / closing operation time of the car door 13" includes the reopening time T2 in addition to the door opening duration T1 described above. The reopening time T2 is the time until the car door 13 reopens in the middle of closing and fully opens, and the position where the car door 13 starts reopening (the start position of the reverse movement) and the moving speed of the car door 13. Demanded by. As the notification time Ta, at least a time corresponding to the door opening duration T1 may be set (Ta = T1), or a time obtained by adding the reopening time T2 to the door opening duration T1 may be set (Ta =). T1 + T2). The notification unit 32 lights or blinks the door open button 46 on the operation panel 44 during the notification time Ta (step S22).

FIG. 10 is a diagram showing a state change of the operation panel 44 in the car 11 due to user detection, FIG. 10A is a state of the operation panel 44 before user detection, and FIG. 10B is a user. The state of the operation panel 44 after the detection is shown.

Normally, as shown in FIG. 10A, various operation buttons on the operation panel 44, including the door open button 46, are in the off state unless the user operates them. When a user is detected, as shown in FIG. 6B, by lighting or blinking the door open button 46 on the operation panel 44, the user in the car 11 (particularly in front of the operation panel 44). (Users in) are notified that the detection operation is in progress. This makes it possible for the user in the car 11 to recognize that it is not necessary to operate the door open button 46. Furthermore, it is possible to make other users recognize that they are boarding. As a result, unnecessary operation of the door closing button 47 can be prevented, and the user can get on the vehicle safely.

The lighting or blinking of the door open button 46 is continued during the notification time Ta. In this case, if Ta = T1 or Ta = T1 + T2 is set in consideration of the opening / closing operation time of the car door 13, the door open button 46 continues to light or blink until the user gets on the vehicle. Therefore, it is possible to more reliably notify the user in the car 11 that the detection operation is in progress. When the notification time Ta has elapsed (Yes in step S23), the notification unit 32 turns off the door open button 46 to return to the original state (step S24).
Returning to FIG. 7, when the counting operation for the door opening duration T1 minutes is completed after the car door 13 is opened, the door opening / closing control unit 31 closes the car 11 and departs for the destination floor. (Step S18).

In the flowchart of FIG. 7, the case where the user is detected when the door is opened has been described, but the same applies when the door is closed, and the period from the start of the door closing to the full closing (during the door closing operation). ), When a user or an object is detected in the detection area E1, the door closing operation is temporarily suspended and the car door 13 is reopened.

As described above, according to the first embodiment, the detection operation is notified through the door open button 46 on the operation panel 44. The door open button 46 is one of the operation buttons related to the opening / closing operation of the car door 13, and is an existing elevator facility. Therefore, for example, it is possible to notify that the user is being detected without separately installing a notification display in the car 11. As a result, it is possible to prevent unnecessary button operations in the car 11 and allow the user coming from the landing 15 to board safely.

(Second Embodiment)
Next, the second embodiment will be described.
In the first embodiment, the door open button 46 is used as the operation button for notification, but in the second embodiment, the door close button 47 is used as the operation button for notification. Since the system configuration and the user detection process are the same as those in the first embodiment, the notification process will be described here.

FIG. 11 is a flowchart showing the notification process in the second embodiment. This notification process is executed in step S17 of FIG.

First, the notification unit 32 sets the notification time Ta (step S31). Similar to the first embodiment, the notification time Ta may be a predetermined fixed time (for example, 5 seconds). Further, in consideration of the opening / closing operation time of the car door 13, at least a time corresponding to the door opening duration T1 may be set (Ta = T1), and the time obtained by adding the reopening time T2 to the door opening duration T1. May be set (Ta = T1 + T2). In the second embodiment, this notification time Ta is used as a time for locking the operation of the door closing button 47.

That is, when a user or an object is detected by the notification unit 32, the notification unit 32 temporarily turns on or blinks the door closing button 47 on the operation panel 44 and then turns it off (steps S32-S33).

FIG. 12 is a diagram showing a state change of the operation panel 44 in the car 11 due to user detection, FIG. 12A is a state of the operation panel 44 before user detection, and FIG. 12B is a user. The state of the operation panel 44 after the detection is shown.

Normally, various operation buttons on the operation panel 44, including the door closing button 47, are turned off unless the user operates them. When a user or an object is detected, as shown in FIG. 12A, by lighting or blinking the door closing button 47 on the operation panel 44, the user in the car 11 (particularly the operation panel 44) The user in front of the user) can be notified that the detection operation is in progress.

The lighting or blinking of the door closing button 47 is temporary, and is turned off after a few seconds as shown in FIG. This is because if the door closing button 47 continues to be lit or blinking, it may be misunderstood that the car door 13 is closed. However, it is difficult to inform the user in the car 11 that the detection operation is in progress simply by temporarily lighting or blinking the door close button 47, and it is possible to forcibly close the door by operating the door close button 47. There is sex.

Therefore, the operation control unit 33 provided in the car control device 30 locks the operation of the door closing button 47 during the notification time Ta (step S34). As a result, for example, even in a system in which the door can be closed by operating the door closing button 47 in the car 11 during camera detection, the door closing operation during that time can be prohibited and the user can get on safely. .. When the notification time Ta elapses (Yes in step S23), the operation control unit 33 releases the operation lock of the door closing button 47 and returns it to the original state (step S36).

As described above, according to the second embodiment, the detection operation is notified through the door closing button 47 on the operation panel 44. Like the door open button 46, the door close button 47 is one of the operation buttons related to the opening / closing operation of the car door 13, and is an existing elevator facility. Therefore, as in the first embodiment, for example, it is possible to notify that the user is being detected without separately installing a notification display in the car 11. Further, by locking the operation of the door closing button 47 during the detection operation, the user coming from the landing 15 can safely get on the vehicle.

In addition, in combination with the first embodiment, the door open button 46 may be turned on or blinked.

(Third Embodiment)
Next, a third embodiment will be described.
In the first and second embodiments, the description is made on the assumption that the user in the car 11 is notified, but in the third embodiment, the user in the landing 15 is notified.

FIG. 13 is a diagram showing a state change of the operation panel 53 of the landing 15 due to user detection in the third embodiment, and FIG. 13 (a) shows a state of the operation panel 53 before user detection, FIG. 13 (b). ) Indicates the state of the operation panel 53 after the user is detected.

The landing call buttons 51 and 52 on the operation panel 53 installed at the landing 15 are also one of the operation buttons related to the opening / closing operation of the car door 13, and are normally turned off as shown in FIG. 13A. is there. When a user or an object is detected, the notification unit 32 selects a landing call button corresponding to the driving direction of the car 11 among the landing call buttons 51 and 52, and notifies the landing call button of the notification time Ta. Lights or flashes for a while. In the example of FIG. 13B, the landing call button 51 (upward button) is lit or blinking.

As described above, according to the third embodiment, it is notified that the detection operation is in progress through the landing call buttons 51 and 52 on the operation panel 53. As a result, it is possible to prevent the user from rushing into the car 11 or pressing the landing call buttons 51 and 52 to keep the door open, so that the vehicle can be safely boarded.

Since there is a possibility that the user in the car 11 may operate the door open button 46 and the door close button 47 only by notifying the user of the landing 15, the first or second embodiment may be combined. , It is preferable to include a notification to the user in the car 11.

(Fourth Embodiment)
Next, a fourth embodiment will be described.
In recent years, touch panel type operation panels have been increasingly used for elevators. On the touch panel type operation panel, the operation buttons displayed on the display screen are touch-operated with the user's finger. In the fourth embodiment, the detection operation is notified through the operation buttons on the touch panel type operation panel.

FIG. 14 is a diagram showing a configuration of a touch panel type operation panel according to the fourth embodiment. Instead of the physical button type operation panel 44 shown in FIG. 4, a touch panel type operation panel 60 is installed in the car 11.

The touch panel type operation panel 60 is composed of a display 61 and a transparent touch panel 62 mounted on the display 61. The touch panel 62 is a pointing device capable of detecting a position on the screen in which an object (for example, a user's finger) is in contact.

The touch panel 62 method includes, for example, a resistance film method and a capacitance method, but is not particularly limited to these methods. Further, the display 61 is composed of, for example, an LCD (Liquid Crystal Display), an organic EL (Organic Electro-Luminescense), or the like, but is not particularly limited thereto.

In addition to the destination floor button 63 corresponding to each floor, the door open button 64 and the door close button 65 are displayed on the display screen of the display 61 so as to be touch-operable. The touch panel 62 detects the user's touch position (coordinates), lights an operation button corresponding to the user's touch position via a touch panel controller (not shown), and sends a signal of the operation button to the car control device 30. Output.

The system configuration and user detection processing are the same as those in the first embodiment. Hereinafter, the notification process using the touch panel type operation panel 60 will be described.

FIG. 15 is a flowchart showing a notification process according to the fourth embodiment. This notification process is executed in step S17 of FIG.

First, the notification unit 32 sets the notification time Ta (step S41). Similar to the first embodiment, the notification time Ta may be a predetermined fixed time (for example, 5 seconds). Further, in consideration of the opening / closing operation time of the car door 13, at least a time corresponding to the door opening duration T1 may be set (Ta = T1), and the time obtained by adding the reopening time T2 to the door opening duration T1. May be set (Ta = T1 + T2).

Here, in the fourth embodiment, the notification unit 32 lights or blinks the door open button 64 on the operation panel 60 during the notification time Ta (step S42). Further, the notification unit 32 erases the display of the door closing button 65 on the operation panel 60 or changes to another display mode during the notification time Ta (step S43). Specifically, according to the instruction from the notification unit 32, the touch panel controller (not shown) controls the display of the door open button 64 and the door close button 65 on the operation panel 60.

FIG. 16 is a diagram showing a state of the operation panel 60 after the user is detected. As another example, FIG. 17 is a diagram showing a state of the operation panel 60 after user detection.

Normally, various operation buttons on the operation panel 60, including the door open button 64 and the door close button 65, are displayed so as to be touch-operable. When a user is detected, as shown in FIG. 16, by lighting or blinking the door open button 64 on the operation panel 60, the user in the car 11 (particularly the use in front of the operation panel 44). Person) is notified that the detection operation is in progress. As a result, it is possible to recognize that the door open button 64 does not need to be touch-operated.

Further, the door closing button 65 is made to recognize that the door closing operation cannot be performed by turning off the display as shown in FIG. 16 or changing to another display form as shown in FIG. The door closing button 65 shown in FIG. 17 is an example, and any display form may be used as long as it can be visually recognized that the door closing operation cannot be performed. As a result, it is possible to prevent the door closing operation during the detection operation of the user, and the user can be safely boarded.

The notification process using the door open button 64 and the door close button 65 is continued during the notification time Ta. In this case, if Ta = T1 or Ta = T1 + T2 is set in consideration of the opening / closing operation time of the car door 13, the door open button 64 lights or blinks and the door closes until the user gets on the vehicle. Since the display of the button 65 is erased or the display is changed, the user in the car 11 can be more reliably notified that the detection operation is in progress. When the notification time Ta elapses (Yes in step S44), the notification unit 32 turns off the door open button 46 through a touch panel controller (not shown) and normally displays the door close button 47 (steps S45-S46).

As described above, according to the fourth embodiment, the detection operation is notified through the door open button 64 and the door close button 65 on the touch panel type operation panel 60. Therefore, as in the first embodiment, for example, it is possible to notify that the user is being detected without separately installing a notification display in the car 11.

Further, by taking advantage of the characteristics of the touch panel, the door closing operation can be prohibited by turning off the display of the door closing button 65 or changing to another display form. Therefore, even if the operation is not locked by an internal process as in the second embodiment (see step S34 in FIG. 11), it is possible to prevent the door closing operation during the detection operation of the user, and the user can ride safely. Can be made to.

In addition, in this 4th embodiment, the notification to the landing user described in the 3rd embodiment may be combined.

(Fifth Embodiment)
Next, a fifth embodiment will be described.
In the first to fourth embodiments, the notification time Ta is set in advance, and the notification is made through the operation button during the set notification time Ta. On the other hand, in the fifth embodiment, the operation button is set only while the user or the object is detected by the camera 12 or until the door closing signal is output without setting the notification time Ta. Notify through.

FIG. 18 is a flowchart showing a notification process according to the fifth embodiment. This notification process is executed in step S17 of FIG.

When a user or an object is detected in the detection area E1 by the camera 12, the notification unit 32 lights or blinks the operation button 46 in the car 11 to notify that the detection operation is in progress (step S51). ).

Here, for example, when the user gets in the car 11 and the detection operation ends (Yes in step S52) such as when the user gets out of the detection area E1 (Yes in step S52), the notification unit 32 determines that the notification is unnecessary and opens the door. The button 46 is turned off (step S53). Alternatively, for example, when the door closing is started by operating the door closing button 47, that is, when the door closing signal indicating the door closing operation is output to the car control device 30 from the operation panel 44 in the car 11 (step). Yes) of S52, the notification unit 32 determines that the notification is not necessary, and turns off the door open button 46 (step S53).

As described above, according to the fifth embodiment, the notification time Ta is not required to be set, and the detection operation is performed through the door open button 46 only during the detection operation or until the door close signal is output. You can notify that.

Although the notification using the door open button 46 in the first embodiment has been described here as an example, the same applies to the second to fourth embodiments, and the notification time Ta is not set. It may be configured to notify only during the detection operation or until the door closing signal is output.

(About imaging means)
In each of the above embodiments, a system for detecting a user using one camera 12 has been described, but the imaging means is not limited to one camera 12. For example, a stereo camera 71 as shown in FIG. 18 may be used. The stereo camera 71 has two cameras 72 and 73, and three-dimensional information including a distance in the depth direction can be obtained from each image simultaneously captured by these cameras 72 and 73. The cameras 72 and 73 do not have to be integrated as the stereo camera 71, and may be a single unit.

Further, a TOF (Time of Fight) camera 81 as shown in FIG. 18 may be used. The TOF camera 81 includes a light source 82 and a camera sensor 83 compatible with reflected light, and includes a distance in the depth direction from the time until the light emitted from the light source 82 is reflected by the subject and received by the camera sensor 83. Dimensional information can be measured.

In this way, if the two cameras 72 and 73 or the TOF camera 81 are used, the detection accuracy in the depth direction is improved, so that the user or the object located away from the car door 13 can be detected more accurately to open and close the door. It can be reflected in the control. Also in this case, as described in each of the above embodiments, the user can prevent unnecessary button operations by promptly notifying that the detection operation is in progress through the operation buttons related to the opening / closing operation of the car door 13. Can be safely boarded.

According to at least one embodiment described above, it is possible to notify that the user has been detected without the need for a special device, and as a result, unnecessary button operations are prevented and the user can ride safely. It is possible to provide an elevator user detection system that can be used.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are also included in the scope of the invention described in the claims and the equivalent scope thereof.

11 ... Car, 11a ... Curtain board, 12 ... Camera, 13 ... Car door, 13a, 13b ... Door panel, 13c ... Car sill, 14 ... Landing door, 14a, 14b ... Door panel, 14c ... Landing sill, 15 ... Landing, 17a, 17b, 17c ... three-sided frame, 20 ... image processing device, 21 ... storage unit, 22 ... detection unit, 22a ... detection area setting unit, 22b ... detection processing unit, 30 ... car control device, 31 ... door opening / closing control unit , 32 ... Notification unit, 33 ... Operation control unit, E1 ... Detection area, 44 ... Operation panel, 45 ... Destination floor button, 46 ... Door open button, 47 ... Door close button, 51, 52 ... Landing call button, 53 ... Operation panel, 60 ... Touch panel type operation panel, 61 ... Display 61 ... Touch panel, 63 ... Destination floor button, 64 ... Door open button, 65 ... Door close button.

Claims (15)

An imaging means that captures a predetermined range including the door from the car to the landing,
A detection means that detects a user or an object using an image taken by this imaging means,
Based on the detection result of this detection means, the door opening / closing control means for controlling the opening / closing operation of the door and the door opening / closing control means
An elevator user detection system including a notification means for notifying that a user or an object has been detected by the detection means through an operation button related to the opening / closing operation of the door. The above notification means
Use of the elevator according to claim 1, wherein the elevator is notified through the operation button while the user or an object is detected by the detection means or until the door closing signal of the door is output. Person detection system. The user detection system for an elevator according to claim 1, wherein the notification time by the notification means is set in consideration of the opening / closing operation time of the door. The elevator user detection system according to claim 3, wherein the door opening / closing operation time includes at least a door opening duration of the door. The elevator according to claim 3, wherein the opening / closing operation time of the door includes a door opening duration of the door and a reopening time until the door is fully opened when the door is reopened in the middle of closing the door. User detection system. The operation buttons include a door open button provided in the car.
The above notification means
The user detection system for an elevator according to claim 1, wherein when a user or an object is detected by the detection means, the door open button is turned on or blinks. The operation buttons include a door closing button provided in the car.
The above notification means
The user detection system for an elevator according to claim 1, wherein when a user or an object is detected by the detection means, the door closing button is temporarily turned on or blinks and then turned off. The user detection system for an elevator according to claim 7, further comprising an operation control means for locking the operation of the door closing button when a user or an object is detected by the detection means. The user detection system for an elevator according to claim 8, wherein the time for locking the operation of the door closing button by the operation control means is set in consideration of the opening / closing operation time of the door. The elevator user detection system according to claim 9, wherein the door opening / closing operation time includes at least a door opening duration of the door. The elevator according to claim 9, wherein the opening / closing operation time of the door includes a door opening duration of the door and a reopening time until the door is fully opened when the door is reopened in the middle of closing the door. User detection system. The operation buttons include a door open button and a door close button displayed on a touch panel type operation panel provided in the car.
The above notification means
When a user or an object is detected by the detection means, the door open button is turned on or blinks, and the door close button display is turned off from the operation panel, or another display form indicating that the operation is not possible. The elevator user detection system according to claim 1, wherein the elevator is changed to. The operation buttons include a landing call button installed at the landing.
The user detection system for an elevator according to claim 1, wherein when a user or an object is detected by the detection means, the landing call button is turned on or blinks. The elevator user detection system according to claim 1, wherein the image pickup means includes at least two cameras. The elevator user detection system according to claim 1, wherein the image pickup means includes a camera capable of measuring three-dimensional information.

Images