JP2023074380A - Elevator device and notification control method - Google Patents

Abstract

To provide an elevator device capable of notifying a user who gets on/off a car backward of situations behind the user in diversified manners.SOLUTION: An elevator device (1) includes an acquisition unit (31) acquiring imaging data from cameras (10, 21) photographing at least either a landing or the inside of a car (2), a recognition unit (32) recognizing a detection object existing in a predetermined area behind a user who gets on the car together with a predetermined kind of an accompanying object in relation to at least either the landing or the inside of the car (2) based on the imaging data acquired by the acquisition unit (31), a generation unit (33) generating notification data expressing the existence of the detection object recognized by the recognition unit (32) in a predetermined manner for notification to the user, and a notification unit (4) outputting notification information based on the notification data generated by the generation unit (33).SELECTED DRAWING: Figure 1

Description

The present invention relates to an elevator apparatus and an information control method.

When using an elevator with a wheelchair, baby stroller, trolley, etc., or when two people carrying luggage are using the elevator, etc., if you get on the elevator facing forward, you will be able to get off the elevator in a narrow car. is difficult to change. For example, in Patent Document 1, in order to check the surroundings when the user of such an elevator is getting off backwards, a plurality of cameras that capture images of the hall and a monitor that displays the images captured by the cameras are provided. An elevator system is disclosed.

JP 2005-178935

However, in the above-mentioned Patent Document 1, there is a method for avoiding danger, such as notifying the position of a person approaching the entrance and notifying when the user approaches the door of the elevator and is about to collide. A notification function is not disclosed. For example, in the elevator system described above, it is possible to display a person moving in the hall on the monitor, but even if a person is displayed on the monitor while running to get in, it is difficult for people getting off the elevator facing backwards to see it.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an elevator apparatus that diversifies the mode of notifying the rearward situation to a user getting in or out of the elevator facing backwards.

In order to solve the above problems, an elevator apparatus according to aspect 1 of the present invention includes an acquisition unit that acquires captured image data from a camera that captures images of at least one of the hall and the inside of the car; a recognition unit that recognizes, based on the imaging data, a detection target object existing in a predetermined area behind a user who gets on board with a predetermined type of user accompanying object in at least one of the hall and the car; a generation unit for generating notification data expressed in a predetermined manner for notifying the user of the presence of the detection target object recognized by the recognition unit; and based on the notification data generated by the generation unit. and a notification unit that outputs notification information.

According to the above configuration, when a detection target object exists in a predetermined area behind the user, it is detected and notified to the user in a predetermined manner. Able to recognize the presence of objects. Therefore, the user can move backward more safely.

In the elevator apparatus according to aspect 2 of the present invention, in the above aspect 1, the recognition unit determines whether the detection target object is detected based on a time change of an image captured by the camera of at least one of the landing and the car. Recognizing that the object is approaching the user, the generating unit may generate the notification data for notifying the user of the presence of the detection target object approaching the user.

According to the above configuration, it is possible for a user exiting the vehicle facing backward to easily notice a detection target object approaching the entrance/exit at the hall. In addition, it is possible for a user who gets on the car facing backward from the hall to easily notice the detection target object approaching the boarding/alighting gate in the car. This makes it easier for the user to take action to avoid collision with the detection target object.

In the elevator apparatus according to aspect 3 of the present invention, in aspect 1, the recognition unit recognizes that the user is approaching a frame of the entrance/exit based on the imaging data of the hall or the car. The generating unit may generate the notification data for notifying the user that the user is approaching the frame.

According to the above configuration, it is possible to make it easier for a user getting on or off the vehicle facing backward to notice that the user is approaching the frame of the boarding/alighting gate. This makes it easier for the user to take action to avoid collision with the frame.

An elevator apparatus according to aspect 4 of the present invention is the elevator apparatus according to aspect 1, wherein the recognizing unit detects that the user is facing backward from the current position in the hall based on the imaging data of at least one of the hall and the inside of the car. The generation unit recognizes that the detection target object exists in a moving area that may move a predetermined distance in the direction of the user, and the generating unit detects that the detection target object exists in the moving area. You may generate the said alerting|reporting data for alert|reporting to.

According to the above configuration, it is possible for a user who exits the vehicle facing backward to easily notice that a passenger or the like is present in a fixed moving area in which the user moves backward in the hall. As a result, the user moving backward at the boarding hall can easily take actions to avoid collision with passengers at the destination.

In the elevator apparatus according to aspect 5 of the present invention, in any one of aspects 1 to 4, the recognizing unit detects the image behind the one or more users based on the imaging data of the landing and the car. Recognizing the presence of the target object, the generating unit generates first notification data as the notification data for notifying the user that the detection target object exists in the car. and generating second notification data as the notification data for notifying the user that the object to be detected is present in the boarding hall, and generating the first notification according to the position of the user. The data and the second notification data may be output in different forms.

According to the above configuration, for example, one user getting off the car facing backwards is notified that the object to be detected exists behind the user in the car while the user is in the position before getting off the car. be able to. In addition, it is possible to inform one user getting off the vehicle facing backward that an object to be detected exists behind the user at the landing when the user is in a position near the entrance when getting off the vehicle. Moreover, when there are multiple users exiting the vehicle facing backwards, it is also possible to preferentially notify the users near the entrance/exit that there is an object to be detected behind the users at the boarding point. can.

In the elevator apparatus according to aspect 6 of the present invention, in any one of aspects 1 to 5, when the user is in the car or in a predetermined area near the entrance of the hall, the notification data is sent to the notification unit You may further have an output control part which outputs to.

According to the above configuration, it is possible not to notify when the user is not in the car. This makes it possible to avoid unnecessary notifications.

An elevator apparatus according to aspect 7 of the present invention, in any one of aspects 1 to 6, outputs the notification data to the notification unit only when the car arrives at the destination floor specified by the user. A controller may be further provided.

According to the above configuration, it is possible not to notify when the car has not arrived at the user's destination floor. This makes it possible to avoid unnecessary notifications.

According to an eighth aspect of the present invention, there is provided an elevator apparatus according to any one of the above aspects 1 to 7, in which the user gets in or out of the car during the period from when the door of the car starts to open until it finishes closing, or after the door starts to open. may be further provided with an output control section for outputting the notification data to the notification section until the completion of the above.

According to the above configuration, it is possible to prevent the notification from being performed at least during periods other than the period when the user is likely to get on or off the vehicle. This can reduce unnecessary notifications.

The elevator apparatus according to aspect 9 of the present invention is the elevator apparatus according to any one of aspects 1 to 8 above, further comprising an output control unit configured to control output of the notification data to the notification unit, wherein the recognition unit includes the user-associated While recognizing the wheelchair as a body, the direction of getting on and off of the user accompanied by the wheelchair is recognized, and the output control unit recognizes that the user got on the wheelchair with the wheelchair facing backward by the recognizing unit. The annunciation data may be output to the annunciation unit when it is recognized and/or when the recognizing unit recognizes that the user gets off the wheelchair backwards with the wheelchair.

According to the above configuration, it is possible to prevent notification other than at least one of when a wheelchair user who has difficulty turning in the car gets into the car facing backwards and when getting off the car facing backwards. can. This can reduce unnecessary notifications.

According to a tenth aspect of the present invention, in any one of the first to ninth aspects, the notification unit may be a display device that displays the notification information.

According to the above configuration, notification information can be visually provided to the user.

In the elevator apparatus according to aspect 11 of the present invention, in aspect 10 above, the generation unit may generate notification data for emphasizing and displaying the presence of the detection target object recognized by the recognition unit. .

According to the above configuration, the presence of the detection target object can be emphasized and displayed. This makes it easier for the user to notice the presence of the object to be detected in the background.

In an elevator apparatus according to aspect 12 of the present invention, in any one of aspects 1 to 11, the notification unit may include a speaker that outputs the notification information by sound.

According to the above configuration, it is possible to provide the user with the notification information in the form of sound.

In an elevator apparatus according to aspect 13 of the present invention, in any one of aspects 1 to 12, the notification unit may transmit the notification information to a terminal device possessed by the user.

According to the above configuration, it is possible to notify the rear situation from the terminal device at hand of the user. Therefore, it is possible to more reliably inform the user of the rear situation.

A notification control method according to aspect 14 of the present invention includes an acquisition step of acquiring imaging data from a camera that images at least one of the hall and the inside of the car, and based on the imaging data acquired in the acquisition step, the hall and a recognition step of recognizing a detection target object existing in a predetermined area behind a user who gets on board with a predetermined type of user accompanying object in at least one of said cars; a generation step of generating notification data expressed in a predetermined manner for notifying the user of the presence of the detection target object; and a notification step of outputting notification information based on the notification data generated in the generation step. ,including.

According to one aspect of the present invention, it is possible to provide an elevator apparatus that diversifies the aspect of notifying the rearward situation to a user getting in or out of an elevator facing backward.

1 is a block diagram showing the configuration of an elevator apparatus according to one embodiment of the present invention; FIG. It is a figure which shows the state in which the car of the said elevator apparatus exists in the position of a boarding point. FIG. 10 is a diagram showing a notification image displayed on the display device so as to highlight the presence of a detection target object whose presence is recognized in a predetermined area behind the user; A diagram showing a notification image displayed on the display device so as to indicate that a detection target object exists in an area where a user of the elevator apparatus may move backward from the current position by a predetermined distance in the hall. is. FIG. 10 is a diagram showing a notification image displayed so as to indicate that a detection target object exists according to the user's position;

[Embodiment]
An embodiment of the present invention will be described in detail below. FIG. 1 is a block diagram showing the configuration of an elevator apparatus 1 according to one embodiment of the present invention. FIG. 2 is a diagram showing a state in which the car 2 of the elevator system 1 is positioned at the landing 100. As shown in FIG.

<Configuration of Elevator Device 1>
The elevator apparatus 1 shown in FIG. 1 includes a car 2, a control device 3, and a notification unit 4.

The car 2 is provided with a camera 21 and a control panel 22 . The operation panel 22 is provided for specifying the destination floor, opening and closing the door 2a, and the like.

As shown in FIG. 2 , the camera 21 is installed above the back wall of the car 2 . Further, the camera 21 is installed on the transom of the car 2 so as to image the landing 100 from inside the car 2 . A camera 10 may be provided at the landing 100 to monitor the landing 100 instead of the camera 21 installed at the transom. The camera 10 is installed at a position close to the ceiling above the door frame 100a in the hall 100 on each floor. However, by installing the camera 21 in the transom of the car 2, the camera 10 on each floor can be omitted.

The control device 3 controls the operation of the car 2 by controlling a drive system (not shown) that drives the car 2 . Further, the control device 3 performs control for notifying that the detection target object O exists behind the user U shown in FIG. The control device 3 has an acquisition unit 31, a recognition unit 32, a generation unit 33, and an output control unit 34 in order to perform the control.

Acquisition unit 31 acquires imaging data from at least one of camera 10 installed at hall 100 and camera 21 installed in car 2 . The acquisition unit 31 is a part that receives the imaging data, and includes, for example, an image interface to which a cable for transmitting the imaging data of the cameras 10 and 21 is connected.

Based on the imaging data acquired by the acquisition unit 31, the recognition unit 32 exists in a predetermined area behind the user U who gets on the wheelchair U1 (user companion) in the hall 100 as shown in FIG. A detection target object O is recognized. Although FIG. 2 shows an example in which the detection target object O exists in a predetermined area of the hall 100, the recognition unit 32 recognizes that the user A detection target object O existing in a predetermined area behind U is recognized.

The detection target object O is an object that obstructs the route on which the user U exits the vehicle facing backward. Objects O to be detected include not only people but also objects placed in the hall 100 (plants, ornaments, etc.), the door 2a of the car 2, the doorway frame 100a, the wall around the door 2a, and the like.

The user attendant is such that the user U entering the car 2 in the forward direction by accompanying the user U exits in the backward direction. The user's companion is a predetermined type that can be recognized by the recognition unit 32, such as a shopping cart, stroller, trolley, and movable bed, in addition to the wheelchair U1. Also, when two people carry a load, if the front transporter gets on the car 2 first, and the rear transporter gets on the car 2 later, the rear transporter gets on the car 2 backwards. Since the user gets off the vehicle, the baggage also corresponds to the user's accompanying body.

The generation unit 33 generates notification data expressed in a predetermined manner for notifying the user U of the presence of the detection target object O recognized by the recognition unit 32 . Modes in which the notification data is expressed include sounds (warning sounds, voices such as announcements, etc.), displays, and combinations thereof.

The output control unit 34 outputs the notification data generated by the generation unit 33 to the notification unit 4 when predetermined conditions such as the position of the user, a predetermined period of time, and a predetermined case are satisfied. to control the output of

The notification unit 4 outputs notification information based on the notification data generated by the generation unit 33 . The notification unit 4 has a speaker 41, a display device 42, and a communication unit 43 as devices for notification.

The speaker 41 is provided to output notification information by sound. As shown in FIG. 2, the speaker 41 is installed on the ceiling of the car 2, for example. The display device 42 is provided to output notification information by displaying an image. As shown in FIG. 2, the display device 42 is installed on the back wall of the car 2, for example. The place where the speaker 41 is installed is not limited to the ceiling and may be a side wall. Moreover, the place where the display device 42 is installed is not limited to the back wall, and may be a side wall as long as it is easy for the user U to see. Also, the device that outputs the notification information may be a projector. The notification information may be projected onto the floor or wall of the hall 100 by a projector.

The communication unit 43 communicates with the terminal device 20, which is equipment possessed by the user U. FIG. The communication unit 43 transmits notification information to the terminal device 20 . The terminal device 20 is a device having a portable communication function, such as a smart phone and a tablet.

<Notification Operation of Elevator Device 1>
Next, the notification operation of the elevator apparatus 1 executed according to the notification control method by the control device 3 will be described.

FIG. 3 is a diagram showing a notification image 200 displayed on the display device 42 so as to highlight the presence of the detection target object O whose presence is recognized in the predetermined area behind the user U. As shown in FIG. FIG. 4 is displayed on the display device 42 so as to indicate that the detection target object O exists in the movement area A where the user U may move backward from the current position by a predetermined distance in the boarding hall 100. 4 is a diagram showing a notification image 201; FIG. FIG. 5 is a diagram showing a notification image 202 displayed on the display device 42 so as to indicate that the detection target object O exists according to the position of the user U. As shown in FIG.

As shown in FIG. 2 , it is assumed that the object to be detected O exists in the hall 100 when the user U enters the car 2 facing forward and gets off at the desired floor. In this case, at least one of the cameras 10 and 21 images the detection target object O, and outputs the captured image of the detection target object O as captured data.

In the control device 3, the acquisition unit 31 acquires image data from the cameras 10 and 21 (acquisition step). The recognition unit 32 recognizes the user U and the detection target object O in the captured image based on the captured data (recognition step). The recognition unit 32 recognizes the detection target object O using a known object recognition technology. Examples of such object recognition technology include object recognition technology using AI (Artificial Intelligence).

When the recognizing unit 32 extracts the characteristics of the person in the captured image and the characteristics of the wheelchair U1 as the characteristics other than the person, the recognition unit 32 recognizes that the person is the user U who got in the wheelchair U1 and the orientation of the user U. to recognize Further, when recognizing the presence of the detection target object O in the captured image, the recognition unit 32 outputs information indicating the presence of the detection target object O, such as position information of the detection target object O. This information also includes information indicating the positional relationship between the user U and the object O to be detected.

When the recognizing unit 32 recognizes that the detection target object O exists in a predetermined area behind the user U getting off the vehicle facing backward in the captured image, the generating unit 33 generates a Generate notification data (generating step). When the generation unit 33 generates notification data in the form of sound, data of a warning sound, voice data announcing that the detection target object O exists in a predetermined area behind the user U who gets off the vehicle facing backward, and the like. to generate Alternatively, instead of generating the warning sound data and the voice data, the generation unit 33 may read these data pre-recorded in a storage device (not shown) included in the elevator apparatus 1 from the storage device. , such data reading may be regarded as data generation. Further, when generating notification data in the form of an image, the generation unit 33 generates, as notification data, an image indicating that the detection target object O exists in a predetermined area behind the user U getting off the vehicle facing backward. . The generation unit 33 may generate, for example, an illustration showing the relative positional relationship between the user U and the door 2a or the like, or may generate a mark (for example, a frame F (Fig. 3) or a moving area A (see FIG. 4)) may be added.

The output control unit 34 controls output of notification data to the notification unit 4 . Specifically, the output control unit 34 outputs the notification data from the generation unit 33 to the notification unit 4 when a predetermined condition is satisfied. Such conditions will be described later in detail. Moreover, the output control unit 34 may convert the digital notification data output from the generation unit 33 into an analog notification signal as necessary.

In the notification unit 4, when sound notification data is input, the speaker 41 outputs the notification data as sound notification information (notification step). Further, when the notification data of the notification image is input, the display device 42 displays the notification image as notification information. The communication unit 43 also modulates the notification data into a transmission signal and transmits the transmission signal to the terminal device 20 .

Although not shown, the terminal device 20 includes a speaker and a display device as well as a vibration device for vibrating the terminal device 20 in the same manner as the notification unit 4 . Therefore, not only can the speaker output sound notification information and the display device can display the notification image, but the vibration device can vibrate the terminal device 20 to output the notification information.

As described above, the elevator apparatus 1 includes the control device 3 having the acquisition unit 31 , the recognition unit 32 , the generation unit 33 and the output control unit 34 , and the notification unit 4 . Thereby, when the detection target object O exists in the predetermined area behind the user U, it is detected and notified to the user U in a predetermined manner. Therefore, the user U can recognize the presence of the detection target object O, which is difficult for the user to notice. Therefore, the user U can move backward more safely.

The notification unit 4 includes a speaker 41 that outputs notification information by sound. Accordingly, it is possible to provide the user U with the notification information in the form of sound. The notification unit 4 also includes a display device 42 that displays notification information. Thereby, the notification information can be visually provided to the user U. By outputting the notification information through the speaker 41 and the display device 42, the notification information can be provided to the user U in various ways.

When displaying notification information on the display device 42 , the generation unit 33 may generate notification data for emphasizing the existence of the detection target object O recognized by the recognition unit 32 and displaying it. The display device 42 displays a notification image 200 as shown in FIG. 3 based on such notification data. The notification image 200 shows a figure (for example, a circle) indicating the position where the detection target object O exists in the hall 100, and a frame F arranged so as to surround the detection target object O. FIG.

As a result, the presence of the detection target object O can be emphasized and displayed. Therefore, it becomes easier for the user U to notice the existence of the detection target object O in the back. Note that the form in which the presence of the detection target object O is emphasized is not limited to the frame F described above, and may be another form in which an arrow is shown in the vicinity of the detection target object O. FIG.

The notification unit 4 also includes a communication unit 43 that transmits notification information to the terminal device 20 . As a result, the terminal device 20 at the user U's hand can notify the rear situation. Therefore, it is possible to inform the user U of the rear situation more reliably.

By the way, in the example described above, it is assumed that the detection target object O is in a stationary state. On the other hand, the control device 3 may output notification data for notifying the presence of the moving detection target object O, specifically, the detection target object O approaching the user U. FIG.

When informing the user U of the existence of the object to be detected O approaching the user U, the recognition unit 32 detects the presence of the detection target object O based on the time change of the captured image of at least one of the hall 100 and the car 2 captured by the cameras 10 and 21 . It recognizes that the target object O is approaching the user U. The recognition unit 32 determines the moving direction and moving speed of the detection target object O based on the change between two or more consecutive captured images by a moving object recognition method using optical flow, inter-frame difference method, or the like. . Further, the recognition unit 32 determines the moving direction and moving speed of the detection target object O based on the difference in the coordinate values of the representative point (for example, the center) of the detection target object O between two or more consecutive captured images. may

The generating unit 33 generates notification data for notifying the user U of the presence of the detection target object O approaching the user U. FIG. The generation unit 33 may determine whether or not to notify according to at least one of the position and speed of the detection target object O approaching.

When generating notification data expressed in the form of sound, the generation unit 33 may generate notification data so that the notification sound differs according to at least one of the position and speed of the approaching detection target object O. good. For example, the generating unit 33 may increase the notification sound as the detection target object O approaches, or lengthen the output length of the notification sound as the detection target object O approaches.

When the generation unit 33 generates notification data expressed in the form of an image, the generation unit 33 generates display data for animation display of a state in which the detection target object O is approaching the user U, or display data for displaying the state by switching between still images. Generate data. The generation unit 33 may also generate display data for displaying a warning message warning that the detection target object O is approaching the user U. FIG. Further, the generation unit 33 may generate the notification image 200 described above such that the frame F arranged so as to surround the detection target object O blinks or the color of the frame F changes.

As a result, the user U exiting the vehicle facing backward can easily notice the detection target object O approaching the entrance/exit at the hall 100 . In addition, the user U who gets on from the hall 100 facing backward can easily notice the detection target object O approaching the entrance/exit in the car 2 . Therefore, it becomes easier for the user U to take action to avoid collision with the object O to be detected.

In addition, the control device 3 notifies the user U that the user U is approaching the frame 100a of the entrance/exit when the user U gets on from the platform 100 backwards or gets off from the car 2 backwards. You may output the alerting|reporting data to carry out. In this case, the recognition unit 32 recognizes the frame 100a as the detection target object O and also recognizes that the user U is approaching the frame 100a, based on the imaging data obtained by imaging the inside of the hall 100 or the car 2 .

The generating unit 33 generates notification data for notifying the user U that the user U is approaching the frame 100a. The generation unit 33 may determine whether or not to notify according to the degree to which the user U approaches the frame 100a.

When generating the notification data expressed in the form of sound, the generation unit 33 may generate the notification data so that the notification sound changes according to the degree of approach to the frame 100a. For example, the generating unit 33 may increase the notification sound as the degree increases, or lengthen the output length of the notification sound as the degree increases.

When generating notification data expressed in the form of an image, the generation unit 33 generates display data that displays an animation of the state in which the user U is approaching the frame 100a, and display data that displays the state by switching between still images. Generate. The generation unit 33 may also generate display data for displaying a warning message warning that the user U is approaching the frame 100a.

This makes it easier for the user U getting off the vehicle facing backward to notice that the user U is approaching the frame 100a. Therefore, it becomes easier for the user U to take action to avoid collision with the frame 100a.

Further, the control device 3 may output notification data for notifying the presence of the detection target object O in the moving area where the user U moves in the hall 100 . In this case, the recognizing unit 32 identifies a movement area in which the user U may move backward from the current position in the hall 100 by a predetermined distance based on the imaging data obtained by imaging at least one of the hall 100 and the car 2. recognizes that the detection target object O exists in

The generating unit 33 generates notification data for notifying the user U that the detection target object O exists in the movement area. When generating notification data expressed in the form of an image, the generation unit 33 generates, as notification data, display data that clearly indicates a movement area in which the user U moves backward and the position of the detection target object O in the movement area. .

In addition, when a plurality of users U get off, the generation unit 33 may generate notification data indicating a moving area behind each of the users U. FIG.

The display device 42 displays a notification image 201 as shown in FIG. 4 based on such notification data. The notification image 201 shows the user U exiting the vehicle backwards, a certain movement area A in which the user U moves backwards in the hall 100, and the position where the detection target object O exists in the movement area A. there is

This makes it easier for the user U to notice that the detection target object O exists at the destination of the user U's movement. Therefore, the user U who moves backward in the hall 100 is more likely to take action to avoid collision with passengers or the like at the destination.

The control device 3 may output different notification data according to the user U's position. In this case, the recognition unit 32 recognizes that the object to be detected O exists behind the user U from the imaging data of the hall 100 and the car 2 . The user U may not be limited to one person, but may be multiple persons.

The generation unit 33 generates notification data so that the output forms of the first notification data and the second notification data are changed according to the position of the user U. FIG. Specifically, when the user U is in the car 2 and the detection target object O exists in the predetermined area behind the user U in the car 2 , the generation unit 33 generates the detection target object O First notification data is generated as notification data for notifying the user U of the existence of the . Further, when the user U approaches the boarding/alighting gate when getting off the train and the detection target object O exists in the hall 100 , the generation unit 33 notifies the user U that the detection target object O exists in the hall 100 . second notification data is generated as notification data for

The generation unit 33 may generate notification data so as to switch from the first notification data to the second notification data according to the position of the user U. FIG. In addition, when generating notification data expressed in the form of an image, the generation unit 33 may generate notification data by connecting the first notification data and the second notification data as images.

The display device 42 receives image notification data based on the first notification data and the second notification data output from the generation unit 33 through the output control unit 34, and displays a notification image 202 as shown in FIG. In notification image 202, user U and detection target object O are shown in car 2 based on the first notification data when user U is at position P1 in car 2 (first display state). Further, when the user U is at the position P2 at the threshold 2b of the entrance/exit, the user U is shown near the entrance/exit, and the detection target object O is shown in the hall 100 based on the second notification data ( second display state).

Note that when the user U has moved to the position P3 in the boarding hall 100, the notification image 202 does not show the object O to be detected.

In FIG. 5, for the sake of convenience, the first display state and the second display state are shown to be displayed at the same time, but the first display state and the second display state are displayed separately in the notification image 202. shown. Also, in FIG. 5, the position P3 of the user U is shown for the sake of convenience, but it is not shown in the notification image 202. FIG.

Thereby, the user U can recognize the presence of the detection target object O according to his/her own position.

When a plurality of users U get off, the generation unit 33 divides the notification image 202 into two, one of which displays the state inside the car 2, and the other of which displays the state of the hall 100. You may generate|occur|produce as the alerting|reporting data displayed as a screen which carries out. Such notification data is generated, for example, as a two-screen image such as a picture-in-picture.

In addition, the generation unit 33 displays information on a large screen for the user U with a high priority of notification, for example, the user U who is closer to the entrance/exit, and displays the information on a large screen for the user U with a low priority of notification. The information to be shown may be processed so as to be displayed on a small screen. Alternatively, the generation unit 33 may process the notification data so that the screen is equally divided regardless of the notification priority.

As described above, the control device 3 may output notification data to the notification unit 4 when a predetermined condition is satisfied. An example of this will be described in detail below.

For example, the control device 3 outputs the notification data when the user U is in the car 2 or in a predetermined area near the entrance/exit in the hall 100 . The predetermined area is set to the width of the threshold 2b including the position of the user U shown in FIG. 4, for example. When the recognition unit 32 recognizes that the user U is in the car 2 or in the predetermined area, the recognition unit 32 notifies the output control unit 34 of the recognition result. The output control unit 34 controls the output of notification data based on the recognition result.

In this way, when the user U leaves the car 2 or the predetermined area, it is possible to prevent the notification from being given. Therefore, unnecessary notification can be avoided.

Further, the output control unit 34 may output the notification data to the notification unit 4 only when the car 2 has arrived at the destination floor designated by the user U on the operation panel 22 .

Thus, when the car 2 has not arrived at the destination floor of the user U, it is possible not to notify. Therefore, unnecessary notification can be avoided. Note that, for example, it is possible to determine that the user U has operated the control panel 22 from the imaging data of the camera 21, and use the destination floor registered at the time of determination as the destination floor specified by the user U. Further, when a plurality of operating panels including a wheelchair operating panel are provided in the car 2, the destination floor registered on the wheelchair operating panel may be the destination floor designated by the user U.

Alternatively, the output control unit 34 may output notification data to the notification unit 4 when the recognition unit 32 recognizes the user U who is about to get off by image recognition. Further, the output control unit 34 outputs notification data to the notification unit while the user's silhouette (shape) is detected by a sensor (not shown) such as a multi-beam provided near the door 2a of the car 2. 4 may be output. Further, when the control device 3 can accept the reservation of the destination floor of the user U by the terminal device 20, the output control unit 34 outputs the notification data when the car 2 reaches the destination floor reserved by the user U. may be output.

In addition, the output control unit 34 notifies the notification data during the period from when the door 2a of the car 2 starts to open until it finishes closing, or from when the door 2a starts to open until the user U completes boarding or getting off. You may output to the part 4. The output control unit 34 determines whether the door 2a is opened or closed based on detection information from an open/close sensor (not shown) that detects opening and closing of the door 2a.

The output control unit 34 outputs various types of information such as the floor where the car 2 is scheduled to stop, driving information such as the driving direction of the car 2, public announcements, general-purpose information such as news, etc. may be output to the notification unit 4 . Such information is generated by an information generator (not shown) provided in the control device 3, for example. Further, when the recognition unit 32 recognizes that the user U is at the hall 100, the output control unit 34 may output an image of the inside of the car 2 captured by the camera 21 to the display device 42. .

Thereby, it is possible to prevent the notification from being performed at least during periods other than the period when the user U is likely to get on or off the vehicle. Therefore, unnecessary notifications can be reduced.

In addition, the output control unit 34 may output notification data when the user U gets on and off the vehicle facing backwards. Therefore, the recognizing unit 32 recognizes the wheelchair U1 as a user accompanying object, and also recognizes the getting-on and getting-off directions of the user U accompanied by the wheelchair U1.

When the recognition unit 32 recognizes that the user U gets on the wheelchair U1 facing backwards, the output control unit 34 recognizes that the user U gets off the wheelchair U1 facing backwards. In at least one of the cases, the notification data is output to the notification unit 4 .

As a result, the user U, who is difficult to turn around in the car 2, is not informed except at least one of the case of getting on the car facing backwards and the case of getting off facing backwards. This can reduce unnecessary notifications. When the user U gets on the wheelchair U1 facing backward, the user U can be notified of the existence of the object O to be detected behind the user U in the car 2 .

[Example of realization by software]
The function of the control device 3 in the elevator system 1 is a control program for causing a computer to function as the control device 3, and can be realized by a control program for causing a computer to function as each control block of the control device 3.

In this case, the control device 3 comprises a computer having at least one arithmetic processing device (eg processor) and at least one storage device (eg memory) as hardware for executing the control program. Each function described in the above embodiment is realized by executing the above control program using the arithmetic processing device and the storage device.

The control program may be recorded on one or more non-transitory computer-readable recording media. This recording medium may or may not be included in the control device 3 . In the latter case, the control program may be supplied to the control device 3 via any wired or wireless transmission medium.

Also, part or all of the functions of the above control blocks can be realized by logic circuits. For example, integrated circuits in which logic circuits functioning as the control blocks described above are formed are also included in the scope of the present invention. In addition, it is also possible to implement the functions of the control blocks described above by, for example, a quantum computer.

Also, each process described in the above embodiment may be executed by AI. In this case, the AI may operate on the control device 3, or may operate on another device (for example, an edge computer or a cloud server).

[Additional notes]
The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Further, embodiments obtained by appropriately combining technical means disclosed in the embodiments are also included in the technical scope of the present invention.

1 elevator device 2 car 4 notification unit 10, 21 camera 20 terminal device 22 control panel 31 acquisition unit 32 recognition unit 33 generation unit 34 output control unit 41 speaker 42 display device 43 communication unit 100 landing 100a frame U user U1 wheelchair (use accompanying body)
O object to be detected

Claims (14)

an acquisition unit that acquires imaged data from a camera that images at least one of the hall and the inside of the car;
Based on the imaging data acquired by the acquisition unit, a detection target existing in a predetermined area behind a user who gets on board with a predetermined type of user accompanying object in at least one of the hall and the car. a recognition unit that recognizes an object;
a generating unit for generating notification data expressed in a predetermined manner for notifying the user of the presence of the detection target object recognized by the recognition unit;
and an announcing unit that outputs annunciation information based on the annunciation data generated by the generating unit. The recognizing unit recognizes that the object to be detected is approaching the user based on a temporal change in an image captured by the camera of at least one of the hall and the inside of the car,
2. The elevator apparatus according to claim 1, wherein said generating unit generates said notification data for notifying said user of existence of said detection target object approaching said user. The recognizing unit recognizes that the user is approaching a frame of the entrance/exit based on the imaging data in the hall or the car,
2. The elevator apparatus according to claim 1, wherein said generating unit generates said notification data for notifying said user that said user is approaching said frame. Based on the imaging data of at least one of the inside of the hall and the car, the recognition unit moves the detection target to a movement area in which the user may move backward from a current position in the hall by a predetermined distance. recognizing the existence of an object,
2. The elevator apparatus according to claim 1, wherein said generating unit generates said notification data for notifying said user that said object to be detected exists in said movement area. The recognizing unit recognizes that the detection target object exists behind one or more of the users based on the imaging data of the landing and the car,
The generating unit generates first notification data as the notification data for notifying the user that the detection target object exists in the car, and the detection target object exists in the hall. second notification data is generated as the notification data for notifying the user that a 5. Elevator installation according to any one of claims 1 to 4, wherein 6. The apparatus according to any one of claims 1 to 5, further comprising an output control unit that outputs the notification data to the notification unit when the user is in the car or in a predetermined area near the boarding gate of the hall. Elevator installation as described. 7. The elevator apparatus according to any one of claims 1 to 6, further comprising an output control unit that outputs the notification data to the notification unit only when the car reaches the destination floor specified by the user. . An output control unit that outputs the notification data to the notification unit during a period from when the door of the car starts to close until it finishes closing, or from when the door starts to open until the user completes getting in or out of the car. 8. An elevator system as claimed in any one of claims 1 to 7, further comprising: Further comprising an output control unit that controls output of the notification data to the notification unit,
The recognition unit recognizes a wheelchair as the user's accompanying body, and recognizes the direction of getting on and off the vehicle of the user accompanied by the wheelchair,
The output control unit, when the recognizing unit recognizes that the user gets on the wheelchair facing backwards, and when the recognizing unit recognizes that the user gets off the wheelchair with the wheelchair facing backwards. The elevator apparatus according to any one of claims 1 to 8, wherein in at least one of the cases, the notification data is output to the notification unit. The elevator apparatus according to any one of claims 1 to 9, wherein the notification unit is a display device that displays the notification information. 11. The elevator apparatus according to claim 10, wherein said generation unit generates notification data for emphasizing and displaying presence of said detection target object recognized by said recognition unit. The elevator apparatus according to any one of claims 1 to 11, wherein the notification unit includes a speaker that outputs the notification information by sound. 13. The elevator apparatus according to any one of claims 1 to 12, wherein said reporting unit transmits said reporting information to a terminal device carried by said user. an acquisition step of acquiring imaging data from a camera that images at least one of the landing and the inside of the car;
Based on the imaging data acquired in the acquisition step, a detection target existing in a predetermined area behind a user who gets on board with a predetermined type of user accompanying object in at least one of the hall and the car. a recognition step of recognizing an object;
a generation step of generating notification data expressed in a predetermined manner for notifying the user of the presence of the detection target object recognized in the recognition step;
and a notification step of outputting notification information based on the notification data generated in the generating step.

Images