JP6886645B2 - Elevator user support system - Google Patents

Description

The present invention relates to an elevator user support system that supports elevator users.

Conventionally, a security camera system for an elevator has been provided in which a surveillance camera is installed in an elevator car, the situation inside the car is imaged and recorded by the surveillance camera, and the recorded contents can be confirmed after the fact. In such a security camera system, the recorded camera image can be displayed to check the situation inside the car.

However, in the conventional security camera system, since the image captured by the surveillance camera is displayed on the display after the fact, it is not possible to check the current state of the car, and the user in the car has trouble (for example, sudden illness, sudden illness, etc.). Even if you are confused about the operation, you cannot take prompt action against the trouble.

Japanese Unexamined Patent Publication No. 2006-151581

Therefore, the present invention provides an elevator user support system that can support users according to the situation of elevator users.

The elevator user support system of the present invention captures a control microcomputer arranged in the elevator, an image pickup device that images the inside of the elevator car over time, and an image that is connected to the control microcomputer and captured by the image pickup device. Model data to be compared between the processing unit to be processed, the execution unit that executes a predetermined operation according to the situation of the user of the elevator based on the instruction of the processing unit, and the image captured by the imaging device. The model data includes a storage unit for storing, and the model data includes a model pattern of at least one person, and the processing unit captures edges from at least two images out of a plurality of images captured by the image pickup apparatus. The first process of extracting, the second process of applying the model pattern of the person to the edge of the image for the person among the edges extracted from the at least two images, and the second process of applying the model pattern of the person to the edge of the image for the person, and the said for the at least two images in the second process. Based on the fitting of the human model pattern, the third process of grasping the situation of the person and the fourth process of causing the execution unit to execute a predetermined operation according to the situation of the person grasped in the third process. It is characterized by doing.

In the user support system of the elevator, the situation of the person in the car is properly recognized by the image recognition using the model pattern of the person, and based on this recognition, the execution unit performs a predetermined operation (to the user's situation). Support according to the situation). As a result, support is provided according to the situation of the elevator user.

In the elevator user support system, the model data also includes a model pattern of the internal structure of at least one car, and the second process is performed on an edge extracted from one of the at least two images. The first step of applying the model pattern of the internal structure of the car to the edge of the image with respect to the internal structure of the car, and the edges other than the edges that overlap the model pattern of the internal structure of the car among the edges extracted from the one image. In the second step of applying the model pattern of the person, and to the edge other than the edge overlapping the model pattern of the internal structure of the car in the edge extracted from the image other than the one image among the at least two images. It may have a third step of fitting the model pattern of the person who fits in the second step.

According to this configuration, the human model pattern can be applied more appropriately by applying the human model pattern to the edges other than the edges that overlap the model pattern of the internal structure of the car among the edges extracted from the captured image. Therefore, the situation of the person in the car can be recognized more appropriately. As a result, support according to the situation of the elevator user is provided more appropriately.

In the user support system of the elevator, the execution unit has a notification device arranged in the car of the elevator, and the processing unit performs the predetermined operation on the notification device in the fourth process. , The information according to the situation of the grasped person may be notified.

According to such a configuration, since the notification device notifies the information according to the situation of the user in the car, it is possible to provide the information according to the situation of the user (information necessary for the user).

In the user support system of the elevator, the execution unit has a communication unit connected to a public line, and the processing unit has grasped the communication unit as the predetermined operation in the fourth process. Information about a person's situation may be sent.

According to this configuration, in order for the communication unit to transmit information about the status of the user in the car to the outside (public line), for example, a terminal outside the system such as an external center connected to the public line is used. Then, it is possible to make a response according to the situation of the user.

In the elevator user support system, the image includes a landing that can be seen from the entrance and exit of the car, the execution unit is a switchgear that opens and closes the door of the car, and the processing unit is the third processing. Even if a person's getting on and off the car is grasped based on the image including the landing, and in the fourth process, the opening / closing device opens and closes the door according to the grasped person's getting on and off as the predetermined operation. Good.

According to such a configuration, the switchgear controls the opening and closing of the door according to the entry and exit of a person, so that, for example, the door prevents the person from getting in and out of the car while getting in and out of the car. The door can be opened and closed according to the timing of getting in and out of the car.

In the user support system of the elevator, the execution unit has a drive device for raising and lowering the car, and the processing unit causes the car to shake based on an image in the car in the third process. The behavior of the connected person may be grasped, and in the fourth process, the driving device may be made to operate the car according to the grasped behavior of the person as the predetermined operation.

According to such a configuration, when the behavior of a person leading to the shaking of the car is grasped, the car is operated according to this behavior, for example, by suppressing the speed of the car when the car is shaking, the car is operated. Confinement of the user in the car due to the shaking of the car is suppressed, and as a result, the user can be supported more appropriately.

From the above, according to the present invention, it is possible to support the user according to the situation of the user of the elevator.

FIG. 1 is a block diagram of an elevator user support system according to an embodiment of the present invention. FIG. 2 is a diagram showing a model pattern of a person used in the user support system of the elevator according to the embodiment. FIG. 3 is a diagram showing a model pattern of the internal structure of the car used in the user support system of the elevator according to the embodiment. FIG. 4 is a flowchart showing the processing of the elevator user support system according to the embodiment. FIG. 5 is a flowchart showing the processing of the elevator user support system according to the embodiment. FIG. 6 is a block diagram of an elevator user support system according to a modified example of the present invention.

Hereinafter, the elevator user support system according to the present invention (hereinafter, simply referred to as a user support system) will be described. The user support system is a system that grasps the user's situation based on the captured image in the car and supports the user according to this situation.

As shown in FIG. 1, the user support system captures a control microcomputer 20 arranged in the elevator 2, a camera (imaging device) 210 that images the inside of the car 21 of the elevator 2 over time, and an image captured by the camera 210. The processing unit 23 for processing, the storage unit 221 for storing model data to be compared with the captured image, and the execution unit 10 for executing a predetermined operation according to the situation of the user of the elevator 2 are provided.

In the user support system 1 of the present embodiment, the image recognition device 22 is connected to the camera 210. The storage unit 221 is provided in the image recognition device 22. Further, the processing unit 23 includes an image recognition processing unit 220 provided in the image recognition device 22, and a microcomputer processing unit 200 provided in the control microcomputer 20.

For example, the elevator 2 includes a car 21 that goes up and down the hoistway, a control microcomputer 20 that outputs information on the operating status of the elevator 2, and an image recognition device 22 that is connected between the control microcomputer 20 and the camera 210. The control microcomputer 20 has a voice recognition device 24, a voice guidance device 25, a display guidance device 26, and a drive device 27, respectively.

In addition to the camera 210, the car 21 is, for example, a microphone (sound collector) 211, which is arranged in the car 21 and is connected to the voice recognition device 24 and collects the voice in the car 21, and a voice guidance device. A speaker 212 connected to 25 and outputting voice in the car 21, a display (display unit) 213 connected to the display guidance device 26 and displaying character information and the like in the car 21, a door 214 that opens and closes, and the like. It includes an opening / closing device 215 for opening / closing the door 214, a car frame including a ceiling, a wall, and a floor, and an operation panel including a floor button and the like.

The user support system 1 of the present embodiment has a monitoring terminal 3 connected to the control microcomputer 20, a first server (communication unit) 4 connected to the monitoring terminal 3, and a second server connected to the first server 4. It includes a server 5. Further, the user support system 1 of the present embodiment includes an administrator terminal 6 and a technician terminal 7 that can be connected to the first server 4, respectively.

For example, the execution unit 10 drives the speaker (notification device) 212, the display (notification device) 213, the first server (communication unit) 4 connected to the control microcomputer 20, the opening / closing device 215, and the car 21 up and down. The drive device 27 and the like.

Although one elevator 2 is shown in FIG. 1, the user support system 1 of the present embodiment includes a plurality of elevators. Further, although one administrator terminal 6 and a technician terminal 7 are shown in FIG. 1, the user support system 1 of the present embodiment includes a plurality of administrator terminals 6 and a plurality of technician terminals 7.

The camera 210 is arranged on the ceiling in the car 21, for example, and images the inside of the car 21 over time. Further, the camera 210 can output the captured images (a plurality of captured images) in the car 21 to the image recognition device 22. For example, one surveillance camera is provided in the car 21 to monitor the inside of the car 21, and in the user support system 1 of the present embodiment, this surveillance camera is used as the camera 210.

Specifically, the camera 210 intermittently (for example, every second) repeatedly takes pictures in the car 21. The camera 210 may continuously take pictures in the car 21. Further, in the user support system 1 of the present embodiment, the camera 210 is installed at a position where the landing seen from the car entrance / exit can be photographed. Therefore, the captured image taken by the camera 210 may include this platform (when the door is opened, etc.).

The image recognition device 22, the voice recognition device 24, the voice guidance device 25, and the display guidance device 26 are, for example, microcomputers provided outside the car 21. Specifically, the voice recognition device 24 can analyze the voice collected by the microphone 211 and output it to the monitoring terminal 3 via the control microcomputer 20. The voice guidance device 25 can output voice from the speaker 212 based on the information input from the monitoring terminal 3 via the control microcomputer 20. The display guidance device 26 can output, for example, character information from the display 213 based on the information input from the monitoring terminal 3 via the control microcomputer 20.

The control microcomputer 20 is connected to the monitoring terminal 3 via the communication system R1. For example, the communication system R1 can communicate from the control microcomputer 20 to the monitoring terminal 3 via the public line (telephone line), and can communicate from the monitoring terminal 3 to the control microcomputer 20 via the public line (telephone line). Communication system.

In the user support system 1 of the present embodiment, the image recognition device 22 performs a process of detecting a person from the captured image, grasps the situation of the person, and causes the execution unit 10 to execute a predetermined operation according to the situation. The image recognition processing unit 220 and a storage unit 221 that stores a model pattern of at least one person as model data to be compared with the captured image are included.

In the user support system 1 of the present embodiment, the storage unit 221 stores a model pattern of the internal structure of the car 21 and a model pattern of a plurality of people. Further, the storage unit 221 stores the outline (edge) of the car 21 and the person as the internal structure of the car 21 and the model pattern of the person, respectively. The human model pattern is set as, for example, a model pattern common to each elevator. The model pattern of the internal structure of the car is set individually for each elevator, for example.

For example, the storage unit 221 stores a model pattern of a person having a different silhouette as a model pattern of the person. Specifically, the storage unit 221 stores a model pattern of a person wearing a general silhouette (general clothes), a model pattern of a person wearing a hat, a model pattern of a person wearing a kimono, and the like. More specifically, the general human model pattern stored in the storage unit 221 is a simplified version of the human head, ears, torso, arms, and legs, as shown in FIG. It consists of lines (wireframes) connecting the contours.

In the user support system 1 of the present embodiment, the storage unit 221 stores the model pattern of the internal structure of the car 21 output from the first server 4. More specifically, as shown in FIG. 3, the model pattern of the internal structure of the car 21 stored in the storage unit 221 is a car frame including a line connecting the contours of the door 214 that opens and closes, and a ceiling, a wall, and a floor. It is composed of a line connecting the contours of 216 and a line connecting the contours of the operation panel 217 including the floor button and the like.

Further, in the user support system 1 of the present embodiment, the storage unit 221 stores a predetermined operation according to the situation in association with the situation of the person in the car 21 (human trouble in the car 21). ing. Artificial troubles include human behavior (jumping, bending and stretching, stepping, fighting, and rampage, etc.) that leads to the shaking of the car 21, people falling down, situations where there is no lift button operation, and people slowly moving the car 21. The situation of getting on and off the door, and the holding of the door 214 by a person.

More specifically, the storage unit 221 stores the situation in which the car 21 is swaying due to a person jumping or the like in association with an announcement by the speaker 212, information display by the display 213, and an operation such as limiting the running speed of the car. At the same time, the situation where a person is lying down in the car 21 is stored in association with the announcement by the speaker 212 and the report by the first server 4. Further, the storage unit 221 stores the situation in which the car 21 is manned and the elevating button is not operated for a certain period of time in association with the announcement by the speaker 212 and the display of information by the display 213. Further, the storage unit 221 stores the situation in which the person is slowly getting in and out of the car 21 and the maintenance of the door 214 in the open state, and the person is holding the door of the car 21. The situation is associated with the announcement by the speaker 212 and the maintenance of the door 214 in the open state. The storage unit 221 also stores conditions for determining the situation of a person in the car 21. This specific condition will be described later together with the processing by the processing unit 23.

Further, in the user support system 1 of the present embodiment, the storage unit 221 also stores human troubles in the car in which the car is subject to operation suspension. Car suspension means that for elevators with multiple cars, the car that is subject to suspension is excluded from the target car (the target car that goes to the calling floor when the call button at the elevator platform is pressed). It is to be. An artificial trouble in a car that is subject to suspension of operation is, for example, a rampage of a person in the car.

When the processing unit 23 detects a person in the car 21, it determines whether or not there is an artificial trouble in the car 21, and causes the execution unit 10 to execute a predetermined operation according to the content of the trouble. repeat. For example, the processing unit 23 acquires captured images (a plurality of captured images) in the car 21 captured by the camera 210 over time for a certain period of time, and when a person is detected from the captured images, the person in the car 21 (The presence or absence of an artificial trouble in the car 21 is determined), and a series of processes of causing the execution unit 10 to execute a predetermined operation according to this situation (trouble) are repeated. This process (first, second, third process) will be described in detail below.

First, the image recognition processing unit 220 performs a first process of extracting edges from at least two of the acquired plurality of captured images. Specifically, the image recognition processing unit 220 performs preprocessing such as density correction, distortion correction, and noise removal for each of the acquired plurality of images, and then the brightness of each image suddenly increases. The boundary that changes to is extracted as an edge.

The image recognition processing unit 220 sets a model pattern of a person on the edge of the image for a person among the edges extracted from at least two images (a plurality of images acquired in the user support system 1 of the present embodiment). Perform the second process to apply. The image recognition processing unit 220 matches the size of each model pattern (model pattern of the internal structure of the car and the model pattern of a person) with the field of view of the camera 210 (coordinates of the camera 210) on the extracted edges. By letting and fitting, each model pattern is fitted to the edge extracted from the captured image.

Specifically, the image recognition processing unit 220 is an image of the internal structure of the car 21 at the edge extracted from one image (hereinafter referred to as the first image) of the plurality of acquired images in the second process. The first step of applying the model pattern of the internal structure of the car 21 to the edge of the car 21 is performed. Next, in the second process, the image recognition processing unit 220 sets the edge of the image extracted from this one image as the edge of the image for a person among the edges other than the edge overlapping the model pattern of the internal structure of the car 21. Perform the second step of applying a human model pattern.

After that, in the second process, the image recognition processing unit 220 performs a human model pattern in the second step of at least two images (a plurality of acquired images in the user support system 1 of the present embodiment). The basket 21 at the edge extracted from an image other than the fitted image (an image other than the first image among at least two images (a plurality of images acquired in the user support system 1 of the present embodiment)). The third step of applying the model pattern of the person who applied in the second step to the edges other than the edges overlapping the model pattern of the internal structure of is performed.

Hereinafter, the first to third steps in the second process described above will be described in more detail. In the first step, the image recognition processing unit 220 superimposes a model pattern of the internal structure of the car on the edge extracted from the first image, and this overlapped portion (edge overlapping the model pattern of the internal structure of the car). Whether or not there is a human body characteristic (for example, whether or not there is a circular edge that overlaps the human head, whether or not there is a tubular edge that overlaps the torso, and whether or not there is an edge that overlaps the limbs. Whether or not there is) is determined.
When the image recognition processing unit 220 determines that there is a circular edge or the like, the image recognition processing unit 220 determines that the inside of the car 21 is manned (a person is detected in the car 21), and in the second step, the circular edge and the like. The size of the human model pattern and the field of view of the camera 210 are matched so that the parts corresponding to the heads of the human model pattern overlap, and the human model pattern is applied to the edges extracted from the first image. Further, in the second step, the image recognition processing unit 220 sets the ground contact position of the fitted person's model pattern in the first image (specifically, the ground contact position between the person's model pattern and the floor surface of the car 21). Based on this, the position of the person in the space and the space occupied by the person are recognized. When the ground contact position of the model pattern of the applied person in the first image cannot be confirmed, the image recognition processing unit 220 determines the existence position of the person and the space occupied by the person based on the estimated ground contact position. recognize. Next, the image recognition processing unit 220 calculates the coordinates of each point from the model pattern of the person applied to the edge extracted from the first image. The coordinates of the human model pattern are, for example, as shown in P1 of FIG. 2, such as the apex of the head, both ears, both shoulders, both elbows, the tips of both hands, both hips, both knees, both heels, and the toes of both legs. The coordinates.

In the third step, the image recognition processing unit 220 applies the model pattern of the person applied in the second step to the images other than the first image among at least the two images mentioned above. More specifically, in the third step, the image recognition processing unit 220 describes the internal structure of the basket 21 of the first image from the edges extracted from the images other than the first image among the plurality of acquired images. Except for the edge that overlaps the model pattern, the model pattern of the person who applied in the second step is applied to this edge. After that, the image recognition processing unit 220 calculates the coordinates of each point from the model pattern of the person applied to the image other than the first image.

When the image recognition processing unit 220 determines that the edges extracted from each image do not have circular edges or the like, the image recognition processing unit 220 assumes that the inside of the car 21 is unmanned and applies a human model pattern to the edges extracted from each image. Ends the processing of.

Hereinafter, the third process and the fourth process performed after the first process and the second process will be described.

The image recognition processing unit 220 is in the car 21 based on the model pattern of the person applied in the second processing to at least two images (a plurality of images acquired in the user support system 1 of the present embodiment). Perform the third process to grasp the situation of the person. Specifically, the image recognition processing unit 220 determines whether or not the coordinates of the human model pattern in the captured images before and after the captured image to which the human model pattern is applied in the second process are at a specific position in a certain period of time. And, depending on whether or not the change in the coordinates of the human model pattern in the captured images before and after the captured image to which the human model pattern is applied in the second process shows a specific behavior, the situation of the person in the car 21 To grasp.

The captured images before and after the captured image to which the human model pattern is applied in the second process are the captured images to which the imaging time is before and after the captured images to which the human model pattern is applied in the second process. In addition, when there are three or more captured images before and after the captured image to which the human model pattern is applied in the second process, "when the coordinates of the model pattern of the person applied in the second process are at specific coordinates", In addition to the case where the coordinates of the human model pattern overlap with the specific coordinates, the case where the coordinates predicted to be reached by the movement (coordinates by the movement line prediction) overlap with the specific coordinates is also included. In the second process, when there are three or more captured images before and after the captured image to which the human model pattern is applied, "when the change in the coordinates of the human model pattern shows a specific behavior", the same applies to the person. In addition to when the change in the coordinates of the model pattern of the model shows a specific behavior, the change in the coordinates predicted to reach by the movement of the human model pattern (coordinates by motion line prediction) shows the specific behavior. Including when.

More specifically, the image recognition processing unit 220 causes the coordinates of the human model pattern in the captured images before and after the captured image to which the human model pattern is applied in the second process to reciprocate in the vertical direction or the horizontal direction. If it changes to, it is determined that the car 21 is shaking due to a person's jumping, etc., and the coordinates of both shoulders, elbows, etc. of this person's model pattern are on the floor of the car 21 for a certain period of time. If it is in contact with, it is determined that a person is lying down in the car 21. Further, when the image recognition processing unit 220 detects a person in the car 21 and the operation of the elevating button is not input to the control microcomputer 20 for a certain period of time, the inside of the car 21 is manned and there is no operation of the elevating button. Judge as a situation.

The image recognition processing unit 220 has the car entrance / exit with the coordinates of the human model pattern in the front and rear captured images (image including the landing) in the captured image to which the human model pattern is applied in the second processing with the door 214 open. When it changes slowly so as to pass through, it is determined that the person is slowly getting on and off the car 21. Further, the image recognition processing unit 220 uses the door 214 for a certain period of time at least one of the coordinates of the tips of both hands of the human model pattern in the images captured before and after the image captured by applying the human model pattern in the second process. When the door 214 is maintained in the open state for a certain period of time, it is determined that a person is holding the door 214 of the car 21. These determination conditions are stored in the storage unit 221 as described above.

In this way, immediately after the detection of a person in the car 21, the situation of the person in the car 21 can be determined by applying the model pattern of the person to the edge extracted from the image captured by the camera 210. Therefore, in the user support system 1 of the present embodiment, the situation of a person can be grasped in real time.

The image recognition processing unit 220 outputs the determination result (human trouble) by the third processing to the microcomputer processing unit 200. In the user support system 1 of the present embodiment, the image recognition processing unit 220 also outputs this determination result (human trouble) to the first server 4. As a result, the control microcomputer 20 can cause the execution unit 10 to execute a predetermined operation corresponding to the content of the human trouble, as will be described later.

When the image recognition processing unit 220 inputs that there is an artificial trouble, the microcomputer processing unit 200 stores the input according to the situation of the person in the car 21 (human trouble in the car 21). The fourth process of causing the execution unit 10 to execute at least one of the predetermined operations stored in the unit 221 is performed. Specifically, the microcomputer processing unit 200 can make the speaker 212 and the display 213 notify the information according to the situation of the person grasped as a predetermined operation. The microcomputer processing unit 200 can cause the first server 4 to transmit information about the situation of a person grasped as a predetermined operation. In addition, the microcomputer processing unit 200 can open and close the door 214 according to the grasped person getting on and off as a predetermined operation of the opening / closing device 215. Further, the microcomputer processing unit 200 can cause the drive device 27 to operate the car 21 according to the grasped behavior of the person as a predetermined operation.

More specifically, when the car 21 is swaying due to a person jumping or the like, the microcomputer processing unit 200 makes a sound to the speaker 212 to give an announcement saying "The car is swaying and dangerous, so please stop the jumping". An instruction signal is output to the guidance device 25, and an instruction signal is output to the display guidance device 26 so that the display 213 displays "The car is swaying and dangerous, so please stop jumping." An instruction signal is output to the drive device 27 so as to limit the speed of the car 21.

In addition, when a person is lying down in the car 21, the microcomputer processing unit 200 tells the speaker 212, "I have detected that a person is falling down in the car. Is it okay? If it is okay, please reply. An instruction signal is output to the voice guidance device 25 so as to send an announcement saying ".", And if no voice information is input via the microphone 211 and the voice recognition device 24 even after a certain period of time has passed from this announcement, The first server 4 outputs an instruction signal to the first server 4 so as to notify the administrator terminal 6 and the engineer terminal 7.

Further, the microcomputer processing unit 200 sends a voice guidance device 25 to the speaker 212 to announce "Please press the floor button" when the inside of the car 21 is manned and the elevating button is not operated for a certain period of time. The instruction signal is output to the display guide device 26 so that the display 213 displays "Please press the floor button". When a person is holding the door of the car 21, the microcomputer processing unit 200 outputs an instruction signal to the voice guidance device 25 so as to send an announcement "Please move away from the door" to the speaker 212, and also outputs the instruction signal to the door 214. An instruction signal is output to the opening / closing device 215 so as to keep the door open.

In the user support system 1 of the present embodiment, the microcomputer processing unit 200 has the situation of a person in the car 21 (in the car 21) input from the image recognition processing unit 220 based on the information stored in the storage unit 221. It is determined whether or not (artificial trouble) is subject to suspension, and if this trouble is subject to suspension, the car 21 is suspended, and if this trouble is not subject to suspension, the car 21 is left in normal operation. To do.

For example, the microcomputer processing unit 200 instructs the opening / closing device 215 to stop the car 21 on the nearest floor and keep the door 214 in the open state when the operation is suspended due to human trouble in the car 21. Output a signal.

The monitoring terminal 3 monitors, for example, a large number of elevators installed in a plurality of areas. Further, the monitoring terminal 3 is installed in a monitoring center or the like, which is a building away from the target elevator. An observer (operator) is stationed at the monitoring center of the present embodiment.

The second server 5 is connected to the first server 4 by, for example, a wired line, and is connected by, for example, P2P (Peer to Peer). Further, the second server 5 has a database 50. The database 50 stores information such as car design values in each elevator. Specifically, the database 50 sets the size of the car frame in the car (dimensions inside the car), the position of the door in the car, the position of the control panel in the car, and the like as the design values of the car as the elevator identification number (for example,). It is stored in association with the elevator model number). The database 50 is rewritable. For example, when a new elevator is installed, information such as a car design value in the elevator can be added to the database 50.

In the user support system 1 of the present embodiment, the database 50 stores information (administrator's contact information and technician's contact information) regarding the administrator terminal 6 and the technician terminal 7 corresponding to each elevator. For example, since the database 50 outputs from the first server 4 to the administrator terminal 6 and the engineer terminal 7 via the Internet, the IP address of the administrator terminal 6 and the engineer terminal are used as information about the administrator terminal 6 and the engineer terminal 7. It stores the IP address of 7. The database 50 may store such information in association with the behavior of a person or an object.

The first server 4 is connected to the monitoring terminal 3 via the Internet, for example. Further, the first server 4 is connected to the control microcomputer 20 via the Internet, the monitoring terminal 3, and the communication system R1.

The first server 4 can be connected to the administrator terminal 6 via the communication system R2. The communication system R2 is, for example, a communication system capable of communicating from the first server 4 to the administrator terminal 6 via the Internet and communicating from the administrator terminal 6 to the first server 4 via the Internet. Further, the first server 4 can be connected to the technician terminal 7 via the communication system R3. The communication system R3 is, for example, a communication system capable of communicating from the first server 4 to the technician terminal 7 via the Internet and communicating from the technician terminal 7 to the first server 4 via the Internet. The communication systems R2 and R3 are common to some (Internet).

The first server 4 includes a server processing unit 40 that creates a model pattern of the internal structure of the car. For example, the server processing unit 40 stores in the database 50 before the first processing by the processing unit 23 (before the first series of processing from the first processing to the fourth processing described above) or when the specifications of the car are changed. A model pattern of the internal structure of the car is created based on the information such as the design value of the car, and the created model pattern is output to the image recognition device 22.

Specifically, the server processing unit 40 acquires information such as design values of the car 21 from the database 50, and also enters the car 21 in an unmanned state (empty car state) from the camera 210 via the image recognition device 22 or the like. Acquire the captured image. The server processing unit 40 acquires, for example, one captured image in the unmanned car 21.

The server processing unit 40 performs preprocessing such as noise removal on the acquired image captured in the unmanned car 21, and extracts edges from the captured image after the preprocessing. The server processing unit 40 uses the edges extracted from the captured image based on the shape characteristics of the walls, doors, floors, and ceilings of the car 21 obtained from the design values of the car 21, and the walls, doors, floors of the car 21. And recognize the positional relationship of the ceiling. Further, the server processing unit 40 specifies the position of the camera in the car 21 based on the positional relationship of the walls and the like of the car 21 recognized from the captured image. Further, the server processing unit 40 re-recognizes the positional relationship of the car wall and the like based on the specified camera position, determines the portion overlapping the outline of the car frame and the outline of the door, and coordinates the camera viewpoint (FIG. It calculates the P _C) at 3, to create a model pattern of the internal structure of the car (for example, the floor of the four corners, ceiling corners, door and control panel respective coordinates (P2 in FIG. 3) to calculate these Create a model pattern consisting of lines connecting the coordinates of).

The server processing unit 40 transmits the coordinates of the camera viewpoint to the image recognition device 22 as the field of view of the camera in the car, and as a model pattern of the internal structure of the car, for example, the four corners of the floor and the ceiling in the car. The coordinates of each of the four corners, the door, and the operation panel are output to the image recognition device 22.

The server processing unit 40 determines the result of the determination by the image recognition processing unit 220 in the third processing (whether or not a person is in contact with the door of the car 21 or whether or not the person is performing an operation that shakes the car 21. When the determination result) is input from the microcomputer processing unit 200 via the communication system R1, the monitoring terminal 3, and the Internet, the administrator terminal 6 and the technician terminal 7 according to the notification source (elevator 2) are input from the database 50. Information (contact information of the administrator and contact information of the technician) is acquired, and for example, the determination results are output as character information to the administrator terminal 6 and output to the technician terminal 7. The output judgment result is, for example, a message such as "A person is jumping in the car. There is no problem with the elevator 2 itself."

The administrator terminal 6 and the engineer terminal 7 are, for example, a portable terminal such as a PDA (Personal Digital Assistant) and a laptop computer, and a terminal such as a stationary personal computer, respectively. Each of the administrator terminal 6 and the technician terminal 7 has, for example, an output unit that outputs input information. The output unit is a display when the information to be output is image information or character information, and is a speaker when the information to be output is audio information. In the user support system 1 of the present embodiment, the output unit of the administrator terminal 6 and the technician terminal 7 is a display, and this display outputs the notification content input from the server processing unit 40.

Since the administrator terminal 6 and the technician terminal 7 are each connected to the communication system R1 via the first server 4 as described above, they are connected to the public line (telephone line) via the first server 4. It will be.

The administrator terminal 6 is possessed by, for example, an administrator who manages the elevator 2. The technician terminal 7 is possessed by a technician who is seconded to the elevator 2 in order to deal with a trouble in the elevator 2, for example, when a request for secondment is received.

Hereinafter, the flow of processing related to the creation of the model pattern of the internal structure of the car by the server processing unit 40 will be described with reference to the flowchart of FIG.

The server processing unit 40 transfers the car from the database 50 before the first processing by the processing unit 23 (before the first series of processing from the first processing to the fourth processing described above) or when the specifications of the car 21 are changed. Acquire the design value (S01). Further, the server processing unit 40 acquires an image captured in the car 21 (an image captured in the car in an unmanned state (empty car state)) from the camera 210 via the image recognition device 22 or the like (S02). The server processing unit 40 extracts the edge of the internal structure of the car from the acquired captured image (S03).

The server processing unit 40 identifies the position of the camera 210 in the car based on the edge extracted from the captured image and the design value of the car acquired from the database 50, and creates a model pattern of the internal structure of the car ( S04).

After that, the server processing unit 40 outputs the information regarding the position of the camera 210 in the car 21 and the information regarding the model pattern of the internal structure of the car to the image recognition device 22 (image recognition processing unit 220) (S05). Specifically, the server processing unit 40 transmits the coordinates of the camera viewpoint to the image recognition device 22, and as a model pattern of the internal structure of the car, for example, the four corners of the floor, the four corners of the ceiling, the door, and the inside of the car. A model pattern composed of lines (wire frames) connecting the contours of the operation panels is output to the image recognition device 22. The storage unit 221 stores the output information regarding the position of the camera 210 and the information regarding the model pattern of the internal structure of the car.

Next, a series of processes by the processing unit 23 will be described with reference to the flowchart of FIG. The processing unit 23 constantly repeats a series of processes shown in the flowchart.

When the image recognition processing unit 220 detects a person in the car 21 (Yes in S10), the image recognition processing unit 220 determines whether or not there is a human trouble in the car 21 (S11).

For example, the image recognition processing unit 220 acquires captured images (plurality of captured images) in the car 21 captured over time by the camera 210, and at least two of the acquired plurality of captured images (the present embodiment). In the user support system 1 of the above, the first process of extracting an edge from each of a plurality of acquired images) is performed. Further, the image recognition processing unit 220 applies a human model pattern to the edges extracted from the plurality of images whose edges have been extracted in the first process.

Specifically, the image recognition processing unit 220 applies a model pattern of the internal structure of the car 21 to the edge of the image with respect to the internal structure of the car 21 at the edge extracted from the first image of the acquired plurality of images. (First step), the human model pattern was applied to the edges other than the edges that overlap the model pattern of the internal structure of the car 21 among the edges extracted from this one image (second step), and then acquired. The model pattern of the person applied in the second step is applied to the edges other than the edges that overlap the model pattern of the internal structure of the car 21 in the edges extracted from the images other than the first image among the plurality of images (third). Step).

In this way, it is assumed that the image recognition processing unit 220 detects a person in the car 21 when the model pattern of the person can be applied to the plurality of acquired images. Specifically, the processing unit 23 detects a person in the car 21 when there is a human body feature in an edge other than the edge that overlaps the model pattern of the internal structure of the car among the edges extracted from the acquired plurality of images. It shall be.

Further, the image recognition processing unit 220 calculates the coordinates of each point in the human model pattern from the human model patterns applied to the edges extracted from the acquired plurality of images, and based on these coordinates, in the car 21. Judge the presence or absence of human trouble. For example, the image recognition processing unit 220 determines whether or not the coordinates of the human model pattern in the captured images before and after the captured image to which the human model pattern is applied in the second process are at a specific position in a certain period of time. , Whether or not there is an artificial trouble in the car 21 depending on whether or not the change in the coordinates of the human model pattern in the captured images before and after the captured image to which the human model pattern is applied in the second process shows a specific behavior. (Understand the situation of the person in the car 21).

When the image recognition processing unit 220 determines that there is an artificial trouble in the car 21 (Yes in S12), the image recognition processing unit 220 outputs information about the trouble (determination result in S11) to the first server 4 and the control microcomputer 20 (S13). ..

When the information about the trouble is input, the microcomputer processing unit 200 extracts a predetermined operation corresponding to the trouble from the storage unit 221 (S14), and controls the execution unit 10 (in the user support system 1 of the present embodiment). An instruction signal for executing a predetermined operation is output to at least one of the microcomputer 20, the drive device 27, the speaker 212, the display 213, the switchgear 215, and the server processing unit 40). As a result, the execution unit 10 executes a predetermined operation based on the instruction signal (S15).

Further, in the user support system 1 of the present embodiment, the microcomputer processing unit 200 determines whether or not the trouble is an operation suspension target based on the information stored in the storage unit 221 (S16). When the microcomputer processing unit 200 determines that the trouble is the operation suspension target (Yes in S17), the microcomputer processing unit 200 sets the car 21 as the operation suspension target (S18), and performs detection processing of a person in the car (returns to S10).

When the microcomputer processing unit 200 determines that the trouble is not the operation suspension target (No in S17) and determines that there is no human trouble in the car 21 (No in S12), the microcomputer processing unit 200 sets the operation suspension target. The instruction signal is not output, the car 21 is set to normal operation (S19), and the detection process of a person in the car is performed (returns to S10).

If the image recognition processing unit 220 does not detect a person in the car 21 (No in S10), the image recognition processing unit 220 ends the processing.

In the above user support system 1, the processing unit 23 can appropriately recognize the situation of a person in the car 21 in real time by image recognition using a person's model pattern. The processing unit 23 extracts a predetermined operation from the storage unit 221 based on this recognition (user's situation), and outputs an instruction signal related to the predetermined operation to the execution unit 10. As a result, the execution unit 10 performs a predetermined operation (support according to the user's situation). As a result, the user support system 1 provides support to the user according to the situation.

Further, in the user support system 1, the processing unit 23 applies a human model pattern to an edge other than the edge that overlaps the model pattern of the internal structure of the car 21 among the edges extracted from the captured image. It is possible to apply a person's model pattern more appropriately. As a result, the situation of the user in the car 21 can be recognized more appropriately, so that the support according to the situation of the user of the elevator 2 is provided more appropriately.

Further, in the user support system 1, the notification device (in the user support system 1 of the present embodiment, at least one of the speaker 212 and the display 213) notifies information according to the situation of the user in the car. Information according to the user's situation (information necessary for the user) can be provided.

In the user support system 1, the processing unit 23 sends information about the status of the user in the car 21 to the outside (public line) by the communication unit (in the user support system 1 of the present embodiment, the server processing unit 40). In order to transmit the information, for example, a terminal or the like outside the user support system 1 such as an external center connected to the public line can be used to take measures according to the situation of the user.

Further, in the user support system 1, the opening / closing device 215 opens / closes the door 214 according to the getting on / off of the person. Therefore, for example, the door 214 prevents the person from getting on / off while the person is getting on / off the car 21. The door 214 can be opened and closed according to the timing of getting on and off the car 21.

Further, in the user support system 1, when the behavior of the person leading to the shaking of the car 21 is grasped, the car 21 is operated according to this behavior, for example, when the car 21 is shaking, the driving device By suppressing the speed of the car 21 by 27, the confinement of the user in the car 21 due to the shaking of the car 21 is suppressed, and as a result, the user can be supported more appropriately.

In the user support system 1 of the present embodiment, since the processing unit 23 uses a simplified model pattern as a human model pattern, the data capacity of the model pattern handled by the processing unit 23 uses a detailed model pattern. Smaller than. Therefore, processing can be performed by a microcomputer (control microcomputer 20) whose processing speed is not so high, which is used for controlling the elevator 2, that is, the existing control microcomputer 20 can be used without separately installing a microcomputer having a high processing speed. Can be used for processing.

Further, in the user support system 1 of the present embodiment, the image recognition processing unit 220 determines, for example, whether the coordinates of the model pattern of the person are on the floor or the door 214 of the car 21 for a certain period of time. It is possible to prevent it from being determined that an artificial trouble has occurred in the car 21 when the car temporarily comes into contact with the floor or the door 214. In this way, the processing unit 23 can more appropriately determine the situation of a person.

Further, in the user support system 1 of the present embodiment, the image recognition processing unit 220 uses the image recognition processing unit 220 for three or more images of a person as the images before and after the captured image to which the model pattern of the person is applied in the second processing. Since the coordinates of the model pattern and the changes in these coordinates are determined, it is possible to grasp the situation of a person more accurately.

In the user support system 1 of the present embodiment, the server processing unit 40 outputs the determination result (contents of human trouble in the car 21) by the image recognition processing unit 220 to the administrator terminal 6 or the like as necessary. For example, even when the technician is staying at a place far from the site (elevator 2), the manager can quickly respond to the trouble. Further, in this case, it is possible to prevent further accidents and troubles caused by this trouble from occurring.
Further, in the user support system 1 of the present embodiment, the microcomputer processing unit 200 suspends the operation of the car 21 as necessary to prevent further accidents and troubles caused by this trouble. be able to.

The user support system 1 of the present invention is not limited to the above embodiment, and it goes without saying that various modifications can be made without departing from the gist of the present invention. For example, the configuration of one embodiment can be added to the configuration of another embodiment, and a part of the configuration of one embodiment can be replaced with the configuration of another embodiment. In addition, some of the configurations of certain embodiments can be deleted.

For example, in the second process, the image recognition processing unit 220 applies the model pattern of the internal structure of the car to the edge extracted from at least one of the two images of the captured image, and then applies the model pattern of the person. Fitting (first step and second step), human model pattern without applying the model pattern of the internal structure of the car to the edges extracted from images other than one of at least two images of the captured image (Third step), but after applying the model pattern of the internal structure of the car to the edges extracted from images other than one of at least two of the captured images, the human model You may apply a pattern. That is, every time a person's model pattern is applied to the edges extracted from at least two of the captured images, the person's model pattern may be applied after applying the model pattern of the internal structure of the car.

In the user support system 1 of the above embodiment, in the second processing, the image recognition processing unit 220 other than the edge overlapping the model pattern of the internal structure of the car among the edges extracted from at least two images of the captured image. Although the human model pattern was applied to the edge of the car, the human model pattern may be applied to the edge extracted from at least two images without using the model pattern of the internal structure of the car.

For example, the image recognition processing unit 220 determines that some object is in the car 21 from the difference between at least two images out of the plurality of images acquired from the camera 210 and the captured image in the unmanned car 21 and changes in these images. Detects that an object inside or is expected to get in and out of the car 21, and if this object has human features, there is a person in the car 21 or a person gets in and out of the car 21. You may understand that you are doing it.

In this case, the image recognition processing unit 220 extracts an edge from the captured image in the unmanned car 21 acquired from the camera 210 instead of creating a model pattern of the internal structure of the car, and the storage unit 221 uses the storage unit 221 as model data. In addition, the edges extracted from the captured image in the unmanned car 21 may be stored. In this case, the storage unit 221 does not have to store the model pattern of the internal structure of the car 21.

Further, in this case, if the image recognition processing unit 220 applies the human model pattern to the difference between the edge extracted from the first image and the edge extracted from the captured image in the unmanned car, the human model Since the situation of a person can be properly grasped by the pattern, it is possible to cause the execution unit 10 to execute a predetermined operation according to the situation of the person.

When the processing unit 23 determines that the car 21 is shaking due to a person jumping or the like, the drive device 27 outputs an instruction signal to limit the traveling speed of the car 21, but instead of limiting the traveling speed, the processing unit 23 outputs an instruction signal. For example, different car 21 may be operated (such as stopping the car 21 on the nearest floor).

Although the processing unit 23 uses a model pattern commonly set for each elevator as a human model pattern, a model pattern individually set for each elevator may be used. For example, individual person model patterns may be added according to the silhouette of the user in the building where each elevator is installed.

The human model pattern was a model pattern consisting of lines (wireframes) connecting the contours of simplified human parts (head, torso, etc.), but the human parts were drawn in some detail. It may be a model pattern composed of lines (wireframes) connecting the contours of objects. By using a detailed human model pattern, it is possible to grasp the position and behavior of a person in more detail. For example, when a detailed human model pattern includes lines connecting contours such as the human pupil, nose, and mouth, the human pupil, nose, and the human eye, nose, among the human model patterns, are relative to the edges extracted from the captured image. By applying the parts corresponding to the mouth and the mouth, it is possible to more reliably determine whether or not the inside of the car 21 is manned.

In the user support system 1 of the above embodiment, the storage unit 221 stores the model pattern of the internal structure of the car and the model pattern of the person as model data. You may memorize the model pattern of your belongings, animals, etc.). For example, if the storage unit 221 stores a model pattern of a blade or the like, the processing unit 23 determines that the person staying in the car 21 possesses the blade or the like, and the server processing unit 40 causes the server processing unit 40 to store the model pattern. It is possible to output an instruction signal to the server processing unit 40 so as to notify the administrator terminal 6 to this effect, and to cause the switchgear 215 to perform operations such as keeping the door 214 open. Further, in this case, if an emergency bell is provided as a notification device in the car 21, the server processing unit 40 can execute an operation such as ringing the emergency bell in the car 21.

The model data (model pattern of the internal structure of the car, model pattern of a person, etc.) was installed in a place other than the storage unit 221 of the image recognition device 22, for example, a place different from the elevator 2 (a place away from the elevator 2). It may be stored in a server or the like.

The server processing unit 40 received the instruction signal from the microcomputer processing unit 200 and output the determination result by the image recognition processing unit 220 as character information to the administrator terminal 6 and the engineer terminal 7, but the server processing unit 40 When the determination result is input from the image recognition device 220, the determination result by the image recognition processing unit 220 may be output to the administrator terminal 6 and the engineer terminal 7 as character information.

Further, although the server processing unit 40 has output the determination result by the image recognition processing unit 220 to the administrator terminal 6 and the technician terminal 7 as character information, it may be output as voice information. Further, the server processing unit 40 may output the determination result by the image recognition processing unit 220 to one of the administrator terminal 6 and the technician terminal 7. For example, by transmitting the possibility of mischief such as jumping of a person in the car 21 only to the administrator terminal 6, the administrator is alerted and the work of a technician who supports other elevators is performed. Interruption can be suppressed.

In the microcomputer processing unit 200, when a person is lying down in the car 21, the first server 4 is the administrator terminal in response to the response to the announcement from the speaker 212 (when there is no reply to this announcement). An instruction signal was output to the first server 4 to notify 6 and the engineer terminal 7, but instead, the speaker 212 said, "We have detected that a person has fallen, so we will notify the building manager." An instruction signal may be output to the first server 4 so that the first server 4 makes an announcement and notifies the administrator terminal 6.

Further, when a person is lying down in the car 21, the first server 4 may make a report to the monitoring terminal 3 in addition to the administrator terminal 6 and the technician terminal 7. In this case, the observer staying at the monitoring center can take measures such as calling out to a person who has fallen in the car 21.
Further, the user support system 1 may include a customer terminal connected to the first server 4. The customer terminal is installed in, for example, a hospital or a nursing home for the elderly. In this case, the microcomputer processing unit 200 may output an instruction signal to the first server 4 so that the first server 4 notifies the customer terminal of the determination result. For example, by transmitting information about a person's fall to a customer terminal installed in a hospital, a nursing home for the elderly, or the like, a nurse, a caregiver, or the like can appropriately respond to the person's fall. In order to perform such transmission, the database 50 may store information about the customer terminal corresponding to each elevator in association with the behavior of a person or an object (for example, the nearest hospital of each elevator). You may remember the contact and the information about the fallen person in association with each other).

The processing unit 23 includes an image recognition processing unit 220 provided in the image recognition device 22, and a microcomputer processing unit 200 provided in the control microcomputer 20, but the processing unit 23 is not limited to this, and all of the processing units 23 include. It may be provided in the control microcomputer 20 or in the image recognition device 22. Further, at least a part of the processing unit 23 is included in a configuration other than the elevator 2 (for example, a first server 4 or a server installed in a place different from the elevator 2 (a place away from the elevator 2)). You may.

For example, when the processing unit 23 uses a detailed human model pattern, a higher processing capacity is required as compared with the case where a simplified human model pattern is used. Therefore, the processing unit 23 and the storage unit 221 are combined with the elevator 2 It may be installed in a server installed in a place different from the above (a place away from the elevator 2).

Further, the processing unit 23 may perform an operation other than the above-mentioned predetermined operation according to the situation of the person grasped based on the captured image.

For example, the processing unit 23 is a person from inside the car 21 even though the car 21 is stopped on the floor corresponding to the operation of the floor button and the door 214 is stopped once closed for a predetermined time after opening and closing the door. Is continuously detected, an instruction signal is output to the voice guidance device 25 so that the speaker 212 announces "Please press the door open button and exit the elevator from the open door or press the floor button". At the same time, an instruction signal may be output to the display guide device 26 so that the display 213 displays "Please press the door open button and exit the elevator from the opened door or press the floor button".

Further, when the car 21 is stopped on the floor corresponding to the operation of the floor button and the person is staying near the door 214 with his / her back to the door 214, the processing unit 23 tells the speaker 212 “backward”. An instruction signal may be output to the voice guidance device 25 so as to make an announcement that "the door on the side will open".

Further, the processing unit 23 makes an announcement that "Keep away from the door" when a person is trying to open the door 214, or "Failure to open / close the door" when a person is holding the door 214. An instruction signal is given to the voice guidance device 25 to make an announcement saying "Please be careful about the door" or when a person is hitting the door, make an announcement saying "Please be careful about hitting the door". May be output.

A plurality of cameras 210 may be provided in the car 21. Further, as the camera 210, instead of using the surveillance camera, another camera other than the surveillance camera may be used. As such a camera, for example, a 360 ° camera capable of simultaneously photographing the entire surroundings may be used.

In the user support system 1 of the above embodiment, the speaker 212 and the display 213 are used as the notification device arranged in the car 21 of the elevator 2, but only one of these may be used. Further, the notification device may include an emergency bell or the like arranged at the landing.

Further, in the user support system 1 of the above embodiment, the first server 4 is used as the communication unit connected to the public line, but for example, the monitoring terminal 3 or the like may be used as the communication unit.

The user support system 1 of the above embodiment includes a plurality of elevators, but may include one elevator. Further, although the user support system 1 includes a plurality of administrator terminals 6 and a plurality of technician terminals 7, one administrator terminal 6 and a plurality of technician terminals 7 may be provided. , A plurality of administrator terminals 6 and one technician terminal 7 may be provided.

Although the communication system R1 includes a telephone line, as shown in FIG. 6, the communication system R1 may include the Internet instead of the telephone line. The communication system R1 is, for example, a communication system capable of communicating with the monitoring terminal 3 via the Internet in order from the control microcomputer 20, and capable of communicating with the control microcomputer 20 from the monitoring terminal 3 via the Internet. In this case, the communication systems R1, R2, and R3 are partly common (Internet).

1 ... User support system, 2 ... Elevator, 10 ... Execution unit, 20 ... Control microcomputer, 200 ... Microcomputer processing unit, 21 ... Basket, 210 ... Camera, 211 ... Microphone, 212 ... Speaker, 212 ... Display, 214 ... Door , 215 ... switchgear, 22 ... image recognition device, 220 ... image recognition processing unit, 221 ... storage unit, 22 ... image recognition device, 23 ... processing unit, 24 ... voice recognition device, 25 ... voice guidance device, 26 ... display Guidance device, 27 ... drive device, 3 ... monitoring terminal, 4 ... first server, 40 ... server processing unit, 5 ... second server, 50 ... database, 6 ... administrator terminal, 7 ... engineer terminal (engineer mobile terminal) , R1, R2, R3 ... communication line, P1, P2, P C _... coordinates

Claims (5)

The control microcomputer placed in the elevator and
An image pickup device that images the inside of the elevator car over time,
A processing unit that is connected to the control microcomputer and processes an image captured by the image pickup apparatus.
An execution unit that executes a predetermined operation according to the situation of the user of the elevator based on the instruction of the processing unit, and an execution unit.
A storage unit for storing model data to be compared with an image captured by the image pickup device is provided.
The model data includes a model pattern of a plurality of people.
The processing unit
The first process of extracting edges from at least two images out of a plurality of images captured by the image pickup apparatus, and
A second process of applying the model pattern of any one of the plurality of people to the edge of the image for a person among the edges extracted from at least two images.
The third process of grasping the situation of the person based on the fitting of the model pattern of the person to the at least two images in the second process, and the third process.
The fourth process of causing the execution unit to execute a predetermined operation according to the situation of the person grasped in the third process, and
And
Each of the plurality of model patterns is composed of human edges .
The second treatment is
The extracted edges have a circular edge that overlaps the human head, a tubular edge that overlaps the human torso, and an edge that overlaps the human limbs. A step of determining whether or not the extracted edge has human body characteristics by determining whether or not the extracted edge has a human body feature.
When it is determined that the extracted edge has the human body characteristic, the extracted edge is overlapped with the portion corresponding to the head of the model pattern of any of the persons. Including steps to apply that person's model pattern,
Elevator user support system featuring this. The execution unit has a notification device arranged in the car of the elevator.
The elevator user support system according to claim 1, wherein in the fourth process, the processing unit causes the notification device to notify the information according to the situation of the grasped person as the predetermined operation. The execution unit has a communication unit connected to a public line, and has a communication unit.
The elevator user support system according to claim 1 or 2, wherein in the fourth process, the processing unit causes the communication unit to transmit information about the situation of the grasped person as the predetermined operation. .. The image also includes a platform that can be seen from the doorway of the car.
The execution unit is an opening / closing device that opens / closes the door of the car.
In the third process, the processing unit grasps the getting on and off of the car with respect to the car based on the image including the landing, and in the fourth process, the opening and closing device grasps the getting on and off of the person as the predetermined operation. The elevator user support system according to any one of claims 1 to 3, which opens and closes a door according to the above. The execution unit has a drive device for raising and lowering the car.
In the third process, the processing unit grasps the behavior of a person leading to the shaking of the car based on the image in the car, and in the fourth process, the driving device performs the grasp as the predetermined operation. The elevator user support system according to any one of claims 1 to 4, wherein the car is operated according to the behavior of the person who has made the car.

Images