WO2023281631A1

WO2023281631A1 - Elevator control system and control method

Info

Publication number: WO2023281631A1
Application number: PCT/JP2021/025491
Authority: WO
Inventors: 健太久瀬; 広泰田畠; 太陽文屋; 淳井上
Original assignee: 三菱電機ビルソリューションズ株式会社
Priority date: 2021-07-06
Filing date: 2021-07-06
Publication date: 2023-01-12
Also published as: JP7423862B2; CN117615985A; JPWO2023281631A1

Abstract

A video processing device (6) calculates the congestion information of passengers in a car (1) on the basis of the image captured by a camera (4). When the calculated congestion information is equal to or less than a threshold value, the video processing device (6) sends a command to a control device (2) to set the elevator operation mode to a first operation mode, and when the calculated congestion information exceeds the threshold value, the video processing device (6) sends a command to the control device (2) to set the operation mode to a second operation mode. A display unit (20) displays the congestion information and the operation mode along with the image.

Description

Elevator control system and control method

The present disclosure relates to an elevator control system and control method.

　Conventional elevator control systems include cameras that are installed inside the elevator car and calculate congestion information for passengers in the car based on images captured by the camera. In such a system, the operation of the elevator is optimized by changing the setting of the elevator, such as changing the operation mode of the elevator, based on the calculated congestion information.

For example, Japanese Patent Application Laid-Open No. 2019-85253 (Patent Document 1) describes an elevator control system that calculates the area occupied by passengers in a car based on an image taken by a camera installed in the car. It is In this elevator control system, when the remaining area obtained by subtracting the exclusive area from the floor area of the car is less than a threshold value, the operation of the car is controlled so as not to respond to the call from the hall.

In such a system, when calculating congestion information by analyzing images taken by cameras, there are times when congestion information is not calculated correctly due to erroneous recognition or erroneous judgment depending on the shooting conditions. In addition, users of elevators and building owners have different preferences and requests regarding how to change elevator operation under different congestion conditions.

JP 2019-85253 A

When trying to solve the above problems, it is necessary to change the elevator settings according to the usage status of the elevator at the site and the preferences and requests of the building owner. In addition, if a situation in which erroneous recognition or erroneous determination is likely to occur is assumed in advance, it is necessary to temporarily stop the elevator system, check the situation, and then change the elevator settings.

　When trying to change the elevator settings in these situations, it is necessary to make a comprehensive judgment after confirming the time transition of various information such as the operating status of the elevator, images taken by the camera, and congestion information. For this purpose, it is necessary to search for various data generated at the time when the image was taken, decode them, and compare them. However, such work requires specialized knowledge and takes time and effort even for maintenance personnel with specialized knowledge.

The present disclosure has been made to solve such problems, and an object thereof is to provide an elevator control system capable of easily grasping the congestion situation of passengers in the car necessary for adjusting the setting of the elevator. and to provide a control method.

An elevator control system according to the present disclosure includes a control device, a camera, a video processing device, and a display. A controller controls the elevator. The camera is installed inside the elevator car. A video processor communicates with the controller and the camera. The video processing device calculates congestion information of passengers in the car based on the image captured by the camera. When the calculated congestion information is equal to or less than the threshold, the video processing device transmits a command to set the elevator operation mode to the first operation mode to the control device, and when the calculated congestion information exceeds the threshold, , to the controller to set the operating mode to the second operating mode. The display unit displays the congestion information and the driving mode along with the image.

A control method according to the present disclosure is a method of controlling an elevator control system. The elevator control system includes a control device that controls the elevator, a camera installed in the car of the elevator, a video processing device that communicates with the control device and the camera, and a display that displays. a step of calculating congestion information of passengers in the car based on the image taken by the camera; When the calculated congestion information exceeds the threshold, a step of sending a command to set the operation mode to the second operation mode to the control device, and the congestion information and the operation mode along with the image are displayed on the display unit and displaying.

According to this disclosure, it is possible to easily grasp the passenger congestion situation in the car, which is necessary to adjust the elevator settings.

It is a figure which shows an example of the functional block diagram of an elevator control system. FIG. 10 is a diagram showing a display example of a synthesized image; 4 is a flowchart of main processing executed by the video processing device; FIG. 4 is a diagram for explaining the relationship between cage size and congestion degree; FIG. 4 is a diagram for explaining the relationship between cage size and congestion degree; It is a figure for demonstrating the example which a congestion degree shows an abnormal value. FIG. 4 is a diagram for explaining user authority; 4 is a flowchart of display processing executed by a terminal device; 4 is a flowchart of change processing executed by a terminal device;

Embodiments will be described below with reference to the drawings. In the following description, the same parts are given the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

First, an elevator control system 100 according to this embodiment will be described. FIG. 1 is a diagram showing an example of a functional block diagram of an elevator control system 100. As shown in FIG.

The elevator control system 100 includes a car 1 , a control device 2 , an in-car display section 3 , a camera 4 , a hall display section 5 , a video processing device 6 , a terminal device 8 and a server device 9 . The terminal device 8 has a display section 20 . The in-car display section 3, the hall display section 5, and the display section 20 are, for example, displays.

The control device 2 controls the elevator. The control device 2 is installed, for example, in a machine room of a building. The control device 2 communicates with an in-car display 3 installed in the car 1 , a hall display 5 installed in the hall of the car 1 , and a video processing device 6 . A video processing device 6 communicates with a camera 4 installed in the elevator car 1 . Video processing device 6 is installed, for example, on top of car 1 .

The server device 9 communicates with the video processing device 6 . The terminal device 8 communicates with the server device 9 . The server device 9, the video processing device 6, and the terminal device 8 may communicate using an Internet line, or may communicate using a telephone line. The terminal device 8 may be a personal computer, a smart phone, or a tablet terminal. The server device 9 and the terminal device 8 may be installed in a building in which an elevator is installed, or may be installed in a building outside the building.

The video processing device 6 includes an external communication unit 6a, a storage unit 6b, an operation mode change instruction unit 6c, a video output unit 6d, a memory 6e, an image analysis unit 6f, a synthesis processing unit 6g, and a display control unit. 6h.

The video processing device 6 includes a CPU (Central Processing Unit) that comprehensively controls the video processing device 6 as a whole. The CPU executes a program stored in the storage section 6b and implements the processing performed by the image analysis section 6f, the composition processing section 6g, and the like.

The memory 6e serves as a work area for executing the program, and temporarily stores the program and data for executing the program. The storage unit 6b is a nonvolatile storage device. For example, the storage unit 6b may include a ROM (Read Only Memory) and a HDD (Hard Disk Drive).

The outline of the processing performed by the elevator control system 100 will be described below. Specific processing contents will be described later using the flowchart of FIG. 3 and the like. The external communication unit 6a acquires an image captured by the camera 4. FIG. The image analysis unit 6f analyzes the acquired image and calculates the degree of congestion of passengers in the car 1. FIG. The operation mode change instruction unit 6c instructs the control device 2 to change the operation mode of the elevator based on the calculated degree of congestion. The synthesis processing unit 6g generates a synthesized image by synthesizing the image with various information such as the degree of congestion.

The video output unit 6d outputs the synthesized image to the in-car display unit 3 and the hall display unit 5. The display control unit 6h controls the display of the in-car display unit 3 and the hall display unit 5. FIG. In order to protect privacy, mosaic processing may be applied to a portion where a person is shown, face, or the like when generating a composite image. Details of various information such as the composite image and the degree of congestion will be described later with reference to FIG.

The external communication unit 6a transmits the composite image to the server device 9. The server device 9 stores the received synthesized image. The terminal device 8 can acquire the composite image by making a request to the server device 9 and display the composite image on the display unit 20 . Also, the terminal device 8 can request the server device 9 to change the setting of the elevator. Details of communication between the server device 9 and the terminal device 8 and changes in elevator settings will be described later with reference to FIGS. 7 to 9. FIG.

FIG. 2 is a diagram showing a display example of a synthesized image. As shown in FIG. 2, an image inside the car 1 photographed by the camera 4 is displayed on the screen 10a. The screen 10 a is a screen displayed on the in-car display section 3 , the hall display section 5 , or the display section 20 of the terminal device 8 . Three passengers 61 are on board in the car 1 . Further, the entrance/exit 51 of the car is in a state where the door is closed (closed state).

Various information is displayed on the screen 10a along with the image inside the car 1. On the left side of the screen 10a, the degree of congestion, congestion index, and ventilation state are displayed from the top. Further, on the right side of the screen 10a, the operation mode and analysis sensitivity are displayed from the top. An image obtained by synthesizing the above information with the image in car 1 is called a "composite image".

On the screen 10a, the degree of congestion is "30%", the congestion index is "second stage" in three stages, the ventilation condition is "good", the operation mode is "normal operation", and the analysis Sensitivity is indicated as "high". Each piece of information will be described below.

"Congestion" indicates the degree of congestion of passengers in car 1, and is indicated by a numerical value of 0 to 100%. The degree of congestion in the present embodiment is the ratio of the number of passengers in car 1 to the capacity of car 1 . For example, when car 1 carries 15 passengers (capacity is 15) and the number of passengers is 4, the degree of congestion is 27% (=4/15) (see FIGS. 4 to 6).

For example, the number of passengers is calculated based on the difference between the image inside the car 1 captured by the camera 4 and the reference image (see FIG. 6). The reference image is an image in which no passenger is in the car 1 . If there are passengers in the car 1, it is possible to extract the area where the person is by taking the difference from the reference image. The number of passengers can be calculated based on the area where people are present.

Also, instead of the "congestion level", the "occupied area ratio" (0 to 100%) may be displayed. The occupied area ratio in the present embodiment is the ratio of the area of objects existing in the car 1 to the floor area of the car 1 . Objects present in the car 1 include objects other than passengers (baggage, trolleys, wheelchairs, etc.). The object area may be calculated by taking the difference from the reference image. Such congestion degree or occupied area ratio may be calculated using a known technique.

"Congestion index" is indicated using a scale of 0 to 3. Each stage is indicated by the number of black squares, and two black squares are displayed for the second stage. For example, the 0th stage=0% congestion degree, the 3rd stage=100% congestion degree, and the 1st stage and the 2nd stage may be set and displayed in the intermediate range. In addition, the congestion index may be indicated using an index other than the degree of congestion (such as the occupied floor area ratio).

"Ventilation" indicates the ventilation status in car 1 in 3 stages. For example, the degree of circulation of the air in the car 1 is detected by a sensor, and indicated by "good", "normal", and "bad" in descending order of circulation. From this display, the maintenance personnel or the like can determine whether or not to operate the fan installed in the car 1 to improve the ventilation state.

"Operation mode" indicates the operation mode of the elevator. In the present embodiment, the operation modes are "normal operation (also referred to as "normal operation mode")", "full passage operation (also referred to as "full passage operation mode"), and "each floor forced stop operation ("each floor forced stop operation"). (also referred to as "operating mode").

The control device 2 is capable of receiving hall calls at the respective halls of a plurality of floors where the car 1 can stop, and making the car 1 respond to the hall calls. Normal operation is a mode in which the car 1 can respond to a hall call from any of the plurality of floors. The full-passage operation is a mode in which the car 1 does not respond to a hall call for any of the plurality of floors.

For example, assume that car 1 has registered a car call (destination floor) to the 5th floor in car 1 and is traveling upward (also referred to as "up direction") to the 2nd floor. At this time, it is assumed that an UP direction hall call is registered in the hall on the fourth floor. If the operation mode is normal operation, car 1 can stop at the fourth floor in response to the hall call. On the other hand, if the operation mode is full passage operation, the car 1 recognizes that the inside of the car 1 is full and passes through the fourth floor without responding to the hall call.

In this embodiment, the control device 2 switches the operation mode between normal operation and full passage operation based on the degree of congestion in the car 1 . Specifically, the control device 2 switches the operation mode to full passage operation when the degree of congestion in the car 1>full passage threshold (also referred to simply as “threshold”) (see FIGS. 3 to 5). The switching may be performed when the occupied area ratio exceeds a predetermined threshold, or when the weight detected by the scale installed in the car 1 exceeds a predetermined threshold. .

　Each floor forced stop operation is a mode that stops on all floors regardless of whether or not there is a car call. The car 1 performs a forced stop operation for each floor based on a command from the control device 2 . A maintenance person or the like can command the control device 2 to perform forced stop operation on each floor.

"Analysis sensitivity" indicates the analysis sensitivity regarding the difference between the acquired image and the reference image in the calculation (model for calculation) for calculating the congestion degree and occupied area ratio. The analytical sensitivity indicates that the highest sensitivity is set in the order of "high", "medium", and "low". When the analysis sensitivity is set to high, the image difference is detected with high sensitivity. Details will be described later with reference to FIG. 6, but in this case, for example, there is a possibility that a protective sheet or the like stretched on the wall may be erroneously detected as a passenger. In such a case, maintenance personnel or the like must take measures (setting changes) such as lowering the analysis sensitivity.

Although it is not displayed on the screen, the elevator has a "crowded passage function" as an elevator function. Maintenance personnel or the like can use the terminal device 8 to set the full capacity passage function for the control device 2 . When the full-passage function is set to ON, normal operation is switched to full-passage operation when the degree of congestion exceeds the threshold, as described above. On the other hand, when the packed passage function is set to OFF, normal operation is always performed even when the degree of congestion exceeds the threshold. Therefore, when the above-described erroneous detection occurs, it is possible to take measures to turn off the full-crowded passage function in addition to lowering the analysis sensitivity.

It should be noted that multiple baskets may be installed in the building. In this case, a camera is installed for each car, and it is determined whether or not to change the operation mode for each car. In addition, a composite image corresponding to the car is displayed on the in-car display unit provided for each car. A composite image of all cars can be displayed on the hall display unit 5 and the display unit 20 of the terminal device 8 . When a hall call is made, one of a plurality of cars is assigned, and the assigned car responds to the hall call. A hall call is assigned by selecting one of a plurality of cars in normal operation. No hall call is assigned to a car that is in full transit operation.

FIG. 3 is a flowchart of main processing executed by the video processing device 6. FIG. The main processing is a series of processing executed by the external communication unit 6a, the image analysis unit 6f, the operation mode change instruction unit 6c, and the synthesis processing unit 6g of the video processing device 6 described above.

The main processing executed by the video processing device 6 may be started, for example, when the power of the video processing device 6 is turned on. Hereinafter, "step" is also simply referred to as "S".

As shown in FIG. 4, when the main process starts, the external communication unit 6a acquires the image of the camera 4, and in S1, the image analysis unit 6f determines whether or not the image analysis conditions are satisfied. When the image analysis unit 6f determines that the image analysis condition is satisfied (YES in S1), the process proceeds to S2. On the other hand, if the image analysis unit 6f does not determine that the image analysis condition is satisfied (NO in S1), the process proceeds to S1. That is, after waiting for the establishment of the image analysis condition, the process proceeds to S2.

The image analysis condition is met, for example, at the timing when the door of car 1 changes from the door open state to the door closed state. A signal indicating the open/closed state of the door of the car 1 is received from the control device 2, and whether the car is in the door open state or the door closed state is determined based on the signal.

From S2 onward, the video processing device 6 calculates the degree of congestion of passengers in the car 1 based on the image captured by the camera 4, and switches the operation mode of the elevator based on the calculated degree of congestion. The number of passengers in the car 1 is determined when the door of the car 1 is closed (when the door is closed). For this reason, in the present embodiment, the video processing device 6 calculates the degree of congestion and determines whether to switch the operation mode at the timing. Note that the image analysis condition may be established at the door closing start timing.

In S2, the image analysis unit 6f calculates congestion information of passengers in the car 1 based on the image captured by the camera 4, and advances the process to S3. Here, in this embodiment, the "congestion information" is the above-mentioned "congestion degree". The "congestion information" may be the above-mentioned "occupied area ratio".

In S3, the driving mode change instruction unit 6c determines whether the calculated degree of congestion exceeds a threshold. When the operating mode change instructing unit 6c determines that the calculated degree of congestion exceeds the threshold (YES in S3), the process proceeds to S4. On the other hand, when the operating mode change instructing unit 6c determines that the calculated degree of congestion is equal to or less than the threshold (NO in S3), the process proceeds to S5.

In S4, the operation mode change instructing unit 6c sends a command to set the elevator operation mode to normal operation to the control device 2, and the process proceeds to S6. In S5, the operation mode change instructing unit 6c transmits to the control device 2 a command to set the operation mode of the elevator to full-passage operation, and the process proceeds to S6.

That is, when the calculated congestion information is equal to or less than the threshold, the operation mode change instruction unit 6c of the video processing device 6 transmits a command to set the elevator operation mode to normal operation to the control device 2, and the calculated When the congestion information exceeds the threshold value, a command to set the operation mode to full passage operation is transmitted to the control device 2 . Note that the operation mode change instruction unit 6c may transmit a command to change the operation mode to the control device 2 only when there is a change in the operation mode.

In S7, the synthesis processing unit 6g determines whether or not the collection mode is set. If the synthesis processing unit 6g determines that the mode is the collection mode (YES in S7), the process proceeds to S8. On the other hand, if the synthesis processing unit 6g does not determine that the mode is collection mode (NO in S7), the process returns to S1.

Here, the collection mode is set by a request from the terminal device 8. A maintenance person or a building owner (building manager) operates the terminal device 8 to set the collection mode. By setting the collection mode, it is possible to generate a composite image and transmit it to the server device 9 (S9).

In S8, the synthesis processing unit 6g determines whether there is a change in the operation mode (change from normal operation to full-passage operation or from full-passage operation to normal operation). When the synthesis processing unit 6g determines that there is a change in the operation mode (YES in S8), the process proceeds to S9. On the other hand, if the synthesis processing unit 6g does not determine that there is a change in the operation mode (NO in S8), the process returns to S1.

In the present embodiment, it is possible to generate a synthetic image and transmit it to the server device 9 (S9) when the operation mode is changed. By doing so, it is possible to confirm the synthesized image when the driving mode is changed. Further, when the degree of congestion is equal to or higher than a predetermined value, the composition image may be generated and transmitted to the server device 9 (S9).

In S9, the synthesis processing unit 6g generates synthesized data. Then, the external communication unit 6a transmits the generated synthesized data to the server device 9, and returns the process to S1.

Specifically, the composition processing unit 6g generates a composite image (see FIG. 2) by superimposing information including the degree of congestion and driving mode as congestion information on the image of the camera 4. The operating mode is a mode set in S4 and S5. The external communication unit 6 a transmits the generated composite image to the server device 9 . In addition, you may each transmit the information of an image, a congestion degree, and a driving mode, without producing|generating a synthetic image.

In this way, the composition processing unit 6g of the video processing device 6 generates a composite image including congestion information and the driving mode when there is a request from the user and the driving mode is switched. Then, the external communication unit 6a transmits the composite image to the server device 9 as display information including the image, the congestion information, and the driving mode.

In addition to the above, the synthetic image may be generated unconditionally, may be generated only when there is a request from the server device 9 or the terminal device 8, or may be generated only when there is a request from the server device 9 or the terminal device 8. It may be generated when the above is reached. Further, the generated composite image may be transmitted unconditionally, may be transmitted only when there is a request from the server device 9 or the terminal device 8, or may be transmitted when the degree of congestion is equal to or greater than a predetermined value. may be sent if

　Figures 4 and 5 are diagrams for explaining the relationship between the cage size and the degree of congestion. In this embodiment, it is assumed that the car 1 has a capacity of 15 people (capacity is 15 people). FIG. 4 shows the relationship between the number of passengers and the degree of congestion together with an image inside the car 1 .

As shown in Fig. 4, when the number of passengers is 1, the degree of congestion is 7%. In the image inside the car 1, one passenger 62 is on board, and the entrance/exit 52 is in a state where the door is open (door open state). In this embodiment, the degree of congestion is calculated from the number of passengers in the car 1 . Congestion degree=number of passengers/capacity=1/15=7%.

When the number of passengers is 4, the degree of congestion is 27% (=4/15). In the image inside the car 1, four passengers 62 are on board, and the doorway 52 is open. When the number of passengers is seven, the degree of congestion is 47% (=7/15). In the image inside the car 1, seven passengers 62 are on board, and the doorway 52 is open. When the number of passengers is 12, the degree of congestion is 80% (=12/15). In the image inside the car 1, 12 passengers 62 are on board, and the doorway 52 is open.

In the present embodiment, it is assumed that the full capacity threshold is set to 30%. In this example, when the degree of congestion is 7% (the number of passengers is 1) and when the degree of congestion is 27% (the number of passengers is 4), car 1 does not pass full (normal operation is done). On the other hand, when the degree of congestion is 47% (the number of passengers is 7) and when the degree of congestion is 80% (the number of passengers is 12), the car 1 passes at full capacity (full pass operation is performed). ).

The threshold for passing the full house can be arbitrarily changed. For example, in recent years, in order to prevent the spread of coronavirus infection, it is desired to keep a certain distance from each other when boarding an elevator as much as possible so that passengers do not get crowded. As shown in Fig. 4, when 4 people are on board, the number of passengers is not close, but if users or building owners feel that 5 or more people are close, setting the full passenger threshold to 30% is recommended. Appropriate. Alternatively, depending on the purpose of the building or condominium, there are circumstances in which passengers do not want to ride together as much as possible, so the full passenger threshold can be changed while viewing the screen in accordance with the needs of the building owner or the like.

On the other hand, Fig. 5 shows an example in which the car 1 has a capacity of 9 people (capacity is 9 people). FIG. 5 shows the relationship between the number of passengers and the degree of congestion together with an image inside the car 1 . As shown in FIG. 5, when the number of passengers is one, the degree of congestion is 11% (=1/9). In the image inside the car 1, one passenger 62 is on board, and the doorway 52 is open. When the number of passengers is three, the degree of congestion is 33% (=3/9). In the image inside the car 1, three passengers 62 are on board, and the doorway 52 is open.

When the number of passengers is 5, the degree of congestion is 56% (=5/9). In the image inside the car 1, five passengers 62 are on board, and the doorway 52 is open. When the number of passengers is eight, the degree of congestion is 89% (=8/9). In the image inside the car 1, eight passengers 62 are on board, and the doorway 52 is open.

In this example, it is assumed that the full capacity threshold is set to 95%. When the degree of congestion is 11% (the number of passengers is 1), when the degree of congestion is 33% (the number of passengers is 3), when the degree of congestion is 56% (the number of passengers is 5), and In none of the cases where the degree of congestion is 89% (the number of passengers is 8), the train does not pass full. When the number of passengers reaches 9, the degree of congestion becomes 100% (=9/9) and the train passes at full capacity.

　Compared to the example in Fig. 4, the capacity is smaller in the example in Fig. 5. For example, if the full-crowded passage threshold is set low to increase the frequency of full-crowded passage, as in the example of FIG. If the number of cars in the car is small or the waiting time is long because the number of cars is small, transportation efficiency can be improved by setting the full passenger threshold high as in the example of FIG. can. In this way, it is possible to set the full-occupancy threshold according to various needs such as the installation status of elevators, the intention of building owners, and the like. When the composite image is displayed, it is possible to appropriately change the full passenger threshold, which is the set value of the elevator, while comparing the situation in the car 1 with the degree of congestion.

FIG. 6 is a diagram for explaining an example in which the degree of congestion indicates an abnormal value. As shown in FIG. 6, in the reference image, the number of passengers is 0, and the doorway 52 is open. In this case, the degree of congestion is 0%. As described above, the degree of congestion is calculated based on the difference between the image captured by the camera 4 and the reference image.

When a passenger gets on in car 1, the area where the passenger is located is detected as a difference from the reference image. As a result, the degree of congestion increases as described with reference to FIGS. 4 and 5. FIG. Then, when the degree of congestion exceeds the full passage threshold, the car 1 passes full.

On the other hand, in the example of FIG. 6, the car 1 is covered with a protective sheet 71 . For example, it is assumed that a moving company puts a protective sheet 71 on the inside of the car 1 so as not to damage the inside of the car 1 when transporting the cargo to be moved.

In Abnormal Case 1 (floor surface change), the floor surface of car 1 is covered with a protective sheet 71 . In this case, the portion of the curing sheet 71 stretched on the floor surface can be the difference from the reference image. Due to this difference, it may be erroneously detected that a passenger is on board. In this example, an abnormal value of 50% congestion is detected even though there are no passengers.

In abnormal example 2 (floor/floor surface change), the floor and wall surfaces of car 1 are covered with protective sheets 71 . In this case, the portion of the curing sheet 71 stretched on the floor surface and the wall surface can be the difference from the reference image. In this example, an abnormal value of 100% congestion is detected even though there are no passengers.

For example, as in the example of FIG. 4, if the full passage threshold is set to 30%, even if the floor surface of car 1 is covered with the protective sheet 71, the full passage will occur. In this case, even though no one is in the car 1, even if a hall call is issued at the hall, the car 1 will not respond at all.

On the other hand, if the color of the protective sheet 71 is close to the color of the floor or wall of the car, there are cases where the protective sheet 71 is not erroneously detected as a passenger. In addition, erroneous detection may or may not occur due to slight image changes such as natural changes such as external light, pasted posters, or stains on the lens of the camera 4 .

For things that change little by little over time, such as the dirt on the lens of the camera 4 and the wall surface, it is possible to prevent anomaly detection by periodically updating the reference image. However, a sudden change, such as attaching a protective sheet when moving, increases the possibility of erroneous detection. In addition, as a sudden change, a case may be assumed in which an object collides with the camera 4 so that the shooting direction of the camera 4 shifts, and the congestion degree is detected to be abnormal.

As described above, the analysis sensitivity indicates the sensitivity regarding the difference between the acquired image and the reference image in the model for calculating the degree of congestion. For example, when the analysis sensitivity is set to "high", the difference from the reference image may cause hypersensitivity, resulting in erroneous detection.

On the other hand, changing the analysis sensitivity to "medium" or "low" makes it possible to prevent the above false detections. When the synthesized image is displayed, it is possible to appropriately change the analysis sensitivity in accordance with the situation at the site while comparing the actual situation in the car 1 with the degree of congestion.

In addition, in the present embodiment, "analysis sensitivity" is exemplified as a changeable parameter in the model for calculating the degree of congestion. However, the parameters that can be changed in this model are not limited to this, and may be, for example, parameters that can be adjusted to increase the detection sensitivity of people, and may be adjusted to increase the detection sensitivity of objects other than people. possible parameters, and these parameters can be adjusted according to the user's preferences. Also, the system may be configured to learn these parameters according to the actual detection conditions on site.

Next, the user authority set in the server device 9 will be explained. FIG. 7 is a diagram for explaining user authority. In this example, it is assumed that three terminal devices 8 are connected to the server device 9 as shown in FIG. Each terminal device 8 can access the server device 9 .

In this embodiment, in order to access the server device 9, it is necessary for a user with user authority to log in to the server device 9. The server device 9 stores user IDs and passwords. User authority is associated with the user ID. Requests that can be made to the server device 9 differ depending on the user's authority.

The user authority includes user authority A, user authority B, and user authority C. User authority A is authority that an elevator maintenance person may have. User authority B is authority that a building owner (or building manager) can have. User authority C is authority that a general user can have. General users refer to users other than maintenance personnel, building owners, and managers, such as building residents.

A person with user authority A or B can request the server device 9 to change the elevator settings. Specifically, a person who has user authority A or B can request the server device 9 to switch the operation mode. On the other hand, a person with user authority C cannot request the server device 9 to change the elevator settings.

Also, a person with user authority A or B can request the server device 9 to change the analysis sensitivity as elevator settings. A person with user authority A can request a change in analysis sensitivity, but a person with user authority B may not be able to request a change in analysis sensitivity. In this way, requests that can be made to the server device 9 differ according to user authority.

When requesting the server device 9 to change the settings of the elevator, it is possible to notify the control device 2 of the request via the video processing device 6 . For example, when a request is made to change the setting of the full-passage function, the control device 2 changes the setting of the full-passage function based on the request. When a request to change the analysis sensitivity is made, the video processing device 6 changes the setting of the analysis sensitivity based on the request.

The "elevator settings" mentioned above are not limited to settings that directly control the elevator, but also include settings that indirectly control the elevator. For example, "Analysis Sensitivity" is a setting that indirectly controls the elevator, because adjusting this may change the elevator's operation mode from "crowded operation" to "normal operation". I can say

In addition, "elevator settings" include "crowded passage threshold" and "crowded passage function". It also includes the operation setting of the fan installed in the car 1 to change the ventilation condition in the car 1 .

When a person having user authority A to C requests the server device 9 to transmit an image, the server device 9 transmits display information including the image, congestion information, and operation mode to the terminal device 8 .

In the present embodiment, the server device 9 transmits the composite image described above to the terminal device 8 as display information. However, not limited to this, various types of information including images, congestion information, and driving modes may be transmitted to the terminal device 8 . The terminal device 8 may generate a composite image based on various information.

In addition, the terminal device 8 can specify an arbitrary period, timing, and arbitrary conditions, such as requesting a composite image for the most recent predetermined period, or requesting only a composite image when the degree of congestion is equal to or greater than a predetermined value. It is possible to request a composite image.

The terminal device 8 displays a composite image on the display unit 20 as described using FIG. 2 (congestion information, driving mode, etc. are displayed along with the image). At that time, the screen 10b is displayed on the display unit 20 of the terminal device 8 of the maintenance person who has the user authority A. FIG. A message 81 indicating that the operation mode can be changed is displayed on the screen 10b together with the synthesized image.

A message 81 is displayed on the screen, saying, "You can change the elevator settings. Please check the congestion status and degree of congestion in the camera image." The screen 10b is also displayed on the display unit 20 of the terminal device 8 of the owner who has the user authority B. FIG.

On the other hand, the screen 10c is displayed on the display unit 20 of the terminal device 8 of the general user who has the user authority C. Although the synthesized image is displayed on the screen 10c, the message 81 is not displayed.

It should be noted that even general users with user authority C may be able to change the settings of some elevators. In this case, the message 81 is also displayed on the display unit 20 of the terminal device 8 . Also, the terminal device 8 used by a general user having user authority C may be a smart phone. In this case, the synthesized image can be confirmed by the smartphone without looking at the display section 3 inside the car or the display section 5 at the hall.

The following is an explanation based on the flowchart. FIG. 8 is a flowchart of display processing executed by the terminal device 8 . The display process may be started when the terminal device 8 logs into the server device 9, for example.

When the display process starts, the terminal device 8 transmits a request for a composite image (display information) to the server device 9 in S11, and advances the process to S12. The server device 9 transmits the composite image to the terminal device 8 based on the request from the terminal device 8 . In S12, the terminal device 8 acquires the composite image from the server device 9, and advances the process to S13.

In S13, the terminal device 8 determines whether or not it is accessing the server device 9 with authority A or authority B. If the terminal device 8 determines that the server device 9 is being accessed with authority A or authority B (YES in S13), the process proceeds to S14. On the other hand, if the terminal device 8 does not determine that the server device 9 is being accessed with authority A or authority B (NO in S13), the process proceeds to S15.

In S14, the display unit 20 of the terminal device 8 displays a composite image (display information) and a message 81 indicating that the elevator settings can be changed. In S<b>15 , the display unit 20 of the terminal device 8 displays the composite image without displaying the message 81 .

FIG. 9 is a flowchart of change processing executed by the terminal device 8. FIG. For example, the change process may be activated when an input is received from an input device connected to the terminal device 8. FIG.

When the change process starts, in S21, the terminal device 8 determines whether or not the server device 9 is accessed with authority A or authority B. If the terminal device 8 determines that the server device 9 is being accessed with authority A or authority B (YES in S21), the process proceeds to S22. On the other hand, when the terminal device 8 does not determine that the server device 9 is being accessed with the authority A or the authority B (NO in S21), the change processing ends.

At S22, the terminal device 8 determines whether or not there is an analysis sensitivity change request. If the terminal device 8 determines that an analysis sensitivity change request has been made (YES in S22), the process proceeds to S23. On the other hand, if the terminal device 8 does not determine that there is an analysis sensitivity change request (NO in S22), the process proceeds to S24.

A user with authority A or authority B can change the analysis sensitivity (request to change the analysis sensitivity) from the input device connected to the terminal device 8 . For example, when the degree of congestion becomes an abnormal value as shown in FIG. 6, the analysis sensitivity is lowered so that the protective sheet 71 is not determined to be a passenger.

In S23, the terminal device 8 commands the server device 9 to change the set analysis sensitivity. Accordingly, the server device 9 instructs the video processing device 6 to change the analysis sensitivity. The video processing device 6 changes the analysis sensitivity to the instructed one.

In S24, the terminal device 8 determines whether or not there is a request to change the setting of the full capacity function. If the terminal device 8 determines that there is a request to change the setting of the full capacity passage function (YES in S24), the process proceeds to S25. On the other hand, if the terminal device 8 does not determine that there has been a request to change the setting of the full capacity passage function (NO in S24), the change processing ends.

A user with authority A or authority B can set whether to turn on or off the full-crowded passage function (request to change the setting of the full-crowded passage function) from the input device connected to the terminal device 8. For example, when the degree of congestion becomes an abnormal value as shown in FIG. 6, the full-crowded passage function is turned off to prevent the problem of illegally full-crowded passage.

In S25, the terminal device 8 instructs the server device 9 to change the setting of the full-crowded passage function. The server device 9 commands the control device 2 to change the setting of the full-crowded passage function. The control device 2 changes the setting of the full-crowded passage function to the commanded one. That is, the control device 2 sets the full-crowded passage function to ON or OFF based on the user's instruction.

In this way, the video processing device 6 or the control device 2 changes the settings of the elevator based on the request from the terminal device 8. The video processing device 6 or the control device 2 can change elevator settings based on requests from users with authority A and B, but does not change elevator settings based on requests from users with authority C.

As described above, in the present embodiment, the display unit 20 displays, as a composite image, the image captured by the camera 4 as well as the congestion information and the operation mode. It is possible to easily grasp the congestion situation of the passengers in the required car 4 . As a result, a user such as a maintenance worker who operates the terminal device 8 can consider how to change the settings of the elevator while viewing the composite screen.

For example, as described with reference to FIGS. 4 and 5, while viewing the composite screen, the threshold for passing full passengers in the car 1 may be adjusted to a lower level in order to avoid congestion among passengers, or the capacity of the elevator, etc., may be taken into account. It is possible to adjust the full-crowded passage threshold to a high value while maintaining the capacity. Alternatively, as shown in FIG. 6, when a sudden change occurs in the car 1, such as the covering sheet 71 being put on the wall surface during moving, the analysis sensitivity can be lowered while viewing the composite screen. It is possible to take countermeasures such as setting the packed passage function to OFF.

In the past, when considering changing elevator settings, it was necessary to check the image taken by camera 4 alone. Then, it is necessary to acquire various data stored in the control device 2 and the video processing device 6, search for various data generated at the time when the image was taken, decode them, and compare them. Such work requires specialized knowledge, and requires time and labor even for maintenance personnel with specialized knowledge.

On the other hand, by configuring as in this embodiment, it is possible to consider changing the elevator settings while viewing a composite screen in which the necessary information is combined with the image used for analysis. As a result, the possibility of overlooking erroneous detection can be reduced, and the work time can be shortened, so that the user's needs can be immediately met. In this way, it is possible to improve the efficiency of elevator monitoring and improve the quality of service to customers.

In addition, building owners and general users (passengers) who do not have specialized knowledge can check the operating status of the system in real time and set the elevator according to their preferences. In addition, by displaying a composite image on the car display section 3 and the hall display section 5, the passenger can check the operating status of the system without going through the terminal device 8. FIG.

[Main configuration and effect]
Main configurations and effects of the above-described embodiment will be described below.

(1) The elevator control system 100 includes a control device 2, a camera 4, a video processing device 6, and a display section 20. A control device 2 controls the elevator. A camera 4 is installed in the car 1 of the elevator. Video processing device 6 communicates with control device 2 and camera 4 . The video processing device 6 calculates congestion information of passengers in the car 1 based on the image captured by the camera 4 . When the calculated congestion information is equal to or less than the threshold, the video processing device 6 transmits a command to set the elevator operation mode to the first operation mode (normal operation) to the control device 2, and the calculated congestion information is When the threshold value is exceeded, a command to set the operation mode to the second operation mode (crowded passage operation) is transmitted to the control device 2 . The display unit 20 displays the congestion information and the driving mode along with the image. As a result, it is possible to easily grasp the state of congestion of passengers in the car 4, which is necessary for adjusting the setting of the elevator.

(2) The control device 2 is capable of receiving a hall call at each hall of a plurality of floors where the car 1 can stop, and making the car 1 respond to the hall call. A first operation mode (normal operation) is a mode in which the car 1 can respond to a hall call from any of the plurality of floors. The second operation mode (full passage operation) is a mode in which the car 1 does not respond to any hall call of any of the plurality of floors. As a result, it is possible to easily grasp the state of congestion of passengers in the car 4, and to change to the full-passage operation in which the car 1 does not respond to any hall call when it is congested.

(3) The elevator control system 100 further includes a server device 9 and a terminal device 8. The server device 9 communicates with the video processing device 6 . The terminal device 8 communicates with the server device 9 . The terminal device 8 has a display section 20 . The video processing device 6 transmits display information including an image, congestion information, and a driving mode to the server device 9 . The server device 9 transmits the display information to the terminal device 8 based on the request from the terminal device 8 . As a result, the terminal device 8 can easily grasp the state of congestion of passengers in the car 4, which is necessary for adjusting the settings of the elevator.

(4) The video processing device 6 generates a composite image including the congestion information and the driving mode in the image when there is a request from the user and switching of the driving mode occurs. The video processing device 6 transmits the synthesized image to the server device 9 as display information. In this way, since the composite image is generated when necessary, the processing load and storage capacity of the video processing device 6 can be reduced.

(5) Based on the request from the terminal device 8, the control device 2 changes the elevator settings. As a result, it is possible to easily grasp the state of congestion of passengers in the car 4 and adjust the setting of the elevator based on this.

(6) The display unit 20 displays that the elevator settings can be changed along with the display information. Thereby, the setting change of the elevator can be prompted.

(7) The control device 2 can change elevator settings based on a request from a user with first authority, but does not change elevator settings based on a request from a user with second authority. This allows only authorized users to change elevator settings in cases where changing the settings would require specialized knowledge.

(8) The control method is a method of controlling the elevator control system 100 . The elevator control system 100 includes a control device 2 that controls the elevator, a camera 4 installed in the car 1 of the elevator, a video processing device 6 that communicates with the control device 2 and the camera 4, and a display unit 20 that displays The control method includes a step of calculating congestion information of passengers in the car 1 based on the image captured by the camera 4, and when the calculated congestion information is equal to or less than a threshold value, the elevator operation mode is changed to the second A step of transmitting a command to set the first operation mode to the control device 2, and a step of transmitting a command to the control device 2 to set the operation mode to the second operation mode when the calculated congestion information exceeds the threshold. and causing the display unit 20 to display the congestion information and the driving mode together with the image. As a result, it is possible to easily grasp the state of congestion of passengers in the car 4, which is necessary for adjusting the setting of the elevator.

The embodiments disclosed this time should be considered illustrative in all respects and not restrictive. The scope of the present disclosure is indicated by the scope of claims rather than the above description, and is intended to include all changes within the meaning and scope of equivalence to the scope of claims.

1: car, 2: control device, 3: car display unit, 4: camera, 5: platform display unit, 6: video processing device, 6a: external communication unit, 6b: storage unit, 6c: operation mode change instruction unit, 6d: video output unit, 6e: memory, 6f image analysis unit, 6g synthesis processing unit, 6h display control unit, 8 terminal device, 9 server device, 10a to 10c screen, 20 display unit, 51, 52 entrance, 61, 62 passenger, 71 curing sheet, 81 message, 100 Elevator control system.

Claims

a controller for controlling the elevator;
a camera installed in the elevator car;
a video processing device in communication with the controller and the camera;
A display unit for displaying,
The video processing device is
Calculate congestion information of passengers in the car based on the image taken by the camera,
when the calculated congestion information is equal to or less than a threshold, sending a command to set the operating mode of the elevator to a first operating mode to the control device;
When the calculated congestion information exceeds the threshold, sending a command to set the operation mode to the second operation mode to the control device,
The elevator control system, wherein the display unit displays the congestion information and the operation mode together with the image.
The control device is capable of receiving a hall call at each hall of a plurality of floors on which the car can stop, and causing the car to respond to the hall call,
The first operation mode is a mode that enables the car to respond to a hall call from any of the plurality of floors,
2. The elevator control system according to claim 1, wherein said second operation mode is a mode in which said car does not respond to hall calls for any of said plurality of floors.
a server device that communicates with the video processing device;
Further comprising a terminal device that communicates with the server device,
The terminal device has the display unit,
The video processing device transmits display information including the image, the congestion information, and the operation mode to the server device,
3. The elevator control system according to claim 1, wherein said server device transmits said display information to said terminal device based on a request from said terminal device.
The video processing device is
When there is a request from the user and the switching of the driving mode occurs, generating a composite image including the congestion information and the driving mode in the image,
4. The elevator control system according to claim 3, wherein said synthesized image is transmitted to said server device as said display information.
The elevator control system according to claim 4, wherein the control device changes the settings of the elevator based on a request from the terminal device.
6. The elevator control system according to claim 5, wherein the display unit displays that the setting of the elevator can be changed together with the display information.
6. The control device is capable of changing settings of the elevator based on a request from a user with first authority, but does not change settings of the elevator based on a request from a user with second authority. Or the elevator control system according to claim 6.
A control method for controlling an elevator control system, comprising:
The elevator control system includes:
a controller for controlling the elevator;
a camera installed in the elevator car;
a video processing device in communication with the controller and the camera;
A display unit for displaying,
The control method is
calculating congestion information of passengers in the car based on the image captured by the camera;
when the calculated congestion information is equal to or less than a threshold, sending a command to set the operating mode of the elevator to a first operating mode to the control device;
when the calculated congestion information exceeds the threshold, sending a command to set the operation mode to a second operation mode to the control device;
and causing the display unit to display the congestion information and the operation mode together with the image.