WO2024075234A1

WO2024075234A1 - Mirror-type monitor device for elevator

Info

Publication number: WO2024075234A1
Application number: PCT/JP2022/037396
Authority: WO
Inventors: 誠一熊谷; 菜々子齊藤
Original assignee: 三菱電機ビルソリューションズ株式会社
Priority date: 2022-10-06
Filing date: 2022-10-06
Publication date: 2024-04-11

Abstract

This mirror-type monitor device comprises: an in-car camera that captures images of a user inside the car of an elevator; a mirror-type monitor that is provided to a side surface in the car and can be switched between a mirror state, in which the mirror-type monitor functions as a mirror, and a monitor state, in which the mirror-type monitor functions as a display device that displays an image; and a control device that controls operation of the in-car camera and the mirror-type monitor. The control device includes: an imaging unit that, when imaging conditions are met, captures an image of a user, who has boarded the car, by using the in-car camera; and a user image display unit that, when display conditions are met, switches the state of the mirror-type monitor from the mirror state to the monitor state, and that displays the user image captured by the imaging unit on the mirror-type monitor.

Description

Elevator mirror monitor

This disclosure relates to a mirror-type monitor device for elevators.

Patent Document 1 discloses technology relating to an elevator car display device equipped with a camera and monitor inside the elevator car. With this technology, an image captured by the camera is displayed on the monitor after being flipped left to right only while the elevator car doors are open to allow passengers to board and disembark.

Japanese Patent Publication No. 2008-74535

　Elevator cars are equipped with mirrors that allow wheelchair users to check what is behind them when they exit the car. The mirror inside the car may be used by users riding alone in the car as a reflection of themselves. If a mirror-type monitor that can be switched between a mirror state where it functions as a mirror and a monitor state where it functions as a display device that displays images is used as the mirror inside the car, there is room to provide additional services to users who use the mirror as a reflection.

This disclosure has been made to solve the problems described above, and aims to provide additional services to users who use a mirror-type monitor installed inside an elevator car to see their full-length image.

The elevator mirror-type monitor device of the present disclosure comprises an in-car camera that captures images of users inside the elevator car, a mirror-type monitor that is provided on the side of the inside of the car and is switchable between a mirror state in which it functions as a mirror and a monitor state in which it functions as a display device that displays images, and a control device that controls the operation of the in-car camera and the mirror-type monitor. The control device includes an imaging unit that captures images of users in the car using the in-car camera when imaging conditions are met, and a user image display unit that switches the state of the mirror-type monitor from the mirror state to the monitor state when display conditions are met, and causes the mirror-type monitor to display the user image captured by the imaging unit.

The elevator mirror monitor device of the present disclosure includes an in-car camera that captures images of users in the elevator car, a mirror monitor that is provided on the side of the car interior and is switchable between a mirror state that functions as a mirror and a monitor state that functions as a display device that displays images, and a control device that controls the operation of the in-car camera and the mirror monitor. The control device includes an imaging unit that captures images of users in the car using the in-car camera when imaging conditions are met, an information acquisition unit that acquires product information including image images of clothing products, an image generation unit that uses the user image captured by the imaging unit and the image images to generate a dress-up image in which the user wears the clothing products, and a dress-up image display unit that switches the state of the mirror monitor from the mirror state to the monitor state when display conditions are met and displays the dress-up image on the mirror monitor.

The elevator mirror-type monitor device disclosed herein can display an image of a user captured by an in-car camera on a mirror-type monitor for the user inside the car. This allows the user to objectively check their own appearance from the displayed image.

1 is a diagram showing an overview of an elevator to which a mirror-type monitor device according to a first embodiment is applied. 1 is a diagram for explaining an overview of a mirror-type monitor device according to a first embodiment; FIG. 1 is a block diagram showing an example of the configuration of a mirror-type monitor device. 2 is a functional block diagram showing functions realized by a processor of the control device executing a program. FIG. 4 is a flowchart of a routine executed in the mirror-type monitor device. FIG. 13 is a diagram for explaining an overview of a modified example of the mirror-type monitor device according to the first embodiment. FIG. 13 is a diagram illustrating a modification of the hardware resources of the control device. FIG. 11 is a block diagram showing a configuration of a mirror-type monitor device according to a second embodiment. 11 is a functional block diagram showing functions realized by a processor of a control device according to a second embodiment executing a program. FIG. FIG. 11 is a diagram for explaining an overview of a mirror-type monitor device according to a second embodiment. 10 is a flowchart of a routine executed in a mirror-type monitor device according to a second embodiment.

Below, an embodiment of the present disclosure will be described with reference to the drawings. Note that elements common to each figure are given the same reference numerals and duplicated explanations will be omitted.

1. Embodiment 1
1-1. Overview of the mirror type monitor device Fig. 1 is a diagram showing an overview of an elevator to which a mirror type monitor device according to the first embodiment is applied. Fig. 2 is a diagram for explaining the overview of the mirror type monitor device according to the first embodiment. The mirror type monitor device 10 according to the first embodiment is installed in an elevator 100. The elevator 100 is installed in a facility consisting of a building or the like having multiple floors.

In the facility, a hoistway 3 for the elevator 100 is provided. The hoistway 3 is a long space in the vertical direction that spans multiple floors. A landing 4 for the elevator 100 is provided on each floor of the facility. The landing 4 is a location adjacent to the hoistway 3.

The elevator 100 comprises a car 1 and a control panel 6. The car 1 is a device that transports passengers and others inside the car between multiple floors by traveling up and down the elevator shaft 3. The car 1 is equipped with car doors 2. When the car 1 stops at any floor, the car doors 2 are a device that opens and closes in conjunction with the hall doors of the hall 4 of that floor so that passengers can board and disembark at the hall 4 of that floor and at the car 1. An in-car operation panel 8 is installed next to the car doors 2 inside the car 1 for opening and closing the car doors 2 and registering destination floors. Operation information from the in-car operation panel 8 is sent to the control panel 6.

The control panel 6 is a device that controls the operation of the elevator 100. The operation of the elevator 100 controlled by the control panel 6 includes, for example, opening and closing the doors, managing registered calls, and running the car 1 in response to calls.

The mirror-type monitor device 10 according to the first embodiment includes an in-car camera 12, a mirror-type monitor 14, and a control device 20. The mirror-type monitor 14 is a monitor that can be switched between a mirror state in which it functions as a mirror and a monitor state in which it functions as a display device that displays an image. The mirror-type monitor 14 is disposed on the side surface 1a that faces the car door 2.

The in-car camera 12 is a camera for capturing images of users inside the car. The in-car camera 12 is capable of capturing images of users operating the in-car operation panel 8 inside the car 1 from the rear side, and is positioned, for example, above the mirror-type monitor 14 on the side surface 1a so that it can capture images of users facing the mirror-type monitor 14 from the front side. The images of users captured by the in-car camera 12 are hereinafter referred to as "user images."

The control device 20 is a computer for controlling the operation of the in-car camera 12 and the mirror-type monitor 14. The control panel 6 transmits operation information and sensor information of the elevator 100 to the control device 20 at any time. Examples of operation information here include operation information of the in-car operation panel 8, opening and closing of the elevator 100 doors, registered calls, and information of the car 1 responding to calls. Examples of sensor information include measurement information of a scale that measures the weight inside the car 1, and detection information of a door sensor that detects a user getting on or off the car 1. The control device 20 captures a user image using the in-car camera 12 when a predetermined imaging condition is met. This process is hereinafter referred to as "imaging process". The imaging condition includes, for example, that the in-car operation panel 8 has been operated by a user, and that there is only one user in the car 1. According to such imaging conditions, the in-car camera 12 captures a rear image of the user alone as a user image. The captured user image is sent from the in-car camera 12 to the control device 20.

The control device 20 normally controls the state of the mirror-type monitor 14 to be in the mirror state. Then, when a predetermined display condition is met, the control device 20 switches the state of the mirror-type monitor 14 from the mirror state to the monitor state, and causes the mirror-type monitor 14 to display the user's image. This process is hereinafter referred to as the "user image display process." The display condition includes, for example, that the user in the car 1 is facing the direction of the mirror-type monitor 14. According to such a display condition, it is possible to provide an image of the back of the user only to those users who wish to use the full-length mirror.

In the example shown in FIG. 2, a user image PIC1 of the user's back is provided to the user facing the mirror-type monitor 14 through the mirror-type monitor 14. By controlling the mirror-type monitor device 10 in this way, an additional service can be provided to a user who uses the mirror in the car 1 to look at himself/herself, by providing an image of the user's back.

1-2. Configuration of the mirror type monitoring device 10 Fig. 3 is a block diagram showing an example of the configuration of the mirror type monitoring device 10. As described above, the mirror type monitoring device 10 comprises the car interior camera 12, the mirror type monitor 14, and the control device 20. The control device 20 has the function of a processing device as a computer. Typically, the control device 20 comprises at least one processor 200 and at least one memory 210 coupled to the processor 200. The memory 210 stores at least one program 220 executable by the processor 200 and various data 230 associated therewith.

By the processor 200 executing the program 220, various processes are realized by the processor 200. FIG. 4 is a functional block diagram showing functions realized by the processor 200 of the control device 20 executing the program 220. As shown in FIG. 4, the processor 200 includes an imaging unit 201, an imaging condition determination unit 202, a user image display unit 203, and a display condition determination unit 204.

The imaging unit 201 is a functional block for performing imaging processing. The imaging condition determination unit 202 is a functional block for determining whether or not the conditions for executing imaging processing by the imaging unit 201 are met. The user image display unit 203 is a functional block for performing user image display processing. The display condition determination unit 204 is a functional block for determining whether or not the conditions for executing user image display processing by the user image display unit 203 are met. Below, the processing executed in each functional block of the processor 200 will be described in detail with reference to the flowchart.

1-3. Specific processing executed in the mirror type monitor device 10 Fig. 5 is a flowchart of a routine executed in the mirror type monitor device 10. The routine shown in Fig. 5 is repeatedly executed at a predetermined control period by the processor 200 of the control device 20 while the elevator 100 is in operation.

The processes of steps S100 and S102 correspond to the processes executed in the image capture condition determination unit 202. In step S100, it is determined whether there is only one user in the car 1. Here, the control device 20 determines whether there is only one user in the car 1 based on the scale measurement information included in the sensor information received from the control panel 6. Alternatively, the control device 20 determines whether there is only one user entering the car 1 based on the detection information of the door sensor. Alternatively, the control device 20 determines whether there is only one user in the car 1 by analyzing the image captured by the in-car camera 12 using a known image analysis method.

If the result of step S100 is that the judgment is not established, the processing of this routine is terminated, and if the judgment is established, the processing proceeds to step S102. In step S102, it is determined whether the user has operated the in-car control panel 8 based on the received operation information. As a result, if the judgment is established, the processing proceeds to step S104, and if the judgment is not established, the processing of this routine is terminated.

The processing of step S104 corresponds to the imaging processing executed by the imaging unit 201. In step S104, the rear of the user operating the in-car operation panel 8 is imaged by the in-car camera 12, and temporarily stored as user image PIC1 in the data 230 area of the memory 210. When the processing of step S104 is completed, the process proceeds to step S106.

The process of step S106 corresponds to the process executed by the display condition determination unit 204. In step S106, it is determined whether the user in car 1 is facing the direction of the mirror-type monitor 14. Here, the control device 20 determines whether the user in car 1 is facing the direction of the mirror-type monitor 14, for example, by performing image analysis of the car interior image captured by the car interior camera 12. If the result shows that the determination is not established, the process proceeds to step S110, and if the determination is established, the process proceeds to step S108.

The process of step S108 corresponds to the user image display process executed by the user image display unit 203. In step S108, the mirror-type monitor 14 is switched from the mirror state to the monitor state, and the user image PIC1 stored in the memory 210 is read out and displayed on the mirror-type monitor 14. When the process of step S108 is completed, the process proceeds to step S110.

In step S110, it is determined based on the operation information received from the control panel 6 whether the elevator 100 has arrived at the destination floor registered by the user, or whether it has stopped at an intermediate floor before arriving at the destination floor due to a call registered by another user. If the determination is not satisfied, the process returns to step S106, and if the determination is satisfied, the process proceeds to step S112.

In step S112, the display of the user image PIC1 on the mirror-type monitor 14 is terminated, and the mirror-type monitor 14 is switched from the monitor state to the mirror state.

The mirror-type monitor device 10 described above can provide a display of an image of the back of a user who uses the mirror in the car 1 as a full-length mirror. This allows the user to check the appearance of the back of their own appearance.

Also, when there is only one user in car 1, the user's image is displayed, allowing the user to check their appearance without worrying about being seen by others. Furthermore, when elevator 100 stops at the destination floor or an intermediate floor, the display of the user's image is terminated, preventing the display of the user's image from being provided to other users.

1-4. Modifications The mirror-type monitor device 10 of the first embodiment may be modified as follows.

In the routine of the flowchart in FIG. 5, the processing of step S106 is not essential. In other words, the user image may be displayed regardless of the orientation of the user in the car 1. In this case, the user may be notified that the user image will be displayed by a notification means such as a sound.

The mirror-type monitor device 10 may display on the mirror-type monitor 14 a user image captured from the front of the user in addition to the user image captured from the back of the user. FIG. 6 is a diagram for explaining an overview of a modified example of the mirror-type monitor device according to the first embodiment. In the example shown in this figure, a user image PIC2 of the front of the user is displayed next to a user image PIC1 of the back of the user displayed on the mirror-type monitor 14. In this type of control, for example, when the determination in step S106 is found to be established in the routine of the flowchart in FIG. 5, an image of a user facing the mirror-type monitor 14 is captured by the in-car camera 12 and temporarily stored as a user image PIC2 in the data 230 area of the memory 210. Then, in the user image display process in the next step S108, the user image PIC1 and the user image PIC2 stored in the memory 210 are read out and displayed side by side on the mirror-type monitor 14. With this type of control, the user in the car 1 can check his/her appearance not only from the back of his/her own but also from the front of his/her own. In addition, in the user image display process, only the user image PIC2 in front of the user may be displayed.

It is also anticipated that a user who has been provided with a display of their own user image may wish to end the display. Thus, the mirror-type monitor device 10 may be provided with a cancel button that allows the user to cancel the display by the user image display process. Such a cancel button may be provided, for example, on the in-car operation panel 8, or the mirror-type monitor 14 may be provided with an input function such as a touch panel, and the cancel button may be displayed on the mirror-type monitor 14.

FIG. 7 is a diagram showing modified examples of the hardware resources of the control device 20. In the example shown in FIG. 7, the control device 20 includes a processing circuit 250 including, for example, a processor 200, a memory 210, and dedicated hardware 240. FIG. 7 shows an example in which some of the functions of the control device 20 are realized by the dedicated hardware 240. All of the functions of the control device 20 may be realized by the dedicated hardware 240. As the dedicated hardware 240, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination of these may be used.

The mirror-type monitor device 10 may have a function for displaying past images of the user. For example, when storing a user image in the memory 210, this function assigns an identification ID to the user image using known face recognition technology before storing it in the memory 210. Then, in the user image display process, the mirror-type monitor device 10 reads out a user image with an identification ID that is the same as the identification ID of the current user image, and displays it together with the current user image as a past image. This process allows the user to visually compare their past and current appearances.

2. Embodiment 2
2-1. Configuration of the mirror type monitor device according to the second embodiment FIG. 8 is a block diagram showing the configuration of the mirror type monitor device according to the second embodiment. FIG. 9 is a functional block diagram showing the functions realized by the processor of the control device according to the second embodiment executing a program. FIG. 10 is a diagram for explaining the outline of the mirror type monitor device according to the second embodiment. As shown in FIG. 9, the mirror type monitor device 10 according to the second embodiment of the control device 20 according to the second embodiment is connected to a communication network such as the Internet or a telephone line network so as to be able to receive clothing information from an external service 30. The external service 30 is an external service that provides product information related to fashion, for example. The mirror type monitor device 10 according to the second embodiment has a common configuration with the mirror type monitor device 10 according to the first embodiment, except that it is connected to the external service 30. Explanation of the common configuration with the mirror type monitor device 10 according to the first embodiment will be omitted.

As shown in FIG. 9, in addition to the functional blocks of the processor 200 of the first embodiment, the processor 200 further includes an information acquisition unit 205 and a dress-up image generation unit 206.

The information acquisition unit 205 is a part that acquires product information on clothing products from the external service 30. This process is hereinafter referred to as the "product information acquisition process." The product information here includes, for example, an image of the clothing product and product description information that can identify the clothing product. The product description information includes information such as the description, price, and store where the clothing product is sold. The product information acquired by the information acquisition unit 205 is temporarily stored in the data 230 area of the memory 210.

The dress-up image generating unit 206 is a part that generates a dress-up image of the user image using the product information acquired by the information acquiring unit 205. The dress-up image generating unit 206 generates a dress-up image by combining an image of the product information with the user image using a known image processing technique. This process is hereinafter referred to as the "dress-up image generating process." The dress-up image generated by the dress-up image generating process is displayed on the mirror-type monitor device 10 by the user image display process. Furthermore, in the user image display process, the product information is displayed in addition to the dress-up image. In the example shown in FIG. 10, the displayed image includes a dress-up image PIC3 in which an image image is combined with the front user image, and product information INF. The product information INF includes detailed information about the product and store information.

In this way, the processing by the mirror-type monitor device 10 according to the second embodiment allows the user to refer to the image of himself/herself dressed up, and thus to get an idea of how the product will look when worn without actually trying it on. In addition, the composite image also displays product information, allowing the user to obtain the information necessary for purchase.

2-2. Specific processing executed in the mirror type monitor device 10 according to embodiment 2 Fig. 11 is a flowchart of a routine executed in the mirror type monitor device 10 according to embodiment 2. The routine shown in Fig. 11 is repeatedly executed at a predetermined control period by the processor 200 of the control device 20 while the elevator 100 is in operation.

The processing of steps S200 and S202 corresponds to the processing executed by the image capture condition determination unit 202. In step S200, it is determined whether there is only one user in car 1. Here, the same processing as the processing of step S100 in the routine shown in FIG. 5 is executed.

If the result of step S200 is that the judgment is not successful, the processing of this routine is terminated, and if the judgment is successful, the processing proceeds to step S202. In step S202, it is determined whether the user in car 1 is facing the direction of the mirror-type monitor 14. Here, the control device 20 determines whether the user in car 1 is facing the direction of the mirror-type monitor 14, for example, by performing image analysis of the image inside the car captured by the in-car camera 12. As a result, if the result is that the judgment is not successful, the processing of this routine is terminated, and if the judgment is successful, the processing proceeds to step S204.

The processing of step S204 corresponds to the imaging processing executed by the imaging unit 201. In step S204, the front of the user facing the mirror-type monitor 14 is imaged by the in-car camera 12, and temporarily stored as user image PIC2 in the data 230 area of the memory 210. When the processing of step S204 is completed, the process proceeds to step S206.

The processing of step S206 corresponds to the product information acquisition processing executed by the information acquisition unit 205. In step S206, product information related to fashion is acquired from the external service 30. The information acquisition unit 205 estimates the gender, age, etc. of the user in the basket 1 by image analysis of the user image PIC2 captured in the processing of step S204, and acquires product information related to fashion that matches the estimated gender, age, etc. When the processing of step S206 is completed, the process proceeds to step S208.

The process of step S208 corresponds to the generation of a dress-up image executed by the dress-up image generating unit 206. In step S208, a dress-up image PIC3 of the user image is generated using the product information acquired by the information acquiring unit 205. The generated dress-up image PIC3 is temporarily stored in the data 230 area of the memory 210. When the process of step S208 is completed, the process proceeds to step S210.

Step S210 corresponds to a user image display process executed by the user image display unit 203. In step S210, the mirror-type monitor 14 is switched from the mirror state to the monitor state, and the dress-up image PIC3 stored in the memory 210 is read out and displayed on the mirror-type monitor 14. When the process of step S210 is completed, the process proceeds to step S212.

In step S212, it is determined based on the operation information received from the control panel 6 whether the elevator 100 has arrived at the destination floor registered by the user, or whether it has stopped at an intermediate floor before arriving at the destination floor due to a call registered by another user. If the determination is not found to be true, the process of step S212 is repeated until the determination is found to be true. If the determination of step S212 is found to be true, the process proceeds to step S214.

In step S214, the display of the dress-up image PIC3 on the mirror-type monitor 14 is terminated, and the mirror-type monitor 14 is switched from the monitor state to the mirror state.

2-3. Modifications The mirror-type monitor device 10 of the second embodiment may be modified as follows.

In the process of step S210 in the flowchart of FIG. 10, the contents of the product information INF displayed on the mirror-type monitor 14 are not limited. In other words, the product information may be, for example, a readable two-dimensional barcode in which the product information is encrypted, or a URL related to the product.

The dress-up image generated in the dress-up image generation process in step S208 of the flowchart in FIG. 10 is not limited to an image of the front of the user, but may also be an image of the back. When generating a dress-up image of the back, if the determination in step S200 is true, an image of the back of the user is captured by executing the processes in steps S102 and S104 shown in FIG. 5, and the captured back image is used in the dress-up image generation process.

1 Cage, 1a Side, 2 Cage door, 3 Hoistway, 4 Landing, 6 Control panel, 8 In-cage operation panel, 10 Mirror-type monitor device, 12 In-cage camera, 14 Mirror-type monitor, 20 Control device, 30 External service, 100 Elevator, 200 Processor, 201 Imaging unit, 202 Imaging condition determination unit, 203 User image display unit, 204 Display condition determination unit, 205 Information acquisition unit, 206 Image generation unit, 210 Memory, 220 Program, 230 Data, 240 Dedicated hardware, 250 Processing circuit

Claims

An in-cab camera that captures images of users inside the elevator car;
a mirror-type monitor provided on a side surface inside the car and switchable between a mirror state in which the mirror functions as a mirror and a monitor state in which the monitor functions as a display device for displaying an image;
A control device that controls the operation of the car interior camera and the mirror-type monitor;
Equipped with
The control device includes:
an imaging unit that images a user who is in the elevator car using an in-elevation camera when an imaging condition is satisfied;
a user image display unit that switches a state of the mirror-type monitor from the mirror state to the monitor state when a display condition is satisfied, and causes the user image captured by the imaging unit to be displayed on the mirror-type monitor;
An elevator mirror-type monitor device including:
The car interior camera is installed at a position where it can capture an image of a user operating an in-car operation panel from the rear side,
2. The mirror-type monitor device according to claim 1, wherein the image capturing condition includes that the in-car operation panel has been operated.
The mirror-type monitor device according to claim 1 or 2, wherein the imaging conditions include the number of passengers in the car being one.
The mirror-type monitor device according to any one of claims 1 to 3, wherein the display condition includes the user facing the direction of the mirror-type monitor.
The mirror-type monitor device according to claim 1, wherein the user image display unit is configured to terminate display of the user image when the elevator arrives at a destination floor or an intermediate floor for which a call has been registered.
An in-cab camera that captures images of users inside the elevator car;
a mirror-type monitor provided on a side surface inside the car and switchable between a mirror state in which the mirror functions as a mirror and a monitor state in which the monitor functions as a display device for displaying an image;
A control device that controls the operation of the car interior camera and the mirror-type monitor;
Equipped with
The control device includes:
an imaging unit that images a user who is in the elevator car using an in-elevation camera when an imaging condition is satisfied;
An information acquisition unit that acquires product information including image images of clothing products;
an image generating unit that generates a dress-up image in which the user wears the clothing product by using the user image captured by the imaging unit and the image image;
a dress-up image display unit that switches a state of the mirror-type monitor from the mirror state to the monitor state when a display condition is satisfied, and displays the dress-up image on the mirror-type monitor;
An elevator mirror-type monitor device including:
The product information includes product description information for identifying the clothing product,
The mirror-type monitor device according to claim 6 , wherein the dress-up image display unit is configured to display the product description information together with the dress-up image.
The car interior camera is installed at a position where it can capture an image of a user facing the mirror-type monitor from the front side,
8. The mirror-type monitor device according to claim 6, wherein the image capturing condition includes that the user faces the direction of the mirror-type monitor.
The mirror-type monitor device according to any one of claims 6 to 8, wherein the imaging conditions include the number of passengers in the car being one.