KR102021394B1 - Method of user-based elevator apparatus with artificial intelligence type - Google Patents

Abstract

The present invention relates to an artificial intelligent user-based elevator apparatus, and a control method thereof.
The present invention includes a first step of receiving, by the central control unit 50, an ascent or descent command to an external elevating input button unit 22 formed on an external panel 20 outside the elevator to board an elevator; A second step of the central control unit 50 controlling the external camera 10 to recognize a user who intends to ride an elevator; A third step of calculating, by the central controller 50, the number of users gathered in front of the elevator through image analysis photographed by the external camera 10; A fourth step of analyzing, by the central controller 50, whether the number of users is singular; As a result of analysis, when the number of users is singular, the central control unit 50 stores the same face information as the photographed image by the external camera 10 to analyze whether the user has the same face among face information previously stored in the storage unit 50a. A fifth step of performing extraction from the portion 50a; A sixth step of analyzing, by the central controller 50, whether the recognized face is the face of an existing user according to whether the extracted result is performed; If it does not correspond to the face of the existing user, when the central control unit 50 is a plurality of elevators are arranged for the driving unit 70 for controlling the opening and closing of the elevator door 30 in the state of positioning each elevator to the desired number of floors At least one or more persons using the sensor unit 60 after the opening and closing control of the elevator door 30 controlled by the call floor number as well as the control of the call floor number for the elevator located closest to the user's floor through driving. A seventh step of confirming boarding of the user; In order to prevent a case in which the central control unit 50 enters the ascent or descent command to the elevating input / lower input unit 22 in the first step, when another user rides with the user when shooting by the external camera 10. Eighth step of performing extraction from the storage unit 50a for the same face information as the photographed image by the internal camera 31 to analyze whether the user having the same face among the face information stored in the storage unit 50a in advance ; A ninth step of analyzing whether the recognized face is the face of an existing user according to whether the extracted result is performed; And when the analysis results correspond to the existing user's face, the central control unit 50 displays the number of floors matching the user recognized by the face recognition using the elevating input / lowering input of the inner panel 40 and the door control button unit 42. A tenth step of starting the elevating control through the driving unit 70 at the displayed number of floors; It includes.
By doing so, the number of users who want to use the elevator is analyzed and self-learned and modified for each case, but ultimately, even if the user inputs an incorrect elevator floor, the user can present the desired floor number based on big data, and The user can provide the appropriate floors based on video recognition and voice recognition, and the user can provide the appropriate floors based on video recognition, but can provide information through grouping. In the case of individuals, it provides the effect of maximizing the utilization of the elevator in the nearest position based on one artificial intelligent user-based elevator device.

Description

Control method of artificial intelligent user-based elevator device {METHOD OF USER-BASED ELEVATOR APPARATUS WITH ARTIFICIAL INTELLIGENCE TYPE}

The present invention relates to a control method of an artificial intelligent user-based elevator apparatus, and more specifically, to analyze the number of users to use the elevator, and to learn and modify for each case, ultimately the user inputs the wrong elevator floor number Even if the present invention relates to a control method of an artificial intelligent user-based elevator device that can present the desired floor number based on big data.

Recently, programs such as Lee Sedol and Algo's Go game have been provided with a neural network structure that works like the brain of a person who does self learning by AI algorithm.

In the Fourth Industrial Revolution, such artificial intelligence is the next-generation industry in which innovative changes are brought about through the convergence of advanced information and communication technologies such as the Internet of Things, big data, and mobile throughout the economy and society. It is expected to be used throughout the industry as one of the key areas in the industry.

Accordingly, in the corresponding technical field, there is an urgent need for technology development for controlling a self-learning and presenting the number of floors desired by a user based on the biometric information of the user in elevator control.

Korean Patent Registration Publication No. 10-0319931 "ELEVATOR DISPLAY CONTROL DEVICE AND METHOD" Korean Patent Registration Publication No. 10-0295877 "SPEED CONTROL DEVICE OF ELEVATOR"

The present invention is to solve the above problems, analyze the number of users who want to use the elevator and learn and modify for each case, but ultimately, even if the user enters the wrong elevator floor number themselves based on big data An object of the present invention is to provide a control method of an artificial intelligent user-based elevator device for presentation.

In addition, the present invention provides an artificial intelligent user base for providing a suitable number of floors based on image recognition and voice recognition for a single user, and providing information through grouping while providing an appropriate number of floors based on image recognition for a plurality of users. It is for providing a control method of an elevator apparatus.

In addition, the present invention provides a control method of an artificial intelligent user-based elevator device for maximizing the utilization of the elevator in the closest position based on one artificial intelligent user-based elevator device when there are a plurality of elevators on one floor. It is for.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, the artificial intelligent user-based elevator apparatus control method according to an embodiment of the present invention, the central control unit 50 is an external elevating input formed on the outer panel 20 outside the elevator to board the elevator A first step of receiving a lift or lower command to the button unit 22; A second step of the central control unit 50 controlling the external camera 10 to recognize a user who intends to ride an elevator; A third step of calculating, by the central controller 50, the number of users gathered in front of the elevator through image analysis photographed by the external camera 10; A fourth step of analyzing, by the central controller 50, whether the number of users is singular; As a result of analysis, when the number of users is singular, the central control unit 50 stores the same face information as the photographed image by the external camera 10 to analyze whether the user has the same face among face information previously stored in the storage unit 50a. A fifth step of performing extraction from the portion 50a; A sixth step of analyzing, by the central controller 50, whether the recognized face is the face of an existing user according to whether the extracted result is performed; If it does not correspond to the face of the existing user, when the central control unit 50 is a plurality of elevators are arranged for the driving unit 70 for controlling the opening and closing of the elevator door 30 in the state of positioning each elevator to the desired number of floors At least one or more persons using the sensor unit 60 after the opening and closing control of the elevator door 30 controlled by the call floor number as well as the control of the call floor number for the elevator located closest to the user's floor through driving. A seventh step of confirming boarding of the user; In order to prevent a case in which the central control unit 50 enters the ascent or descent command to the elevating input / lower input unit 22 in the first step, when another user rides with the user when shooting by the external camera 10. Eighth step of performing extraction from the storage unit 50a for the same face information as the photographed image by the internal camera 31 to analyze whether the user having the same face among the face information stored in the storage unit 50a in advance ; A ninth step of analyzing whether the recognized face is the face of an existing user according to whether the extracted result is performed; And when the analysis results correspond to the existing user's face, the central control unit 50 displays the number of floors matching the user recognized by the face recognition using the elevating input / lowering input of the inner panel 40 and the door control button unit 42. A tenth step of starting up and down control through the driving unit 70 at the displayed number of floors; Characterized in that it comprises a.

In this case, according to the present invention, when the analysis results of the ninth step do not correspond to the face of an existing user, the eleventh step of the central control unit 50 outputting a message about a desired number of floors through the internal speaker 43 ; A twelfth step of the central controller 50 performing extraction on the storage unit 50a for the number of floors called through user voice recognition through the internal voice recognition module 41 and the number of floors used as an existing user; A thirteenth step of analyzing, by the central controller 50, whether the number of floors extracted corresponding to the existing user matches the number of called floors; And a fourteenth step in which, when the analysis result is matched, the central control unit 50 starts the elevating control through the driving unit 70 with the number of floors matched with respect to the elevator. May be further performed.

In addition, in the present invention, when the analysis result of the thirteenth step does not match, the central control unit 50 requests the input and descending input and door control button unit 42 for the desired number of floors through the internal speaker 43 A fifteenth step of outputting an output message; The central controller 50 stores the face information of the image captured by the internal camera 31 together with the number of input floors and the voice information recognized by the internal voice recognition module 41 to the storage unit 50a. A sixteenth step of using the learning information for the next elevator use of the user; And a seventeenth step in which the central controller 50 starts the elevating control through the driving unit 70 with the number of floors inputted by the elevating input and the door control button unit 42. May be further performed.

In addition, in the present invention, if it is determined that the recognized face is the face of the existing user as a result of the analysis of the sixth step, the central control unit 50 through the scheduling drive for the drive unit 70 An eighteenth step of completing an elevator door opening and closing control on the floor of the user, checking a user's boarding using the sensor unit 60, and a user checking process by the internal camera 31 in the same manner as in the eighth step; And the central controller 50 displays the number of floors extracted by the lifting and lowering input of the inner panel 40 and the door control button unit 42 after extraction from the storage unit 50a with respect to the number of floors matching the face-recognized user. A nineteenth step of starting the elevating control for the elevator through the driving unit 70 at the displayed floor number; May be further performed.

In addition, in the present invention, the eighteenth step, when the plurality of elevators are arranged in the same way as the seventh step, the central control unit 50 is to move the elevator door 30 in a state in which each elevator is positioned to the desired number of floors. Control of the number of call floors for the elevator located closest to the user's floor through the scheduling drive for the driving unit 70 to control the opening and closing may be performed.

Further, in the present invention, the first to fourth steps may be performed every time a user touches the external elevating input button unit 22.

In the control method of an artificial intelligent user-based elevator apparatus according to an embodiment of the present invention, the number of users who want to use the elevator is analyzed and self-learned and modified for each case, but ultimately even if the user inputs an incorrect elevator floor number, the big data It provides an effect that can present the desired number of floors on its own.

In addition, the control method of the artificial intelligent user-based elevator apparatus according to another embodiment of the present invention, a single user provides a suitable number of floors based on image recognition and voice recognition, and a plurality of users suitable floors based on image recognition Provides but provides the effect that can provide information through grouping.

In addition, the control method of the artificial intelligent user-based elevator apparatus according to another embodiment of the present invention, when there are a plurality of elevators on one floor, the elevator in the nearest position based on one artificial intelligent user-based elevator apparatus Provides the effect to maximize the utilization of.

1 is a view showing the external components of the artificial intelligent user-based elevator device 1 according to an embodiment of the present invention.
2 is a view showing the internal components of the artificial intelligent user-based elevator apparatus 1 according to an embodiment of the present invention.
3 is a block diagram showing the overall components of the artificial intelligent user-based elevator apparatus 1 according to the embodiment of the present invention.
4 is a block diagram showing the detailed configuration of the central control unit 50 of the artificial intelligent user-based elevator apparatus 1 according to an embodiment of the present invention.
5 is a flowchart illustrating a case of a single user in a method of controlling an artificial intelligent user-based elevator apparatus according to an exemplary embodiment of the present invention.
6 is a flowchart illustrating a case of multiple users in a method for controlling an artificial intelligent user-based elevator apparatus according to an embodiment of the present invention.

Hereinafter, the detailed description of the preferred embodiment of the present invention will be described with reference to the accompanying drawings. In the following description of the present invention, detailed descriptions of well-known functions or configurations will be omitted when it is deemed that they may unnecessarily obscure the subject matter of the present invention.

1 is a view showing the external components of the artificial intelligent user-based elevator apparatus 1 according to an embodiment of the present invention, Figure 2 is an internal configuration of the artificial intelligent user-based elevator apparatus 1 according to an embodiment of the present invention 3 is a block diagram showing all components of an artificial intelligent user-based elevator apparatus 1 according to an embodiment of the present invention, and FIG. 4 is an artificial intelligent user-based elevator according to an embodiment of the present invention. It is a block diagram which shows the detailed structure of the central control part 50 of the apparatus 1. As shown in FIG.

1 to 3, the artificial intelligent user-based elevator device 1 includes an external camera 10, an external panel 20, an external voice recognition module 21, an external elevating input button unit 22, and an external device. Speaker 23, internal camera 31, internal panel 40, internal voice recognition module 41, elevating input and door control button 42, internal speaker 43, central control unit 50, storage The unit 50a may include a transceiver 60 and a driver 70.

Referring to FIG. 4, the central control unit 50 may include an external sensing module 51, a singular processing module 52, a plurality of processing modules 53, a grouping processing module 54, and a smartphone management module 55. Can be.

Hereinafter, the artificial intelligent user-based elevator apparatus 1 will be described in detail with reference to the components of the central controller 50.

First, referring to the [external sensing module 51], the external sensing module 51 is connected to the external panel 20 outside the elevator according to the input of the user's external elevating input button 22 to board the elevator. A rising or lowering command is received from the formed external raising and lowering input button unit 22.

The external sensing module 51 controls the external camera 10 according to the lifting or lowering command reception to photograph a user who wants to board the elevator.

The external sensing module 51 may calculate the number of users gathered in front of the elevator through image analysis photographed by the external camera 10.

The external sensing module 51 may analyze whether the number of users is singular or two or more, and it is preferable to perform each time a touch input by the user to the elevating input / lowering input button unit 22 in determining the number of users.

The external sensing module 51 transmits an operation performance notification to the plurality of processing modules 53 when there are a plurality of users as a result of the analysis.

Next, referring to the [plural processing module 53], the plurality of processing modules 53 are at least using the elevator door opening and closing control and the sensor unit 60 in the user's floor through the scheduling drive for the drive unit 70. After at least one user boarding confirmation, the user recognition request by the internal camera 31 is transmitted.

Subsequently, the plurality of processing modules 53 performs facial recognition analysis on the same number of users as the calculated number of users, that is, each recognized face is based on the captured images of the images captured by the internal camera 31. After analyzing whether or not it is a face, it is analyzed based on face information previously stored in the storage unit 50a whether all recognized faces correspond to the faces of existing users.

In this case, all recognized faces may be divided into a first embodiment and a second embodiment according to a case of an existing user.

<First Embodiment>

The multi-processing module 53 extracts all the used floors for each of the face-recognized users when all the recognized faces correspond to the face of the existing user as a result of the analysis, and then raises and lowers the input and door control buttons of the inner panel 40. The number of floors can be displayed at 42, and the elevating control through the drive unit 70 starts at the displayed number of floors.

Second Embodiment

On the other hand, the multi-processing module 53 may analyze whether some of the recognized faces correspond to the existing user's face when all the recognized faces do not correspond to the existing user's face as a result of the analysis. Some of the cases that do not correspond to the face and some of them may be divided into the embodiment 2-1 and the embodiment 2-2 according to the case corresponding to the face of the existing user.

<Example 2-1>

That is, when a part of the analysis result does not correspond to the face of the existing user, the multi-processing module 53 sends an input request message to the elevating input and door control button unit 42 for the desired number of floors through the internal speaker 43. Simultaneously with or after the output, the inner panel 40 can initiate a real-time display of the number of users not recognized in the total number of users.

Subsequently, the plurality of processing modules 53 display the change of the position information in each elevator inside the elevator, which is not recognized by the image tracking method by the internal camera 31, in the unit of relative points by the inner panel 40 in real time. It is possible to induce a voice input for a desired number of floors to the lower input and door control button unit 42 and / or a desired floor number by the internal voice recognition module 41.

Thereafter, the plurality of processing modules 53 stores the number of input floors together with the photographed image (face information) and / or voice (user voice frequency characteristic information) as the storage unit 50a, and the input / lowering input and door control button unit (42) And the lift control via the drive unit 70 for the elevator boarding the user can be started by the number of floors input to the internal voice recognition module 41.

Subsequently, the plurality of processing modules 53 transmits a group identification number, a rising / lowering input, and a door control button unit to the group of user groups that are lowered by the grouping processing module 54 on each floor by the request to the grouping processing module 54 ( 42) and / or by storing the number of floors inputted to the internal voice recognition module 41, the captured image, and / or the voice to the storage unit 50a, the group information may be utilized when the next elevator is used.

<Example 2-2>

On the other hand, the multi-processing module 53 determines whether all of the unrecognized face users stored by the grouping processing module 54 belong to the same group as the face-recognized user when a part of the analysis corresponds to the face of the existing user. Can be analyzed. In this case, the user may be classified into the embodiment 2-2-1 and the embodiment 2-2-2 according to whether all of the unrecognized face users belong to the same group as the face recognized user.

<Example 2-2-1>

When the multi-processing module 53 does not belong to the same group for at least one of the users stored as the existing face information, the user who is not stored as the existing face information based on the user boarding the same elevator as a result of the analysis, In order to induce floor input for users who do not belong to the same group, the number of floors used for each of the face-recognized users (users stored as existing face information) is extracted, and the lifting and lowering input and door control of the inner panel 40 are performed. The number of floors is displayed by the button portion 42, and the number of users not recognized by the inner panel 40 (the number of users not stored as existing face information) can be displayed.

In addition, the plurality of processing modules 53 analyzes the location information of the unrecognized user (the user who is not stored as the existing face information) according to the image recognition based on the surface of the inside of the elevator and analyzes the location information on the inner panel 40. Can be displayed as The multi-processing module 53 then displays the change in the position information in the elevator of each unrecognized user (user not stored with the existing face information) on the inner panel 40 in real time, thereby raising and lowering input and It is possible to derive an input for the desired number of floors to the door control button unit 42.

<2-2-2 Example>

On the other hand, the multi-processing module 53 is a face-recognized user (which is stored as existing face information when all the users who are not stored as existing face information as a result of analysis belong to the same group as the user stored as the existing face information). After extraction of the number of floors matching the user), the number of floors may be displayed by the elevating input and output of the inner panel 40 and the door control button unit 42.

Thereafter, the plurality of processing modules 53 may sequentially initiate the elevating control through the driver 70 with the number of floors displayed by the elevating input and door control button 42.

Next, referring to [singular processing module 52], the external sensing module 51 transmits an operation performance notification to the singular processing module 52 when the analysis result user is singular.

Accordingly, the singular processing module 52 stores the storage unit 50a for the same face information as the photographed image by the external camera 10 to analyze whether the user has the same face among the face information stored in the storage unit 50a. Extraction may be performed.

The singular processing module 52 analyzes whether the recognized face is the face of an existing user according to whether the performance result is extracted.

Here, the first and second embodiments may be divided according to whether the execution result is extracted.

<First Embodiment>

When the singular treatment module 52 is extracted and corresponds to the face of the existing user, the elevator door is opened and closed on the floor of the user through scheduling driving of the driving unit 70, and then the user boarding is confirmed using the sensor unit 60. In addition, the user identification process may be completed through image recognition by the internal camera 31. Here, the singular treatment module 52 is located in the floor of the user through the scheduling drive for the drive unit 70 for controlling the opening and closing of the elevator door 30 in a state in which each elevator is positioned to the desired number of floors when a plurality of elevators are arranged It is desirable to perform control of the number of floors to call for the nearest elevator. In addition, the singular processing module 52 displays the number of floors extracted by the lifting / lowering input of the inner panel 40 and the door control button unit 42 after extraction from the storage unit 50a for the number of floors matching the face-recognized user. In addition, it is possible to start the elevating control for the elevator through the drive unit 70 by the displayed floor number.

Second Embodiment

On the other hand, the singular treatment module 52 is not extracted and does not correspond to the face of the existing user, when a plurality of elevators are arranged to control the opening and closing of the elevator door 30 in a state in which each elevator is positioned to the desired floor number After the opening and closing control of the elevator door 30 controlled by the call floor number as well as the control of the call floor number for the elevator located closest to the user's floor through the scheduling drive for the driving unit 70, the sensor unit ( At least one user boarding using 60) can be confirmed. The sensor unit 60 may be an infrared sensor.

The singular processing module 52 stores a storage unit to prevent a case where a user who has entered an ascending or descending command to the external elevating input button unit 22 and a different user boarded when shooting by the external camera 10. In order to analyze whether the user has the same face among the face information previously stored in 50a), extraction from the storage unit 50a for the same face information as the captured image by the internal camera 31 may be performed.

The singular processing module 52 analyzes whether the recognized face is the face of an existing user according to whether the performance result is extracted. Here, the recognized face may be divided into the second embodiment and the second embodiment, according to whether the face of the existing user.

<Example 2-1>

When the singular processing module 52 corresponds to an existing user's face as a result of the analysis, the number of floors matching the face recognized user is displayed by the elevating input / lowering input of the inner panel 40 and the door control button unit 42. Start and lower control via the drive unit 70 for driving an elevator in which the user is boarded with the displayed floor number.

<Example 2-2>

If the singular processing module 52 does not correspond to the face of the existing user as a result of the analysis, a message about a desired number of floors is output through the internal speaker 43, and the user voice recognition is performed through the internal voice recognition module 41. The extraction may be performed on the storage unit 50a for the number of floors called through the floor and the number of floors used as existing users.

Accordingly, the singular processing module 52 analyzes whether the number of floors extracted corresponding to the existing user and the number of floors that have been called match the analysis result, and the elevating control through the driving unit 70 with the number of floors matched with the elevator. And if it does not match conversely, after outputting the input request output message to the lifting and lowering input and door control button unit 42 for the desired number of floors through the internal speaker 43, the internal camera ( The facial information of the image photographed by 31) and the voice information recognized by the internal voice recognition module 41 may be stored in the storage unit 50a to be used as learning information for the user's next elevator use. . Thereafter, the singular processing module 52 may start the elevating control through the driving unit 70 by the number of floors inputted by the elevating input and the door control button unit 42.

Next, referring to the [smartphone management module 55], the smart phone management module 55 may perform data transmission and reception via the network with the external smart phone 2 by controlling the transceiver 60. have.

Here, the smartphone 2 is a user's or administrator's smartphone, and if it is a user's own photographed image (face information) and / or recorded voice (user's voice frequency characteristic information), and a group identification number for each elevator The modification request for may be provided to the smart phone management module 55.

On the other hand, when the smartphone 2 is an administrator, the external camera (through the control command transmission to the smartphone management module 55 through the data session connection setting with the smartphone management module 55 by the administrator externally ( 10) or if the 3D facial contour extraction of the user is not possible due to the image captured by the internal camera 31, the user can be controlled by a pan / tilt / yawing control of the external camera 10 or the internal camera 31. Can control video shooting.

5 is a flowchart illustrating a case of a single user in a method of controlling an artificial intelligent user-based elevator apparatus according to an exemplary embodiment of the present invention. Referring to FIG. 5, referring to FIG. 5, the central control unit 50 receives a lift or descend command to an external lift input button unit 22 formed on an external panel 20 outside the elevator. (S111).

After step S111, the central controller 50 controls the external camera 10 to recognize a user who intends to board the elevator (S112).

After the step S112, the central control unit 50 calculates the number of users gathered in front of the elevator through the image analysis captured in the step S112 (S113).

After the step S113, the central controller 50 may determine whether the number of users is singular (S114). On the other hand, the process of steps S111 to S114 is preferably performed every time a touch input by the user to the external elevating input button unit 22 is performed.

As a result of the determination in step S114, when there are a plurality of users, the central control unit 50 performs the process of step S149 after step S130 of FIG. 6.

On the contrary, when the determination result of step S114 is the number of users, the central control unit 50 captures the image captured by the external camera 10 to analyze whether the user has the same face among face information previously stored in the storage unit 50a. Extraction from the storage unit 50a for the same face information as may be performed (S115).

The central control unit 50 determines whether the recognized face is the face of an existing user according to whether the extracted result of the step (S115) (S116).

If it does not correspond to the face of the existing user of step (S116), the central control unit 50, if a plurality of elevators are arranged in the driving unit for controlling the opening and closing of the elevator door (30) in a state in which each elevator is positioned to the desired floor number ( After the opening and closing control of the elevator door 30 controlled by the call floor number as well as the control of the call floor number for the elevator located closest to the user's floor through the scheduling drive for 70), the sensor unit 60 Check at least one user boarding using (S117).

After the step S117, the central control unit 50 receives a user who is different from the photographing by the external camera 10 for the user who inputs the ascent or descent command to the external elevating input button unit 22 in step S111. In order to prevent boarding, from the storage unit 50a for the same face information as the image taken by the internal camera 31 to analyze whether the user has the same face among the face information stored in the storage unit 50a in advance. Extraction may be performed (S118).

The central control unit 50 determines whether the recognized face is the face of an existing user according to whether the extracted result of the step (S118) (S119).

If it is determined in step S119 that it corresponds to the face of the existing user, the central control unit 50 sets the number of floors matching the face-recognized user to the elevating input of the inner panel 40 and the number of floors to the door control button unit 42. After displaying (S125), the control of the lifting and lowering through the drive unit 70 starts with the displayed floor number (S126).

On the contrary, if it does not correspond to the face of the existing user in step S119, the central control unit 50 outputs a message about the desired number of floors through the internal speaker 43 (S120).

After step S120, the central controller 50 performs extraction on the storage unit 50a for the number of floors called through user voice recognition through the internal voice recognition module 41 and the number of floors used as existing users (S120). S121).

After the step S121, the central controller 50 determines whether the number of floors extracted corresponding to the existing user matches the number of called floors (S122).

If the determination result of step S122 matches, the central control unit 50 starts the elevating control through the drive unit 70 with the number of floors matched with respect to the elevator (S123).

On the other hand, if the determination result of step S122 does not match, the central control unit 50 outputs the input request output message to the lift input / lower input and door control button unit 42 for the desired number of floors through the internal speaker 43 ( S128).

After the step S128, the central controller 50, together with the number of floors input in step S128, facial information of the image captured by the internal camera 31, and voice information recognized by the internal voice recognition module 41. By performing the storage in the storage unit (50a) (S129), it is utilized as learning information for the user's next elevator use.

After the step S129, the central controller 50 starts the elevating control through the driving unit 70 with the number of floors inputted by the elevating input and the door control button 42 (S129a).

On the other hand, regressing to step S116, if the recognized face is the face of the existing user as a result of determining whether the face of the existing user, the central control unit 50 at the user's floor through the scheduling drive for the drive unit 70 After the elevator door opening and closing control, the user boarding confirmation using the sensor unit 60, and the user confirmation process by the internal camera 31 is completed in the same manner as in step S118 (S124). Also in step S124, the central control unit 50 is located in the driving unit 70 for controlling the opening and closing of the elevator door 30 in a state in which each elevator is positioned at a desired number of floors when the plurality of elevators are arranged as in step S117. It is preferable to perform control of the number of call floors for the elevator located closest to the user's floor through the scheduling operation for the user.

After the step S124, the central control unit 50 is extracted from the storage unit 50a with respect to the number of floors matching the face-recognized user, and then extracted by the elevating input and output of the inner panel 40 and the door control button unit 42. The number of floors is displayed (S125).

After step S125, the central control unit 50 starts the elevating control for the elevator through the driving unit 70 with the number of floors indicated in step S125 (S126).

6 is a flowchart illustrating a case of multiple users in a method for controlling an artificial intelligent user-based elevator apparatus according to an embodiment of the present invention. Referring to FIG. 6, when the determination result of the step S114 is a plurality of users, the central control unit 50 controls the opening and closing of the elevator door and the sensor unit 60 on the floor of the user through the scheduling driving of the driving unit 70. After confirming at least one user boarding using the, and transmits a user recognition request by the internal camera (31) (S131).

After step S131, the central controller 50 analyzes facial recognition of the same number of users as the number of users calculated based on the captured image according to the image capturing by the internal camera 31, that is, each recognized face is present. The analysis is performed whether or not the user's face (S132).

After step S132, the central controller 50 determines whether all recognized faces correspond to the faces of existing users based on face information previously stored in the storage unit 50a (S133).

As a result of the determination in step S133, when all the recognized faces correspond to the faces of the existing users, the central controller 50 extracts all the used floors for each of the face-recognized users, and then enters and descends the internal panel 40. The floor control display is performed by the door control button unit 42 (S134).

After the step S135, the central control unit 50 starts the lifting control via the driving unit 70 at the number of floors indicated in step S134 (S135).

On the other hand, when all the recognized face does not correspond to the face of the existing user as a result of the determination in step S133, the central control unit 50 determines whether some of the recognized face corresponds to the face of the existing user (S136).

If a part of the determination in step S136 does not correspond to the face of the existing user, the central control unit 50 requests input to the elevating input and the door control button unit 42 for the desired number of floors through the internal speaker 43. The message is output (S137).

After step S137 or together with step S137, the central control unit 50 starts real time display of the number of users not recognized in the total number of users by the inner panel 40 (S138).

After the step S138, the central controller 50 displays the change of the position information in each elevator inside the elevator in real time in units of relative points which are not recognized by the image tracking method by the internal camera 31 in real time. By doing so, the user inputs the desired number of floors to the elevating input and door control button unit 42 and / or voice recognition for the desired number of floors by the internal voice recognition module 41 (S139).

After the step S139, the central controller 50 stores the input floor number together with the captured image (face information) and / or voice (user voice frequency characteristic information) to the storage unit 50a (S140).

After the step (S140), the central control unit 50 through the drive unit 70 for the elevator boarding the user with the number of floors inputted by the elevating input and door control button unit 42, and the internal voice recognition module 41. Starting and lowering control is started (S141).

After step S141, the central control unit 50 is input to the group identification number, the elevating input and door control button unit 42, and / or the internal voice recognition module 41 with respect to the user group group lowered on each floor. By storing in the storage unit 50a together with the number of floors, the photographed image, and / or the voice (S142), the group information is utilized when the next elevator is used.

On the other hand, when returning to step S136 and a portion of the determination result of the step (S136) corresponds to the face of the existing user, the central control unit 50 is stored by some unrecognized user by the same process as the step (S142) It analyzes whether all of the users belong to the same group as the recognized face (S143).

As a result of the analysis in step S143, the central control unit 50 belongs to the same group even if at least one of the users stored as the existing face information is not stored as the existing face information based on the user who boarded the same elevator. It is determined whether or not (S144).

If at least one of the users who are not stored as the existing face information does not belong to the same group as the user stored as the existing face information as a result of the determination in step S144, the floor number input is induced for the user who does not belong to the same group. In order to do this, the central control unit 50 extracts all the used floors for each of the face-recognized users (users stored as existing face information) to the elevating input / lowering input of the inner panel 40 and the door control button unit 42. The number of floors is displayed, and the number of users not recognized by the inner panel 40 (the number of users not stored as existing face information) is displayed (S145).

After step S145, the central control unit 50 analyzes the location information of the unrecognized user (the user who is not stored as the existing face information) with respect to the surface inside the elevator and analyzes the location information to the inner panel 40. To display (S146).

After step S146, the central control section 50 displays the change in the position information inside the elevator of each of the unrecognized users (users not stored with the existing face information) on the inner panel 40 in real time, whereby A downward input and an input for a desired number of floors to the door control button unit 42 are induced (S147). Meanwhile, after step S147, the central controller 50 may further perform the information collection process of steps S140 to S142 described above.

On the other hand, when returning to step S144 and all of the users who are not stored as the existing face information as a result of the determination in step S144 belong to the same group as the user stored as the existing face information, the face-recognized user (existing After extraction of the number of floors matching the user stored as the face information), the number of floors is displayed by the elevating input and output of the inner panel 40 and the door control button 42 (S148).

After the step S148, the central control unit 50 sequentially starts the elevating control through the driving unit 70 with the number of floors displayed by the elevating input and door control button unit 42 (S149).

As described above, the present specification and drawings have been described with respect to preferred embodiments of the present invention, although specific terms are used, it is only used in a general sense to easily explain the technical contents of the present invention and to help the understanding of the present invention. It is not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be carried out in addition to the embodiments disclosed herein.

1: artificial intelligent user based elevator device
10: external camera
20: outer panel
21: external voice recognition module
22: external elevating input button
23: external speaker
31: internal camera
40: inner panel
41: internal voice recognition module
42: lifting and lowering input and door control button unit
43: internal speaker
50: central control unit
50a: storage unit
51: external sensing module
52: singular treatment module
53: multiple processing module
54: grouping processing module
55: smart phone management module
60: transceiver
70: drive unit

Claims (6)

A first step of the central controller 50 receiving a lift or lower command to an external lift input and output button unit 22 formed on an outer panel 20 outside the elevator to board an elevator;
A second step of the central control unit 50 controlling the external camera 10 to recognize a user who intends to ride an elevator;
A third step of calculating, by the central controller 50, the number of users gathered in front of the elevator through image analysis photographed by the external camera 10;
A fourth step of analyzing, by the central controller 50, whether the number of users is singular;
As a result of analysis, when the number of users is singular, the central control unit 50 stores the same face information as the photographed image by the external camera 10 to analyze whether the user has the same face among face information previously stored in the storage unit 50a. A fifth step of performing extraction from the portion 50a;
A sixth step of analyzing, by the central controller 50, whether the recognized face is the face of an existing user according to whether the extracted result is performed;
If it does not correspond to the face of the existing user, when the central control unit 50 is a plurality of elevators are arranged for the driving unit 70 for controlling the opening and closing of the elevator door 30 in the state of positioning each elevator to the desired number of floors At least one or more persons using the sensor unit 60 after the opening and closing control of the elevator door 30 controlled by the call floor number as well as the control of the call floor number for the elevator located closest to the user's floor through driving. A seventh step of confirming boarding of the user;
In order to prevent a case in which the central control unit 50 enters the ascent or descent command to the elevating input / lower input unit 22 in the first step, when another user rides with the user when shooting by the external camera 10. Eighth step of performing extraction from the storage unit 50a for the same face information as the photographed image by the internal camera 31 to analyze whether the user having the same face among the face information stored in the storage unit 50a in advance ;
A ninth step of analyzing whether the recognized face is the face of an existing user according to whether the extracted result is performed;
When the analysis results correspond to the existing user's face, the central control unit 50 displays the number of floors that match the face-recognized user by the elevating input / lowering input of the inner panel 40 and the door control button unit 42. A tenth step of starting the elevating control through the driving unit 70 at the displayed number of floors;
An eleventh step of outputting a query for a desired number of floors through the internal speaker 43 when the analysis result of the ninth step does not correspond to the face of the existing user;
A twelfth step of the central controller 50 performing extraction on the storage unit 50a for the number of floors called through user voice recognition through the internal voice recognition module 41 and the number of floors used as an existing user;
A thirteenth step of analyzing, by the central controller 50, whether the number of floors extracted corresponding to the existing user matches the number of called floors;
A fourteenth step in which the central control unit 50 starts the elevating control through the driving unit 70 with the number of floors matched with the elevator when the analysis result is matched;
If the analysis result of the thirteenth step does not match, the fifteenth step of the central control unit 50 outputs the input request output message to the lift input and output for the desired number of floors through the internal speaker 43 and the door control button unit 42. step;
The central controller 50 stores the face information of the image captured by the internal camera 31 together with the number of input floors and the voice information recognized by the internal voice recognition module 41 to the storage unit 50a. A sixteenth step of using the learning information for the next elevator use of the user; And
An artificial intelligent user-based elevator apparatus, comprising: a seventeenth step of the central control unit 50 starting and lowering control through the driving unit 70 with the number of floors inputted by the elevating input and door control button unit 42; Control method. delete delete The method of claim 1, wherein if the face recognized as a result of the analysis of the sixth step is the face of the existing user,
After the central control unit 50 controls the opening and closing of the elevator door on the user's floor through the scheduling driving of the driving unit 70, confirming the user's boarding using the sensor unit 60, and the internal camera in the same manner as in the eighth step. An eighteenth step of completing the user identification process by 31); And
The central control unit 50 displays the number of floors extracted from the storage unit 50a after the extraction from the storage unit 50a and the number of floors extracted by the door control button unit 42 after extraction from the storage unit 50a. A nineteenth step of starting the elevating control for the elevator through the drive unit 70 with the number of floors; The control method of the artificial intelligent user-based elevator apparatus further comprising.
The method of claim 4, wherein the eighteenth step,
When the plurality of elevators are arranged in the same manner as the seventh step, the central control unit 50 performs scheduling driving of the driving unit 70 that controls the opening and closing of the elevator door 30 in a state where each elevator is positioned at a desired number of floors. A control method for an artificial intelligent user-based elevator apparatus, characterized in that for controlling the number of call floors for the elevator located closest to the user's floor. The method according to claim 1,
The first step to the fourth step, the artificial intelligent user-based elevator device control method, characterized in that is performed every time a user inputs to the external elevating input button unit (22).

Images