JP2012161001A - Control system, face authentication system used with the control system, and portable terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a control system, a face authentication system used with the control system, and a portable terminal capable of efficiently updating reference image information used for face authentication technique with simple operation and performing a high-accuracy face authentication.SOLUTION: A portable terminal of a control system includes: a face image photographing part; a reference image transmission part; and a dictionary data acquisition part. The face image photographing part photographs a face image of a person in a room. With the portable terminal mounted on a charger, the reference image transmission part transmits photographed face image information as reference image information to an authentication information management device connected via PLC. In the state of being mounted on the charger, the dictionary data acquisition part acquires dictionary data, generated based on the feature amount of the face image information on the authentication information management device following to transmitting the face image information, used for image authentication processing by using a PLC.

Description

  Embodiments described herein relate generally to a control system, a face authentication system used for the control system, and a portable terminal.

  Conventionally, as one of personal authentication techniques, there is a face authentication technique for identifying an individual by analyzing a human face image taken by a camera device.

  In this face authentication technique, a face image of a specific target person is previously captured as a reference image, and feature amounts extracted from the reference image are stored as dictionary data of the person. Based on the dictionary data, the similarity between the face image of the person to be authenticated and the reference image captured by the camera device is calculated, and if the similarity is a predetermined value or more, the person is the specific target. To be judged.

  By incorporating such face authentication technology into, for example, an air conditioning control system, it is possible to identify an individual by photographing a room occupant in the air conditioning control target, and to perform air conditioning control suitable for this room occupant. Therefore, it is possible to perform air conditioning control with high comfort for the occupants.

  Also, with this face authentication technology, people with significant changes in face shape, such as growing children and the elderly, cannot use the same reference image dictionary data over a long period of time. There is a technique for appropriately updating dictionary data as an image.

JP 2007-34872 A

  However, as described above, the process of extracting feature values from the reference image and generating dictionary data requires enormous data processing. For this reason, the load is large to execute at the MCU (Micro-Control Unit) level built in the home electric appliance, and it may take several hours to several days depending on the level of the image data to be executed. .

  For this reason, it is conceivable that the dictionary data is generated by a central server with a high processing speed installed separately from the home appliance, but the captured face image is transmitted to the central server or the dictionary data generated by the central server. There is a problem that the user's operation becomes complicated when the dictionary data is updated.

  The present invention has been made in view of the above circumstances, and can control reference image information for efficient use in face authentication technology with a simple operation, and can perform highly accurate face authentication. And a face authentication system and a portable terminal used therefor.

  In order to achieve the above object, in the control system of the present invention, the portable terminal of the control system includes a face image photographing unit, a reference image transmission unit, and a dictionary data acquisition unit. The face image photographing unit photographs a face image of the resident. The reference image transmission unit transmits the captured face image information as reference image information to a connected authentication information management device using PLC (Power Line Communications) while being attached to the charger. The dictionary data acquisition unit stores the dictionary data used for the face authentication process generated based on the feature amount of the face image information in the authentication information management apparatus by transmitting the face image information in a state where it is attached to the charger. Obtained using PLC.

It is a block diagram which shows the structure of the air-conditioning control system by 1st Embodiment of this invention. It is a front view which shows an example of the operation surface of the portable terminal by 1st Embodiment and 2nd Embodiment of this invention. It is a sequence diagram which shows operation | movement of the air-conditioning control system by 1st Embodiment of this invention. It is a flowchart which shows the operation | movement of the imaging | photography process performed in the portable terminal by 1st Embodiment and 2nd Embodiment of this invention. It is a flowchart which shows operation | movement when reference | standard image information is transmitted to the authentication information management apparatus from the portable terminal by 1st Embodiment and 2nd Embodiment of this invention. 6 is a flowchart showing an operation when deleting registered reference image information in the mobile terminal according to the first embodiment and the second embodiment of the present invention. It is a block diagram which shows the structure of the air-conditioning control system by 2nd Embodiment of this invention. It is a sequence diagram which shows operation | movement of the air-conditioning control system by 2nd Embodiment of this invention.

<< First Embodiment >>
<Configuration of air conditioning control system according to the first embodiment>
As a first embodiment of the present invention, the configuration of an air conditioning control system 1A using a face authentication system will be described with reference to FIG.

  An air conditioning control system 1A according to the present embodiment includes an indoor unit 10A of an air conditioning controller, a remote controller 20A that is a portable terminal that transmits an operation instruction of the indoor unit 10A by an operation of a resident, and a PLC modem 40. The charger 30 of the remote controller 20A connected to a commercial power source in a state where power line communication (PLC) can be used, and the authentication information management connected to the charger 30 via the network 50 such as the Internet using the PLC Device 60.

  The power line communication (PLC) uses an existing technology in which a high frequency signal is superimposed on a commercial power line (AC 100 to 120 V / 200 to 240 V) and bidirectional communication is performed using the power line as a transmission path. Although not shown, a PLC modem is also provided between the commercial power line and the network 50, and the PLC modem and the PLC modem 40 allow the remote controller 20A and the authentication information management device 60 to communicate with each other through power line communication. It is possible to exchange information via (PLC). 10 A of indoor units have the indoor imaging | photography part 11 and the authentication process part 12 other than the air-conditioning control part 13 which bears the function as a normal air conditioner which performs air conditioning.

  The indoor photographing unit 11 is a CMOS camera or the like, and photographs a room subject to air-conditioning control using a binocular lens 111 that is installed above the indoor unit 10A with a distance of about 10 cm.

  The authentication processing unit 12 detects the number of people in the room and the position using the image taken by the indoor photographing unit 11, and the image taken by the indoor photographing unit 11 and dictionary data transmitted from the remote controller 20A. The occupants are identified by performing the authentication process for the occupants.

  Whether the air conditioning control unit 13 performs the automatic air conditioning control corresponding to the authenticated occupant based on the number and position of the occupants detected by the authentication processing unit 12 and the information specifying the occupant. Alternatively, manual air conditioning control is performed according to the instruction transmitted from the remote controller 20A.

  The remote controller 20A includes an input unit 21, a face image photographing unit 22, a reference image recording unit 23, a reference image transmission unit 24, a dictionary data acquisition unit 25, a wireless transmission unit 26, and a deletion processing unit 27. Have.

  The input unit 21 includes operation buttons provided on the operation surface of the remote controller 20A and is operated by a person in the room. An example of an operation surface including operation buttons and the like as the input unit 21 is shown in FIG.

  As shown in FIG. 2, on the operation surface of the remote controller 20A, a lens unit 21-1 used for photographing by the face image photographing unit 22, and a photographing process by the face image photographing unit 22 using the lens unit 21-1. A “shoot” button 21-2 for executing the “image” and “registration” for recording the face image information photographed by pressing the “shoot” button 21-2 as reference image information in the reference image recording unit 23. ”Button 21-3, a“ delete ”button 21-4 for deleting the reference image information recorded in the reference image recording unit 23, and a resident who executes these photographing processing, registration processing, or deletion processing An identification button 21-5 for identifying the image, a liquid crystal monitor 21-6 for displaying a target image, notification information, setting information, etc. when executing these photographing processing, registration processing, or deletion processing, An LED lamp 21-7 that is lit when the charging controller 20A is attached to the charger 30 and is being charged; an “operation” button 21-8 for inputting an operation start instruction to the indoor unit 10; “Stop” button 21-9 for inputting an instruction, “Dehumidification” button 21-10 for inputting a dehumidification control instruction, and “Wind removal” button 21-11 for inputting a wind removal control instruction, , A “cooling” button 21-12 for inputting a cooling control instruction, a “heating” button 21-13 for inputting a heating control instruction, and a “heating” button 21-13 for inputting an instruction for raising the set temperature higher than the present time. A “plus (+)” button 21-14 and a “minus (−)” button 21-15 for inputting an instruction to lower the set temperature than the present are provided. In the example of FIG. 2, the identification button 21-5 for identifying the occupants is provided for five people A, B, C, D, and E such as family members and employees. . In the above operation surface, the “operation” button 21-8 to the “minus (−)” button 21-15 for inputting an operation start instruction to the indoor unit 10 are used for control of a general air conditioner. The “photograph” button 21-2 to the identification button 21-5 are used for personal face authentication.

  The face image photographing unit 22 is a camera device that photographs a face image of a resident who operates the remote controller 20A using the lens unit 21-1.

  The reference image recording unit 23 acquires the face image information photographed by the face image photographing unit 22 and records it for each occupant as reference image information for generating dictionary data used for face authentication processing.

  The face image photographing unit 22 can shoot either the remote controller 20A attached to the charger 30 or the remote controller 20A alone before attachment.

  When the remote controller 20A is attached to the charger 30, the reference image transmission unit 24 uses the PLC to authenticate the reference image information already recorded in the reference image recording unit 23 via the network 50 and the authentication information management device 60. Send to. When a face image is captured by the face image capturing unit 22 with the remote controller 20A attached to the charger 30, the reference image information just captured and recorded in the reference image recording unit 23 is stored in the PLC. It transmits to the authentication information management device 60 via the network 50.

  The dictionary data acquisition unit 25 transmits the reference image information from the reference image transmission unit 24 to the authentication information management device 60 in a state where the dictionary data is attached to the charger 30. Obtained using the PLC via the network 50.

  The wireless transmission unit 26 wirelessly transmits the dictionary data acquired by the dictionary data acquisition unit 25 and a signal indicating an instruction regarding the operation of the indoor unit 10A input by the input unit 21 to the authentication processing unit 12 of the indoor unit 10A. To do.

  The deletion processing unit 27 performs processing for deleting specified image information from the reference image information recorded in the reference image recording unit 23.

  The authentication information management device 60 includes a dictionary data generation unit 61 and a dictionary data transmission unit 62.

  The dictionary data generation unit 61 generates dictionary data for use in face authentication processing by extracting the feature amount of the reference image information transmitted from the remote controller 20A. The authentication information management device 60 uses an electronic computer capable of high-speed and advanced processing, and can generate dictionary data from the reference image information in a short time.

  The dictionary data transmission unit 62 transmits the dictionary data generated by the dictionary data generation unit 61 to the remote controller 20A attached to the charger 30 using the PLC via the network 50.

<Operation of the air conditioning control system according to the first embodiment>
Next, the operation of the air conditioning control system 1A according to this embodiment will be described.

  When the operation of the air conditioning control system 1A is started, an instruction for manually controlling the operation of the indoor unit 10A by an occupant from the input unit 21 of the remote controller 20A, for example, an operation instruction by the “operation” button 21-8, “ Dehumidification control instruction by "Dehumidification" button 21-10, Wind removal control instruction by "Wind removal" button 21-11, Cooling control instruction by "Cooling" button 21-12, Heating control instruction by "Heating" button 21-13, An instruction to increase the set temperature by the “plus (+)” button 21-14, an instruction to lower the set temperature by the “minus (−)” button 21-15, and an operation by the “stop” button 21-9 When a stop instruction is input using a button on the operation surface, these instructions are transmitted from the wireless transmission unit 26 using wireless communication to the indoor unit 10A. Operation corresponding to the instruction by the air conditioner control unit 13 of the indoor unit 10A is carried out.

  In addition to the air conditioning control by manual operation of the occupant, as shown in the sequence diagram of FIG. 3, automatic air conditioning control suitable for the occupant by automatically identifying the occupant in the indoor unit 10A. Is also done. The automatic air conditioning control operation will be described below.

  In the present embodiment, air conditioning control content information suitable for individuals (hereinafter referred to as occupants) A, B, C, D, and E, such as a family likely to be in the room of five, is generated in advance. Assume that it is stored in the air conditioning control unit 13 of the indoor unit 10A. This air conditioning control content information is, for example, a temperature desired by each occupant. The air conditioning control content information suitable for the occupant may be set and stored by operating the remote controller 20A by each occupant, and each past presence in the remote controller 20A or the indoor unit 10A may be stored. The setting contents and the like using the remote controller 20A of the room occupant may be stored as data for each occupant and the past data may be automatically obtained by automatically performing statistical processing.

  In the present embodiment, face authentication processing for performing identification based on the characteristics of the face of the occupant is used as the automatic identification processing of the occupant in the indoor unit 10A. A process of acquiring dictionary data related to the characteristics of the face image of each occupant used in the face authentication process by the indoor unit 10A will be described with reference to FIGS.

  First, when the occupant operates the input unit 21 of the remote controller 20A, a face image is captured by the face image capturing unit 22 at a desired time of the occupant, and the captured image information performs face authentication processing. It is registered in the reference image recording unit 23 as reference image information for generating dictionary data used at this time (S1 in FIG. 3).

  The face image shooting process in the face image shooting unit 22 and the reference image information registration process in the reference image recording unit 23 will be described in detail with reference to the flowchart of FIG.

  First, in the remote controller 20A, it is monitored whether any identification button 21-5 is pressed by a person in the room (S11). When it is detected that any one of the identification buttons 21-5, for example, the identification button 21-5 of the occupant A who is the operator is pressed ("YES" in S11), the process proceeds to "shooting mode" and the lens The face image of the occupant A captured by the face image photographing unit 22 that is a camera device is displayed on the liquid crystal monitor 21-6 by the unit 21-1 (S12). The face image capturing unit 22 captures and updates an image every appropriate short time, for example, every second. Therefore, the face image displayed on the liquid crystal monitor 21-6 is sequentially changed.

  When the identification button 21-5 is pressed, a button press waiting time measuring timer (not shown) that measures whether or not the button press waiting time in the remote controller 20A exceeds a preset upper limit, for example, 30 seconds. ) Is initialized (S13).

  Next, it is monitored whether or not the “shoot” button 21-2 has been pressed (S14). If it is detected that the “shoot” button 21-2 has been pressed (“YES” in S14), the button is pressed. When the occupant A's face image information displayed on the liquid crystal monitor 21-6 is temporarily stored (S15), the button press waiting time measurement timer is initialized again (S16).

  If it is determined in step S14 that the “shoot” button 21-2 has not been pressed (“NO” in S14), the next button press waiting time in the button press waiting time measurement timer is updated (S17). . After the update, when the waiting time for pressing the next button does not exceed the set upper limit (“NO” in S18), the process returns to step S14 to continuously monitor the pressing of the “shoot” button 21-2. Accordingly, the occupant A presses the “shoot” button 21-2 at a timing when he / she thinks that the face image is clear while viewing the face image displayed on the liquid crystal monitor 21-6 and sequentially changed. The face image information displayed on the liquid crystal monitor 21-6 at that time is temporarily stored for dictionary data generation (or update). Next, after the button press waiting time measurement timer is initialized in step S16, it is monitored whether or not the “Register” button 21-3 is pressed (S19), and the “Register” button 21-3 is pressed. Is detected (“YES” in S19), the face image information temporarily stored in step S15 is used as reference image information for generating dictionary data to be used when performing face authentication processing. It is recorded in a folder classified for each occupant of 23 (S20).

  At this time, time information at the time of recording is also recorded together with the reference image information. The remote controller 20A incorporates a clock means (not shown), and the time information recorded at the time uses the time counted by the clock means. Further, when the reference image information is already recorded in the corresponding folder, new reference image information is recorded with a file name different from the recorded reference image information.

  If it is determined in step S19 that the “registration” button 21-3 has not been pressed (“NO” in S19), the next button press waiting time in the button press waiting time measurement timer is updated (S21). . After the update, if the waiting time for pressing the next button does not exceed the set upper limit (“NO” in S22), the process returns to step S19 to continuously monitor the pressing of the “Register” button 21-3. If it is determined in step S22 that the next button press waiting time has exceeded the set upper limit (“YES” in S22), the face image temporarily stored in step S15 is deleted (S23).

  In the above-described processing, when it is determined in step S18 that the next button press waiting time exceeds the set upper limit (“YES” in S18), or the next button press waiting time exceeds the set upper limit in step S22. When it is determined (“YES” in S22) and the temporarily stored face image is deleted (S23), the “shooting mode” is canceled (S24), and the face image shooting process and the reference image information registration process are terminated. To do.

  Returning to the sequence diagram of FIG. 3, when the remote controller 20 </ b> A is attached to the charger 30 after the face image capturing process and the reference image information registration process in the remote controller 20 </ b> A are completed, the remote controller 20 </ b> A is registered by the reference image transmission unit 24. The reference image information is transmitted to the authentication information management device 60 (S2).

  Processing for transmitting the reference image information to the authentication information management apparatus 60 in the reference image transmission unit 24 will be described with reference to the flowchart of FIG.

  In transmitting the reference image information, first, the remote controller 20A in which the reference image information is registered is attached to the charger 30, and charging is started. When charging is started, the LED lamp 21-7 of the remote controller is turned on.

  Whether or not a certain amount of charging has been completed is monitored (S31). When the completion is detected and the LED lamp 21-7 is extinguished (“YES” in S31), it is recorded in the reference image recording unit 23. The latest reference image information (NewDate) is read (S32), the recording time information of the read reference image information (NewDate), and the reference transmitted to the authentication information management device 60 for the previous generation of dictionary data. The recording time information of the image information (OldDate) is compared (S33). Here, the latest reference image information (NewDate) and the reference image information (OldDate) with which the recording time information is compared are intended for all the occupants A, B, C, D, and E.

  As a result of comparison between any one of the occupants A, B, C, D, and E, the recording time information of the read reference image information (NewDate) is the reference image information (OldDate) transmitted last time. When it is determined that the reference image information is newer than the recording time information and the reference image information has been updated (“Yes” in S33), the read reference image information (NewDate) is sent from the charger 30 and the PLC modem 40 by the PLC. The data is transmitted to the authentication information management device 60 via the network 50 (S34). The transmitted reference image information (NewDate) and the recording time information are held in the reference image transmission unit 24, and are used as “the previously transmitted reference image information (OldDate) and the recording time information” during the next reference image transmission process. Used.

  If it is determined in step S33 that the reference image information has not been updated (“NO” in S33), the reference image information is not transmitted to the authentication information management device 60, and the process ends.

  Returning to the sequence diagram of FIG. 3, when the reference image information is transmitted to the authentication information management device 60, dictionary data generation processing for use in face authentication processing is performed in the dictionary data generation unit 61 of the authentication information management device 60. (S3).

  This dictionary data is generated using existing technology, and features for identifying individuals are extracted from the reference image information based on the contour distribution of the face, eyes, nose, mouth, etc. Is generated. In an existing technique for generating dictionary data, for example, OpenCV machine learning that has been released as an open source, an image containing information to be recognized and an image not containing it are prepared and learned as dictionary data. Is generated. In this technique, the processing load required for generating dictionary data varies depending on the type and complexity of the object to be recognized, the number of prepared images, and the like.

  The dictionary data generated by the dictionary data generation unit 61 is transmitted from the dictionary data transmission unit 62 via the network 50 to the PLC modem 40 and the charger 30 to the remote controller 20A via the network 50 (S4).

  In the remote controller 20A, the dictionary data transmitted from the authentication information management device 60 is acquired by the dictionary data acquisition unit 25, and then the acquired dictionary data is transmitted from the wireless transmission unit 26 to the indoor unit 10A (S5). The transmitted dictionary data is attached with data for identifying which of the occupants A, B, C, D, and E. In the indoor unit 10A, the dictionary data transmitted from the remote controller 20A is acquired by the authentication processing unit 12 and recorded in the internal nonvolatile memory or the like (S6). Here, the authentication processing unit 12 includes a storage area for dictionary data corresponding to each of the occupants A, B, C, D, and E. The dictionary data newly transmitted from the remote controller 20A is recorded in an area corresponding to the corresponding occupants A, B, C, D, and E. If the dictionary data of the corresponding occupant is already stored in the authentication processing unit 12, the new dictionary data is overwritten, and the dictionary data corresponding to the occupant who has not been stored so far is Newly recorded.

  Further, in the authentication processing unit 12, the deletion processing unit 27 performs the deletion processing of the reference image information of the occupants A, B, C, D, or E already registered by the operation of the resident remote controller 20 </ b> A. When new dictionary data is generated by re-registering the reference image information by executing the occupant's photographing process again in steps S11 to S24 as appropriate after the change, the new dictionary data is non-volatile. Dictionary data for the occupant in the sex memory is newly registered.

  A process executed by the deletion processing unit 27 when the reference image information registered in the remote controller 20A is deleted will be described with reference to the flowchart of FIG.

  First, in the remote controller 20A, it is monitored whether or not the “registration” button 21-3 is pressed by a person in the room (S41). When it is detected that the “Register” button 21-3 is pressed (“YES” in S41), a button press waiting time measurement timer in the remote controller 20A is initialized (S42).

  Next, it is monitored whether any identification button 21-5 is pressed (S43), and any identification button 21-5, for example, the identification button 21-5 of the resident A is pressed. If detected (“YES” in S43), the process proceeds to “recorded image display mode” (S44).

  When the “recorded image display mode” is entered, the latest reference image information in the folder corresponding to the designated identification button 21-5 is read from the reference image recording unit 23 and displayed on the liquid crystal monitor 21-6. At the same time (S45), the button press waiting time measurement timer is initialized again (S46).

  If it is determined in step S43 that any one of the identification buttons 21-5 has not been pressed ("NO" in S43), the next button press waiting time in the button press waiting time measurement timer is updated (S47). ). After the update, when the waiting time for pressing the next button does not exceed the set upper limit (“NO” in S48), the process returns to step S43 and monitoring of pressing any one of the identification buttons 21-5 is continuously performed. If it is determined in step S48 that the waiting time for pressing the next button has exceeded the set upper limit (“YES” in S48), the reference image deletion process ends.

  Next, after the button press waiting time measurement timer is initialized in step S46, it is monitored whether or not the “delete” button 21-4 is pressed (S49), and the “delete” button 21-4 is pressed. When this is detected (“YES” in S49), the corresponding reference image information (reference image information displayed on the liquid crystal monitor 21-6) is deleted from the reference image recording unit 23 (S50).

  If it is determined in step S49 that the “delete” button 21-4 has not been pressed (“NO” in S49), the next button press waiting time in the button press waiting time measurement timer is updated (S51). . After the update, if the waiting time for pressing the next button does not exceed the set upper limit (“NO” in S52), the process returns to step S49 to continuously monitor the pressing of the “delete” button 21-4.

  If it is determined in step S52 that the waiting time for pressing the next button has exceeded the set upper limit (“YES” in S52), the “recorded image display mode” is canceled (S53) and the liquid crystal monitor 21-6. The reference image information displayed in is deleted, and the deletion process of the reference image information ends. At the same time, the indoor unit 10A is instructed to delete the resident person's dictionary data, and the authentication unit 12 of the indoor unit 10A deletes the resident person's dictionary data.

  On the other hand, in the indoor unit 10A, the indoor photographing unit 11 uses the binocular lens 111 to photograph the room to be air-conditioned (S7 in FIG. 3).

  By capturing a subject such as an occupant by stereo measurement with the binocular lens 111, three-dimensional detection is possible, and the position of the occupant can be detected with high accuracy.

  The indoor image information photographed in the indoor photographing unit 11 is acquired by the authentication processing unit 12, and the number and position of the occupants are detected from the indoor image information, and the area of the occupant's face is extracted. A feature amount of the region is extracted.

  Then, the similarity between the feature quantity of the area of the occupant's face extracted from the room image information and the dictionary data of each occupant A, B, C, D, and E recorded in step S6. Is calculated.

  And when the degree of similarity with each dictionary data of each occupant A, B, C, D, and E is a predetermined value or more, it is specified that the occupant is corresponding to the dictionary data. Thus, face authentication processing is performed (S8).

  Based on the air conditioning control content information stored for each occupant stored in advance by the air conditioning control unit 13 and the information for identifying the number, position, and occupants of the occupants detected by the authentication processing unit 12. Then, the automatic air-conditioning control corresponding to the authenticated occupant is executed (S9).

  According to the first embodiment described above, the occupant can re-register the reference image information with a simple photographing operation, and the occupant recharges the remote controller after the reference image information is re-registered. When the camera is attached to the charger, the reference image information re-registered in the authentication information management device is automatically transmitted and new dictionary data is generated. Thus, it is possible to update the dictionary data, and to perform highly accurate face authentication processing using the latest face image information of the occupants.

  In the first embodiment, since the reference image information is captured by the face image capturing unit provided on the operation surface of the remote controller (mobile terminal), it is easy to capture the face image from the front. Can easily shoot and register.

  In the first embodiment, the dictionary data is generated by the authentication information management device having a high processing capability installed separately from the home appliance such as an air conditioner. It becomes possible to generate dictionary data with higher accuracy than that in a short time.

  In addition, because the reference image information and the dictionary data transmission / reception process between the remote controller and the authentication information management apparatus are executed using the PLC, information with a large capacity can be reliably and rapidly transmitted even in an environment with poor communication conditions. Sending and receiving can be performed, and a simple and robust system can be constructed.

<< Second Embodiment >>
<Configuration of air conditioning control system according to the second embodiment>
As a second embodiment of the present invention, a configuration of an air conditioning control system 1B using a face authentication system will be described with reference to FIG.

  The air conditioning control system 1B according to this embodiment includes an air conditioner indoor unit 10B, a remote controller 20B, and a remote controller 20B connected to a commercial power source in a state where power line communication (PLC) can be used via a PLC modem 40. And an authentication information management device 60 connected to the charger 30 via a network 50 such as the Internet using a PLC.

  In these configurations, detailed description of portions having functions similar to those of the air conditioning control system 1A in the first embodiment is omitted.

  The indoor unit 10B in the present embodiment is provided with a occupant detection unit 14 instead of the indoor photographing unit 11 and the authentication processing unit 12 of the indoor unit 10A. The occupant detection unit 14 detects the number and position of occupants using human sensors using infrared rays or the like. Moreover, the air-conditioning control part 13 is based on the number and position of the occupants detected by the occupant detection part 14 and the information specifying the occupants transmitted from the remote controller 20B. Appropriate air conditioning control. For example, when the recognized occupant dislikes that the wind from the indoor unit 10A directly hits, the wind direction is controlled so as to blow the wind away from the direction of the occupant. It should be noted that whether or not the occupant dislikes direct exposure to wind is determined based on whether the operation frequency of the “wind removal” button 21-11 exceeds a predetermined value in the past operation of the remote controller 20B by the occupant. It is determined by the air conditioning control unit 13 or the remote controller 20B depending on whether or not it is.

  In addition, the remote controller 20B in this embodiment is provided with an authentication processing unit 28 in addition to the configuration of the remote controller 20A. The authentication processing unit 28 uses the dictionary data acquired by the dictionary data acquisition unit 25 and the face image information of the occupants photographed by the face image photographing unit 22 to perform occupant authentication processing. The person in the room is specified. In the present embodiment, the operator's face is photographed using the remote controller 20B at hand, compared with the case where recognition is performed using the imaging data of the indoor unit 10A main body, and thus the probability that the operator's front face image can be photographed is increased. The recognition accuracy of the operator can be improved.

  In addition, the wireless transmission unit 26 receives information indicating the occupant generated by the authentication processing unit 28 and a signal indicating an instruction related to the operation of the indoor unit 10B, which is input by the input unit 21, for air conditioning control of the indoor unit 10B. The data is transmitted to the unit 13 by wireless communication.

<Operation of the air conditioning control system according to the second embodiment>
Next, an automatic control operation suitable for the occupant executed in the air conditioning control system 1B according to the present embodiment will be described with reference to the sequence diagram of FIG.

  In the present embodiment, the processes in steps S61 to S64 in FIG. 8 are the same as the processes in steps S1 to S4 in FIG. 3 described in the air conditioning control system 1A in the first embodiment, and thus detailed description thereof is omitted. .

  In the remote controller 20B, when the dictionary data transmitted from the authentication information management device 60 is acquired by the dictionary data acquisition unit 25, it is acquired by the authentication processing unit 28 and recorded in a nonvolatile memory or the like (S65).

  During normal driving, the remote controller 20B photographs the operator with the lens unit 21-1 and the face image photographing unit 22 every time any operation is performed (S66). In the remote controller 20B, the various operation buttons 21-8 to 21-14 for operating the air conditioner and the lens unit 21-1 are on the same plane. Therefore, when the remote controller 20B is operated, the operator's face is exactly the same. Facing the lens unit 21-1, the face image photographing unit 22 can appropriately photograph the face of the operator.

  The authentication processing unit 28 uses the acquired dictionary data and the face image information of the occupant captured by the face image capturing unit 22 to perform authentication processing of the occupant, thereby performing the occupant's authentication process. Identification is performed (S67).

  The information specifying the occupant generated in step S67 is transmitted from the wireless transmission unit 26 to the indoor unit 10B (S68).

  On the other hand, in the indoor unit 10B, the occupant detection unit 14 detects the number and positions of the occupants (S69).

  The air conditioning control unit 13 stores the air conditioning control content information for each occupant stored in advance, the number and position of the occupants detected by the occupant detection unit 14, and the occupancy transmitted from the remote controller 20B. Based on the information specifying the person, the automatic air conditioning control corresponding to the authenticated occupant is executed (S70).

  According to the second embodiment described above, in addition to obtaining the same effects as those of the first embodiment, an inexpensive infrared sensor or the like that only detects the number and position of people in the room is installed in the indoor unit 10A. The air-conditioning control suitable for the occupants can be performed only with this.

  In the first and second embodiments, the case where the PLC modem used for the PLC communication is connected to the charger of the remote controller has been described, but the PLC modem may be built in the charger.

  In the first embodiment and the second embodiment, the amount of clothes of the occupant is determined by analyzing the indoor image information captured by the indoor imaging unit of the air conditioner, and the determination result is reflected in the contents of the air conditioning control. Thus, the air volume control with higher accuracy may be performed.

  Moreover, in the said 1st Embodiment and 2nd Embodiment, in the air conditioner, although the case where the air-conditioning control corresponding to the resident who was authenticated was demonstrated, it is not limited to this, Other household appliances, for example, illumination Lighting control corresponding to an authenticated occupant may be performed in the device, or channel selection control based on the past operation history of the authenticated occupant may be performed in the television receiver.

  When lighting control is performed in the lighting device, it is possible to determine the light / dark state of the room from the captured indoor image information and reflect the determination result in the lighting control. For example, the lighting device may be controlled to be in an ON state when it is determined that the room is below a predetermined brightness.

  In the first embodiment and the second embodiment, the case where the reference image information and the dictionary data are transmitted between the remote controller and the authentication information management device has been described. The remote controller and the authentication information management apparatus may be equipped with an electronic mail transmission / reception function, and the electronic mail transmission / reception function may be used to attach and receive the reference image information or dictionary data as an attached file to the electronic mail.

  By using the e-mail transmission / reception function in this way, when the face image in the reference image information is facing down, for example, when the accuracy is low and it cannot be used to generate dictionary data, an instruction to prompt another photographing operation is issued. Can be added as email body.

  Although the embodiments of the present invention have been described, these embodiments are presented as examples, and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1A, 1B ... Air-conditioning control system 10A10B ... Indoor unit 11 ... Indoor imaging | photography part 12 ... Authentication processing part 13 ... Air-conditioning control part 14 ... In-room detection part 20A, 20B ... Remote controller 21 ... Input part 22 ... Face image photographing part 23 Reference image recording unit 24 ... Reference image transmission unit 25 ... Dictionary data acquisition unit 26 ... Wireless transmission unit 27 ... Deletion processing unit 28 ... Authentication processing unit 30 ... Charger 40 ... PLC modem 50 ... Network 60 ... Authentication information management device 61 ... Dictionary data generator 62 ... Dictionary data transmitter 111 ... Binocular lens

Claims (7)

A portable terminal operated by a resident, a charger of the portable terminal connected to a power source in a state where power line communication is possible, an authentication information management device connected to the charger using the power line communication, In a control system comprising a control device capable of wireless communication with the portable terminal,
The portable terminal is
A face image photographing unit for photographing a face image of the occupant;
A face image transmitting unit that transmits the face image information captured by the face image capturing unit to the authentication information management device using the power line communication in a state of being mounted on the charger;
When the face image information is transmitted from the face image transmission unit to the authentication information management device while being attached to the charger, the authentication information management device generates the face image information based on the feature amount. A dictionary data acquisition unit that acquires dictionary data used for face authentication processing using the power line communication;
Have
The authentication information management device includes:
A dictionary data management unit that generates the dictionary data from face image information transmitted from the mobile terminal;
A dictionary data transmission unit that transmits the dictionary data stored in the dictionary data management unit to the mobile terminal attached to the charger using the power line communication;
The control device is
An authentication processing unit that acquires the dictionary data from the dictionary data acquisition unit of the mobile terminal, and performs face authentication processing using the dictionary data to identify a resident;
And a control unit that stores in advance control contents for each occupant and performs control corresponding to the occupant identified in the face authentication process. The control device further includes an indoor photographing unit,
The indoor photographing unit photographs an area to be controlled,
The authentication processing unit detects at least one of the number of people in the room, the position, the amount of clothes, and the indoor light / dark state using an image taken by the indoor photographing unit, and is photographed by the indoor photographing unit. Identify the occupant by performing authentication processing of the occupant using the image and dictionary data acquired from the mobile terminal,
The control unit is specified based on the number of people in the room detected by the authentication processing unit, the position, the amount of clothes, at least one of indoor light and dark states, and information for identifying the person in the room The control system according to claim 1, wherein control corresponding to a person in the room is performed. A portable terminal operated by a resident, a charger of the portable terminal connected to a power source in a state where power line communication is possible, an authentication information management device connected to the charger using the power line communication, In a control system comprising a control device capable of wireless communication with the portable terminal,
The portable terminal is
A face image photographing unit for photographing a face image of the occupant;
A face image transmitting unit that transmits the face image information captured by the face image capturing unit to the authentication information management device using the power line communication in a state of being mounted on the charger;
When the face image information is transmitted from the face image transmission unit to the authentication information management device while being attached to the charger, the authentication information management device generates the face image information based on the feature amount. A dictionary data acquisition unit that acquires dictionary data used for face authentication processing using the power line communication;
An authentication processing unit that performs face authentication processing using the dictionary data acquired by the dictionary data acquisition unit and identifies a resident;
Have
The authentication information management device includes:
A dictionary data management unit that generates the dictionary data from face image information transmitted from the mobile terminal;
A dictionary data transmission unit that transmits the dictionary data stored in the dictionary data management unit to the mobile terminal attached to the charger using the power line communication;
The control device is
A control system comprising: a control unit that acquires information on the identified occupant from the authentication processing unit of the portable terminal and performs control corresponding to the occupant. The control device further includes a occupant detection unit,
The occupant detection unit detects at least one of the number of people in the room, the position, the amount of clothes, and the light / dark state in the room,
The control unit includes at least one of the number of persons in the room, the position, the amount of clothes, and the indoor light / dark state detected by the room occupant detection unit, and information on the room occupant specified by the mobile terminal. 4. The control system according to claim 3, wherein control corresponding to the specified occupant is performed based on the control. The portable terminal and the authentication information management device are equipped with an e-mail transmission / reception function,
The control system according to claim 1, wherein information transmitted / received between the portable terminal and the authentication information management device is transmitted / received as information attached to an e-mail. A portable terminal operated by an occupant, a charger of the portable terminal connected to a power source in a state where power line communication is possible, and an authentication information management device connected to the charger using the power line communication In the provided face authentication system,
The portable terminal is
A face image photographing unit for photographing a face image of the occupant;
A face image transmitting unit that transmits the face image information captured by the face image capturing unit to the authentication information management device using the power line communication in a state of being mounted on the charger;
When the face image information is transmitted from the face image transmission unit to the authentication information management device while being attached to the charger, the authentication information management device generates the face image information based on the feature amount. A dictionary data acquisition unit that acquires dictionary data used for face authentication processing using the power line communication;
Have
The authentication information management device includes:
A dictionary data management unit that generates the dictionary data from face image information transmitted from the mobile terminal;
A face authentication system comprising: a dictionary data transmission unit configured to transmit dictionary data stored in the dictionary data management unit to the portable terminal attached to the charger using the power line communication. In a portable terminal that can be attached to a charger operated by a resident and connected to the authentication information management device by power line communication,
A face image photographing unit for photographing a face image of the occupant;
A face image transmitting unit that transmits the face image information captured by the face image capturing unit to the authentication information management device using the power line communication in a state of being mounted on the charger;
When the face image information is transmitted from the face image transmission unit to the authentication information management device while being attached to the charger, the authentication information management device generates the face image information based on the feature amount. A dictionary data acquisition unit that acquires dictionary data used for face authentication processing using the power line communication;
A portable terminal comprising:

Images