JP5525165B2 - Operation display device - Google Patents

Description

  The present invention relates to an operation display device capable of interactively giving instructions using a display device.

  In recent years, housing facilities equipped with computers have increased, and many of these housing facilities have made it possible to give interactive instructions using a display device and an operation device such as a switch. As this type of housing equipment, for example, an entrance system that proposes clothes when going out has been proposed (see, for example, Patent Document 1).

  This entrance system determines whether or not to go out by voice input from the user at the entrance, identifies the user based on the face image of the user at the entrance, and goes out when the user goes out Propose appropriate clothing. In this entrance system, in order to propose clothes when going out, information on clothes (including not only clothes but also decorative items) owned by the user, information on clothes before the user goes out, and use Body information such as a person's body temperature, and external environment information such as an outside temperature. Moreover, in order to obtain information on clothes owned by the user and information on clothes before the user goes out, a clothing management device including a closet is provided.

  In the configuration described in Patent Document 1, when a user utters a voice indicating the intention to go out at the entrance and the user is specified, the user is identified by the clothing management device after taking into account physical information and external environment information. In addition, for the clothes of users, proposals concerning clothes for going out, such as wearing a coat and carrying an umbrella, are made.

Japanese Patent Laying-Open No. 2006-301973 (paragraphs 0013-0018 and 0031-0032, FIGS. 1 and 4)

  By the way, the entrance system described in Patent Document 1 is a dedicated system for making proposals regarding clothes when going out, and other information considered to be desirable when going out or when going home is considered. Absent. In addition, since the entrance system is notified by voice that the user is going out, there are not a few users who feel uncomfortable with the unfamiliar act of making a voice toward the entrance system. it is conceivable that.

  The present invention has been made in view of the above-mentioned reasons, and its purpose is to enable presentation of different information depending on individual users, and to make various instructions without using voice. An operation display device is provided.

The present invention includes a display device that displays video, an imaging device that images a person's face existing in front of the display device, a face authentication device that performs personal authentication using a captured image, and a front of the display device. A distance image sensor that generates a distance image of a person existing in the sensing area defined in the above, a presentation information storage unit that stores information to be presented for each individual to be personally authenticated by the face authentication device, and extracted from the distance image An operation determination unit that converts a person's actions into instructions, an information selection unit that extracts information corresponding to a person who has been personally authenticated by the face authentication device from the presentation information storage unit according to an instruction from the operation determination unit, and information a display processing unit for displaying the information selecting unit is extracted to a display device, and a presence determining unit for detecting a human presence in the sensing region based on the distance image, the display device and the face authentication apparatus Start the determination unit detects a human by the distance image, the gesture of a person starts the face authentication device was personal authentication operation determination unit is extracted from the range image, and instruction to the information selection unit It is characterized by converting into.

  It is desirable to dispose the distance image sensor above the display device.

  Further, the operation determination unit may output an operation instruction for the image displayed on the display device, and the display processing unit may operate the image displayed on the display device according to the instruction from the operation determination unit. .

  It is desirable that the operation determination unit can output an instruction to turn off the display on the display device.

  In addition, it is desirable to provide an interface for storing information in the presentation information storage means.

  In the above-described configuration, the display device, the face authentication device, and the distance image sensor are arranged at the entrance of the house, and the information to be presented at the time of going out and at the time of going home for each person whose personal authentication is performed by the face authentication device is stored as the presentation information. If the information is stored in the unit, the information selection unit can extract information from the presentation information storage unit based on the result of personal authentication by the face authentication device and the instruction of going out or going home by the operation determination unit.

  In addition, a half mirror is provided, the display device is arranged on the back side of the half mirror so that video can be displayed through a part of the half mirror, and the face authentication device captures the face of a person existing in front of the half mirror. It may be arranged on the back side of the half mirror.

  According to the configuration of the present invention, the personal authentication of the user is performed by the face authentication means, the action of the person in the sensing area is converted into the instruction by the motion determination unit, and the user who performed the personal authentication and the motion determination unit Therefore, the information to be presented can be displayed on the display device according to the user. In addition, since the action determination unit converts human actions detected from the distance image into instructions, the user does not need to give instructions using voice, but can give instructions by actions such as gestures and poses. It becomes possible to use without feeling uncomfortable.

  When the distance image sensor is placed above the display device, it is easy to set the sensing area in front of the display device, and it is easy to capture the action by monitoring the person's actions in the sensing area from above. Become.

  In the configuration with the presence / absence determination unit, the range image output from the range image sensor can be used for both the function of detecting the human action and the detection of the presence / absence of the person, and can be configured to save space. become. In addition, by adopting a configuration in which display of the display device is started when a person is detected by the presence / absence determination unit, the display device is always turned off to realize power saving, but when there is a person, the display device Display can be started and necessary display can be performed.

  In addition, in the case where the operation determination unit enables an instruction to operate on the icon displayed on the display device, it is possible to use a human action as a pointing device, and it is possible to operate the screen of the display device.

  Furthermore, by enabling an instruction to turn off the display on the display device, the display on the display device can be turned off even when a person is present in the sensing area.

  In the configuration including the interface, desired information that the user intends to present to the information presentation unit can be stored in the presentation information storage unit, and the information presented to the information presentation unit can be changed as appropriate.

  In addition, in the configuration where it is placed at the entrance and gives instructions on whether to go out or go home, it can be used for checking forgotten items, checking for forgetting to turn off equipment that uses electricity and gas, checking for door shuts, etc. When returning home, it can be used to send messages from family members and to check the guests who are away.

  In the case where a half mirror is provided and a display device and face authentication device are arranged on the back side of the half mirror, when using the half mirror as a figure or makeup mirror, interactively in the space where the figure or makeup mirror can be installed There is an advantage that a display operation device capable of giving an instruction can be provided and space is saved. If the display device is turned off at all times, the front of the half mirror can be used as a mirror, and if the display of the display device is started, a unique atmosphere is created so that the display appears in the mirror. Can do.

It is a block diagram which shows embodiment. (A) is a front view same as the above, (b) is a longitudinal sectional view same as the above. It is a rear view same as the above. It is a cross-sectional view same as the above. It is operation | movement explanatory drawing same as the above.

  In the embodiment described below, a case where the operation display device is used as a figure placed at the entrance of a house is shown as an example, but this does not prevent the operation display device from being used for other purposes. Therefore, a half mirror described later can be omitted, and the installation location is not limited.

  In the present embodiment, as shown in FIG. 2, the half mirror 1 is held on one surface of a structural base 31 that forms part of the entrance wall, and the structural base 32 that forms part of the ceiling of the entrance includes A distance image sensor 2 to be described later is attached. The distance image sensor 2 is disposed at the upper end position of the half mirror 1, and the sensing area Es of the distance image sensor 2 is set so as to include a predetermined range in front of the half mirror 1 from the vicinity of the front surface of the half mirror 1. The range of the sensing area Es can be, for example, the entire entrance, but is preferably a range in which personal authentication by the face authentication device 4 described later is possible. The structural bases 31 and 32 can be integrated as a unit. On the back surface of the half mirror 1, a display device 3 attached to the structural base 31 and a face authentication device 4 including an imaging device that images a human face through the half mirror 1 are attached.

  The half mirror 1 is formed in a dimension that can be used as a figure that reflects the whole body of the user. For example, the half mirror 1 has a height dimension from the floor F to the ceiling C, and has a width dimension of about a quarter of the height dimension. Form to have. The screen size of the display device 3 is smaller than that of the half mirror 1 (diagonal length is about 50 cm, for example), and the display device 3 performs display through a part of the half mirror 1. For this reason, a self-luminous type display device such as a liquid crystal display device having a backlight is used for the display device 3, and information displayed on the screen of the display device 3 is displayed from the front of the half mirror 1 to the half mirror 1. It can be seen through.

  Since the half mirror 1 can be used as a figure and needs to transmit light from the display device 3, the half mirror 1 is made of a transparent flat substrate (not shown) made of glass or synthetic resin. Mirror surface coating (not shown) with a metal film or the like is formed on the surface. The strength of the base material is designed so as to maintain a degree of flatness that can be used as a figure.

  A mirror coating is formed on at least one of the surface of the substrate facing the display device 3 and the surface of the substrate opposite to the display device 3. The transmittance of the half mirror 1 is set to 20%, for example, so that an image displayed on the display device 3 can be visually recognized.

  When a mirror surface coating is formed on the surface of the half mirror 1 opposite to the display device 3, the half mirror 1 has a high transmittance of light emitted from the display device 3 and a high reflectance of the front surface. Can be expected to function as That is, since the substrate does not absorb light, the function as a mirror is enhanced.

  However, when the mirror coating is formed on the surface of the substrate opposite to the display device 3, it is desirable to cover the surface of the mirror coating with a transparent protective film. Further, a transparent material that prevents reflection by adjusting the refractive index is filled between the half mirror 1 and the screen of the display device 3 so that the image displayed on the display device 3 can be displayed with high luminance. Is desirable.

  Attachment holes 33 and 34 are provided in the structure base 31 where the display device 3 and the face authentication device 4 are attached. The display device 3 and the face authentication device 4 are fixed to the structure base 31 around the attachment holes 33 and 34. The fixture 35 (only the fixture 35 of the display device 3 is shown) is fixed.

  The display device 3 is set so that it is easy to see when the user stands in front of the half mirror 1, and the face authentication device 4 is arranged slightly above the face position of the user who looks at the display device 3. Therefore, the face authentication device 4 is arranged above the display device 3.

  Incidentally, the face authentication device 4 used in the present embodiment includes an active imaging device. This imaging device is an imaging source that receives modulated light by projecting modulated light by repeating turning on and off at high frequencies (for example, 10 to 100 kHz), and reflected light that is reflected by a detection target. And a device that separates and extracts the modulated light component by removing the ambient light component from the received light component on the light receiving side. That is, the light receiving side includes only the light receiving component and the ambient light component in the lighting period (period in which the light source is lit) including the ambient light component and the modulated light component in synchronization with the modulated light. Synchronous detection is performed so that the light receiving components in the extinguishing period (period in which the light emission source is extinguished) are obtained, and only the modulated light component is extracted from the light receiving components in both periods. Note that either visible light or infrared light can be used as the modulated light.

  In order to simplify the explanation, it is assumed that the length of time between the lighting period and the extinguishing period is one-to-one, and the image sensor generates an amount of charge proportional to the amount of received light. In this case, if the amount of charge generated in the extinguishing period is subtracted from the amount of charge generated in the lighting period, the remaining charge amount is the charge amount corresponding to the modulated light component. Accordingly, if the charge at the timing synchronized with the lighting period and the extinguishing period is taken out by synchronous detection on the light receiving side, an amount of charge corresponding to the modulated light can be obtained.

  In synchronous detection, a technique for storing charges at the timing synchronized with the modulated light using the electronic shutter technology used in an image sensor such as a CCD image sensor is adopted, or each timing is synchronized with the modulated light. A technique of adjusting the light receiving sensitivity by changing the substantial light receiving area of the pixel is adopted. In the latter technique, a plurality of electrodes are provided for one pixel on the surface of a light receiving region made of a semiconductor layer, charges are accumulated in a potential well formed by applying a voltage to the electrodes, and a voltage is applied within one pixel. The substantial light receiving area is changed by changing the number of electrodes to be synchronized with the modulated light. Since these synchronous detection techniques are well known, they will not be described in detail.

  However, in the case of an active type imaging device, when a mirror surface coating is formed on the surface of the half mirror 1 on the opposite side of the display device 3, the projected light is reflected by the mirror surface and reflection occurs. Therefore, a coating on the surface facing the face authentication device 4 is desirable.

  In the above-described technique, by appropriately setting the timing of synchronous detection, it is possible to extract the modulated light component while suppressing the ambient light component, which is noise, among the received light components. An image made up of the modulated light component generated in this way is called an amplitude image. The face authentication device 4 uses an amplitude image that has been subjected to processing such as noise removal, determines a face position in the amplitude image, and then extracts feature parts of facial organs such as eyes, nose, and mouth. Personal verification is performed by checking against the template.

  For extraction of the characteristic part, a differential image of the amplitude image is generated, and a part where the differential value exceeds a prescribed threshold value (part where the edge is clear) is obtained. Since the edges of facial organs and facial contours have clear edges, these end points can be used as feature points (feature parts) by extracting the end points from the obtained contour. By collating the positional relationship of such feature points with the template, it is possible to perform personal authentication as to whether or not the template is registered. In creating a template, it is necessary to capture each person's face image in advance, extract feature points from the captured face image, and register the positional relationship of the feature points in association with each individual. Therefore, the face authentication device 4 has a registration mode for registering each person's face, and switches to the authentication mode after registration to perform personal authentication.

  A person who is registered in the face authentication device 4 is usually a family member who lives together in a house, and by registering individual householders in the face authentication device 4, it becomes possible to identify an individual in the family member. The face authentication device 4 may be always operated. However, since it is not actually necessary to always operate, the face authentication device 4 does not need to be always operated, so that a person is not present in the sensing area Es (detection of presence / absence of a person in the sensing area Es). Will be described later), and the face authentication device 4 is set in a standby state (standby state). The display device 3 is also the same, and during a period in which no person is present in the sensing area Es, the display device 3 does not display and enters a standby state (sleep state) in which the backlight is turned off.

  By the way, the structural substrate 32 to which the distance image sensor 2 is attached is provided with an opening window 36 that exposes the distance image sensor 2 in the vicinity of the upper end position of the half mirror 1, and the distance image sensor 2 passes through the opening window 36. The sensing area Es can be set in front of the.

  The distance image sensor 2 may adopt any configuration as long as it can measure the distance to the detection target in a fine and short time. In the present embodiment, the distance image sensor 2 is used for the face authentication device 4. Similar to the image pickup apparatus, a light source that emits modulated light whose intensity is modulated and an image pickup element that receives reflected light obtained by reflecting the projected modulated light by a detection target is used. The distance image sensor 2 measures a distance based on the principle of the time of flight method. Specifically, intensity-modulated light whose intensity is modulated at a high frequency of a certain frequency (for example, 10 MHz) is projected, the time of flight of the intensity-modulated light is obtained from the phase difference between the light and received light, and converted into distance.

On the light receiving side, an amount of charge corresponding to the amount of received light corresponding to a plurality of phase sections (four sections are often used although three sections are used) defined within one period of the intensity-modulated light is accumulated, and a large number of periods are collected. By accumulating the charges accumulated in the same phase interval (for example, 10,000 cycles), the distance to the detection target can be obtained by performing calculation using the amount of charge accumulated for each phase interval. For example, the phase interval of the intensity-modulated light is divided into 90 degrees, and the charge amounts in four sections of 0 to 90 degrees, 90 to 180 degrees, 180 to 270 degrees, and 270 to 360 degrees are respectively represented by A0, A1, A2, and A2. Assuming A3, the phase difference ψ can be obtained as ψ = tan ⁻¹ {(A3−A1) / (A0−A2)}.

  The distance image sensor 2 having this configuration detects the distance to the detection target existing in the sensing area Es in three dimensions. That is, the distance image is an image in which the pixel value of each pixel becomes a distance value, and as is apparent from the principle described above, the three-dimensional position of the detection target existing in the sensing area Es that is a three-dimensional space is displayed for each screen. To detect.

  Since the moving image of the distance image can be obtained by using the distance image sensor having this configuration, the distance image sensor 2 can detect the time change of the detection target. That is, if a detection target exists in the sensing area Es, a moving image of a distance image corresponding to the movement of the detection target is obtained. In this embodiment, since the presence / absence and movement of a person are detected using the distance image sensor 2, the detection target of the distance image sensor 2 will be described below as a person.

  Since the distance image sensor 2 can limit the distance range in which a person is detected in each direction in the field of view, the sensing region Es can be set to an arbitrary shape. In addition, by disposing the distance image sensor 2 at the upper end position of the half mirror 1, it becomes easy to set the sensing area Es in an arbitrary shape in front of the half mirror 1, and stands in front of the half mirror 1. By capturing human actions (gestures and poses) from above, it is easy to detect fine actions. The calibration of the sensing area Es for the distance image sensor 2 may be performed after installation at the entrance.

  A speaker 5 and a microphone 6 may be provided in the vicinity of the display device 3 (see FIG. 1). The speaker 5 is used to output sound corresponding to the display content of the display device 3, and the microphone 6 is used as a distance image. It can be used to assist the sensor 2.

  As shown in FIG. 1, the distance image sensor 2, the display device 3, and the face authentication device 4 are connected to a controller 10 having a computer. In the illustrated example, the speaker 5 and the microphone 6 are also connected to the controller 10. The place where the controller 10 is disposed is not particularly limited. However, if the controller 10 is provided in the casing of the display device 3, the controller 10 is fixed to the structural base 31 at the same time as the display device 3 is fixed to the structural base 31, so that the controller 10 is easy to install.

  The controller 10 instructs the presence / absence determination unit 11 that determines the presence / absence of a person in the sensing area Es based on the output of the distance image sensor 2 and the action of the person detected from the distance image that is the output of the distance image sensor 2. An operation determination unit 12 for conversion.

  If the distance image which is the output of the distance image sensor 2 is used, the three-dimensional measurement of the detection target existing in the sensing area Es is possible. Therefore, the presence / absence determination unit 11 estimates the size of the detection target existing in the sensing area Es. Then, it is determined whether or not the detection target existing in the sensing area Es is a person.

  On the other hand, the action of the person detected by the motion determination unit 12 may be an action of a part (for example, a hand) instead of the whole human body, and may include not only a stationary form but also a time change. Good. That is, the motion determination unit 12 converts the entire human body or part of a gesture or pose into an instruction. It is set in advance what kind of operation of which part of the human body is converted into what kind of instruction.

  In the present embodiment, it is assumed that the operation determination unit 12 determines a predetermined action so as to represent going out and returning home, and outputs whether it is going out or returning as an instruction. In an example to be described later, an instruction associated with the button (in this embodiment, going out and returning home) is given by pointing the button displayed on the display device 3 with a finger. However, such an operation is an example.For example, an operation that spreads the palm and shakes it sideways is determined as going out, and an operation that repeats bending and stretching with the fingers aligned is determined as going home. A signal may be set. That is, as long as it is an operation in the sensing area Es of the distance image sensor 2, it may be an operation using any part of the body, and if the operation is set so as to distinguish between going out and returning home. Good.

  In addition to the above-described operations when going out and going home, the operation determination unit 12 can give an instruction to perform the same operation as a pointing device such as a mouse. For example, instructions for operations such as click, press, drag and drop, and instructions for operations such as up scroll, down scroll, and display disappearance are possible.

  In particular, the entire half mirror 1 can be used as a mirror by turning off the backlight even during a period in which a person is detected in the sensing area Es by enabling an operation to turn off the display of the display device 3. Is possible. In this case, it is desirable that an operation for resuming the display of the display device 3 can be instructed.

  The controller 10 is provided with a presentation information storage unit 14 that stores information to be presented in association with going out and returning home for each individual authenticated by the face authentication device 4. The presentation information storage unit 14 stores a data set that is a triple of (person, action type, information). That is, each piece of information is associated with an individual and an action type, and information corresponding to the actions of going out and returning home can be set for each resident. “Information” that should be presented when going out includes confirmation of forgetting to turn off electricity / gas, confirmation of door shut-off, weather, train operation status, etc. There is a message to return home and a message to contact a family member. In addition, the display device 3 that presents visual information is used for presentation of information in principle, but a speaker 5 that can present auditory information may be used in combination for presentation of information.

  In order to store the data set in the presentation information storage unit 14, an interface 16 provided in the controller 10 is used. The interface 16 is an interface (such as a communication interface) that electrically connects an external device, but the distance image sensor 2 and the display device 3 can also be used as the interactive interface 16. Also, the microphone 6 is used as the interface 16 and the voice input from the microphone 6 is set as auditory information, or the voice input from the microphone 6 is converted into text data by voice recognition technology and set as visual information. Is possible.

  For inputting messages, a personal computer connected via the interface 16 is basically used. In this case, not only text data but also graphic data can be included in the message. Alternatively, the interface 16 may be provided with an infrared communication function so that a message can be registered using the mobile phone using the infrared communication function of the mobile phone. When the controller 10 is built in the display device 3 arranged on the back surface of the half mirror 1, infrared communication can be performed through the half mirror 1.

  Furthermore, when a device for monitoring the energization state of an electrical device, a device for monitoring the supply state of fuel gas to a gas device, or the like is provided, or a device for obtaining desired information from broadcasting or the Internet is provided. It is possible to obtain information from these devices through the interface 16 and automatically set the information in the presentation information storage unit 14. Further, when a home network is constructed and a home server for centrally managing home network information is provided, the information may be acquired from the home server through the interface 16 and set in the presentation information storage unit 14. .

  Information related to electricity, gas, and door closing can be automatically set in the presentation information storage unit 14 if a device for acquiring information is connected via the interface 16. If there is no device that collects information, it may simply be a message to call attention.

  The information stored in the presentation information storage unit 14 is extracted by the information selection unit 13 provided in the controller 10. The information selection unit 13 collates the individual personally authenticated by the face authentication device 4 and the action type determined by the action determination unit 12 with the data set in the presentation information storage unit 14, and data that matches the individual and the action type The set is extracted from the presentation information storage unit 14.

  The display processing unit 15 is provided in the controller 10, and the display processing unit 15 uses a command from the operation determination unit 12 and information extracted from the presentation information storage unit 14 by the information selection unit 13. 3 is determined. Further, if auditory information is registered in the presentation information storage unit 14, sound is output from the speaker 5.

  A usage example of the operation display device described above will be described below. As an initial state, a state in which no person is present in front of the half mirror 1 (that is, the sensing region Es) and the display device 3 is in a sleep state is assumed. In this initial state, since the backlight is turned off, it is recognized as a normal appearance from the front side of the half mirror 1. In the initial state, when a person stands in front of the half mirror 1 and a person is detected by the presence / absence determination unit 11 based on the output of the distance image sensor 2 as shown in FIG. 5 (S1), the display device 3 The face authentication device 4 is activated (S2). Activation here means returning from a sleep state or a standby state to a normal operation state. When the display device 3 is activated, the screen of the display device 3 becomes visible through the half mirror 1. At this time, the appearance of the screen in the mirror creates a unique luxury feeling as if the screen is floating.

  When the face authentication device 4 is activated, personal authentication is performed by the face authentication device 4, and it is determined whether or not the person is a registered householder (S3). When it is determined by the face authentication device 4 that the person is not a registered family member, another process such as alarm notification for an intruder is performed (S12). On the other hand, when it is determined that the person is a registered householder, an agent as a virtual person (an agent having a guidance function at the entrance) is displayed on the screen of the display device 3 together with a selection button for selecting whether to return home or go out. Whether the user is going home or going out can be selected by voice using the microphone 6, but in this embodiment, the selection button is selected by pointing in principle.

  When returning home is selected (S5: yes), the agent greets the family members. In this greeting, for example, an agent displayed on the screen of the display device 3 performs an operation of bowing, and a word for greeting a householder is displayed on the screen. This wording is a message such as “Please come back, Mr. **”, and not only the characters displayed on the screen but also the voice output from the speaker 5 may be used in combination.

  Furthermore, when information to be presented to a family member who has been personally authenticated by the face authentication device 4 is stored in the presentation information storage unit 14, it is indicated on the screen of the display device 3 that there is information to be presented, A button that prompts the presentation of information is displayed. For example, if the presented information is a message from the mother to the child, a message such as “There is a message from the mother. Do you want to play it?” Is displayed on the screen of the display device 3 along with the play button.

  Here, if the play button is pointed by pointing (S6), a message is output (S7). The message is usually only characters to be displayed on the screen of the display device 3, but may include sound reproduced through the speaker 5. Moreover, you may use together the moving image displayed on the screen of the display apparatus 3. FIG.

  For example, it is possible to register a moving image by a live-action photograph of a householder who wants to convey a message. In order to register a live-action moving image, a separate device connected to the interface 16 is used. However, you may comprise so that the imaging device of the face authentication apparatus 4 may serve as an apparatus which registers a moving image.

  When the message reproduction is completed, the screen returns to a screen on which only the agent is displayed. After that, when a person is no longer detected by the presence / absence detection unit 11, after a predetermined time (several seconds) elapses (S11), the screen returns to the initial state. .

  By the way, when it is verified that the person is a family member registered in the face authentication apparatus 4 in step S3, when going out is selected by a selection button for selecting going out and returning home (S4: yes), the information selecting unit 13 Then, information corresponding to the family member whose personal authentication has been performed by the face authentication device 4 is extracted from the presentation information storage unit 14 and displayed on the display device 3 through the display processing unit 15 (S8). Information displayed on the display device 3 includes traffic information of a commuting route, a weather forecast, and the like. In addition, when information such as confirmation of forgetting to turn off electricity or gas or confirmation of door shut is collected, such information is also displayed on the display device 3. When the amount of information to be presented is large, it is displayed by dividing it into a plurality of screens or by scrolling the screen.

  Here, if the air conditioner is forgotten to be turned off, a stop button for stopping the air conditioner is displayed on the screen of the display device 3. When the stop button is pointed by pointing (S9: yes), the air conditioner can be stopped (S10). When the operation for stopping the device is performed as described above, the result of the operation is displayed on the display device 3. In addition, the screen of the display device 3 also displays the result of the confirmation of door closing.

  In Steps S3 and S4, when it is determined that the user is neither going out nor going home, the display device 3 is returned to the initial state in which the display device 3 is set to the sleep state and the face authentication device 4 is set to the standby state. Wait until In the above-described example, after the personal authentication by the face authentication device 4, the distinction between returning home and going out is selected. However, the personal authentication may be performed after selecting the returning home and going out. .

  Further, in the present embodiment, a liquid crystal display device with a backlight is exemplified as the display device 3. However, in the case of a self-luminous type, a flat panel using an organic EL or a field emission type solid electron beam source in addition to a plasma display. A display can also be used. Even a display device other than a flat panel display can be used as long as an installation space can be secured.

  Moreover, as above-mentioned, when not using as a mirror, the half mirror 1 can be abbreviate | omitted, For example, it may replace with the half mirror 1 and may use the synthetic resin transparent board like an acryl. Alternatively, the distance image sensor 2, the display device 3, and the face authentication device 4 may be housed in a case and integrated.

DESCRIPTION OF SYMBOLS 1 Half mirror 2 Distance image sensor 3 Display apparatus 4 Face authentication apparatus 5 Speaker 6 Microphone 10 Controller 11 Presence / absence determination part 12 Operation | movement determination part 13 Information selection part 14 Presentation information memory | storage part 15 Display process part 16 Interface 31 Structure base 32 Structure base Es Sensing area

Claims (7)

A face authentication device that includes a display device that displays an image, an image pickup device that picks up a person's face that exists in front of the display device, and that performs personal authentication using a captured image, and sensing that is defined in front of the display device A distance image sensor that generates a distance image of a person existing in the region, a presentation information storage unit that stores information to be presented for each individual that is personally authenticated by the face authentication device, and an action of a person extracted from the distance image An operation determining unit that converts to an instruction, an information selecting unit that extracts information corresponding to a person who has been personally authenticated by the face authentication device from the presentation information storage unit in response to an instruction from the operation determining unit, and an information selecting unit a display processing unit for displaying the information on a display device, and a presence determining unit for detecting a human presence in the sensing region based on the distance image, display apparatus and face authentication device existence judgment unit Converting starts when a person is detected by the range image, the gesture of a person starts the face authentication device was personal authentication operation determination unit is extracted from the range image, and the instructions to the information selection unit An operation display device characterized by the above.   The operation display device according to claim 1, wherein the distance image sensor is disposed above the display device. The operation determination unit outputs an operation instruction for an image displayed on the display device, and the display processing unit operates the image displayed on the display device according to an instruction from the operation determination unit. The operation display device according to claim 1 or 2. The operation display device according to claim 1 , wherein the operation determination unit can output an instruction to turn off the display of the display device. The operation display device according to claim 1, further comprising an interface for storing information in the presentation information storage unit . The display device, the face authentication device, and the distance image sensor are arranged at the entrance, and the presentation information storage unit presents each person who is personally authenticated by the face authentication device when going out and returning home. Information is stored, and the information selection unit extracts information from the presentation information storage unit based on a result of personal authentication by the face authentication device and an instruction to go out or return by the operation determination unit. The operation display device according to claim 1, wherein the operation display device is a display device. A half mirror held on a structural substrate, the display device is disposed on a back side of the half mirror and displays an image through a part of the half mirror, and the face authentication device is provided for a person existing in front of the half mirror. operation display equipment as claimed in any one of claims 1 to 6, characterized in that arranged on the rear side of the half mirror to image the face.

Images