JP6336816B2 - refrigerator - Google Patents

Description

  Embodiments of the present invention relate to a refrigerator.

  Conventionally, for example, as in Patent Document 1, a refrigerator including a camera that captures an image of the inside of a cabinet has been proposed. When such a camera is used, it is possible to check the inside of the warehouse and to improve convenience.

JP 2002-267337 A

However, detection of specific information about a person such as a facial expression has not been performed. That is, conventionally, only the user himself / herself makes a determination based on the captured image, and no convenience is provided to the user from the refrigerator side.
Therefore, a refrigerator capable of providing convenience to the user by detecting specific information about a person and performing control according to the specific information is provided.

  The refrigerator of the embodiment includes a camera, and when specific information regarding a person included in an image captured by the camera is detected, control according to the specific information is performed.

Longitudinal sectional view schematically showing the configuration of the refrigerator of the first embodiment The figure which shows typically the flow of the process performed in the refrigerator of 1st Embodiment. It is a figure which shows typically the relationship between the refrigerator and a person in 1st Embodiment, (A) is a figure which shows the position of a hand typically, (B) is a figure which shows the shape of a hand typically The figure which shows typically the flow of the process performed in the refrigerator of 2nd Embodiment. It is a figure which shows the setting registered into the refrigerator of 2nd Embodiment, (A) is a figure which shows a corresponding relationship with an authentication result and use frequency, an article | item, display content, and advice, (B) is an authentication result, The figure which shows the correspondence with the lock release condition and the display contents The figure which shows typically the structure of the household appliance network to which the refrigerator of 3rd Embodiment is applied. The figure which shows typically the flow of the process performed in the refrigerator of 3rd Embodiment.

Hereinafter, a plurality of embodiments will be described with reference to the drawings. In addition, the same code | symbol is attached | subjected to the site | part substantially common in several embodiment, The detailed description is abbreviate | omitted.
(First embodiment)
Hereinafter, a first embodiment will be described with reference to FIGS. 1 to 3.

  As shown in FIG. 1, the refrigerator 1 according to the embodiment has a refrigeration room 3 and a vegetable room 4 in a refrigeration temperature zone, which is a storage for storing foods, and a refrigeration temperature zone. An ice making room 5 and a freezing room 6 are provided. The vegetable room 4 and the ice making room 5 are partitioned by a heat insulating partition wall. As shown in FIG. 1, the refrigerator compartment 3 is opened and closed by a door 3a, and the vegetable compartment 4, the ice making compartment 5 and the freezer compartment 6 are opened and closed by a pull-out door 4a, door 5a and door 6a, respectively. In addition, although illustration is abbreviate | omitted, in the refrigerator 1, the upper freezer compartment is arrange | positioned so that the ice making room 5 may be adjoined. The configuration of these storages is an example, and the arrangement order of the storages may be different.

  The refrigerator 1 is provided with a lock mechanism for locking the door. Specifically, the door 3a is provided with a lock mechanism 3b, the door 4a is provided with a lock mechanism 4b, the door 5a is provided with a lock mechanism 5b, and the door 6a is provided with a lock mechanism. 6b is provided. In addition, the refrigerator 1 is provided with an opening sensor that detects opening of the door. Specifically, the door 3a is provided with an opening sensor 3c, the door 4a is provided with an opening sensor 4c, the door 5a is provided with an opening sensor 5c, and the door 6a is provided with an opening sensor 4c. Is provided with an opening sensor 6c.

  In addition, an internal information acquisition unit 3d that acquires information in the refrigerator compartment 3 is provided inside the door 3a. In this embodiment, the internal information acquisition unit 3d includes an internal camera for imaging the internal space, and a food temperature sensor that detects the temperature of the stored food. The image and the temperature of the food are acquired as in-compartment information. Moreover, the inside information acquisition part 4d and the inside information acquisition part 6d are each provided also in the store | warehouse inside of the door 4a and the door 6a, and the store room information of the vegetable compartment 4 and the freezer compartment 6 is acquired. These internal information acquisition units 3d, 4d, and 6d constitute internal information acquisition means. In addition, you may provide a locking means, a door opening sensor, and the chamber | room information acquisition part also in an upper freezer compartment.

The refrigerator 1 has a refrigeration cycle controlled by a control circuit 7 provided in the main body 2. The control circuit 7 performs control for unlocking the lock means described above, control for detecting the open state of the door by the door opening sensor, and control for acquiring the internal information by the internal information acquisition unit. The control circuit 7 also has a timer function for acquiring the current time.
On the front side of the door 3a of the refrigerator 1, a display unit 10 that displays an image, a message, and the like to visually notify the user, and a speaker 11 that outputs a sound and audibly notifies the user are provided. It has been. The display unit 10 and the speaker 11 constitute notification means.

  In addition, an operation panel 24 (see FIG. 6), an illuminance sensor 12, a human sensor 13, and an ambient temperature sensor 14 that perform operations on the refrigerator 1 are provided on the front side of the refrigerator 1. The illuminance sensor 12 detects the illuminance outside the warehouse. The human sensor 13 is configured by an infrared sensor or the like, for example, and detects a person existing around the refrigerator 1. The ambient temperature sensor 14 detects the temperature outside the warehouse. These illuminance sensor 12, human sensor 13 and ambient temperature sensor 14 constitute outside information acquisition means.

  The illuminance sensor 12, the human sensor 13, and the ambient temperature sensor 14 constitute a human detection unit that detects a person in the vicinity of the refrigerator 1 in connection with the present embodiment. The human sensor 13 can directly detect a person. In the case of the illuminance sensor 12, when the illuminance detected in a dark time zone such as nighttime exceeds a predetermined reference value, it can be determined that the lighting device has been turned on, and thus a person is in the vicinity of the refrigerator 1. This can be detected indirectly. If it is a temperature sensor, when the room temperature exceeds a predetermined reference value, for example, it can be determined that heating is being performed, and thus indirectly detecting that a person is in the vicinity of the refrigerator 1. Can do.

  A camera 15 is provided on the front side of the door 3a. The camera 15 mainly captures an image on the front side of the refrigerator 1. The power source of the camera 15 is linked to the refrigerator 1, and the camera 15 is also energized when the refrigerator 1 is energized. However, the camera 15 basically stands by in a power saving state, and shifts to an operating state when it is detected that a person is present near the refrigerator 1 as will be described later.

  When the camera 15 shifts to the operation state, the camera 15 automatically captures images and detects specific information (hereinafter also referred to as human information) related to the person included in the captured image. That is, in the present embodiment, the specific information is detected by the camera 15. Then, the specific information detected by the camera 15 is transmitted to the control circuit 7, and the control circuit 7 that has received the specific information performs control according to the specific information as will be described later. This camera 15 functions as human information detection means for detecting human information.

Here, the difference between the detection of the person by the illuminance sensor 12, the human sensor 13 and the ambient temperature sensor 14 as the human detection means and the detection of the specific information about the person performed by the camera 15 as the human information detection means will be described. To do.
As described above, the human detection means detects a person existing around the refrigerator 1, and not only when the refrigerator 1 is used, but also there is a person in a kitchen or the like where the refrigerator 1 is installed. It also detects that. In this embodiment, the camera 15 is normally in a power saving state, and when a person is detected by the human detection means, the camera 15 is shifted to an operation state in which an imaging operation can be performed. That is, the person detecting means detects the presence of a person that causes the operation of the camera 15 to start.

  On the other hand, the camera 15 as the human information detecting means picks up a person and detects various kinds of information related to the person shown in the image. Specifically, the camera 15 is based on the captured image, information on whether or not a person is present, information on the hand of the person such as the position of the hand, the orientation of the finger, or whether the palm is visible, facial expression and line of sight. For example, information relating to a person's face is detected as specific information. The camera 15 also performs personal authentication based on the information of the person's face. Note that the camera 15 can be used as a human detection means if information on whether or not a person exists is used. However, in this embodiment, a human detection means is provided separately from the camera 15 in order to save power. ing.

Next, the operation of the refrigerator 1 described above will be described.
When the human detection unit detects that a person is present around the refrigerator 1, the refrigerator 1 shifts the camera 15 to the operating state and executes the process illustrated in FIG. 2. The refrigerator 1 determines whether or not a person has been detected by the camera 15 (S1). In this step S <b> 1, the camera 1 detects that the information indicating that a person exists in the refrigerator 1, more specifically, the information that a person exists near the front of the refrigerator 1. This is because when there is a person near the front of the refrigerator 1, it can be determined that the person is likely to use the refrigerator 1. The processing in step S1 corresponds to the above-described detection of human information.
The refrigerator 1 complete | finishes a process, when not detecting the person (S1: NO). That is, when no person is detected, the door is not unlocked in step S6 described later.

  On the other hand, the refrigerator 1 starts the display of the display part 10 (S2), when a person is detected (S1: YES). That is, in the case of the refrigerator 1, the camera 15 and the display unit 10 operate in conjunction with each other. At this time, the display of the display unit 10 is started after the person is detected in order to keep the display unit 10 in a power saving state and to suppress power consumption. Note that, as described above, since the camera 15 automatically captures an image when it shifts to the operating state, step S2 and step S3 described later are actually performed substantially simultaneously.

  When the refrigerator 1 captures a person with the camera 15 (S3), the refrigerator 1 notifies a message according to the current time (S4). More specifically, the refrigerator 1 displays a message on the display unit 10 and outputs a sound from the speaker 11. Here, the message to be notified is a message such as “Good morning” if the current time is in the morning, and a message such as “Good evening” if the current time is night. That is, the refrigerator 1 is personified. Note that the message display may be performed before or after the following steps S5 and S6, or may be performed simultaneously. The processing in step S4 corresponds to control according to the specific information.

  And the refrigerator 1 detects the information regarding a human hand and the position of a hand based on the image imaged with the camera 15 (S5). In the refrigerator 1, the relationship between the position of the hand received from the camera 15 and the height of the storage of the refrigerator 1 is set in advance. Specifically, in the refrigerator 1, regions R <b> 1 to R <b> 4 are set according to the positions of the doors of the storage rooms as shown in FIG. 3A, and the person M <b> 1 ( It is detected in which region the user's hand M2 is located.

  When the position of the hand M2 is detected, the refrigerator 1 unlocks the corresponding door. For example, when hand M2 is located in area | region R1, it is assumed that the person M1 is going to open the door 3a of the refrigerator compartment 3. FIG. Therefore, when the hand M2 is located in the region R1, the refrigerator 1 releases the lock mechanism 3b of the door 3a so that the door 3a can be opened. Similarly, the refrigerator 1 releases the lock mechanism 4b of the door 4a when the hand M2 is located in the region R2, and the lock mechanism of the door 5a when the hand M2 is located in the region R3. When 5b is released and the hand M2 is located in the region R4, the lock mechanism 6b of the door 6a is released. The processing in step S6 corresponds to control according to the specific information.

  At this time, depending on the configuration of the refrigerator 1, for example, the handle of the refrigerator compartment 3 may be provided at the lower part of the door 3a, and the handle of the vegetable room 4 may be provided at the upper part of the door 4a. Therefore, for example, when the hand M2 is detected on the lower end side of the region R1, both the door 3a and the door 4a may be unlocked. Moreover, it is good also as a structure which makes the lower end side and upper end side of each area | region overlap.

Further, when the person M1 is about to open the door 6a of the freezer compartment 6, depending on the mounting position of the camera 15, the size of the viewing angle, etc., it is determined whether the hand M2 is located in the region R3 or the region R4. There is a possibility that it cannot be detected accurately. Therefore, it is configured to detect the shape of the hand M2, and as shown in FIG. 3B, for example, if a finger M3 (for example, a thumb) extends upward with respect to the hand M2, the door 3a of the refrigerator compartment 3 is locked. If the finger M3 extends downward, the door 6a of the freezer compartment 6 may be unlocked.
Thus, the refrigerator 1 detects specific information with the camera 15, and performs control according to the specific information.

According to the embodiment described above, the following effects can be obtained.
When the refrigerator 1 has a camera 15 and detects specific information about a person included in an image captured by the camera 15, the refrigerator 1 performs control according to the specific information. That is, the refrigerator 1 performs control according to the user who uses the refrigerator 1. Thereby, convenience can be provided to the user.

The refrigerator 1 detects with the camera 15 whether or not specific information is included in the captured image. In other words, the camera 15 itself has a function of detecting specific information. For this reason, it is possible to detect human information without greatly changing the control circuit 7 of the refrigerator 1 and while avoiding a situation in which the processing load of the control circuit 7 is significantly increased.
The refrigerator 1 includes a lock that locks the door of the storage chamber, detects a person located on the front side of the refrigerator 1 as specific information, and performs control not to unlock the door when no person is detected. Thereby, a possibility that the door of the refrigerator 1 may be opened unnecessarily can be reduced.

Moreover, the refrigerator 1 performs control which cancels | releases the lock | rock of the door according to the detected position of the person's hand. Thereby, the door which a user desires can be made openable, suppressing the opening and closing of an unnecessary door.
In the refrigerator 1, when a person is detected by the person detection means, the camera 15 is in an operating state. In other words, the camera 15 stands by in the power saving mode when no person is detected by the person detecting means. As a result, power saving can be achieved, and the activation time can be ensured by being in an operating state when a person is detected by the person detecting means, so that the person comes to the front of the refrigerator 1, that is, the front of the camera 15. It is possible to pick up images quickly.
The refrigerator 1 includes a display unit 10 as notification means, and performs notification according to specific information. In the case of the present embodiment, a greeting according to the time is displayed and output. Thereby, the refrigerator 1 can be personified.
The refrigerator 1 detects a human hand as specific information. When the user uses the refrigerator 1, it is assumed that the door is opened by hand. Therefore, control according to a user's wish can be performed by detecting a human hand as specific information.

Further, when the palm is detected as the specific information and the palm is detected, that is, when the user is showing the palm to the refrigerator 1, notification according to the time may be performed. For example, when the user explicitly turns the palm toward the refrigerator 1 side, it is considered that the user is greeting the refrigerator 1. Therefore, the refrigerator 1 can be anthropomorphic by notifying the greeting from the refrigerator 1 side when the palm is detected. In order to distinguish from the above-described unlocking, for example, a greeting may be given when a palm is detected in the vicinity of a human face.
Moreover, although the structure which provided the one camera 15 in this embodiment was illustrated, it is good also as a structure which provides the camera 15 in each door, respectively, or provides the camera 15 in the door 3a and the door 4a. As a result, for example, even a small child can take an image from the front and the like, and a finer response can be performed.

(Second Embodiment)
Hereinafter, the second embodiment will be described with reference to FIGS. 4 and 5. In the second embodiment, the type of specific information is different from that in the first embodiment. In addition, since the structure of the refrigerator 1 is common in 1st Embodiment, it demonstrates, also referring FIG.
The refrigerator 1 of 2nd Embodiment detects a person's face as specific information. In addition, you may perform simultaneously the detection of the human face of this embodiment, and the detection of the human hand shown in 1st Embodiment.
When the human detection unit detects that a person is present around the refrigerator 1, the refrigerator 1 shifts the camera 15 to the operating state and executes the process shown in FIG. 4. When the refrigerator 1 detects a person with the camera 15 (S11), the refrigerator 1 starts displaying on the display unit 10 (S12). Subsequently, the refrigerator 1 captures an image of a person (S13) and determines whether or not face authentication has been performed (S14). At this time, authentication data is registered in the refrigerator 1 in advance.

  The refrigerator 1 complete | finishes a process, when face authentication cannot be performed (S14: NO). Note that since the face authentication itself is performed by the camera 15 as described above, in step S14, the control circuit 7 of the refrigerator 1 determines whether or not the authentication result indicating that the authentication has been received is received from the camera 15. It will be. Further, in step S14, determination is made by including a state in which a face cannot be detected, that is, a state in which a face cannot be imaged, even if face authentication cannot be performed.

  On the other hand, if the face authentication is successful (S14: YES), that is, if the authentication result is received from the camera 15, the refrigerator 1 acquires in-chamber information (S15). At this time, the refrigerator 1 acquires in-compartment information based on the setting shown in FIG. In FIG. 5A, the authenticated person and the past usage status of the person are stored in association with each other. Therefore, if the authentication result in step S14 is "father", the refrigerator 1 will be the door 3a of the refrigerator compartment 3 in view of the past use condition, and if it takes out, goods will be beer. As expected, the temperature of beer acquired by the in-chamber information acquisition unit 3d as the content to be displayed on the display unit 10 (beer chilling condition) and “Let's be careful about drinking too much” are set as advice to be displayed.

  In addition, when the authentication result is “mother”, in view of the past usage situation, the door with high usage frequency is the door 4a of the vegetable room 4, and when taken out, the product is expected to be vegetable, As the contents to be displayed on the display unit 10, the type of vegetables, that is, the image inside the vegetable room 4 acquired by the in-chamber information acquisition unit 3d, and “let's take green and yellow vegetables” are set as advice to be displayed together. If the authentication result is “children”, in view of past usage conditions, the door with high usage frequency is the door 6a of the freezer compartment 6 and when removed, the item is ice cream (in FIG. As the advice to be displayed together with the type of ice cream, that is, the image inside the freezer compartment 6 acquired by the internal information acquisition unit 6d as the content displayed on the display unit 10 Do not eat too much ".

Then, the refrigerator 1 alert | reports the message according to the authenticated person (S16). Specifically, if the authenticated person is a father, the temperature of beer and advice such as “Let's be careful about drinking too much” are displayed as described above. Then, the refrigerator 1 unlocks the corresponding door (S17).
In addition, although not shown in FIG. 5, the refrigerator 1 memorize | stores an actual utilization condition. For example, when the door 3a of the refrigerator compartment 3 is unlocked with respect to the father as described above, the door opening sensor 3c detects whether the door 3a is actually opened or closed. Moreover, it is detected by the opening sensor 4c-6c etc. whether the other door was opened. Then, by storing the authentication result of “Father” and the door that is actually opened and closed in association with each other, the frequently used door is learned.
Thus, the refrigerator 1 detects a human face as specific information by the camera 15 and performs control according to the specific information.

According to the embodiment described above, the following effects can be obtained.
The refrigerator 1 detects a human face as specific information. If the users who use the refrigerator 1 are different, the usage situation is also expected to be different. Therefore, by detecting a human face and performing control according to the detected face, it is possible to deal with each individual user, and more convenient control can be performed for the user.

  When the refrigerator 1 authenticates the person based on the specific information, the refrigerator 1 performs notification according to the authenticated person. The refrigerator 1 notifies the situation of the storage room which a user often uses, for example, or presents advice. Thereby, the refrigerator 1 can be personified more.

And the refrigerator 1 performs control which collects the use condition of this refrigerator of the authenticated person. As a result, it is possible to learn a door with a high cost frequency, and to perform a more detailed response.
The refrigerator 1 includes a storage information acquisition unit that acquires information in the storage, and performs control to display the status of the storage that is frequently used by the authenticated person on the display unit 10. Thereby, even if it does not open a door, the state in a store | warehouse | chamber can be grasped | ascertained, the temperature in a store | warehouse | chamber can be prevented from rising excessively and it can contribute to power saving.

The refrigerator 1 includes control even when no human face is detected, and performs control not to unlock the door when face authentication cannot be performed. Thereby, unnecessary opening and closing of the door can be restricted.
As control according to specific information, when a human face is detected, control according to the time may be performed. For example, as shown in the first embodiment, in the morning, a message such as “Good morning” may be output by display or voice.

  As control according to specific information, you may perform control which judges whether the lock | rock of a door is cancelled | released according to the authenticated person. Further, it may be determined whether to release the lock according to the time. For example, as shown in FIG. 5B, an authenticated person is stored in association with a condition for not releasing the lock (non-release condition). For example, if it is “father”, authentication is performed after 23:00. If this happens (that is, if the refrigerator 1 is to be used), the lock may not be released, and advice such as “Let's be careful about metabolism” may be displayed. Alternatively, for a “child”, for example, advice such as “Don't eat before meals” may be displayed so that ice cream is not eaten before dinner, such as from 16:00 to 18:00. Of course, it can also be used as a so-called child lock function. Thus, the utility value of the refrigerator 1 can be improved, for example, attention to health can be recommended.

  As control according to specific information, you may perform control which changes the time after calling a door to close after opening a door according to the authenticated person. For example, if the authenticated person is a “child”, it may be forgotten to close it, so the time for calling attention may be shorter than usual. Or, if the certified person is a “mother”, it may be under consideration for a menu or put in bulk ingredients, so even if the time to call attention is longer than usual Good. As a result, it is possible to suppress unnecessary caution and to cope with forgetting to close the door.

  As control according to specific information, you may perform control which proposes the position of the shelf according to the position of the face of the authenticated person. If the position of a person's face can be detected, the approximate height can be grasped. And since the refrigerator 1 has the shelf 8a-8d from which height differs in the refrigerator compartment 3 as shown in FIG. 1, by suggesting the shelf which is easy to use according to the height of the authenticated person The convenience of the refrigerator 1 can be improved.

  As a control according to the specific information, when a human face is detected, the operation panel 24 (see FIG. 6) of the refrigerator 1 may be controlled to be operable. Saying that a person's face has been detected is a state in which the person is almost directly facing the refrigerator 1, and is considered likely to be used with the refrigerator 1. Therefore, it is possible to save power when the refrigerator 1 is not used by turning on the operation panel when a human face is detected, and to save power when the refrigerator 1 is used. There is no waiting.

Similarly, as control according to the specific information, when detecting a human face, control may be performed such that notification means such as the display unit 10 and the speaker 11 are operable. In this case as well, power saving when the refrigerator 1 is not used can be achieved.
As specific information, when a person's face is detected, the person's eyes may be detected together. And you may perform control which cancels | releases the lock | rock of the door according to the position which a person's eyes | visual_axis shows as control according to specific information.
Moreover, you may perform control which raises the illumination intensity of the position which a person's eyes show as control according to specific information. For example, when the line of sight faces downward of the refrigerator compartment 3, it is possible to make it easier to see the interior by increasing the illuminance on the lower side.

(Third embodiment)
Hereinafter, the third embodiment will be described with reference to FIGS. 6 and 7. In 3rd Embodiment, the kind of specific information differs from 1st Embodiment. In addition, since the structure of the refrigerator 1 is common in 1st Embodiment, it demonstrates, also referring FIG.
The refrigerator 1 of 3rd Embodiment detects a human facial expression as specific information. The human facial expression may be performed in conjunction with the detection of the human face exemplified in the second embodiment, or may be performed simultaneously with the detection of the human hand shown in the first embodiment.

  As shown in FIG. 5, the refrigerator 1 of the present embodiment is connected to a network 21 such as the Internet via an access point 20. A server 22 and a mobile terminal 23 owned by the user are also connected to the network 21. The mobile terminal 23 is not limited to the one owned by the user of the refrigerator 1 but may be owned by the user's family. The network 21 may be connected to another refrigerator installed in a grandparent's house that lives in a remote place, for example.

  When the human detection unit detects that a person is present around the refrigerator 1, the refrigerator 1 shifts the camera 15 to the operating state and executes the process illustrated in FIG. 7. When the refrigerator 1 detects a person with the camera 15 (S21), the refrigerator 1 starts displaying on the display unit 10 (S22). Subsequently, the refrigerator 1 captures an image of a person (S23) and recognizes an expression (S24). Recognition of this facial expression is also performed by the camera 15. At this time, the camera 15 detects (recognizes) a human facial expression including emotions such as bright and dark facial expressions.

  Subsequently, the refrigerator 1 transmits information related to the facial expression to the server 22 and acquires data corresponding to the facial expression from the server 22 (S25). At this time, in the server 22, a message corresponding to the facial expression is set as data in association with the time. Specifically, for example, a sentence such as “Let's go with a smile” is set as data if the expression is dark and the time is morning. Alternatively, the server 22 is set with data such as “Relax and rest” if the time is night with a tired expression. The data to be set may be, for example, an image or music that raises the mood, an image or music that relaxes, or the like.

When the refrigerator 1 receives data from the server 22, the refrigerator 1 notifies a message corresponding to the data and time (S26). At this time, the refrigerator 1 displays and outputs a text such as “Let's go with a smile” on the display unit 10, and outputs a voice such as “Come to me” from the speaker 11.
Thus, the refrigerator 1 detects a human facial expression as specific information, and performs control according to the specific information.

According to the embodiment described above, the following effects can be obtained.
The refrigerator 1 detects a human facial expression as specific information and performs control according to the facial expression. Thereby, the above role can be given to the refrigerator 1 as a mere storage.
The refrigerator 1 can improve the user's mood by, for example, notifying a message for brightening a dark expression. That is, the refrigerator 1 can be anthropomorphic and can function as simple artificial intelligence.

  As control according to specific information, you may perform control which displays on the display part 10 the facial expression of the person who authenticated based on the said specific information. Specifically, for example, the family can grasp the state of the child by displaying, for example, a facial expression in which the child is happy or a depressed facial expression on the display unit 10. At this time, in combination with the face authentication exemplified in the second embodiment, if the child's dark expression is displayed to the parents, if the father's tired expression, the child is not shown to the mother. It is also possible to display only. By these, the opportunity which thinks of a family in the refrigerator 1 can be provided. Of course, the same applies to facial expressions of grandparents in remote places.

(Other embodiments)
The present invention is not limited to the one exemplified in the above-described embodiment, and can be arbitrarily modified or expanded as follows, for example, without departing from the scope thereof.
The messages and the like shown in each embodiment are examples and are not limited thereto.
You may combine the structure of each embodiment. For example, the first embodiment and the second embodiment may be combined to determine that the refrigerator 1 is going to be used when both a human face and a hand are detected, and the lock may be released.

An image captured by the camera 15 may be displayed on the display unit 10. At that time, as exemplified in the third embodiment, the data corresponding to the facial expression may be acquired from the server 22, and the data may be displayed together.
For example, an image captured by the refrigerator 1 may be transmitted to a refrigerator in a grandparent's house. Further, for example, the refrigerator 1 may have a function of a message board for transmitting a message from the mother to the child.
The server 22 may store an e-mail or the like transmitted from the mobile terminal 23 or the like, and display the corresponding e-mail or the like when face authentication is performed in the second embodiment.

Images captured when a person is detected in each embodiment or when face authentication cannot be performed in the second embodiment may be stored. Thereby, the function of a security camera can be given to the refrigerator 1.
Instead of locking and unlocking the door by the lock mechanism, a door opening means that automatically opens the door by pushing the bar provided on the refrigerator housing by driving the solenoid when specific information is detected May be provided. And as control according to specific information, you may perform control which opens a door automatically.

  Each embodiment is presented as an example and is not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. This embodiment and its modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  In the drawings, 1 is a refrigerator, 3a to 6a are doors, 3b to 6b are lock mechanisms, 3c to 6c are door opening sensors, 3d to 6d are internal information acquisition units (internal information acquisition means), and 8a to 8d are shelves. Reference numeral 10 denotes a display unit (informing means), 11 denotes a speaker (informing means), 15 denotes a camera, 24 denotes an operation panel, M1 denotes a person, M2 denotes a human hand, and M3 denotes a finger.

Claims (21)

Has a camera, upon detection of specific information about the person included in the image captured by the camera, have row control in accordance with the specific information,
As the specific information, a human face is detected,
As a control according to the specific information, a control is performed to change a time from when the door is opened until a warning is issued according to a person who is authenticated based on the specific information . When having specific information about a person included in an image captured by the camera, and performing control according to the specific information,
As the specific information, a human face is detected,
The refrigerator which performs control which suggests the position of the shelf according to the position of the face of the person who authenticated based on the specific information as control according to the specific information. When having specific information about a person included in an image captured by the camera, and performing control according to the specific information,
As the specific information, a human eye is detected,
It has a lock mechanism that locks the door of the storage room,
As the control according to the specific information, a control is performed to release the lock of the door according to the position indicated by the eye of the person detected based on the specific information. When having specific information about a person included in an image captured by the camera, and performing control according to the specific information,
As the specific information, a human eye is detected,
The refrigerator characterized by performing control which raises the illumination intensity of the position which the person's eye line detected based on the specific information shows as control according to the specific information. The refrigerator according to any one of claims 1 to 4, wherein the camera itself detects whether or not the specific information is included in a captured image. It has a lock mechanism that locks the door of the storage room,
As the specific information, a person located on the front side of the refrigerator is detected,
The refrigerator according to any one of claims 1 to 5, wherein as control according to the specific information, control is performed so that the door is not unlocked when a person is not detected. Providing a notification means,
The refrigerator according to any one of claims 1 to 6, wherein a control according to the specific information is performed as the control according to the specific information. The refrigerator according to claim 1, wherein a human hand is detected as the specific information. It has a lock mechanism that locks the door of the storage room,
The refrigerator according to claim 8, wherein the control according to the specific information includes a control for releasing the lock of the door according to the position of a human hand detected based on the specific information. Providing a notification means,
10. The refrigerator according to claim 8, wherein when the palm of a person is detected based on the specific information, control according to the time is performed as the control according to the specific information. Providing a notification means,
As the specific information, a human face is detected,
The control according to any one of claims 1 to 10, wherein when the person is authenticated based on the specific information, control according to the specific information is performed as the control according to the specific information. refrigerator. Providing a notification means,
As the specific information, a human face is detected,
The refrigerator according to any one of claims 1 to 11, wherein, as the control according to the specific information, when a human face is detected, control according to the time is performed. As the specific information, a human face is detected,
The control according to any one of claims 1 to 12, wherein when the person is authenticated based on the specific information, the control according to the specific information is performed to collect the usage status of the refrigerator of the authenticated person. The refrigerator according to the item. A display unit;
An internal information acquisition means for acquiring information in the storage,
As the specific information, a human face is detected,
The refrigerator according to any one of claims 1 to 13, wherein as the control according to the specific information, control is performed to display on the display unit the status of a storage that is frequently used by an authenticated person. It has a lock mechanism that locks the door of the storage room,
As the specific information, a human face is detected,
The refrigerator according to any one of claims 1 to 14, wherein as control according to the specific information, control is performed so as not to unlock the door when a human face is not detected. It has a lock mechanism that locks the door of the storage room,
As the specific information, a human face is detected,
The control according to any one of claims 1 to 15, wherein as the control according to the specific information, control is performed to determine whether or not to unlock the door according to a person who is authenticated based on the specific information. The refrigerator according to the item. As the specific information, a human face is detected,
The control according to any one of claims 1 to 16, wherein as control according to the specific information, control is performed so that an operation panel of the refrigerator is operable when a human face is detected based on the specific information. The refrigerator according to one item. Providing a notification means,
As the specific information, a human face is detected,
The refrigerator according to any one of claims 1 to 17, wherein as the control according to the specific information, control is performed so that the notification means is operable when a human face is detected. The refrigerator according to claim 1, wherein a facial expression of a person is detected as the specific information. Providing a notification means,
The refrigerator according to claim 19, wherein as the control according to the specific information, control is performed to notify a message according to a facial expression detected based on the specific information. With a display,
21. The refrigerator according to claim 19 or 20, wherein as the control according to the specific information, control is performed to display a human facial expression detected based on the specific information on the display unit.

Images