JP2019070477A - refrigerator - Google Patents

Abstract

To provide a refrigerator capable of acquiring and managing information of food stored in a storage chamber more surely, by eliminating a constitution for preventing fogging of a lens.SOLUTION: A refrigerator 1 includes: a refrigeration chamber 10 having an opening 10a; a right door and a left door 12 for opening/closing the refrigeration chamber 10; a camera 60 arranged in a position which is outside of the refrigeration chamber 10 and in which the opening 10a is included in an imaging range 60a when the right door or the left door 12 is in an open state; a food information acquisition part for acquiring information of food passing the opening 10a from the photographed image by the camera 60; and a food information managing part for managing the information of food stored in the refrigeration chamber 10 storage chamber based on the food information acquired by the food information acquisition part.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a refrigerator.

  Conventionally, a refrigerator has been proposed in which the refrigerator compartment is imaged by a camera provided inside the right door of the refrigerator compartment, and data of the imaged image is transmitted via the network to an external communication terminal (for example, , Patent Document 1). In the refrigerator described in Patent Document 1, a configuration is disclosed in which a lens heater is provided in order to prevent fogging of the lens that occurs when the door of the refrigerator compartment is opened.

JP, 2015-111025, A

As in the configuration described in Patent Document 1, when the refrigerator compartment is imaged by a camera provided inside the door, depending on the storage condition of the food, a plurality of food products overlap in the imaging direction of the camera. Department of food may not be imaged. In this case, it is not possible to obtain information on food that has not been imaged. Further, providing the lens heater in the camera disposed in the storage increases the installation space around the camera and increases the cost, and also has the disadvantage that the cooling of the inside of the storage is hindered by the heat radiation from the lens heater.
The present invention has been made in view of the above background, and it is possible to more reliably acquire and manage information on food stored in a storage room without requiring a configuration for preventing fogging of a camera lens. Intended to provide a refrigerator.

  In order to solve the above-mentioned conventional problems, in the refrigerator according to the present invention, a storage chamber having an opening, an opening and closing portion for opening and closing the opening, and an outside of the storage chamber, the opening and closing portion being open A food information acquisition unit that acquires information of food passing through the opening from the camera when the opening is located at a position where the opening is included in the imaging range, an image captured by the camera, and the food information acquisition unit And a food information management unit that manages information of the food contained in the storage room based on the information of the food obtained by the method.

  According to the present invention, since the camera is disposed outside the storage chamber, air in the room flowing into the storage chamber does not cloud the lens of the camera when the open / close unit is switched from the closed state to the open state. Therefore, the configuration for preventing the fogging of the lens can be eliminated. In addition, when the opening / closing unit is in the open state, the opening of the storage chamber is included in the imaging range of the camera, so the food information acquisition unit passes the opening of the storage chamber from the captured image of the camera You can get information on the food you Thereby, even if the food stored in the storage room overlaps each other, the food information management unit is based on the information of the food acquired from the captured image at the stage when the food passes through the opening, It is possible to manage information of food contained in the storage room.

  According to the refrigerator of the present invention, the image of food passing through the opening of the storage chamber is imaged by the camera disposed outside the storage chamber, thereby eliminating the need for a configuration for preventing the camera lens from being fogged. Information on stored food can be acquired and managed more reliably.

Explanatory drawing of the structure which confirms the condition of the food accommodated in the refrigerator installed in the house by a terminal device Illustration of the appearance of the refrigerator Explanatory drawing which showed the structure in the inside of the refrigerator of a refrigerator by sectional drawing seen from the right side Explanatory drawing which showed the state when the left door of the refrigerator compartment was opened by the sectional view seen from the right side An explanatory view of the state in which the right door of the refrigerator compartment is opened and closed as viewed from above Explanatory drawing which showed the internal structure of the refrigerator compartment by sectional drawing seen from the front Control unit configuration diagram Flow chart showing overall processing by control unit Flow chart of imaging process Flowchart of weight information processing Flow chart of analysis process of image at storage Flow chart of analysis processing at the time of delivery Flow chart of weight sensor correction process First flow chart of in-house food management processing Second flow chart of in-house food management processing Explanatory diagram of in-house food list and shelf life criteria list

According to a first aspect of the present invention, there is provided a storage chamber having an opening, an opening and closing portion for opening and closing the opening, and the outside of the storage chamber, the opening being in an imaging range when the opening and closing portion is open. Based on the information of the food obtained by the food information acquisition unit that acquires information of the food passing through the opening from the camera disposed at the included position, the image captured by the camera, and the information on the food acquired by the food information acquisition unit And a food information management unit configured to manage information of food stored in the storage room.
According to the first aspect of the invention, the camera including the opening of the storage chamber in the imaging range is disposed outside the storage chamber. Therefore, when the opening / closing part of the storage chamber is switched from the closed state to the open state, the lens of the camera is prevented from being fogged by room air flowing into the storage chamber, and the configuration for preventing the lens from fogging is unnecessary. be able to. Further, the food information acquisition unit acquires, from the captured image of the camera, information on the food that has passed through the opening of the storage chamber. Then, the food information management unit stores the food in the storage room based on the information on the food that has passed through the opening acquired by the food information acquisition unit, even when the food stored in the storage room overlaps each other. You can manage the information of the food that is being

In a second aspect of the present invention, the camera is disposed at an outer peripheral portion of the opening, and is provided at an outer peripheral portion of the opening and closing portion and facing the camera when the opening and closing portion is in a closed state. When the unit is in the closed state, it has a blind portion that makes it impossible to view the camera from the outside of the opening / closing unit.
According to the second aspect of the invention, by providing the blindfold portion that makes it impossible to view the camera when the opening and closing portion is in the closed state, the refrigerator when the storage into the storage chamber and the removal from the storage chamber are not performed Can enhance the aesthetics of

In the third invention, the storage chamber is disposed at the top of the refrigerator, and the camera is disposed on a top plate of the storage chamber.
According to the third aspect of the present invention, by disposing the camera on the top plate of the storage room disposed at the uppermost stage of the refrigerator, it is difficult for the user to visually recognize the camera, and aesthetics is achieved by disposing the camera in the storage room. It is possible to suppress the decline.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The present invention is not limited by the present embodiment.

[1. Usage of refrigerator]
FIG. 1 shows a usage mode of the refrigerator of the present embodiment. The refrigerator 1 according to the present embodiment is installed in a house H and has a function of communicating with the management server 520 via the gateway 500 and the communication network 510. In addition, the refrigerator 1 has a function of performing communication with a terminal device (a smartphone, a tablet terminal, and the like) 400. The terminal device 400 has a function of communicating with the management server 520 via the gateway 500 and the communication network 510.

  The control unit 100 provided in the refrigerator 1 controls the overall operation of the refrigerator 1 and generates an in-box food list 131 indicating information on the food stored in the storage chamber of the refrigerator 1 to manage the management server 520. Send to The application for management of the refrigerator executed in the terminal device 400 is in the storage by acquiring the data of the storage in the storage list 131 from the management server 520 or by acquiring the data of the storage in the storage list 131 from the refrigerator 1 Information of the food accommodated in the refrigerator 1 is displayed on the display unit based on the food list 131. The user P of the refrigerator 1 can confirm the condition (food name, expiration date, remaining amount, etc.) of the food accommodated in the refrigerator 1 by visually recognizing the display on the terminal device 400.

  At the top outside (outside the refrigerator) of the refrigerator 1, a camera 60 for imaging the vicinity of the opening of the refrigerator compartment 10 is provided. The camera 60 will be described later in detail, but will not be viewed by the user P when the right door 11 is closed. Further, in the present embodiment, since the camera 60 is provided at a position higher than the user P, the camera 60 is less likely to be visually recognized by the user P even when the right door 11 is opened. With such an installation mode of the camera 60, the appearance of the refrigerator 1 is prevented from being impaired by providing the camera 60 outside the storage.

[2. Configuration of refrigerator]
The configuration of the refrigerator 1 will be described with reference to FIGS. 2 to 7. FIG. 2 is an explanatory view showing the appearance of the refrigerator 1. As shown in FIG. 2, the refrigerator 1 is provided with a main box 2 opened at the front, and in the main box 2, a refrigerator compartment 10 (corresponding to the storage compartment of the present invention), an ice making room 30, an ice making room A switching room 20, a freezing room 40, and a vegetable room 50 which are juxtaposed to 30 and in which the temperature inside the storage can be changed are formed.

  At the front opening of the refrigerator compartment 10, rotary right and left doors 11 and 12 are provided. Further, drawers 21, 31, 41, 51 for storing food are provided in the switching room 20, the ice making room 30, the freezing room 40, and the vegetable room 50, respectively. The camera 60 which includes the opening of the refrigerator compartment 10 in the imaging range is arranged at the outer peripheral part of the top plate of the refrigerator compartment 10 (outside of the refrigerator compartment 10).

  Next, FIG. 3 is an explanatory view showing the internal configuration of the refrigerator 1 as viewed from the right side, and FIG. 4 is an explanatory view showing the internal configuration of the refrigerator compartment 10 as viewed from the front. is there. With reference to FIG. 3 and FIG. 4, an upper shelf 13, a middle shelf 14, and a lower shelf 15 are disposed in the refrigerator compartment 10 to partition the refrigerator compartment 10 into sub areas. In the refrigerator compartment 10, weight sensors 13a and 13b for detecting the weight of food placed on the upper shelf 13, weight sensors 14a and 14b for detecting weight of food placed on the middle shelf 14, and lower shelf 15 Weight sensors 15a and 15b are provided to detect the weight of the prepared food. Furthermore, in the refrigerator compartment 10, illumination units 16a to 16f for illuminating the inside of the refrigerator compartment 10, illuminance sensors 17a to 17c for detecting the illuminance in the refrigerator compartment 10, and a camera 60 are provided.

  In addition, a compressor 61, which is an auxiliary device constituting the refrigeration cycle, a cooling fan 62, a cooler 63, and a condenser 64 are provided. Furthermore, on the back surface of the refrigerator compartment 10, a refrigerator compartment duct 70 and cold air discharge ports 71 to 73 for circulating cold air are disposed.

  In the refrigerator compartment 10, an open / close sensor 18b for detecting the opening / closing of the right door 11 and an open / close sensor 18a for detecting the opening / closing of the left door 12 are provided. The open / close sensor 18b outputs a close detection signal when the right door 11 is closed, and outputs an open detection signal when the right door 11 is open. Similarly, the open / close sensor 18a outputs a close detection signal when the left door 12 is closed, and outputs an open detection signal when the left door 12 is open.

  The switching chamber 20 is provided with an open / close sensor 22 for detecting the opening / closing of the opening 20a. The open / close sensor 22 outputs a close detection signal when the drawer 21 is accommodated in the switching chamber 20, and outputs an open detection signal when the drawer 21 is withdrawn from the switching chamber 20.

  Similarly, the ice making chamber 30 is provided with an open / close sensor 32 for detecting the opening / closing of the opening 30a by the drawer 31, and the freezing chamber 40 is provided with the open / close sensor 42 for detecting the opening / closing of the opening 40a by the drawer 41 The chamber 50 is provided with an open / close sensor 52 for detecting the opening / closing of the opening 50 a by the drawer 51. The open / close sensors 32, 42, 52 output the close detection signal and the open detection signal, as in the case of the open / close sensor 22.

  Next, FIG. 5 is explanatory drawing which showed the structure in the inside of the refrigerator 1 in the state in which the left door 12 of the refrigerator compartment 10 was open by sectional drawing seen from the right side. The camera 60 is provided on the outside near the front end of the top 19 of the refrigerator compartment 10. The imaging range 60 a of the camera 60 includes the opening 10 a of the cold storage room 10, and the camera 60 images the range from the opening 10 a to the vicinity of the front end of each shelf 13, 14, 15. Thus, the camera 60 receives the food stored in the upper shelf 13, the middle shelf 14, and the lower shelf 15, and the food discharged from the upper shelf 13, the middle shelf 14, and the lower shelf 15 through the opening 10 a. Is configured to be capable of imaging.

  Moreover, FIG. 6 has shown the case where the state which opened and closed the right door 11 of the refrigerator compartment 10 was seen from the upper direction of the refrigerator 1. FIG. The right door 11 is pivotally supported by the right hinge 200, and the left door 12 is pivotally supported by the left hinge 201.

  A concave blind portion 210 is provided at the upper end of the outer peripheral portion of the frame of the right door 10. As shown in A of FIG. 6, the blindfold portion 210 is provided at a position facing the camera 60 when the right door 11 is closed. In the state where the right door 11 is closed, the front surface of the camera 60 is covered by the blindfold portion 210, so the user P can not visually recognize the camera 60 from the front surface of the refrigerator 1 (direction of arrow D1 in FIG. 6). Thus, the appearance of the refrigerator 1 in a state in which the right door 11 is closed is prevented from being impaired as the camera 60 is provided outside the storage.

  Moreover, as shown to B of FIG. 6, when the right door 11 of the refrigerator compartment 10 is open, although the concealment part 210 is separated and exposed from the camera 60, as above-mentioned with reference to FIG. Since the camera 60 is provided at the top of the refrigerator 1, it is difficult for the user P to view.

  Here, when the camera is disposed in the refrigerator compartment 10, when the right door 11 or the left door 12 is opened, indoor air (air having a temperature higher than that in the refrigerator compartment 10) is sent to the refrigerator compartment 10. Touching the camera lens that has flowed in and becoming cold, the lens becomes cloudy. Therefore, it is necessary to provide a lens heater or the like to prevent fogging of the lens.

  On the other hand, in the present embodiment, since the camera 60 is provided outside the refrigerator compartment 10, when the right door 11 or the left door 12 is opened, the lens of the camera 60 does not become cloudy. Therefore, it is not necessary to provide a configuration for preventing the fogging of the lens, and it is possible to avoid the reduction of the storage space of the food in the refrigerator by providing this configuration. Furthermore, it is possible to avoid an increase in the temperature inside the chamber due to heat generation from the lens heater, which is a bad effect when the lens heater is provided.

  Next, FIG. 7 is a block diagram of the control unit 100. As shown in FIG. Referring to FIG. 7, control unit 100 is an electronic device configured of a central processing unit (CPU) 110, an image processing unit 120, a storage unit 130, a wireless communication unit 140, a date and time recognition unit 141, and an interface circuit not shown. It is a circuit unit.

  The CPU 110 executes the control program for the refrigerator 1 stored in the storage unit 130 to detect the passing object detection unit 111, the storage amount recognition unit 112, the storage and storage determination unit 113, the food information acquisition unit 114, and the food information management. It functions as the unit 115.

  The control unit 100 includes open / close sensors 18a, 18b, 22, 32, 42, 42, illuminance sensors 17a, 17b, 17c, weight sensors 13a, 13b, 14a, 14b, 15a, 15b, a camera 60, illumination units 16a, 16b, It is connected to 16c, 16d, 16e, 16f and refrigeration cycle accessories 61, 62, 63, 64.

  Detection signals and the like of the open / close sensors 18a, 18b, 22, 32, 42, 42, the illuminance sensors 17a, 17b, 17c, and the weight sensors 13a, 13b, 14a, 14b, 15a, 15b are input to the control unit 100. . In addition, the operation of the illumination units 16a, 16b, 16c, 16d, 16e, 16f, the refrigeration cycle accessories 61, 62, 63, 64 and the like is controlled by the control signal output from the control unit 100.

  Furthermore, the imaging by the camera 60 is controlled via the image processing unit 120 by the control signal output from the control unit 100. The image processing unit 120 converts a video signal output from the camera 60 into a digital gradation signal to generate a captured image, and stores data of the captured image in the image memory 121. The image processing unit 120 performs processing on a captured image stored in the image memory 121 in accordance with a control signal output from the CPU 110.

  The date and time recognition unit 141 counts a clock signal to recognize the current date and time (date and time). Information on the current date and time may be acquired from the management server 520 through communication with the management server 520 to recognize the current date and time.

  In the storage unit 130, in addition to the data of the in-warehouse food list 131, the warehousing food information 132 in which the information of the food received in the cold storage 10 is recorded, and the information of the food delivered from the cold storage 10 are recorded Data of leaving food information 133 is stored. Furthermore, the storage unit 130 stores sample images 134 of various foods and data of a shelf life date list 135 indicating general shelf life of various foods.

  The passing object detection unit 111 detects an object passing through the opening 10a of the refrigerator compartment 10 based on the change in the illuminance in the refrigerator compartment 10 detected by the illuminance sensors 17a, 17b and 17c. Based on the detection signals of the weight sensors 13a, 13b, 14a, 14b, 15a and 15b, the storage amount recognition unit 112 uses the weight of the amount of food placed on the upper shelf 13, the middle shelf 14 and the lower shelf 15 by weight. recognize.

  The storage amount recognition unit 112 detects the weight of food placed on the upper shelf 13 detected by the weight sensors 13a and 13b, and the middle shelf detected by the weight sensors 14a and 14b. The weight of the food placed at 14 and the weight of the food placed on the lower shelf 15 detected by the weight sensors 15a and 15b are distinguished and recognized.

  The storage / storage determination unit 113 is placed on each shelf 13, 14, 15 recognized by the storage capacity recognition unit 112 when the passing object detection unit 111 detects an object passing through the opening 10a of the refrigerator compartment 10. Based on the change in the amount (weight) of the food, it is determined whether the storage of the food into the cold storage room 10 and the delivery of the food from the cold storage room 10 are performed.

  The food information acquisition unit 114 picks up an object that has passed through the opening 10 a of the refrigerator compartment 10 with the camera 60. Then, when the storage determination unit 113 determines that the storage of the food into the cold storage room 10 or the delivery of the food from the cold storage room is determined, the image part of the food is extracted from the captured image.

  The food information acquisition unit 114 recognizes characters included in the image portion of the food, or acquires information such as the food name, content, origin, expiration date, and the like from the characteristics of the image portion of the food. And the food information acquisition part 114 records the acquired information in the warehousing food information 132 about the food (warehousing food) in which the warehousing was determined, and the food-out food information 133 about the food (the leaving food) in which the warehousing was judged. Record on

  The food information management unit 115 is based on the weight of the food in the cold storage compartment 10 recognized by the storage capacity recognition unit 112, the received food information 132 recorded by the food information acquisition unit 114, the delivered food information 133, etc. Add and update food information to the food list 131.

[3. Processing by control unit]
Next, with reference to FIGS. 8-16, the process regarding management of the foodstuff accommodated in the refrigerator compartment 10 performed by the control unit 100 is demonstrated.

  FIG. 8 is a flowchart showing an outline of a series of processes executed by the control unit 100. The control unit 100 performs "imaging processing" in step S1, "weight information processing" in step S2, "image analysis processing" in step S3, "weight sensor correction processing" in step S4, and "in-box food management processing" in step S5. ", Respectively. The details of each process will be described below.

[3-1. Imaging process]
The execution procedure of the "imaging process" will be described according to the flowchart shown in FIG. The “imaging process” is executed by the passing object detection unit 111 and the food information acquisition unit 114. Steps S <b> 10 to S <b> 15 in FIG. 9 are processes by the passing object detection unit 111. When the passing object detection unit 111 determines in step S10 that one or both of the right door 11 and the left door 12 of the refrigerator compartment 10 are opened from the detection signals of the open / close sensors 18a and 18b, the process is performed in step S11. Advance.

  In step S11, the passing object detection unit 111 detects the illuminance of the upper shelf 13, the middle shelf 14, and the lower shelf 15 of the refrigerator compartment 10 (the illuminance of each space partitioned by the shelves) by the illuminance sensors 17a, 17b, 17c. Then, the passing object detection unit 111 sets the detected illuminance of the upper shelf 13 as the upper reference illuminance, the illuminance of the middle shelf 14 as the middle reference illuminance, and the illuminance of the lower shelf 15 as the lower reference illuminance. The passing object detection unit 111 stores data of the upper reference illuminance, the middle reference illuminance, and the lower reference illuminance in the storage unit 130.

  In the upper reference illuminance, the middle reference illuminance, and the lower reference illuminance, one or both of the right door 11 and the left door 12 of the refrigerator compartment 10 are opened, and an object (a user's hand, food, etc.) The illuminance of each shelf 13, 14 and 15 in the state before passing through. The upper reference illuminance, the middle reference illuminance, and the lower reference illuminance are set to illuminance slightly lower or higher than the detected illuminance of each of the illuminance sensors 17a, 17b, 17c in consideration of the error and fluctuation of the detected illuminance. You may Also, the upper reference illuminance, the middle reference illuminance, and the lower reference illuminance used in step S13 described later and the upper reference illuminance, the middle reference illuminance, and the lower reference illuminance used in step S14 may be set to different values. Good.

  In the subsequent step S12, the passing object detection unit 111 detects the illuminance of the upper shelf 13, the middle shelf 14 and the lower shelf 15 by the illuminance sensors 17a, 17b and 17c. Then, in the next step S13, the passing object detection unit 111 determines whether there is a shelf whose detected illuminance is lower than the reference illuminance by a predetermined level or more. Specifically, the passing object detection unit 111 determines whether the following conditions (1) to (3) are met.

(1) The detected illuminance of the illuminance sensor 17a has changed from "upper reference illuminance" to "upper reference illuminance-α" or less.
(2) The detected illuminance of the illuminance sensor 17b changes from "medium reference illuminance" to "middle reference illuminance-α" or less.
(3) The detected illuminance of the illuminance sensor 17c has changed from "lower reference illuminance" to "lower reference illuminance-α" or less.

  However, α: determined by experiment, computer simulation, etc. on the assumption that the illuminance (ie, food, user's hand, etc.) enters the upper shelf 13, middle shelf 14, and lower shelf 15 and decreases in illuminance. Constant for threshold determination. Here, α may be a value common to the upper reference illuminance, the middle reference illuminance, and the lower reference illuminance, and is set to values individually different from the upper reference illuminance, the middle reference illuminance, and the lower reference illuminance. It is also good.

  Then, when at least one of the above (1) to (3) is established, the passing object detection unit 111 advances the process to step S20. When at least one of the above (1) to (3) is established, the user puts the food in the refrigerator compartment 10 (storage), or removes the food from the refrigerator compartment 10 (delivery), or the refrigerator compartment It is assumed that the cold storage room 10 is put into a hand in order to change the position of the food 10 and so on. Then, in this case, the passing object detection unit 111 can determine that the object (the user's hand, the food held by the user's hand, etc.) has passed through the opening 10 a of the refrigerator compartment 10.

  On the other hand, when none of the above (1) to (3) holds, the passing object detection unit 111 proceeds with the process to step S14. In step S14, the passing object detection unit 111 determines whether there is a shelf in which the detected illuminance has changed from "reference illuminance-β" or less to "reference illuminance" or more. Specifically, the passing object detection unit 111 determines whether the following conditions (4) to (6) are met.

(4) The detected illuminance of the illuminance sensor 17a changes from "upper reference illuminance-β" or less to "upper reference illuminance" or more.
(5) The detected illuminance of the illuminance sensor 17b changes from "middle reference illuminance-β" or less to "middle reference illuminance" or more.
(6) The detected illuminance of the illuminance sensor 17c changes from "lower reference illuminance-β" or less to "lower reference illuminance" or more.

  However, β: illuminance generated when an object (food, user's hand, etc.) entering the upper shelf 13, middle shelf 14, or lower shelf 15 passes through the opening 10a and exits the refrigerator compartment 10 A constant for determining the threshold value determined by experiments, computer simulations, etc., assuming an increase in. Note that β may be set commonly for the upper reference illuminance, the middle reference illuminance, and the lower reference illuminance, or is set to values individually different for the upper reference illuminance, the middle reference illuminance, and the lower reference illuminance. You may

  Then, the passing object detection unit 111 advances the process to step S22 when at least one of the above (4) to (6) is established. When at least one of the above (4) to (6) is established, the user puts the food into the cold storage room 10 (storage), takes out the food from the cold storage room 10 (delivery), or It is assumed that the hand placed in the refrigerator compartment 10 is removed by changing the position of the food stored in the storage room 10. Then, in this case, the passing object detection unit 111 can determine that the object (the user's hand, the food held by the user's hand, etc.) has passed through the opening 10 a of the refrigerator compartment 10.

  On the other hand, when none of the above (4) to (6) is established, the passing object detection unit 111 proceeds with the process to step S15. In step S15, the passing object detection unit 111 determines whether or not the right door 11 and the left door 12 of the cold storage room 10 are both closed from the detection signals of the open / close sensors 18a and 18b. Then, when the right door 11 and the left door 12 are both closed, the passing object detection unit 111 proceeds to step S15 and ends the “imaging process”. On the other hand, when at least one of the right door 11 and the left door 12 is open, the passing object detection unit 111 proceeds the process to step S12.

  Next, steps S20 to S21 and steps S22 to S23 are processes by the food information acquisition unit 114. In step S <b> 20, the food information acquisition unit 114 images a range including the opening 10 a of the refrigerator compartment 10 with the camera 60 via the image processing unit 120. In the following step S21, the food information acquisition unit 114 stores the data of the image captured in step S20 in the image memory 121 as data of "image at storage time", and advances the process to step S15. Note that imaging may be performed a plurality of times, and data of a plurality of images may be stored in the storage unit 130 as data of “image at storage”.

  Further, in step S22, the food information acquisition unit 114 images a range including the opening 10a of the refrigerator compartment 10 with the camera 60 via the image processing unit 120. In the following step S23, the food information acquisition unit 114 stores the data of the image captured in step S22 in the image memory 121 as data of the “delivery image”, and the process proceeds to step S15. Note that imaging may be performed a plurality of times, and data of a plurality of images may be stored in the storage unit 130 as data of “image upon leaving”.

  Based on the change in the illuminance of the upper shelf 13, the middle shelf 14 and the lower shelf 15 detected by the illuminance sensors 17a, 7b and 17c by the passing object detection unit 111 by the "imaging process" shown in FIG. An object passing through the ten openings 10a is detected.

  In addition, “the image at the time of storage” which is a captured image when an object which has passed through the opening 10a and entered any of the shelves 13, 14 and 15 is detected by the passing object detection unit 111, and the passing object detection The unit 111 stores in the image memory 121 an “at-delivery image” which is a captured image at the time when an object which has exited any one of the shelves 13, 14 and 15 and has passed through the opening 10 a is detected.

  If an object passing through the opening 10a is detected a plurality of times in step 13 before it is detected in step S15 in FIG. 9 that the right door 11 and the left door 12 are closed, the steps S20 to S21 are performed. As a result, imaging and storage of a plurality of "image at storage time" are performed. Then, the “image analysis process” is executed for each “image upon storage” of the food of which the storage is determined by “weight information processing” described later.

  Similarly, when an object passing through the opening 10a is detected a plurality of times in step S14 before it is detected that the right door 11 and the left door 12 are closed in step S15 of FIG. 9, step S22 to step S22 By S23, imaging and storage of a plurality of "outgoing images" are performed. Then, the “image analysis process” is performed on each “food-at-delivery image” of the food of which the delivery is determined by “weight information processing” described later.

[3-2. Weight information processing]
Next, the execution procedure of the "weight processing" will be described according to the flowchart shown in FIG. The “weight information processing” is executed by the storage and storage determination unit 113 and the food information acquisition unit 114.

  Steps S30 to S33 and S40 in FIG. In step S30, the storage / receipt determination unit 113 recognizes the weight of each shelf 13, 14, 15 by the storage capacity recognition unit 112, and stores the weight in the storage unit 130. In the subsequent step S31, when an object passing through the opening 10a of the refrigerator compartment 10 is detected by the passing object detection unit 111 in step S13 or step S14 of FIG. 7 (with objects entering and leaving the refrigerator compartment 10). The storage / storage determination unit 113 advances the process to step S32.

  In step S32, the storage / receipt determination unit 113 causes the storage amount recognition unit 112 to recognize the weight of each shelf 13, 14, 15. In the next step S33, the storage / withdrawal determination unit 113 determines whether there is a shelf in which the weight recognized in step S32 has increased relative to the weight recognized in step S30. Then, when there is a shelf whose weight has increased (in this case, it can be determined that the food has been stored in the refrigerator compartment 10), the storage / storage determination unit 113 proceeds with the process to step S34.

  On the other hand, when there is no shelf whose weight has increased, the storage / storage determination unit 113 proceeds from step 33 to step S40, and there is a shelf in which the weight recognized in step S32 is reduced relative to the weight recognized in step S30. Determine if it is or not. Then, when there is a shelf whose weight has decreased (in this case, it can be determined that the food has been delivered from the refrigerator compartment 10), the storage / storage determination unit 113 proceeds with the process to step S41. In addition, when there is no shelf whose weight has increased (in this case, it can be determined that the storage of the food into the cold storage room 10 and the delivery of the food from the cold storage room 10 have not been performed), Process and end “weight information processing”.

  Steps S34 to S35 and step S41 are processing by the food information acquisition unit 114. In step S34, the food information acquisition unit 114 estimates the storage position of the stored food from the left and right weights of the shelves 13, 14 and 15 recognized by the storage capacity recognition unit 112.

  In the next step S35, the food information acquisition unit 114 records the information on the weight and storage position of the received food in the received food information 132 (see FIG. 5), proceeds to step S36, and performs “weight information processing” Finish. The data of the stored food information 132 is temporarily stored in the storage unit 130 in order to add information to the in-house food list 131, update the information, and the like.

  Further, in step S41, the food information acquisition unit 114 records the information on the weight of the output food in the output food information 133 (see FIG. 5), proceeds the process to step S36, and ends the “weight information processing”. The data of the leaving food information 133 is temporarily stored in the storage unit 130 in order to add or update the food information to the in-chamber food list 131.

[3-3. Image analysis processing]
Next, the execution procedure of the “image analysis process” will be described according to the flowcharts shown in FIG. 11 and FIG. The “image analysis process” is performed by the food information acquisition unit 114. FIG. 11 is a process of acquiring information from the “image at storage time” for the food stored in the cold storage room 10. Moreover, FIG. 12 is a process which acquires information from "the image at the time of leaving" about the foodstuff delivered from the refrigerator compartment 10. As shown in FIG.

  First, with reference to FIG. 11, the “image analysis process” for the “image at time of storage” will be described. The food information acquisition unit 114 causes the image processing unit 120 to perform character extraction processing on the "image at storage time" of the stored food at step S50 in FIG. Here, the stored food is the food which is determined to be stored in the refrigerator compartment 10 by the storage and storage determination unit 113 in step S33 of FIG. 8. In addition, the "image at storage time" of the storage food is the "image at storage time" captured and stored by the food information acquisition unit 114 in steps S20 and S21 of FIG. 7 for the food determined to be storage in step S33 of FIG. ".

  In the subsequent step S51, the food information acquisition unit 114 determines whether the character has been extracted by the image processing unit 120 from the "image at storage time". Then, when the character is extracted, the food information acquisition unit 114 proceeds with the process to step S52, and when the character is not extracted, the food information acquiring unit 114 proceeds with the process to step S60.

  In step S52, the food information acquisition unit 114 analyzes the information of the character extracted by the image processing unit 120. Then, in the subsequent step S53, the food information acquisition unit 114 acquires information of the received food such as the food name, the expiration date, the production area, and the content from the information of the character. In the next step S54, the food information acquisition unit 114 records the acquired information on the stored food in the stored food information 132, and ends the “image analysis process”.

  Further, in step S60, the food information acquisition unit 114 causes the image processing unit 120 to extract the image portion of the received food from the “image at storage time”. In the subsequent step S61, the food information acquisition unit 114 calculates the matching rate between the extracted image portion of the stored food and the sample images 134 (see FIG. 7) of various food items stored in advance in the storage unit 130.

  In the next step S62, the food information acquisition unit 114 estimates and acquires the food name of the sample image 134 with the highest matching rate as the food name of the received food, and advances the process to step S54. By the processes of steps S60 to S62, even if characters can not be extracted from the "image at the time of storage" of the storage food, the food name of the storage food can be estimated and recorded in the storage food information.

  Next, with reference to FIG. 12, the “image analysis process” on the “delivery image” will be described. In step S70 of FIG. 10, the food information acquisition unit 114 causes the image processing unit 120 to perform character extraction processing on the “delivery image” of the delivered food. Here, the delivered food is a food which is determined in step S40 of FIG. 10 to have been delivered from the cold storage room 10 by the entering and leaving determination unit 113. In addition, the “at-delivery image” of the delivered food refers to the “at-delivery image taken and stored by the food information acquisition unit 114 at steps S22 and S23 of FIG. 7 for the food determined to be withdrawn at step S40 of FIG. ".

  In the subsequent step S71, the food information acquisition unit 114 determines whether the character has been extracted from the “delivery image” by the image processing unit 120. Then, when the character is extracted, the food information acquisition unit 114 proceeds with the process to step S72. When the character is not extracted, the food information acquiring unit 114 proceeds with the process to step S80.

  In step S72, the food information acquisition unit 114 analyzes the information of the character extracted by the image processing unit 120. Then, in the subsequent step S73, the food information acquisition unit 114 acquires information of the delivered food such as the food name, the expiration date, the production area, and the content from the information on the character. In the next step S74, the food information acquisition unit 114 records the acquired information on the exited food in the exited food information 133, and ends the “image analysis process”.

  In step S80, the food information acquisition unit 114 causes the image processing unit 120 to extract the image portion of the delivered food from the "delivery image". In the subsequent step S81, the food information acquisition unit 114 calculates the matching rate between the extracted image portion of the stored food and the sample images 134 of various food items stored in advance in the storage unit 130.

  In the next step S82, the food information acquisition unit 114 estimates and acquires the food name of the sample image 134 with the highest matching rate as the food name of the delivered food, and the process proceeds to step S74. Even if characters can not be extracted from the “at-delivery image” of the delivered food by the processes at steps S80 to S82, it is possible to estimate the food name of the delivered food and record it in the delivered food information.

  The image analysis process of FIG. 11 is performed on the image at the time of storage when the storage in the cold storage room 10 is determined, and the image analysis process of FIG. 12 is the delivery when the storage from the cold storage room 10 is determined. It is performed for the time image. Therefore, when the right door 11 or the left door 12 is detected by the passing object detection unit 111 instead of the food, the image analysis processing is not performed (the captured image is invalidated) because it is not determined to be warehousing or leaving. As a result, it is possible to prevent acquisition of erroneous food information from the image portion of the right door 11 or the left door 12.

[3-4. Weight sensor correction process]
The execution procedure of the "weight sensor calibration process" for correcting the detected weight of the weight sensors 13a, 13b, 14a, 14b, 15a, 15b will be described according to the flowchart shown in FIG. The “weight sensor correction process” is performed by the storage amount recognition unit 112. The "weight sensor correction process" is a process for correcting (calibrating) a detection error of the weight sensors 13a, 13b, 14a, 14b, 15a, 15b which may occur due to a change with time or the like.

  In step S90 of FIG. 13, when the storage / receipt determination unit 113 determines that the storage of food is in the cold storage (YES in step S33 of FIG. 10), the storage capacity recognition unit 112 proceeds to step S91. . In step S91, the storage capacity recognition unit 112 determines whether or not the information on the content of the stored food is stored in the stored food information 132 (processing of step S54 in FIG. 11). Then, when the information on the content of the received food (the content of the food acquired in step S53 of FIG. 11) is recorded in the received food information 132, the storage capacity recognition unit 112 proceeds the process to step S92.

  In step S 92, the storage capacity recognition unit 112 calculates the ratio between the weight and the internal capacity of the stored food stored in the stored food information 132. Then, the storage amount recognition unit 112 sets the calculated ratio as the correction coefficient of the weight sensor used for detecting the weight of the received food. For example, when the stored food is stored in the upper shelf 13 and the weight is detected by the weight sensors 13a and 13b, the storage amount recognition unit 112 sets the calculated ratio as a correction coefficient of the detected weight of the weight sensors 13a and 13b. Do.

  In the following step S93, the storage amount recognition unit 112 stores the data of the correction coefficient in the storage unit 130, advances the process to step S94, and ends the "weight sensor correction process". Thereafter, the storage amount recognition unit 112 treats a value obtained by multiplying the detection weight of the weight sensors 13a and 13b by the correction coefficient as a detection weight. Similarly, when the stored food is stored in the middle shelf 14, the storage amount recognition unit 112 sets the correction coefficient of the weight sensors 14a and 14b, and when the stored food is stored in the lower shelf 15, the weight is recognized The correction coefficients of the sensors 15a and 15b are set.

  On the other hand, when the information on the content is not recorded in the received food information 132 in step S91, the storage capacity recognition unit 112 advances the process to step S94 and ends the “weight sensor correction process”. In this case, calculation and setting of the correction coefficient are not performed.

[3-5. In-house food control processing]
The execution procedure of the "in-house food management process" for managing the information of the food stored in the cold storage room 10 will be described according to the flowcharts shown in FIG. 14 and FIG. The “in-box food management process” is executed by the food information management unit 115.

  The food information management unit 115 manages information of the food stored in the refrigerator compartment 10 by the in-storage food list 131 (see FIG. 5). In the in-chamber food list 131, as shown in FIG. 16, the numbers (1, 2, 3,...) Attached to the food stored in the refrigerator compartment 10, and the information of the respective stored food items with the numbers As the food name, weight (first time, current consumption amount), arrival and withdrawal date (first receipt, latest issue, latest receipt) inventory (1: present, 0: no), shelf life, and production area are recorded. . The food information management unit 115 generates and updates the in-chamber food list 131 based on the information of the stored food information 132 and the leaving food information 133 recorded by the food information acquisition unit 114.

  In step S100 of FIG. 14, the food information management unit 115 determines whether the storage determination of the food to the cold storage room 10 or the delivery of the food from the cold storage room 10 has been determined by the storage and storage determination unit 113. When the delivery is determined, the process proceeds to step S101. In step S101, the food information management unit 115 determines whether or not the storage determination is made, and when the storage determination is made, the process proceeds to step S102. On the other hand, when the storage determination is not made (when the storage determination is made), the food information management unit 115 proceeds the process to step S110.

  In step S102, the food information management unit 115 determines whether or not there is a delivery from the cold storage room 10 within a predetermined time. Then, the process proceeds to step S103 when there is leaving the cold storage room 10 within the predetermined time, and the process proceeds to step S111 when there is no leaving from the cold storage room 10 within the predetermined time. In addition, it can be recognized from the in-warehouse food list 131 that there is a delivery from the refrigerator compartment 10 within a predetermined time.

  In step S103, the food information management unit 115 determines whether the matching rate between the previously issued food and the currently received food is equal to or greater than a predetermined value. Here, the food information management unit 115 compares the information of the product that has been issued last time recorded in the in-chamber food list 131 with the information of the currently received product and information recorded in the incoming food information 132, From the matching situation of name, expiration date, production area, etc., the matching rate of the food that was issued last time and the food that was received this time is calculated.

  Then, the food information management unit 115 advances the processing to step S104 when the matching rate between the previously delivered food and the currently received food is equal to or more than the predetermined value, and the previously delivered food and the currently received food If the matching rate with is less than the predetermined value, the process proceeds to step S112.

  Step S104 is a process where it is determined that the matching rate between the previously issued food and the currently received food is equal to or higher than a predetermined value, and the previously issued food and the currently received food are identical. It is. In step S104, the food information management unit 115 stores the current weight, the latest warehousing date, and the eating amount (difference between the weight at the first warehousing and the current weight) of the food delivered before the predetermined time in the in-chamber food list 131 It updates based on the information recorded on the information 132, and advances a process to FIG.15 S105.

  Step S112 is processing in the case where it is determined that the matching rate between the delivered food and the currently received food is less than a predetermined value, and that the previously delivered food and the currently received food are different. In step S112, the food information management unit 115 newly registers the stored food on the basis of the information recorded in the stored food information 132 in the in-chamber food list 131, and advances the process to step S105 in FIG.

  Step S111 is processing when there is no delivery before a predetermined time. In step S111, the food information management unit 115 newly registers the stored food on the basis of the information recorded in the stored food information 132 in the in-chamber food list 131, and advances the process to step S105 in FIG.

  Step S110 is processing when it is determined that the food has been discharged from the refrigerator compartment 10. In step S110, the food information management unit 115 updates the current weight of the corresponding food (disbursed food) to 0 in the in-chamber food list 131. Further, the food information management unit 115 updates the eating amount of the corresponding food in the in-chamber food list 131, and updates the latest delivery time based on the information recorded in the delivery food information 133, and step 105 of FIG. Proceed to

  In step S105 of FIG. 15, the food information management unit 115 determines whether there is any food whose weight is currently 0 gram by the process of step S110. Then, the food information management unit 115 advances the process to step S105 when there is a food whose weight is currently 0 gram, and advances the process to step S120 when there is no food whose weight is currently 0 gram.

  In step S106, the food information management unit 115 updates the information of the corresponding food (food determined to have been delivered this time) in the in-chamber food list 131 to 'not in stock' (in stock 0), and the process proceeds to step S107. Proceed with the process. Further, in step S120, the food information management unit 115 updates the information of the corresponding food (food determined to be received this time) in the in-box food list 131 to 'in stock' (in stock 1), and step The process proceeds to step S107.

  In step S107, the food information management unit 115 determines whether or not the information on the expiration date is recorded in the incoming food information 132. Then, the food information management unit 115 proceeds the process to step S107 when the information on the shelf life is recorded in the received food information 132, and proceeds to the process to step S121 when the information on the shelf life is not recorded.

  In step S171, the food information management unit 115 records the expiration date of the food that is currently received in the in-house food list 131 based on the information on the expiration date recorded in the received food information 132, and the process is performed in step S107. Advance. Further, in step S121, the food information management unit 115 refers to the expiration date list 135 stored in the storage unit 130, and searches for the expiration date of the corresponding food.

  The expiration date list 135 is a list in which the food name and the food expiration date are associated with each other, as shown in FIG. 16, and the food information management unit 115 is associated with the food name of the present stored food. Search for deadlines. In the following step S122, the food information management unit 115 records the expiration date in the data of the corresponding food in the in-chamber food list 131, and advances the process to step S107.

  In step S107, the food information management unit 115 causes the wireless communication unit 140 to transmit the updated data of the stored food list 131 to the management server 520 via the communication network 510, and ends the "stored food management process". Do.

  The management server 520 stores the data of the in-box food list 131 received from the refrigerator 1 in a storage device (not shown), and the eating condition of each product recognized from the in-box food list 131, the remaining number of days until the expiration date, etc. Are sent to the terminal device 400 of the user. Thereby, the user can confirm the condition of the goods accommodated in the refrigerator 1 by the terminal device 400 even when he or she goes out.

[4. Other embodiments]
In the said embodiment, the passing object detection part 111 detected the object which passes the opening part 10a of the refrigerator compartment 10 by the change of the illumination intensity in the refrigerator compartment 10 detected by illuminance sensor 17a, 17b, 17c. As another configuration of the passing object detection unit 111, an object passing through the opening 10a may be detected by extracting an image portion of an object near the opening 10a from an image captured by the camera 60. Alternatively, an object passing through the opening 10 a may be detected by a reflective or transmissive optical sensor, an ultrasonic sensor, a capacitance sensor, or the like.

  Alternatively, as shown in FIGS. 3 to 5, an objective sensor 80 (a reflective or transmissive optical sensor, an ultrasonic sensor, and the like) which includes the opening 10 a in a detection range and directly detects an object passing through the opening 10 a. A capacitance sensor or the like may be used. In this case, the detection range of the objective sensor 80 may be set on the front side of the imaging range 60a of the camera 60 in the direction from the opening 10a to the inside of the refrigerator compartment 10. As a result, it is possible to prevent a failure in imaging of the stored food due to a delay time from when an object passing through the opening 10a is detected to when the imaging by the camera 60 is performed.

  Also, when the open / close sensor 18a detects that the left door 12 is opened, and when the open / close sensor 18b detects that the right door 11 is opened, energization of the camera 60 is started, Imaging by 60 may be enabled. According to this configuration, when the left door 12 and the right door are closed, the camera 60 can be deenergized to save power. Further, by starting energization of the camera 60 at the timing when the right door or the left door 12 is opened, it is possible to prevent failure in imaging of the stored food due to the delay in activation of the camera 60.

  Further, the food information acquisition unit 114 switches the left door 12 from the open state to the closed state by the open / close sensor 18a within a predetermined time from when the passing object detection unit 111 detects an object passing through the opening 10a. When it is detected or when the open / close sensor 18b detects that the right door 11 is switched from the open state to the closed state, the image data captured by the camera 60 may be invalidated. According to this configuration, when the left door 12 or the right door 11 is detected by the passing object detection unit 111 and captured by the camera 60 when the left door 12 or the right door 11 is closed, the left door 12 or the right It is possible to prevent extraction of erroneous food information from the image of the door 11.

  In the above embodiment, the storage capacity recognition unit 112 is configured to store the food stored in each shelf 13, 14, 15 of the refrigerator compartment 10 based on the detected weight by the weight sensors 13a, 13b, 14a, 14b, 15a, 15b. Recognized the amount. As another configuration of the storage capacity recognition unit 112, each of the refrigerator compartment 10 based on the detected illuminance by the illuminance sensors 17a, 17b and 17c in the state where the illumination units 16a, 16b, 16c, 16d, 16e and 16f are turned on. The amount of food contained in the shelves 13, 14, 15 may be recognized. Alternatively, the amount of food contained in each shelf 13, 14, 15 of the refrigerator compartment 10 is obtained by extracting the image part of the food from the captured image of the inside of the refrigerator compartment 10 by the camera 60 or a camera separately disposed. It may be recognized.

  In the above embodiment, the image processing unit 120 performs the process on the captured image of the camera 60. However, the CPU 110 may have the function of the image processing unit 120 and the CPU 110 may perform the process on the captured image.

  Although the data of the sample image 134 and the expiration date list 135 are stored in the storage unit 130 in the above embodiment, they are stored in the management server 520 and downloaded from the management server 520 to the control unit 100 of the refrigerator 1 when used. May be

  In addition, although the sample image 134 is stored in the storage unit 130 or the management server 520, an image recognition program in which the features of each food or stored item such as color, shape, and size are learned in advance is installed in the CPU 110 The image recognition program may process the image portion of the incoming food to calculate the matching rate and estimate the same as the food name of the incoming food. As a result, the sample image 134 becomes unnecessary and the storage capacity stored in the storage unit 130 or the management server 520 can be reduced, and the recognition processing time for estimating the food name of the stored food can be processed quickly. The estimation of the food name of the leaving food can be processed in the same manner as described above.

  In the above embodiment, in the cold storage room 10 of the refrigerator 1, the storage / storage determination unit 113 determines the storage and exit of the food, and the food information acquisition unit 114 acquires the information of the storage food and the storage food, and the food information management unit The information of the food stored in the refrigerator compartment 10 was managed by 115. The switching room 20, the freezing room 40, and the vegetable room 50 also have a passing object detection unit that detects an object passing through the openings 20a, 40a, 50a, and a storage capacity recognition unit that recognizes the amount of food stored. Thus, it is possible to determine whether the food is in or out.

  Further, the camera may be configured to pick up an image of the food passing through the openings 20a, 40a, 50a of the switching room 20, the freezing room 40, and the vegetable room 50 by a camera disposed outside. According to this configuration, it is possible to capture a range including the openings 20a, 40a, and 50a by the camera without requiring a configuration for preventing fogging of the camera lens. Then, by acquiring information of the stored food and the stored food from the captured image, the information of the food accommodated in the switching room 20, the freezing room 40, and the vegetable room 50 can be acquired to manage the food. .

  As described above, the refrigerator according to the present invention does not require a configuration for preventing fogging of the camera lens by imaging the food passing through the opening of the storage chamber with the camera disposed outside the storage chamber. Since the information of the food stored in the storage room can be acquired more reliably and managed, the present invention can be applied to the application for managing the food stored in the refrigerator.

DESCRIPTION OF SYMBOLS 1 refrigerator 10 cold storage room 10a opening part 11 right door 12 left door 13 upper shelf 13 shelves 13a and 13b weight sensor 14 middle shelf 14a and 14b weight sensor 15 lower shelf 15a and 15b weight sensor 16a, 16b, 16c, 16d, 16r, 16f Lighting unit 17a, 17b, 17c Illuminance sensor 18a, 18b Open / close sensor 19 Top plate of cold storage room 10 Switched room 20a Opening 22 Open / close sensor 30 Icemaker 30a Opening 32 Open / close sensor 32 Step 32 Open / close sensor 40 Step 40 Freezer 40a Opening 42 opening / closing sensor 50 vegetable room 50a opening 52 opening / closing sensor 60 camera 61 compressor 62 cooling fan 63 cooler 64 condenser 100 control unit 110 CPU
111 passing object detection unit 112 storage capacity recognition unit 113 entry and exit determination unit 114 food information acquisition unit 115 food information management unit 120 image processing unit 121 image memory 130 storage unit 131 in-chamber food list 132 warehousing food information 133 leaving food information 134 samples Image 135: Shelf life list 140: Wireless communication unit 141: Date and time recognition unit 210: Blind part 400: Terminal device 500: Gateway 510: Communication network 520: Management server

Claims (3)

A storage chamber having an opening;
An opening and closing part for opening and closing the opening;
A camera which is disposed outside the storage chamber, and in which the opening is included in an imaging range when the open / close unit is in an open state;
A food information acquisition unit that acquires information of food passing through the opening from the image captured by the camera;
And a food information management unit that manages information of the food stored in the storage room based on the food information acquired by the food information acquisition unit. The camera is disposed at an outer peripheral portion of the opening,
It is an outer peripheral portion of the opening and closing part, and is provided at a position facing the camera when the opening and closing part is in a closed state, and when the opening and closing part is in a closed state, the camera from the outside of the opening and closing part The refrigerator according to claim 1, characterized in that it comprises a blind part that makes it impossible to view. The storage room is disposed at the top of the refrigerator,
The refrigerator according to claim 1 or 2, wherein the camera is disposed on a top plate of the storage chamber.

Images