JP2015025640A - Refrigerator inside recording system, control device and refrigerator inside recording method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To grasp latest contents of a refrigerator at any time, while eliminating the need of an imaging instruction for imaging the inside of the refrigerator.SOLUTION: A camera control section 111 and a refrigerator inside light control section 112 of a control device 1 activate a camera 7 and a refrigerator inside light 6, respectively, upon receiving from an opening/closing sensor 8 of a refrigerator 2 detection information indicating that a door and/or a drawer of the refrigerator 2 is opened. Upon receiving from the opening/closing sensor 8 detection information indicating that the door and/or drawer of the refrigerator 2 is closed, an imaging instruction for imaging the inside of the refrigerator is sent to the camera 7. An A-D conversion section 113 receives an image signal indicating a captured image of the refrigerator inside from the camera 7 of the refrigerator 2 and converts the image signal into a digital image signal. An image data generation section 114 generates image data by compressing the digital image signal converted by the A-D conversion section 113. A storage section 115 stores the image data generated by the image data generation section 114, and a communication section 116 transmits the image data stored in the storage section 115 to a portable terminal 3.

Description

  The present invention relates to an in-fridge recording system for recording the contents of a refrigerator, a control device, and an in-fridge recording method.

  Generally, in order to grasp the ingredients in the refrigerator, it is necessary to open the inside of the refrigerator and check and record it. While checking and recording, the cool air escapes and electric energy is used to cool it again. In addition, when purchasing food or the like, if there is no memo recording the information in the warehouse or if it is lost, it is necessary to purchase it with the help of memory, which may be duplicated or insufficient.

  Patent Document 1 discloses a refrigerator stored product image display system in which the state of stored products in a refrigerator can be viewed from the outside.

JP 2003-90673 A

  In the refrigerator-contained product image display system disclosed in Patent Document 1, in order to check the state of the refrigerator while on the go, a photographing instruction from the portable terminal to the refrigerator is necessary, and the contents of the latest refrigerator cannot be confirmed immediately.

  The present invention has been made in view of the circumstances as described above, and an object of the present invention is to eliminate the need for a photographing instruction for photographing the inside of the refrigerator and to grasp the latest contents of the refrigerator at any time.

  In order to achieve the above object, an in-fridge recording system according to the present invention includes a refrigerator, a control device that controls the refrigerator, and a portable terminal connected to the control device via a network. The refrigerator detects opening / closing of the door and / or drawer of the refrigerator and transmits an opening / closing sensor that transmits detection information indicating opening / closing of the detected door and / or drawer to the control device, an interior lamp that illuminates the interior, A camera is provided for photographing the interior and transmitting an image signal indicating the photographed image to the control device. When the control device receives the detection information indicating that the door and / or the drawer is opened from the opening / closing sensor, the control device activates the camera and receives the detection information indicating that the door and / or the drawer is closed from the opening / closing sensor. In this case, the camera control unit that causes the camera to image the interior, the image data generation unit that receives the image signal from the camera and generates image data from the received image signal, and the image data generated by the image data generation unit are stored. And a communication unit that transmits the latest image data stored in the storage unit to the portable terminal.

  According to the present invention, when the refrigerator door and / or drawer is closed, the contents of the refrigerator are photographed and automatically transmitted to the portable terminal, thereby eliminating the need for photographing instructions for photographing the interior of the refrigerator. The contents of can be grasped.

It is a figure which shows the structural example of the recording system in a refrigerator which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the inside of the refrigerator which concerns on Embodiment 1. FIG. 3 is a block diagram illustrating an exemplary functional configuration of a control device according to Embodiment 1. FIG. 6 is a flowchart illustrating an example of an operation of recording processing in the refrigerator according to the first embodiment. 6 is a flowchart illustrating an example of an operation of recording processing in the refrigerator according to the first embodiment. It is a block diagram which shows the function structural example of the control apparatus which concerns on Embodiment 2 of this invention. 10 is a flowchart illustrating an example of an operation of an in-fridge recording process according to Embodiment 2.

  EMBODIMENT OF THE INVENTION Below, the form for implementing this invention is demonstrated in detail with reference to drawings. In addition, the same code | symbol is attached | subjected to the part which is the same or it corresponds in a figure.

(Embodiment 1)
FIG. 1 is a diagram illustrating a configuration example of an in-fridge recording system according to Embodiment 1 of the present invention. The in-refrigerator recording system 100 includes a refrigerator 2, a control device 1 that controls the refrigerator 2, and a mobile terminal 3 that is connected to the control device 1 through a network 4.

  The refrigerator 2 includes a compressor, for example, and cools the articles in the warehouse. In the example of FIG. 1, the upper stage A is a door-type refrigeration room that opens left and right, the middle stage B is a drawer-type freezer room, and the lower stage C is a door-type vegetable room that opens left and right. The refrigerator 2 is provided with devices such as an open / close sensor that detects opening and closing of doors and drawers, an interior light that illuminates the interior, and a camera that photographs the interior. The interior of the refrigerator 2 will be described with reference to FIG.

  FIG. 2 is a diagram illustrating an example of the interior of the refrigerator according to the first embodiment. On the front surface of the door and drawer of the refrigerator 2, an open / close sensor 8 that detects opening and closing of the door and drawer is installed. The open / close sensor 8 of the refrigerator 2 transmits detection information indicating opening / closing of the door and the drawer to the control device 1. Moreover, the doors 9 of the upper stage A and the lower stage C are provided with door pockets 9, respectively, and can store articles.

  On the inner wall of the refrigerator 2, an interior lamp 6 that illuminates the interior and a camera 7 that photographs the interior are installed. In the example of FIG. 2, the interior lamps 6 of the upper stage A and the lower stage C with the sorting shelf 5 are installed on the inner wall surface for each space partitioned by the sorting shelf 5, and the camera 7 is the sorting shelf 5. It is installed on either the left or right side wall for each divided space. The interior lamp 6 and the camera 7 in the middle stage B are installed on the ceiling surface for each drawer.

  The arrangement of the interior lamp 6 and the camera 7 is not limited to this, and the interior lamp 6 and the camera 7 may be installed in a necessary range for photographing the interior of the refrigerator 2. For example, in the case of a drawer-type freezer room in the middle stage B, it is difficult to determine an article from an image, so the camera 7 may not be provided. Further, the open / close sensor 8 is not limited to the front surface of the door and the drawer, and may be installed in the main body of the refrigerator 2.

  Returning to FIG. 1, the control device 1 is a device that controls the interior lamp 6, the camera 7, and the open / close sensor 8 of the refrigerator 2. When receiving the detection information indicating that the door and the drawer are opened from the open / close sensor 8, the control device 1 activates the interior lamp 6 and the camera 7. The interior light 6 is turned on when activated to illuminate the interior. The camera 7 takes an image of the interior and transmits an image signal indicating the taken image to the control device 1. The control device 1 executes predetermined processing on the received image signal to generate image data. The control device 1 transmits the generated latest image data to the mobile terminal 3 via the network 4.

  The portable terminal 3 displays the image data received from the control device 1 on the screen. Although one portable terminal 3 is described as a representative, two or more portable terminals 3 may be provided.

  FIG. 3 is a block diagram illustrating a functional configuration example of the control device according to the first embodiment. The control device 1 receives detection information from the open / close sensor 8 of the refrigerator 2, receives the detection information from the camera control unit 111 that controls the camera 7 based on the received detection information, and the open / close sensor 8, and receives the received detection information. , An interior light control unit 112 that controls the interior light 6, an A / D conversion unit 113 that receives an image signal from the camera 7 of the refrigerator 2 and converts it into a digital image signal, and an A / D conversion unit 113. The image data generation unit 114 that generates image data from the digital image signal converted by the image data, the storage unit 115 that stores the image data generated by the image data generation unit 114, and the image data stored in the storage unit 115 are stored in the mobile terminal 3. The communication part 116 which transmits to is provided.

  When receiving the detection information indicating that the door of the refrigerator 2 is opened, the camera control unit 111 transmits an activation instruction signal to the camera 7. The camera 7 is activated when it receives the activation instruction signal. Upon receiving detection information indicating that the door of the refrigerator 2 is closed, the camera control unit 111 transmits a shooting instruction signal to the camera 7. When the camera 7 receives the shooting instruction signal, the camera 7 takes a picture of the interior and transmits an image signal indicating the shot image to the AD converter 113.

  When receiving the detection information indicating that the door of the refrigerator 2 is opened, the interior light control unit 112 transmits an activation instruction signal to the interior light 6. The interior lamp 6 is activated and turned on when the activation instruction signal is received. When receiving the detection information indicating that the door of the refrigerator 2 is closed, the interior light control unit 112 transmits a turn-off signal to the interior light 6. When receiving the turn-off signal, the interior lamp 6 is turned off after the set time has elapsed. The set time is a time longer than the time required for the camera 7 set in advance. The interior lamp 6 may be configured to be constantly activated. In this case, the interior light control unit 112 may be omitted.

  When receiving the image signal from the camera 7, the A-D conversion unit 113 performs digital conversion processing and generates a digital image signal. The AD converter 113 sends the generated digital image signal to the image data generator 114.

  The image data generation unit 114 generates image data from the digital image signal received from the A / D conversion unit 113 using a compression unit such as JPEG. The image data generation unit 114 stores the generated image data in the storage unit 115.

  When the image data is stored in the storage unit 115, the communication unit 116 transmits the latest image data to the mobile terminal 3 via the network 4.

  Here, operation | movement of the recording system 100 in a refrigerator is demonstrated using a flowchart.

  FIG. 4 is a flowchart showing an example of the operation of the in-fridge recording process according to the first embodiment. The refrigerator recording process 1 starts when the refrigerator 2 and the control device 1 are powered on.

  When receiving the detection information indicating that the door of the refrigerator 2 is opened (step S11; YES), the camera control unit 111 and the interior light control unit 112 transmit an activation instruction signal to the camera 7 and the interior light 6, respectively. Then, the camera 7 and the interior lamp 6 are activated (step S12). The interior lamp 6 is lit when activated. When the detection information indicating that the door of the refrigerator 2 is opened is not received (step S11; NO), the camera control unit 111 and the interior lamp control unit 112 repeat step S11 to detect that the door is opened. Wait for information to be received.

  When the camera control unit 111 receives detection information indicating that the door of the refrigerator 2 is closed (step S13; YES), the camera control unit 111 transmits a shooting instruction signal to the camera 7. When the camera 7 receives the shooting instruction signal, the camera 7 takes a picture of the interior (step S14) and transmits an image signal indicating the shot image to the A-D conversion unit 113.

  When receiving the detection information indicating that the door of the refrigerator 2 is closed (step S13; YES), the interior light control unit 112 transmits a turn-off signal to the interior light 6. When receiving the turn-off signal, the interior lamp 6 is turned off after the set time has elapsed (step S15). When the detection information indicating that the door of the refrigerator 2 is closed is not received (step S13; NO), the camera control unit 111 and the interior light control unit 112 repeat step S13 to detect that the door is closed. Wait for information to be received.

  Upon receiving the image signal from the camera 7, the A-D conversion unit 113 performs digital conversion processing and generates a digital image signal (step S16). The AD converter 113 sends the generated digital image signal to the image data generator 114.

  The image data generation unit 114 compresses the digital image signal received from the A / D conversion unit 113 to generate image data (step S17). The image data generation unit 114 stores the generated image data in the storage unit 115 (step S18).

  When the image data is stored in the storage unit 115, the communication unit 116 transmits the latest image data to the portable terminal 3 via the network 4 (step S19), and ends the process.

  The control device 1 may be configured to transmit image difference information indicating a difference from the latest image data to the mobile terminal 3. In this case, the image data generation unit 114 calls the image data stored most recently from the storage unit 115 and calculates a difference from the image data generated from the digital image signal received from the AD conversion unit 113. The image data generation unit 114 generates image difference information indicating the calculated difference and stores it in the storage unit 115.

  When the image difference information is stored in the storage unit 115, the communication unit 116 transmits the latest image difference information to the mobile terminal 3 via the network 4. When there is no latest image data, the communication unit 116 transmits the latest image data stored in the storage unit 115 by the image data generation unit 114 to the mobile terminal 3 via the network 4.

  The operation of the refrigerator recording system 100 in this configuration will be described using a flowchart.

  FIG. 5 is a flowchart showing an example of the operation of the in-fridge recording process according to the first embodiment. The refrigerator recording process 2 starts when the refrigerator 2 and the control device 1 are powered on.

  Steps S21 to S28 are the same as steps S11 to S18 in the flowchart of FIG.

  When there is no image data stored most recently in the storage unit 115 (step S29; NO), the communication unit 116 carries the latest image data stored in the storage unit 115 by the image data generation unit 114 via the network 4. The data is transmitted to the terminal 3 (step S30), and the process ends.

  When there is image data stored most recently in the storage unit 115 (step S <b> 29; YES), the image data generation unit 114 calls the image data stored most recently from the storage unit 115 and receives it from the AD conversion unit 113. It is determined whether there is a difference from the image data generated from the digital image signal (step S31).

  When there is a difference between the most recent image data and the generated image data (step S31; YES), the image data generation unit 114 generates image difference information indicating the difference between the most recent image data and the generated image data ( Step S32), storing in the storage unit 115.

  When the image difference information is stored in the storage unit 115, the communication unit 116 transmits the latest image difference information to the mobile terminal 3 via the network 4 (step S33), and ends the process. If there is no difference between the most recent image data and the generated image data (step S31; NO), the image data generation unit 114 ends the process.

  Note that if there is no difference between the latest image data and the generated image data, the image data generation unit 114 generates data indicating that there is no difference, and the communication unit 116 transmits this to the mobile terminal 3. Also good.

  As described above, according to the in-fridge recording system 100 of the first embodiment, a shooting instruction for photographing the inside of the refrigerator becomes unnecessary, and the latest contents of the refrigerator can be grasped at any time. Thereby, when purchasing foodstuffs etc., it can prevent overlapping or shortage.

(Embodiment 2)
Similarly to the in-fridge recording system 100 of the first embodiment, the in-fridge recording system 200 of the second embodiment is connected to the refrigerator 2, the control device 1 that controls the refrigerator 2, and the control device 1 and the network 4. The mobile terminal 3 is used. In addition to the configuration of the refrigerator recording system 100, the refrigerator internal recording system 200 has a configuration for measuring the weight of articles in the refrigerator.

  A weight sensor 10 is installed for each space in which articles are placed on the rear shelf of the upper stage A and the lower stage C of the refrigerator 2, the door pocket 9, and the bottom of the drawer of the middle stage B. For example, an increase or decrease in the internal capacity can be detected by the weight sensor 10 installed on the bottom surface of a space for placing an image whose internal capacity is unknown in an image such as paper pack milk. When receiving the detection information indicating that the door and the drawer are opened from the open / close sensor 8, the control device 1 activates the weight sensor 10 in addition to the interior light 6 and the camera 7.

  The weight sensor 10 measures the weight of the articles placed on the sorting shelf 5 and the door pocket 9 and transmits a weight signal indicating the measured weight to the control device 1. The control device 1 performs predetermined processing on the weight signal received from the weight sensor 10 and the image signal received from the camera 7 to generate weight data and image data, respectively, and generates presentation information from these data. The control device 1 transmits the generated presentation information to the mobile terminal 3 via the network 4.

  FIG. 6 is a block diagram illustrating a functional configuration example of the control device according to the second embodiment of the present invention. Similarly to the control device 1 of the first embodiment, the control device 1 of the second embodiment includes a camera control unit 111, an interior lamp control unit 112, an A-D conversion unit 113, and an image data generation unit 114. A storage unit 115 and a communication unit 116. The AD converter 113 further has a function of receiving a weight signal from the weight sensor 10 and converting it into a digital weight signal. In addition, the image data generation unit 114 sends the generated image data to the processing unit 119.

  In addition to these functional configurations, the control device 1 receives detection information from the open / close sensor 8 of the refrigerator 2, and a sensor control unit 117 that controls the weight sensor 10 based on the received detection information, and an A / D conversion unit 113. The weight data generation unit 118 that generates weight data from the digital weight signal converted by, and the processing unit 119 that generates presentation information from the image data generated by the image data generation unit 114 and the weight data generated by the weight data generation unit 118. Is provided.

  When the sensor control unit 117 receives detection information indicating that the door of the refrigerator 2 is opened, the sensor control unit 117 transmits an activation instruction signal to the weight sensor 10. The weight sensor 10 is activated when it receives the activation instruction signal. When the sensor control unit 117 receives the detection information indicating that the door of the refrigerator 2 is closed, the sensor control unit 117 transmits a measurement instruction signal to the weight sensor 10.

  When receiving the measurement instruction signal, the weight sensor 10 measures the weight of the placed article and transmits a weight signal indicating the measured weight to the AD conversion unit 113. The AD converter 113 converts the weight signal received from the weight sensor 10 into a digital weight signal and sends the digital weight signal to the weight data generator 118. The weight data generation unit 118 generates weight data from the digital weight signal received from the AD conversion unit 113 and sends the weight data to the processing unit 119.

  The processing unit 119 generates presentation information from the image data received from the image data generation unit 114 and the weight data received from the weight data generation unit 118 and stores the presentation information in the storage unit 115.

  For example, the processing unit 119 may generate presentation information that combines image data and weight data, or detects changes in the image data and / or weight data, and only changes portions of the image data and / or weight data. Presentation information may be generated. Alternatively, the presentation information may be generated only when it is determined that the image data and / or the weight data has changed.

  By generating presentation information indicating only the changed part of the image data and / or weight data, or by generating the presentation information only when the image data and / or weight data has changed, and transmitting it to the mobile terminal 3, The processing load is reduced, and the memory can be saved.

  When the presentation information is stored in the storage unit 115, the communication unit 116 transmits the latest presentation information to the mobile terminal 3 via the network 4.

  Here, operation | movement of the recording system 200 in a refrigerator is demonstrated using a flowchart.

  FIG. 7 is a flowchart showing an example of the operation of the recording process in the refrigerator according to the second embodiment. The refrigerator recording process 3 starts when the refrigerator 2 and the control device 1 are turned on.

  When the camera control unit 111, the interior light control unit 112, and the sensor control unit 117 receive the detection information indicating that the door of the refrigerator 2 is opened (step S41; YES), the camera 7, the interior light 6 and the weight are respectively received. An activation instruction signal is transmitted to the sensor 10 to activate the camera 7, the interior lamp 6, and the weight sensor 10 (step S42). The interior lamp 6 is lit when activated. When the detection information indicating that the door of the refrigerator 2 is opened is not received (step S41; NO), the camera control unit 111, the interior light control unit 112, and the sensor control unit 117 repeat step S41 to open the door. It waits for reception of the detection information which shows that.

  When the camera control unit 111 receives the detection information indicating that the door of the refrigerator 2 is closed (step S43; YES), the camera control unit 111 transmits a shooting instruction signal to the camera 7. When the camera 7 receives the shooting instruction signal, the camera 7 takes a picture of the interior (step S44), and transmits an image signal indicating the shot image to the A-D conversion unit 113.

  When the sensor control unit 117 receives detection information indicating that the door of the refrigerator 2 is closed (step S43; YES), the sensor control unit 117 transmits a measurement instruction signal to the weight sensor 10. Upon receiving the measurement instruction signal, the weight sensor 10 measures the weight of the placed article (step S45), and transmits a weight signal indicating the measured weight to the AD conversion unit 113.

  When the interior light control unit 112 receives detection information indicating that the door of the refrigerator 2 is closed (step S43; YES), the interior light control unit 112 transmits a turn-off signal to the interior light 6. When receiving the turn-off signal, the interior lamp 6 is turned off after the set time has elapsed (step S46). When the detection information indicating that the door of the refrigerator 2 is closed is not received (step S43; NO), the camera control unit 111, the interior light control unit 112, and the sensor control unit 117 repeat step S43 to close the door. It waits for reception of the detection information which shows that.

  Upon receiving the image signal and the weight signal from the camera 7 and the weight sensor 10, respectively, the AD conversion unit 113 performs digital conversion processing to generate a digital image signal and a digital weight signal (step S47). The AD converter 113 sends the generated digital image signal and digital weight signal to the image data generator 114 and the weight data generator 118, respectively.

  The image data generation unit 114 and the weight data generation unit 118 generate image data and weight data from the digital image signal and the digital weight signal received from the AD conversion unit 113, respectively (step S48), and send them to the processing unit 119. .

  The processing unit 119 generates presentation information from the image data received from the image data generation unit 114 and the weight data received from the weight data generation unit 118 (step S49), and the processing unit 119 stores the generated presentation information in the storage unit 115. (Step S50).

  When the presentation information is stored in the storage unit 115, the communication unit 116 transmits the latest presentation information to the mobile terminal 3 via the network 4 (step S51), and ends the process.

  The control device 1 may be configured to transmit presentation information indicating the difference between the latest image data and weight data to the mobile terminal 3. In this case, the image data generation unit 114 calls the image data stored most recently from the storage unit 115 and calculates a difference from the image data generated from the digital image signal received from the AD conversion unit 113. The image data generation unit 114 sends image difference information indicating the difference of the calculated image data to the processing unit 119.

  In addition, the weight data generation unit 118 calls the weight data stored most recently from the storage unit 115 and calculates a difference from the weight data generated from the digital weight signal received from the AD conversion unit 113. The weight data generation unit 118 sends weight difference information indicating the difference of the calculated weight data to the processing unit 119. The processing unit 119 generates presentation information from the image difference information and the weight difference information and stores it in the storage unit 115.

  When there is no recent image data and weight data, the processing unit 119 generates presentation information from the latest image data and weight data stored in the storage unit 115 by the image data generation unit 114 and the weight data generation unit 118, respectively. .

  As described above, according to the in-fridge recording system 200 according to the second embodiment, there is no change in the image taken inside the warehouse, but it is possible to grasp the case where the content of the article is reduced.

  Further, when the above-described functions are realized by sharing between an OS (Operating System) and an application, or by cooperation between the OS and the application, only a part other than the OS may be stored in the medium.

  Furthermore, each program can be superimposed on a carrier wave and distributed via a communication network. For example, the program may be posted on a bulletin board (BBS, Bulletin Board System) on a communication network, and the program may be distributed via the network. Then, the above-described processing may be executed by starting these programs and executing them in the same manner as other application programs under the control of the operating system.

  Any of the above embodiments can be variously modified within the scope of the gist of the present invention. The above embodiments are for explaining the present invention, and are not intended to limit the scope of the present invention. The scope of the invention is indicated by the appended claims rather than the embodiments. Various modifications made within the scope of the claims and within the scope equivalent to the claims of the invention are included in the scope of the present invention.

  DESCRIPTION OF SYMBOLS 1 Control apparatus, 2 Refrigerator, 3 Portable terminal, 4 Network, 5 Arrangement shelf, 6 Interior light, 7 Camera, 8 Open / close sensor, 9 Door pocket, 10 Weight sensor, 100 Recording system in refrigerator, 111 Camera control part, 112 Interior light control unit, 113 AD conversion unit, 114 image data generation unit, 115 storage unit, 116 communication unit, 117 sensor control unit, 118 weight data generation unit, 119 processing unit, 200 recording system in refrigerator.

Claims (7)

A refrigerator recording system comprising a refrigerator, a control device for controlling the refrigerator, and a portable terminal connected to the control device via a network,
The refrigerator is
An open / close sensor that detects opening / closing of the door and / or drawer of the refrigerator and transmits detection information indicating opening / closing of the detected door and / or drawer to the control device;
An interior light that illuminates the interior,
A camera that shoots the interior and transmits an image signal indicating the captured image to the control device;
The controller is
When the detection information indicating that the door and / or the drawer is opened is received from the opening / closing sensor, the camera is activated, and the detection information indicating that the door and / or the drawer is closed is received from the opening / closing sensor. And a camera control unit that causes the camera to take a picture of the interior,
An image data generation unit that receives the image signal from the camera and generates image data from the received image signal;
A storage unit for storing the image data generated by the image data generation unit;
An in-fridge recording system comprising a communication unit that transmits the latest image data stored in the storage unit to the portable terminal. The controller is
When the detection information indicating that the door and / or the drawer is opened is received from the opening / closing sensor, the interior lamp is turned on, and the detection information indicating that the door and / or the drawer is closed is received from the opening / closing sensor. The refrigerator recording system according to claim 1, further comprising: an interior lamp control unit that turns off the interior lamp after a set time longer than the shooting time of the camera. The image data generation unit, when there is past image data in the storage unit, calls the most recently stored image data, and the difference between the called image data and the image data generated from the image signal received from the camera Image difference information indicating
The storage unit stores the image difference information generated by the image data generation unit,
The said communication part is a recording system in a refrigerator of Claim 1 or 2 which transmits the newest image difference information memorize | stored in the said memory | storage part to the said portable terminal. The refrigerator is
A weight sensor that measures the weight of the article in the refrigerator and transmits a weight signal indicating the measured weight to the control device;
The controller is
When the detection information indicating that the door and / or the drawer is opened is received from the opening / closing sensor, the weight sensor is activated, and the detection information indicating that the door and / or the drawer is closed is received from the opening / closing sensor. A sensor control unit that causes the weight sensor to measure the weight of the article;
A weight data generator that receives the weight signal from the weight sensor and generates weight data from the weight signal;
A processing unit that generates presentation information from the image data generated by the image data generation unit and the weight data generated by the weight data generation unit;
The storage unit stores the presentation information generated by the processing unit,
The said communication part is a recording system in a refrigerator of Claim 1 or 2 which transmits the newest presentation information memorize | stored in the said memory | storage part to the said portable terminal. The image data generation unit, when there is past image data in the storage unit, calls the most recently stored image data, and the difference between the called image data and the image data generated from the image signal received from the camera Image difference information indicating
The weight data generation unit, when there is past weight data in the storage unit, calls the weight data stored most recently, and the weight data generated from the weight data received from the weight signal received from the weight sensor Generate weight difference information indicating the difference,
The in-fridge recording system according to claim 4, wherein the processing unit generates presentation information from the image difference information generated by the image data generation unit and the weight difference information generated by the weight data generation unit. A control device that controls a refrigerator that is connected to a mobile terminal via a network and that includes an open / close sensor that detects opening and closing of a door and / or a drawer, a camera that photographs the interior, and an interior lamp that illuminates the interior,
When the detection information indicating that the door and / or the drawer is opened is received from the opening / closing sensor, the camera is activated, and the detection information indicating that the door and / or the drawer is closed is received from the opening / closing sensor. And a camera control unit that causes the camera to take a picture of the interior,
An image data generation unit that receives an image signal indicating an image captured from the camera and that generates image data from the received image signal;
A storage unit for storing the image data generated by the image data generation unit;
A control apparatus provided with the communication part which transmits the newest image data memorize | stored in the said memory | storage part to the said portable terminal. An open / close sensor that detects opening and closing of a door and / or a drawer, a camera that captures the interior of the cabinet, a refrigerator that includes an interior lamp that illuminates the interior of the cabinet, a control device that controls the refrigerator, the control device, and the network A recording method in a refrigerator executed by a recording system in a refrigerator constituted by a connected portable terminal,
A detection and transmission step of detecting opening / closing of the door and / or drawer of the refrigerator and transmitting detection information indicating opening / closing of the detected door and / or drawer to the control device;
When the detection information indicating that the door and / or the drawer is opened is received from the open / close sensor, the camera is activated to indicate that the door and / or the drawer is closed from the open / close sensor. When the detection information is received, a camera control step for causing the camera to take an image of the interior;
An illumination step for illuminating the interior performed by the interior light;
An imaging transmission step of imaging the interior of the cabinet executed by the camera and transmitting an image signal indicating the captured image to the control device;
An image data generation step for receiving the image signal from the camera and generating image data from the received image signal, which is executed by the control device;
A storage step for storing the image data generated in the image data generation step;
A recording method in a refrigerator comprising a communication step of transmitting the latest image data stored in the storage step to the mobile terminal.

Images