WO2018020541A1 - Réfrigérateur, système de réseau doté de celui-ci, procédé et programme de rapport de circonstances de vie - Google Patents

Réfrigérateur, système de réseau doté de celui-ci, procédé et programme de rapport de circonstances de vie Download PDF

Info

Publication number
WO2018020541A1
WO2018020541A1 PCT/JP2016/071697 JP2016071697W WO2018020541A1 WO 2018020541 A1 WO2018020541 A1 WO 2018020541A1 JP 2016071697 W JP2016071697 W JP 2016071697W WO 2018020541 A1 WO2018020541 A1 WO 2018020541A1
Authority
WO
WIPO (PCT)
Prior art keywords
food
user
refrigerator
image
information
Prior art date
Application number
PCT/JP2016/071697
Other languages
English (en)
Japanese (ja)
Inventor
毅 内田
永田　滋之
伊藤　敬
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to JP2018530207A priority Critical patent/JP6576560B2/ja
Priority to PCT/JP2016/071697 priority patent/WO2018020541A1/fr
Priority to TW105127212A priority patent/TWI751977B/zh
Publication of WO2018020541A1 publication Critical patent/WO2018020541A1/fr

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D23/00—General constructional features

Definitions

  • the present invention relates to a refrigerator having a communication function, a network system including a refrigerator, a notification method of a living condition of a user of the refrigerator, and a notification program of a living condition that causes a computer to execute a notification method.
  • a wireless tag is attached to food, and based on the information sent from the wireless tag and the temperature information sent from the temperature sensor in the refrigerator, based on the storage period-storage temperature-quality tolerance (TTT) theory, Discloses a technique for estimating quality degradation characteristics.
  • TTT storage period-storage temperature-quality tolerance
  • Patent Document 2 transmits image data obtained by photographing inside and outside a warehouse to a mobile phone (mobile terminal) via a server, and monitors inside and outside the warehouse from a remote place. Describes a refrigerator as a storage for goods.
  • JP 2006-317109 A for example, paragraphs 0027-0042, FIG. 5
  • JP 2007-046833 A for example, paragraphs 0021-0025, FIG. 1
  • Patent Document 1 requires a dedicated device such as a reader and lighter for a wireless tag attached to food in order to obtain information indicating the usage status of the refrigerator. There is a problem that increases.
  • the refrigerator described in Patent Document 2 does not require a dedicated device such as a reader and a writer, transmits image data inside and outside the refrigerator to the user's portable terminal, and displays the inside and outside of the refrigerator on the display unit of the user's portable terminal. Images can be displayed.
  • this refrigerator has a problem that it cannot make a determination based on the usage status of the refrigerator (for example, a determination regarding a user's life status).
  • both patent documents 1 and 2 describe the technique which alert
  • This invention is made
  • the person other than the 1st user of a refrigerator shows the living condition of the 1st user of the refrigerator acquired from the image information of the food preserve
  • the refrigerator which concerns on 1 aspect of this invention is equipped with the storage room which accommodates food, and the communication part which communicates, It is a refrigerator used by a 1st user, Comprising: The imaging device which acquires the image in the said storage room, An image management unit that extracts a food image from the image acquired by the imaging device; and a food status detection unit that detects a change in the status of the food stored in the storage chamber from the food image in a certain period; A usage status acquisition unit that acquires first information indicating a usage status of the refrigerator by the first user from a change in the status of the food detected by the food status detection unit; and the first information from the first information.
  • the second information indicating the living situation is transmitted to the second user via the communication unit.
  • the is a life management unit notifies the terminal device to be used.
  • a network system includes the refrigerator, and the terminal device connected to the refrigerator so as to be communicable and used by the second user.
  • a method for informing a living situation a step of acquiring an image in the storage room by photographing the storage room of a refrigerator used by a first user, and a food image from the acquired image. Extracting a change in the status of the food stored in the storage chamber from the food image in a certain period, and detecting the change in the status of the food detected by the first user.
  • acquiring the first information indicating the usage status of the refrigerator and determining from the first information that the first user's living status should be notified to a second user different from the first user And informing the terminal device used by the second user of the second information indicating the living situation.
  • the 1st information which shows the usage condition of the refrigerator by the 1st user from the change of the situation of the food detected from the food image is acquired, and the living situation of the 1st user is given to the 2nd user from the 1st information.
  • the second information indicating the living situation can be notified to the terminal device (another user terminal) used by the second user. For this reason, the 2nd user who received the 2nd information which shows the living situation of the 1st user can take appropriate measures with respect to the 1st user.
  • FIG. 3 is a block diagram schematically showing a configuration of a control system of the refrigerator according to Embodiment 1.
  • FIG. 3 is a flowchart showing the operation of the refrigerator according to the first embodiment.
  • (A)-(d) is a figure which shows the example of the accompanying information of the picked-up image of the refrigerator compartment of the refrigerator which concerns on Embodiment 1, the food image extracted from the picked-up image, and a food image.
  • FIG. (A) And (b) is a figure which shows the example of the display screen in a portable terminal of the food image extracted from the picked-up image of the refrigerator compartment of the refrigerator which concerns on Embodiment 1.
  • FIG. It is a figure which shows an example of the display screen in a portable terminal of the food image extracted from the picked-up image of the refrigerator compartment of the refrigerator which concerns on Embodiment 1.
  • FIG. (A) And (b) is a schematic diagram for demonstrating the time change detection method of the food image in the change detection part of the refrigerator which concerns on Embodiment 1.
  • FIG. (A) And (b) is a figure which shows the example of the display screen in the portable terminal of the food image of the refrigerator which concerns on Embodiment 1.
  • FIG. 10 is a flowchart for explaining the operation of the refrigerator according to the second embodiment. It is sectional drawing which shows schematic structure (cross-sectional structure which cuts FIG. 1 in line segment II-II) of the refrigerator compartment of the refrigerator which concerns on Embodiment 3 of this invention.
  • FIG. It is a block diagram which shows roughly the structure of the control system of the refrigerator which concerns on Embodiment 3.
  • FIG. It is a figure which shows the example of the schedule display screen (1-month display) in the operation panel (schedule setting part) of the refrigerator which concerns on Embodiment 3.
  • FIG. It is a figure which shows the example of the schedule display screen (1 week display) in the operation panel (schedule setting part) of the refrigerator which concerns on Embodiment 3.
  • FIG. It is a figure which shows the example of the schedule display screen (1 day display) in the operation panel (schedule setting part) of the refrigerator which concerns on Embodiment 3.
  • FIG. It is a figure which shows the whole structure of the in-home system and the outside system to which the network system provided with the refrigerator which concerns on Embodiment 4 of this invention was applied.
  • FIG. 1 is a front view showing a schematic structure of a refrigerator 1 according to Embodiment 1 of the present invention.
  • the refrigerator 1 according to Embodiment 1 includes a plurality of storage rooms for storing food.
  • the plurality of storage rooms include, for example, a refrigerator room 11, an ice making room 12, a switching room 13, a freezing room 14, and a vegetable room 15.
  • the refrigerator compartment 11, the ice making room 12, the switching room 13, the freezer compartment 14, and the vegetable compartment 15 are arranged in this order from the top. Further, the ice making chamber 12 and the switching chamber 13 are arranged side by side in the horizontal direction.
  • the refrigerator 1 includes a cooling device that cools the storage chamber.
  • the cooling device includes, for example, a refrigeration cycle circuit having a compressor, a condenser, an expansion valve, and an evaporator.
  • the plurality of storage rooms are cooled by a refrigeration cycle circuit.
  • FIG. 1 is also referred to in the second embodiment (FIG. 10) and the third embodiment (FIG. 14).
  • Refrigerator 1 is described as refrigerators 2, 3, and 4 in the second, third, and fourth embodiments, respectively.
  • An operation panel 21 having a display unit (display screen) as a display device may be provided on the front surface (front surface) of the door (refrigeration chamber door) 20 of the refrigerator compartment 11.
  • the operation panel 21 has, for example, a touch panel that receives user input.
  • the installation position of the operation panel 21 is not limited to the door 20 of the refrigerator compartment 11, and may be installed at other positions such as the outer surface of the door of another storage room or the side surface of the refrigerator 1.
  • FIG. 1 shows an example of a refrigerator to which the present invention is applicable, but the refrigerator to which the present invention is applicable is not limited to that shown in FIG.
  • FIG. 2 is a cross-sectional view showing a schematic structure of the refrigerator compartment 11 of the refrigerator 1 according to Embodiment 1 (cross-sectional structure taken along line II-II in FIG. 1).
  • the refrigerator 1 has a door 20 that opens and closes an opening on the front side (left side in FIG. 2) of the refrigerator compartment 11.
  • the refrigerator compartment 11 is partitioned into a plurality of spaces by a plurality of shelf boards (shelves) 16 arranged inside.
  • the space below the lowermost shelf 16 is a chilled chamber 17.
  • a chilled case 18 that can be drawn forward (leftward in FIG. 2) along a guide member (not shown) such as a rail is installed inside the chilled chamber 17.
  • a cooling air passage 19 is provided on the back side of the refrigerator compartment 11 (on the right side in FIG. 2) as a passage for guiding the air cooled by the refrigeration cycle circuit to the storage compartment.
  • the main body of the refrigerator 1 in contact with the door 20 is provided with an opening / closing detection unit 22 as an opening / closing detection device that detects opening / closing of the door 20.
  • the open / close detection unit 22 is, for example, a magnet-type device that detects the proximity of a magnet (permanent magnet) embedded in the door 20 by a pair of reed switches installed in the main body of the refrigerator 1.
  • the open / close detection unit 22 may be a detection device that employs another detection method such as a mechanical switch or an optical switch.
  • the refrigerator 1 also includes a control board 110 having a control circuit (control unit) for operating the refrigerator 1.
  • the control board 110 is provided on the back surface of the refrigerator 1, for example.
  • the photographing device 27 is installed on the inner surface of the door 20.
  • the imaging device 27 can capture the inside of the refrigerator compartment 11 from the door 20 side, which is the same side as the user's viewpoint, with the visual field range from the ceiling surface of the refrigerator compartment 11 to the chilled chamber 17. It has a configuration.
  • the installation position of the photographing device 27 is not limited to the inner surface of the door 20.
  • the imaging device 27 may be installed at any position as long as it can capture a wide range of storage items such as foods placed on the shelf board 16. Further, in consideration of the fact that the shelf plate 16 blocks the field of view, a plurality of photographing devices 27 may be installed in order to photograph more stored items. Further, the photographing device 27 may be provided at a position for photographing a storage room other than the refrigerator compartment 11.
  • the refrigerator 1 includes a control board 110 having a control circuit for operating the refrigerator 1.
  • the control board 110 is attached to the back surface of the refrigerator 1, for example.
  • FIG. 3 is a block diagram schematically showing the configuration of the control system of the refrigerator 1 according to the first embodiment.
  • the control system of the refrigerator 1 includes, for example, an operation panel 21, an open / close detection unit 22 that detects an open state and a closed state of the door 20, and a mobile terminal (terminal device) as an external device.
  • the communication unit 23 as a communication device capable of performing wired or wireless communication, a storage unit 24 such as a semiconductor memory for storing information, a time providing unit 25 for providing time information, and the overall operation of the refrigerator 1
  • the control part 100 which controls this is provided.
  • control system of the refrigerator 1 includes, for example, a compressor drive circuit 31 that drives a compressor (compressor) 32 that constitutes a part of the refrigeration cycle circuit, and a fan (motor) 34 that flows air into the storage chamber of the refrigerator 1. And a fan driving circuit 33 to be driven.
  • the circuit that is the main part of the control system of the refrigerator 1 can be provided on the control board 110. However, a part of the circuit of FIG. 3 may be provided on another control board (not shown).
  • the communication unit 23 includes a communication module such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).
  • the refrigerator 1 uses the communication unit 23, for example, via at least one of a router (a broadband router 506 shown in FIG. 19 described later) and the Internet (the Internet 601 shown in FIG. 19 described later), It is possible to communicate with a terminal device such as a smartphone, a mobile tablet, a mobile phone, a personal computer, or the like that exists inside or outside the house.
  • This terminal device is, for example, a terminal device (hereinafter also referred to as “first user terminal”) used by a user of the refrigerator 1 (hereinafter also referred to as “first user” or “managed person”) and a user other than the first user.
  • a terminal device hereinafter also referred to as “second user terminal” or “another user terminal”
  • second user used by a third party user
  • the control unit 100 of the refrigerator 1 transmits information for displaying various information related to the refrigerator 1 on either or both of the display unit of the first user terminal and the display unit 71 of the second user device 70. Can do.
  • the time information provided by the time providing unit 25 can include not only the hour, minute, and second but also the date (month / day or year / month / day).
  • the time providing unit 25 may be, for example, a clock or a time receiving device that receives a time signal transmitted by a time signal provider.
  • the control unit 100 may be configured by an electric circuit, or may be configured by a processor as an information processing apparatus that executes a program as software stored in the storage unit 24.
  • the function of the control unit 100 is realized by executing a program stored in the storage unit 24.
  • the function of the control unit 100 can be realized by a program (informing method or informing program for living conditions) executed by the processor in the refrigerator 1 (or 2 to 4).
  • the function of the control unit 100 can also be realized by a program (living status notification method or notification program) executed by a computer (which may be a server on a network) that can communicate with the refrigerator 1.
  • the living situation notification program uses the refrigerator 1 (or 2 to 4) including a storage room 11 for storing food, a communication unit 23 for communication, and a photographing device 27 for acquiring images in the storage room 11.
  • a first user's life situation notification program which is obtained by causing the photographing device 27 to photograph the inside of the storage room 11 of the refrigerator 1 (or 2 to 4) and acquiring an image in the storage room 11 From the process of extracting the food image from the captured image, the process of detecting the change in the status of the food stored in the storage chamber 11 from the food image in a certain period, and the change in the status of the detected food, the first A process for obtaining first information indicating the usage status of the refrigerator 1 (or 2 to 4) by the user, and a situation in which the living status of the first user should be notified to the second user different from the first user from the first information It is In such a case, the computer (the information processing device such as the control unit 100 or an external computer or a server on the network) is caused to execute processing for informing
  • the control unit 100 includes an image management unit 101, a change detection unit 102, a deterioration detection unit 103, a usage status acquisition unit 104, and a life management unit 105.
  • the control unit 100 may include a main control unit (not shown) that controls the overall operation of the control unit 100.
  • the change detection part 102 and the deterioration detection part 103 comprise the food condition detection part 103a.
  • the storage unit 24 is shown as a separate configuration from the image management unit 101, but the storage unit 24 is a part of the image management unit 101 (or a part of the control unit 100). It may be a part of another configuration.
  • the storage unit 24 may be a storage device connected to the outside of the refrigerator 1 or a storage device connected to be communicable via a network (for example, a server).
  • the image management unit 101 is connected to the imaging device 27, the change detection unit 102, and the communication unit 23.
  • the image management unit 101 receives an entire image (image data) in the refrigerator compartment 11 acquired by photographing in the refrigerator compartment 11 by the photographing device 27 and receives the received whole image (hereinafter referred to as “store”).
  • the image of the food part (food image) is extracted from the “inner image” or “storage room image”.
  • the image management unit 101 adds time information (for example, shooting time information) to the food image extracted from the acquired whole image as supplementary information, and stores the storage unit (the storage unit 24 and the storage unit 24 in the image management unit 101). It may be a different storage unit or may be the storage unit 24).
  • the image management unit 101 may store the food images rearranged in time series based on the time information.
  • the image management unit 101 gives the food image and accompanying information (which may include time information and entry / exit identification information) to the change detection unit 102 and the communication unit 23.
  • the change detection unit 102 is connected to the image management unit 101, the deterioration detection unit 103, and the communication unit 23.
  • the change detection unit 102 receives the food image and supplementary information from the image management unit 101, detects a change in the color and size of the food image (corresponding to the color and size of the actual food), and detects the change.
  • the storage unit may be a storage unit different from the storage unit 24 or may be the storage unit 24.
  • the change detection unit 102 provides information indicating the temporal change in the color and size of the detected food image to the deterioration detection unit 103 and the communication unit 23.
  • the deterioration detection unit 103 is connected to the change detection unit 102, the usage status acquisition unit 104, and the communication unit 23.
  • the deterioration detection unit 103 receives the time change of the color and size of the food image from the change detection unit 102, detects (estimates) the deterioration state of the food based on the time change, and obtains the use state of the detection result of the deterioration state To the unit 104 and the communication unit 23. Therefore, the food condition detection unit 103a including the change detection unit 102 and the deterioration detection unit 103 can detect the storage state of the stored food from the food image extracted from the storage room image.
  • the usage status acquisition unit 104 is connected to the deterioration detection unit 103, the life management unit 105, and the communication unit 23 of the food status detection unit 103a.
  • the use state acquisition unit 104 receives the deterioration state of the food in units of food images as the storage state of the food stored in the refrigerator compartment 11 from the deterioration detection unit 103, and from the information indicating the deterioration state, for example, “Current Short-term use status such as “The stored food has not deteriorated”, or “Deteriorated food has been left for several days” in combination with time information such as date or date. Detect (estimate) long-term usage.
  • the usage status acquisition unit 104 detects the usage status by the first user of the refrigerator 1 based on the deterioration state of the food in the storage room, and also indicates information indicating this usage status (hereinafter also referred to as “first information”). ) Is given to the life management unit 105.
  • the life management unit 105 is connected to the usage status acquisition unit 104 and the communication unit 23.
  • the life management unit 105 receives first information indicating the usage status of the first user based on the deterioration state of the food from the usage status acquisition unit 104, and information indicating the first user's lifestyle status (hereinafter, “ Also referred to as “second information”).
  • the second information indicating the living state of the first user is, for example, the tendency of the first user to stay at home or away from the home of the first user, or the frequency at which the first user goes shopping.
  • the life management part 105 is the information (notification information required) which should be alert
  • the communication unit 23 is connected to the image management unit 101, the change detection unit 102, the deterioration detection unit 103, the usage status acquisition unit 104, and the life management unit 105, and is connected to the second user terminal 70 wirelessly or by wire.
  • the communication unit 23 receives the food image and supplementary information from the image management unit 101, receives information indicating the time change of the color and size of the food image from the change detection unit 102, and indicates the deterioration state of the food from the deterioration detection unit 103.
  • Receive information receive first information indicating the usage status of the first user from the usage status acquisition unit 104, and send information (second information) to be notified to the second user in the lifestyle status from the life management unit 105. receive.
  • Each information can be transmitted to the 2nd user terminal 70 which 2nd users other than the 1st user who uses refrigerator 1 use by wireless communication, for example.
  • the second user terminal 70 that is the transmission destination of the second information may be registered in advance in the storage unit in the refrigerator 1 or in a server as a management device on the network, for example, by the first user or the like. Good.
  • the second user terminal 70 is connected to the communication unit 23 so as to be capable of wireless communication.
  • the second user terminal 70 transmits the food image and supplementary information transmitted from the communication unit 23, information indicating the color and size change of the food image, information indicating the deterioration state of the food, the first user's refrigerator 1 Information to be notified to the second user among the first information indicating the usage status and the second information indicating the living status can be received, and the received content can be displayed on the display unit 71 of the second user terminal 70.
  • FIG. 4 is a flowchart for explaining an operation performed each time the door 20 of the refrigerator 1 is opened and closed.
  • step S11 the photographing device 27 photographs the inside of the refrigerator compartment 11 (step S12).
  • the imaging device 27 performs imaging while the illumination in the refrigerator compartment 11 is turned on. This is because when the opening / closing of the door 20 is detected, the food in the refrigerator compartment 11 may have been put in and out.
  • the imaging device 27 provides the image management unit 101 with the storage room image (preferably the image of the entire storage room) in the refrigerator compartment 11 obtained by imaging (step S13). Therefore, the image management unit 101 receives the storage room image from the imaging device 27 every time the door 20 is opened and closed (that is, every time the storage state in the refrigerator compartment 11 may change).
  • the current (latest) door 20 opening / closing is referred to as “current door opening / closing”
  • the previous (one-time previous) door 20 opening / closing is referred to as “previous door opening / closing”.
  • the image management unit 101 stores the storage room image (image data) received from the imaging device 27 at the previous opening / closing of the door (for example, in the storage unit 24), and the storage received from the imaging device 27 at the current opening / closing of the door.
  • the room image is newly saved (for example, in the storage unit 24).
  • the image management part 101 extracts the image of the change part of a store room image as a food image by calculating the difference of the store room image at the time of the last door opening and closing, and the store room image at the time of this door opening and closing. (Step S14). That is, the image of the changed portion of the storage room image is an image of food that has been received or delivered.
  • beer is placed on the shelf 16 of the refrigerator compartment 11, and in the storage room image when the door is opened and closed this time, the shelf where no beer is placed in the same place.
  • the food image of beer is extracted based on the difference between the two storage room images.
  • the image management unit 101 adds time information that is the current time (or time when the image was taken) as supplementary information to the food image extracted in this way,
  • the incidental information is rearranged in a time series based on the time information and stored (step S15).
  • the image management unit 101 determines whether the food is in or out. Specifically, when the food image is extracted, the image management unit 101 analyzes a portion changed due to the difference, for example, an edge change amount obtained by edge processing, and a storage room image at the time of photographing. The food image is compared with the prestored storage state image in the empty state (the state where no food is stored in the refrigerator compartment 11), and the food in / out is determined. Then, the image management unit 101 adds and stores the determination result (entry / exit identification information) of warehousing or evacuation to the incidental information of the food image.
  • the determination result entity / exit identification information
  • the image management unit 101 gives the food image and the accompanying information (time information and entry / exit identification information) to the change detection unit 102 and the communication unit 23 (step S16).
  • the change detection unit 102 receives the food image and the supplementary information from the image management unit 101, and detects and stores the time change of the color and size of the food image, which will be described later.
  • a series of operations from acquiring the storage room image of the refrigerator compartment 11 in steps S12 to S17 to giving the food image and the supplementary information to the food condition detection unit 103a is detected by opening and closing of the door 20 in step S11. It is carried out every time.
  • 5 (a) to 5 (d) show captured images 81a to 81d of the refrigerator compartment 11 of the refrigerator 1 according to the first embodiment, food images 82b, 82c, 82d1, and 82d2 extracted from the captured images, and food images It is a figure which shows the example of incidental information 83d1, 84d1, 83d2, 84d2.
  • 5 (a) to 5 (d) when the door 20 is opened and closed, the storage room image which is the shooting data acquired by the shooting by the shooting device 27 and sent to the image management unit 101 and the storage room image are extracted.
  • a food image as image data and its accompanying information time information and entry / exit identification information
  • FIG. 5A shows a storage room image 81a that is acquired by photographing by the photographing device 27 and transmitted to the image management unit 101 at time A.
  • FIG. At time A the door 20 has been opened and closed, but no food is received or delivered. Since there is no change in the storage room image at time A and before that, the image management unit 101 does not generate a difference image (food image).
  • FIG. 5B shows a storage room image 81b that is acquired by photographing by the photographing device 27 and sent to the image management unit 101 at time B after time A, and a food image 82b extracted from the storage room image 81b.
  • the accompanying information 83b and 84b are shown.
  • beer which is a canned beverage
  • the image management unit 101 extracts the food image (beer) 82b based on the difference between the storage room image at the time A and the storage room image at the time B, and includes the supplementary information together with the food image based on the determination result of entering or leaving.
  • the time information “time B” 83b and the entry / exit identification information 84b “departure” are stored.
  • FIG. 5 (c) shows a storage room image 81c acquired by photographing by the photographing device 27 and transmitted to the image management unit 101 at time C after time B, and a food image 82c extracted from the storage room image 81c. And its accompanying information 83c and 84c.
  • the image management unit 101 extracts the food image (salad) 82c based on the difference between the storage room image at time B and the storage room image at time C, and includes the supplementary information together with the food image based on the determination result of entering or leaving.
  • the time information “time C” 83c and the warehousing / departure identification information 84c “departure” are stored.
  • FIG. 5D illustrates a storage room image 81d that is captured by the imaging device 27 and transmitted to the image management unit 101 at time D after time C, and food images 82d1 and 82d2 extracted from the storage room image 81d. And the accompanying information 83d1, 84d1, 83d2, and 84d2.
  • the milk in the paper pack is stored on the uppermost refrigerator compartment shelf in the refrigerator compartment 11, and the cake is received on the lower refrigerator compartment shelf.
  • the image management unit 101 extracts food images (milk and cake) 82d1 and 82d2 based on the difference between the storage room image at time C and the storage room image at time D, and the determination result of entering or leaving (in this case, On the basis of “receipt” for both milk and cake, the time information “time D” 83d1, 83d2 and the entry / exit identification information 84d1, 84d2 of “entry” are stored together with the food image.
  • the image management unit 101 since the image management unit 101 stores the food image together with the time information and the warehousing / departure identification information, the image management unit 101 can grasp the warehousing time of the food and detect the deterioration state based on the warehousing time. Can do. That is, the image management unit 101 grasps food (stock food) stored in the refrigerator compartment 11 as an image and holds information necessary for detecting the deterioration state of the stock food.
  • the image data stored by the image management unit 101 includes the food image (changed portion of the storage room image) extracted based on the difference from the previous image data, and the latest storage room image (refrigerated) serving as a reference for the difference. Only the whole image of the room 11) may be used. That is, after extracting the food image, the image management unit 101 may store only the latest storage room image and delete other storage room images.
  • the image management unit 101 reduces the amount of stored image data, the memory capacity of the storage unit and the data communication load can be reduced. Further, the photographing by the photographing device 27, the extraction of the food image in the image management unit 101, and the storage of the image data are performed only when the door 20 is opened and closed (when there is a possibility that the food has been put in and out). Alternatively, only data necessary for managing the food stored in the refrigerator compartment 11 is stored. For this reason, it is possible to acquire the storage state and the deterioration state of the food in the refrigerator compartment 11 with the minimum necessary operations (photographing, image processing and storage).
  • the storage state of food means information indicating which food is stored in the refrigerator compartment 11 at which time.
  • the deterioration state of food means information indicating how much the deterioration of food has progressed (for example, whether or not it is necessary to consume the food at an early stage).
  • the image management unit 101 divides the food image data stored together with the stored supplementary information (time information and storage / entry identification information) in time series or storage / departure, via the communication unit 23. And it can output to the display part 71 of the 2nd user terminal 70 which not only the 1st user terminal which the 1st user who uses the refrigerator 1 uses but 2nd users other than a 1st user uses.
  • a second user (for example, a family or a living person of the first user who uses the refrigerator 1) is housed in the refrigerator compartment 11 by viewing the display screen of the display unit 71 of the second user terminal 70. You can grasp the food.
  • FIG. 6A and 6 (b) are diagrams illustrating an example of a display screen on a mobile terminal of a food image extracted from a photographed image of the refrigerator 1 according to the first embodiment.
  • the display screen timeline display screen
  • FIG. 6A the food image 42 extracted from the storage room image each time the door 20 is opened and closed, the time information 43 attached to the food image 42, and the input information.
  • the shipping identification information 44 is displayed side by side in time series.
  • food images 42 are arranged in the center of the screen from the top (in order from the latest shooting time information as time information), time information 43 on the left side of each food image, and entry / exit identification information 44 on the right side. Is displayed.
  • a target storage room in this example, the refrigerating room 11
  • its set temperature and the current time are also displayed.
  • the display screen (incoming / outgoing list display screen) shown in FIG. 6B is divided into left and right fields for warehousing and warehousing, and food images and time information are displayed in chronological order in each field (list display). is doing.
  • the food images whose entry / exit identification information 54 is “Receive” and the time information (that is, the entry time) 53 are displayed side by side in order from the latest entry time 53.
  • the food images 52 whose entry / exit identification information 54 is “exit” and the time information (that is, the exit time) 53 are displayed side by side in order from the latest exit time 53.
  • the current remaining amount of the food can be acquired from the history of loading and unloading of the target food.
  • a family member or a helper confirms the display unit 71 of the other user terminal 70 at a remote place, for example, a shopping destination, so that excessive purchase of food or purchase of food is performed. It becomes possible to prevent forgetting.
  • FIG. 7 is a diagram illustrating another example of the display screen on the mobile terminal of the food image extracted from the photographed image of the refrigerator 1 according to the first embodiment.
  • the image management unit 101 uses the stored food image (that is, the food image extracted every time the door 20 is opened / closed) and the time information and the warehousing / departure identification information as incidental information at a certain time.
  • the food image stored in (the entry / exit identification information is not “exit”) is specified.
  • a list of stock food images is displayed as a stock food list display screen 62 via the communication unit 23.
  • the food images are arranged from the top in order of the warehousing time based on the time information.
  • the display unit 71 of the second user terminal 70 is referred to as an “entrance / exit timeline” in FIG. 6A, an “entry / exit list” in FIG. 6B, and an “inventory food list” in FIG.
  • an “entrance / exit timeline” in FIG. 6A an “entrance / exit timeline” in FIG. 6A
  • an “entry / exit list” in FIG. 6B an “inventory food list” in FIG.
  • any one of these may be displayed at all times, or may be displayed in response to a first user operation (for example, touching the touch panel). Also good.
  • the food image display screen may be switched by operating a button linked to each display screen, or may be switched by a horizontal swipe operation.
  • the target storage room in this example, the refrigerator room 11
  • its set temperature in this example, the current time
  • the measured temperature of the storage room may be displayed.
  • step S ⁇ b> 17 shown in FIG. 4 the time of the color and size of the food image received by the change detection unit 102 from the image management unit 101 (that is, the food image extracted from the storage room image every time the door 20 is opened and closed).
  • the change is detected (for example, stored in the storage unit 24) and saved.
  • the food stored in the refrigerator compartment 11 gradually deteriorates, and particularly changes in the color of food or the size (or shape) of food.
  • fresh foods such as meat and fish change color to brown due to oxidation (methation).
  • broccoli gradually fades from bright green color to increase the yellow part, and when it further deteriorates, it changes to grayish brown due to decay or mold.
  • Leafy vegetables such as spinach are deflated or shrunken by transpiration, and the size also changes.
  • the change detection unit 102 detects and stores a time change in the color and size of the received food image. Based on the temporal change in the color and size of the food image stored in the change detection unit 102, the deterioration detection unit 103 detects (estimates) the deterioration state.
  • the change detection unit 102 detects and stores the a * value, the b * value, and the L * value (for example, in the storage unit 24).
  • the color index is not limited to the L * a * b * color system, but the RGB color system or Munsell table, which is a color system in which the primary colors are R (red), G (green), and B (blue). Even if another color system such as a color system is used, a color change (red fading, yellow increase, etc.) and a brightness change can be quantified.
  • the change detection unit 102 may store the change in color distribution in a storage unit (for example, the storage unit 24).
  • the change detection unit 102 stores a large number of color samples in advance in a storage unit (for example, the storage unit 24) as a database, and compares the color detected from the food image received from the image management unit 101 with the color sample. Then, the similarity is calculated. Then, the entire food image is classified for each color corresponding to the most similar color sample, and the area occupancy for each color is calculated.
  • FIGS. 8A and 8B are diagrams illustrating an example of a time change of the food image in the change detection unit 102.
  • FIG. FIG. 8A shows a food image at the time of receipt of food (meat) and a color distribution detected based on the food image.
  • FIG. 8B shows a food image after a sufficient time (T time) for the food to oxidize and a color distribution detected based on the food image. T is a value of 0 or more.
  • T is a value of 0 or more.
  • the area occupancy (vertical axis) for each color (horizontal axis) corresponding to the color sample in the food image is shown by a bar graph.
  • the change detection unit 102 calculates and stores data of the color distribution of the newly received food image.
  • the change detection unit 102 stores, for example, a projection area, a perimeter, a length of the longest axis, and the like as an index for detecting a change in size. Further, the change detection unit 102 may extract a pattern from the outline shape of the food and store the pattern. Here, the change detection unit 102 detects and stores changes in the color and size of the food image. However, only the change in color or only the change in size may be detected and stored.
  • the deterioration detection unit 103 detects the deterioration state of the food based on the temporal change in the color and size detected and stored by the change detection unit 102.
  • the detection of the food deterioration state by the deterioration detection unit 103 is preferably performed not at every opening / closing of the door 20 but at every predetermined time.
  • the state of deterioration of food varies depending on the type of food (meat, fish, vegetables, etc.). Therefore, it is desirable that the deterioration detection unit 103 determines the deterioration state of the food using a determination criterion suitable for the type of food. However, the deterioration detection unit 103 may determine the deterioration state of the food using the same determination criterion regardless of the type of food. Therefore, the deterioration detection unit 103 makes a determination based on a plurality of indexes for one food image, and determines that “it is necessary to consume at an early stage” when at least one index exceeds a reference value.
  • the deterioration detection unit 103 uses at least one of the a * value, the b * value, and the L * value stored in the change detection unit 102.
  • the reference value it is determined that the food corresponding to the food image needs to be consumed at an early stage.
  • the color of the food is oxidized due to oxidation in FIG. It changes dark (actually brown), and the area occupancy of the dark color increases. Brown is the color that metmyoglobin exhibits upon oxidation or methation.
  • the reference value is registered in advance in the deterioration detection unit 103 for each color that reflects the deterioration.
  • the deterioration detection unit 103 determines that at least one of the area occupancy rates of a plurality of colors registered in advance (for example, colors corresponding to a plurality of color samples such as No. 10 and No. 20) exceeds a reference value. In addition, it is determined that the food corresponding to the food image “there is a possibility that the food has deteriorated”.
  • the deterioration state can be determined based on a change in the size of the food included in the food image.
  • the change detection unit 102 for example, the projected area, the peripheral length, or the length of the longest axis
  • the deterioration detection unit 103 determines whether the size of the food is When the rate of decrease from the time of warehousing exceeds the reference value, it can be determined that the food needs to be consumed early.
  • the deterioration detection unit 103 performs pattern matching between the food contour shape pattern at the time of warehousing and the food contour shape pattern at the time of detection. If the error exceeds the reference time, it may be determined that the food needs to be consumed early.
  • the deterioration detection unit 103 determines a deterioration state for each food image stored in the change detection unit 102.
  • the display unit 71 of the second user terminal 70 displays the detection result of the deterioration state by the deterioration detection unit 103 together with the food image stored by the image management unit 101.
  • FIGS. 9A and 9B are diagrams showing display examples of the deterioration state of food on the mobile terminal.
  • An alert here, an exclamation point
  • the display unit 71 of the second user terminal 70 is a food that should be consumed at an early stage. I can understand that there is. That is, it becomes obvious at a glance which food should be consumed early among the plurality of foods stored in the refrigerator compartment 11. As a result, it is possible to suppress wastefully discarding food due to the expiration of the expiration date or the expiration date.
  • an alert is superimposed on the food image.
  • the present invention is not limited to such an example, and based on the detection result of the deterioration detection unit 103, the food to be consumed early is displayed. Any other display may be used as long as it can inform one user or the second user.
  • the display unit 71 of the second user terminal 70 also displays a food image indicating a change in color or size of the food image detected by the change detection unit 102, as schematically shown in FIG. 9B. May be.
  • a food image indicating a change in color or size of the food image detected by the change detection unit 102
  • FIG. 9B May be.
  • the food change display screen 64 which displays the change of a magnitude
  • the 1st user and the 2nd user can grasp
  • the deterioration detection unit 103 detects the deterioration state of the food based on changes in the color and size of each food image stored in the change detection unit 102 at regular intervals, and based on the detection result, Predicting the time when one user or the second user should consume food (notifying time to the first user or the second user) and displaying an alert on the display unit of the mobile terminal when the predicted time is reached. desirable.
  • the use status acquisition unit 104 determines the storage state of the food stored in the refrigerator compartment 11, that is, the first user storing the food from the information on the deterioration state of the food image unit transmitted from the deterioration detection unit 103. Detect (acquire) usage status. Specifically, if there is no deterioration in the currently stored food, it is detected that the food is always replaced and stored properly, and there is a movement of the food as a whole. The usage situation that the existence of the food is forgotten if the food has deteriorated, and the usage situation that the refrigerator compartment 11 itself is not used if many foods have been left for several days with deterioration. Is detected.
  • the life management unit 105 receives the first information indicating the usage status of the first user detected by the usage status acquisition unit 104, and detects the living status based on the first information indicating the usage status. For example, if food is constantly being replaced, if the first user frequently goes shopping and eats at home, or if the presence of a particular food in the storage room is forgotten, simply In addition to forgetting the existence, it is also possible to detect a life in which the food is not used, that is, a living situation in which there is a possibility of having an unbalanced diet. Further, when a situation in which the refrigerator compartment 11 itself is not used is detected as the usage situation, there is a possibility that the first user has been out for a long period of time or that some safety problem has occurred. is assumed.
  • the life management unit 105 classifies information determined to be notified to the second user from the detected second information indicating the life status of the first user.
  • information determined to be notified to the second user there is no problem at all in the living situation where the food in the storage room is always replaced and the first user is assumed to be shopping and eating properly.
  • eating habits related information that the eating habits may be biased, or a usage situation in which the refrigerator compartment 11 itself is not used is determined as a situation related to health problems or crimes of the first user.
  • it notifies to the 2nd user terminal 70 which the 2nd user different from the 1st user who uses the refrigerator 1 has via the communication part 23 as safety related information.
  • conditions for determining that the second user should be notified in the second information indicating the detected life status of the first user are set in advance.
  • a threshold value for determining whether to notify the second user is set in advance. If it is made to cancel
  • the second information indicating the life situation acquired by the life management unit 105 and notified to the second user is not limited to the safety related information.
  • the second information to be notified is, for example, when a food change in the storage room occurs during a trip or during work or school on a weekday daytime (at a time when no one should be at home)
  • the crime prevention related information may be notified to the second user.
  • the second user can promptly report to the police or security company, and can prevent crimes.
  • a usage warning can be notified to the second user as dietary related information.
  • Such notification is useful information for parents or wife who manage the health status of a single child or a husband who lives alone from a remote location.
  • the second user who owns the second user terminal 70 may be a second user who has been authenticated in advance.
  • the above-mentioned dietary information is personal information, it is assumed that it will not be a big problem in terms of security even if it is disclosed to unspecified third parties.
  • the safety related information or the crime prevention related information includes the health information of the first user or the home or absence information of the first user, a helper or the like when the first user is an elderly person
  • the 2nd user terminal 70 which can receive the 2nd information which shows the living situation of the 1st user beforehand is set up beforehand. Note that an authentication method for the second user who owns the second user terminal 70 will be described in a fourth embodiment.
  • the food image is extracted and managed from the image in the refrigerator compartment 11 photographed by the photographing device 27, and the second user terminal
  • the display unit 71 displays a food image and information related to the deterioration of the food (for example, information indicating the deterioration state). Therefore, not only the first user but also the second user can grasp the food stored in the refrigerator compartment 11 even in a remote place (for example, a shopping destination), and can grasp the food to be consumed particularly quickly among them. it can.
  • the second user can be encouraged to consume the food by the expiration date, and wasteful disposal of the food can be suppressed.
  • waste of space and energy due to leaving food in the refrigerator compartment 11 for a long period of time can be reduced.
  • the food stock status or deterioration state can be confirmed on the mobile terminal, so that the temperature rise in the refrigerator compartment 11 due to the opening and closing of the door 20 is suppressed, and the power consumption is reduced. can do.
  • the first user and the second user can easily determine how long a certain food has been stored in the refrigerator compartment 11.
  • the purchase of food can be determined in consideration of the expiration date or expiration date of the stock food.
  • the food image is stored together with the loading / unloading identification information and time information, and the deterioration state of the food is detected based on the information. Therefore, the food image is changed and the time elapsed since the loading is taken into consideration. Can be detected with high accuracy.
  • the imaging device 27 captures a storage room image, and the image management unit 101 extracts a food image from the storage room image, so that the food in the refrigerator compartment 11 may change. Information is updated every time Therefore, the 1st user and the 2nd user can know stock food and its deterioration state more correctly.
  • the deterioration detection unit 103 detects the deterioration state of the food based on the change in the color and / or size (or both) of the food image, the detection accuracy of deterioration such as oxidation (methanization) and spoilage is increased. Can do.
  • the 2nd information which shows the living condition of the 1st user who owns the refrigerator 1 can be detected from the stock condition or the deterioration state of the foodstuffs in the refrigerator compartment 11, and the 1st user's safety relation is detected as the living condition.
  • Information, crime prevention related information, eating habits related information or the like is notified to a limited second user. For this reason, it is possible to confirm the safety status of elderly parents, the crime prevention status of an answering house, the health status of a family living away from a remote location, etc., and it is possible to take appropriate countermeasures for each. It is done.
  • the image management unit 101 identifies food warehousing or warehousing, but in addition to food warehousing and warehousing, food movement in the refrigerator compartment 11 is identified. Also good.
  • Food movement is identified by the following method, for example. That is, as described above, the image management unit 101 obtains a difference image between the storage room images at the previous and current door opening and closing times. Furthermore, it is determined by matching processing whether there is a difference image of the storage room image at the time of opening and closing the previous door and the previous time and the difference image of the storage room image at the time of opening and closing the door of the previous time and this time. . As a result of the matching process, if any of the difference images of the storage room images at the previous and previous door opening / closing coincides with the difference images of the storage room images at the previous and current door opening / closing, the food is refrigerated. It is determined that it has moved in the chamber 11.
  • the deterioration detection unit 103 calculates the elapsed time from the receipt of the food (that is, the inventory period), the inventory period before the food is moved in the refrigerator compartment 11 is also included, so that the deterioration state of the food can be detected.
  • the accuracy of notification to two users can be improved.
  • various information images of the refrigerator compartment 11 or extracted food images, changes in color and size of food images over time, food deterioration states, first user information indicating the usage status of the first user).
  • first user information indicating the usage status of the first user.
  • the life management unit 105 the life status is detected in the second information indicating the detected life status of the first user.
  • the various types of information may be transmitted to the second user terminal 70 only when it is determined that the situation should be notified to the second user. Thereby, useless transmission can be prevented and the burden on the second user can be reduced.
  • the photographing device 27 is provided in the refrigerator compartment 11, but it may be provided in a storage room other than the refrigerator compartment 11, or may be installed in a plurality of storage rooms simultaneously.
  • the photographing device 27 is installed in the vegetable room 15 in which vegetables that have a relatively short purchase cycle and are likely to deteriorate, the frequency of shopping can be grasped in a shorter period of time as the occurrence of deterioration or the living situation.
  • it is additionally provided in the freezer compartment 14, it is possible to detect the use status of frozen meat or rice and frozen food as dietary related information.
  • FIG. 10 is a cross-sectional view showing a schematic structure (a cross-sectional structure taken along line II-II in FIG. 1) of refrigerator compartment 11 of refrigerator 2 according to Embodiment 2 of the present invention.
  • FIG. 10 components that are the same as or correspond to the components shown in FIG. 2 are assigned the same reference numerals as those shown in FIG.
  • FIG. 11 is a block diagram schematically showing the configuration of the control system of the refrigerator 2 according to the second embodiment.
  • the same reference numerals as those shown in FIG. 3 are given to the same or corresponding elements as those shown in FIG.
  • the refrigerator 2 according to the second embodiment is different from the refrigerator 1 according to the first embodiment in that the control unit 200 includes a food information storage unit 106 and a food identification unit 107. Is different.
  • the control unit 200 is provided on the control board 210, for example.
  • the food information storage unit 106 and the storage unit 24 may be separate storage devices, or may be different storage areas of the same storage device.
  • the food information storage unit 106 may be a storage area of an information storage unit of an external device (for example, a server) that can communicate via a network.
  • the food identification unit 107 is connected to the image management unit 101, the change detection unit 102, and the food information storage unit 106.
  • the food identification unit 107 receives the food image extracted by the image management unit 101, and identifies the food (for example, the type and amount of food) stored in the storage room (here, the refrigerator room 11).
  • the food identification unit 107 refers to information stored in the food information storage unit 106 in order to identify the type of food.
  • the food identification unit 107 adds identification information (information about the type and amount of food) indicating the identification result to each supplementary information (time information and entry / exit identification information) of the food image received from the image management unit 101.
  • the change detection unit 102 is provided with the food image and the incidental information to which the identification information is added.
  • the food information storage unit 106 is connected to the food identification unit 107.
  • the food information storage unit 106 has, for each type of food, a characteristic attribute for distinguishing the type of food from other types of food (for example, at least one of the shape, size, color, and exterior label of the food) Is stored as reference information associated with the type of food.
  • FIG. 12 is a diagram showing an example of the specific information (food image database) stored in the food information storage unit 106.
  • the food information storage unit 106 stores the characteristic amount of the food itself belonging to the type of food or the characteristic amount of the container containing the food in association with the type of food.
  • the food information storage unit 106 features information such as a shape (contour), a major axis size, a representative color (red green blue (RGB) value), and a label (character) for each type of food. I remember it as a quantity.
  • the food identification unit 107 collates the food shape of the acquired food image with the food shape stored in the food information storage unit 106, for example, by a method such as pattern matching. Moreover, you may make it the food identification part 107 use other index values, such as brightness or a saturation, for example other than the RGB value of a representative color about the color of a food image.
  • control unit 200 may be configured by an electric circuit, or may be configured by a processor as an information processing device that executes a program as software stored in the storage unit 24.
  • control unit 200 is configured by a processor, the function of the control unit 200 is realized by executing a program stored in the storage unit 24.
  • FIG. 13 is a flowchart for explaining an operation performed each time the door 20 of the refrigerator 2 is opened and closed.
  • steps that are the same as or correspond to the steps shown in FIG. 4 (Embodiment 1) are assigned the same step numbers as the step numbers shown in FIG.
  • the image management unit 101 calculates the difference between the storage room images when the door 20 is opened / closed last time and this time.
  • the image is extracted as a food image, the time information when the extraction is performed, and the food image is determined based on the time of the extraction, and the food identification information is stored in the image management unit 101 as supplementary information together with the food image.
  • Step S15 the operation is the same as that of the first embodiment shown in FIG.
  • the image management unit 101 transmits the extracted food image and the accompanying information to the change detecting unit 102.
  • the image management unit 101 uses the extracted food image and the accompanying information as the food. It gives to the identification part 107 (step S21).
  • the food identification unit 107 refers to the information stored in the food information storage unit 106 (for example, the information shown in FIG. 12), and based on the food image received from the image management unit 101, the storage room (here, The type and amount of food stored in the refrigerator compartment 11) are identified (step S22). In this identification, the food identification unit 107 selects the feature value of which food type among the types of food stored in the food information storage unit 106 for each food image extracted by the image management unit 101. Check for a match.
  • the food identification unit 107 It is determined that the type of food in the image extracted by the management unit 101 is a type associated with the matched feature amount. If there is no feature amount (feature type feature amount stored in the food information storage unit 106) that matches the extracted food image in the food information storage unit 106, the food identification unit 107 The food type of the image extracted by the management unit 101 may be replaced with the most similar food type, or the food of this image may be configured to identify only the size as a stored item of unknown type. Good.
  • the food identification unit 107 indicates the type and amount of the food identified in this way in the food image received from the image management unit 101 and the incidental information (time information and entry / exit identification information) for each food image. Information is added as incidental information (step S23), and the food image and incidental information are given to the change detection unit 102 as in the case of the first embodiment (step S24).
  • the change is made in the same manner as in the first embodiment, based on the food image and incidental information (time information, information indicating the type and amount of food, and entry / exit identification information) received from the food identification unit 107.
  • the detection unit 102 detects and stores temporal changes in the color and size of the food image.
  • the deterioration detection unit 103 uses a uniform judgment criterion regardless of the type of food. A deterioration state was detected. That is, the deterioration detection unit 103 makes a determination based on a plurality of indices for one food image, and if the at least one index exceeds a predetermined reference value, the target food is “consumed early”. It is necessary ”.
  • the deterioration state of food varies depending on the type of food (meat, fish, vegetables, etc.).
  • meat and fish which are the same fresh food, are generally cooked, even if the color changes from red to brown due to oxidation (metoization), even if the fish eaten raw as sashimi is severely degraded
  • metalization oxidation
  • the leafy vegetables are deflated or shrunk by transpiration and become smaller, but the size of what is in the container, such as milk or dressing, does not change no matter how much it deteriorates.
  • the deterioration detection unit 103 detects the deterioration state of the food
  • the criterion for judging deterioration reflecting the information indicating the type and amount of the food identified by the food identification unit 107 is used. The value has been changed. Thereby, the detection accuracy of the deterioration state of food can be improved.
  • the reference value for judging deterioration is registered in advance, but the reference value is changed depending on the type of food, and it is the same by methodization or decay
  • the reference value for the color change is set larger than that of the fish whose color changes (for example, tuna).
  • the same food for example, thin sliced meat that can be photographed almost entirely, and block meat that can only photograph the surface, even if the area occupancy that has changed color due to methodization or spoilage is the same, the block meat also undergoes internal deterioration Therefore, the deterioration can be detected in advance by setting the reference value to be small by reflecting the information indicating the amount.
  • the change in size over time reflects information indicating the type of food, and the food contained in the container is excluded from the criteria for judging deterioration, thereby improving the detection accuracy of the food deterioration state. be able to.
  • the detection accuracy of the deterioration state of the food in the deterioration detection unit 103 is reflected by reflecting the information indicating the type and amount of the food. Will improve. Therefore, based on the deterioration state of the food, the first information indicating the usage status of the refrigerator compartment 11 detected by the usage status acquisition unit 104 and the life status of the first user detected by the life management unit 105 are displayed. The precision of the 2nd information to show can be improved.
  • the life management unit 105 first It is determined that a health or safety problem has occurred in the user, and the safety related information is notified to the second user terminal 70 used by the second user via the communication unit 23.
  • the deteriorated food is a seasoning or a luxury product that is used only in a specific dish, it is highly likely that the first user has forgotten to use it, so the urgency is reduced, It is possible to suppress useless notification.
  • FIG. 14 is a cross-sectional view showing a schematic structure (a cross-sectional structure taken along line II-II in FIG. 1) of refrigerator compartment 11 of refrigerator 3 according to Embodiment 3 of the present invention. 14, components that are the same as or correspond to the components shown in FIGS. 2 and 10 are given the same reference numerals as those shown in FIGS.
  • FIG. 15 is a block diagram schematically showing the configuration of the control system of the refrigerator 3 according to the third embodiment. 15, components that are the same as or correspond to the components shown in FIGS. 3 and 11 are given the same reference numerals as those shown in FIGS.
  • the refrigerator 3 according to the third embodiment is different from the refrigerator 2 according to the second embodiment in that a schedule management unit 108 and a schedule setting unit 109 are provided. More specifically, the refrigerator 3 according to the third embodiment is a user who actually uses the refrigerator 3 for an operation panel 21a as an operation unit or an operation display unit installed on the door 20 of the refrigerator compartment 11.
  • a schedule setting unit 109 capable of inputting and displaying a schedule that is an action plan of the first user is built in, and is input to the control board 310 as a control device attached to the back of the refrigerator 3 by the schedule setting unit 109. This is different from the refrigerator 2 according to the second embodiment in that a schedule management unit 108 that manages the performed schedule is implemented.
  • the operation panel 21a is, for example, a touch panel having an image display function and an information input function.
  • the schedule setting unit 109 has, for example, a schedule input button displayed on the operation panel 21a.
  • the schedule input button of the schedule setting unit 109 may be a display unit (touch panel) of the first user's mobile terminal that can communicate with the refrigerator 3.
  • the schedule management unit 108 can display information useful for the schedule management of the first user on the operation panel 21a using the input schedule.
  • the first user of the refrigerator 3 schedules whether the resident of the residence where the refrigerator 3 is installed (that is, the first user of the refrigerator 3) is at home or away from the operation panel 21a (scheduled presence or absence).
  • the first user's life pattern for example, a pattern such as wake-up time, bedtime, work time, home time, meal time, etc.
  • the first user's shopping pattern for example, a pattern of shopping cycles in one week, supplement to the refrigerator
  • Schedule information such as the type and amount of food to be made).
  • the schedule information is displayed on the operation panel 21a as shown in FIGS.
  • the schedule information of the first user of the refrigerator 3 is managed in the refrigerator 3.
  • a server on the network a cloud server 602 in FIG. 19 to be described later
  • the schedule management unit 108 is connected to the schedule setting unit 109 and the life management unit 105 in the operation panel 21a, and receives schedule information of the first user of the refrigerator 3 input to the schedule setting unit 109 from the operation panel 21a.
  • the schedule information is displayed on the schedule setting unit 109 in a predetermined format (shown in FIGS. 16 to 18 to be described later) and given to the life management unit 105.
  • 16 to 18 are diagrams showing examples of a schedule display screen showing schedule information set by the schedule setting unit 109 of the refrigerator 3 according to the third embodiment. 16 to 18 show examples of screens in which the schedule information of the input first user is managed by the schedule management unit 108 and is displayed again on the operation panel 21a. 16 shows an example of a schedule display for one month, FIG. 17 shows an example of a schedule display for one week, and FIG. 18 shows an example of a schedule display for one day.
  • the first user of the refrigerator 3 is a family of four people, that is, the father “Taro” (TARO), the mother “Hanako” (HANAKO), the eldest daughter “Kazumi” (TOMOMI), and the eldest son “Kazuo” (KAZUO). ).
  • TARO father “Taro”
  • HANAKO mother “Hanako”
  • TOMOMI eldest daughter
  • KAZUO eldest son “Kazuo”
  • the scheduled mark 91a “all” (ALL) indicates that the entire family has a schedule
  • the scheduled mark 91b “thick” (TA) indicates that “Taro” has a schedule
  • the scheduled mark 91c “flower” “(HANA) indicates that there is a plan for" Hanako "
  • a scheduled mark 91d” Wa indicates that there is a plan for" Kazumi "
  • a scheduled mark 91e” One “(KAZU) indicates” “Ichio” shows that there is a plan.
  • a schedule content mark 92 (92a to 92g) is shown in the one week schedule display of FIG.
  • the schedule content mark 92a indicates that the trip is scheduled
  • the schedule content mark 92b indicates that the trip is scheduled
  • the schedule content mark 92c indicates that the golf is scheduled
  • the schedule content mark 92d is
  • the schedule content mark 92e indicates that there is a plan for swimming (learning)
  • the schedule content mark 92f indicates that there is a plan for piano (learning)
  • the schedule content mark 92g indicates soccer ( It shows that there is a schedule of learning.
  • the current time 93 the outing period scheduled in the normal period (that is, the period in which a regularly repeated action pattern exists)
  • Time periods 94a, 94b, outing periods 95a, 95b and a sleeping period 96 scheduled in a period other than the normal period (that is, a period in which there is no regularly repeated action pattern) are shown.
  • the outing period 95a scheduled in a period other than the normal period indicates that there is (or has been) a business trip
  • the outing period 95b scheduled in a period other than the normal period has a plan to eat out. (Or was there).
  • the outing period 94a scheduled in the normal period indicates that there is (or was) a work schedule
  • the outing period 94b scheduled in the normal period indicates that the school is scheduled (or was). Show.
  • the life management unit 105 uses the refrigerator 3 based on the usage status of the refrigerator compartment 11 acquired from the storage status or the deterioration status of the food in the storage chamber.
  • the second information indicating the life status of one user is detected (acquired).
  • the life management unit 105 indicates the living state of the first user.
  • the determination as to whether or not the second information is information to be notified to the second user is erroneous (that is, an appropriate determination cannot be made).
  • the refrigerator It is not necessary to notify safety-related information to a second user different from the first user who uses 3.
  • the expiry date of a luxury item such as cake is approaching, if it is determined taking into consideration the type of food, it is a luxury item and there is no urgency, so the second user is notified. do not have to.
  • the schedule management unit 108 manages the schedule information of the first user input by the operation panel 21a (that is, the schedule setting unit 109 of the operation panel 21a),
  • the schedule setting unit 109 displays a schedule on the operation panel 21 a and gives schedule information indicating the schedule to the life management unit 105.
  • the life management unit 105 in the third embodiment adds to the first information indicating the use state detected based on the deterioration state of the food in the use state acquisition unit 104 described in the first and second embodiments. It is possible to detect and manage the second information indicating the living status of the first user reflecting the schedule information of the first user.
  • unnecessary safety-related information can be prevented from being notified to a second user such as a family living in a distant place.
  • December 25 shown in the daily schedule display of FIG. 18 is not in the normal period in addition to the outing time zones 94a and 94b scheduled in the normal period.
  • the usage status acquisition unit 104 detects a situation where a food item whose expiration date is approaching, such as sashimi or cake, is not used, the life management unit 105 is the first tonight.
  • the second user By reflecting the schedule information that all users (all family members) are eating out, the second user, who is a family living in the neighborhood, is notified that there is food in the refrigerator 3 that is about to expire. Can be used by the second user. In this way, wasteful disposal of food can be prevented.
  • the life management unit 105 uses the first user's schedule information to indicate the second user's life situation. Since it is determined whether or not the information is information to be notified to the second user, it is based on notification of the second information of information that does not need to be notified to the second user (that is, excessive notification of the second information). It is possible to prevent communication loss and food loss due to notification failure (that is, insufficient notification) of the second information that needs to be notified to the second user.
  • the continuous storage pattern of the foodstuff in a storage room the pattern of a 1st user's shopping, etc. It can be assumed. For example, when the deterioration state of the food progresses as it approaches the weekend, and the weekday daytime schedule is almost filled with the outing periods 94a and 94b scheduled in the normal period shown in FIG. It is assumed that the household has a shopping pattern in which food is bought at the weekend.
  • the life management unit 105 sends a second user (for example, an electrical store with a long-standing transaction, or a service representative of the electrical store) to the second user different from the first user who uses the refrigerator 3.
  • the second information indicating the living status of the first user can be notified.
  • the transmission destination of the schedule information may be the deterioration detection unit 5 or the usage status acquisition unit 104 arranged in a stage preceding the life management unit 105.
  • the schedule information can be reflected in the detection of the living condition of the first user, and particularly when the schedule information is sent to the deterioration detection unit 103, the deterioration state of the generated food is It is possible to determine in advance whether it is accidental or inevitable due to a change in the schedule of the first user. For this reason, the 2nd information which shows the 1st user's living condition can be appropriately notified to the 2nd user via communications department 23.
  • FIG. 19 is a diagram illustrating a schematic configuration of a network system according to the fourth embodiment.
  • the same components as those described in the first to third embodiments are denoted by the same reference numerals as those used in the first to third embodiments.
  • the network system according to the fourth embodiment includes a home system 500 and an outside system 600 that can communicate with the home system 500 via the Internet.
  • Home system 500 includes refrigerator 4.
  • the refrigerator 4 is any one of the refrigerators 1, 2, and 3 of the first, second, and third embodiments.
  • the in-home system 500 includes home appliances such as a refrigerator 4, a room air conditioner, a water heater, an IH (Induction Heating) cooking heater, and a microwave oven. These home appliances and power measuring device 503 are connected to the system power source 501 by the electric lamp line 502, and power is supplied from the system power source 501.
  • the in-home system 500 includes a power measurement device 503 and a power measurement terminal 504 for measuring the power supplied from the system power source 501 to each home appliance through the power line 502, a home controller 505, a broadband router 506, and a communication device.
  • Device communication unit 515 Device communication unit 515.
  • the power measuring device 503 measures the power supplied to each home appliance (that is, the power consumption of each home appliance) and the total power supplied from the system power source 501 to the entire home appliance and the power measuring device 503. Measurement results (history) can be saved.
  • the power measuring device 503 measures the supplied power using a power measuring terminal 504 such as a CT (Current Transformer).
  • Each of the home appliance and the power measuring device 503 is provided with a device communication unit 515 for communicating with the home controller 505 via a communication network.
  • the communication network is, for example, a wired or wireless LAN (local area network).
  • the home appliances such as the refrigerator 4 and the power measuring device 503 can bidirectionally communicate with the in-home controller 505 via the respective device communication units 515 in a wired or wireless manner.
  • the apparatus communication part 515 connected to the refrigerator 4 plays the same role as the communication part 23 as a communication apparatus demonstrated by Embodiment 1-3. Therefore, when the communication unit 23 of the refrigerator 4 can directly communicate with the home controller 505 by wire or wireless, it is not necessary to include the device communication unit 515 for the refrigerator 4.
  • the device communication unit 515 When the device communication unit 515 has a function of performing wired communication, the device communication unit 515 includes a wired communication module such as a serial interface or a driver, for example. When the device communication unit 515 has a wireless communication function, the device communication unit 515 includes a wireless communication module such as Wi-Fi (registered trademark) or Bluetooth (registered trademark). Note that the device communication unit 515 may be included in each of the home appliance and the power measurement device 503 or may be provided outside the home appliance and the power measurement device 503.
  • Wi-Fi registered trademark
  • Bluetooth registered trademark
  • the home controller 505 can acquire information on the power consumption of the home appliance and the power supplied to the system power source 501 measured by the power measuring device 503 from the power measuring device 503 via the communication network. Further, the home controller 505 can acquire information on the operating state of the home appliance via the communication network. Then, the home controller 505 manages the acquired power consumption, supply power, and operating state information, and if necessary, controls change instructions (for example, operating state change instructions) to the home appliance via the communication network. ) Can be transmitted.
  • change instructions for example, operating state change instructions
  • the home controller 505 is connected to the Internet 601 of the outside system 600 via the broadband router 506.
  • the Internet 601 is connected to a cloud server 602 in which various power information and environmental information such as weather forecasts are stored.
  • the Internet 601 is also connected to the second user terminal 70.
  • the second user terminal 70 is a device used by a second user different from the first user of the refrigerator 4 as described in the first embodiment.
  • the second user terminal 70 is, for example, a smart phone, a mobile tablet, a second user (a manager such as a family member, a relative, a friend, an acquaintance, a security company, a public institution, or a care company) that has been given usage rights.
  • a device having a communication function such as a mobile phone or a personal computer.
  • the cloud server 602 is an external server that is communicably connected to the refrigerator 4 and the second user terminal 70 via the Internet 601. It is desirable that the cloud server 602 includes a personal authentication unit 603 that authenticates the second user terminal 70 with or without connection authority to the refrigerator 4.
  • the cloud server 602 stores in advance a portable terminal ID of the second user terminal 70 having the authority to connect to the refrigerator 4 with respect to the ID (identifier) of the refrigerator 4 in a built-in or externally connected storage unit.
  • the ID of the refrigerator 4 is information that can uniquely identify each of the plurality of refrigerators that can be connected to the Internet 601.
  • the mobile terminal ID is information that can uniquely identify each of a plurality of mobile terminals connected to the Internet 601.
  • the personal authentication unit 603 determines whether or not the portable terminal ID of the second user terminal 70 is stored as having authority to connect to the refrigerator 4 with respect to the refrigerator 4 (at the registered second user terminal). By checking whether or not there is an authority to connect to the refrigerator 4 with respect to the second user terminal 70.
  • the cloud server 602 as an external server connects (communications) the second user terminal 70 that has been authenticated by the personal authentication unit 603 to have the authority to connect to the refrigerator 4 to the refrigerator 4 via the Internet 601. to approve. That is, the cloud server 602 prohibits a mobile terminal that is not authenticated to have authority to connect to the refrigerator 4 by the personal authentication unit 603 from connecting to the refrigerator 4 via the Internet 601.
  • the home controller 505 obtains the power consumption of the home appliance or the power supplied from the system power source 501 from the power measuring device 503 in the home system 500, and obtains information on the operating state or the surrounding environment from the home appliance. Further, the home controller 505 is connected to the Internet 601 via the broadband router 506, and can obtain various power information or various environment information from the cloud server 602.
  • the in-home controller 505 of the in-home system 500 can obtain the power supply / demand situation regarding the area where the in-home system 500 is installed as power information from the cloud server 602 of the outside system 600.
  • the in-home controller 505 can transmit a power saving instruction to a home electric appliance with particularly high power consumption.
  • a power saving instruction to a home electric appliance with particularly high power consumption.
  • an increase in the set temperature can be instructed from the home controller 505.
  • the second user terminal 70 can be connected to the refrigerator 4 directly or indirectly via the Internet 601 and via the home controller 505. At this time, only the second user terminal 70 that is authenticated by the personal authentication unit 603 of the cloud server 602 to be authorized to connect to the refrigerator 4 is permitted to connect to the refrigerator 4.
  • the portable terminal ID of the second user terminal 70 is registered, the life status of the first user of the refrigerator 4 is shown while maintaining security.
  • the second information can be shared. Further, not only the first user but also the second user can check the stock status of the food in the storage room of the refrigerator 4 at a shopping destination such as a supermarket. Or forgetting to buy necessary food.
  • all or part of the reference information referred to by the food identification unit may be stored in the cloud server 602 that is an external server.
  • the reference information of the food information storage unit (configuration 106 in FIG. 11) in the cloud server 602
  • huge data regarding the type of food is shared with users other than the first user and the second user, for example. Is possible.
  • the personal authentication unit 603 described above authenticates the connection authority using the ID
  • the authentication method is not limited to this.
  • the personal authentication unit 603 replaces the authentication using the ID or in addition to the authentication using the ID, for example, biometric authentication such as a fingerprint, a vein, and an iris of the eye, or authentication using a password, or these authentication methods.
  • the connection authority may be authenticated by a combination of.
  • the second terminal device 70 used by the second user is Whether or not it is a portable terminal of a person who has authority to communicate with the refrigerator can be strictly authenticated. For this reason, it can prevent reliably that the usage condition of a refrigerator and the 1st user's living condition which are personal information of a 1st user leak to the person who does not have authority.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

L'invention concerne un réfrigérateur (1) utilisé par un premier utilisateur comprenant : une chambre de stockage qui stocke des aliments; une unité de communication (23) qui effectue des communications; un dispositif d'imagerie (27) qui acquiert une image de l'intérieur de la chambre de stockage; une unité de gestion d'image (101) qui extrait des images alimentaires de la chambre de stockage acquises par le dispositif d'imagerie (27); une unité de détection de l'état des aliments (103a) qui détecte pendant une certaine période et à partir d'images alimentaires s'il y a une modification de l'état des aliments stockés dans la chambre de stockage; une unité d'acquisition d'état d'utilisation (104) qui acquiert des premières informations indiquant l'état d'utilisation du réfrigérateur (1) par le premier utilisateur, à partir des changements d'état des aliments détectés par l'unité de détection d'état des aliments (103a); et une unité de gestion de vie (105) qui rapporte des secondes informations indiquant un niveau de vie à un dispositif terminal (70) utilisé par un second utilisateur par l'intermédiaire de l'unité de communication (23), s'il a été déterminé à partir des premières informations que le niveau de vie du premier utilisateur est dans un état qui devrait être rapporté au second utilisateur.
PCT/JP2016/071697 2016-07-25 2016-07-25 Réfrigérateur, système de réseau doté de celui-ci, procédé et programme de rapport de circonstances de vie WO2018020541A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2018530207A JP6576560B2 (ja) 2016-07-25 2016-07-25 冷蔵庫、それを備えたネットワークシステム、生活状況の報知方法、及び生活状況の報知プログラム
PCT/JP2016/071697 WO2018020541A1 (fr) 2016-07-25 2016-07-25 Réfrigérateur, système de réseau doté de celui-ci, procédé et programme de rapport de circonstances de vie
TW105127212A TWI751977B (zh) 2016-07-25 2016-08-25 冰箱、具有該冰箱之網路系統、生活狀況之通報方法以及生活狀況之通報程式

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/071697 WO2018020541A1 (fr) 2016-07-25 2016-07-25 Réfrigérateur, système de réseau doté de celui-ci, procédé et programme de rapport de circonstances de vie

Publications (1)

Publication Number Publication Date
WO2018020541A1 true WO2018020541A1 (fr) 2018-02-01

Family

ID=61015747

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/071697 WO2018020541A1 (fr) 2016-07-25 2016-07-25 Réfrigérateur, système de réseau doté de celui-ci, procédé et programme de rapport de circonstances de vie

Country Status (3)

Country Link
JP (1) JP6576560B2 (fr)
TW (1) TWI751977B (fr)
WO (1) WO2018020541A1 (fr)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019229949A1 (fr) * 2018-05-31 2019-12-05 三菱電機株式会社 Système de réfrigérateur
CN111709913A (zh) * 2020-05-21 2020-09-25 四川虹美智能科技有限公司 冰箱内变质食品检测方法、装置及系统
WO2020096235A3 (fr) * 2018-11-05 2020-10-15 삼성전자주식회사 Système de gestion des aliments, appareil serveur et réfrigérateur
WO2020245965A1 (fr) * 2019-06-06 2020-12-10 三菱電機株式会社 Dispositif de détection de comportement anormal, entrepôt d'articles, procédé de détection de comportement anormal, et programme de détection de comportement anormal
CN114294897A (zh) * 2021-04-19 2022-04-08 海信视像科技股份有限公司 冰箱及食材图标显示方法
US11335010B2 (en) 2019-08-15 2022-05-17 Haier Us Appliance Solutions, Inc. Methods for viewing and tracking stored items
WO2023007895A1 (fr) * 2021-07-30 2023-02-02 アイリスオーヤマ株式会社 Réfrigérateur
WO2023162312A1 (fr) * 2022-02-22 2023-08-31 日立グローバルライフソリューションズ株式会社 Système de gestion d'image, serveur de gestion d'image, procédé de gestion d'image et procédé de production de système de gestion d'image
WO2023166916A1 (fr) * 2022-03-02 2023-09-07 パナソニックＩｐマネジメント株式会社 Système de gestion d'articles, procédé de gestion d'articles et programme
WO2024116537A1 (fr) * 2022-11-29 2024-06-06 日立グローバルライフソリューションズ株式会社 Dispositif de classement et stockage

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001357475A (ja) * 2000-06-12 2001-12-26 Art Data:Kk 安否確認システム及びこのシステムを用いた付帯サービスシステム
JP2003030421A (ja) * 2001-07-13 2003-01-31 Seiko Epson Corp 生活支援システム及び生活支援方法
JP2005326113A (ja) * 2004-05-17 2005-11-24 Matsushita Electric Ind Co Ltd 保管庫とそのプログラム
JP2015081762A (ja) * 2013-10-24 2015-04-27 三菱電機株式会社 冷蔵庫
JP2016057022A (ja) * 2014-09-11 2016-04-21 株式会社東芝 食材管理システム
JP2016080232A (ja) * 2014-10-15 2016-05-16 三菱電機株式会社 冷蔵庫及びそれを備えたネットワークシステム

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004286355A (ja) * 2003-03-24 2004-10-14 Matsushita Electric Ind Co Ltd 冷蔵庫
WO2011139427A1 (fr) * 2010-05-07 2011-11-10 Alleato Inc. Procédé de surveillance d'un individu
JP2015068525A (ja) * 2013-09-27 2015-04-13 三菱電機株式会社 冷蔵庫
JP2015145732A (ja) * 2014-01-31 2015-08-13 三菱電機株式会社 冷凍冷蔵庫
JP6305122B2 (ja) * 2014-03-10 2018-04-04 三菱電機株式会社 冷蔵庫及び冷蔵庫を備えたネットワークシステム
CN105184719A (zh) * 2015-08-28 2015-12-23 小米科技有限责任公司 食品监控方法及装置
CN105513052B (zh) * 2015-11-26 2018-01-12 四川长虹电器股份有限公司 一种冰箱内食物存量及变质信息探知系统及方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001357475A (ja) * 2000-06-12 2001-12-26 Art Data:Kk 安否確認システム及びこのシステムを用いた付帯サービスシステム
JP2003030421A (ja) * 2001-07-13 2003-01-31 Seiko Epson Corp 生活支援システム及び生活支援方法
JP2005326113A (ja) * 2004-05-17 2005-11-24 Matsushita Electric Ind Co Ltd 保管庫とそのプログラム
JP2015081762A (ja) * 2013-10-24 2015-04-27 三菱電機株式会社 冷蔵庫
JP2016057022A (ja) * 2014-09-11 2016-04-21 株式会社東芝 食材管理システム
JP2016080232A (ja) * 2014-10-15 2016-05-16 三菱電機株式会社 冷蔵庫及びそれを備えたネットワークシステム

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2019229949A1 (ja) * 2018-05-31 2021-01-07 三菱電機株式会社 冷蔵庫及び冷蔵庫システム
WO2019229949A1 (fr) * 2018-05-31 2019-12-05 三菱電機株式会社 Système de réfrigérateur
WO2020096235A3 (fr) * 2018-11-05 2020-10-15 삼성전자주식회사 Système de gestion des aliments, appareil serveur et réfrigérateur
JP7270730B2 (ja) 2019-06-06 2023-05-10 三菱電機株式会社 異常行動検知装置、物品保管庫、異常行動検知方法、及び異常行動検知プログラム
WO2020245965A1 (fr) * 2019-06-06 2020-12-10 三菱電機株式会社 Dispositif de détection de comportement anormal, entrepôt d'articles, procédé de détection de comportement anormal, et programme de détection de comportement anormal
JPWO2020245965A1 (ja) * 2019-06-06 2021-10-14 三菱電機株式会社 異常行動検知装置、物品保管庫、異常行動検知方法、及び異常行動検知プログラム
US11335010B2 (en) 2019-08-15 2022-05-17 Haier Us Appliance Solutions, Inc. Methods for viewing and tracking stored items
CN111709913B (zh) * 2020-05-21 2023-04-18 四川虹美智能科技有限公司 冰箱内变质食品检测方法、装置及系统
CN111709913A (zh) * 2020-05-21 2020-09-25 四川虹美智能科技有限公司 冰箱内变质食品检测方法、装置及系统
CN114294897A (zh) * 2021-04-19 2022-04-08 海信视像科技股份有限公司 冰箱及食材图标显示方法
WO2023007895A1 (fr) * 2021-07-30 2023-02-02 アイリスオーヤマ株式会社 Réfrigérateur
WO2023162312A1 (fr) * 2022-02-22 2023-08-31 日立グローバルライフソリューションズ株式会社 Système de gestion d'image, serveur de gestion d'image, procédé de gestion d'image et procédé de production de système de gestion d'image
WO2023166916A1 (fr) * 2022-03-02 2023-09-07 パナソニックＩｐマネジメント株式会社 Système de gestion d'articles, procédé de gestion d'articles et programme
WO2024116537A1 (fr) * 2022-11-29 2024-06-06 日立グローバルライフソリューションズ株式会社 Dispositif de classement et stockage

Also Published As

Publication number Publication date
JP6576560B2 (ja) 2019-09-18
JPWO2018020541A1 (ja) 2018-08-30
TWI751977B (zh) 2022-01-11
TW201804860A (zh) 2018-02-01

Similar Documents

Publication Publication Date Title
JP6576560B2 (ja) 冷蔵庫、それを備えたネットワークシステム、生活状況の報知方法、及び生活状況の報知プログラム
JP6324360B2 (ja) 冷蔵庫及びそれを含むネットワークシステム
JP6745872B2 (ja) 冷蔵庫及びそれを含むネットワークシステム
KR102003149B1 (ko) 정보 생성 방법 및 디바이스
JP6336816B2 (ja) 冷蔵庫
US7673464B2 (en) Method and apparatus for temperature based placement of an item within a storage unit
WO2017044917A1 (fr) Appareil et système pour la télédétection, la surveillance, l'analyse et l'alerte d'attributs environnementaux
CN106642969A (zh) 冰箱的食物管理方法及冰箱
JP2016130609A (ja) 冷蔵庫
JP6447334B2 (ja) 冷蔵庫及びネットワークシステム
WO2019029442A1 (fr) Procédé de stockage d'articles pour réfrigérateur partagé, et réfrigérateur partagé
JP2006317109A (ja) 冷蔵庫
JP6410550B2 (ja) 冷蔵庫及びそれを備えたネットワークシステム
JP2023083476A (ja) プログラム
JP6335847B2 (ja) 冷蔵庫
CN109631453B (zh) 冰箱
JP7467897B2 (ja) 食材管理システム
JP2018112402A (ja) 冷蔵庫
WO2021014931A1 (fr) Système
WO2021210132A1 (fr) Réfrigérateur
WO2021014930A1 (fr) Dispositif d'information et procédé de commande
WO2024004569A1 (fr) Étiquette, procédé de commande et système de commande
JP7266004B2 (ja) 管理装置
KR20180006719A (ko) 바코드인식을 통해 유통기한과 칼로리 안내 기능을 갖는 다기능 주방용 디스플레이장치
JP2023136970A (ja) 調理支援システムおよび調理支援装置

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2018530207

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16910445

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16910445

Country of ref document: EP

Kind code of ref document: A1