JP2007046834A - Article storage, article storage monitoring system and refrigerator monitoring system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an article storage, an article storage monitoring system and a refrigerator monitoring system capable of easily grasping the change of stored objects inside the article storage such as a refrigerator. <P>SOLUTION: The refrigerator monitoring system comprises the refrigerator 1, a server and a cellphone respectively connected through an electric communication line. A CPU 151 of the refrigerator 1 detects the presence of the change of stored objects inside a refrigerator body 11 based on image data acquired by an image pickup part 14, specifies the change position of the changed stored object in the case of detecting the change, performs image processing so that the change position of the stored object can be identified, and further transmits the image data to the server by a transmitting part 16. The server stores the image data by a storage part, notifies the cellphone by a transmitting-receiving part, and further transmits the image data to the cellphone. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an article storage, an article storage monitoring system, and a refrigerator monitoring system.

  Conventionally, in a refrigerator as an article storage, image data obtained by imaging the inside of the refrigerator is transmitted to a mobile phone of a user at a remote place via an electric communication line such as the Internet, and the image data is displayed on a display screen of the mobile phone. A technique is disclosed in which the stock status of food can be confirmed by displaying an image based on (see, for example, Patent Document 1).

In addition, a technique is disclosed in which a terminal or the like can connect to a network via an Internet service provider using wireless communication or a telephone line, and can check inventory information of a refrigerator from a server (for example, Patent Document 2). reference).
JP 2002-236798 A JP 2002-081818 A

  However, in the techniques disclosed in Patent Document 1 and Patent Document 2, even when there is no change in the stored item while going out, for confirmation, the image based on the image data captured inside the refrigerator is viewed or inventory information is displayed. There was a problem that it had to be checked and took extra time.

  The subject of this invention is providing the goods storage, the goods storage monitoring system, and the refrigerator monitoring system which can grasp | ascertain easily the change of the articles | goods inside goods storage, such as a refrigerator.

In order to solve the above problems, the invention according to claim 1 is a refrigerator, a management device connected to the refrigerator via an electric communication line, and a terminal connected to the management device via an electric communication line. A refrigerator monitoring system comprising:
The refrigerator is
A refrigerator body having an openable / closable door;
Door closing detection means for detecting closing of the door;
Based on the detection of the closing of the door by the door closing detection means, an imaging means for imaging the inside of the refrigerator main body and acquiring image data;
Based on the image data acquired by the imaging unit, a determination unit that determines whether there is a change in the stored item inside the refrigerator body;
When it is determined by the determining means that there is a change in the stored item inside the refrigerator body, the specifying unit for specifying the change position of the stored item inside the refrigerator body;
The change position of the stored item inside the refrigerator body specified by the specifying unit can be identified in the image data determined by the determining unit as a change in the stored item inside the refrigerator body. Image processing means for image processing;
Transmission means for transmitting the image data image-processed by the image processing means to the management device,
The management device
Storage means for storing the image data transmitted by the transmission means;
When the image data is transmitted from the transmission unit, a notification unit that notifies the terminal device to that effect;
Image data transmission means for transmitting the image data stored by the storage means to the terminal device in response to a request from the terminal device;
It is characterized by providing.

The invention according to claim 2 is an article storage box connected to the terminal device via a telecommunication line,
An article storage body having an openable / closable door;
Door closing detection means for detecting closing of the door;
Based on the detection of the closing movement of the door by the door closing detection means, an imaging means for imaging the inside of the article storage body and acquiring image data;
A determination means for determining whether or not there is a change in the stored item inside the article storage body based on the image data acquired by the imaging means;
Transmitting means for transmitting predetermined notification information to the terminal device when it is determined by the determining means that there is a change in the stored items inside the article storage body;
It is characterized by providing.

The invention according to claim 3 is the invention according to claim 2, wherein, when the determination means determines that there is a change in the stored item inside the article storage body, the article storage container is further provided. A specifying means for specifying the change position of the stored item inside the main body is provided.
The notification information includes information related to a change position of the stored item inside the article storage body specified by the specifying unit.

  According to a fourth aspect of the present invention, in the invention according to the second or third aspect, the notification information includes the image data that is determined to have a change in a stored item inside the article storage body. It is characterized by that.

According to a fifth aspect of the present invention, in the invention according to the third or fourth aspect, the specifying means may include the image data determined by the determining means that there is a change in the stored items inside the article storage body. Image processing means for image processing so as to be able to identify the change position of the stored item inside the article storage body body specified by
The notification information includes the image data processed by the image processing means.

The invention described in claim 6 is an article storage for storing stored items, a management apparatus connected to the article storage via an electric communication line, and connected to the management apparatus via an electric communication line. In an article storage monitoring system comprising a terminal device,
The article storage is
An article storage body having an openable / closable door;
Door closing detection means for detecting closing of the door;
Based on the detection of the closing movement of the door by the door closing detection means, an imaging means for imaging the inside of the article storage body and acquiring image data;
A determination means for determining whether or not there is a change in the stored item inside the article storage body based on the image data acquired by the imaging means;
Transmission means for transmitting the image data determined to have the change to the management apparatus when the determination means determines that there is a change in the stored item inside the article storage body. ,
The management device
Storage means for storing the image data transmitted by the transmission means;
When the image data is transmitted from the transmission unit, a notification unit that notifies the terminal device to that effect;
Image data transmission means for transmitting the image data stored by the storage means to the terminal device in response to a request from the terminal device;
It is characterized by providing.

  According to the first aspect of the present invention, based on the image data acquired by the imaging means, it is determined whether there is a change in the stored item inside the refrigerator main body, and the stored item inside the refrigerator main body is changed. If it is determined, the change position of the stored item inside the refrigerator main body is specified. Further, in the image data determined that there is a change in the stored item inside the refrigerator main body, image processing is performed so that the change position of the stored item inside the refrigerator main body can be identified, and the image processed image data Is transmitted to the management apparatus, and the management apparatus stores the image data. Then, the image data processed by the management device is transmitted to the terminal device, so that the user can easily grasp the change in the contents in the refrigerator main body without inquiring one by one, and the image based on the image data can be obtained. By browsing, the user can more easily and reliably identify the changed storage item in the refrigerator main body even at a remote place.

  According to the second aspect of the present invention, based on the image data acquired by the imaging unit, the determination unit determines whether there is a change in the storage item inside the article storage body, and the inside of the article storage body When it is determined that there is a change in the stored item, predetermined notification information is transmitted to the terminal device. With this notification information, the user can change the stored item inside the article storage body even at a remote location. You can easily grasp without inquiring one by one.

  According to the third aspect of the invention, it is a matter of course that the effect of the second aspect of the invention can be obtained, and the judgment means judges that there is a change in the stored items inside the article storage body. Further, the change position of the stored item inside the article storage body is specified by the specifying unit, and further, the transmission unit relates to the change position of the stored item inside the article storage unit body specified by the specifying unit as the notification information. Since the information is transmitted, the notification information enables the user to easily identify the changed storage item inside the article storage body.

  According to the invention described in claim 4, it is a matter of course that the effect of the invention described in claim 2 or 3 can be obtained, and the transmission means changes the stored information inside the article storage body as notification information. Since the image data determined to be present is transmitted to the terminal device, by browsing the image based on this image data, the user can identify the changed storage item inside the article storage body even at a remote location. It can be done easily.

  According to the fifth aspect of the invention, the effect of the third or fourth aspect of the invention can of course be obtained, and it is judged by the judging means that there is a change in the stored items inside the article storage body. The image data is processed by the image processing means so that the change position of the stored item inside the article storage body can be identified, and further, the image data processed by the transmission means as the notification information is Since the image is transmitted to the apparatus, the user can easily and reliably identify the changed storage item inside the article storage body even at a remote place by browsing the image based on the image data.

According to the sixth aspect of the present invention, based on the image data acquired by the imaging means, it is determined whether there is a change in the stored item inside the article storage body. When it is determined that there is a change, the image data determined that there is a change in the stored item inside the article storage body is transmitted to the management device, and the management device stores the image data. Then, the image data is transmitted to the terminal device by the management device, so that the user can easily grasp the change of the stored item inside the article storage body without inquiring one by one, and browse the image based on this image data. Thus, the user can easily identify the changed storage item inside the article storage body even in a remote place.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  In addition, in this embodiment, it demonstrates using a refrigerator monitoring system as an article storage monitoring system.

  FIG. 1 is a diagram illustrating a configuration of a refrigerator monitoring system 100 according to the present embodiment.

  A refrigerator monitoring system 100 according to the present embodiment includes a refrigerator 1 as an article storage, a server 2 as a management device, and a mobile phone 3 as a terminal device, each of which is an Internet that is an electric communication line. Connected by.

  The refrigerator 1 transmits the image data acquired by monitoring the inside of the refrigerator body 11 to the server 2 via the Internet.

  The server 2 provides services such as a mail server that transmits and receives e-mails and a web server that publishes web pages to the Internet. The server 2 receives and stores the image data transmitted from the refrigerator 1 via the Internet, and notifies the mobile phone 3 that the image data has been received by e-mail or the like, for example.

When the mobile phone 3 receives an e-mail transmitted from the server 2 via the Internet, the mobile phone 3 requests image data stored in the server 2 and accesses a web page provided by the server 2. Then, the server 2 transmits image data to the mobile phone 3 using a web page on the Internet. The mobile phone 3 displays the received image data on the display screen 34 a, whereby the user can view the image inside the refrigerator main body 11.
(Configuration of refrigerator 1)
FIG. 2 is a perspective view of the refrigerator 1 with the door of the refrigerator main body 11 opened, and FIG. 3 is a block diagram showing the main configuration of the refrigerator 1.

  As shown in FIGS. 2 and 3, the refrigerator 1 includes a refrigerator main body 11 having a door that can be opened and closed, a door opening / closing detection sensor 12 as a door closing detection means, a lighting device 13, and an imaging unit as an imaging means. 14, a control unit 15, and a transmission unit 16 as a transmission unit.

  The refrigerator body 11 has, for example, a rectangular parallelepiped shape, and includes a refrigerating room 11a and a freezing room 11b, and further includes a refrigerating room opening / closing door 11c and a freezing room opening / closing door 11d. Yes.

  The door open / close detection sensor 12 detects opening and closing of the refrigerator door 11c by the user, and outputs a detection signal to the controller 15, and opens the freezer door 11d. And a freezer compartment door sensor 12b for detecting a closing movement and outputting a detection signal to the control unit 15. The door open / close detection sensor 12 is, for example, a contact-type detection sensor. When the open / close door 11c for the refrigerator compartment and the open / close door 11d for the freezer compartment are closed, the door sensor 12a for the refrigerator compartment and the door sensor 12b for the freezer compartment are provided. Each outputs, for example, a detection signal in the “L” state to the control unit 15. On the other hand, when the open / close door 11c for the refrigerating chamber and the open / close door 11d for the freezer compartment are opened, the refrigerating room door sensor 12a and the freezer door sensor 12b each control a detection signal in the “H” state, for example. To the unit 15.

  The illuminating device 13 includes a refrigerator compartment interior lamp 13a and a freezer compartment interior lamp 13b, each of which includes a drive circuit (not shown) connected to the control unit 15 and a light source (shown) connected to the drive circuit. (Omitted). The drive circuit supplies, to the light source, a current for turning on the refrigerator compartment interior lamp 13a or the freezer compartment interior lamp 13b according to a control signal from the control unit 15.

  Specifically, when the opening of the refrigerating room opening / closing door 11c or the freezing room opening / closing door 11d is detected by the refrigerating room door sensor 12a or the freezing room door sensor 12b, the detection result is the detection of the “H” state. The signal is output to the control unit 15 as a signal. Then, the control unit 15 outputs a control signal that instructs the drive circuit to supply a drive current to the light source. Thereby, a drive current is supplied from the drive circuit to the light source, and the refrigerator interior lamp 13a or the freezer compartment lamp 13b is turned on. On the other hand, when the refrigerating room door sensor 12a or the freezing room door sensor 12b detects the closing movement of the refrigerating room opening / closing door 11c or the freezing room opening / closing door 11d, the detection result is a detection signal in the “L” state. It is output to the control unit 15. Then, after the imaging by the imaging unit 14 is executed, the control unit 15 outputs a control signal instructing the drive circuit to stop supplying the drive current to the light source. Thereby, the refrigerator interior lamp 13a or the freezer compartment lamp 13b is turned off.

  The imaging unit 14 includes, for example, a first refrigeration room camera 14a and a second refrigeration room camera 14a provided on the inner surface of the refrigeration room opening / closing door 11c so as to be able to capture images of the upper, middle, and lower stages inside the refrigeration room 11a. A refrigerator room camera 14b and a third refrigerator room camera 14c, and a freezer compartment camera 14d provided on the inner surface of the freezer compartment door 11d so that the inside of the freezer compartment 11b can be imaged are provided. The first refrigeration room camera 14a, the second refrigeration room camera 14b, the third refrigeration room camera 14c, and the freezer room camera 14d capture images at a predetermined timing to obtain image data.

  Each of the cameras provided in the imaging unit 14 includes an imaging lens (not shown) that converges the reflected light reflected by the light emitted from the light source of the illumination device 13 and strikes the subject, and forms an image of the subject. And an image sensor (not shown) that forms a subject image based on the subject image formed by.

  The imaging lens is disposed so as to form an image on the light receiving surface of the imaging element, and is configured by a concave lens, a convex lens alone, or a combination thereof.

  The imaging device is configured by, for example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like, and images the imaging target range in front of the imaging lens according to the control of the control unit 15. More specifically, a formed image input from the imaging lens is converted into an electric signal by a CMOS or the like, image data as a digital signal is generated by an A / D conversion circuit or the like, and this image data is sent to the control unit 15. Output.

The control unit 15 includes a CPU (Central Processing Unit) 151 and a RAM (Random Access).
Memory) 152, ROM (Read Only Memory) 153, I / O port 154, and the like.

  The CPU 151 executes various programs stored in the ROM 153 in response to an instruction input from the door opening / closing detection sensor 12 or the like, and outputs a control signal to each unit, thereby controlling the overall operation of the refrigerator 1.

  The RAM 152 is used as a work area for the CPU 151 and temporarily stores various programs read from the ROM 153 and data related to these programs in the memory area.

  The ROM 153 stores various processing programs executed by the CPU 151 and data such as various initial setting values related to the processing of each program.

Specifically, the ROM 153 stores an imaging program 153a, a determination program 153b, a specific program 153c, an image processing program 153d, a transmission program 153e, and the like.

  The imaging program 153a controls the drive circuit to supply power to the CPU 151 to turn on the illumination device 13, and further controls the imaging unit 14 so that the reflected light reflected from the subject passes through the imaging lens. This is a program that realizes a function of causing the control unit 15 to output image data as a digital signal by converting a focused and focused image into an electrical signal.

  Specifically, the CPU 151 detects that the refrigerating room door sensor 12a detects that the refrigerating room opening / closing door 11c is closed, and if the opening of the refrigerating room opening / closing door 11c is not detected again for a certain period of time, the CPU 151 The interior lamp 13a is turned on, and the first cold room camera 14a, the second cold room camera 14b, and the third cold room camera 14c are controlled to image the inside of the cold room 11a, and then the cold room. The warehouse light 13a is turned off. In addition, when the freezer compartment door sensor 12b detects that the freezer compartment opening / closing door 11d is closed, the CPU 151 determines that the freezer compartment door 11d is not detected again after a certain period of time has elapsed. The inner lamp 13b is turned on, and the freezer compartment camera 14d is controlled to image the inside of the freezer compartment 11b, and then the freezer compartment inner lamp 13b is turned off.

  The CPU 151 functions as an imaging unit together with the imaging unit 14 by executing the imaging program 153a.

  The determination program 153b realizes a function of causing the CPU 151 to determine whether there is a change in the contents in the refrigerator main body 11 by performing predetermined image processing on the image data acquired by executing the imaging program 153a. It is a program.

  Specifically, the CPU 151 executes the determination program 153b to capture the current frame image (N) (see FIG. 4A) data captured by each camera included in the imaging unit 14 and stored in the RAM 152, One frame previous image (N-1) captured by each camera provided in the imaging unit 14 after the previous closing of the refrigerator door 11c or the freezer door 11d and stored in the RAM 152 (FIG. 4B) (Ref.) In the difference image (Nd) (see FIG. 4C) data generated by the difference processing with the data, and the difference image (Nd) (see FIG. 4 (c)), for example, the change more than a predetermined value by the processing such as binarization processing or edge detection It is determined whether or not is measured. When it is determined that a change of a predetermined value or more has been measured, the CPU 151 determines that there is a change in the stored items inside the refrigerator main body 11.

  The CPU 151 functions as a determination unit by executing the determination program 153b.

  When the CPU 151 determines that the stored item in the refrigerator main body 11 is changed by executing the determination program 153b, the specific program 153c further specifies the change position of the stored item in the refrigerator main body 11. It is a program that realizes the function.

  Specifically, the CPU 151 specifies the position of an area where a change of a predetermined value or more is measured in the difference image (Nd) data created by executing the determination program 153b in the current frame image (N) data.

  The CPU 151 functions as a specifying unit by executing the specifying program 153c.

  The image processing program 153d is a function that causes the CPU 151 to perform image processing on the current frame image (N) data so that the area where the change position of the stored item is identified can be identified by executing the specifying program 153c. It is a program that realizes.

Specifically, for example, as shown in FIG. 4, the CPU 151 performs image processing such as cutting out the region where the change position of the stored item is specified, for example, by surrounding the region with the current frame image (N).
The identification image (Np) (see FIG. 4D) data is generated by performing processing on the data. Using the image based on the identification image (Np) data, the user can recognize at a glance the region X (FIG. 4 (d)) in which the change position of the storage item is specified. Can be identified.

  The CPU 151 functions as an image processing unit by executing the image processing program 153d.

  The transmission program 153e is a program that realizes a function of causing the server 151 to transmit identification image (Np) data image-processed by the execution of the image processing program 153d to the server 151.

  The CPU 151 functions as a transmission unit together with the transmission unit 16 by executing the transmission program 153e.

The transmitter 16 includes a modem (MODEM / MOdulator / DEModulator), terminal adapter, LA
An N adapter is used to communicate with an external device via a communication network such as the Internet.

Specifically, the transmission unit 16 transmits identification image (Np) data subjected to image processing by execution of the transmission program 153e to the server 2 through the Internet together with the user ID.
(Configuration of server 2)
Next, the server 2 will be described with reference to FIG.

  FIG. 5 is a block diagram showing a main configuration of the server 2.

  As shown in FIG. 5, the server 2 includes a notifying unit for transmitting and receiving data and a transmitting / receiving unit 21 as an image data transmitting unit, a storage unit 22 as a storing unit for storing image data and the like, various programs, and input data. And a main memory 23 for storing processing results generated when the program is executed, and a CPU 24 for controlling the server 2 by executing the program stored in the main memory 23.

The storage unit 22 includes, for example, an HDD (Hard Disc Drive) or the like, and includes a user list 221 in which users of the refrigerator monitoring system 100 are registered, and an image folder unit 222 that stores image data.

  Each user registered in the user list 221 is given a user ID, and further, an email address of a terminal device such as a mobile phone 3 which is a transmission destination of a notification email or the like is described in association with the user ID. ing.

  The image folder unit 222 includes a plurality of image folders 222a that store image data transmitted from the refrigerator 1 and received by the transmission / reception unit 21.

  In the image folder 222a, each image data is stored in association with a user ID together with an image ID, a reception date and time, an image file name, and the like assigned to identify the image data.

  The main memory 23 includes a storage program 23a executed by the CPU 24, a notification program 23b, an image data transmission program 23c, and the like.

  The storage program 23a is a function for causing the CPU 24 to store the identification image (Np) data in the image folder 222a when the identification image (Np) data is transmitted from the refrigerator 1 via the Internet and received by the transmission / reception unit 21. It is a program that realizes.

The CPU 24 functions as a storage unit together with the storage unit 22 by executing the storage program 23a.

  When the identification image (Np) data is transmitted from the refrigerator 1 via the Internet and received by the transmitting / receiving unit 21, the notification program 23b notifies the CPU 24 that the identification image (Np) data has been received. This is a program for realizing a function of sending mail to the mail address of the user's mobile phone 3.

  The CPU 24 functions as a notification unit together with the transmission / reception unit 21 by executing the notification program 23b.

  The image data transmission program 23c realizes a function of causing the CPU 24 to transmit identification image (Np) data to the user's cellular phone 3 using an Internet web page in response to receiving a request from the cellular phone 3. It is a program.

The CPU 24 functions as an image data transmission unit together with the transmission / reception unit 21 by executing the image data transmission program 23c.
(Configuration of mobile phone 3)
Next, the mobile phone 3 will be described with reference to FIG.

  FIG. 6 is a block diagram showing a main configuration of the mobile phone 3.

  As shown in FIG. 6, the mobile phone 3 includes a transmission / reception unit 31 that transmits / receives data, a memory unit 32 that stores data and programs, an operation input unit 33 through which various instructions are input by a user, and image data. The display unit 34 includes a display screen 34a for displaying the display and the like, and the CPU 35 that controls the mobile phone 3 by outputting a control signal to each unit.

  When the notification mail is transmitted by the server 2, the transmission / reception unit 31 receives the notification mail, and, for example, as shown in FIG. A notification is displayed that is detected. The notification mail further includes a link button displaying a link destination URL of the image data so that the identification image (Np) data stored in the image folder unit 222 of the server 2 can be read.

  Then, by pressing the link button displayed on the display screen 34 a, the URL of the pressed link button is transmitted to the server 2 via the transmission / reception unit 31, and the web page transmitted from the server 2 is stored in the memory unit 32. It is displayed on the display screen 34a of the display unit 34 by stored browser software or the like.

  Next, image acquisition / transmission operation processing performed by the CPU 151 of the refrigerator 1 and the CPU 24 of the server 2 will be described with reference to FIG.

  In the image acquisition / transmission operation processing, the CPU 151 of the refrigerator 1 executes the imaging program 153a, the determination program 153b, the specific program 153c, the image processing program 153d, and the transmission program 153e, and the CPU 24 of the server 2 executes the storage program 23a. Is done.

  In this process, a case where the user opens and closes the refrigerator door 11c will be described.

  First, the CPU 151 determines whether or not the refrigerating room opening / closing door 11c is detected to be closed by the refrigerating room door sensor 12a (step S1). When the user opens the refrigerator compartment door 11c and, for example, inputs an “L” detection signal to the control unit 15, the CPU 151 determines that the movement of the refrigerator compartment door 11c is detected (step S100). S1: YES), the process proceeds to step S2. In step S2, when a predetermined time elapses without the refrigerating room opening / closing door 11c being opened again, the CPU 151 turns on the refrigerating room interior lamp 13a (step S3).

  Next, the CPU 151 causes the first refrigeration room camera 14a, the second refrigeration room camera 14b, and the third refrigeration room camera 14c included in the imaging unit 14 to image the inside of the refrigeration room 11a (step S4). When is finished, the refrigerator interior light 13a is turned off (step S5). Next, the CPU 151 captures an image in step S4 and stores the acquired current frame image (N) data in the RAM 152 (step S6). Further, the CPU 151 creates difference image (Nd) data between the current frame image (N) data stored in the RAM 152 in step S 6 and the previous frame image (N−1) data already stored in the RAM 152 ( In step S7), the difference image (Nd) data is subjected to processing such as binarization and edge detection to detect a change area.

  Next, based on the difference image (Nd) data, the CPU 151 determines whether or not a change of a predetermined value or more is detected in the current frame image (N) data and the previous frame (N-1) data. Judgment is made (step S8). When CPU 151 determines in step S8 that a change greater than a predetermined value has been detected (step S8: YES), CPU 151 identifies a position where a change greater than a predetermined value is detected in the current frame image (N) data (step S9). ). Next, the CPU 151 performs image processing on the current frame image (N) data so as to identify the change position specified in step S9, and creates identification image (Np) data (step S10). Further, the CPU 151 causes the transmission unit 16 to transmit the created identification image (Np) data to the server 2 via the Internet (step S11), and ends this process.

  On the other hand, when the CPU 24 of the server 2 receives the identification image (Np) data transmitted by the refrigerator 1 in step S12, the identification image (Np) data corresponds to the user ID together with the image ID, the reception date and the image file name. At the same time, it is registered and stored in the image folder 222a (step S13), and this process is terminated.

  Next, image browsing operation processing performed by the CPU 24 of the server 2 and the CPU 35 of the mobile phone 3 will be described with reference to FIG.

  The image browsing operation process is performed by the CPU 24 of the server 2 executing the notification program 23b and the image data transmission program 23c.

  First, when the CPU 24 of the server 2 receives the identification image (Np) data from the refrigerator 1, a notification email indicating that the stored item inside the refrigerator main body 11 has changed is sent to the user's mobile phone described in the user list 221. It is transmitted to the mail address of the telephone 3 (step S21).

  In step S22, the CPU 35 of the mobile phone 3 receives the notification mail transmitted by the server 2, and the link button on which the URL for reading the identification image (Np) data set in the notification mail is displayed by the user. Is pressed (step S23), a request for the identification image (Np) data is transmitted to the server 2 (step S24). Next, the CPU 24 of the server 2 that has received the request reads out desired identification image (Np) data from the image folder 222a of the image folder 222 based on the identification information of the image data described in the request ( In step S25), the transmission / reception unit 21 transmits the identification image (Np) data to the mobile phone 3 using the web page of the server 2 (step S26), and the process is terminated.

  When the web page data including the identification image (Np) data transmitted by the server 2 is received by the transmission / reception unit 31 (step S27), the CPU 35 of the mobile phone 3 executes the browser software stored in the memory unit 32. As a result, a web page including an image based on the received image data is displayed on the display screen 34a of the display unit 34 (step S28), and this process is terminated.

  According to the refrigerator monitoring system 100 according to the present invention described above, on the basis of the image data acquired by the execution of the imaging program 153a by the CPU 151 of the refrigerator 1, execution of the determination program 153b causes the stored items in the refrigerator main body 11 to be stored. Whether there is a change is determined. When it is determined that there is a change in the items stored in the refrigerator main body 11, the change position of the items stored in the refrigerator main body 11 is specified by executing the specifying program 153c, and further, by executing the image processing program 153d. Identification image (Np) data is created in which image processing is performed on the image data determined to have a change in the stored item inside the refrigerator main body 11 and the change position of the stored item in the refrigerator main body 11 can be identified. Is done. The identification image (Np) data is transmitted to the server 2 by the execution of the transmission program 153e, and the identification image (Np) data transmitted from the refrigerator 1 is stored by the execution of the storage program 23a by the CPU 24 of the server 2. Is done. Then, by executing the image data transmission program 23c, the identification image (Np) data stored by the execution of the storage program 23a is transmitted to the mobile phone 3 in response to a request from the mobile phone 3. Accordingly, even in a remote place, the user can easily grasp the change in the contents in the refrigerator main body 11 without inquiring one by one, and by browsing the identification image (Np) from the mobile phone 3, the refrigerator main body 11 Thus, it is possible to easily and reliably identify a changed storage item in the interior.

  The present invention is not limited to the above embodiment, and various improvements and design changes may be made without departing from the scope of the present invention.

  For example, the present invention has been described using the example in which the link destination of the image data is set in the notification mail transmitted to the mobile phone 3 as the terminal device, but the identification image (Np) data is attached to the notification mail. May be.

  Moreover, although this invention demonstrated using the example in which the identification image (Np) data in which image processing was performed is transmitted from the refrigerator 1 to a management apparatus or a terminal device, what is transmitted is subjected to image processing There may be no image data.

  Moreover, although this invention demonstrated using the example in which the server 2 as a management apparatus was provided in the exterior of the refrigerator 1, the function which the management apparatus was incorporated in the refrigerator 1 may be used. In this case, the notification information is directly transmitted from the refrigerator 1 to the terminal device.

The terminal device is not limited to the mobile phone 3 and may be a PC (Personal Computer) or the like.

  Further, according to the present invention, a determination program 153b, a specific program 153c, and an image processing program 153d are provided in the refrigerator 1, and in the refrigerator 1, detection of a change in items stored in the refrigerator main body 11 and creation of identification image (Np) data can be performed. Although described using an example, the detection of the change in the stored item and the creation of the identification image (Np) data may be designed by a management device.

  Further, in the present invention, the server 2 as the management apparatus is designed to provide a service as a mail server, a web server, and the like, but it may be designed such that a management apparatus is provided for each service.

  Moreover, although this invention illustrated the refrigerator 1 as an article | item preservation | save store | warehouse | chamber, as long as it stores or preserve | stores articles | goods, such as a safe, a warehouse, a showcase, a closet, and a closet, what kind of thing is Also good.

  Moreover, although this invention demonstrated using the example which provides multiple cameras of the imaging part 14 for every imaging location, you may image a some imaging location with one camera by moving, rotating, etc. FIG.

  Moreover, although this invention demonstrated using the example which lights the illuminating device 13 when imaging by the imaging part 14 is performed, the design by which the flash function is provided in the imaging part 14 may be sufficient.

It is a figure which shows the structure of the refrigerator monitoring system which concerns on this invention. It is a perspective view of the refrigerator which concerns on this invention. It is a block diagram which shows the principal part structure of the refrigerator which concerns on this invention. It is explanatory drawing which shows an example of the present frame image (N), 1 frame previous image (N-1), a difference image (Nd), and an identification image (Np). It is a block diagram which shows the principal part structure of the server as a management apparatus which concerns on this invention. It is a block diagram which shows the principal part structure of the mobile telephone as a terminal device which concerns on this invention. It is explanatory drawing which shows an example of the notification mail displayed on the display screen of a mobile telephone. It is a flowchart which shows the image acquisition / transmission operation | movement process of the refrigerator monitoring system which concerns on this invention. It is a flowchart which shows the image browsing operation process of the refrigerator monitoring system which concerns on this invention.

Explanation of symbols

100 Refrigerator monitoring system (article storage monitoring system)
1 Refrigerator (goods storage)
11 Refrigerator body (article storage body)
11c Open / close door for cold room (door)
11d Open / close door for freezer (door)
12 Door open / close detection sensor (door closing detection means)
14 Imaging unit (imaging means)
151 CPU (imaging means, determination means, identification means, image processing means, transmission means)
153a Imaging program (imaging means)
153b Judgment program (judgment means)
153c Specific program (specific means)
153d Image processing program (image processing means)
153e Transmission program (transmission means)
16 Transmitter (transmission means)
2 Server (Management device)
21 Transmission / reception unit (notification means, image data transmission means)
22 Storage unit (storage means)
23a Storage program (storage means)
23b Notification program (notification means)
23c Image data transmission program (image data transmission means)
24 CPU (storage means, notification means, image data transmission means)
3 Mobile phone (terminal equipment)

Claims (6)

In a refrigerator monitoring system comprising a refrigerator, a management device connected to the refrigerator via an electric communication line, and a terminal device connected to the management device via an electric communication line,
The refrigerator is
A refrigerator body having an openable / closable door;
Door closing detection means for detecting closing of the door;
Based on the detection of the closing of the door by the door closing detection means, an imaging means for imaging the inside of the refrigerator main body and acquiring image data;
Based on the image data acquired by the imaging unit, a determination unit that determines whether there is a change in the stored item inside the refrigerator body;
When it is determined by the determining means that there is a change in the stored item inside the refrigerator body, the specifying unit for specifying the change position of the stored item inside the refrigerator body;
The change position of the stored item inside the refrigerator body specified by the specifying unit can be identified in the image data determined by the determining unit as a change in the stored item inside the refrigerator body. Image processing means for image processing;
Transmission means for transmitting the image data image-processed by the image processing means to the management device,
The management device
Storage means for storing the image data transmitted by the transmission means;
When the image data is transmitted from the transmission unit, a notification unit that notifies the terminal device to that effect;
Image data transmission means for transmitting the image data stored by the storage means to the terminal device in response to a request from the terminal device;
A refrigerator monitoring system comprising: An article storage connected to a terminal device via a telecommunication line,
An article storage body having an openable / closable door;
Door closing detection means for detecting closing of the door;
Based on the detection of the closing movement of the door by the door closing detection means, an imaging means for imaging the inside of the article storage body and acquiring image data;
A determination means for determining whether or not there is a change in a stored item inside the article storage body, based on the image data acquired by the imaging means;
Transmitting means for transmitting predetermined notification information to the terminal device when it is determined by the determining means that there is a change in the stored items inside the article storage body;
An article storage box comprising: When it is determined by the determination means that there is a change in the stored item inside the article storage body, the determination unit further includes a specifying unit that specifies a change position of the stored item inside the article storage body.
The article storage according to claim 2, wherein the notification information includes information on a change position of the stored item inside the article storage body specified by the specifying unit.   4. The article storage according to claim 2, wherein the notification information includes the image data determined to have a change in a stored item inside the article storage main body. The change position of the stored item inside the article storage body specified by the specifying unit can be identified in the image data determined by the determination unit as a change in the stored item inside the article storage body. Image processing means for image processing so that
The article storage according to claim 3 or 4, wherein the notification information includes the image data image-processed by the image processing means. An article storage comprising: an article storage for storing items; a management device connected to the article storage via an electric communication line; and a terminal device connected to the management device via an electric communication line In the monitoring system,
The article storage is
An article storage body having an openable / closable door;
Door closing detection means for detecting closing of the door;
Based on the detection of the closing movement of the door by the door closing detection means, an imaging means for imaging the inside of the article storage body and acquiring image data;
A determination means for determining whether or not there is a change in the stored item inside the article storage body based on the image data acquired by the imaging means;
Transmission means for transmitting the image data determined to have the change to the management apparatus when the determination means determines that there is a change in the stored item inside the article storage body. ,
The management device
Storage means for storing the image data transmitted by the transmission means;
When the image data is transmitted from the transmission unit, a notification unit that notifies the terminal device to that effect;
Image data transmission means for transmitting the image data stored by the storage means to the terminal device in response to a request from the terminal device;
An article storage monitoring system comprising:

Images