JP2002295959A - Refrigerator with photographing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a refrigerator with a photographing device capable of confirming a content even in a place spaced away from the refrigerator. SOLUTION: The refrigerator 1 with a photographing device is provided with a video camera 2 for a freezing chamber to photograph the interior of the pocket of an opening door 1e for a freezing chamber, and the interior of a freezing chamber 1a; a video camera 3 for a first refrigerator to photograph the shelf of the opening door 1f for a refrigerator and the interior of a first refrigerating chamber 1b; a video camera 4 for a second refrigerating to photograph the interior of the pocket of an opening door 1f for refrigerating chamber, and the interior of a second refrigerating chamber 1c; and a video camera 5 for a vegetable chamber to photograph the interior of a vegetable chamber 1d. A control circuit to store and transmit a photographed picture is incorporated therein. The control circuit comprises a picture memory to store a picture; a picture transmission part to effect processing of data to transfer a picture stored at the memory; a transmitting receiving part to picture data to an external apparatus such as portable telephone sets; and a video camera control unit to effect video camera operation from an external apparatus.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a refrigerator for cooling and preserving food, and more particularly, to a refrigerator with a photographing device that allows a user to check the contents without opening a refrigerator door. Related to refrigerators.

[0002]

2. Description of the Related Art In a conventional refrigerator, it is necessary to open the door of the refrigerator in order to check and take out the contents. In addition, most users do not know the contents of the refrigerator, and often leave the refrigerator door open for a long time to take out foods, etc., which causes an increase in electricity consumption. I was

Therefore, an invention as described in Japanese Patent Application Laid-Open No. 8-49958 was made. This is a camera that is installed in the refrigerator and the captured image is displayed on a display installed on the outside of the refrigerator, and it is possible to check the contents while the refrigerator door is closed. is there.

[0004]

However, in the above-mentioned conventional method, since the contents are confirmed by the display installed on the refrigerator body, the user goes to the vicinity of the refrigerator to confirm the contents. Needed. Accordingly, the present invention has been made in view of such unresolved problems of the conventional technology, and provides a refrigerator with a photographing device capable of checking contents even at a place away from the refrigerator. It is an object.

[0005]

In order to achieve the above object, a refrigerator with a photographing device according to the present invention has a photographing device at a predetermined position inside the refrigerator and photographs are taken by the photographing device. The image processing apparatus further includes an image transfer unit that transfers an image inside the refrigerator to a predetermined device located at a location away from the refrigerator.

With such a configuration, the contents of the refrigerator can be photographed by a photographing device such as a camera, and the image can be transferred to a device distant from the refrigerator. If the device has a display device, the image can be displayed on the display unit, and the contents of the refrigerator can be checked on the go. It is.

[0007] The invention according to claim 2 is based on claim 1.
In the refrigerator with an imaging device described in the above, the image transfer means can transfer the image to a predetermined device connected to the Internet. That is, for example, an image photographed by a photographing device such as a camera can be transferred to a device connected to the Internet. For example, the image can be transferred to a server device that manages a Web site, and a dedicated Web site can be used. By making the image of the contents of the refrigerator available for browsing, it is possible to check the contents of the refrigerator from a PC or mobile phone that can connect to the Internet,
It is convenient.

[0008] Here, the Web is an abbreviation of the World Wide Web, and in 1989, CERN (Conseil European
Pour la Recherche Nucleaire) is a wide area information system, which is a client / server type application that can access all information distributed on the Internet via hypertext. In other words, a Web site is managed by a Web server provided with this application, and links one or more Web pages in which information is written to each other, and
In one package.

According to a third aspect of the present invention, in the refrigerator with the photographing device according to the first or second aspect, an image storage means for storing an image photographed by the photographing device is provided. And In other words, the image storage means is used to store images taken by a photographing device such as a camera in the refrigerator main body, so that in a large refrigerator or the like, the refrigerating room is divided into a number of sections. If you want to save the image, for example, to transfer the image to a mobile phone with less memory and display it, instead of sending all the images at once, any one of the stored divided images By enabling the transfer, it is possible to compensate for the lack of memory of the device that receives the image.

The invention according to claim 4 is the invention according to claim 3.
In the refrigerator with a photographing device described in the above, the image storage means stores a plurality of images photographed at different timings by the photographing device. In other words, if an image of the contents of the refrigerator taken in the past is held for, for example, one week, the past image and the latest image can be browsed,
By comparing the two, you can confirm the ingredients used, moved, or aged.
This is convenient because it is possible to know the progress of the contents of the refrigerator to the current state.

Further, the invention according to claim 5 is based on claim 1.
5. The refrigerator with a photographing device according to claim 4, wherein the photographing device is operable by the predetermined device. In other words, for example, if a photographing device such as a camera installed inside the refrigerator can be operated from a remote place by a mobile phone or the like, when the photographing device cannot photograph the contents desired by the user, It is possible to operate the lens position of the photographing apparatus from a remote place to display a target object.

[0012]

Embodiments of the present invention will be described below with reference to the drawings. 1 to 4 are views showing an embodiment of a refrigerator with a photographing device according to the present invention.
First, the external configuration of a refrigerator with a photographing device according to the present invention will be described with reference to FIG. FIG. 1 is a front view of the inside of a refrigerator with a photographing device according to the present invention when the door is open.

The refrigerator 1 with a photographing device includes a freezing room 1a for storing ice cream and frozen foods in a frozen state, a first refrigerator room 1b for storing mainly foods and the like that requires low-temperature storage, and A second refrigerator compartment 1c, a vegetable compartment 1d for refrigerated storage of vegetables and the like at an appropriate temperature, a freezer compartment opening / closing door 1e provided with a pocket inside the door, and eggs and the like inside the door. Refrigerated compartment opening / closing door 1f provided with shelves and pockets for placing plastic bottles and the like. The freezing compartment opening / closing door 1e photographs the inside of the pocket of the same door 1e and the inside of the freezer compartment 1a. A video camera 2 for the freezer compartment is provided, and a first refrigerator video for photographing the inside of the first refrigerator compartment 1b and the shelf of the refrigerator door 1f is provided on the refrigerator compartment door 1f. A camera 3 is provided, and the refrigerator compartment opening / closing door 1f is opened. A video camera 4 for the refrigerator compartment for photographing the inside of the pocket of the door 1f and the interior of the second refrigerator compartment 1c is provided, and a video for the vegetable compartment for photographing the interior of the vegetable compartment 1d is provided in the vegetable compartment 1d. A camera 5 is provided.

Further, the refrigerator 1 with the photographing device includes a control circuit 11 for storing and transmitting the image photographed by each video camera described above. FIG. 2 is a block diagram showing a configuration of the control circuit 11. Hereinafter, the configuration of the control circuit 11 will be described with reference to FIG. Control circuit 11
The image conversion unit 6 receives video signals from the respective video cameras, converts analog signals into digital signals, and also reduces the number of colors and converts to an appropriate image format.
And an image storage unit 7 for storing the converted image;
An image transfer unit 8 that performs data processing for transferring an image stored in the storage unit 7; and a transmission and reception unit 9 that has a telephone function and transmits image data to an external device such as a mobile phone.
And a video camera operation request from an external device,
Video camera controller 1 for controlling the lens position of the camera
0.

Although not shown, the refrigerator 1 with a photographing device has a ROM (Read Only Memory) storing a control program for performing processing in each of the above-described control units and conversion units.
mory), RAM (Random Access Memory) for storing data used for executing programs, etc., and CPU (Central Processing Uniform) for executing programs.
t), an interface circuit for exchanging data between the above units is provided.

More specifically, the operation of the refrigerator 1 with the photographing device will be explained.
e and the refrigerator compartment opening / closing door 1f at the time of closing, the inside of the pocket of the freezing compartment opening / closing door 1e, the inside of the shelf and the pocket of the refrigerator compartment opening / closing door 1f, and the freezer compartment 1a, the first refrigerator compartment 1b, The second refrigerator room 1c and the vegetable room 1d are photographed, and their video signals are transmitted to the image converter 6. Here, each of the video cameras in the present embodiment has a camera mode for shooting a still image (one image data), and normally outputs a video signal of the still image to the image conversion unit 6. Send. The image converter 6 converts the received video signal into a digital signal by A / D conversion, and further compresses the image data to reduce the data amount. Then, the compressed image data is stored in the image storage unit 7 together with the date information. In the present embodiment, one week of image data is stored, and when checking the contents, the contents can be checked up to one week before.

Then, the user operates the refrigerator 1 with the photographing device.
In order to check the contents, a portable controller (not shown) with an attached display function, or a PC (Personal Computer) equipped with a mobile phone or a modem,
A dedicated telephone number is input by a device having an image display unit and a telephone function to call the transmission / reception unit 9. Then, in response to the call, the image transfer unit 8 starts voice guidance via the transmission / reception unit 9. The user selects a number according to the voice guide, and the image transfer unit 8
Reads out the image of the content corresponding to the selected number from the image storage unit 7 and transfers it to the device owned by the user.

Further, the refrigerator 1 with a photographing device according to the present embodiment has a function of uploading a photographed image of the contents to a dedicated Web site on the Internet and confirming the contents via the Internet. are doing. In other words, immediately after shooting the contents of the refrigerator,
The image transfer unit 8 instructs the transmission / reception unit 9 to connect to the Internet. Then, the transmitting / receiving unit 9 makes a call to a predetermined access point and establishes a connection with the Internet. When connected to the Internet, it automatically connects to a dedicated Web site prepared for each user, and uploads an image just taken along with date information according to an instruction from the image transfer unit 8. This process is automatically performed by the transmission / reception unit 9. Therefore, the user can use the dedicated Internet W
From the website, you can check the image of the contents. In the present embodiment, when using the Internet, one month's worth of image data can be stored so that the contents one month ago can be checked.

Further, each of the above-mentioned video cameras provided in the refrigerator 1 with the photographing device can variably adjust the direction of the lens according to a user's instruction, and the attached portable controller or A mobile device having a telephone function such as a mobile phone or a Personal Handy-phone System possessed by the user can issue an instruction to change the lens position from a distant position in the same procedure as that for checking the contents. In the present embodiment, the lens position of the camera can store several patterns of position information in advance, and at the time of operation, by inputting a number corresponding to the position information, the lens can be stored in that number. The position is automatically changed based on the registered position information. In addition, since the inside of the refrigerator is completely dark when the door is closed, the refrigerator is provided with lighting equipment which is turned on only at the time of shooting, though not shown.

Next, an example of an operation process of the control circuit 11 when each function of the refrigerator 1 with a photographing device is executed using a mobile phone will be described with reference to FIG. FIG. 3 is a flowchart illustrating an example of an operation process of the control circuit 11. As shown in FIG. 3, first, the process proceeds to step S300,
It is determined whether or not there is a call from the user's mobile phone. If there is a call (Yes), step S302 is performed.
If not (No), wait until there is a call.

When the process proceeds to step S302, the process shifts to a call state, and informs the image transfer unit 8 of the call from the user via the transmission / reception unit 9, and the transfer unit 8 provides voice guidance. Start. Here, the contents that can be executed are explained by the voice guidance. By pressing the numeric button of the mobile phone corresponding to the contents to be executed, the mode shifts to the corresponding execution mode. That is, if the content confirmation mode is selected, step S3
The process moves to step S04, and if the camera operation mode is selected, the process moves to step S312. If nothing is done, cancel is selected and the process moves to step S322.

If the operation has proceeded to step S304, the operation proceeds to the content confirmation mode, and the operation proceeds to step S306.
In step S306, the refrigerator 1 with the imaging device is provided to the user by the voice guidance of the image transfer unit 8.
The user is prompted to enter the location information of the location of the content to be checked. That is, similarly to the mode selection in the above step S302, the freezing room 1a, the first refrigerated room 1b, the second refrigerated room 1c, the vegetable room 1d, the pocket of the freezing room opening / closing door 1e, the refrigerated room, of the refrigerator 1 with the photographing device. A number corresponding to each position of the shelf and the pocket of the room opening / closing door 1f is input. When the input of the number is completed, step S30
Move to 8.

In step S308, of the image data of the contents stored in the past one week, the image data of the desired date is selected, and the flow proceeds to step S310. Here, in the present embodiment, when the number 0 is input, the image of the latest content is displayed, and when it is 1, it is one day before, and when it is 2, it is two days before, such as the number of days before the input number. Data is displayed. Therefore, in the present embodiment, the content is always photographed once a day so that the refrigerator door may not be opened on some days.

At step S310, the image transfer section 8 reads out the image data of the contents at the corresponding position from the image storage section 7, transfers the image data to the user's mobile phone by the transfer section 9, and proceeds to step S312. Transition. In step S312, the user confirms whether or not to end the contents confirmation mode, and if the end is confirmed (Yes).
Shifts to step S300, and if not (No), shifts to step S306.

That is, when the contents confirmation mode is ended, the process returns to the selection of the mode of the execution contents, and when the contents confirmation mode is not ended, the process returns to the selection of the position information for confirming the contents.
On the other hand, when the camera operation mode is selected and the process proceeds to step S314, the fact that the camera operation mode has been selected is notified to the video camera control unit 10 by the transmission / reception unit 9, the mode is shifted to the camera operation mode, and the process proceeds to step S316. Transition.

In step S316, the voice guidance by the video camera control unit 10 is started, and the user selects a video camera to be operated. The choice is
As with the execution mode selection and the selection of the contents confirmation position,
This is performed by inputting the numbers corresponding to the freezer compartment video camera 2, the first refrigerator compartment video camera 3, the second refrigerator compartment video camera 4, and the vegetable compartment video camera 5 using a mobile phone. When the camera to be operated is selected, the process moves to step S318.

In step S318, the video camera control unit 10 informs the image conversion unit 6 that the operation mode has shifted to the camera operation mode, and the image conversion unit 6 transfers the image captured by the selected camera to the user's mobile phone. In order to transmit the image data to the telephone in real time, conversion is performed such that the number of colors of the image is reduced and the resolution is further reduced so that the image data can be efficiently transferred. Then, the converted image data is transmitted to the image transfer unit 8 via the video camera control unit 10 and processed by the transmission / reception unit 9 so as to be transferred to the user's mobile phone. The process moves to S320.

In step S320, it is determined whether or not the user designates information on the lens position of the camera which is set in advance in association with the number. The process moves to step S322, and if not (No), the process moves to step S324. When the process proceeds to step S322, the process proceeds to a state of waiting for selection of a setting number, and when the user selects a number using a mobile phone, the process proceeds to step S326.

On the other hand, when the process proceeds to step S324, the user operates the lens of the camera while viewing the image. The user operates the lens position using the button of the mobile phone corresponding to the position operation, and proceeds to step S326. In step S326, the video camera control unit 10 gives an instruction to the selected video camera to change the lens position according to the content instructed by the mobile phone, and responds to the end of the operation by the user. When the number is pressed, the flow shifts to step S328. In other words, the video camera given the instruction immediately changes the lens position according to the instruction, and the changed image is displayed on the display unit of the mobile phone in real time. The user can operate the lens at an appropriate position while watching.

At step S328, whether or not to end the camera operation mode is provided by voice guidance. If the end is selected (Yes), the process proceeds to step S302, and if not, the process proceeds to step S316. In other words, when the camera operation mode ends, the process returns to the selection of the mode to be executed, and when the camera operation mode does not end, the process returns to the selection of the video camera to be operated.

Further, in the mode selection of the execution contents in step S302, when cancel without performing any operation is selected and the process proceeds to step S330, the transmission / reception unit 9 performs a telephone disconnection process, and then proceeds to step S300.
In other words, if cancel is selected in the selection of the mode to be executed, the process shifts to step S300 and waits for the next call from the user.

Further, the actual operation will be described based on the setting example of FIG. FIG. 4 is a diagram illustrating an example of setting numbers of respective operations of the refrigerator 1 with the imaging device. It is assumed that the user checks the contents of the refrigerator from outside by using a mobile phone. First, the user makes a call to the transmission / reception unit 9 of the refrigerator 1 with the imaging device. Then, when a call is received (step S300), the state shifts to a call state, and the image transfer unit 8 provides voice guidance for selecting a mode of execution (step S302). According to the voice guidance, the user presses, for example, a push button of the mobile phone as 1 # (see FIG. 4), and selects the content confirmation mode. Then, the fact that the content confirmation mode has been selected is heard by voice, and the mode shifts to the content confirmation mode (step S304). When the mode is shifted to the content confirmation mode, a voice is played so as to select a position at which the user wants to confirm the content. The refrigerator compartment 1b is selected (Step S306).
Further, the user selects how many days ago the user wants to check the contents (step S308). Here, the user wants to see the latest data, so the user pushes the push button of the mobile phone to 0 #. Then, the process proceeds to step S308, where the image of the latest contents in the first refrigerator compartment is transferred to the user's mobile phone and displayed on the display unit of the mobile phone.

Further, in step S302, when the mobile phone is depressed with the push button 2 # (see FIG. 4) to shift to the camera operation mode (step S314), a video camera to be operated is selected first (step S31).
6). Here, the push button is pressed as 4 # (see FIG. 4). Therefore, since the vegetable room video camera 5 is selected, the image data captured by the video camera 5 is transferred to the user's mobile phone in real time (step S318). At the time of transfer, the image conversion unit 6
The image data is converted in such a manner as to reduce the number of colors, and transfer delay is prevented as much as possible. Then, the voice guidance by the video camera control unit 10 asks whether or not to specify the registered lens position, so that the user selects to use (for example, press 1 #) (step S320), and then the position information Is selected (step S322), the process proceeds to step S326, and the lens position is moved according to the position information of the designated number. Then, the end of the operation mode is selected (step S328), and further, the cancel is selected in step S302, and the process ends.

Further, when the content is confirmed by accessing a dedicated Web site on the Internet, the URL (Uniform Resource Loc) of the Web site is stored in the browser software using a PC or the like which can be connected to the Internet.
ators) and connect. Since the contents of the refrigerator are unpleasant to be seen by others, in the present embodiment, the user performs an authentication process by inputting a user ID and a password, and confirms the contents when there is no error in the input contents. Authorize connections to possible pages and allow browsing.

On the Web site, you can view the image data of the contents up to the past month, select the data you want to see based on the date and location information displayed on the screen, and click the date and location information. Displays image data. Further, since an image can be displayed on a display screen larger than the display unit of the mobile phone, it can be set so that image data having a high resolution and a large number of colors can be displayed. Here, in the present embodiment, the image data registered on the Web site can be changed by an instruction to the image transfer unit 8, and this can be set by a mobile phone. Of course, the quality can be set for the image data stored in the image storage unit 7 built in the refrigerator 1 with the photographing device.

As described above, since the image data of the contents of the refrigerator photographed by the video camera can be transferred to the mobile phone, the contents of the refrigerator can be viewed even when the user is away, and when he or she returns, he buys the missing ingredients. It can be convenient. Further, the refrigerator 1 with the photographing device has an image storage unit 7.
The image data taken in the past is stored so that it is possible to browse the contents of the refrigerator while comparing it with the past data, and to know the process up to the current state It becomes possible.

Further, since the lens position of the video camera can be controlled from the mobile phone, when the displayed image does not capture the desired position, the video camera is moved from a position away from the refrigerator 1 with the photographing device. By manipulating the lens position, it is possible to photograph a desired position even from a remote position. Further, since the image of the contents of the refrigerator can be browsed on a dedicated Web site of the Internet, it is possible to check the contents of the refrigerator from a personal computer or a mobile phone that can be connected to the Internet, which is convenient. .

Here, the freezer compartment video camera 2, the first refrigerator compartment video camera 3, the second refrigerator compartment video camera 4, and the vegetable compartment video camera 5 shown in FIG.
The image transfer unit 8 and the transmission / reception unit 9 correspond to the image transfer unit according to the first and second aspects, and the image storage unit 7 corresponds to the image transfer unit according to the third aspect. It corresponds to storage means.

In the above-described embodiment, there are two functions, that is, a function of directly transferring image data to a mobile phone to browse image data and a function of browsing image data on an Internet Web site. However, it is not necessary to have both of these functions, and a configuration having one of these functions may be used. In the above-described embodiment, an analog video camera is used as a photographing device. However, the present invention is not limited to this, and a digital photographing device such as a digital video camera may be used.

Further, in the above-described embodiment, the content is photographed at the time when the door is finally closed. However, the present invention is not limited to this, and the photographing may be performed at a time arbitrarily set by the user. When the conditions are set and the door is not opened even once on that day, the photographing may be performed at any timing without departing from the gist of the present invention, such as photographing at a preset time. good.

In the above embodiment, the time information and the image data are stored each time. However, the present invention is not limited to this. Only the time information of opening and closing the door is stored except for the set timing. You may do it.

[0042]

As described above, according to the refrigerator with the photographing device according to the first aspect of the present invention, the image of the contents of the refrigerator is transferred to a device located away from the refrigerator. Therefore, it is possible to check the contents of the refrigerator at a place such as a destination, so that it is convenient to buy missing ingredients on the way home.

According to the refrigerator with the photographing device of the second aspect, in addition to the effect of the first aspect, the image of the contents of the refrigerator can be transferred to a device connected to the Internet. By making the image of the contents of the refrigerator visible on the Web site, it is possible to check the contents of the refrigerator from a personal computer or a mobile phone that can be connected to the Internet, which is convenient.

According to the refrigerator with the photographing device according to the third and fourth aspects, in addition to the effects according to the first and second aspects, an image of the contents of the refrigerator photographed in the past can be held. Allows you to browse past images and recent images, so by comparing both, you can check the ingredients used, moved, or aged, etc. It is convenient because it allows you to know the process of an object up to its current state, which is a measure to reduce consumption of foodstuffs.

According to the refrigerator with the photographing device according to the fifth aspect, in addition to the effects of the first to third aspects, the photographing device such as a camera installed inside the refrigerator can be controlled from a remote place. Therefore, when the photographing device is not able to photograph the content desired by the user, it is possible to operate the lens position of the photographing device from a distant place to display the target object. .

[Brief description of the drawings]

FIG. 1 is a front view of the inside of a refrigerator with a photographing device when a door is open.

FIG. 2 is a block diagram illustrating a configuration of a control circuit 11.

FIG. 3 is a flowchart illustrating an example of an operation process of a control circuit 11;

FIG. 4 is a diagram showing an example of setting numbers of respective operations of the refrigerator 1 with a photographing device.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Refrigerator with an imaging device 2 Video camera for freezer compartment 3 Video camera for first refrigerator compartment 4 Video camera for second refrigerator compartment 5 Video camera for vegetable compartment 7 Image storage unit 8 Image transfer unit 9 Transmission / reception unit 10 Video camera control Department

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04Q 9/00 321 H04Q 9/00 321E (72) Inventor Isuke Karaki 3-chome 3-5 Yamato, Suwa City, Nagano Prefecture No. Seiko Epson Corporation (72) Inventor Masahiro Kitano 3-3-5 Yamato, Suwa-shi, Nagano F-term in Seiko Epson Corporation (reference) 5C054 AA01 CD03 CG08 DA09 EA03 GB01 GB05 HA37 5K048 BA10 BA21 DC07 EB02 EB15

Claims (5)

[Claims] An image capturing device is provided at a predetermined position inside a refrigerator, and image transfer means is provided for transferring an image inside the refrigerator taken by the image capturing device to a predetermined device located away from the refrigerator. A refrigerator with a photographing device, characterized in that: 2. The refrigerator with a photographing device according to claim 1, wherein said image transfer means can transfer the image to a predetermined device connected to the Internet. 3. The refrigerator with a photographing device according to claim 1, further comprising an image storage unit for storing an image photographed by the photographing device. 4. A refrigerator with a photographing device according to claim 3, wherein said image storage means stores a plurality of images photographed at different timings by said photographing device. 5. The refrigerator with a photographing device according to claim 1, wherein the photographing device is operable by the predetermined device.