JP7185659B2 - refrigerator - Google Patents

Description

Embodiments of the present invention relate to refrigerators .

2. Description of the Related Art Conventionally, there is known a refrigerator capable of obtaining information such as foodstuffs in a refrigerator even from a remote location by installing a camera device in the refrigerator (see, for example, Patent Document 1).

JP 2012-226748 A

However, when an instruction to acquire information is given, it is assumed that the situation is not suitable for acquiring information.

A problem to be solved by the present invention is to provide a refrigerator capable of taking an image in an appropriate situation.

A refrigerator according to an embodiment includes an image capturing means and a receiving means for receiving an image capturing instruction , and when the image capturing instruction is received by the receiving means , a camera device that captures an image and determines whether the door of the refrigerator is open or closed. and transmission means for transmitting the imaging instruction to the camera device, wherein the control means determines the open/closed state of the door and closes the door when the door is open. While waiting until the door is closed, by transmitting the imaging instruction to the camera device on condition that the door is closed, the imaging is performed at the timing when the door is closed.

1 is a diagram schematically showing an indoor imaging system according to one embodiment; FIG. 1 is a diagram schematically showing the appearance of a camera device according to an embodiment; FIG. 1 is a diagram schematically showing the inside of a camera device according to one embodiment; FIG. 1 is a diagram schematically showing the electrical configuration of a camera device and an indoor imaging system according to one embodiment; FIG. The figure which shows the flow of processing of the refrigerator in one embodiment. FIG. 4 is a diagram showing the flow of processing of the camera device according to one embodiment; FIG. 4 is a diagram showing an example of a blinking pattern when transmitting an imaging instruction by optical energy in one embodiment; FIG. 4 is a diagram showing an example of a ringing pattern when transmitting an imaging instruction by sound energy in one embodiment; FIG. 10 is a diagram showing the processing flow of the refrigerator when transmitting an imaging instruction using vibration energy in one embodiment; FIG. 4 is a diagram showing the flow of processing of the camera device when transmitting an imaging instruction using vibration energy in one embodiment; FIG. 4 is a diagram showing the flow of processing of the camera device when an imaging instruction is transmitted using light energy and vibration energy in one embodiment;

An embodiment will be described below with reference to FIGS. 1 to 11. FIG.

As shown in FIG. 1, the indoor imaging system 100 of the present embodiment includes a refrigerator 1 as a home appliance, a camera device 2 for imaging the interior, an access point 3 for communicating with the refrigerator 1, It is composed of a portable terminal 4 or the like as an operation terminal. Of these, the access point 3 is connected to the external network 5, and connects the portable terminal 4, the server 6, or the like at a remote location to the refrigerator 1 via the external network 5 so as to be able to communicate with each other. In the present embodiment, wireless communication by Bluetooth (registered trademark) is used between the refrigerator 1 and the access point 3, between the access point 3 and the mobile terminal 4, and between the camera device 2 and the access point 3. is done.

The mobile terminal 4 is an operation terminal for inputting an imaging instruction for causing the camera device 2 to capture an image of the room, and is assumed to be a so-called smart phone (high-performance mobile phone). However, the operation terminal is not limited to the mobile terminal 4, and may be, for example, a tablet-type personal computer. When the mobile terminal 4 is located inside the house 7, it is connected to the access point 3 so as to be able to communicate with it by a short-range wireless system. Further, when the mobile terminal 4 is located outside the house 7, the mobile terminal 4 is connected to the access point 3 via the external network 5 by wide area communication so as to be able to communicate therewith. In addition, the mobile terminal 4 can be connected to the access point 3 via the external network 5 by wide area communication even from inside the house 7. Direct communication with the refrigerator 1 side is also possible.

The server 6 is configured by a well-known computer system, and stores information (for example, an IP address, etc.) for accessing the refrigerator 1. In the present embodiment, image data captured by the camera device 2 memorize Although only the refrigerator 1 is shown in FIG. 1, other home appliances such as an air conditioner (not shown) are also networked.

By networking home appliances in this way, it is possible to visualize the power consumption of each home appliance in a form that is visible to the user, and to reduce power consumption during periods of high power demand, such as daytime in the summer. We provide a system that provides user-friendliness, comfort, or convenience, such as shift, power control such as peak cut to avoid momentary use of power that exceeds the rating of general households, and failure diagnosis of home appliances. becomes possible. Also, by installing the camera device 2 in, for example, the refrigerator compartment, it is possible to check the state of the interior of the refrigerator 1 (such as the state of storage of articles). By storing these various types of information, imaging data, and the like in the server 6, it becomes possible to refer to the information using the portable terminal 4 or the like via the external network 5 or the like even in a remote location.
Next, the camera device 2 will be explained.

As shown in FIGS. 2 and 3, the camera device 2 has a lens 12 of an imaging unit 11 (see FIG. 4) on the surface of a housing 10 formed in a substantially rectangular parallelepiped shape. A light 13 and an optical sensor 14 are provided to be exposed. However, the lens 12, the imaging light 13, and the optical sensor 14 may be covered with a cover or the like instead of being exposed to the outside of the housing 10. FIG. Hereinafter, the side where the lens 12 and the like are exposed (the right side in FIG. 3) is the front of the camera device 2, and the opposite side (the left side in FIG. 3) is the back.

As shown in FIG. 3, the camera device 2 includes a housing 10 housing a control board 15, a battery 16, a communication module 17, a sound sensor 19, a vibration sensor 20, and the like. The control board 15 is provided with the imaging unit 11 having the lens 12 and an imaging element (not shown), the imaging light 13, and the camera-side control unit 18 (see FIG. 4) for controlling them. A well-known image pickup device such as CCD or CMOS is used as the image pickup device. The imaging light 13 employs an LED. Although not shown, the camera device 2 is also provided with a power switch.

The battery 16 supplies power to the control unit, the communication module 17, the optical sensor 14, the sound sensor 19, the vibration sensor 20, and the like. That is, the camera device 2 is driven by the built-in battery 16 . Therefore, the camera device 2 does not require a power cable or the like, and can be installed at any location. In this embodiment, the camera device 2 is installed in the refrigerator compartment as described above.

The communication module 17 transmits imaged data of the inside of the refrigerator imaged by the imaging unit 11 to the mobile terminal 4, the server 6, or the like via the access point 3. FIG. The reason for transmitting to the server 6 is to store the imaging data in the server 6 . Here, the imaging data is data including indoor images, for example, data (still images, moving images) in well-known formats such as bitmap format, JPEG format, or MPEG format, and the data is compressed, encrypted, or imaged. The data may be of any format, such as data converted by processing, as long as the state of the room can be checked with the portable terminal 4 or the like.

As shown in FIG. 4, the camera-side control section 18 is composed of a microcomputer having a CPU 18a, a ROM 18b, a RAM 18c, an RTC 18d, etc., and controls the camera device 2 as a whole. Specifically, the camera-side control unit 18 controls the imaging timing of the imaging unit 11, controls the imaging environment for imaging (lighting control of the imaging light 13), transmits imaging data by the communication module 17, and controls each sensor. control for receiving (accepting) an imaging instruction, which will be described later. In this embodiment, the camera-side control unit 18 also performs image processing such as correction of the captured image. The camera-side control section 18 constitutes control means.

The optical sensor 14 connected to the camera-side controller 18 is a so-called illuminance sensor and detects the illuminance around the camera device 2 . More specifically, the optical sensor 14 detects optical energy in a predetermined wavelength band (in this embodiment, optical energy emitted from indoor LEDs described later). Optical energy detected by the optical sensor 14 is converted into an electrical signal and output to the camera-side control section 18 .

The sound sensor 19 detects sounds generated around the camera device 2 . More specifically, the sound sensor 19 detects sound energy emitted in a preset frequency band (in this embodiment, sound energy emitted from a panel buzzer 29 or an indoor buzzer 33, which will be described later). Sound energy detected by the sound sensor 19 is converted into an electric signal and output to the camera-side control section 18 .

The vibration sensor 20 detects vibration applied to the camera device 2 . The vibration sensor 20 is composed of, for example, a three-axis acceleration sensor or the like, converts the detected vibration energy into an electric signal, and outputs the electric signal to the camera-side control section 18 . Then, the camera-side control unit 18 detects vibration applied to the camera device 2 based on the acceleration.

The optical sensor 14, the sound sensor 19, and the vibration sensor 20, which will be described later in detail, are sensors that detect physical energy, and constitute receiving means for receiving imaging instructions. Note that it is not always necessary to provide all of the optical sensor 14, the sound sensor 19, and the vibration sensor 20, and only the optical sensor 14 may be provided if the imaging instruction is received only by light energy, for example.

The camera-side control unit 18 determines whether it is an imaging instruction, as described later, based on the intensity and pattern of each detected energy. In other words, in the case of this embodiment, the imaging instruction from the user is configured to be indicated by the energy emitted in a predetermined pattern, and the camera-side control unit 18 controls the energy pattern detected by each sensor and the imaging It also functions as determination means for determining whether the pattern indicating the instruction matches.

The camera device 2 with such a configuration is always on standby in the low power mode, which consumes relatively less power than in the normal operation mode, and upon receiving an imaging instruction, returns to the normal operation mode to capture an image of the room. do. In the case of this embodiment, since the camera device 2 is provided in the refrigerator compartment, the inside of the refrigerator compartment is imaged.

The refrigerator 1 in which the camera device 2 is installed has a refrigerator-side controller 21 . The refrigerator-side control unit 21 is composed of a microcomputer having a CPU 21a, a ROM 21b, a RAM 21c, a timer 21d, etc., and controls the refrigerator 1 as a whole. Specifically, the refrigerator-side control unit 21 adjusts the temperature inside the refrigerator detected by the temperature sensor 23 and the opening/closing state of the door detected by the door sensor 24 so as to achieve the operating state set from the operation panel 22, for example. Based on this, the operational states of the refrigerating cooling mechanism 25 and the freezing cooling mechanism 26 that constitute a well-known refrigerating cycle are controlled.

The operation panel 22 is provided with a panel display 27 , a panel LED 28 and a panel buzzer 29 . The panel display 27 displays set values and the like. A panel LED 28 is provided for lighting operation switches, operating conditions, and the like. The panel buzzer 29 is composed of a piezoelectric buzzer or the like, and emits a sound (sound energy) according to the operation to notify the operation content. In the case of this embodiment, the panel buzzer 29 is capable of outputting a sound of 6 kHz, and as will be described later, also functions as a transmission means that emits sound energy to transmit an imaging instruction to the camera device 2. .

The indoor lighting 30 is provided in a refrigerator compartment or the like, and lights up when the door is opened. That is, the interior lighting 30 generates light energy. The interior lighting 30 can be flashed under the control of the warehouse-side control section 21 . Blower 31 is provided to circulate cool air in refrigerator 1 during normal operation. The blower 31 can generate sound energy such as wind noise and motor noise by, for example, increasing the number of revolutions higher than that of normal operation.

The indoor LED 32 generates light energy for transmitting an imaging instruction to the camera device 2. In this embodiment, the indoor LED 32 is configured to emit light in a predetermined frequency band that can be detected by the optical sensor 14 described above. It's becoming In addition, the indoor LED 32 can blink in a predetermined pattern, and constitutes transmission means for transmitting an image capturing instruction to the camera device 2 side by blinking in a pattern corresponding to the image capturing instruction. In addition, since the indoor lighting 30 described above also emits light energy, it can be used as a transmission means instead of the indoor LED 32 . Moreover, when using the indoor lighting 30 as a transmission means, it is not necessary to provide indoor LED32.

The indoor buzzer 33 is composed of, for example, a piezoelectric buzzer that generates sound energy to transmit an imaging instruction to the camera device 2 . The indoor buzzer 33 can output, for example, 20 kHz sound (that is, sound out of the audible range). It is configured to be inaudible. When the panel buzzer 29 is used as the transmission means or the air blower 31 is used as the transmission means, the indoor buzzer 33 may not be provided. The indoor buzzer constitutes a transmission means.

The communication adapter 34 communicates with the access point 3, the indoor portable terminal 4, and the like, and is detachably attached to the refrigerator 1 in this embodiment. Although only the refrigerator 1 is shown in FIG. 1, the communication adapter 34 is also provided for other home appliances such as an air conditioner to network the home appliances. The communication adapter 34 constitutes communication means. Also, the communication adapter 34 is configured to be able to directly communicate with the camera device 2 without going through the access point 3 . Since this communication adapter 34 is also used for visualization as described above, it basically always operates while the refrigerator 1 is operating.
Next, the operation of the configuration described above will be described.

By providing the camera device 2 described above, it is possible to image the interior of the house 7, the interior of the refrigerator, and the like. In this case, by transmitting an imaging instruction from the portable terminal 4 to the camera device 2 via the external network 5, it is possible to obtain imaging data at any timing even from a remote location. However, since it is unknown when the imaging instruction will be sent, the communication module 17 must always be in operation, which increases power consumption. As a result, the battery 16 needs to be replaced (or charged) in one day or several days.

Therefore, in the camera device 2 and the indoor imaging system 100, by transmitting an imaging instruction from a household appliance such as the refrigerator 1 (by linking with the household appliance), power consumption is suppressed and indoor information such as imaging data is captured. can be obtained arbitrarily. In the following, for the sake of simplification of explanation, examples of the case of using optical energy, the case of using sound energy, the case of using vibrational energy, and the case of combining them (optical energy and energy are Examples of use) will be explained individually.
<When using light energy>
When an image capturing instruction is transmitted using optical energy, the refrigerator 1 executes the refrigerator-side processing shown in FIG. 5, and the camera device 2 executes the camera-side processing shown in FIG.

Refrigerator 1 determines whether it has received an imaging instruction in the refrigerator-side process shown in FIG. 5 (R1). A request for imaging from the user is received by the refrigerator 1 through the communication adapter 34 via the access point 3 (see FIG. 4). If the refrigerator 1 has not received the imaging instruction (R1: NO), it stands by. On the other hand, when the refrigerator 1 receives the imaging instruction (R1: YES), it determines whether the door is closed (R2). Wait until closed.

When the door is closed (R2: YES), the refrigerator 1 emits energy (light energy in this case) after notifying that it is being imaged from the operation panel 22 or the like (R3). In this step R3, the refrigerator 1 emits light energy by blinking the indoor LED 32 in a predetermined pattern corresponding to the imaging instruction. Specifically, as shown in FIG. 7, the refrigerator 1 repeats ON/OFF of the indoor LED 32 during a blinking period set in advance upon receiving the imaging instruction. That is, in the present embodiment, a pattern in which the light energy blinks at 5 Hz is adopted as the pattern indicating the imaging instruction. This blinking pattern is a pattern that cannot occur in a general usage state of the refrigerator 1 . That is, although the interior lighting 30 is turned on when the door is opened, it is considered that the door will not be opened and closed at 5 Hz (0.2 s cycle), so there is a risk of misjudgment between the opening and closing of the door and the imaging instruction. There is no

Now, in the camera-side processing shown in FIG. 6, when the power is turned on (S1), the camera device 2 shifts to sleep mode (S2). This sleep mode corresponds to a low power mode that consumes less power than the normal operating mode. Then, the camera device 2 determines whether or not energy has been detected (S3). More specifically, in this step S3, the camera-side control section 18 is in a standby state in the sleep mode, and it is determined whether or not the optical sensor 14 has notified that light energy has been detected. This notification is given by a well-known interrupt signal or the like in a microcomputer or the like.

If the camera device 2 does not detect energy (S3: NO), it stands by, and if it detects energy (S3: YES), it returns to the normal operation mode (S4). Then, it is determined whether the pattern of the detected energy matches the pattern of the imaging instruction (S5). Specifically, the camera device 2 detects an ON/OFF edge of light energy, and if the edge is detected 10 times or more in, for example, 5 seconds, determines that it indicates an imaging instruction.

If the camera device 2 matches the pattern of the image capturing instruction (S5: YES), the camera device 2 captures an image of the interior (S6), and after transmitting the image data to the mobile terminal 4 or the like or storing it in the server 6 or the like ( S7), the process proceeds to step S2 and shifts to the sleep mode. The camera device 2 also shifts to the sleep mode when the pattern does not match the imaging instruction pattern (S5: NO).
In this way, it is possible to transmit an imaging instruction to the camera device 2 in the sleep mode using optical energy.
<When sound energy is used>

When the image capturing instruction is transmitted using sound energy, refrigerator 1 executes the refrigerator-side processing shown in FIG. 5, and camera device 2 executes the camera-side processing shown in FIG. 6, as in the case of optical energy. Differences in processing contents will be described in detail below.

When the refrigerator 1 receives the imaging instruction (R1: YES), it checks whether the door is closed (R2: YES), and after notifying that imaging is in progress (R3), energy (here, sound energy) emitted. In this case, the refrigerator 1 emits sound energy by ringing the panel buzzer 29 in a predetermined pattern. Specifically, as shown in FIG. 8, the refrigerator 1 has a pattern of ON (ringing) for 0.5 seconds and OFF (stopping) for 0.5 seconds during a preset ringing period upon receiving the imaging instruction. , the panel buzzer 29 is sounded. That is, in the present embodiment, the pattern indicating the imaging instruction is a preset frequency band of 6 kHz (in the case of the indoor buzzer 33, an inaudible range of 20 kHz), and a predetermined period (0.5 seconds). A pattern that intermittently rings at a period) is adopted. This ringing pattern is a pattern different from a normal operation (user's setting operation), and is a pattern that cannot occur except for an imaging instruction.

Now, in the camera-side processing shown in FIG. 6, when the power is turned on (S1), the camera device 2 shifts to a sleep mode and waits (S2). When the refrigerator 1 is notified by the sound sensor 19 that sound energy has been detected by an interrupt signal or the like, that is, when sound energy is detected (S3: YES), the refrigerator 1 returns to the normal operation mode (S4). It is determined whether the pattern of sound energy matches the pattern of the imaging instruction (S5). In this case, the camera device 2 detects an ON/OFF edge of the sound energy, and if the edge is detected 10 times or more in, for example, 5 seconds, it determines that the imaging instruction is indicated.

Then, when the pattern of the image capturing instruction matches (S5: YES), the camera device 2 captures an image of the interior (S6), and transmits the image data to the mobile terminal 4 or the like or stores it in the server 6 or the like. After that (S7), the process proceeds to step S2 and shifts to the sleep mode.
In this way, the imaging instruction can be transmitted to the camera device 2 in the sleep mode using sound energy.
<When vibration energy is used>

In the case of the light energy and the sound energy described above, it was assumed that the user would send an imaging instruction in real time. A situation is assumed in which an imaging instruction is set in advance to perform imaging when there is a possibility. That is, the receiving means for receiving the imaging instruction is configured to be capable of receiving (accepting) not only real-time imaging instructions but also imaging instructions based on preset conditions.

At this time, the refrigerator 1 executes the refrigerator-side processing shown in FIG. 9, and the camera device 2 executes the camera-side processing shown in FIG. Note that the flow of the camera-side processing shown in FIG. 10 is generally common to the camera-side processing shown in FIG. 6, so the different points will be described in detail.

Refrigerator 1 determines whether the door has been opened or closed (R10) in the chamber-side processing shown in FIG. 9, and waits when the door has not been opened (R10: NO). On the other hand, when the door is opened and closed (R10: YES), the refrigerator 1 notifies that the image is being captured (R11), and then transmits an image capturing instruction from the communication adapter 34 to the camera device 2 (R11). ).

In the camera-side processing shown in FIG. 10, when the power is turned on (S10), the camera device 2 shifts to sleep mode (S11) and determines whether vibration (vibration energy) is detected (S12). When the door of the refrigerator 1 is opened and closed as described above, vibration is generated accordingly. Therefore, when the camera device 2 detects vibration (S12: YES), it returns to the normal operation mode (S13), and determines whether it has received an imaging instruction from the refrigerator 1 (S14). In this step S14, the imaging instruction is received via the communication module 17. FIG.

Then, when receiving the imaging instruction (S14: YES), the camera device 2 takes an image of the interior (S15), transmits the imaging data or stores it in the server 6 or the like (S16), and then shifts to sleep mode. The destination in step S16 is the portable terminal 4 or the like. In other words, when the door of the refrigerator 1 is opened and closed, the camera device 2 notifies the user of the possibility that the storage state of the article or the like has changed as imaging data.
In this way, the imaging instruction can be transmitted to the camera device 2 in the sleep mode using vibration energy.
<When light energy and vibration energy are used>

This time, an example of capturing an image by the camera device 2 alone in a situation where an image capturing instruction is set in advance to capture an image when the door of the refrigerator 1 is opened and closed using light energy and vibration energy will be described. At this time, the camera device 2 executes camera-side processing shown in FIG. Note that the flow of the camera-side processing shown in FIG. 11 is generally the same as the camera-side processing shown in FIG. 10, so different points will be described in detail.

In the camera-side processing shown in FIG. 11, when the power is turned on (S20), the camera device 2 shifts to sleep mode (S21) and determines whether light energy is detected (S22). When the door of the refrigerator 1 is opened, the refrigerator 1 turns on the interior lighting 30, for example. Further, when the door is opened, the camera device 2 is illuminated by the light outside the refrigerator. In other words, the open/closed state of the door can be detected by detecting the light energy. Therefore, when the camera device 2 detects light energy (S22: YES), the door of the refrigerator 1 is assumed to be opened, and the camera device 2 returns to the normal operation mode (S23).

Subsequently, the camera device 2 determines whether the state corresponds to closing of the door (S24). Here, "a state corresponding to door closing" means a state in which the door is closed after being opened. More specifically, the following two points are determined in step S24.
a) Was the period during which the light energy was detected not instantaneous, but a period required to take out the article, etc.?
b) Did you detect vibrational energy when the door was closed?

Camera device 2 determines that the door of refrigerator 1 has been opened or closed by determining these. When it is determined that the state corresponds to the door being closed (S24: YES), the interior of the room is imaged (S25), and after the imaged data is transmitted or stored in the server 6 or the like (S26), the system shifts to sleep mode. . The destination in step S26 is the portable terminal 4 or the like.
In this way, the imaging instruction can also be transmitted to the camera device 2 in the sleep mode by combining light energy and vibration energy.
According to the embodiment described above, the following effects can be obtained.

The camera device 2 has an image capturing unit 11 for capturing an image of the interior, a receiving unit for receiving an image capturing instruction via a home appliance, and is always on standby in a low power mode that consumes relatively less power than in a normal operation mode. and a camera-side control unit 18 that returns to the normal operation mode when an imaging instruction is received by the receiving means and performs control for imaging the interior of the room by the imaging means. There is no need to wait in the normal operating state even if the As a result, power consumption during standby can be reduced. Further, since the receiving means is provided, the interior can be imaged whenever the imaging instruction is transmitted. Therefore, it is possible to arbitrarily acquire imaging data, which is indoor information, while suppressing power consumption.

The imaging instruction is transmitted by physical energy emitted from the home appliance, and the receiving means is composed of the optical sensor 14, the sound sensor 19, the vibration sensor 20, etc. for detecting the energy. It is possible to use the lighting 30 or the like, which is already present in home electric appliances, to transmit the imaging instruction. Accordingly, the imaging instruction can be transmitted to the camera device 2 without providing an additional component.

A dedicated configuration such as the indoor LED 32 or the indoor buzzer 33 may be provided as a transmission means. In this case, for example, by setting the indoor LED 32 to emit light energy in a wavelength band other than visible light, or by setting the indoor buzzer 33 to emit sound energy of about 20 kHz or higher, which exceeds the audible range, the user is affected. It is possible to transmit an imaging instruction without having to do so.

An imaging instruction is transmitted by emitting energy in a predetermined pattern, and whether or not the patterns match is added to the imaging conditions. Detection and erroneous imaging can be prevented.

When the imaging is finished and when the pattern of the detected energy does not match the pattern indicating the imaging instruction, the sleep mode (low power mode) is entered, so power consumption can be reduced.

For example, when using devices such as the panel buzzer 29 and the interior lighting 30 that are pre-installed in home electric appliances, energy may be emitted from them, as a matter of course, in cases other than imaging instructions. Therefore, erroneous image capturing can be prevented by setting the image capturing instruction pattern to a pattern that cannot occur in normal operation (such as the blinking pattern shown in FIG. 7 and the ringing pattern shown in FIG. 8).

The camera device 2 described above, an operation terminal such as the portable terminal 4 for inputting the imaging instruction to the camera device 2, a communication adapter 34 for receiving the imaging instruction from the operating terminal, and transmitting the received imaging instruction to the camera device 2. Since the indoor imaging system 100 is configured by home appliances having a transmission means (indoor LED 32, panel buzzer 29, etc.) that communicates, it is possible to reduce power consumption during standby, and while suppressing power consumption, It is possible to arbitrarily acquire imaging data, which is indoor information.
(Other embodiments)

The configurations exemplified in the above-described embodiments are not limited thereto, and can be modified, changed in combination, etc. as shown below, for example. And also with those configurations, it is possible to obtain an effect similar to that of the first embodiment.

Numerical values such as the blinking period and the ringing period shown in one embodiment are examples, and can be set as appropriate. When detecting light energy, instead of detecting the ON/OFF edge, it is determined whether the intensity (illuminance) of the light energy exceeds a reference value, whether the ON/OFF cycle matches, or whether the ON/OFF Any pattern or determination criterion may be adopted as long as the influence of disturbance light can be suppressed, such as whether the pulse widths of the .

In that case, the light energy may be set to a wavelength band other than visible light, such as using infrared rays. In addition, when the camera device 2 is installed in the room of the house 7 and lighting equipment (visible light) is used as a transmission means, by setting the blinking cycle to a cycle (for example, about 30 Hz or more) that cannot be determined by the human eye, It is also possible to transmit an imaging instruction in a state that is invisible to the human eye.

Also, when detecting sound energy, it is determined whether the intensity of sound energy (so-called sound pressure or dB value) exceeds a reference value, whether the ON/OFF cycle matches, or whether the ON/OFF pulse width matches. Any pattern or criterion may be employed as long as the influence of disturbance sound can be suppressed.

In that case, by using ultrasonic waves in a wavelength range exceeding the human audible range (for example, about 20 kHz or more), the user does not have to worry about the generation of sound even at home. Further, without using the panel buzzer 29 or the indoor buzzer 33, the blower 31 may be raised to a speed not used in normal operation (for example, 2500 rpm) to generate sound energy.

In one embodiment, the refrigerator 1 was exemplified as a home appliance, but other home appliances may be successful or unsuccessful. For example, if the sound of an air conditioner or television is used, not only the interior of the refrigerator 1 but also the interior of the house 7 can be captured by the camera device 2 in a similar manner. Furthermore, the frequency corresponding to the imaging instruction may be set in advance, such as transmitting the imaging instruction by sound energy in a frequency band that does not compete with home electric appliances. As for light energy, for example, since an air conditioner is provided with an infrared transmitting/receiving unit capable of two-way communication with a remote controller, the infrared transmitting/receiving unit can be used as a transmission means. Also, even a washing machine can be used as a transmission means by using a buzzer or the like to indicate the end of operation.

Although sensors for detecting light energy, sound energy, and vibration energy are provided in one embodiment, one or two sensors may be provided.

In one embodiment, an example in which light energy and vibration energy are combined is shown, but light energy and sound energy may be combined, sound energy and vibration energy may be combined, or all of them may be combined. good too. Of course, not only when an imaging instruction is set in advance to take an image when the door of the refrigerator 1 is opened and closed, but also when transmitting an imaging instruction transmitted in real time, each energy is combined and transmitted. may

In one embodiment, image data captured by the camera device 2 is shown as indoor information, but other information may be acquired. That is, in the same configuration as in one embodiment, an information acquisition device for acquiring indoor information such as image data and audio data is provided with information acquiring means for acquiring indoor information and an acquisition instruction for the information acquiring means. It is always on standby in a low power mode that consumes relatively less power than the normal operation mode with the receiving means, and returns to the normal operation mode when the acquisition instruction is received by the receiving means, and retrieves the indoor information. and a control means for controlling the information acquisition means to acquire the information. With such a configuration as well, it is possible to obtain the same effects as in the first embodiment, such as being able to arbitrarily acquire indoor information while suppressing power consumption.
In addition, the following inventions are described in this specification.

The camera device, wherein the control means picks up an image of the room when the pattern of the light energy received by the receiving means matches the pattern indicating the image pick-up instruction.

The control means shifts to a low power mode when the pattern of the light energy received by the receiving means and the pattern indicating the imaging instruction do not match, and when imaging by the imaging means ends. A camera device characterized by:
A camera device according to claim 1, wherein the light energy has a blinking cycle set to 30 Hz or more.
The camera device, wherein the light energy is set in a wavelength band other than visible light.

Imaging means for imaging the interior of the room; Receiving means for receiving imaging instructions for imaging the interior of the room via the refrigerator; a control means for returning to a normal operation mode and capturing an image of the interior of the room by the imaging means when the imaging instruction is received by the receiving means; and for inputting the imaging instruction to the camera apparatus. , communication means for receiving the image capturing instruction from the operation terminal, and transmission means for transmitting the image capturing instruction received by the communication means to the camera device, wherein the image capturing The indoor imaging system is characterized in that means is provided in a room of the refrigerator to take an image of the interior of the refrigerator, and when an imaging instruction is detected by a receiving means, the indoor imaging system returns to a normal operation mode.

The imaging instruction is transmitted by light energy of a predetermined pattern emitted from an indoor lighting provided in the room of the refrigerator, and the receiving means is composed of an optical sensor that detects the light energy. and wherein said control means returns to a normal operation mode when a predetermined pattern of light energy emitted from said room lighting is detected by said receiving means.

Information acquiring means for acquiring indoor information, receiving means for receiving an acquisition instruction to the information acquiring means, and always standing by in a low power mode that consumes relatively less power than the normal operating mode, control means for returning to a normal operation mode when the acquisition instruction is received by the receiving means, and for controlling the information acquisition means to acquire indoor information; The indoor imaging system is provided for obtaining information on the interior of the refrigerator, and is characterized by returning to a normal operation mode when an imaging instruction is detected by a receiving means.

The acquisition instruction is transmitted by light energy of a predetermined pattern emitted from an indoor lighting provided in the refrigerator, and the receiving means is composed of an optical sensor that detects the light energy. and wherein said control means returns to a normal operation mode when light energy of a predetermined pattern emitted from said indoor lighting is detected by said receiving means.

While several embodiments of the invention have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and equivalents thereof.

In the drawing, 1 is a refrigerator (home appliance), 2 is a camera device, information acquisition device, 4 is a mobile terminal (operation terminal), 6 is a server (operation terminal), 11 is an imaging unit (imaging means, information acquisition means), 14 is an optical sensor (sensor, detection means, reception means), 18 is a camera side control section (control means), 19 is a sound sensor (sensor, detection means, reception means), 20 is a vibration sensor (sensor, detection means, reception means). 28 is a panel LED (transmitting means), 29 is a panel buzzer (transmitting means), 30 is an indoor lighting (transmitting means), 31 is a blower (transmitting means), 32 is an indoor LED (transmitting means), and 33 is an indoor A buzzer (transmission means), 34 a communication adapter (communication means), and 100 an indoor imaging system.

Claims (1)

a camera device having imaging means and receiving means for receiving an imaging instruction, and imaging when the imaging instruction is received by the receiving means;
a control means for determining whether the door of the refrigerator is open or closed;
a transmission means for transmitting an imaging instruction to the camera device,
When the control means receives an imaging instruction from an external operation terminal, it determines whether the door is open or closed , and if it determines that the door is open, it waits until the door is closed, A refrigerator in which, when it is determined that the door is closed, an image is captured by the camera device when the door is closed by transmitting a received image capturing instruction to the camera device .

Images