JP7353340B2 - refrigerator - Google Patents

Description

The present disclosure relates to refrigerators.

As a technology for photographing the storage compartment of a refrigerator with a camera, for example, Patent Document 1 states that ``a switch for photographing the door pocket, which is used when photographing the door pocket, is installed on the operation panel provided in the front of the door of the refrigerator compartment. It is stated that ``is provided.''

Japanese Patent Application Publication No. 2003-42626

Patent Document 1 does not describe, for example, the operability of a photographing switch when photographing a storage room of a refrigerator, etc., and there is room for more appropriate photographing with a camera.

The refrigerator according to the present disclosure includes:
a casing having a storage room;
a rotating door that closes the opening of the storage room;
a photographing unit provided outside the housing and photographing at least the storage room;
a control unit that causes the imaging unit to perform imaging;
A shooting button provided on the door,
The photographing button is provided on the door opposite to the side on which the door hinge is provided ,
The photographing button is provided on the side surface of the door near a handle portion as a concave portion disposed on the lower surface .

FIG. 1 is a front view of the refrigerator according to the first embodiment. It is a side view of the refrigerator concerning a 1st embodiment. FIG. 2 is a front view of the refrigerator according to the first embodiment with left and right refrigerator compartment doors open. FIG. 2 is a plan view of the refrigerator according to the first embodiment with left and right refrigerator compartment doors open. FIG. 2 is a perspective view of the camera unit of the refrigerator according to the first embodiment, viewed diagonally from below. It is a front view of the camera unit of the refrigerator concerning a 1st embodiment. It is a sectional view taken along the line II-II in FIG. 6A in the refrigerator according to the first embodiment. FIG. 1 is a system configuration diagram including a camera unit of a refrigerator according to a first embodiment. It is a flowchart of the process of automatic photography performed by the control part of the refrigerator concerning a 1st embodiment. It is a flowchart of the process of automatic photography performed by the control part of the refrigerator concerning a 1st embodiment. FIG. 2 is an explanatory diagram chronologically showing a process in which a refrigerating compartment door of the refrigerator according to the first embodiment is opened and closed. This is an example of a photographed result of the camera unit of the refrigerator according to the first embodiment in a state where image processing is not performed. This is an example of a photographed result of the camera unit of the refrigerator according to the first embodiment, after image processing has been performed. FIG. 2 is an explanatory diagram showing candidate areas that serve as a reference when adjusting exposure in the refrigerator according to the first embodiment. FIG. 7 is an explanatory diagram showing a reference area when adjusting exposure in a refrigerator according to a comparative example. It is a front view and a bottom view of the left and right refrigerator compartment doors with which the refrigerator based on 2nd Embodiment is equipped. It is a cross-sectional perspective view of the lower part of the right refrigerator compartment door with which the refrigerator based on 2nd Embodiment is equipped. It is a sectional view of the lower part of the right refrigerator compartment door with which the refrigerator concerning a 2nd embodiment is provided.

≪First embodiment≫
FIG. 1 is a front view of a refrigerator 100 according to the first embodiment.
The refrigerator 100 is a device that cools food and the like, and includes a housing 1, doors such as refrigerator compartment doors 211 and 212, and a camera unit 3. The housing 1 has a plurality of storage chambers inside thereof. In the example of FIG. 1, the storage compartments of the refrigerator 100 include, in order from the top, a refrigerator compartment 21, ice-making compartments 22 and upper freezing compartments 23 arranged on the left and right, a vegetable compartment 24, and a lower freezing compartment 25. ing.

The housing 1 has a structure in which a heat insulating material (not shown) such as urethane foam is filled between an outer box 11 made of a steel plate and an inner box (not shown) made of resin. A plurality of openings 10 (see FIGS. 2 and 4) corresponding to each chamber are provided on the front side (front side) of the housing 1. For example, when food or the like is put into the refrigerator compartment 21 through the opening 10, the refrigerator compartment doors 211 and 212 are opened. Furthermore, when the refrigerator compartment doors 211 and 212 are closed, the opening 10 of the refrigerator compartment 21 is closed. In this way, the refrigerator compartment doors 211 and 212 (doors) have the function of closing the opening 10 of the housing 1 and the like. Note that the same applies to each of the other doors.

The refrigerator 100 includes left and right refrigerator compartment doors 211 and 212 as French doors that form a refrigerator compartment 21 together with the housing 1 . The left refrigerator compartment door 211 (left door) is rotatable about the axis of the left end hinge 211a (see FIG. 4). The same applies to the right refrigerator compartment door 212 (right door). Further, the refrigerator 100 includes an ice making compartment door 221, an upper freezing compartment door 231, a vegetable compartment door 241, and a lower freezing compartment door 251 as pull-out doors.

The refrigerator compartment 21 is provided with a plurality of shelf boards 213 (see FIG. 3) that partition the refrigerator compartment 21 into predetermined areas. A plurality of door pockets 211c (see FIG. 3) for storing foods, etc. are provided on the inside of the left refrigerator compartment door 211 (the same applies to the right refrigerator compartment door 212). The ice-making compartment 22 is provided with an ice-making compartment container (not shown) that is pulled out integrally with the ice-making compartment door 221 . Similarly, the upper freezer compartment 23 is provided with an upper freezer container (not shown), the vegetable compartment 24 is provided with a vegetable compartment container (not shown), and the lower freezer compartment 25 is provided with a container (not shown). A lower freezer container (not shown) is provided.

Although not shown, the refrigerator 100 also includes a compressor, a radiator (condenser), a capillary tube (throttling mechanism), and an evaporator. The refrigerant circulates through the compressor, radiator, capillary tube, and evaporator in sequence, and the air in the storage room is cooled by heat exchange with the refrigerant flowing through the evaporator. There is. The camera unit 3 shown in FIG. 1 takes an image of the storage room of the refrigerator 100, and is installed on the top surface of the housing 1.

FIG. 2 is a side view of refrigerator 100.
As shown in FIG. 2, the camera unit 3 includes a main body part 31 and a support part 32. The main body 31 has a function of capturing images of the storage room and the like. The support section 32 supports the main body section 31 and is installed on the top surface of the housing 1.

A lens 31a (see also FIG. 5) is provided near the front end of the main body portion 31. The lens 31a is an optical element that refracts and focuses light. For example, a fisheye lens is used as such a lens 31a. The lens 31a is in a state facing downward so that the camera unit 3 can take an image of the refrigerator compartment 21 (see Figure 1) when the refrigerator compartment doors 211, 212 (see Figure 1) are opened. There is.

As shown in FIG. 2, the lens 31a is located in front of the front end of the housing 1 (the opening 10 of the housing 1). More preferably, the lens 31a is located further in front of the front surfaces of the refrigerator compartment doors 211, 212 (see FIG. 1) in the closed state. Thereby, for example, when the refrigerator compartment doors 211 and 212 are opened, the refrigerator compartment 21 can easily come into the field of view of the lens 31a. Note that it is also possible to image the vegetable compartment 24 and the like (see FIG. 1) with the camera unit 3 in a state where a pull-out door such as the vegetable compartment door 241 is opened. In this way, the lens 31a is provided at a position where each storage chamber can be viewed from above.

FIG. 3 is a front view of the refrigerator 100 with the left and right refrigerator compartment doors 211 and 212 open.
As described above, the inner plate 211b of the left refrigerator compartment door 211 is provided with a plurality of door pockets 211c for storing foods and the like (the same applies to the right refrigerator compartment door 212). When the left and right refrigerator doors 211 and 212 are opened, the food and the like in the refrigerator compartment 21 and the door pockets 211c and 212c come into the field of view of the lens 31a of the camera unit 3 (Fig. 10). (see also).

The rotating partition 211d shown in FIG. 3 is a partition for suppressing cold air leakage from the gap between the refrigerator compartment doors 211 and 212. In the example of FIG. 3, in the left refrigerator compartment door 211, a rotating partition 211d is provided at the end opposite to the axis of the hinge 211a (see FIG. 4), and rotates in a predetermined manner as the refrigerator compartment door 211 opens and closes. It is supposed to be done.

Moreover, when manually photographing the refrigerator compartment 21 using the camera unit 3, the photographing button 7, which is pressed by the user, is provided on each of the left and right refrigerator compartment doors 211 and 212. In the example of FIG. 3, in the left refrigerator compartment door 211 (door), the photographing button 7 is provided at the bottom of the surface of the refrigerator compartment door 211 opposite to the hinge 211a (see FIG. 4) (right side). The same applies to the refrigerator compartment door 212). To explain from another point of view, when the left and right refrigerator compartment doors 211, 212 are closed (see FIG. 1), one of the refrigerator compartment doors 211, 212 faces the other (rotating partition 211d in FIG. 3). A photographing button 7 is provided near the camera. By arranging the shooting button 7 in this way, for example, when the user puts his/her hand on the handle portion 212e when opening the right refrigerator compartment door 212, it is possible to prevent the user from accidentally pressing the shooting button 7 without intending to do so. It can be prevented. Further, since the user can take a photograph with the refrigerator compartment door 212 opened to a predetermined position and the rotation of the refrigerator compartment door 212 stopped, blurring of the photographed image can be suppressed. Also, compared to the case where the photographing button 7 is provided on the inner panels 211b and 212b on the inside of the refrigerator compartment doors 211 and 212, on the front surface on the outside of the refrigerator, on the wall surface of the refrigerator compartment 21, the user's hand is more likely to be reflected in the photographed image. can be suppressed.

Photographing performed when at least one of these two photographing buttons 7 is pressed by the user is referred to as "manual photographing". Moreover, the photographing performed by the control unit 8 (see FIG. 7) based on the elapsed time from the timing when the refrigerator compartment doors 211 and 212 start opening is referred to as "automatic photographing".

FIG. 4 is a plan view of the refrigerator 100 with the left and right refrigerator compartment doors 211 and 212 open.
In the example of FIG. 4, the main body 31 of the camera unit 3 is arranged slightly to the left of the center of the housing 1 of the refrigerator 100 in the left-right direction. To explain in more detail, the main body 31 of the camera unit 3 is arranged directly above the joint between the closed refrigerator compartment doors 211 and 212 (see also FIG. 1). By arranging the main body portion 31 in this manner, for example, when the refrigerator compartment doors 211 and 212 are opened, food and the like in the door pockets 211c and 212c easily enter the field of view of the camera unit 3.

Furthermore, when using the refrigerator 100, the user is often aware of the seam (boundary part) between the refrigerator compartment doors 211 and 212. Therefore, by arranging the main body part 31 directly above the joint between the refrigerator compartment doors 211 and 212, the user will not feel a sense of discomfort compared to a case where the horizontal position of the main body part 31 is outside the joint. can be suppressed.

FIG. 5 is a perspective view of the camera unit 3 viewed diagonally from below.
The main body 31 of the camera unit 3 shown in FIG. 5 includes a case 31b and a camera LED 31c (Light Emitting Diode: lighting section) in addition to the above-mentioned lens 31a (see also FIG. 2). In the example of FIG. 5, the case 31b of the main body portion 31 generally has a rectangular parallelepiped shape that is elongated in the front-rear direction. A circular hole (reference numeral not shown) is provided on the lower surface near the front end of the case 31b, and the lens 31a is exposed through this hole. Further, a camera LED 31c is provided on the rear side (inner side) of the lens 31a.

The camera LED 31c irradiates light onto the refrigerator compartment 21, etc. so that the camera unit 3 can photograph the refrigerator compartment 21 (see Figure 3) and the door pockets 211c, 212c (see Figure 3) under appropriate brightness. It is a light source. Further, the camera LED 31c (illumination section) is provided on the outside of the housing 1 of the refrigerator 100 (see FIG. 2). Although the details will be described later, in the first embodiment, the camera unit 3 is turned on when the camera LED 31c is turned on while the interior light 4 (see FIG. 7) of the refrigerator 100 is turned off. (see).

As shown in FIG. 5, by providing a lens 31a in front of the camera LED 31c, reflected light from the refrigerator compartment 21, etc. (see FIG. 3) enters the lens 31a when the refrigerator compartment doors 211, 212 are open. It becomes easier to do. Therefore, the food stored in the refrigerator compartment 21 or the like can be appropriately photographed. Note that it is preferable that the camera LED 31c be located in front of the front end (opening 10 of the housing 1) of the housing 1 (see FIG. 2) of the refrigerator 100. This makes it easier for the light emitted from the camera LED 31c to enter the refrigerator compartment 21 and the like, thereby making it easier to obtain clear photographic results.

FIG. 6A is a front view of the camera unit 3.
As shown in FIG. 6A, the main body part 31 of the camera unit 3 is installed above the support part 32. Further, the main body portion 31 is installed near the center of the support portion 32 in the left-right direction.

FIG. 6B is a sectional view taken along the line II-II in FIG. 6A.
As shown in FIG. 6B, the camera unit 3 includes a lens 31a (see also FIG. 5), a camera LED 31c (see also FIG. 5), a case 31b, and a circuit board 31d. The circuit board 31d is a printed circuit board on which an image sensor 31e (see FIG. 7) and a camera/communication control SoC 31f (System-on-a-Chip: see FIG. 7), which will be described later, are mounted. In this way, by housing the lens 31a, camera LED 31c, and circuit board 31d in one case 31b, the camera unit 3 can be made smaller and the length of the wiring can be shortened, compared to the case where these are provided separately. can.

FIG. 7 is a system configuration diagram including the camera unit 3 of the refrigerator 100.
As shown in FIG. 7, the refrigerator 100 includes, in addition to the camera unit 3, an interior light 4, a buzzer 5, a door sensor 6, a photographing button 7, and a control section 8. The interior light 4 is a light source that irradiates light into the interior of the refrigerator 100, and is provided inside the housing 1. The buzzer 5 is set at a predetermined location on the housing 1, and is sounded when, for example, the interior light 4 is turned off when photographing with the camera unit 3.

The door sensor 6 outputs a predetermined signal indicating the open/closed state of the refrigerator compartment doors 211 and 212 to the control unit 8. Although one door sensor 6 is shown in FIG. 7, in reality, the door sensor 6 corresponds to the left refrigerator compartment door 211 (see FIG. 1), and the door sensor 6 corresponds to the right refrigerator compartment door 212 (see FIG. 1). Another door sensor 6 is provided. For example, when the left refrigerator compartment door 211 is opened, the door sensor 6 corresponding to this refrigerator compartment door 211 outputs an open signal to the control unit 8 . The photographing button 7 (see also FIG. 3) is a button that is pressed by the user when manually photographing using the camera unit 3, as described above.

The control unit 8 is, for example, a microcomputer, and is configured to include electronic circuits such as a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and various interfaces, although not shown. . Then, the program stored in the ROM is read out and expanded to the RAM, and the CPU executes various processes. In addition to performing the above-described "automatic photographing", the control unit 8 performs "manual photographing" when the photographing button 7 is pressed. Note that details of the processing performed by the control unit 8 will be described later.

The camera unit 3 includes a lens 31a (see also FIG. 5), a camera LED 31c (see also FIG. 5), an image sensor 31e, a camera/communication control SoC 31f, and a wireless LAN unit 31g. The image sensor 31e is an element that photoelectrically converts the light that enters through the lens 31a and generates captured image data. As such an image sensor 31e, for example, a CCD sensor (Charge Coupled Device) or a CMOS sensor (Complementary Metal Oxide Semiconductor) is used.

The camera/communication control SoC 31f is an integrated circuit in which circuits having microcomputer functions and other applied functions are integrated on one chip and are designed to work together. The camera/communication control SoC 31f performs predetermined communication with the control unit 8 and outputs a shooting command to the image sensor 31e. As a result, captured image data is input from the image sensor 31e to the camera/communication control SoC 31f. Note that the camera/communication control SoC 31f is an example of an integrated circuit, and other types of circuits may be used.

The photographing unit 30 shown in FIG. 7 has a function of photographing at least the refrigerator compartment 21 and the like (storage compartment), and is provided outside the casing 1 of the refrigerator 100 (see FIG. 1). As shown in FIG. 7, the photographing unit 30 includes a lens 31a, an image sensor 31e, and a camera/communication control SoC 31f.

The wireless LAN unit 31g transmits photographed image data output from the camera/communication control SoC 31f to the router 51. The router 51 is a communication relay device, and transmits captured image data received from the wireless LAN unit 31g to the server 53 via the network 52. The server 53 performs predetermined processing on the captured image data and stores it in association with the identification information of the refrigerator 100. Further, when the server 53 receives a request signal for an internal image of the refrigerator 100 from the user's mobile terminal 54, the server 53 transmits the photographed image data to the mobile terminal 54. As such a mobile terminal 54, in addition to a mobile phone or a smartphone, a tablet, a wearable terminal, or the like is used.

<Control unit processing>
8A and 8B are flowcharts of automatic photographing processing executed by the control unit of the refrigerator (see FIG. 7 as appropriate).
Below, as an example, a process in which the camera unit 3 photographs the refrigerator compartment 21 when at least one of the refrigerator compartment doors 211 and 212 (see FIG. 3) is opened will be described. It is assumed that at the time of "START" in FIG. 8A, the left and right refrigerator compartment doors 211 and 212 (see FIG. 3) are in a closed state. Further, by operating the mobile terminal 54 (see FIG. 7) by the user, the automatic shooting setting can be turned on/off and the manual shooting setting can be turned on/off. In the examples of FIGS. 8A and 8B, it is assumed that the automatic shooting setting is on (automatic shooting is possible), and the manual shooting setting is also on (manual shooting is possible).

In step S101, the control unit 8 determines whether an open signal is input from the door sensor 6. That is, the control unit 8 determines whether at least one of the left and right refrigerator compartment doors 211, 212 (see FIG. 3) is opened. In step S101, if there is no input of an open signal from the door sensor 6 (S101: No), the control unit 8 repeats the process of step S101. On the other hand, in step S101, if an open signal is input from the door sensor 6 (S101: Yes), the process of the control unit 8 proceeds to step S102.

In step S102, the control unit 8 turns on the interior light 4 of the refrigerator 100 and turns on the camera LED 31c. That is, immediately after at least one of the refrigerator compartment doors 211 and 212 (doors) is opened, the control unit 8 turns on the interior light 4 and also turns on the camera LED 31c (illumination unit). As will be described later, after a predetermined time has elapsed since the opening signal was input from the door sensor 6, the control unit 8 turns off the interior light 4 (S103: Yes, S104), but until then, the interior light 4 is turned off. Turn it on. As a result, the refrigerating compartment 21 is irradiated with light, making it easier for the user to visually recognize the refrigerating compartment 21. Moreover, compared to the case where the internal light 4 is off when the user opens at least one of the refrigerator compartment doors 211 and 212, it is possible to suppress the user from feeling uncomfortable.

Further, the control unit 8 turns on the camera LED 31c as well as the interior light 4 (S102), thereby preparing for subsequent photographing (S106). Furthermore, compared to the case where the internal light 4 and the camera LED 31c are turned on at different timings, the time required for exposure adjustment during photographing can be shortened. Note that the camera LED 31c continues to be lit until both the left and right refrigerator compartment doors 211, 212 are closed.

Next, in step S103, the control unit 8 determines whether a predetermined time has elapsed since the opening signal was input from the door sensor 6. This predetermined time (for example, several seconds) is the time until the interior light 4 is turned off (S104), and is set in advance. For example, taking into account the time for subsequent exposure adjustment (S105), the steps in step S103 are made such that there is a high possibility that the refrigerator compartment doors 211, 212 are opened to a predetermined opening angle or more at the time of photographing (S106). A predetermined time is set in advance.

In step S103, if the predetermined time has not elapsed since the opening signal was input from the door sensor 6 (S103: No), the control unit 8 repeats the process of step S103. On the other hand, if the predetermined time has elapsed since the opening signal was input from the door sensor 6 (S103: Yes), the process of the control unit 8 proceeds to step S104.

In step S104, the control unit 8 turns off the interior light 4 and sounds the buzzer 5. That is, the control unit 8 sounds the buzzer 5 when turning off the internal light 4 after at least one of the refrigerator compartment doors 211 and 212 (door) is opened. By sounding the buzzer 5 in this manner, it is possible to reduce the sense of discomfort that the user feels when the interior light 4 is turned off, and it also becomes easier for the user to understand that the light is turned off for photographing.

Next, in step S105, the control unit 8 performs exposure adjustment. That is, the control unit 8 adjusts the gain (sensitivity to brightness) when amplifying the electrical signal output from the image sensor 31e, and also adjusts the shutter speed of the camera unit 3 and the like. For example, the control unit 8 adjusts the gain described above so that the average value of the brightness of the captured image data is within a predetermined range. By adjusting the exposure in this way, it is possible to suppress overexposure (halation) and underexposure in the photographed image. Note that image input and exposure adjustment may be repeated in a predetermined manner from when at least one of the refrigerator compartment doors 211 and 212 is opened until both of the refrigerator compartment doors 211 and 212 are closed.

Next, in step S106, the control unit 8 outputs a photographing command. That is, the control unit 8 takes in, as photographed image data, an electric signal output from the image sensor 31e through photoelectric conversion and further amplified with a predetermined gain. In this way, after at least one of the refrigerator compartment doors 211 and 212 (door) is opened (S101: Yes), the control unit 8 turns off the interior light 4, and further turns on the camera LED 31c (illumination unit). In this state, the photographing section 30 is caused to perform photographing (S102, S104, S106).

Although not particularly shown in FIGS. 8A and 8B, after a predetermined period of time (for example, several seconds) has elapsed since the interior light 4 was turned off, the control section 8 causes the photographing section 30 to perform photographing. is preferred. By providing a predetermined period of time between turning off the interior light 4 and photographing in this manner, exposure adjustment (S105) can be appropriately performed.

Further, although not particularly shown in FIGS. 8A and 8B, the control unit 8 may perform imaging every time a predetermined period of time has elapsed since the first imaging. The length of this predetermined time may be the same as the predetermined time in step S103, or may be different.

In step S107, the control unit 8 recognizes the opening angles of the refrigerator compartment doors 211 and 212. For example, the control unit 8 recognizes the opening angle of the opened refrigerator compartment doors 211 and 212 by performing image processing such as edge detection. Note that the "opening angle" is the angle at which the refrigerator compartment doors 211 and 212 are open, and is recognized based on the front end of the housing 1 (see FIG. 4) when the refrigerator 100 is viewed from above, for example.

Next, in step S108 of FIG. 8B, the control unit 8 determines whether the opening angle of the refrigerator compartment doors 211, 212 is greater than or equal to a predetermined value. This predetermined value is a threshold value of the opening angle that serves as a criterion for selecting whether to save the photographing result (S109) or discard it (S110), and is set in advance.

In step S108, when the opening angle of at least one of the refrigerator compartment doors 211 and 212 is equal to or greater than the predetermined value (S108: Yes), the process of the control unit 8 proceeds to step S109. In step S109, the control unit 8 saves the photographing results and proceeds to the process of step S112. This is because if the opening angles of the refrigerator compartment doors 211 and 212 are equal to or greater than a predetermined value, there is a high possibility that the refrigerator compartment 21 and the like are properly photographed.

In addition, the photographing result when only the left refrigerator compartment door 211 is open, the photographing result when only the right refrigerator compartment door 212 is open, and the photographing result when both the left and right refrigerator compartment doors 211 and 212 are open. The photographic results obtained when the camera is being scanned may be stored in different storage areas.

Further, in step S108, when the opening angles of the refrigerator compartment doors 211 and 212 are both less than the predetermined value (S108: No), the process of the control unit 8 proceeds to step S110. In step S110, the control unit 8 discards the photographing results. This is because if the opening angle of the refrigerator compartment doors 211 and 212 is less than a predetermined value, there is a high possibility that the refrigerator compartment 21 and the like are not properly imaged.

Then, in step S111, the control unit 8 sounds the buzzer 5. That is, when photographing is performed in a state where the opening angle of the refrigerator compartment doors 211, 212 (doors) is less than a predetermined value (S108: No), the control unit 8 sounds the buzzer 5 (S111). This allows the user to be informed that the current imaging result has been discarded. Note that the sound of the buzzer 5 in step S111 and the sound of the buzzer 5 in step S104 (when the interior light 4 is turned off) may be made different so that the user can distinguish between the two. After performing the process of step S111, the process of the control unit 8 proceeds to step S112.

In step S112, the control unit 8 turns on the interior light 4. In other words, the control unit 8 turns on the interior light 4 while keeping the camera LED 31c on. In this way, after the control unit 8 causes the photographing unit 30 to take a photograph (S106 in FIG. 8A), the control unit 8 turns on the interior light 4 (S112 in FIG. 8B). As a result, the refrigerator compartment 21 is brightly illuminated, making it easier for the user to visually recognize the refrigerator compartment 21.

Next, in step S113, the control unit 8 determines whether a close signal is input from the door sensor 6. If there is no close signal input from the door sensor 6 (S113: No), the control unit 8 returns to step S102. On the other hand, if a close signal is input from the door sensor 6 (S113: Yes), the process of the control unit 8 proceeds to step S114.

In step S114, the control unit 8 turns off the interior light 4 and turns off the camera LED 31c.
In step S115, the control unit 8 selects a photographing result. For example, the control unit 8 selects the newest photographing result to be transmitted to the server 53 from among the plurality of stored photographing results.

In step S116, the control unit 8 transmits the photographing results to the server 53. That is, the control unit 8 sequentially transmits the captured image data to the server 53 via the wireless LAN unit 31g, router 51, and network 52 shown in FIG. After performing the process of step S116, the control unit 8 ends the series of processes (END).

In addition, in the server 53, for example, in addition to the right and left regions of the refrigerator compartment 21 (see FIG. 3), the region of the left refrigerator compartment door 211 (see FIG. 3) and the right refrigerator compartment door are 212 (see FIG. 3) are extracted. Then, in the server 53, the images in each area are individually updated to the latest ones. Further, in response to a request signal from the mobile terminal 54, the photographed image data is transmitted from the server 53 to the mobile terminal 54, and is displayed in a predetermined manner on the display (not shown) of the mobile terminal 54.

FIG. 9 is an explanatory diagram chronologically showing the process of opening and closing the refrigerator compartment doors 211 and 212.
In addition, in FIG. 9, in addition to the states of the refrigerator compartment doors 211 and 212, the states of the interior light 4 and the camera LED 31c are shown in chronological order in the alphabetical order of A, B, C, ..., J, K, L. It shows. Further, in FIG. 9, the interior light 4 of the refrigerator 100 is illustrated when it is on (for example, state B), and when the interior light 4 of the refrigerator 100 is off, it is illustrated. The interior light 4 is not shown (for example, state A). Similarly, in FIG. 9, the camera LED 31c is illustrated when the camera LED 31c is on (for example, state B), and the camera LED 31c is not illustrated when the camera LED 31c is off. (For example, state A).

In the example of FIG. 9, the user opens the left refrigerator compartment door 211 from state A in which both the left and right refrigerator compartment doors 211 and 212 are closed (states B, C, and D). Thereafter, the camera LED 31c remains lit until both the left and right refrigerator doors 211, 212 are closed (S102 in FIG. 8A). Furthermore, as shown in states B and C, both the interior light 4 and the camera LED 31c are turned on until a predetermined period of time has elapsed since the left refrigerator compartment door 211 started to be opened (S103: No). There is (S102). Then, when a predetermined period of time has elapsed since the left refrigerator door 211 started to be opened (S103 in FIG. 8A: Yes), as shown in state D, the interior light 4 is turned off and the camera LED 31c is turned on. Automatic photographing is performed in this state (S104 to S106). Thereafter, the interior light 4 is turned on again in state E (S112 in FIG. 8B).

In states E and F, the left refrigerator compartment door 211 is closed, while the right refrigerator compartment door 212 is opened. In this case, as shown in state F, automatic photographing is performed again with the interior light 4 turned off and the camera LED 31c turned on (S104 to S106 in FIG. 8A). Thereafter, in the example of FIG. 9, as shown in states G, H, and I, the user closes the left refrigerator compartment door 211 and then opens it again.

Even in such a case, as shown in state I, automatic photographing is performed again with the interior light 4 turned off and the camera LED 31c turned on (S104 to S106 in FIG. 8A). As a result, it is possible to take a picture with both the left and right refrigerator compartment doors 211 and 212 open. Thereafter, as shown in state J, the interior light 4 is turned on again (S112 in FIG. 8B). In this way, every time at least one of the left and right refrigerator compartment doors 211 and 212 is opened, the control unit 8 uses the camera unit 3 to take a picture of the refrigerator compartment 21 and the like.

Further, as shown in state K, when the user presses the shooting button 7 (see FIG. 3), the control unit 8 performs manual shooting. Although this case is not particularly shown in the flowcharts of FIGS. 8A and 8B, the control unit 8 performs the following process. That is, when the photographing button 7 is pressed after at least one of the refrigerator compartment doors 211 and 212 (door) is opened, the control unit 8 turns off the interior light 4, and further turns off the camera LED 31c (illumination unit). The photographing unit 30 is caused to perform photographing with the light turned on (state K). In addition, when turning off the interior light 4, the control unit 8 may sound the buzzer 5 in order to reduce the user's discomfort. After performing manual photography, the control unit 8 turns on the interior light 4 again as shown in state L.

Note that when shooting based on the operation of the shooting button 7 (manual shooting), the control unit 8 gives priority to the result of this shooting over other shooting results (results of automatic shooting) and sends the result to the mobile terminal 54 (FIG. 7). It is preferable to use it for displaying (see). Thereby, the user can check the result of the photographed image by pressing the photographing button 7 on his/her own mobile terminal 54 (see FIG. 7).

Further, after shooting based on the operation of the shooting button 7 (after manual shooting), while at least one of the refrigerator compartment doors 211 and 212 (door) is open, the control unit 8 controls shooting again (automatically). It is preferable not to take photographs. This is because if the results of manual photography are preferentially transmitted, there is no particular need to perform automatic photography afterwards.

Further, if the user does not firmly close at least one of the refrigerator compartment doors 211 and 212, leaving the door ajar, automatic photography is performed at predetermined intervals, but the photography results are It is not sent to the server 53 (see FIG. 7). This is because, in the case of so-called ajar doors, the opening angle of the refrigerator compartment doors 211, 212 is usually less than a predetermined value (S108 in FIG. 8B: No), and the photographic result is discarded (S110).

FIG. 10 is an example of the photographed result of the camera unit in a state where no image processing is performed.
Note that in FIG. 10, the upper side of the paper is the front and the lower side of the paper is the rear, so the left and right sides are reversed with respect to FIG. 3 (the same applies to FIGS. 11, 12A, and 12B). In the example of FIG. 10, both the left and right refrigerator compartment doors 211 and 212 are open, and in addition to the refrigerator compartment 21, there is a door pocket 211c of the left refrigerator compartment door 211, and a door pocket 212c of the right refrigerator compartment door 212. has also been photographed.

In particular, by using a fisheye lens as the lens 31a of the camera unit 3 (see FIG. 5), images can be captured with a wide range of angles of view. However, in a state where image processing is not performed, as shown in FIG. , the number of pixels in the captured image decreases.

FIG. 11 shows an example of a photographed result of the camera unit 3 after image processing has been performed.
For example, predetermined image processing is performed by the server 53 (see FIG. 7) based on the photographic results shown in FIG. image. By displaying such an image on the mobile terminal 54 (see FIG. 7), the user can grasp at a glance what kind of food is stored in the refrigerator compartment 21 or the like.
Next, details of the exposure adjustment process (S105 in FIG. 8A) by the control unit 8 will be described in detail using FIG. 12A (first embodiment) and FIG. 12B (comparative example).

FIG. 12A is an explanatory diagram showing candidate regions that serve as a reference when adjusting exposure in the refrigerator according to the first embodiment.
As described above, in the exposure adjustment process (S105 in FIG. 8A), the gain when amplifying the electrical signal output from the image sensor 31e (see FIG. 7) is adjusted. In the first embodiment, at least one of the three rectangular areas 61 to 63 shown in FIG. 12A is used as a reference for indicating the degree of brightness of an image in exposure adjustment. That is, at least one of the region 61 of the left refrigerator compartment door 211, the region 62 of the right refrigerator compartment door 212, and a predetermined region 63 between these regions 61 and 62 is used. Note that the positions and sizes of the regions 61 to 63 may be changed as appropriate based on the opening angles of the refrigerator compartment doors 211 and 212.

In the example of FIG. 12A, the left refrigerator compartment door 211 is open, but the right refrigerator compartment door 212 is closed. In such a case, the control unit 8 performs exposure adjustment based on the average value of the brightness of the region 61 corresponding to the left refrigerator compartment door 211. That is, the control unit 8 adjusts the gain when amplifying the electrical signal output from the image sensor 31e (see FIG. 7) so that the average value of the brightness of the region 61 is included in a predetermined range. As a result, the region 62 of the right refrigerator compartment door 212 that is in the closed state and the region 63 that is partially separated from the left refrigerator compartment door 211 are excluded from the reference when adjusting the gain. Therefore, even when the surroundings of the refrigerator compartment are dark, the control unit 8 can appropriately adjust the exposure without increasing the gain too much.

In this way, when one of the right side refrigerator door 212 (right door) and the left side refrigerator door 211 (left door) is opened, the control unit 8 controls The exposure gain during photographing is adjusted using the area corresponding to one as a reference. Note that signals indicating the open/closed states of the left and right refrigerator compartment doors 211 and 212 are output to the control unit 8 from the left and right door sensors 6 (see FIG. 7).

Further, the exposure adjustment may be performed based on the one having the highest average value of image brightness among the three regions 61 to 63. That is, the control unit 8 adjusts the exposure gain during photographing based on the region having the highest average value of image brightness among the plurality of regions 61 to 63 included in the field of view of the photographing section 30. This prevents the gain from becoming too high and, in turn, suppresses whiteout (halation) in the photographed image.

Further, exposure is adjusted based on an area including at least a part of the left and right refrigerator doors 211 and 212 to which an open signal is input from the door sensor 6, and which has the highest average image brightness. may be performed. This allows the control unit 8 to appropriately set the gain in exposure adjustment even in a situation where, for example, light irradiated from outside the refrigerator 100 is reflected on the surface of the closed refrigerator compartment door 212. Thereby, it is possible to suppress the occurrence of blown-out highlights and blown-up shadows in the photographed image.

FIG. 12B is an explanatory diagram showing a region serving as a reference for brightness when adjusting exposure in a refrigerator according to a comparative example.
In the comparative example of FIG. 12B, one rectangular area 60 is set as a reference when adjusting exposure. For example, when the left and right refrigerator compartment doors 211, 212 are opened, the rectangular area 60 is set to include both of these refrigerator compartment doors 211, 212. When one large area 60 is used in this way, when the surroundings of the refrigerator 100 are dark, the right refrigerator compartment door 212 appears dark when photographed, so the gain is set high to increase the sensitivity to light. As a result, in the photographed image, overexposure tends to occur in the left refrigerator compartment door 211 in the open state and in the left half of the refrigerator compartment 21.

On the other hand, in the first embodiment (see FIG. 12A), for example, the control unit 8 selects a reference area for adjusting exposure based on the open/closed states of the refrigerator compartment doors 211 and 212. There is. Thereby, it is possible to suppress overexposure in the captured image and display a clear image that is easy for the user to view on the mobile terminal 54 (see FIG. 7).

Note that the wall surface of the refrigerator compartment 21 (storage compartment) and the inner plates 211b, 212b (see FIG. 3) of the refrigerator compartment doors 211, 212 (doors) may be white, respectively. Here, "white" is a color that is reflected over substantially the entire spectrum of visible light with a reflectance of 50% or more. From another perspective, "white" means that in the RGB color system, the brightness of each element of R (Red), G (Green), and B (Blue) is approximately the same, and the reflectance is 50% or more. The color is reflective.

When the wall surface of the refrigerator compartment 21 is white, there is a tendency for the photographed results to have blown out highlights. It can be suppressed. In this manner, according to the first embodiment, the refrigerator compartment 21 and the like can be appropriately photographed using the camera unit 3. Therefore, the user can easily check the state of the refrigerator compartment 21 and the like by looking at the mobile terminal 54.

≪Second embodiment≫
In the second embodiment, a photographing button 7A (see FIG. 13) is provided near the handles 211e, 212e (see FIG. 13) provided on the lower surfaces of the left and right refrigerator doors 211, 212 (see FIG. 13). However, this embodiment is different from the first embodiment. Note that other aspects are the same as those in the first embodiment. Therefore, the parts that are different from the first embodiment will be explained, and the explanation of the overlapping parts will be omitted.

FIG. 13 is a front view and a bottom view of left and right refrigerator compartment doors 211, 212 included in the refrigerator 100A according to the second embodiment.
In addition, in FIG. 13, a bottom view of the refrigerator compartment doors 211, 212 is shown below the front view of the refrigerator compartment doors 211, 212. As shown in FIG. 13, a handle portion 211e recessed upward is provided on the lower surface of the left refrigerator compartment door 211 over a predetermined length in the lateral direction.

Further, on the lower surface of the left refrigerator compartment door 211, on the inner side of the handle portion 211e (on the opposite side from the hinge axis 211f), there is provided a photographing button 7A that is pressed by the user when performing manual photographing. That is, the photographing button 7A is provided on the outside of the handle 211e of the refrigerator compartment door 211 (door) and near the handle 211e. Similarly, a handle portion 212e and a photographing button 7A are also provided on the lower surface of the right refrigerator compartment door 212.

By arranging the shooting button 7A in this way, for example, when the user puts his/her hand on the handle portion 212e when opening the right refrigerator compartment door 212, it is possible to prevent the user from accidentally pressing the shooting button 7A without intending to do so. It can be prevented. Note that when the user places his right hand on the right handle portion 211e, his palm faces upward and the thumb of his right hand is located on the outside (on the right side). In the example of FIG. 13, the photographing button 7A is provided inside (on the left side) of the handle portion 212e. Therefore, when the user places his right hand on the handle portion 212e, it is possible to prevent the right thumb from accidentally touching the photographing button 7A. Note that the same can be said of the photographing button 7A on the left refrigerator compartment door 211.

Further, since the photographing button 7A is provided near the handle portion 212e, the user can move his hand while keeping his hand on the refrigerator compartment door 212 and press the photographing button 7A with the touch of his fingertip. . Therefore, when the user presses the photographing button 7A, there is no need to temporarily release the hand placed on the refrigerator compartment door 212, so that operability can be improved. Further, since the user can take a photograph with the refrigerator compartment door 212 opened to a predetermined position and the rotation of the refrigerator compartment door 212 stopped, blurring of the photographed image can be suppressed. Furthermore, compared to the case where the photographing button 7A is provided on the inner panels 211b and 212b on the inside of the refrigerator compartment door 212, the front surface on the outside of the refrigerator, the wall surface of the refrigerator compartment 21, etc., it is possible to prevent the user's hand from appearing in the photographed image. It can be suppressed. Further, by providing the photographing button 7A near the handle portion 212e, it is possible to share the wiring of the rotating partition 211d (see FIG. 3) and the operation panel (not shown) with the wiring of the photographing button 7A.
Note that the processing of the control unit 8 (see FIG. 7) based on the operation of the shooting button 7A is the same as that of the first embodiment (see FIGS. 8A and 8B), and therefore the description thereof will be omitted.

FIG. 14A is a cross-sectional perspective view of the lower part of the right refrigerator compartment door 212 included in the refrigerator.
Note that the configuration in FIG. 14A corresponds to FIG. 13. As shown in FIG. 14A, the photographing button 7A of the right refrigerator compartment door 212 is connected to a resin switch part 71A that is pressed by the user, a laminate film 72A that is pasted on the outside of the switch part 71A, and a press of the switch part 71A. It also includes a switch board 73A that generates a predetermined electrical signal. Further, a plurality of wiring lines 80 are connected to the switch board 73A. These wiring lines 80 include power lines and signal lines. Note that the left refrigerator compartment door 211 (see FIG. 13) has a similar configuration.

FIG. 14B is a sectional view of the lower part of the right refrigerator compartment door 212 included in the refrigerator.
Note that the configuration in FIG. 14B corresponds to FIG. 13 and FIG. 14A. As shown in FIG. 14B, inside the refrigerator compartment door 212 (door), a partition wall 92 is provided that partitions a region 91a around the photographing button 7A from others. The partition wall 92 is provided with an insertion hole 93 for the wiring 80 connected to the photographing button 7A. A seal member 94 that closes the insertion hole 93 is installed in the insertion hole 93 . As such a sealing member 94, for example, urethane foam is used. The wiring 80 is inserted through the seal member 94. That is, with the wiring 80 inserted through the insertion hole 93, the insertion hole 93 is closed by the seal member 94.

By providing such a sealing member 94, when a heat insulating material such as urethane is injected (filled) into the internal space of the refrigerator compartment door 212 during manufacturing, the heat insulating material is placed on the shooting button 7A side through the insertion hole 93. Can prevent leakage. Further, the wiring 80 connected to the photographing button 7A can be drawn out to the area 91b above the partition wall 92.

≪Modification example≫
Although the refrigerator 100 and other embodiments according to the present disclosure have been described above, the invention is not limited to these descriptions, and various changes can be made.
For example, in each embodiment, a configuration has been described in which the camera unit 3 is provided on the top surface of the housing 1 of the refrigerator 100 (see FIG. 2), but the configuration is not limited to this. That is, the camera unit 3 may be provided at another predetermined position on the outside of the housing 1.

Further, in each embodiment, a configuration has been described in which the camera LED 31c (see FIG. 5) is arranged on the rear side of the lens 31a (see FIG. 5), but the present invention is not limited to this. For example, a camera LED may be arranged in front of the lens 31a. Further, a plurality of camera LEDs may be arranged at predetermined positions.

Further, in each embodiment, as an example, a case has been described in which the inside of the refrigerator compartment doors 211 and 212 is photographed by the camera unit 3 in addition to the refrigerator compartment 21, but the present invention is not limited to this. For example, at least one of the pull-out ice making compartment door 221 (door: see Figure 1), the upper freezer compartment door 231 (door), the vegetable compartment door 241 (door), and the lower freezer compartment door 251 (door) One may be photographed by the camera unit 3.

Moreover, although each embodiment demonstrated the structure in which the photography button 7 (refer FIG. 3) is provided in the left and right refrigerator compartment doors 211 and 212, it is not limited to this. For example, a photographing button (not shown) is provided on at least one of the pull-out ice making compartment door 221 (see FIG. 1), the upper freezing compartment door 231, the vegetable compartment door 241, and the lower freezing compartment door 251. You can do it like this.

In each embodiment, when at least one of the refrigerator compartment doors 211 and 212 is opened (S101 in FIG. 8A: Yes), the control unit 8 turns on the internal light 4 and turns on the camera LED 31c. Although the process (S102) has been described, the present invention is not limited thereto. That is, when at least one of the refrigerator compartment doors 211 and 212 is opened, the control unit 8 may turn on the internal light 4 and the camera LED 31c at a predetermined timing.

Further, in each embodiment, the control unit 8 continues to light the camera LED 31c after at least one of the left and right refrigerator doors 211, 212 is opened until both of the refrigerator compartment doors 211, 212 are closed. Although explained above, it is not limited to this. For example, when the exposure adjustment (S105 in FIG. 8A) is not being performed, the control unit 8 may turn off the camera LED 31c at a predetermined timing.

Further, in the second embodiment, a configuration has been described in which concave handle portions 211e and 212e are provided on the lower surfaces of the refrigerator compartment doors 211 and 212 (see FIG. 13), but the present invention is not limited to this. For example, the refrigerator compartment doors 211 and 212 may be provided with predetermined door handles (not shown). In this case, a photography button (not shown) may be provided on the outside of the door handle, or a photography button (not shown) may be provided at a predetermined location on the door handle itself.

Further, the refrigerator 100 and the like described in each embodiment are merely examples, and the present invention can be applied to other types of refrigerators. For example, each embodiment can be applied to a refrigerator equipped with a single-opening refrigerator compartment door (not shown) or a portable refrigerator (not shown).

Further, each embodiment is described in detail to explain the present invention in an easy-to-understand manner, and the present invention is not necessarily limited to having all the configurations described. Furthermore, it is possible to add, delete, or replace some of the configurations of the embodiments with other configurations.
Further, the mechanisms and configurations described above are those considered necessary for explanation, and not all mechanisms and configurations are necessarily shown in the product.

100,100A Refrigerator 1 Housing 10 Opening 21 Refrigerator room (storage room)
211 Refrigerator door (door, left door)
212 Refrigerator door (door, right door)
211a, 212a Hinge 211b, 212b Inner plate 211e, 212e Handle portion 22 Ice making room (storage room)
221 Ice making room door (door)
23 Upper freezer room (storage room)
231 Upper freezer compartment door (door)
24 Vegetable room (storage room)
241 Vegetable compartment door (door)
25 Lower freezer room (storage room)
251 Lower freezer compartment door (door)
3 Camera unit 4 Interior light 5 Buzzer 6 Door sensor 7,7A Shooting button 8 Control section 31c Camera LED (lighting section)
30 Photographing unit 54 Mobile terminal 61, 62, 63 Area 80 Wiring 91a Area (area around the shooting button)
92 Partition wall 93 Through hole 94 Seal member

Claims (7)

a casing having a storage room;
a rotating door that closes the opening of the storage room;
a photographing unit provided outside the housing and photographing at least the storage room;
a control unit that causes the imaging unit to perform imaging;
A shooting button provided on the door,
The photographing button is provided on the door opposite to the side on which the door hinge is provided ,
The refrigerator is characterized in that the photographing button is provided near a handle portion as a recessed portion of the side surface of the door . The photographing unit is capable of performing automatic photographing in response to a command other than pressing the photographing button;
The refrigerator according to claim 1, wherein when the shooting button is pressed during execution of the automatic shooting, shooting is performed. 3. The refrigerator according to claim 2, wherein, when the photographing is performed based on the pressing of the photographing button, the control section does not perform photographing again while the door is open. The refrigerator according to claim 2 or 3, wherein when the control unit performs photography based on pressing the photography button, the control unit outputs the result of the photography with priority over other photography results. The control unit may output the result of the photographing or set it as a candidate for output when the opening angle of the door is a predetermined value or more when photographing is performed based on the pressing of the photographing button. The refrigerator according to any one of items 2 to 4. The door includes a partition wall that partitions an area around the shooting button from other areas,
The partition wall is provided with an insertion hole for a wire connected to the shooting button,
The refrigerator according to any one of claims 1 to 5 , further comprising a sealing member that closes the insertion hole in a state in which the wiring is inserted through the insertion hole. 7. The photographing button is provided on the lower surface between the handle and an end of the door opposite to the hinge. refrigerator.

Images