JP6566694B2 - Control device, refrigerator, refrigerator photographing control system and program - Google Patents

Description

The present invention relates to a control device, refrigerator, to a refrigerator photographing control system and program.

  In recent years, home appliances have become more multifunctional, and network connection functions and other added values have been added. As for the refrigerator, a refrigerator that has a function of browsing a user's information communication terminal by installing a camera in the store and browsing an image in the store taken by the camera has been proposed and put to practical use.

  In addition, because it is used for surveillance camera applications and user recognition, it can be used for refrigerators that can shoot both inside and outside with one camera by changing the direction of the camera, A refrigerator equipped with a camera has also been proposed.

  Patent Document 1 automatically changes the direction of the camera to shoot not only inside the refrigerator compartment, vegetable compartment, freezer compartment, etc., but also inside the drawer, door pocket, and the user in front of the refrigerator body. A refrigerator is disclosed.

  Patent Document 2 discloses an article storage that can confirm who opened the door of an article storage such as a refrigerator based on outside image data acquired by an outside imaging camera.

JP 2003-42626 A JP 2007-46833 A

  The techniques of Patent Literature 1 and Patent Literature 2 can be used as a surveillance camera for photographing an intruder, but on the other hand, it is necessary to provide a mechanism for driving the camera and a camera dedicated to photographing outside the warehouse. Become expensive.

This invention is made | formed in view of the above situations, and it aims at providing the function which image | photographs the person who opened the refrigerator which exists in the low cost at low cost.

In order to achieve the above object, a control device according to the present invention provides:
An open / close determination unit that determines whether the refrigerator door is open or closed based on an open / close signal indicating opening / closing of the refrigerator door;
The inside of the refrigerator is photographed when the door of the refrigerator is closed to a camera attached to the inside of the refrigerator and the photographing direction as seen from the position inside the refrigerator and the attached part is fixed, and the open / close determination unit is the refrigerator A camera control unit for instructing to take a picture of the outside when it is determined that
An image acquisition unit that receives an image signal captured by the camera and generates image information.

According to the present invention, the camera control unit is attached to the inside of the refrigerator, and the outside of the refrigerator is photographed when the open / close determination unit determines that the refrigerator door is opened. Instruct them to do so. As a result, by using a camera to shoot the refrigerator inside when the refrigerator door is closed, it is possible to shoot the outside-compartment when the refrigerator door is opened, dedicated camera for photographing the outside-compartment is not required It is possible to provide a function of photographing a person who opened a refrigerator outside the warehouse at a low cost.

It is a figure which shows the structural example of the refrigerator imaging | photography control system which concerns on Embodiment 1 of this invention. FIG. 3 is a diagram illustrating a functional configuration example of a control device according to the first embodiment. 2 is a diagram illustrating a hardware configuration example of a control device according to Embodiment 1. FIG. 5 is a diagram illustrating an example of home information according to Embodiment 1. FIG. 6 is a flowchart illustrating an example of operation of refrigerator photographing control processing according to the first embodiment. It is a figure which shows the structural example of the refrigerator imaging | photography control system which concerns on Embodiment 2 of this invention. 6 is a diagram illustrating a functional configuration example of a control device according to Embodiment 2. FIG. It is a figure which shows the structural example of the refrigerator imaging | photography control system which concerns on Embodiment 3 of this invention. FIG. 10 is a diagram illustrating a functional configuration example of a control device according to a third embodiment. It is a figure which shows the structural example of the refrigerator imaging | photography control system which concerns on Embodiment 4 of this invention. FIG. 10 is a diagram illustrating a functional configuration example of a control device and a management device according to a fourth embodiment. FIG. 11 is a diagram illustrating an example of home information according to the fourth embodiment. 10 is a flowchart illustrating an example of operation of refrigerator photographing control processing according to the fourth embodiment.

  EMBODIMENT OF THE INVENTION Below, the form for implementing this invention is demonstrated in detail with reference to drawings. In addition, the same code | symbol is attached | subjected to the part which is the same or it corresponds in a figure. In the present invention, the camera for photographing inside the refrigerator is used for photographing outside the warehouse. However, the existing technology may be used for the control at the time of photographing inside the warehouse, and will be omitted in the following description.

(Embodiment 1)
FIG. 1 is a diagram illustrating a configuration example of a refrigerator imaging control system according to Embodiment 1 of the present invention. The refrigerator photographing control system 100 includes a refrigerator 2 and a control device 1 that controls the refrigerator 2.

  The refrigerator 2 includes, for example, a compressor, an evaporator, a circulation fan, and the like (all not shown), and cools items in the warehouse. The refrigerator 2 includes a camera 7a and a camera 7b for in-compartment shooting, and an opening / closing sensor 8 that detects opening / closing of the door. In the example of FIG. 1, two cameras are provided. However, it is sufficient that at least one camera is located at a position where the outside can be photographed when the door is opened.

  The refrigerator 2 is connected to the control device 1, and the camera 7 a and the camera 7 b transmit image signals of captured images to the control device 1. The opening / closing sensor 8 transmits an opening / closing signal indicating opening / closing of the detected door to the control device 1. The open / close signal may output an open signal when the door is opened, and may output a close signal when the door is closed, or at different levels depending on whether the door is closed or open. May be output. The control device 1 may be built in the refrigerator 2 or may control a plurality of refrigerators 2.

  FIG. 2 is a diagram illustrating a functional configuration example of the control device according to the first embodiment. The control device 1 includes a home information acquisition unit 11, a storage unit 12, a home determination unit 13, an open / close determination unit 14, a camera control unit 15, and an image acquisition unit 16. The at-home information acquisition unit 11 acquires at-home information indicating whether or not the user is at home. The home information acquisition method may be directly input by the user, or may be acquired from the user terminal connected to the user terminal. The home information acquisition unit 11 stores the acquired home information in the storage unit 12.

  The control device 1 includes a processor 1001 and a memory 1002, for example, as shown in FIG. Home information acquisition unit 11, home determination unit 13, open / close determination unit 14, camera control unit 15, and image acquisition unit 16 are realized by processor 1001 executing a program stored in memory 1002. In addition to the program, the memory 1002 stores image information and home information processed by the processor 1001. The user interface 1003 passes the at-home information input by the user to the processor 1001. The sensor interface 1004 receives an open / close signal from the open / close sensor 8 and notifies the processor 1001 of the open / close signal. The camera interface 1005 transmits a signal for instructing photographing generated by the processor 1001 to the camera 7a and the camera 7b, and receives an image signal from the camera 7a and the camera 7b. Although FIG. 3 shows an example in which the processor 1001 and the memory 1002 are each configured as one, a plurality of processors and a plurality of memories may execute the above functions in cooperation.

  FIG. 4 is a diagram illustrating an example of at-home information according to the first embodiment. In the example of FIG. 4, the number of users is one, and the at-home information is information indicating a user's daily home or absence time zone. For example, the user goes out at 10:00 on April 1 and returns home at 21:00, and stays at home until 10:00 on April 2 of the following day. The at-home information is not limited to such information indicating the home or absence time zone of each day, but may be information indicating the home or absence time zone of each day of the week, or may be information indicating the current home or absence. .

  The home determination unit 13 of the control device 1 in FIG. 2 refers to the home information stored in the storage unit 12 and monitors the absence of the user. When the at-home information is information indicating the user's home or absence schedule as shown in FIG. 4, the at-home determination unit 13 includes a timer, and checks whether the user is absent by checking the current time with the at-home information. Determine. If the home determination unit 13 determines that the user is absent, the home determination unit 13 sends an absence notification signal to the camera control unit 15 to notify that the user is absent.

  The open / close determination unit 14 receives an open / close signal from the open / close sensor 8. When the open / close determination unit 14 receives an open / close signal indicating that the door of the refrigerator 2 has been opened, the open / close determination unit 14 sends a door open notification signal to the camera control unit 15 to notify that the door of the refrigerator 2 has been opened. When the open / close determination unit 14 receives an open / close signal indicating that the door of the refrigerator 2 is closed, the open / close determination unit 14 sends a door close notification signal to the camera control unit 15 to notify that the door of the refrigerator 2 is opened.

  When the camera control unit 15 receives the absence notification signal from the home determination unit 13 and then receives the door opening notification signal from the open / close determination unit 14, the camera control unit 15 transmits a shooting instruction signal instructing the camera 7a and the camera 7b to perform shooting. Thereafter, when the camera control unit 15 receives the closing notification signal from the open / close determination unit 14, the camera control unit 15 transmits a shooting end signal instructing the camera 7a and the camera 7b to end shooting. When the camera 7a and the camera 7b are always activated, the camera control unit 15 may transmit only the shooting instruction signal.

  When the image acquisition unit 16 receives image signals from the camera 7a and the camera 7b, the image acquisition unit 16 performs processing such as digital conversion and image compression on the received image signal to generate image information. The image acquisition unit 16 stores the generated image information in the storage unit 12. The image acquisition unit 16 may store all of the generated image information in the storage unit 12 or may store it in the storage unit 12 only when a person is captured. For example, a general technique such as face recognition may be used to determine whether a person is captured. By discarding image information in which no person is shown, the capacity of the storage unit 12 can be minimized, and the cost can be reduced.

  FIG. 5 is a flowchart illustrating an example of the operation of the refrigerator imaging control process according to the first embodiment. The refrigerator photographing control process starts when the control device 1 is turned on.

  The home determination unit 13 refers to the home information stored in the storage unit 12 and determines whether or not the user is away (step S11). When the user is not absent (step S11; NO), the home determination unit 13 repeats step S11 and monitors the absence of the user. When the user is absent (step S11; YES), the home determination unit 13 sends an absence notification signal to the camera control unit 15.

  The open / close determination unit 14 determines whether or not the door of the refrigerator 2 is opened based on the open / close signal received from the open / close sensor 8 (step S12). When the door is not open (step S12; NO), the open / close determination unit 14 repeats step S11 and step S12, and waits for reception of an open / close signal indicating that the door of the refrigerator 2 is open. When the door is opened (step S <b> 12; YES), the open / close determination unit 14 sends a door opening notification signal to the camera control unit 15.

  Upon receiving the absence notification signal from the home determination unit 13 and the door opening notification signal from the opening / closing determination unit 14, the camera control unit 15 transmits a shooting instruction signal to the camera 7a and the camera 7b (step S13). The camera 7a and the camera 7b are activated when receiving a shooting instruction signal, and take a picture. The camera 7 a and the camera 7 b transmit the image signal of the captured image to the control device 1. When receiving the image signal from the camera 7a and the camera 7b (step S14), the image acquisition unit 16 generates image information from the received image signal and stores it in the storage unit 12 (step S15).

  The open / close determination unit 14 determines whether or not the door of the refrigerator 2 is closed based on the open / close signal received from the open / close sensor 8 (step S16). When the door is not closed (step S16; NO), the open / close determination unit 14 repeats step S16 and waits for reception of an open / close signal indicating that the door of the refrigerator 2 is closed. When the door is closed (step S <b> 16; YES), the opening / closing determination unit 14 sends a door closing notification signal to the camera control unit 15. Upon receiving the door closing notification signal from the open / close determination unit 14, the camera control unit 15 transmits a shooting end signal to the camera 7a and the camera 7b (step S17), and ends the process. The camera 7a and the camera 7b stop when receiving the photographing end signal.

  Note that the camera 7a and the camera 7b may shoot repeatedly until receiving the shooting end signal after receiving the shooting instruction signal, or may take a video (moving image).

  As described above, according to the refrigerator photographing control system 100 of the first embodiment, there is no need for a dedicated camera for photographing the outside of the box, and no drive device for changing the direction of the camera is necessary. It is possible to provide a function of photographing a person who has opened the refrigerator when absent.

(Embodiment 2)
FIG. 6 is a diagram illustrating a configuration example of the refrigerator imaging control system according to Embodiment 2 of the present invention. The refrigerator photographing control system 200 includes a refrigerator 2 and a control device 1 that controls the refrigerator 2. The refrigerator 2 according to the second embodiment includes a display device 9 that displays image information in addition to the configuration of the refrigerator 2 according to the first embodiment.

  FIG. 7 is a diagram illustrating a functional configuration example of the control device according to the second embodiment. The control device 1 includes a display control unit 17 in addition to the home information acquisition unit 11, the storage unit 12, the home determination unit 13, the open / close determination unit 14, the camera control unit 15, and the image acquisition unit 16. The display control unit 17 transmits the image information stored in the storage unit 12 to the display device 9 for display. The display control unit 17 may be configured to receive input from the user and display the image information on the display device 9 according to an instruction from the user.

  As described above, according to the refrigerator photographing control system 200 of the second embodiment, it is not necessary to transmit the image information stored in the storage unit 12 to the outside, and the user can check the photographed image with the refrigerator 2. This improves convenience.

(Embodiment 3)
FIG. 8 is a diagram illustrating a configuration example of a refrigerator imaging control system according to Embodiment 3 of the present invention. The refrigerator photographing control system 300 includes a refrigerator 2, a control device 1 that controls the refrigerator 2, and a mobile terminal 3 that is used by a user. The mobile terminal 3 is connected to the control device 1 via the network 4. In the example of FIG. 8, one mobile terminal 3 is described as a representative, but the present invention is not limited to this. When there are a plurality of users, a plurality of portable terminals 3 may be connected to the control device 1.

  FIG. 9 is a diagram illustrating a functional configuration example of the control device according to the third embodiment. The control device 1 includes a storage unit 12, a camera control unit 15, and an image acquisition unit 16, and includes a communication unit 18 instead of the home information acquisition unit 11 and the display control unit 17. In the example of FIG. 9, three users each have a portable terminal 3a, a portable terminal 3b, and a portable terminal 3c. The mobile terminal 3 a, the mobile terminal 3 b, and the mobile terminal 3 c can communicate with the communication unit 18 via the network 4.

  The user transmits home information indicating whether or not he / she is at home using his / her mobile terminal 3 to the control device 1. The communication part 18 of the control apparatus 1 will memorize | store in the memory | storage part 12, if at-home information of each user is received. In addition, the user transmits instruction information for instructing display of image information to the control device 1 using his / her portable terminal 3. When receiving the instruction information, the communication unit 18 of the control device 1 reads the image information from the storage unit 12 and transmits the image information to the portable terminal 3 that is the instruction information transmission source. Note that the communication unit 18 may automatically transmit the image information to the user's portable terminal 3 together with information for notifying the opening of the refrigerator 2 when the image acquisition unit 16 generates the image information. Alternatively, the communication unit 18 automatically transmits only the information for notifying the opening of the refrigerator 2 to the user's portable terminal 3 when the opening / closing determination unit 14 receives an opening / closing signal indicating that the door of the refrigerator 2 is opened. May be.

  As described above, according to the refrigerator photographing control system 300 of the third embodiment, the user can input home information indicating whether or not he / she is at home to his / her mobile terminal 3, and the captured image can be input to his / her mobile terminal 3. The convenience can be improved.

(Embodiment 4)
FIG. 10 is a diagram illustrating a configuration example of a refrigerator imaging control system according to Embodiment 4 of the present invention. The refrigerator photographing control system 400 includes a refrigerator 2, a control device 1 that controls the refrigerator 2, a mobile terminal 3 that is used by a user, and a management device 5 that manages home information and image information. The portable terminal 3 and the management device 5 are connected to the control device 1 via the network 4. In the example of FIG. 10, the refrigerator 2, the control device 1, and the mobile terminal 3 are described as a single unit, but this is not a limitation. For example, when managing home information and image information of a plurality of homes, the plurality of refrigerators 2, the control device 1, and the mobile terminal 3 may be connected to the management device 5.

  FIG. 11 is a diagram illustrating a functional configuration example of the control device and the management device according to the fourth embodiment. The management device 5 includes a management communication unit 51, a management storage unit 52, and a management unit 53. The management communication unit 51 receives home information indicating whether each user is at home from the mobile terminal 3a, the mobile terminal 3b, and the mobile terminal 3c, respectively. The management communication unit 51 stores the received home information in the management storage unit 52.

  FIG. 12 is a diagram illustrating an example of home information according to the fourth embodiment. In the example of FIG. 12, the at-home information includes a “user ID” that identifies the user, a “user name” that is the name of the user, and an “absence flag” that indicates the current home / absence. Here, it is assumed that the user is a father / mother / son and uses the mobile terminal 3a, the mobile terminal 3b, and the mobile terminal 3c, respectively. For example, when the management communication unit 51 of the management device 5 in FIG. 11 receives home information indicating absence from the mobile terminal 3a, the “user name” father of “user ID” 01 of the home information stored in the management storage unit 52 is stored. Turn on the “absence flag”.

  The management unit 53 periodically refers to home information stored in the management storage unit 52 and monitors the absence of the user. When all the users are absent, in the example of FIG. 12, when the “absence flag” of all of the father, mother, and son is turned on, the management unit 53 notifies the absence of all the users. The signal is sent to the management communication unit 51. The management communication unit 51 transmits the absence notification signal received from the management unit 53 to the control device 1.

  The control device 1 includes an open / close determination unit 14, a camera control unit 15, an image acquisition unit 16, and a communication unit 18. When receiving the absence notification signal from the management device 5, the communication unit 18 sends the absence notification signal to the camera control unit 15. Upon receiving the absence notification signal from the communication unit 18, the camera control unit 15 waits for a door opening notification from the opening / closing determination unit 14. Upon receiving the door opening notification from the open / close determination unit 14, the camera control unit 15 transmits a shooting instruction signal that instructs the camera 7a and the camera 7b to perform shooting. When the camera control unit 15 receives the door closing notification from the open / close determination unit 14, the camera control unit 15 transmits a shooting end signal instructing the camera 7a and the camera 7b to end shooting.

  The image acquisition unit 16 sends the generated image information to the communication unit 18. The communication unit 18 transmits the image information received from the image acquisition unit 16 to the management device 5. When receiving the image information from the control device 1, the management communication unit 51 of the management device 5 stores the received image information in the management storage unit 52.

  The user transmits instruction information for instructing display of image information to the management apparatus 5 using his / her mobile terminal 3. When the management communication unit 51 receives the instruction information from the user, the management communication unit 51 sends it to the management unit 53. Upon receiving the instruction information from the management communication unit 51, the management unit 53 reads the image information from the management storage unit 52 and sends it to the management communication unit 51. The management communication unit 51 transmits the image information received from the management unit 53 to the portable terminal 3 that is the instruction information transmission source.

  FIG. 13 is a flowchart illustrating an example of the operation of the refrigerator photographing control process according to the fourth embodiment. The refrigerator photographing control process starts when the control device 1 and the management device 5 are turned on.

  The management unit 53 of the management device 5 refers to the at-home information stored in the management storage unit 52, and determines whether or not all users are absent (step S31). When all the users are absent (step S31; NO), the management unit 53 repeats step S31 and monitors the absence of the user. When all the users are absent (step S31; YES), the management unit 53 transmits an absence notification signal to the control device 1 via the management communication unit 51 (step S32).

  When receiving the absence notification signal from the management device 5 (step S21), the communication unit 18 of the control device 1 sends it to the camera control unit 15. The open / close determination unit 14 determines whether or not the door of the refrigerator 2 is opened based on the open / close signal received from the open / close sensor 8 (step S22). When the door is not open (step S22; NO), the open / close determination unit 14 repeats step S22 and waits for reception of an open / close signal indicating that the door of the refrigerator 2 is open. When the door is opened (step S <b> 22; YES), the open / close determination unit 14 sends a door opening notification to the camera control unit 15. Upon receiving the door opening notification from the opening / closing determination unit 14, the camera control unit 15 transmits a shooting instruction signal to the camera 7a and the camera 7b (step S23). The camera 7a and the camera 7b are activated when receiving a shooting instruction signal, and take a picture. The camera 7 a and the camera 7 b transmit the image signal of the captured image to the control device 1. When receiving the image signal from the camera 7a and the camera 7b (step S24), the image acquisition unit 16 generates image information from the received image signal and transmits the image information to the management device 5 via the communication unit 18 (step S25).

  When receiving the image information from the control device 1 (step S33), the management communication unit 51 of the management device 5 stores the received image information in the management storage unit 52 (step S34) and ends the process.

  The open / close determination unit 14 of the control device 1 determines whether or not the door of the refrigerator 2 is closed based on the open / close signal received from the open / close sensor 8 (step S26). When the door is not closed (step S26; NO), the open / close determination unit 14 repeats step S26 and waits for reception of an open / close signal indicating that the door of the refrigerator 2 is closed. When the door is closed (step S <b> 26; YES), the open / close determination unit 14 sends a door closing notification to the camera control unit 15. Upon receiving the door opening notification from the opening / closing determination unit 14, the camera control unit 15 transmits a shooting end signal to the camera 7a and the camera 7b (step S27), and ends the process. The camera 7a and the camera 7b stop when receiving the photographing end signal.

  As described above, according to the refrigerator photographing control system 400 of the fourth embodiment, the configuration of the control device 1 can be simplified by including the management device 5. In addition, a plurality of household refrigerators can be managed collectively.

  Further, when the above-described functions are realized by sharing between an OS (Operating System) and an application, or by cooperation between the OS and the application, only a part other than the OS may be stored in the medium.

  Furthermore, each program can be superimposed on a carrier wave and distributed via a communication network. For example, the program may be posted on a bulletin board (BBS, Bulletin Board System) on a communication network, and the program may be distributed via the network. Then, the above-described processing may be executed by starting these programs and executing them in the same manner as other application programs under the control of the operating system.

  Embodiments 1 to 4 may be combined. Further, in the above embodiment, the at-home information is information including a user's schedule or information including a flag indicating the user's current home status, but is not limited thereto. For example, when the operation information indicating the operation status of other home appliances in the room can be acquired, it may be determined whether the user is at home based on the operation information. Alternatively, the network 4 is a home network, and a mechanism for determining whether or not the user's mobile terminal 3 is connected to the home network is provided, and a user whose mobile terminal 3 is not connected to the home network is determined to be absent. May be. Moreover, you may acquire at-home information from a housing security system.

  In the above embodiment, the control device 1 or the management device 5 stores at-home information and image information, but is not limited thereto. The control device 1 or the management device 5 may store the history of the temperature sensor in the cabinet, the number of times the door is opened and closed, the time that the door is open, and the like, which are taken by the camera 7a and the camera 7b of the refrigerator 2. It may be used as a trigger condition. For example, when the user is at home and the door is kept open for a time longer than the threshold, the shooting trigger can be used to identify users who are using inefficient refrigerators. It can be used to raise awareness. Further, when an abnormality that triggers photographing is generated, information notifying the abnormality may be displayed on the display device 9 or transmitted to the user's portable terminal 3.

  DESCRIPTION OF SYMBOLS 1 Control apparatus, 2 Refrigerator, 3, 3a, 3b, 3c Portable terminal, 4 Network, 5 Management apparatus, 7a, 7b Camera, 8 Opening / closing sensor, 9 Display apparatus, 11 Home information acquisition part, 12 Storage part, 13 Home judgment , 14 Open / close determination unit, 15 Camera control unit, 16 Image acquisition unit, 17 Display control unit, 18 Communication unit, 51 Management communication unit, 52 Management storage unit, 53 Management unit, 100, 200, 300, 400 Refrigerator shooting control System, 1001 processor, 1002 memory, 1003 user interface, 1004 sensor interface, 1005 camera interface.

Claims (15)

An open / close determination unit that determines whether the refrigerator door is open or closed based on an open / close signal indicating opening / closing of the refrigerator door;
The inside of the refrigerator is photographed when the door of the refrigerator is closed to a camera attached to the inside of the refrigerator and the photographing direction as seen from the position inside the refrigerator and the attached part is fixed, and the open / close determination unit is the refrigerator A camera control unit for instructing to take a picture of the outside when it is determined that
An image acquisition unit that receives an image signal captured by the camera and generates image information;
Control device. An open / close determination unit that determines whether the refrigerator door is open or closed based on an open / close signal indicating opening / closing of the refrigerator door;
Camera control attached to the inside of the refrigerator and instructing the camera to take an image of the inside of the refrigerator when the door of the refrigerator is closed, and to take an image of the outside of the refrigerator when the open / close determination unit determines that the door of the refrigerator is opened. And
An image acquisition unit that receives an image signal captured by the camera and generates image information;
A home information acquisition unit for acquiring home information indicating whether or not the user is at home;
A home determination unit that monitors the absence of the user with reference to the home information acquired by the home information acquisition unit, and
The camera control unit instructs the camera to take an image of the outside when the home determination unit determines that the user is absent and the open / close determination unit determines that the door of the refrigerator is opened. ,
Control apparatus. The home information acquisition unit acquires the home information from a home security system,
The control device according to claim 2 . The at-home information acquired by the at-home information acquisition unit is information indicating whether the user is at home transmitted from the mobile terminal of the user.
The control device according to claim 2 . The at-home information acquired by the at-home information acquisition unit is information indicating a schedule of home or absence of the user,
The at-home determination unit compares the current time with the at-home information to determine whether the user is absent,
The control device according to claim 2 . The at-home information acquired by the at-home information acquisition unit is information indicating the operation status of indoor home appliances,
The home determination unit, based on the information indicating the稼work conditions, determines the user whether at home,
The control device according to claim 2 . The at-home information acquired by the at-home information acquisition unit is information indicating whether the user's mobile terminal is connected to a home network,
The home determination unit determines that the user is absent if the mobile terminal is not connected to the home network.
The control device according to claim 2 . The image acquisition unit determines whether or not a person is included in the captured image using face recognition, and stores the image information in the storage unit when the person is included in the captured image.
The control device according to any one of claims 1 to 7 . A communication unit that transmits the image information to an external device via a network;
The communication unit transmits information notifying the opening of the refrigerator to the external device via the network when the opening / closing determination unit determines that the door of the refrigerator is opened.
The control device according to any one of claims 1 to 8. The camera control unit instructs the camera to take an image of the outside when the open / close determining unit determines that the door of the refrigerator has been opened for a period of time equal to or greater than a threshold.
The control device according to any one of claims 1 to 9. An open / close sensor for detecting opening and closing of the refrigerator door;
An open / close determination unit that receives an open / close signal indicating opening / closing of the refrigerator door detected by the open / close sensor and determines whether the refrigerator door is open or closed;
A camera attached to the inside of the refrigerator and having a constant shooting direction as viewed from the position inside the refrigerator and the attached part ;
To the camera, the refrigerator inside the shooting when the refrigerator door is closed, when the opening and closing judging unit determines that the refrigerator door is opened, a camera control unit that instructs to shoot out compartment,
An image acquisition unit that receives an image signal captured by the camera and generates image information;
refrigerator.   An open / close sensor for detecting opening and closing of the refrigerator door;
  An open / close determination unit that receives an open / close signal indicating opening / closing of the refrigerator door detected by the open / close sensor and determines whether the refrigerator door is open or closed;
  A camera attached to the inside of the refrigerator and photographing the inside of the refrigerator when the refrigerator door is closed;
  When the open / close determination unit determines that the refrigerator door has been opened, a camera control unit that instructs the camera to take an image of the outside of the refrigerator,
  An image acquisition unit that receives an image signal captured by the camera and generates image information;
  A home information acquisition unit for acquiring home information indicating whether or not the user is at home;
  A home determination unit that monitors the absence of the user with reference to the home information acquired by the home information acquisition unit, and
  The camera control unit instructs the camera to take an image of the outside when the home determination unit determines that the user is absent and the open / close determination unit determines that the door of the refrigerator is opened. ,
  refrigerator. A management communication unit for receiving at-home information indicating whether or not the user is at home from a mobile terminal;
A management unit that monitors the absence of the user with reference to the at-home information received by the management communication unit;
An open / close sensor for detecting opening and closing of the refrigerator door;
A camera capable of photographing the inside of the refrigerator;
An open / close determination unit that receives an open / close signal indicating opening / closing of the refrigerator door detected by the open / close sensor and determines whether the refrigerator door is open or closed;
A camera control unit that instructs the camera to shoot;
An image acquisition unit that receives an image signal captured by the camera and generates image information;
When the management unit detects the absence of the user and the open / close determination unit determines that the refrigerator door is opened, the camera control unit instructs the camera to take an image of the outside,
When the management unit receives instruction information for instructing display of the image information from the mobile terminal, the management unit transmits the image information to the mobile terminal.
Refrigerator shooting control system. Computer
An open / close determining unit that determines whether the refrigerator door is open or closed based on an open / close signal indicating opening / closing of the refrigerator door,
The inside of the refrigerator is photographed when the door of the refrigerator is closed to a camera attached to the inside of the refrigerator and the photographing direction as seen from the position inside the refrigerator and the attached part is fixed, and the open / close determination unit is the refrigerator A camera control unit for instructing to take a picture of the outside when it is determined that
An image acquisition unit that receives an image signal captured by the camera and generates image information;
Program to function as.   Computer
  An open / close determining unit that determines whether the refrigerator door is open or closed based on an open / close signal indicating opening / closing of the refrigerator door,
  A camera control unit that is attached to the inside of the refrigerator and instructs the camera that takes an image of the inside of the refrigerator when the refrigerator door is closed to take an image of the outside of the refrigerator when the open / close determination unit determines that the door of the refrigerator is opened. ,
  An image acquisition unit that receives an image signal captured by the camera and generates image information;
  A home information acquisition unit for acquiring home information indicating whether or not the user is at home;
  A home determination unit that monitors the absence of the user with reference to the home information acquired by the home information acquisition unit,
  A program that functions as
  The camera control unit instructs the camera to take an image of the outside when the home determination unit determines that the user is absent and the open / close determination unit determines that the door of the refrigerator is opened. ,
  program.

Images