JP6744444B2 - Operating terminal, operating terminal program, home appliances - Google Patents

Description

Embodiments of the present invention relate to an operation terminal, a program for the operation terminal, and a home electric appliance.

2. Description of the Related Art Conventionally, it is known that a refrigerator can be provided with a camera or the like to obtain information on foodstuffs in a refrigerator, for example, from a remote location (see Patent Document 1, for example).

JP2012-226748A

The present invention provides an operation terminal, a program for the operation terminal, and a home electric appliance that can give an image pickup command to a camera device in a favorable manner.

The operation terminal according to the embodiment is capable of communicating with a camera device and a home electric appliance having a signal output unit that outputs an imaging command to the camera device, and a communication unit capable of communicating with the camera device and the home electric appliance, and an input. And a determination unit that determines whether or not the camera device can receive the imaging command, and a control unit. The control unit determines by the determination unit that the camera device can receive the imaging command. At the time, the input unit is validated, and based on the validated input unit being operated, the imaging command is transmitted to the camera device via the home electric appliance.

The figure which shows the indoor imaging system of one embodiment typically. The figure which shows the external appearance of the camera apparatus of one embodiment typically. The figure which shows the inside of the camera apparatus of one embodiment typically. The figure which shows typically the electric constitution of the camera apparatus and indoor imaging system of one Embodiment. The figure which shows typically the electric constitution of the operating terminal of one embodiment. The figure which shows the initial screen of the operating terminal of one embodiment. The figure which shows the setting screen of the operating terminal of one embodiment. The figure which shows the flow of a process of the refrigerator in one Embodiment. The figure which shows the flow of a process of the camera apparatus in one embodiment. The figure which shows the flow of a process of the operating terminal in one embodiment.

Hereinafter, one embodiment will be described with reference to FIGS. 1 to 10.
As shown in FIG. 1, an indoor imaging system 100 of this embodiment includes a refrigerator 1 as a home electric appliance, a camera device 2 for imaging the room, an access point 3 for communicating with the refrigerator 1 side, It is composed of the operation terminal 4 and the like. Of these, the access point 3 is connected to an external network (wide area communication network or mobile phone network) 5 which is a communication means, and via the external network 5, the remote operation terminal 4, the server 6 and the like and the refrigerator 1 side. It is connected so that it can communicate with. In the present embodiment, short-distance wireless communication, such as Bluetooth (communication), is performed between the refrigerator 1 and the access point 3, between the access point 3 and the operation terminal 4, and between the camera device 2 and the access point 3. Communication is performed by wireless communication according to the registered trademark).

The operation terminal 4 is for inputting an imaging instruction for causing the camera device 2 to image the room, and is assumed to be a tablet PC or a so-called smartphone (high-performance mobile phone). When the operating terminal 4 is located inside the house 7, the operating terminal 4 is communicably connected to the access point 3 by a short-range wireless system. When the operation terminal 4 is located outside the house 7, the operation terminal 4 is communicably connected to the access point 3 via the external network 5 by wide area communication. Further, the operation terminal 4 can be connected to the access point 3 via the external network 5 by wide area communication even from inside the house 7, and inside the house 7 without going through the access point 3. It is also possible to directly communicate with the refrigerator 1 side.

The server 6 is composed of a well-known computer system, stores information for accessing the refrigerator 1 (for example, an IP address, etc.) and the like, and in the present embodiment, image pickup data imaged by the camera device 2. Memorize Although only the refrigerator 1 is shown in FIG. 1, other home electric appliances such as an air conditioner (not shown) are also networked.

By networking home appliances in this way, visualization that provides the power consumption of each home appliance to the user in a visible form, and reduction of power consumption during times such as summer daytime when power demand increases Provide a system to provide usability, comfort or convenience such as power control such as peak cut to avoid instantaneous use of electric power that exceeds the rating of general households, failure diagnosis of home appliances, etc. It becomes possible. Further, by installing the camera device 2 in, for example, a refrigerating room, it is possible to check the indoor state of the refrigerator 1 (a storage state of articles, etc.). Then, by storing these various types of information, imaged data, and the like in the server 6, it becomes possible to refer to those information by the operation terminal 4 or the like via the external network 5 or the like even in a remote place.

Next, the camera device 2 will be described.
As shown in FIGS. 2 and 3, the camera device 2 includes a lens 12 of an imaging unit (imaging unit) 11 (see FIG. 4) on a surface of a housing 10 formed in a substantially rectangular parallelepiped shape, in the present embodiment. The two imaging lights 13 and the optical sensor 14 (reception means) are provided so as to be exposed. However, the lens 12, the imaging light 13, and the optical sensor 14 may not be exposed to the outside of the housing 10, but may have a surface covered with a cover or the like. Hereinafter, the side where the lenses 12 and the like are exposed (the right side in the drawing in FIG. 3) is the front of the camera device 2, and the opposite side (the left side in the drawing in FIG. 3) is the back.

As shown in FIG. 3, the camera device 2 has a housing 10 in which a control board 15, a battery 16, a communication module 17, an acceleration sensor 19, a temperature sensor 20, and the like are housed. The control board 15 is provided with an image pickup unit 11 having a lens 12 and an image pickup device (not shown), an image pickup light 13, and a camera side control unit 18 (see FIG. 4) for controlling them. A known image pickup device such as CCD or CMOS is used as the image pickup device. The imaging light 13 uses LEDs. Further, the camera device 2 is provided with a power switch 10a (see FIG. 4) and a setting information receiving switch 10b (see FIG. 4) for starting and terminating receiving setting information. However, the camera device 2 does not include a display unit, an operation switch (input unit) for fine setting, and the like.

The battery 16 supplies electric power to the control unit, the communication module 17, the optical sensor 14, the acceleration sensor 19, and the like. That is, the camera device 2 is driven by the built-in battery 16. Therefore, the camera device 2 does not require a power cable or the like, and can be installed at any place. In the present embodiment, the camera device 2 is installed in the refrigerating room as described above.

The communication module 17 transmits the imaged data in the refrigerator imaged by the imaging unit 11 to the operation terminal 4, the server 6 and the like via the access point 3. The transmission to the server 6 is for storing the imaging data in the server 6. Here, the imaged data is data including an image of a room, for example, data in a well-known format such as a bitmap format, a JPEG format, or an MPEG format (still image, moving image), compression or encryption of the data, or an image. Any format may be used as long as it is data that can be confirmed by the operation terminal 4 or the like, such as data converted by processing.

As shown in FIG. 4, the camera side control unit 18 is composed of a microcomputer having a CPU 18a, a ROM 18b, a RAM 18c, a clock unit (clock means) 18d, a non-volatile memory 18e as an information storage means, and the like, and a camera device. 2 Control the whole. Specifically, the camera-side control unit 18 controls the imaging timing by the imaging unit 11, control for adjusting the imaging environment for imaging (lighting control of the imaging light 13), transmission of imaging data by the communication module 17, optical sensor. The control and the like for receiving (accepting) an image capturing instruction described later by 14 are performed. Further, in the present embodiment, the camera-side control unit 18 also performs image processing such as correction of a captured image. The camera-side control unit 18 constitutes sleep control, storage control means, and imaging control means.

The clock unit 18d is composed of a real-time clock module, has a time/calendar function, and can measure real-time time (time, month, day, day of the week).

The optical sensor 14 connected to the camera-side control unit 18 is a so-called illuminance sensor, and detects the illuminance around the camera device 2. More specifically, the optical sensor 14 detects light energy in a predetermined wavelength band (in this embodiment, light energy emitted from indoor lighting lamps 30 and 32 described later). The light energy detected by the optical sensor 14 is converted into an electric signal and output to the camera side control unit 18.

The optical sensor 14, which will be described in detail later, is a sensor that detects physical energy (light energy), and constitutes a receiving unit that receives an imaging instruction. In the case where the imaging instruction is received not by light energy but by sound energy or vibration energy, a sound sensor or a vibration sensor may be provided as the receiving means.

In the case of the present embodiment, the final signal form of the imaging instruction from the user has a configuration indicated by the light energy emitted in a predetermined pattern (blinking of a predetermined pattern of indoor illumination lamps 30 and 32 described later). Therefore, when the optical sensor 14 detects the blinking of the predetermined pattern, the camera-side control unit 18 determines that it is an imaging instruction.
The acceleration sensor 19 detects the installation posture of the camera device 2 (vertical installation, horizontal installation, the lens 12 faces downward, the lens 12 faces upward).

The temperature sensor 20 detects the temperature of the place where the camera device 2 is installed. The camera device 2 determines that the camera device 2 is installed in the refrigerating compartment when the temperature detected by the temperature sensor 20 is in the refrigerating compartment temperature range, and the camera is installed in the freezing compartment when the detected temperature is in the freezing compartment temperature range. It is determined that the device 2 is installed. In this case, if it is determined that it is installed in the freezer, there is a risk of malfunction, so check the refrigerator 1 side such as "Please do not put it in the freezer", advise, warn, etc. The information is transmitted and the user is informed through the operation panel 22 or the like of the refrigerator 1.

The camera device 2 having such a configuration is always on standby in the low power mode (sleep control mode), which consumes relatively less power than the normal operation mode, and returns to the normal operation mode when the imaging instruction is received. Then, the inside of the room is imaged. In the case of the present embodiment, since the camera device 2 is provided in the refrigerating compartment, the inside of the refrigerating compartment is imaged.

The refrigerator 1 in which the camera device 2 is installed has a refrigerator-side control unit 21. The storage-side control unit 21 is composed of a microcomputer having a CPU 21a, a ROM 21b, a RAM 21c, a timer 21d, etc., and controls the entire refrigerator 1. Specifically, the storage-side control unit 21 controls the temperature inside the storage detected by the temperature sensor 23, the open/closed state of the door detected by the door sensor 24, and the like so that the operating state set from the operation panel 22 is reached, for example. Based on this, the operating states of the refrigerating cooling mechanism 25 and the refrigerating cooling mechanism 26 that constitute a known refrigeration cycle are controlled.

The operation panel 22 is provided with a panel display 27, a panel LED 28, and a panel buzzer 29. The panel display 27 displays set values and the like. The panel LED 28 is provided for turning on the operation switch and the operating state. The panel buzzer 29 is configured by a piezoelectric buzzer or the like, and emits a sound (sound energy) in response to an operation to notify the operation content.

The indoor lighting lamp 30 is provided, for example, in the refrigerating compartment 1a (see FIG. 1) to illuminate almost the entire refrigerating compartment, and the indoor lighting lamp 32 is, for example, a refrigerating container provided in the refrigerating compartment 1a. It is provided to light the inside of 1b (see FIG. 1). The refrigerating container 1b is made of a transparent material, and when the inside of the refrigerating container 1b is imaged by the camera device 2, the camera device 2 may be inside or outside the refrigerating container 1b. These indoor illumination lights 30 and 32 are turned on when the door is opened. That is, the indoor illumination lamps 30 and 32 generate light energy. The indoor illumination lamps 30 and 32 also serve as a signal output unit, and can be blinked in a predetermined pattern under the control of the cabinet-side control unit 21. The blinking of the predetermined pattern is a signal indicating an image pickup command for the camera device 2. The blower 31 is provided to circulate the cool air inside the refrigerator 1 in a normal operation.

The communication adapter 34 communicates with the access point 3, the operation terminal 4 in the room, and the like, and is detachably attached to the refrigerator 1 in the present embodiment. Although only the refrigerator 1 is shown in FIG. 1, the communication adapter 34 is also provided in other home electric appliances such as an air conditioner to network the home electric appliances. The communication adapter 34 constitutes a communication means. Further, the communication adapter 34 is also configured to be able to directly communicate with the camera device 2 without going through the access point 3. Since the communication adapter 34 is also used for visualization as described above, it is basically always operating when the refrigerator 1 is operating.

On the other hand, the operation terminal 4 includes a terminal side control unit 42, a display unit 43, an input unit 44, a wide area wireless communication unit 45, a communication module 46 and the like.
The terminal-side control unit 42 includes a CPU 42a, a ROM 42b, a RAM 42c, and a non-volatile memory 42d as an information storage unit. The terminal-side control unit 42 includes a program (indoor imaging application software or the like) that cooperates with the camera device 2 in the ROM 42b or the nonvolatile memory 42d. The terminal side control unit 42 corresponds to a control unit, a determination unit, an installation location name setting unit, and an abnormality notification unit. The nonvolatile memory 42d also functions as a backup storage unit that backs up and stores the setting information.

The display unit 43 is composed of, for example, a liquid crystal display or an organic EL display, and displays various information based on a display command signal input from the terminal-side control unit 42. The input unit 44 includes a so-called touch panel input unit 44A that is a touch switch formed on the display screen of the display unit 43, a switch (not shown) mechanically provided around or near the display unit 43, and the like. It is composed of various operation keys including. The touch panel input unit 44A constitutes an image capturing command input unit 44a (see FIG. 6) and an image capturing timing input unit 44g (see FIG. 7) described later.
The wide area wireless communication unit 45 communicates with the access point 3 and the server 6 via the external network 5.

The communication module 46 is for communicating with the access point 3 by wireless communication using Bluetooth (registered trademark) as a communication means as described above. When the operation terminal 4 has a mobile phone function, it includes a voice input unit, a voice output unit, and the like.

In this embodiment, three camera devices 2 are provided in the refrigerating compartment 1a, the refrigerating container 1b, and the vegetable compartment 1c (see FIG. 1). Note that the camera devices 2 are individually referred to as camera devices 2A, 2B, and 2C.

The operation of the camera device 2 will be described.
When the power switch 10a of the camera device 2 is turned on, the camera side controller 18 performs the control shown in FIG. First, it is determined whether or not the setting information receiving switch 10b has been operated to enter the setting information receiving mode (step S1). If the setting information receiving mode has been set, the operation terminal 4 which has established communication with the camera device 2 is determined. It is determined whether or not the setting information of the imaging timing has been received from (step S2). If it is determined that the information has been received, the setting information is stored (set) in the non-volatile memory 18e (step S3, storage control means).

When the setting information receiving switch 10b is operated again to end the setting information receiving mode (step S4), the process shifts to sleep control (step S5, sleep control means). In this sleep control state, the functions other than the function of receiving the image capturing command from the indoor illumination lamp 30 or 32 and the function of determining whether or not the time measured by the clock unit 18d has reached the set image capturing timing are activated. It is in a stopped state. Therefore, the battery consumption of the battery 16 which is the power source is suppressed. In this case, the operation of the communication module 17 is also stopped. The reason for this is that the continuous operation of the communication module 17 causes the battery 16 to consume more speed, whereas the function of receiving the image capturing command from the indoor illumination lamp 30 or 32 described above consumes the battery 16 more. The speed is slow and the battery consumption can be further suppressed.

In this sleep control state, if an image pickup command is received from the indoor illumination lamp 30 or 32 (step S6), or if the image pickup timing at which the measured time is set comes (step S7), the normal operation mode is restored. Yes (step S8). Then, the inside of the room is imaged (step S9), and the imaging data is transmitted (step S10).

Next, the operation of the operation terminal 4 will be described. When the indoor imaging application of the operation terminal 4 is started, if the camera device 2 is in the setting information reception mode by operating the setting information reception switch 10b, for various settings of the operation terminal 4 and the camera device 2. Communication is established via the access point 3 or directly.

The terminal-side control unit 42 of the operation terminal 4 performs the control of FIG. First, the initial screen display (step T1) is performed. This initial screen display causes the display unit 43 to display the initial screen shown in FIG. At this time, the touch panel input unit 44A on the display unit 43 forms the imaging command input unit 44a, the setting mode start input unit 44b, and the first to fourth individual designation input units 44c to 44f. Further, the display unit 43 is provided with an image display unit 43a for displaying a captured image of the room and an image capturing date/time display unit 43b for displaying an image capturing date/time history and an image capturing date/time schedule. The display names of the individual designation input units 44c to 44f represent the refrigerator compartment name and the vegetable compartment name of the refrigerator 1, for example, "refrigerator compartment 1" means the refrigerator compartment 1a, and "refrigerator compartment 2" is the refrigerator container. 1b, and "vegetable compartment 1" means the vegetable compartment 1c. Although this display name will be described later, it can be changed.

When the user performs a touch operation on the setting mode start switch 44b (determined in step T2), the screen display of the display unit 43 displays the setting screen of FIG. 7 (step T3). In FIG. 7, the touch panel input unit 44A is used to input an image pickup timing input unit 44g, a "when I want to see" setting input unit 44h, an installation location name setting input unit 44i, a "cancel" input unit 44j, a "return" input unit 44k, and a setting. An end input section 44l is formed.

The image pickup timing input unit 44g includes a confirmation input unit 44gs for confirming the image pickup timing setting, a time down setting input unit 44g1, a time up setting input unit 44g2, a minute down setting input unit 44g3, a minute up setting input unit 44g4, and "every day". A setting input unit 44g5, a "weekday only" setting input unit 44g6, a day of the week designation input unit 44g7, a day of the week individual input unit group 44g8, a month/day setting input unit 44g9, and a special sale date automatic setting input unit 44g10 are provided.
After the step T3, processing according to the input operation is performed (step T4).

First, the relationship between the three camera devices 2A, 2B and 2C and the room in which they are installed is set by operating the individual designation input units 44c to 44f. That is, when the communication between the operating terminal 4 and the three camera devices 2A, 2B, and 2C is established, a camera designation input unit (not shown) for selectively designating each camera is displayed, and the camera designation input unit is used to arbitrarily The camera device 2 is designated and one of the individual designation input units 44c to 44f is operated to associate one of the camera devices 2 with one of the individual designation input units 44c to 44f. The method of association in this case is not limited to this.

Here, an example of setting the imaging timing will be described. For example, in the case of "photograph the room with the display name "refrigerator 1" every day at xx", the following settings are made.

First, the user operates the individual designation input unit 44c with the display name "refrigerating room 1" to specify the room with the display name "refrigerating room 1" (the room in which the camera device 2A is installed). Then, the "everyday" setting input unit 44g5 is operated, "hours/minutes" are appropriately set by the setting input units 44g1 to 44g4, and the confirmation input unit 44gs is operated to confirm the setting.

When the setting end input unit 44l is operated (determined in step T5), the terminal-side control unit 42 of the operation terminal 4 sets the imaging timing of "every day for chilling room 1a (camera device 2A)". The information is temporarily stored in the nonvolatile memory 42d (step T6) and is transmitted to the camera device 2 (step T6). This setting information is stored in the non-volatile memory 18e by the camera device 2 (2A) in step S3 described above. If the "hour/minute" (time) is confirmed by operating the confirmation input unit 44gs for one time, a plurality of times can be set by performing this a plurality of times.

Regarding the setting of the "day" of the imaging timing, except for the "every day", based on the operation of each of the input units 44g6 to 44g10, only weekdays, one to six or less days from Monday to Sunday, the month and day (day In some cases), at least one of the days according to the special sale date delivery information is set. A plurality of "days" can be set for the above "days".

For example, when the month/day setting input unit 44g9 is operated, a display screen (for example, a calendar display screen) for inputting the month/day is switched, though not shown, and the month/day (may be only the day) is set and input. It is possible to do. In this case, for example, the date immediately before the monthly payday may be input. In other words, if you buy food in bulk on a monthly payday, you can set the day before that day in advance, and on the day of payday, you can take a captured image in the refrigerator at a remote location (such as a grocery store). It is possible to know the food stock status), which is convenient for users. Further, when a special sale date or a service point day of a food store (such as a supermarket) is determined (for example, a date marked with "1"), it is advisable to set the date immediately before that.

Also, when the special sale date automatic setting input unit 44g10 is operated, the special sale date delivery information such as the special sale date and service point day is automatically acquired from the special sale information site provided by the grocery store (supermarket, etc.) via the Internet. Then, the day immediately before that can be automatically set.

Further, in FIG. 7, the display names of the individual designation input units 44c to 44f are determined based on the display names of the individual designation input units 44c to 44f being selected and operated. One of the predetermined display names is selected and set. Such a setting is a display name setting of a room in which the user installs the camera devices 2A to 2C. In this case, the refrigerating compartment 1a designated by the display name "refrigerating compartment 1", the refrigerating container 1b designated by the "refrigerating compartment 2", and the vegetable compartment 1c designated by the display name "vegetable compartment 1", It shows that the camera devices 2A, 2B, and 2C are installed, respectively. When only one camera device 2 is installed, one display name may be displayed. Further, the display name may be arbitrarily set by the user by inputting characters.

The indoor lighting lamps 30 and 32 (signal output means) are present in the refrigerating rooms designated by the display names "refrigerating room 1" and "refrigerating room 2", respectively. In addition, it is assumed that the vegetable room designated by the display name "vegetable room 1" does not have an indoor illumination lamp (signal output means). It is assumed that the freezer room also does not have an indoor illumination lamp (signal output means).

Further, the "when I want to see" setting input unit 44h normally uses (activates) the imaging command input unit 44a for causing the camera device 2 to perform an imaging operation when the user wants to image the inside of the refrigerator, Alternatively, it is for setting whether or not it is normally used (disabled, that is, only automatic imaging is performed).

Here, the operation terminal 4 is provided with the determination means as described above, and the determination means causes the camera device 2 to receive the imaging command from the indoor illumination lamps 30 and 32 which are the signal output means in the setting mode. It is determined whether or not reception is possible. In this case, the determination means determines whether or not the camera device 2 can receive the imaging command from the indoor illumination lamps 30 and 32 based on the set installation name. That is, if "refrigerating" is entered in the name of the set installation location (display name of the individual designation input units 44c to 44f), the camera device 2 captures images from the indoor illumination lamps 30 and 32 provided in the refrigerating room. If it can be determined that a command (imaging command by blinking a predetermined pattern) can be received, and “refrigerator” is not included (“vegetable” or “frozen” is included), the camera device 2 causes the indoor illumination lamps 30, 32. It can be determined that it cannot receive the imaging command from. In the state of FIG. 6, the terminal-side control unit 42 of the operation terminal 4 displays the individual designation input unit 44c that is the display name of "refrigerator 1" or the individual designation input unit 44d that is the display name of "Refrigerator 2". When operated, the imaging command input unit 44a remains displayed, and when the individual designation input unit 44e which is the display name of "vegetable room 1" is operated, the imaging command input unit 44a is not displayed. This makes it possible to inform the user that the vegetable room 1c with the display name “Vegetable room 1” cannot be imaged by the user by hiding the imaging command input unit 44a, and the imaging command input is performed. The portion 44a can be made inoperable. In this case, the image of the vegetable compartment 1c is automatically taken only at the image pickup timing.

Note that if “NO” in step T2 of FIG. 10, the process proceeds to step T7, it is determined whether or not there is another input, and if there is any input, the process according to the input operation is executed ( Step T8). For example, in FIG. 6, the user operates the individual designation input unit 44c corresponding to the display name "Cold room 1" with the intention that the user wants to view the imaged image of the cold room 1a at the present time, and then the imaging command input unit 44a is displayed. When operated (“YES” in step T7), the terminal-side control unit 42 outputs an image pickup command associated with the display name “refrigerator 1” information in step T8.

In the refrigerator 1 that has received this image pickup command, it is determined that the image pickup command has been received in step R1 shown in FIG. Then, the indexed room to be imaged (in this case, the indoor illumination lamp 30 (signal output unit) of the refrigerating room 1a is made to blink in a predetermined pattern, so that the imaging command is in the form of an optical signal to the camera device 2 (2A). (Step R3).

Then, the camera device 2A determines “YES” in step S6 of FIG. 9, returns to the normal operation mode (step S8), images the room (step S9), and transmits the imaging data (step S10). In this case, this imaging data is transmitted to the server 6 and stored therein, and is transmitted from the server 6 to the operation terminal 4. Then, if the user performs a selection operation on the individual designation input unit 44c of the operation terminal 4 (or if the selection operation has already been performed), the captured image is displayed on the image display unit 43a. In this case, the server 6 notifies the operation terminal 4 of acquisition of the captured image by e-mail or the like before transmitting the captured image to the operation terminal 4, and the operation terminal 4 transmits the captured image when the operation terminal 4 requests transmission. 4 may be transmitted.

Further, when the operation terminal 4 can receive the determination result of the determination means, even if the image capturing command input unit 44a is operated, the captured image (or a mail notifying that the image has been captured) from the camera device 2 is operated. If not transmitted to the terminal 4, for example, an abnormality is displayed on the image display unit 43a (abnormality notification means). Note that such a situation may be a case where the optical sensor 14 is blocked by food in the refrigerator, a failure of the optical sensor 14 or the interior illumination lamps 30 and 32, or the like. The abnormality notification may be a buzzer, a voice, or the like.

In the indoor imaging system 100 according to the above-described embodiment, as described above, the camera device 2 employs the battery 16 that does not require a power supply line so that the installation location can be freely selected. Under these circumstances, the camera device 2 performs sleep control that suspends functions other than the function of waiting for an imaging command from the user and the function of determining the set imaging timing. This reduces the consumption of the battery 16.

However, in this indoor imaging system 100, as described above, the captured image is also acquired at the imaging timing desired by the user. For that purpose, the imaging timing according to the user's request is set in the camera device 2 ( It is necessary to remember. However, if an attempt is made to perform an image pickup timing setting operation (display operation or input operation) on the camera device 2, various setting switches (input section), a display device, and a setting operation program are required, and a storage means having a larger capacity is also required. Will be required. That is, MMI (Man Machine Interface) is required. Moreover, the setting operation performed by the user is often unfamiliar to the user, and the setting may take a considerable amount of time. Then, the battery consumption of the battery 16 is increased at the time of setting, and although the sleep control is performed, the use time (operating time) of the camera device 2 is shortened.

In this respect, according to the present embodiment, the imaging timing input unit 44g and the imaging timing input unit 44g are operated on the operation terminal 4 having the display unit 43 and the input unit 44 for various displays and setting inputs. The terminal-side control unit 42 that sets the imaging timing based on this and transmits the setting information of the imaging timing to the camera device 2 is provided. In addition, the camera device 2 that performs sleep control for reducing the consumption of the battery 16 that is a power source, the nonvolatile memory 18e as an information storage unit that stores the setting information of the imaging timing set by the operation terminal 4, The camera-side control unit 18 that functions as a storage control unit that stores the imaging timing in the nonvolatile memory 18e based on the reception of the imaging timing setting information from the operation terminal 4 is provided.

According to this embodiment, in the operation terminal 4 in which it is easy for the user to arbitrarily connect the power source and charge, the display unit 43, the input unit 44 (imaging timing input unit 44g), and the terminal-side control unit 42 necessary for setting the imaging timing. Is provided, and the user can set the imaging timing on the operation terminal 4 side. Then, by transmitting the setting information to the camera device 2, the camera device 2 only needs to store the setting information in the non-volatile memory 18e. As a result, the imaging timing can be set in the camera device 2 while suppressing the power consumption of the camera device 2. Therefore, it is very effective for the indoor imaging system 100 in which the user arbitrarily acquires the image of the imaging target and acquires the image of the imaging target at the set imaging timing while installing the camera device 2 at a predetermined installation location for a long time. Become.

Further, according to the present embodiment, the camera device 2 does not include the display unit and the input unit for inputting and setting the imaging timing. Therefore, the consumption of the battery 16 can be reduced.

According to this embodiment, the imaging timing input to the operation terminal 4 includes time. According to this, if the image capturing timing is the time immediately before the user habitually goes out (the time of going to work or the time of shopping), the latest stock status of food can be known at a remote place (the place of work or the place of shopping). be able to.
In this case, according to this embodiment, a plurality of times can be set as the imaging timing, which is convenient.

Further, according to the present embodiment, since the image capturing timing includes the date, the date desired by the user can be set. In this case, it is convenient because it can be set according to a special sale day or point service day. Moreover, it is more convenient because a plurality of days can be set.

Further, according to the present embodiment, since the image capturing timing includes the day of the week, it is convenient when the day of the week for food shopping is determined by the day of the week or the special sale day is determined.
Further, according to the present embodiment, since the image capturing timing includes only weekdays, it is convenient when it is desired to know the food stock situation in the refrigerator only on weekdays.
Further, according to the present embodiment, since a plurality of camera devices 2 are provided, it is convenient that captured images of different installation locations can be acquired.

In the present embodiment, since the camera device 2 is installed in the refrigerator 1, the internal information of the refrigerator can be acquired as image information. However, if the camera device 2 is installed in the room of the building, the indoor image information of that room can be obtained. You can get it.

Further, in the present embodiment, an image pickup command given from the operation terminal 4 to the camera device 2 is given to the refrigerator 1 which is a home electric appliance on the way, and the indoor illumination lamp 30 which is a signal output means included in the refrigerator 1, The configuration is given from 32 to the camera device 2. Further, the image capturing command input section 44a in the operation terminal 4 is displayed on the display section 43 and is formed by the touch panel input section 44A. Further, the operation terminal 4 includes a determination unit that determines whether or not the camera device 2 can receive the imaging command from the indoor illumination lamps 30 and 32, and the terminal-side control unit 42 of the operation terminal 4 includes the determination unit. When the camera device 2 determines that the camera device 2 can receive the imaging command from the indoor illumination lamps 30 and 32, the imaging command input unit 44a is displayed.

According to this embodiment, when the camera device 2 cannot receive the image pickup command from the indoor illumination lamps 30 and 32, the user is informed that the image pickup command input unit 44a does not display a message that the user cannot take an arbitrary image. It is possible to notify the user, and it is possible to make the imaging command input unit 44a inoperable.

In this case, in the present embodiment, the operation terminal 4 includes the installation location name setting input unit 44i that sets the name of the installation location where the camera device 2 is installed, and the determination unit uses the set installation location name. Based on this, it is determined whether or not the camera device 2 can receive the imaging command from the indoor illumination lamps 30 and 32 of the refrigerator 1. According to this, it is possible to determine whether or not the room in which the camera device 2 is installed is provided with the interior illumination lamps 30 and 32 which are the signal output means of the imaging command for the camera device, based on the name of the installation location. If the room in which the camera device 2 is installed is the installation location name corresponding to the room provided with the indoor illumination lamps 30 and 32, which are the signal output means of the image pickup command for the camera device, the image pickup command is not received. It can be determined that it is possible.

The above-mentioned determination means of the operation terminal 4 is provided when the camera device 2 itself has a detection means that detects that the camera device 2 has received an imaging command from the indoor illumination lamps 30 and 32 and notifies the operation terminal 4 of the detection result. Alternatively, it may be determined whether or not the camera device 2 can receive an imaging command from the indoor illumination lamps 30 and 32 based on the detection result of the detection means.

Further, in the present embodiment, when the operation terminal 4 does not transmit the captured image from the camera device 2 to the operation terminal 4 even if the image capturing command input unit 44a is operated when the determination result of the determination unit is communicable. First, the image display unit 43a serving as the abnormality notification unit is notified of the abnormality. According to this, it is possible to report an abnormality such as a case where the optical sensor 14 is blocked by the food in the refrigerator or a failure of the optical sensor 14 or the indoor illumination lamps 30 and 32.

Although the refrigerator 1 is illustrated as an electric home appliance in one embodiment, other electric home appliances may be used. For example, if a sound sensor is used as the receiving means, the sound of an air conditioner or a television can be used as an imaging command for the camera device, and the camera device 2 can be used not only in the room of the refrigerator 1 but also in the room of the house 7 by the same method. It can be imaged. It is also possible to add a setting function in the operating terminal to the access point 3.

The following inventions are described in the embodiments.
An indoor imaging system in which the camera device does not include a display unit and does not include an input unit for inputting and setting imaging timing.
The indoor imaging system including the time at the imaging timing input to the operation terminal.
The indoor imaging system including a plurality of times at the imaging timing input to the operation terminal.
The indoor imaging system including the day at the imaging timing input to the operation terminal.

The indoor imaging system including a plurality of days at the imaging timing input to the operation terminal.
The indoor imaging system including the day of the week as the imaging timing input to the operation terminal.
An indoor imaging system in which the imaging timing input to the operation terminal includes only weekdays.
An indoor imaging system having a plurality of camera devices.

The image pickup command given to the camera device from the operation terminal is given to a home electric appliance on the way, and is given to the camera device from a signal output means of the home electric appliance, and the image pickup instruction input unit is the Displayed on a display unit, the operation terminal includes a determination unit that determines whether or not the camera device can receive an imaging command from the signal output unit, and the control unit of the operation terminal is configured to operate by the determination unit. An indoor imaging system that displays the imaging command input unit when it is determined that the camera device can receive the imaging command from the signal output unit.

The camera device includes detection means for detecting that the camera device has received an imaging command from the signal output means and for notifying the operation terminal, and the determination means is based on the detection result of the detection means. The indoor imaging system for determining whether or not the camera device can receive the imaging command from the signal output means.

The operation terminal includes installation site name setting means for setting a name of an installation site where the camera device is installed, and the determination means includes the signal output means for the camera device based on the set installation site name. An indoor imaging system that determines whether or not it is possible to receive an imaging command from the.

When the operation terminal receives the determination result of the determination means and the captured image is not transmitted from the camera device to the operation terminal even when the imaging command input means is operated, the operation terminal issues an abnormality notification. An indoor imaging system including means.
According to this specification, the following problems can be extracted.

It is known that a refrigerator can be provided with a camera or the like to obtain information such as foodstuffs in the refrigerator from a remote place. However, since it is not possible to know when a user at a remote place gives an instruction to acquire information about the room, it is necessary to always operate in a state where the instruction can be received, which increases power consumption. There was a problem. In particular, a camera installed in a refrigerator or the like uses a battery as a power source, and it is highly necessary to reduce power consumption. From this point of view, it is preferable that the camera has few power-consuming components and controls. On the other hand, the image captured by the camera may be desired immediately by the user or may be automatically and periodically desired. In the latter case, it is necessary to set the time (imaging timing) desired by the user. Therefore, there is provided an indoor imaging system capable of setting an imaging timing in the camera device while suppressing power consumption of the camera device.

While some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and the gist of the invention, and are also included in the invention described in the claims and the scope equivalent thereto.

In the drawings, 1 is a refrigerator (home electric appliances), 2 is a camera device, 4 is an operation terminal, 6 is a server, 11 is an imaging unit (imaging means), 14 is an optical sensor, 18 is a camera side control unit (sleep control means, Storage control means, imaging control means), 30 and 32 are room lighting (signal output means), 34 is a communication adapter (communication means), 42 is a terminal side control unit (control means, determination means, installation place name setting means, abnormality) (Notification means), 42e is a non-volatile memory (information storage means), 43 is a display section, 44 is an input section, 44A is a touch panel input section, 44g is an imaging timing input section, and 100 is an indoor imaging system.

Claims (2)

An operation terminal capable of independently communicating with a camera device including a communication unit, and a home electric appliance including a signal output unit that outputs an imaging command to the camera device and a communication unit,
A communication means capable of communicating with the camera device and the home electric appliance;
Input part,
Determination means for determining whether or not the camera device can receive an imaging command,
And a control unit,
The control unit validates the input unit when it is determined by the determination unit that the camera device can receive an image capturing command, and based on the validated input unit being operated, An operation terminal for transmitting an imaging command to the camera device via the home electric appliance. A camera device including a communication unit, and a control unit of an operation terminal that can independently communicate with a home appliance including a signal output unit that outputs an image capturing command to the camera device and a communication unit,
A process of determining whether or not the camera device can receive an imaging command output from the home electric appliance;
A process of activating the input unit when it is determined that the camera device can receive an imaging command;
A process of transmitting an imaging command to the camera device based on the operation of the validated input unit;
A program of the operating terminal that executes the.

Images