JP2013149272A - Electronic apparatus and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus that allows information associated with power consumption of apparatuses to be intuitively and intelligibly checked.SOLUTION: An electronic apparatus capable of controlling a plurality of types of apparatuses provided in a domestic system comprises: imaging means; displaying means; detecting means; identifying means; and display controlling means. The imaging means captures an image. The displaying means displays information. The detecting means detects an apparatus that is included in the plurality of types of apparatuses and consumes power from the image captured by the imaging means. The identifying means identifies other apparatus that is the same type and has the same controlling method as those of the apparatus detected by the detecting means. The display controlling means causes the displaying means to display first information indicating power consumption of the apparatus and second information in which items are different depending upon the types of the apparatuses for determining whether or not operation affecting the power consumption of the apparatus is necessary for each of the apparatus detected by the detecting means and the apparatus identified by the identifying means.

Description

  Embodiments described herein relate generally to an electronic device and a program.

  2. Description of the Related Art In recent years, attention has been focused on efforts to reduce power consumption of devices that consume power, such as home appliances, due to increasing awareness of environmental issues. Various home appliances are installed in the home, and the materials for determining whether or not power is wasted is different for each home appliance. Therefore, in order to appropriately reduce the power consumption of home appliances, It is necessary to recognize home appliances correctly.

  As a technology for recognizing various household electrical appliances installed in the home, for example, each household electrical appliance sends out a control command by wire or wireless, so that the household electrical appliance reacts to the control command. Techniques for determining the type are known. For example, the determination may be made using “Echonet” or “DLNA”, which are home network standards standardized by IEC and the like.

JP 2009-288859 A

  In order to prompt the user to take an action to reduce the power consumption of the home appliance, it is effective to make the user confirm information related to the power consumption of the home appliance and raise the user's awareness of power saving. At this time, if a complicated operation is required to confirm information related to the power consumption of the home appliance, or if it is difficult to confirm the information, the user will be shy away from it. It is required that the user can check information related to power. However, in the prior art, the user cannot confirm information related to the power consumption of home appliances in an intuitive and easy-to-understand manner.

  Therefore, an embodiment of the present invention has, as an example, an object of obtaining an electronic device that can intuitively and easily check information related to power consumption of the device.

  The electronic device of the embodiment is an electronic device that can control a plurality of types of devices provided in a home system, and includes an imaging unit, a display unit, a detection unit, a specifying unit, and a display control unit. Prepare. The imaging means captures an image. The display means displays information. The detection unit detects a device that consumes power, which is included in the plurality of types of devices, from images captured by the imaging unit. The specifying unit specifies another device of the same type having the same control method as the device detected by the detecting unit. For each of the device detected by the detecting unit and the device specified by the specifying unit, the display control unit determines first information indicating the power consumption of the device and whether an operation that affects the power consumption of the device is necessary. The display means displays second information whose items differ depending on the type of the device.

FIG. 1 is a schematic diagram illustrating an overview of a home system according to the first embodiment. FIG. 2 is a diagram illustrating an example of an appearance of the electronic apparatus according to the first embodiment. FIG. 3 is a block diagram illustrating an example of a hardware configuration of the electronic device according to the first embodiment. FIG. 4 is a block diagram illustrating a functional configuration of the electronic device according to the first embodiment. FIG. 5 is a diagram illustrating a screen transition example of the display unit of the electronic device according to the first embodiment. FIG. 6 is a diagram illustrating a screen transition example of the display unit of the electronic device according to the first embodiment. FIG. 7 is a flowchart illustrating a specific example of the operation of the electronic apparatus according to the first embodiment. FIG. 8 is a schematic diagram illustrating an overview of a home system according to the second embodiment. FIG. 9 is a block diagram illustrating a functional configuration of the electronic device according to the second embodiment. FIG. 10 is a diagram illustrating a screen transition example of the display unit of the electronic device according to the second embodiment. FIG. 11 is a diagram illustrating a screen transition example of the display unit of the electronic device according to the second embodiment. FIG. 12 is a block diagram illustrating a functional configuration of an electronic device according to the third embodiment.

  Hereinafter, an electronic device and a program according to embodiments will be described with reference to the drawings. In the embodiment shown below, information related to the power consumption of various home appliances installed in the home is displayed on an electronic device such as a tablet terminal that can be easily carried by the user (operator), thereby saving the user's power. This is an example of application to a home system that raises awareness and arouses user actions for power saving. This in-home system makes it possible for a user to check information related to power consumption of home appliances in an intuitive and easy-to-understand manner by taking advantage of good operability that is a characteristic of electronic devices such as tablet terminals.

<First Embodiment>
FIG. 1 is a schematic diagram illustrating an overview of a home system according to the first embodiment. In the home, an air conditioner 1, a television 2, a lighting device 3, a refrigerator 4, and a washing and drying machine 5 are installed as examples of home appliances. The home system of the present embodiment displays information related to the power consumption of each home appliance using, for example, the electronic device 10 configured as a tablet terminal. The electronic device 10 according to the present embodiment has a function of capturing (inputting) an image, and uses the captured (input) image in order to identify a home appliance that is a target for displaying information.

  In addition, the electronic device 10 according to the present embodiment has a function of acquiring information by wireless communication from the home appliances such as the air conditioner 1, the television 2, the lighting device 3, the refrigerator 4, and the washing / drying machine 5. For example, an adapter (not shown) for performing wireless communication with the electronic device 10 is connected to each home appliance. The electronic device 10 performs wireless communication with each home appliance via this adapter, and acquires information from each home appliance. Note that various known standards such as Bluetooth (registered trademark) and ZigBee (registered trademark) can be used as wireless communication standards.

  The electronic device 10 according to the present embodiment is connected to a network 6 such as the Internet using mobile communication technology such as 3G (third generation) communication or a router via WiFi, and information on the network 6 is used. It has a function of acquiring various types of information from the providing server 7. The electronic device 10 acquires information from each household electrical appliance described above and the information providing server 7 on the network 6 by using a wireless communication module (described later) built in the device.

  FIG. 2 is a diagram illustrating an example of an appearance of the electronic device 10 according to the present embodiment. The electronic device 10 includes a thin box-shaped housing 11 that is held by a user. A display unit 12 for displaying information is provided on the front surface (one main surface) side of the housing 11. The display unit 12 includes a touch panel that detects a position on the display screen touched by the user. In addition, an operation switch 13 is provided on the front side of the housing 11 and is located below the display unit 12 so that the user can perform various operations. In addition, a speaker 14 is provided on the front side of the housing 11 and is located above the display unit 12 for outputting sound. Furthermore, a camera module 15 for taking an image is provided on the top of the housing 11. The camera module 15 includes a front camera that captures an image on the front side of the housing 11 and a rear camera that captures an image on the back surface (the other main surface) of the housing 11.

  FIG. 3 is a block diagram illustrating an example of a hardware configuration of the electronic device 10 according to the present embodiment. As shown in FIG. 3, the electronic device 10 includes a CPU 16, a system controller 17, a graphics controller 18, a touch panel controller 19, a nonvolatile memory 20, a RAM 21, an audio processing unit 22, and a wireless communication module 23 in addition to the above-described configuration. Is provided.

  The display unit 12 is configured as a so-called touch screen in which the display 12a and the touch panel 12b are combined. The display 12a is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display. The touch panel 12b detects a position (touch position) on the display screen of the display 12a touched by a user's finger or a stylus pen.

  The CPU 16 is a processor that comprehensively controls the operation of the electronic device 10. The CPU 16 controls each part of the electronic device 10 via the system controller 17. The CPU 16 realizes a function for controlling each unit of the electronic device 10 by executing, for example, an operation system or various application programs loaded from the nonvolatile memory 20 to the RAM 21. In the present embodiment, the CPU 16 executes an application program for power saving (hereinafter referred to as “power saving application”) for displaying information related to the power consumption of home appliances and increasing the user's power saving awareness. Each function part (refer FIG. 4) mentioned later is implement | achieved.

  The nonvolatile memory 20 stores an operation system, various application programs, various data necessary for executing the programs, and the like. The RAM 21 serves as a main memory of the electronic device 10 and provides a work area when the CPU 16 executes a program.

  The system controller 17 includes a memory controller that controls access to the nonvolatile memory 20 and the RAM 21. In addition, the system controller 17 has a function of executing communication with the graphics controller 18, the touch panel controller 19, and the sound processing unit 22. Further, the system controller 17 has a function of inputting user operation information received by the operation switch 13 and image information from the camera module 15. Further, the system controller 17 has a function of acquiring various information from outside the electronic device 10 using the wireless communication module 23.

  The graphics controller 18 is a display controller that controls the display 12 a of the display unit 12. The touch panel controller 19 controls the touch panel 12b, and acquires coordinate data indicating a touch position by the user from the touch panel 12b.

  The voice processing unit 22 performs processing of outputting voice guidance generated by performing voice processing such as voice synthesis from the speaker 14 under the control of the CPU 16.

  The wireless communication module 23 is connected to the network 6 and wireless communication with each home appliance such as the air conditioner 1, the television 2, the lighting device 3, the refrigerator 4, and the washing / drying machine 5 under the control of the CPU 16. Wireless communication is performed.

  FIG. 4 is a block diagram illustrating a functional configuration of the electronic device 10 realized by the CPU 16 executing the above-described power saving application. As shown in FIG. 4, the functional configuration of the detection unit 31, the display control unit 32, and the notification unit 33 is realized in the electronic device 10 by executing the power saving application. The power saving application is activated, for example, when the user touches an icon representing the power saving application displayed on the display unit 12.

  The detection unit 31 detects the above-described various home appliances (devices that consume power) from the image captured by the camera module 15. Specifically, for example, when the user wants to confirm information related to the power consumption of the air conditioner 1, the user holds the electronic device 10 over the air conditioner 1 with the power saving application activated, and the rear camera ( The air conditioner 1 is photographed by a front camera). The term “photographing” as used herein does not mean only the operation of recording the subject image as a still image, but also includes the operation of inputting the subject image by the camera module 15 and displaying it on the display unit 12. When an image including a subject is captured (input) by the camera module 15 in response to a user operation, the detection unit 31 performs image processing on the captured (input) image, and from this image, a user operation is performed. The home appliance (the air conditioner 1 in the above example) that is the subject photographed in this way is detected.

  As image processing performed by the detection unit 31 on an image captured (input) by the camera module 15, various techniques already known as techniques for detecting an object from an image, such as pattern matching, may be used. it can. When a home appliance is detected by pattern matching with an image, the feature amount of each home appliance installed in the home is stored in advance, and the image input by the camera module 15 is compared with the feature amount of each home appliance. Then, when an object that matches the feature amount of any home appliance is extracted from the image, the object may be detected as the home appliance.

  When the detection unit 31 detects a home appliance from the image, the display control unit 32 determines first information indicating the power consumption of the home appliance and the necessity of an operation that affects the power consumption of the home appliance. The second information is displayed on the display unit 12. At this time, the display control unit 32 causes the display unit 12 to display the first information and the second information in a manner of superimposing (overlaying) on the image photographed (input) by the camera module 15 in accordance with a user operation. Is desirable. Since the image captured (input) by the camera module 15 according to the user's operation includes the home appliance detected by the detection unit 31, the display unit overlays the first information and the second information on the image. 12, the user can grasp the home appliance, the first information, and the second information intuitively in association with each other.

  The first information is, for example, current power consumption of home appliances. The current power consumption of a home appliance can be obtained from the home appliance as an example. The display control unit 32 acquires the current power consumption of the home appliance from the home appliance detected by the detection unit 31 using the wireless communication module 23 and causes the display unit 12 to display it. In addition, when a power measurement unit is connected to a distribution board that distributes power to each home appliance in the home, and this power measurement unit measures the power consumption of each home appliance in real time, the display control unit 32 The power measurement unit may be accessed using the wireless communication module 23, and the current power consumption of the home appliance detected by the detection unit 31 may be acquired from the power measurement unit and displayed on the display unit 12. When a home server is provided for controlling the home appliances in an integrated manner while monitoring the operation of the home appliances in the home, the display control unit 32 uses the wireless communication module 23 to The current power consumption of the home appliance detected by the detection unit 31 may be acquired from the home server and displayed on the display unit 12.

  In addition, when the home appliance or the power measurement unit or the home server has a function of storing the past (for example, the previous day) power consumption of the home appliance, the display control unit 32 may be the home appliance or the power measurement unit or The power consumption of the previous day of the home appliance may be acquired from the home server, and the power consumption of the previous day of the home appliance may be displayed on the display unit 12 as the first information together with the current power consumption. In addition, when the home appliance or the power measurement unit or the home server has a function of calculating the daily estimated power consumption from the current power consumption of the home appliance, the display control unit 32 may select the home appliance or the power measurement. The estimated daily power consumption of the home appliance is acquired from the unit or the home server, and the estimated daily power consumption of the home appliance is displayed on the display unit 12 as the first information together with the current power consumption, the previous day power consumption, and the like. You may make it display. The display form of the first information can be arbitrarily determined, for example, a numerical display or a graph display. Moreover, you may enable it to change the display form of 1st information according to a user's setting.

  As described above, the second information is information for determining whether or not an operation that affects the power consumption of the home appliance detected by the detection unit 31 from the image is necessary. There are various operations that affect the power consumption of home appliances for each type of home appliance. Therefore, 2nd information turns into information about the item which changed according to the kind of household appliances.

  When the home appliance detected by the detection unit 31 from the image is the air conditioner 1, the second information is, for example, room temperature, outside temperature, weather information indicating an overview of current and future weather, and temperature changes. When the detection unit 31 detects the air conditioner 1 from the image, the display control unit 32 uses the wireless communication module 23 to acquire, for example, room temperature information measured by a temperature sensor built in the air conditioner 1 from the air conditioner 1. External temperature information, weather information, and the like are acquired from the information providing server 7 on the network 6. And the display control part 32 displays the item which shows the said information on the display part 12 as 2nd information for every such information acquired from the air conditioner 1 or the information provision server 7. FIG. The second information is useful for the user to determine whether an operation that affects the power consumption of the air conditioner 1, for example, an operation to turn on / off the air conditioner 1 or an operation to change the set temperature should be performed. Information. The display control unit 32 acquires other information related to the air conditioner 1 other than the first information and the second information (for example, the dirt condition of the filter of the air conditioner 1), and obtains the first information and the second information. The information may be displayed on the display unit 12 together with the information.

  When the home appliance detected from the image by the detection unit 31 is the television 2, the second information is, for example, continuous viewing time (continuous power-on time), information on whether the television 2 is in the power saving mode, or the like. The power saving mode is an operation mode in which the power consumption of the television 2 is reduced by lowering the luminance of the display screen. When the detection unit 31 detects the television 2 from the image, the display control unit 32 uses the wireless communication module 23 to acquire the continuous viewing time, information on whether or not in the power saving mode, and the like from the television 2. And the display control part 32 displays the item which shows the said information on the display part 12 as 2nd information for every such information acquired from the television 2. FIG. The second information is used by the user to determine whether an operation that affects the power consumption of the television 2, for example, a power on / off operation of the television 2 or a switching operation between the power saving mode and the normal mode should be performed. Useful information. Note that the display control unit 32 acquires other information related to the television 2 other than the first information and the second information (for example, the program name of the program being viewed), and obtains the first information and the second information. And may be displayed on the display unit 12 together.

  When the home appliance detected by the detection unit 31 from the image is the lighting device 3, the second information is, for example, indoor brightness, weather information indicating current and future weather conditions, and temperature changes. When the detection unit 31 detects the illumination device 3 from the image, the display control unit 32 uses the wireless communication module 23 to display, for example, information on the brightness of the room temperature measured by the illuminance sensor built in the illumination device 3. 3, weather information and the like are acquired from the information providing server 7 on the network 6. And the display control part 32 displays the item which shows the said information on the display part 12 as 2nd information for every information acquired from the illuminating device 3 or the information provision server 7. FIG. The second information is useful for the user to determine whether an operation that affects the power consumption of the lighting device 3, for example, a power on / off operation of the lighting device 3 or an operation for switching the brightness should be performed. Information. The display control unit 32 acquires other information related to the lighting device 3 other than the first information and the second information (for example, the degree of consumption of the light bulb), and the first information and the second information. You may make it display on the display part 12 collectively.

  When the home appliance detected by the detection unit 31 from the image is the refrigerator 4, the second information is, for example, information on the internal temperature and the storage rate in the internal storage. When the detection unit 31 detects the refrigerator 4 from the image, the display control unit 32 uses the wireless communication module 23 to detect, for example, the internal temperature information measured by the temperature sensor built in the refrigerator 4 or other sensors. The storage rate information in the storage is obtained from the refrigerator 4. And the display control part 32 displays the item which shows the said information on the display part 12 as 2nd information for every such information acquired from the refrigerator 4. FIG. The second information is useful information for the user to determine whether or not an operation that affects the power consumption of the refrigerator 4, for example, an operation of changing the set temperature of the refrigerator 4 should be performed. The display control unit 32 acquires other information related to the refrigerator 4 other than the first information and the second information (for example, the amount of ice stock, the remaining amount of water in the ice making machine, etc.) You may make it display on the display part 12 together with 1 information and 2nd information.

  When the home appliance detected from the image by the detection unit 31 is the washing / drying machine 5, the second information is, for example, the remaining operation time until the end of drying, weather information indicating an overview of current and future weather, and temperature changes, and the like. . When the detection unit 31 detects the washing / drying machine 5 from the image, the display control unit 32 uses the wireless communication module 23 to acquire, for example, information on the remaining operation time until the drying is completed from the washing / drying machine 5, Weather information and the like are acquired from the information providing server 7 on the network 6. And the display control part 32 displays the item which shows the said information on the display part 12 as 2nd information for every such information acquired from the washing dryer 5 and the information provision server 7. FIG. The second information is an operation that affects the power consumption of the washing / drying machine 5, for example, the user determines whether to turn off the washing / drying machine 5 to interrupt drying and to hang the laundry outside. It will be useful information to do. The display control unit 32 provides other information related to the washing / drying machine 5 other than the first information and the second information (for example, water consumption) on the washing / drying machine 5 and the network 6. It may be acquired from the server 7 and displayed on the display unit 12 together with the first information and the second information.

  The electronic device 10 according to the present embodiment includes information indicating the content of information to be displayed on the display unit 12 as the second information and the acquisition source of the first information and the second information for each household electrical appliance in the home. Device address information, address information of the information providing server 7, etc.), information necessary for the detection unit 31 to detect the home appliance from the image (for example, information on the feature amount of each home appliance), etc. It is stored in association with the home appliance ID. These pieces of information are stored in, for example, the non-volatile memory 20 and loaded from the non-volatile memory 20 onto the RAM 21 as the power saving application is activated. For example, when the detection unit 31 detects a home appliance from an image captured (input) by the camera module 15, the detected home appliance ID is passed from the detection unit 31 to the display control unit 32. The display control unit 32 specifies the content of information to be displayed as the second information based on the ID of the home appliance, specifies the acquisition source of the first information and the second information, and specifies the first information and the second information. Get information.

  The alerting | reporting part 33 alert | reports to the user the operation method which reduces the power consumption of the household appliances which the detection part 31 detected from the image, for example by audio | voice guidance. At this time, the notification unit 33 determines whether or not an operation for reducing the power consumption of the home appliance detected by the detection unit 31 from the image is recommended based on various information acquired by the display control unit 32, and recommends When it is determined that the operation is to be performed, it is desirable to notify the user of the operation method.

  Specifically, for example, when the home appliance detected from the image by the detection unit 31 is the air conditioner 1, the notification unit 33 is based on the room temperature, outside temperature, weather information, and the like acquired as the second information by the display control unit 32. Then, it is determined whether or not an operation of raising the set temperature of the air conditioner 1 or turning off the power is recommended. If it is determined to be recommended, the notification unit 33 uses the voice processing unit 22, for example, a voice guidance such as “It seems that the temperature setting is too low. How about raising the set temperature?” , “The outside air temperature has fallen. How about turning off the air conditioner and opening the window?” Is output from the speaker 14.

  For example, when the home appliance detected from the image by the detection unit 31 is the television 2, the notification unit 33 is information indicating whether the continuous control time acquired by the display control unit 32 as the second information or the power saving mode is in effect. Based on the above, it is determined whether or not an operation of turning off the power of the television 2 or switching the operation mode from the normal mode to the power saving mode is recommended. If it is determined to be recommended, the notification unit 33 uses the audio processing unit 22 to say, for example, “Continuous viewing time exceeds 3 hours. How about turning off the TV?” The voice guidance or voice guidance such as “the power saving mode is off. When the power saving mode is turned on, power consumption is reduced.” Is output from the speaker 14.

  In addition, in cooperation with the display control unit 32, the notification unit 33 displays a message text similar to the content of the voice guidance instead of the voice guidance as described above or in addition to the voice guidance as described above. 12 may display an operation method for reducing the power consumption of the home appliance. In this case, for example, the message text is overlaid on a display screen that displays the first information and the second information.

  When the notification unit 33 notifies the user of the operation method for reducing the power consumption of the home appliance as described above, the display control unit 32 displays an operation screen for accepting a user operation on the home appliance on the display unit 12. Further display. That is, the display control unit 32 displays the first information and the second information described above on the display unit 12 and then performs notification by the notification unit 33 or after notification by the notification unit 33. According to the operation method notified by the notification unit 33, the display unit 12 further displays an operation screen for the user to operate the home appliance.

  Specifically, for example, when the notification unit 33 notifies the user that the set temperature of the air conditioner 1 is to be increased, the display control unit 32 further displays an operation screen for changing the set temperature of the air conditioner 1 on the display unit 12. Display. For example, when the notification unit 33 notifies the user that the power supply of the air conditioner 1 is turned off, the display control unit 32 further causes the display unit 12 to display an operation screen for switching on / off the power supply of the air conditioner 1. . In addition, for example, when the notification unit 33 notifies the user of power-off of the television 2 or switching to the power saving mode, the display control unit 32 displays an operation screen for switching the power-on / off of the television 2, An operation screen for switching the operation mode to the power saving mode is further displayed on the display unit 12. These operation screens are overlaid on a display screen that displays the first information and the second information, for example. The display control unit 32 displays an operation screen for accepting an operation on the home appliance after displaying the first information and the second information on the display unit 12 regardless of whether the operation unit is notified by the notification unit 33. 12 may be further displayed.

  When the user performs an operation on the home appliance using the operation screen displayed on the display unit 12 by the display control unit 32, an operation command corresponding to the operation is transmitted to the target home appliance via the wireless communication module 23. Is done. And the household appliances which received the operation command are operation-controlled according to the operation command. That is, when the display control unit 32 displays the operation screen on the display unit 12, the electronic device 10 according to the present embodiment can be used as a remote control terminal for remotely operating the home appliance. In addition, since the technique of using the electronic device 10 such as a tablet terminal as a remote control terminal is a known technique, detailed description thereof is omitted here.

  When the home appliance is controlled in response to the operation command transmitted from the electronic device 10 according to the present embodiment, the power consumption of the home appliance is reduced. When the power consumption of the home appliance is reduced, the display control unit 32 uses the wireless communication module 23 to acquire the reduced power consumption from the home appliance and display the first information displayed on the display unit 12. Then, the display mode is changed so that the reduction in power consumption can be recognized. Thereby, the user can intuitively recognize that the power consumption of the home appliance has been reduced by the operation using the operation screen.

  In addition, the notification unit 33 may notify the user of a maintenance method for reducing the power consumption of the home appliance detected by the detection unit 31 from the image, for example, by voice guidance. At this time, the notification unit 33 determines, based on various information acquired by the display control unit 32, whether or not maintenance for reducing the power consumption of the home appliance detected by the detection unit 31 from the image is recommended. When it is determined that the maintenance is to be performed, it is desirable to notify the user of the maintenance method by voice guidance or the like.

  Specifically, for example, when the home appliance detected from the image by the detection unit 31 is the air conditioner 1, the notification unit 33 uses the air conditioner 1 based on the information indicating the contamination status of the filter of the air conditioner 1 acquired by the display control unit 32. It is determined whether or not one filter cleaning is recommended, and when it is determined that the filter cleaning is recommended, voice guidance or the like explaining a filter cleaning method is output from the speaker 14. At this time, it is desirable that the notification unit 33 outputs a voice guidance for explaining a filter cleaning method after issuing a warning for prompting the air conditioner 1 to clean the filter.

  Next, a specific example of a screen displayed on the display unit 12 of the electronic device 10 will be described. FIG. 5 is a diagram illustrating an example of screen transition of the display unit 12 when information related to the power consumption of the air conditioner 1 is displayed.

  When the user holds the electronic device 10 over the air conditioner 1 and the air conditioner 1 enters the shooting range of the camera module 15, an image including the air conditioner 1 input by the camera module 15 is displayed as shown in FIG. It is displayed on the display unit 12. The detection unit 31 detects the air conditioner 1 from the image input by the camera module 15. At this time, in order to make the user recognize that the detection unit 31 has detected the home appliance, it is desirable to display a mark M indicating the range of the detected home appliance on the display screen of the display unit 12.

  When the detection unit 31 detects the air conditioner 1 from the image, the display control unit 32 acquires the first information and the second information related to the air conditioner 1 and causes the display unit 12 to display them. Thereby, the display screen of the display unit 12 is changed from the screen shown in FIG. 5A to the screen shown in FIG. 5B, and first, “living room air conditioner” indicating the air conditioner 1 detected by the detecting unit 31. Is displayed.

  Subsequently, on the display screen shown in FIG. 5B, the current power consumption of the air conditioner 1 is displayed as the first information D1, and further, the second information D2 is an overview of the room temperature, the outside temperature, the current and future weather. And a graph showing the relationship between the temperature change and the temperature change and the current room temperature. The user sees this display screen, recognizes the current power consumption of the air conditioner 1, recognizes whether the room temperature is appropriate for the current and future temperatures, and turns off the power of the air conditioner 1. It is possible to accurately determine whether or not the set temperature should be changed.

  When the detection unit 31 detects the air conditioner 1 from the image, the image including the air conditioner 1 is recorded as a still image, and when displaying various information regarding the air conditioner 1 thereafter, the recorded still image is used as the background. It is desirable to display various information as an overlay. Thereby, even if the user moves the electronic device 10 after the detection unit 31 detects the air conditioner 1 from the image, the user intuitively recognizes that the various information displayed is information related to the air conditioner 1. Can do.

  After the display control unit 32 displays the first information and the second information related to the air conditioner 1 on the display unit 12, for example, when a predetermined time has elapsed, the notification unit 33 provides the user with an operation method for reducing the power consumption of the air conditioner 1. A voice guidance for notification is output from the speaker 14, and a message text indicating an operation method for reducing the power consumption of the air conditioner 1 is displayed on the display unit 12 in cooperation with the display control unit 32. Further, the display control unit 32 further causes the display unit 12 to display an operation screen for accepting a user operation on the air conditioner 1. Thereby, the display screen of the display part 12 changes from the screen shown in FIG.5 (b) to the screen shown in FIG.5 (c).

  In the display screen shown in FIG. 5 (c), on the display screen shown in FIG. 5 (b), a message sentence D3 such as “The temperature setting seems to be too low. How about raising the set temperature?” An operation screen D4 for changing the set temperature of the air conditioner 1 is overlaid. The user can surely recognize that it is desirable to raise the set temperature of the air conditioner 1 by using the message text D3 on this display screen, voice guidance, or the like, and use the operation screen D4 displayed on the display unit 12. And operation which raises preset temperature of air-conditioner 1 can be performed easily. That is, the user can easily perform an operation for reducing the power consumption of the air conditioner 1 while using the electronic device 10 as a remote control terminal according to the voice guidance or the message text D3 notified from the electronic device 10.

  When the user performs an operation of raising the set temperature of the air conditioner 1 using the operation screen D4 displayed on the display unit 12, an operation command corresponding to the operation is transmitted to the air conditioner 1 via the wireless communication module 23, The set temperature of the air conditioner 1 is raised according to the operation command. As a result, the power consumption of the air conditioner 1 is reduced. Further, when the user's operation using the operation screen D4 is performed, the display control unit 32 ends the display of the message text D3 and the operation screen D4 on the display unit 12, and uses the wireless communication module 23, The power consumption of the air conditioner 1 reduced by changing the set temperature according to the operation command is acquired from the air conditioner 1, and the first information D1 displayed on the display unit 12 is changed to a display form that can recognize the reduction in power consumption. . Thereby, the display screen of the display part 12 changes from the screen shown in FIG.5 (c) to the screen shown in FIG.5 (d).

  On the display screen shown in FIG. 5D, the first information D1 is displayed so that the power consumption of the air conditioner 1 is reduced from 850 W to 837 W. The user can intuitively recognize that the power consumption of the air conditioner 1 has been reduced by the operation using the operation screen D4 by looking at the first information D1 on the display screen.

  FIG. 6 is a diagram illustrating an example of screen transition of the display unit 12 when information related to the power consumption of the television 2 is displayed.

  When the user holds the electronic device 10 over the television 2, the detection unit 31 detects the television 2 from the image input by the camera module 15. At this time, in order to make the user recognize that the detection unit 31 has detected the home appliance, a mark M indicating the range of the detected home appliance is displayed on the display screen of the display unit 12 as shown in FIG. indicate.

  When the detection unit 31 detects the television 2 from the image, the display control unit 32 acquires the first information and the second information regarding the television 2 and causes the display unit 12 to display them. Thereby, the display screen of the display unit 12 changes from the screen illustrated in FIG. 6A to the screen illustrated in FIG. 6B, and first, “living room television” indicating the television 2 detected by the detection unit 31. Is displayed. Subsequently, on the display screen shown in FIG. 6B, the current power consumption of the television 2 is displayed as the first information D1, and further, whether or not the second information D2 is in the continuous viewing time and the power saving mode. Information is displayed. The user recognizes the current power consumption of the television 2 by looking at the display screen, recognizes the operation state of the television 2 so far, and whether to turn off the television 2 or switch to the power saving mode. Can be accurately determined.

  When the detection unit 31 detects the television 2 from the image, the image including the television 2 is recorded as a still image, and when displaying various information related to the television 2 thereafter, the recorded still image is used as the background. It is desirable to display various information. Thereby, even if the user moves the electronic device 10 after the detection unit 31 detects the television 2 from the image, the user intuitively recognizes that the displayed various information is information related to the television 2. Can do.

  After the display control unit 32 displays the first information and the second information about the television 2 on the display unit 12, for example, when a predetermined time has elapsed, the notification unit 33 gives the user an operation method for reducing the power consumption of the television 2. Voice guidance for notification is output from the speaker 14, and a message sentence indicating an operation method for reducing the power consumption of the television 2 is displayed on the display unit 12 in cooperation with the display control unit 32. In addition, the display control unit 32 further causes the display unit 12 to display an operation screen that accepts a user operation on the television 2. As a result, the display screen of the display unit 12 changes from the screen shown in FIG. 6B to the screen shown in FIG.

  In the display screen shown in FIG. 6 (c), a message sentence D3 on the display screen shown in FIG. 6 (b) such as “The power saving mode is off. When the power saving mode is turned on, the power consumption is reduced.” And an operation screen D4 for switching the operation mode of the television 2 to the power saving mode are overlaid. The user can surely recognize that it is desirable to switch the operation mode of the television 2 to the power saving mode by using the message text D3 or voice guidance on the display screen, and the operation screen displayed on the display unit 12. The operation of switching the operation mode of the television 2 to the power saving mode can be easily performed using D4. That is, the user can easily perform an operation for reducing the power consumption of the television 2 while using the electronic device 10 as a remote control terminal according to the voice guidance and the message text D3 notified from the electronic device 10.

  When the user performs an operation of switching the operation mode of the television 2 to the power saving mode using the operation screen D4 displayed on the display unit 12, an operation command corresponding to the operation is sent to the television 2 via the wireless communication module 23. The operation mode of the television 2 is switched from the normal mode to the power saving mode in response to the operation command. As a result, the power consumption of the television 2 is reduced. Further, when the user's operation using the operation screen D4 is performed, the display control unit 32 ends the display of the message text D3 and the operation screen D4 on the display unit 12, and uses the wireless communication module 23, The power consumption of the television 2 reduced by switching to the power saving mode according to the operation command is acquired from the television 2, and the first information D1 displayed on the display unit 12 is changed to a display form that can recognize the reduction of the power consumption. Let Thereby, the display screen of the display part 12 changes from the screen shown in FIG.6 (c) to the screen shown in FIG.6 (d).

  On the display screen shown in FIG. 6D, the first information D1 is displayed so that the power consumption of the television 2 is reduced from 150 W to 100 W. The user can intuitively recognize that the power consumption of the television 2 has been reduced by the operation using the operation screen D4 by looking at the first information D1 on the display screen.

  Next, a specific example of the operation of the electronic device 10 will be described with reference to FIG. 7 on the assumption that the user holds the electronic device 10 according to the present embodiment over the air conditioner 1. FIG. 7 is a flowchart illustrating a specific example of the operation of the electronic device 10, which starts when the power saving application is activated in response to a user operation.

  When the power saving application is activated, the camera module 15 starts to capture (input) an image, and the detection unit 31 starts a process of detecting the home appliance from the image input by the camera module 15 (step S101). At this time, in order to prompt the user to hold the electronic device 10 over the desired home appliance, the notification unit 33 outputs, for example, voice guidance such as “Please hold the tablet over the home appliance” from the speaker 14. You may do it. Since the image input by the camera module 15 is displayed on the display unit 12, the user can acquire the image by holding the electronic device 10 over a desired home appliance while checking the image displayed on the display unit 12. it can. In this example, when the user holds the electronic device 10 over the air conditioner 1, an image of the air conditioner 1 as a subject is input by the camera module 15, and the detection unit 31 detects the air conditioner 1 from this image.

  When the air conditioner 1 is detected from the image input by the camera module 15, the display control unit 32 affects the first information indicating the detected power consumption of the air conditioner 1 and the detected power consumption of the air conditioner 1. The second information for determining whether or not the operation is necessary is acquired from the air conditioner 1 or the information processing server 7 on the network 6 (step S102). In this example, room temperature, outside temperature, weather information, and the like are acquired as the second information. Further, the display control unit 32 also acquires information such as a dirt condition of a filter of the air conditioner 1 as information regarding the air conditioner 1.

  Next, the display control unit 32 causes the display unit 12 to display the first information and the second information acquired in step S102 (step S103). Further, the notification unit 33 reduces the power consumption of the air conditioner 1 such as increasing the set temperature of the air conditioner 1 or turning off the power based on the room temperature, the outside air temperature, the weather information, etc. acquired as the second information in step S102. It is determined whether or not the operation to be performed is recommended (step S104). If it is determined that an operation for reducing the power consumption of the air conditioner 1 is recommended (step S104: Yes), the notification unit 33, for example, “The temperature setting seems to be too low. How about raising the set temperature? "Or" The outside air temperature has fallen. How about turning off the air conditioner and opening the window? "By outputting voice guidance from the speaker 14 to reduce the power consumption of the air conditioner 1. The user is notified (step S105). On the other hand, if it is determined that an operation for reducing the power consumption of the air conditioner 1 is not recommended (step S104: No), the process proceeds to step S109.

  When the notification unit 33 notifies the operation method for reducing the power consumption of the air conditioner 1 in step S105, the display control unit 32 displays an operation screen for the user to operate the home appliance, for example, the set temperature of the air conditioner 1 An operation screen for changing the air conditioner, an operation screen for switching the power on / off of the air conditioner 1 and the like are displayed on the display unit 12 (step S106), and a user operation using the operation screen is monitored (step S107). . When the user performs an operation of raising the set temperature of the air conditioner 1 or an operation of turning off the power of the air conditioner 1 using the operation screen displayed on the display unit 12 (step S107: Yes), the display control unit 32 transmits an operation command corresponding to the user operation to the air conditioner 1 using the wireless communication module 23 (step S108). As a result, the set temperature of the air conditioner 1 is changed or the power is turned off according to the user operation, and the power consumption of the air conditioner 1 is reduced. At this time, in order to make the user surely recognize that the power consumption of the air conditioner 1 has actually been reduced according to the user operation, the notification unit 33 provides voice guidance such as “power consumption has been reduced” to the speaker. 14 may be output. If there is no user operation using the operation screen (step S107: No), the process proceeds to step S109 without performing the process of step S108.

  Next, the alerting | reporting part 33 judges whether the filter cleaning of the air conditioner 1 is recommended based on the information which shows the dirt condition of the filter of the air conditioner 1 acquired by the display control part 32 (step S109). If it is determined that the filter cleaning of the air conditioner 1 is recommended (step S109: Yes), the notification unit 33 provides a voice guidance or the like explaining the filter cleaning method together with a warning for prompting the filter cleaning of the air conditioner 1. (Step S110). On the other hand, when it is determined that the filter cleaning of the air conditioner 1 is unnecessary (step S109: No), the process proceeds to step S111 without performing the process of step S110.

  While the above-described series of processing is being performed, for example, the operation system monitors whether there is a user operation for ending the power saving application (step S111). If the operation for ending the power saving application is not performed (step S111: No), the processing of step S101 to step S110 is repeatedly executed, and the operation for ending the power saving application is performed (step S111: Yes). A series of processes shown in the flowchart of FIG.

  As described above in detail with specific examples, the electronic device 10 according to the present embodiment includes a detection unit 31 that detects a home appliance from an image captured (input) by the camera module 15, and a detection unit. A display control unit that causes the display unit 12 to display first information indicating power consumption of the home appliance detected by the image 31 and second information for determining whether or not an operation affecting the power consumption of the home appliance is necessary. 32. The electronic device 10 according to the present embodiment includes the detection unit 31 and the display control unit 32, so that the electronic device 10 is held over a desired home appliance (an image of the home appliance is input by the camera module 15). By the operation, information related to power consumption of a desired home appliance can be intuitively and easily understood by the user.

  In addition, the display control unit 32 of the electronic device 10 according to the present embodiment overlays the first information and the second information on an image photographed (input) by the camera module 15 in accordance with a user operation. To display. Therefore, the user can grasp the first information and the second information displayed on the display unit 12 intuitively in association with the target home appliance.

  The electronic device 10 according to the present embodiment further includes a notification unit 33 that notifies an operation method for reducing the power consumption of the home appliance detected by the detection unit 31 from the image. The electronic device 10 according to the present embodiment includes the notification unit 33, thereby notifying the user of an operation method for reducing the power consumption of the home appliance photographed (input) by the camera module 15 and contributing to power saving. The user can be prompted to perform the operation.

  Moreover, the alerting | reporting part 33 of the electronic device 10 concerning this embodiment alert | reports the maintenance method which reduces the power consumption of the household appliances which the detection part 31 detected from the image. Therefore, it is possible to allow the user to recognize a maintenance method for reducing the power consumption of the home appliance and to encourage the user to maintain the home appliance that contributes to power saving.

  In addition, the display control unit 32 of the electronic device 10 according to the present embodiment displays the first information and the second information on the display unit 12 and then receives an operation for the home appliance detected by the detection unit 31 from the image. The screen is further displayed on the display unit 12. Therefore, the user can easily operate home appliances that contribute to power saving while looking at the display screen of the display unit 12.

  In addition, the display control unit 32 of the electronic device 10 according to the present embodiment can recognize the reduction in power consumption when the power consumption of the home appliance is reduced according to the operation received on the operation screen of the display unit 12. Then, the first information is displayed on the display unit 12. Therefore, the user can intuitively recognize that the power consumption of the home appliance has been reduced by the operation using the operation screen.

<Modification>
Note that in a home, the state changes manually without consuming electric power, but there are also objects whose change affects the power consumption of home appliances. For example, a window that is manually opened and closed does not consume power by itself, but when it is opened, outside air is taken into the room and the room temperature approaches the outside temperature. It is an object that affects In addition, the curtain that is manually opened and closed does not consume power by itself, but when it is opened, external light is taken into the room and the brightness of the room changes. It is an object that affects.

  The electronic device 10 according to the present embodiment enables the detection unit 31 to detect not only home appliances but also objects such as windows and curtains as described above from the image input by the camera module 15. When these objects are detected, the display control unit 32 may cause the display unit 12 to display the third information for determining whether or not the state change of these objects is necessary.

  Specifically, when the detection unit 31 detects a window from the image, the display control unit 32 acquires information such as outside temperature, weather information, and room temperature as the third information about the window, and displays the display unit 12. To display. These pieces of information are useful information for the user to determine the necessity of opening the window to take in outside air or closing the window to block outside air. It is also useful to display the outside temperature, weather information, etc. on the electronic device 10 and notify the user when the electronic device 10 detects the outside of the house by holding the electronic device 10 over a window.

  Further, when the detection unit 31 detects a curtain from the image, the display control unit 32 acquires, for example, indoor brightness, information on a planned planned power outage, and the like as the third information about the curtain, and displays the information on the display unit 12. Display. These pieces of information are useful information for the user to determine the necessity of opening the curtain and taking in external light, or closing the curtain and blocking external light.

<Second Embodiment>
Next, a second embodiment will be described. The second embodiment is an application example when a plurality of home appliances of the same type are installed in the home. The electronic device 10 according to the first embodiment targets only the home appliance detected by the detection unit 31 from the image captured (input) by the camera module 15 and displays information related to the power consumption of the home appliance. It was displayed. On the other hand, the electronic device according to the present embodiment (hereinafter referred to as the electronic device 10A) is consumed not only by the home appliance detected by the detection unit 31, but also by other home appliances of the same type as the home appliance. Information related to power is also displayed on the display unit 12. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 8 is a schematic diagram illustrating an overview of a home system according to the second embodiment. In this embodiment, an air conditioner (hereinafter referred to as a living room air conditioner 1a) and a TV (hereinafter referred to as a living room TV 2a) are installed in a living room, and an air conditioner (hereinafter referred to as a children's room air conditioner 1b). And a television (hereinafter referred to as a children's room television 2b) and an air conditioner (hereinafter referred to as a bedroom air conditioner 1c) and a television (hereinafter referred to as a bedroom television 2c) in the bedroom. Are installed. The living room air conditioner 1a, the child room air conditioner 1b, and the bedroom air conditioner 1c are the same type of home appliances. The living room TV 2a, the children's room TV 2b, and the bedroom TV 2c are the same type of home appliances.

  An electronic device 10A according to the present embodiment has the same hardware configuration (see FIG. 3) as the electronic device 10 according to the first embodiment, and includes a living room air conditioner 1a, a children's room air conditioner 1b, a bedroom air conditioner 1c, and a living room. Various types of information can be acquired from the home appliances of the television 2 a, the children's room television 2 b and the bedroom television 2 c and the information providing server 7 on the network 6.

  FIG. 9 is a block diagram illustrating a functional configuration of the electronic device 10A that is realized when the CPU 16 of the electronic device 10A according to the present embodiment executes the power saving application. In the electronic device 10A according to the present embodiment, as shown in FIG. 9, in addition to the functional configuration of the electronic device 10 according to the first embodiment, a specifying unit 34 is provided, and the display control of the first embodiment is performed. A display control unit 32A is provided instead of the unit 32, and a notification unit 33A is provided instead of the notification unit 33 of the first embodiment.

  The identification unit 34 identifies another household electrical appliance of the same type as the household electrical appliance detected by the detection unit 31 from the image captured (input) by the camera module 15. For example, when the home appliance detected by the detection unit 31 from the image is the living room air conditioner 1a, the specifying unit 34 specifies the child room air conditioner 1b and the bedroom air conditioner 1c as other home appliances of the same type as the living room air conditioner 1a. To do. When the home appliance detected from the image by the detection unit 31 is the living room TV 2a, the specifying unit 34 specifies the child room TV 2b and the bedroom TV 2c as other home appliances of the same type as the living room TV 2a. To do.

  As with the electronic device 10 according to the first embodiment, the electronic device 10A according to the present embodiment includes the contents of information to be displayed on the display unit 12 as the second information for each household electrical appliance in the home, 1 information or information indicating the acquisition destination of the second information (such as address information of the home appliance or the address information of the information providing server 7), information necessary for the detection unit 31 to detect the home appliance from the image (for example, each home appliance) For example, information on the feature amount of the device is stored in association with the ID of each home appliance. In particular, in the present embodiment, the ID of each household electrical appliance is associated with each household electrical appliance of the same type. These pieces of information are stored in, for example, the non-volatile memory 20 and loaded from the non-volatile memory 20 onto the RAM 21 as the power saving application is activated. For example, when the detection unit 31 detects a home appliance from an image captured (input) by the camera module 15, the ID of the detected home appliance is passed from the detection unit 31 to the specifying unit 34. The specifying unit 34 searches for the ID of another household electrical appliance associated with the ID of the household electrical appliance received from the detecting unit 31, and the ID of the household electrical appliance acquired from the detecting unit 31 and the ID of the household electrical appliance obtained by the search. To the display control unit 32A.

  When the detection unit 31 detects the home appliance from the image and the specifying unit 34 specifies another home appliance of the same type as the home appliance detected by the detection unit 31, the display control unit 32 </ b> A detects the home appliance. The display unit 12 displays not only the first information and the second information about the home appliances detected from the information but also the first information and the second information about the home appliances specified by the specifying unit 34. For example, the display control unit 32 </ b> A is based on the home appliance ID received from the specifying unit 34, that is, the home appliance ID detected by the detection unit 31 from the image and the home appliance ID specified by the specifying unit 34. In addition, the content of the information to be displayed as the second information is specified, the acquisition source of the first information and the second information for each home appliance is specified, and the first information and the second information are acquired. Then, the display control unit 32A causes the display unit 12 to display the first information and the second information about each acquired home appliance.

  The notification unit 33A uses, for example, voice guidance as an operation method for reducing the power consumption of the home appliance specified by the user's touch operation among the home appliances on which the first information and the second information are displayed on the display unit 12. For example, the user is notified. At this time, in the same way as the notification unit 33 of the first embodiment, the notification unit 33A is recommended to reduce the power consumption of the designated home appliance based on various information acquired by the display control unit 32A. It is desirable to notify the user of the operation method when it is determined whether or not it is recommended.

  In addition, the notification unit 33A is similar to the content of the voice guidance in place of or in addition to the voice guidance in cooperation with the display control unit 32A, similarly to the notification unit 33 of the first embodiment. You may make it alert | report the operation method which reduces the power consumption of the designated household appliances by displaying a message sentence on the display part 12. FIG. In this case, for example, the message text is overlaid on a display screen that displays the first information and the second information.

  As described above, when the notification unit 33A notifies the user of the operation method for reducing the power consumption of the designated home appliance, the display control unit 32A is the same as the display control unit 32 of the first embodiment. In addition, an operation screen for accepting a user operation on the home appliance is further displayed on the display unit 12. When the user performs an operation on the home appliance using this operation screen, an operation command corresponding to the operation is transmitted to the target home appliance via the wireless communication module 23. And the household appliance which received the operation command is operation-controlled according to the operation command, and the power consumption of the household appliance reduces. When the power consumption of the home appliance is reduced, the display control unit 32A uses the wireless communication module 23 to acquire the reduced power consumption from the home appliance, and the home appliance to be displayed on the display unit 12 The first information of the device is changed to a display form that can recognize the reduction in power consumption. Thereby, the user can intuitively recognize that the power consumption of the home appliance has been reduced by the operation using the operation screen.

  In addition, the notification unit 33A provides, for example, a maintenance method for reducing power consumption of a home appliance specified by a user's touch operation to the user by voice guidance or the like, similar to the notification unit 33 of the first embodiment. You may make it alert | report. At this time, similarly to the notification unit 33 of the first embodiment, the notification unit 33A is recommended to perform maintenance for reducing the power consumption of the designated home appliance based on various information acquired by the display control unit 32A. When it is determined whether or not it is recommended, it is desirable to notify the user of the maintenance method by voice guidance or the like.

  Next, a specific example of a screen displayed on the display unit 12 of the electronic apparatus 10A according to the present embodiment will be described. FIG. 10 is a diagram illustrating an example of screen transition of the display unit 12 when the user holds the electronic device 10A over the living room air conditioner 1a.

  When the user holds the electronic device 10A over the living room air conditioner 1a and the living room air conditioner 1a enters the shooting range of the camera module 15, the living room input by the camera module 15 as shown in FIG. An image including the air conditioner 1a is displayed on the display unit 12. And the detection part 31 detects the living room air conditioner 1a from the image input by this camera module 15. FIG.

  When the detection unit 31 detects the living room air conditioner 1a from the image, the specifying unit 34 specifies the child room air conditioner 1b and the bedroom air conditioner 1c, which are other home appliances of the same type as the living room air conditioner 1a. Then, the display control unit 32A acquires the first information and the second information related to the living room air conditioner 1a, the child room air conditioner 1b, and the bedroom air conditioner 1c, and displays the first information and the second information on the display unit 12. Thereby, the display screen of the display part 12 changes from the screen shown to Fig.10 (a) to the screen shown to FIG.10 (b).

  In the display screen shown in FIG. 10B, the current power consumption of the living room air conditioner 1a is displayed in the display area R1 as the first information D1 related to the living room air conditioner 1a, and as the second information D2 related to the living room air conditioner 1a, The room temperature and the outside temperature of the living room are displayed. In the display area R2, the current power consumption of the child room air conditioner 1b is displayed as the first information D1 related to the child room air conditioner 1b, and the room temperature and the outside temperature of the child room are displayed as the second information D2 related to the child room air conditioner 1b. Has been. In the display area R3, the current power consumption of the bedroom air conditioner 1c is displayed as the first information D1 related to the bedroom air conditioner 1c, and the room temperature and the outside temperature of the bedroom are displayed as the second information D2 related to the bedroom air conditioner 1c. In addition, the second information D2 common to the living room air conditioner 1a, the child room air conditioner 1b, and the bedroom air conditioner 1c is displayed in a region that does not overlap with the display regions R1, R2, and R3. Information is displayed. The user recognizes the current power consumption of each of the living room air conditioner 1a, the child room air conditioner 1b, and the bedroom air conditioner 1c by looking at the display screen, and the room temperature of each room is appropriate for the current and future temperatures. It is possible to accurately determine whether to turn off the power or change the set temperature for each of the living room air conditioner 1a, the child room air conditioner 1b, and the bedroom air conditioner 1c.

  After the display control unit 32A displays the first information and the second information related to the living room air conditioner 1a, the child room air conditioner 1b, and the bedroom air conditioner 1c on the display unit 12, for example, the user touches the display region R2 to operate the child. When the room air conditioner 1b is designated, the notification unit 33A outputs voice guidance for notifying the user of an operation method for reducing the power consumption of the child room air conditioner 1b from the speaker 14, and in cooperation with the display control unit 32A. Then, a message sentence indicating an operation method for reducing the power consumption of the child room air conditioner 1b is displayed on the display unit 12. In addition, the display control unit 32A further causes the display unit 12 to display an operation screen for accepting a user operation on the child room air conditioner 1b. As a result, the display screen of the display unit 12 changes from the screen shown in FIG. 10B to the screen shown in FIG.

  In the display screen shown in FIG. 10 (c), on the display screen shown in FIG. 10 (b), a message sentence D3 such as “It seems that the temperature setting is too low. An operation screen D4 for changing the set temperature of the child room air conditioner 1b is overlaid. The user can surely recognize that it is desirable to raise the set temperature of the child room air conditioner 1b by the message text D3 on the display screen, voice guidance, or the like, and the operation screen D4 displayed on the display unit 12. Can be used to easily raise the set temperature of the children's room air conditioner 1b. That is, the user uses the electronic device 10A as a remote control terminal in accordance with voice guidance and message text D3 notified from the electronic device 10A, and performs an operation for reducing the power consumption of the child room air conditioner 1b while in the living room. It can be done easily.

  When the message text D3 and the operation screen D4 are displayed on the display unit 12 in accordance with the designation of the child room air conditioner 1b, information on the living room air conditioner 1a in the display area R1 and information on the bedroom air conditioner 1c in the display area R3 are as follows. It is desirable to end the display or make the display inconspicuous as shown in FIG. Thus, the user can intuitively recognize that the message text D3 and the operation screen D4 displayed on the display unit 12 relate to the child room air conditioner 1b.

  When the user performs an operation of raising the set temperature of the child room air conditioner 1b using the operation screen D4 displayed on the display unit 12, an operation command corresponding to the operation is sent via the wireless communication module 23 to the child room air conditioner 1b. And the set temperature of the child room air conditioner 1b is raised according to the operation command. As a result, the power consumption of the child room air conditioner 1b is reduced. Further, when the user's operation using the operation screen D4 is performed, the display control unit 32A ends the display of the message text D3 and the operation screen D4 on the display unit 12, and uses the wireless communication module 23, Display of power consumption of the child room air conditioner 1b reduced by changing the set temperature in accordance with the operation command is obtained from the child room air conditioner 1b, and the first information D1 displayed on the display unit 12 can recognize the reduction in power consumption. Change to form. As a result, the display screen of the display unit 12 changes from the screen shown in FIG. 10C to the screen shown in FIG.

  In the display screen shown in FIG. 10D, the first information D1 is displayed so that the power consumption of the child room air conditioner 1b is reduced from 900 W to 820 W. The user can intuitively recognize that the power consumption of the child room air conditioner 1b is reduced by the operation using the operation screen D4 by looking at the first information D1 on the display screen.

  FIG. 11 is a diagram illustrating an example of screen transition of the display unit 12 when the user holds the electronic device 10A over the living room television 2a.

  When the user holds the electronic device 10A over the living room TV 2a and the living room TV 2a enters the shooting range of the camera module 15, the living room input by the camera module 15 as shown in FIG. An image including the television 2a is displayed on the display unit 12. And the detection part 31 detects the living room television 2a from the image input by this camera module 15. FIG.

  When the detection unit 31 detects the living room TV 2a from the image, the specifying unit 34 specifies the child room TV 2b and the bedroom TV 2c, which are other home appliances of the same type as the living room TV 2a. Then, the display control unit 32A acquires the first information and the second information related to the living room television 2a, the child room television 2b, and the bedroom television 2c, and displays them on the display unit 12. As a result, the display screen of the display unit 12 changes from the screen shown in FIG. 11A to the screen shown in FIG.

  In the display screen shown in FIG. 11B, the current power consumption of the living room TV 2a is displayed as the first information D1 related to the living room TV 2a in the display area R11, and the second information D2 related to the living room TV 2a is displayed as Information on whether or not the continuous viewing time of the living room TV 2a is in the power saving mode is displayed. In the display area R12, the current power consumption of the child room TV 2b is displayed as the first information D1 regarding the child room TV 2b, and the continuous viewing time of the child room TV 2b and the second information D2 regarding the child room TV 2b are displayed. Information indicating whether or not the power saving mode is in effect is displayed. In the display area R13, the current power consumption of the bedroom television 2c is displayed as the first information D1 related to the bedroom television 2c. The second information D2 related to the bedroom television 2c is displayed during the continuous viewing time and power saving mode of the bedroom television 2c. Information on whether or not there is displayed. The user sees this display screen and recognizes the current power consumption of the living room TV 2a, the child room TV 2b, and the bedroom TV 2c, and the living room TV 2a, the child room TV 2b, and the bedroom TV 2c. It is possible to recognize whether or not to switch to power-off or power-saving mode.

  After the display control unit 32A displays the first information and the second information related to the living room TV 2a, the child room TV 2b, and the bedroom TV 2c on the display unit 12, for example, the user touches the display region R12 to operate the child. When the room television 2b is designated, the notification unit 33A outputs voice guidance for notifying the user of an operation method for reducing the power consumption of the child room television 2b from the speaker 14, and in cooperation with the display control unit 32A. Then, a message sentence indicating an operation method for reducing the power consumption of the child room television 2b is displayed on the display unit 12. In addition, the display control unit 32A further causes the display unit 12 to display an operation screen for accepting a user operation on the child room television 2b. As a result, the display screen of the display unit 12 transitions from the screen shown in FIG. 11B to the screen shown in FIG.

  In the display screen shown in FIG. 11 (c), on the display screen shown in FIG. 11 (b), “Continuous viewing time exceeds 4 hours. How about turning off the power to the children's room TV?” The message text D3 and the operation screen D4 for switching the power on / off of the child room television 2b are overlaid. The user can surely recognize that it is desirable to turn off the power of the child room TV 2b by the message text D3 on the display screen, voice guidance, or the like, and the operation screen D4 displayed on the display unit 12. Can be used to easily turn off the power of the children's room TV 2b. That is, the user uses the electronic device 10A as a remote control terminal in accordance with voice guidance and message text D3 notified from the electronic device 10A, and performs an operation for reducing the power consumption of the child room TV 2b while in the living room. It can be done easily.

  When the message text D3 and the operation screen D4 are displayed on the display unit 12 according to the designation of the child room television 2b, information on the living room television 2a in the display region R11 and information on the bedroom television 2c in the display region R13 are as follows. It is desirable to end the display or make the display inconspicuous as shown in FIG. Thus, the user can intuitively recognize that the message text D3 and the operation screen D4 displayed on the display unit 12 relate to the child room television 2b.

  When the user performs an operation of turning off the power of the child room TV 2b using the operation screen D4 displayed on the display unit 12, an operation command corresponding to the operation is transmitted via the wireless communication module 23 to the child room TV 2b. The child room television 2b is turned off in response to the operation command. As a result, the power consumption of the child room television 2b is reduced. Further, when the user's operation using the operation screen D4 is performed, the display control unit 32A ends the display of the message text D3 and the operation screen D4 on the display unit 12, and uses the wireless communication module 23, Display of power consumption of the child room TV 2b reduced by changing the set temperature according to the operation command is obtained from the child room TV 2b, and the first information D1 displayed on the display unit 12 can recognize the reduction in power consumption. Change to form. Thereby, the display screen of the display part 12 changes from the screen shown in FIG.11 (c) to the screen shown in FIG.11 (d).

  In the display screen shown in FIG. 11D, the first information D1 is displayed so that it can be seen that the power consumption of the child room television 2b has been reduced from 100W to 0W. The user can intuitively recognize that the power consumption of the child room television 2b has been reduced by the operation using the operation screen D4 by looking at the first information D1 on the display screen.

  As described above in detail with specific examples, the electronic device 10 </ b> A according to the present embodiment is of the same type as the home appliance detected by the detection unit 31 from the image captured (input) by the camera module 15. A specifying unit 34 for specifying other home appliances is further provided. The display control unit 32 </ b> A displays not only the first information and the second information related to the home appliance detected by the detection unit 31 but also the first information and the second information of the home appliance specified by the specifying unit 34 on the display unit 12. Let Therefore, according to the electronic apparatus 10A according to the present embodiment, not only the information related to the power consumption of the home appliance installed in the room where the user is staying, but also the same type of home appliance installed in another room. Information related to power consumption can be confirmed by the user in an intuitive and easy-to-understand manner.

  In addition, the notification unit 33A of the electronic device 10A according to the present embodiment notifies the user of an operation method for reducing the power consumption of the home appliance specified by the user by a touch operation on the display screen of the display unit 12 or the like. Therefore, it is possible to notify the user of an operation method for reducing the power consumption of the designated home appliance, and to prompt the user to operate the home appliance that contributes to power saving.

  In addition, the notification unit 33A of the electronic device 10A according to the present embodiment notifies a maintenance method for reducing the power consumption of the home appliance specified by the user by a touch operation on the display screen of the display unit 12 or the like. Therefore, the user can be made aware of the maintenance method for reducing the power consumption of the designated home appliance, and the user can be encouraged to maintain the home appliance that contributes to power saving.

  In addition, the display control unit 32A of the electronic device 10A according to the present embodiment further causes the display unit 12 to display an operation screen that accepts an operation on the home appliance specified by the user by a touch operation on the display screen of the display unit 12 or the like. . Therefore, the user can easily operate the home appliance that contributes to power saving, for example, on a home appliance installed in a room different from the room where the user stays while looking at the display screen of the display unit 12. be able to.

  In addition, the display control unit 32A of the electronic device 10A according to the present embodiment reduces the power consumption when the power consumption of the designated home appliance is reduced according to the operation received on the operation screen of the display unit 12. The first information is displayed on the display unit 12 in a recognizable display form. Therefore, the user can intuitively recognize, for example, that the power consumption of the home appliance in another room is reduced by the operation using the operation screen.

<Third Embodiment>
Next, a third embodiment will be described. The electronic device according to the third embodiment (hereinafter, referred to as an electronic device 10B) is a display form of the first information and the second information or a method for operating the home appliance according to the attribute of the user (operator). The only difference from the first embodiment is that the notification method such as the maintenance method is changed. In the following, the same components as those in the first embodiment will be denoted by the same reference numerals, and redundant description will be omitted, and only differences from the first embodiment will be described.

  FIG. 12 is a block diagram illustrating a functional configuration of the electronic device 10B realized by the CPU 16 of the electronic device 10B according to the present embodiment executing the power saving application. In the electronic device 10B according to the present embodiment, as shown in FIG. 12, in addition to the functional configuration of the electronic device 10 according to the first embodiment, an attribute determination unit 35 is provided, and the display of the first embodiment A display control unit 32B is provided instead of the control unit 32, and a notification unit 33B is provided instead of the notification unit 33 of the first embodiment.

  The attribute determination unit 35 determines the attribute of the user who operates the electronic device 10B according to the present embodiment. Here, the user attributes include, for example, age (child, general, elderly, etc.), gender, nationality, and the like.

  Various methods are conceivable as the method by which the attribute determination unit 35 determines the user's attribute. For example, the user's login ID and the user's attribute information are stored in association with each other, and when the user inputs the login ID when using the electronic apparatus 10B according to the present embodiment, the user's login ID is based on the login ID. An example of a method for determining an attribute is given below. Further, for example, biometric information such as a user's fingerprint and user attribute information are stored in association with each other, and biometric information such as a fingerprint is acquired when the user touches the display screen of the display unit 12, You may make it determine a user's attribute based on information. Further, for example, the user's facial features and the user's attribute information are stored in association with each other, and the user's attributes are determined based on a face image obtained by photographing the user's face with the front camera of the camera module 15. You may make it determine.

  Similar to the display control unit 32 of the first embodiment, the display control unit 32B causes the display unit 12 to display the first information and the second information related to the home appliance detected by the detection unit 31 from the image. However, the display control unit 32 </ b> B of the present embodiment changes the display mode when displaying the first information and the second information on the display unit 12 in accordance with the user attribute determined by the attribute determination unit 35. Specifically, for example, when the attribute of the user determined by the attribute determination unit 35 is an elderly person, the display control unit 32B determines the size of the first information and the second information displayed on the display unit 12. The user attribute is larger than that in the general case. For example, when the attribute of the user determined by the attribute determination unit 35 is a child, the display control unit 32B displays the first information and the second information to be displayed on the display unit 12 as hiragana notation or notation in a chart. To do. For example, when the attribute of the user determined by the attribute determination unit 35 is female, the display control unit 32B causes the display unit 12 to display the first information and the second information with a character icon or the like. . Further, the display control unit 32B matches the characters of the first information and the second information displayed on the display unit 12 with the language used by the user according to the nationality of the user determined by the attribute determination unit 35. In addition, the above is an example of the display form changed according to a user's attribute, It is not limited to these.

  As with the notification unit 33 of the first embodiment, the notification unit 33B is configured to reduce the power consumption of the home appliance detected by the detection unit 31 from the image, or the consumption of the home appliance detected by the detection unit 31 from the image. A maintenance method for reducing power is notified to the user. However, the notification unit 33B of the present embodiment changes the notification method of the home appliance operation method and the maintenance method according to the user attribute determined by the attribute determination unit 35. Specifically, for example, when the attribute of the user determined by the attribute determination unit 35 is an elderly person, the notification unit 33B sets the volume of the voice guidance to be output from the speaker 14 more than when the user attribute is general. Enlarge. For example, when the attribute of the user determined by the attribute determination unit 35 is an elderly person or a child, the notification unit 33B notifies the maintenance method of the home appliance in more detail than when the user attribute is general. Further, the notification unit 33B matches the voice guidance output from the speaker 14 with the language used by the user according to the nationality of the user determined by the attribute determination unit 35. In addition, the above is an example of the alerting | reporting method changed according to a user's attribute, It is not limited to these.

  As described above, the electronic device 10B according to the present embodiment further includes the attribute determination unit 35 that determines the attribute of the user who operates the electronic device 10B. The display control unit 32B changes the display mode when displaying the first information and the second information on the display unit 12 according to the user attribute determined by the attribute determination unit 35, and the notification unit 33B Depending on the attribute of the user determined by the attribute determination unit 35, the method of notifying the home appliance operation method and the maintenance method is changed. Therefore, according to the electronic device 10B according to the present embodiment, it is possible to allow the user to check information related to the power consumption of the home appliance in a more easily understandable manner, and to operate and maintain the home appliance that contributes to power saving. Can be conveyed to the user in a more understandable manner.

  According to at least one embodiment described above, the detection unit 31 that detects the home appliance from the image photographed (input) by the camera module 15 and the power consumption of the home appliance detected by the detection unit 31 from the image. Display control unit 32 that causes display unit 12 to display 1 information and second information for determining whether or not an operation that affects the power consumption of the home appliance is desired. By a simple operation such as holding over a home electric appliance, information relating to power consumption of the desired electric home appliance can be intuitively and easily understood by the user.

  Note that the characteristic functions of the electronic devices 10, 10 </ b> A, and 10 </ b> B according to the above-described embodiments are realized by an application program (power saving application) executed by the CPU 16 as an example. This application program (power saving application) is provided by being incorporated in advance in, for example, the non-volatile memory 20 in the electronic device 10, 10A, 10B. In addition, this application program (power saving application) can be read by a computer such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disc) in a file that can be installed or executed. You may comprise so that it may record and provide on a recording medium. Further, the application program (power saving application) may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Further, the application program (power saving application) may be provided or distributed via a network such as the Internet.

  The application program (power saving application) executed by the CPU 16 of each of the electronic devices 10, 10A, and 10B according to each embodiment described above includes the detection unit 31, the display control unit 32 (32A, 32B), and the notification unit 33 (33A, 33B). ), A module configuration including the specifying unit 34 and the attribute determination unit 35. As actual hardware, the CPU 16 reads out and executes an application program (power saving application) from the nonvolatile memory 20, and the above-described units are It is loaded on the main memory (for example, the RAM 21), and the above-described units are generated on the main memory.

  As mentioned above, although some embodiment of this invention was described, these embodiment is shown as an example and is not intending limiting the range of invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 Air conditioner 1a Living room air conditioner 1b Children's room air conditioner 1c Bedroom air conditioner 2 Television 2a Living room television 2b Children's room television 2c Bedroom television 3 Lighting device 4 Refrigerator 5 Washer / dryer 6 Network 7 Information providing server 10, 10A, 10B Electronic equipment 12 Display Unit 15 Camera module 31 Detection unit 32, 32A, 32B Display control unit 33, 33A, 33B Notification unit 34 Identification unit 35 Attribute determination unit

Claims (9)

An electronic device capable of controlling a plurality of types of devices provided in a home system,
Photographing means for photographing an image;
Display means for displaying information;
Detecting means for detecting a device that consumes power, included in the plurality of types of devices, from images captured by the photographing unit;
A device for identifying the device detected by the detecting device, and another device of the same type having the same control method;
For each of the device detected by the detection unit and the device specified by the specifying unit, first information indicating the power consumption of the device, and whether or not an operation that affects the power consumption of the device is necessary, Display control means for causing the display means to display second information having different items depending on the type of the device;
Electronic equipment comprising.   The electronic device according to claim 1, further comprising notification means for notifying an operation method for reducing power consumption of the device.   The electronic device according to claim 2, wherein the notification unit further notifies a maintenance method for reducing power consumption of the device. A determination means for determining an attribute of the operator;
The display control means changes a display form of the first information and the second information according to the attribute of the operator,
The electronic device according to claim 2, wherein the notification unit changes a notification method according to an attribute of the operator.   The display control means causes the display means to further display an operation screen for accepting an operation on the device after displaying the first information and the second information on the display means. An electronic device according to any one of the above.   The display control means causes the display means to display the first information in a display form indicating a reduction in the power consumption when the power consumption of the device is reduced in accordance with an operation received on the operation screen. Item 6. The electronic device according to Item 5.   The electronic device according to claim 1, wherein the display control unit causes the display unit to display the first information and the second information superimposed on an image captured by the imaging unit. The detection means further detects an object that changes its state manually without consuming power from the image taken by the shooting means, and the change in state affects the power consumption of the device,
2. The electronic device according to claim 1, wherein, when the detection unit detects the object, the display control unit causes the display unit to display third information for determining whether or not the state of the object needs to be changed. A computer comprising a photographing means for photographing an image and a display means for displaying information, and a computer capable of controlling a plurality of types of devices provided in a home system,
A detection step of detecting a device that consumes power, included in the plurality of types of devices, from an image captured by the photographing unit;
A step of identifying the device detected by the detection step and another device of the same type having the same control method;
For each of the device detected by the detection step and the device specified by the specifying step, the first information indicating the power consumption of the device and the necessity of an operation that affects the power consumption of the device are determined. A display step for causing the display means to display second information having different items depending on the type of the device;
A program to realize

Images