TWI407130B - A system and a method for real-time displaying using status and power consumption information of electrical appliances - Google Patents

Abstract

A system and a method for real-time displaying using status and power consumption information of electrical appliances are disclosed. The system comprises a server and a portable electronic device. The server is electrically connected an electrical appliance in a room to obtain the using status and power consumption information of the electrical appliance. The server includes a database having scene image features and electrical appliance image features. The portable electronic device includes an image-capturing module, a processing module and a displaying module. The image-capturing module is used to capture the image of a scene within the room and the image of the electrical appliance within the room. The processing module is used to recognize the room as one of a plurality of rooms recorded in the database according to the image of the room captured by the image-capturing module and the scene image features in the database. The processing module is also used to recognize the image within an electrical appliance-recognizing window as one of a plurality of electrical appliances within the room recorded in the database by comparing the image of the electrical appliance within the electrical appliance-recognizing window to the electrical appliance image features in the database. Afterwards, the displaying module real-time displays the using status and power consumption information of the electrical appliance recognized by the processing module.

Description

System and method for instantly displaying the state of use of electrical appliances and information on power consumption

The present invention relates to a system and method for instantly displaying the state of use and power consumption of an appliance, and more particularly to a user who can use the portable electronic device to instantly obtain the usage status and power consumption information of the indoor appliance. System and method.

As everyone knows, people have used a variety of portable electronic devices in their lives, such as using mobile phones for mobile communication, or using a laptop instead of a desktop computer to make use of the notebook anytime, anywhere. To handle the transaction.

At present, the above portable electronic devices such as mobile phones and the like all have camera functions. When the user carries such a portable electronic device with a camera function, the camera function of the portable electronic device is usually used to photograph a portrait or a scene. However, due to the functional limitations of such portable electronic devices, it is currently not possible to use their camera functions to provide further additional applications, such as the collaborative operation of camera functions through remote databases and portable electronic devices. Display the use information of indoor appliances on the display screen of the portable electronic device to create an environment of intelligent living. Therefore, it is necessary to seek a solution.

Accordingly, it is an object of the present invention to provide a system for instantly displaying the state of use and power usage information of an appliance.

Therefore, the system for displaying the state of use of the electrical appliance and the power consumption information of the present invention comprises a server and a portable electronic device. The server is electrically connected to an electrical appliance in a room to instantly obtain the usage status and power consumption information of the electrical appliance, and includes a database having scene image features and electrical image features. The portable electronic device includes an image capture module, a processing module, and a display module. The image capture module is used to capture an image of a scene in the room and an image of the appliance in the room. The processing module is configured to identify the room as one of a plurality of rooms recorded in the database according to the image of the room captured by the image capturing module and the scene image feature in the database. And identifying the image in the electrical identification frame as recorded in the database by using an image of the electrical device in the frame and the electrical image feature in the library in a predetermined size of the display screen of the display module. One of the multiple appliances in the room. The display module is further configured to display the usage status and power consumption information of the electrical appliance identified by the processing module.

Another object of the present invention is to provide a method for instantly displaying the usage status and power consumption information of an appliance.

Therefore, the method for instantly displaying the state of use of the electrical appliance and the power consumption information comprises: (A) providing a server electrically connected to an electrical appliance in a room to obtain the use state and power consumption of the electrical appliance in real time. Information, including a library of scene image features and electrical image features; (B) capturing a scene of a scene in the room using a portable electronic device; (C) based on the image of the room captured and a scene image feature in the database, the portable electronic device identifying the room as one of a plurality of rooms recorded in the database; and (D) displaying the portable electronic device by comparing The image of the electrical appliance in the predetermined size of the electrical identification frame and the electrical image feature in the database, and the image in the electrical identification frame is identified as one of the plurality of electrical appliances in the room recorded in the database. And displaying the used state of the electrical appliance and the power consumption information on the display screen of the portable electronic device.

The utility model has the advantages that the user can use the portable electronic device to obtain the usage status and the power consumption information of the indoor electrical appliance in an augmented reality manner.

The above and other technical contents, features and advantages of the present invention will be apparent from the following detailed description of the preferred embodiments.

Before the present invention is described in detail, it is noted that in the following description, similar elements are denoted by the same reference numerals.

Referring to FIG. 1, a preferred embodiment of the system for instantly displaying the state of use and power consumption information of the present invention includes a portable electronic device 11 and a server 12. The system can be connected to the servos of the portable electronic device 11 (such as a mobile phone, a PDA, a notebook computer, etc.) and to the servos of the indoor electrical appliances (such as the air conditioner 91, the electric fan 92, the refrigerator 93, the oven 94). The cooperative operation of the devices 12 enables the portable electronic device 11 to display the usage status and power consumption information of the indoor electrical appliances in an augmented reality manner.

As shown in FIG. 1 , in the preferred embodiment of the present invention, the indoor electrical appliances (such as the air conditioner 91, the electric fan 92, the refrigerator 93, and the oven) are displayed on the portable electronic device 11 of the user. The usage status and power consumption information of 94, etc., so that the electrical appliances and the server 12 need to be electrically connected by a transmission line 90 (such as a power line), and an appropriate processing unit must be provided between each electrical appliance and the server 12. Not shown), so that the server 12 can immediately receive the usage status (such as turning on or off) of each appliance and the power consumption information. Since the server 12 utilizes the transmission line 90 and the processing units to immediately receive the state of use of the electrical appliances and the technical details of the power consumption information, the technical field of the present invention can be easily implemented, so it is not necessary to add it in this specification. Narration.

The server 12 includes a database 120 having pre-established scene image features 121, electrical image features 122, non-identified objects 123, room numbers 124, and electrical codes 125. For a specific room, the database 120 records a plurality of (for example, 15) scene image features 121 corresponding to different scenes in the specific room, so that the user can take a certain image in the specific room by using the portable electronic device 11 In a scene, the captured scene can be successfully identified as one of the scene image features 121 of the database 120, thereby identifying the captured specific room as multiple rooms recorded in the database 120. One of them.

In addition, for each particular scene, each of the scene image features 121 includes at least one electrical appliance image feature 122 of the appliance. Therefore, after the specific room photographed is identified as one of the plurality of rooms recorded in the database 120, the portable electronic device 11 can further identify the appliance appearing in the scene it is photographing. One of the electrical appliances in the particular room recorded in the database 120. Moreover, in the preferred embodiment, the database 120 further records a plurality of samples of the non-identified target 123, wherein each of the non-identified target 123 samples does not include any image of the electrical appliance, thereby improving the present The recognition rate and accuracy in the preferred embodiment.

The portable electronic device 11 includes an image capturing module 111, a processing module 112, and a display module 113.

The image capturing module 111 is configured to capture an image of a scene in the specific room and an image of the appliance in the specific room.

The processing module 112 is configured to identify the specific room as the plurality of records in the database 120 according to the image of the specific room captured by the image capturing module 111 and the scene image feature 121 in the database. One of the rooms in the room. In addition, the processing module 112 is further configured to identify the appliance as the number of the rooms recorded in the database according to the image of the specific appliance in the specific room and the appliance image feature 122 in the database 120. One of the electrical appliances.

The display module 113 is configured to display the usage status and power consumption information of the identified electrical appliance in real time according to the result of the processing module 112. The display module 113 can be, for example, a touch panel. In addition, the display module 113 is further configured to display a power consumption warning for prompting that the instantaneous power consumption is greater than a threshold value.

In the present specification, a preferred embodiment of the method for instantly displaying the state of use and power consumption information of the present invention will be described below with reference to FIGS. 1 to 5. First, as shown in step 21 of FIG. 2, as described above, the system of the present invention needs to establish the server 12 in advance to provide the portable electronic device 11 with an instant display of the state of use of the indoor electrical appliance in an augmented reality manner. The service of the function of electricity consumption information.

Then, as shown in step 22, the user uses the shooting mode of the portable electronic device 11 to capture an image of a certain scene in a specific room.

Then, as shown in step 23, the portable electronic device 11 recognizes the room as multiple recorded in the database 120 according to the captured image of the room and the scene image feature 121 in the database 120. One of the rooms. As shown in FIG. 3, in the preferred embodiment, the user can first press a specific function option on the touch panel of the portable electronic device 11 to display a room identification frame 114 in the central area of the touch panel. The portable electronic device 11 is brought into the room identification mode, wherein the size of the room identification frame 114 can be, for example, 128 pixels x 128 pixels. Then, the processing module 112 of the portable electronic device 11 first calculates the difference between the brightness of each pixel of the actual image in the room identification frame 114 and the surrounding pixels, and then calculates the distribution of all the brightness difference values as a comparison. Characteristics. Then, the processing module 112 of the portable electronic device 11 compares the features of the image in the room identification frame 114 with the scene image features 121 obtained from the database 120. If the scene image in the room identification frame 114 meets the scene image feature 121 obtained from the database 120, the processing module 112 has successfully recognized the scene image in the room identification frame 114 as multiple records in the database 120. One of the rooms. On the other hand, if the scene image in the room identification frame 114 does not match the scene image feature 121 obtained from the database 120, as shown in FIG. 3, the room identification frame 114 is continuously displayed in the display screen of the display module 113, and the processing mode is Group 112 continues the alignment process.

When the processing module 112 successfully identifies the scene image in the room identification frame 114 as one of the plurality of rooms recorded in the database 120 in step 23, the portable electronic device is then displayed as shown in step 24. The processing module 112 of the 11 identifies the image in the electrical identification frame 115 by comparing the image of the electrical device in the electrical identification frame 115 of the predetermined size in the display screen of the display module 113 with the electrical image feature 122 in the database 120. It is identified as one of the appliances in the room recorded in the database 120. As shown in FIG. 4, in the preferred embodiment, the user can first display the electrical device around the electrical device in the display screen of the display module 113 by operating a specific function option on the touch panel of the portable electronic device 11. The identification frame 115 causes the portable electronic device 11 to enter an appliance recognition mode, wherein the size of the appliance identification frame 115 can be, for example, 64 pixels×64 pixels. Then, the processing module 112 of the portable electronic device 11 first calculates the difference between the brightness of each pixel of the actual image in the electrical recognition frame 115 and the surrounding pixels, and then calculates the distribution of all the luminance differences as a comparison. Characteristics. Then, the processing module 112 of the portable electronic device 11 compares the features of the image in the electrical identification frame 115 with the electrical image features 122 obtained from the database 120. If the electrical image in the electrical identification frame 115 meets the electrical image feature 122 obtained from the database 120, the processing module 112 has successfully identified the electrical image in the electrical identification frame 115 as the room recorded in the database 120. One of the appliances in the middle. On the other hand, if the electrical image in the electrical identification frame 115 does not meet the electrical image feature 122 obtained from the database 120, as shown in FIG. 3, the room identification frame 114 can be continuously displayed on the display screen of the display module 113, and processed. The module 112 continues the comparison process, or the user can operate the portable electronic device 11 to enter the shooting mode or the room identification mode according to the needs thereof.

When the processing module 112 in step 24 successfully identifies the electrical image in the electrical identification frame 115 as one of the electrical appliances in the room recorded in the database 120, the display module 113 of the portable electronic device 11 In the display screen, the usage status and power consumption information will be displayed immediately in the vicinity of the appliance. In the preferred embodiment, the processing module 112 of the portable electronic device 11 has successfully identified the electrical image in the electrical identification frame 115 of FIG. 4 as one of the electrical devices in the room recorded in the database 120 (eg, In the air conditioner of the embodiment, as shown in FIG. 5, in the display screen of the display module 113, the relevant use status and power consumption information, such as the electric appliance code 125, are displayed in the vicinity of the identified electric appliance. The air conditioner (shown in the air conditioner) and the instant information 99 of the appliance (if the air conditioner is turned on, and the daily or weekly or monthly cumulative power consumption is 0.0485 degrees 〞). In addition, while the appliance code 125 and the appliance instant information 99 are displayed in the vicinity of the identified appliance in the display screen of the display module 113, the identified room can be simultaneously displayed on the display screen of the display module 113. Room number 124 (〝 room 747〞 as shown in the figure).

Moreover, when the portable electronic device 11 moves the position, the recognized electrical code 125 and the electrical instant information 99 are displayed in the display module 113 of the portable electronic device 11 and the image of the electrical device. The relative position remains unchanged, that is, the electric appliance code 125 of the air conditioner in the display screen of the portable electronic device 11 in FIG. 5 and the electric appliance instant information 99 which is opened at 0.0485 degrees can be along with the electric appliance. Augmented reality moves. In the preferred embodiment, the processing module 112 calculates the moving distance according to the difference between the screens before and after the movement of the display module 113 caused by the movement of the portable electronic device 11, and then updates the electrical code 125 according to the moving distance. And the display position of the instant information 99 of the appliance, so that the user can use the portable electronic device 11 to obtain the usage status and power consumption information of the indoor appliance in an augmented reality manner.

In addition, in the foregoing step 24, when the processing module 112 of the portable electronic device 11 detects that the instantaneous power consumption of the electrical appliance is greater than a threshold, the display module 113 of the portable electronic device 11 can also Instant display of power consumption warnings to warn that the instantaneous power consumption is greater than the threshold.

In summary, the system and method for displaying the state of use of the appliance and the power consumption information of the present invention are combined with the scene connected to the remote server 12 of the appliance by the camera function of the portable electronic device 11 of the user. The image feature 121, the electrical image feature 122, the non-identification target 123, the room number 124, and the electrical code 125 enable the user to instantly obtain the usage status and power consumption information of the indoor electrical appliance in an augmented reality manner, so that the present invention can be achieved. The purpose.

The above is only the preferred embodiment of the present invention, and the scope of the invention is not limited thereto, that is, the simple equivalent changes and modifications made by the scope of the invention and the description of the invention are All remain within the scope of the invention patent.

11. . . Portable electronic device

111. . . Image capture module

112. . . Processing module

113. . . Display module

114. . . Room identification box

115. . . Electrical identification box

12. . . server

120. . . database

121. . . Scene image feature

122. . . Electrical image sample

123. . . Non-identified target

124. . . Room number

125. . . Electrical code

21~24. . . step

8. . . Wireless network

90. . . Transmission line

91. . . Air conditioner

92. . . electric fan

93. . . refrigerator

94. . . oven

99. . . Electrical information

1 is a system block diagram showing a preferred embodiment of the system for instantly displaying the state of use and power consumption information of the present invention;

2 is a flow chart showing a preferred embodiment of the method for instantly displaying the state of use and power consumption information of the present invention;

3 is a schematic diagram showing a scene captured by the portable electronic device and a room identification frame displayed on the display screen of the portable electronic device in the preferred embodiment;

4 is a schematic diagram showing a scene captured by the portable electronic device and an electrical identification frame displayed on the display screen of the portable electronic device in the preferred embodiment;

FIG. 5 is a schematic diagram showing the room scene recognized by the portable electronic device and the electrical code of the electrical appliance and the instant information of the electrical appliance in the display screen of the portable electronic device in the preferred embodiment.

11. . . Portable electronic device

111. . . Image capture module

112. . . Processing module

113. . . Display module

12. . . server

120. . . database

121. . . Scene image feature

122. . . Electrical image sample

123. . . Non-identified target

124. . . Room number

125. . . Electrical code

8. . . Wireless network

90. . . Transmission line

91. . . Air conditioner

92. . . electric fan

93. . . refrigerator

94. . . oven

99. . . Electrical information

Claims (7)

A system for instantly displaying the usage status and power consumption information of an electric appliance includes: a server electrically connected to an electric appliance in a room to instantly obtain the usage status and power consumption information of the electric appliance, and includes a scene image a library of features and electrical image features; and a portable electronic device including an image capture module, a processing module and a display module, wherein the image capture module is used to capture one of the rooms The image of the scene and the image of the electrical appliance in the room, the processing module is configured to identify the room as the database according to the image of the room captured by the image capturing module and the scene image feature in the database One of the plurality of rooms recorded in the library is used to identify the appliance by an image of the appliance within a predetermined size of the display panel of the display module and an electrical image feature in the library The image in the frame is identified as one of a plurality of electrical appliances in the room recorded in the database, and the display module is also used to instantly display the identification of the processing module. Information on the state of use and power consumption of the appliance, wherein when the portable electronic device moves, the state of use of the appliance and the position of the power consumption information in the display module and the relative position of the image of the appliance remain unchanged change. According to the system of the present invention, the display module of the portable electronic device is a touch panel. According to the use of instant display appliances as described in item 1 of the patent application scope The system of the power consumption information, wherein the display module of the portable electronic device is further configured to display a power consumption warning for prompting that the instantaneous power consumption is greater than a threshold value. The system for instantly displaying the state of use and power consumption information of the appliance according to the first aspect of the patent application, wherein the server is electrically connected to the electric appliance in the room by a power line, and the portable electronic device is wirelessly connected. To the server. A method for instantly displaying the usage status and power consumption information of an electric appliance includes the following steps: (A) providing a server electrically connected to an electric appliance in a room to instantly obtain the use state of the electric appliance and use the electric appliance Information, including a library of scene image features and electrical image features; (B) capturing a scene of a scene in the room using a portable electronic device; (C) based on the image of the room captured and a scene image feature in the database, the portable electronic device identifying the room as one of a plurality of rooms recorded in the database; and (D) displaying the portable electronic device by comparing The image of the electrical appliance in the predetermined size of the electrical identification frame and the electrical image feature in the database, and the image in the electrical identification frame is identified as one of the plurality of electrical appliances in the room recorded in the database. And displaying, by the portable electronic device, the usage status and the power consumption information of the electrical device in the display screen of the portable electronic device, wherein the portable electronic device When moving, using state of the electrical appliances and power consumption information in the The display position in the display screen of the portable electronic device and the relative position of the image of the electrical device remain unchanged. According to the method of displaying the state of use of the electrical appliance and the power consumption information according to the fifth aspect of the patent application, the step (D) further includes: the portable electronic device is used to warn that the instantaneous power consumption is greater than one The threshold power consumption warning is instantly displayed on the display screen of the portable electronic device. According to the method of displaying the state of use of the electrical appliance and the power consumption information according to the fifth aspect of the patent application, wherein the server is electrically connected to the electrical appliance in the room by a power line, and the portable electronic device is wirelessly connected. To the server.