CN113341758B - Intelligent household electrical appliance remote control system and method based on Internet - Google Patents

Intelligent household electrical appliance remote control system and method based on Internet Download PDF

Info

Publication number
CN113341758B
CN113341758B CN202110878428.6A CN202110878428A CN113341758B CN 113341758 B CN113341758 B CN 113341758B CN 202110878428 A CN202110878428 A CN 202110878428A CN 113341758 B CN113341758 B CN 113341758B
Authority
CN
China
Prior art keywords
unit
information
image
remote control
instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110878428.6A
Other languages
Chinese (zh)
Other versions
CN113341758A (en
Inventor
周国贤
吴启楠
文坚
李吉刚
陈政
赵磊
张锦旗
徐健健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Skyworth Electric Co Ltd
Original Assignee
Skyworth Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Skyworth Electric Co Ltd filed Critical Skyworth Electric Co Ltd
Priority to CN202110878428.6A priority Critical patent/CN113341758B/en
Publication of CN113341758A publication Critical patent/CN113341758A/en
Application granted granted Critical
Publication of CN113341758B publication Critical patent/CN113341758B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Selective Calling Equipment (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention discloses an intelligent household appliance remote control system and a method thereof based on the Internet, comprising a monitoring analysis module, a remote control module and an operation execution terminal; the monitoring analysis module is used for collecting, processing and analyzing image information in the intelligent household appliance and comparing the image information at different time points; the remote control module is used for issuing a remote encryption control instruction according to an analysis result of the monitoring analysis module and remotely controlling the intelligent household appliance; the operation execution terminal is used for executing a control instruction of the remote control module, and is provided with the monitoring analysis module, so that the image collection, processing, analysis and comparison can be carried out on the condition inside the refrigerator, the monitoring analysis module can replace a user to monitor the inside of the refrigerator, the monitoring result is timely fed back to the user in a digital mode, and the user can conveniently carry out remote control on the refrigerator in time according to the monitoring result.

Description

Intelligent household electrical appliance remote control system and method based on Internet
Technical Field
The invention relates to the technical field of internet household appliances, in particular to an internet-based intelligent household appliance remote control system and method.
Background
With the continuous development of the intelligent household appliance industry, people can remotely control the intelligent household appliance through the mobile phone APP to obtain the state parameters of the intelligent household appliance and can adjust the parameters of the intelligent household appliance, but the existing intelligent household appliance remote control system can only manually select and control, and cannot give feedback to users according to the actual use condition of the intelligent household appliance, so that the normal use of the household appliance is influenced;
for example: the remote control system can give feedback to remind the user to ventilate the intelligent household appliance or open the refrigerator door to remotely control peculiar smell removal;
the remote control system has the safety problem, and the modification of a lawless person on a remote control instruction can cause potential safety hazard, so that the safety and the stability of the remote control instruction are ensured to be transmitted to the greatest extent;
therefore, there is a need for an internet-based remote control system and method for intelligent household appliances to solve the above problems.
Disclosure of Invention
The invention aims to provide an internet-based intelligent household appliance remote control system and a method thereof, which aim to solve the problems in the prior art.
In order to achieve the purpose, the invention provides the following technical scheme: the intelligent household electrical appliance remote control system based on the Internet comprises a monitoring analysis module, a central management module, a remote control module and an operation execution terminal;
the monitoring and analyzing module is used for collecting, processing and analyzing image information in the intelligent household appliance and comparing the image information at different time points, so that the types of articles stored in the refrigerator can be confirmed, and the articles which are not suitable for being stored for a long time can be monitored conveniently; the central management module is used for carrying out intelligent management on the whole remote control system; the remote control module is used for issuing a remote encryption control instruction according to an analysis result of the monitoring analysis module and remotely controlling the intelligent household appliance, so that a user can be reminded of remotely controlling the intelligent household appliance according to self monitoring of the intelligent household appliance, and the intelligent degree of the intelligent household appliance is improved; the operation execution terminal is used for executing the control instruction of the remote control module and carrying out corresponding operation on the remote control instruction;
the output end of the monitoring and analyzing module is connected with the input ends of the central management module and the operation execution terminal, the central management module is electrically connected with the remote control module, and the output end of the central management module is connected with the input end of the operation execution terminal.
Through the technical scheme, the user can remotely control the intelligent household appliance according to self monitoring and information feedback of the intelligent household appliance, the intelligent degree of the intelligent household appliance is improved, and the operation difficulty and the use difficulty of the user are reduced.
According to the technical scheme, the monitoring analysis module comprises an image acquisition unit, an image processing unit, an image analysis unit and an image comparison unit;
the image acquisition unit is an acquisition camera and is used for acquiring image information inside the intelligent household appliance to obtain a scene picture inside the intelligent household appliance; the image processing unit is used for carrying out digital processing on the scene picture acquired by the image acquisition unit, extracting characteristic points in the scene picture and forming a plurality of object outlines, so that the scene picture can be analyzed in a digital form, and the analysis result of the scene picture is more accurate; the image analysis unit is used for analyzing the digitized scene picture, confirming the types of different article outlines in the digitized scene picture, and annotating each article outline, wherein the content of the annotation comprises article types, storage time points, storage duration and the like, so that each article stored can be monitored, the phenomenon of decay caused by long-time storage is avoided, and the cleanness degree of the interior of the intelligent household appliance is ensured; the image comparison unit is used for comparing the digital images at different time points and confirming the article change condition in the intelligent household appliance, so that the current situation of each article can be accurately judged;
the output of image acquisition unit connects image processing unit's input, image processing unit's output is connected image analysis unit's input, image analysis unit's output is connected the output of image comparison unit, the input of central management module is connected to the output of image comparison unit, image analysis unit's input is connected to image analysis unit's output, for image acquisition unit with feedback signal, the signal that image analysis unit analysis was accomplished promptly, image processing unit's output is connected the input of image comparison unit for when carrying out the secondary comparison, reduce image analysis's step, only need to compare the digital picture after handling can.
Through the technical scheme, the scene picture inside the intelligent household appliance can be digitally processed, so that the scene inside the intelligent household appliance can be analyzed and judged in a digital mode, the scene inside the intelligent household appliance can be analyzed more accurately, the state of the article inside the intelligent household appliance can be analyzed more accurately, and more accurate feedback information can be given to a user.
According to the technical scheme, the central management module comprises a system control unit, an information feedback unit, an instruction splitting unit and an information comparison unit;
the system control unit is used for executing the control instruction of the remote control module to intelligently control the operation execution terminal; the information feedback unit is used for feeding back information to the remote control module according to the picture comparison result of the picture comparison unit, so that the remote control module can remotely know the internal condition of the intelligent household appliance; the instruction splitting unit is used for splitting the encrypted control instruction issued by the remote control module to obtain a control instruction and feedback information II, so that the remote control of the control instruction is safer and more reliable, and the transmission safety of the control instruction is ensured; the information comparison unit is used for comparing feedback information II obtained after the encryption control instruction is split by the instruction splitting unit with feedback information I sent by the information feedback unit, so that the remote control instruction can be ensured to be a control instruction which is sent after the feedback information I is received, the intelligent household appliance is not maliciously remotely controlled, and the safety of the control instruction is ensured;
the image is compared the input of the output connected system control unit of unit, the input of the output connection information feedback unit of system control unit, the input of remote control module is connected to the output of system control unit and information feedback unit, the input of unit is compared to the output connection information of information feedback unit, the input of instruction split unit is connected to the output of remote control module, the input of unit is compared to the output connected system control unit of instruction split unit and information, the input of unit is compared to the output connected system control unit of unit to information.
Through the technical scheme, the remote control instruction can be encrypted through the feedback information, the encrypted remote control instruction is split, the initial feedback information I and the feedback information II after the split are compared, the safety of the remote control instruction is ensured, and the intelligent household appliance is safer to use.
According to the technical scheme, the remote control module comprises an information receiving unit, an image display unit, an instruction sending unit and an information packaging unit;
the information receiving unit is used for receiving the feedback information I sent by the information feedback unit, the image display unit is used for displaying the digital picture processed by the image processing unit, and the image display unit is also used for issuing a remote control instruction by a user, so that the user can intuitively know the specific condition in the intelligent household appliance; the information packaging unit is used for packaging the feedback information I received by the information receiving unit to obtain feedback information II, so that the feedback information II can be used for encrypting the remote control instruction, and the safety of the remote control instruction is ensured; the instruction sending unit is used for merging and sending the control instruction generated by the graphic display unit and the feedback information II generated by the information packaging unit;
the output end of the system control unit is connected with the input end of the image display unit, the output end of the information feedback unit is connected with the input end of the information receiving unit, the output end of the information receiving unit is connected with the output ends of the image display unit and the information packaging unit, and the output ends of the image display unit and the information packaging unit are connected with the input end of the instruction sending unit, so that the feedback information II can be used as the encrypted content of the control instruction, the transmission safety of the control instruction is ensured, and the output end of the instruction sending unit is connected with the input end of the instruction splitting unit.
Through the technical scheme, the feedback information I is packaged to obtain the feedback information II, and the feedback information II is used as a cipher of the control instruction, so that the control instruction is more stable in the transmission process, the system control unit can distinguish the control instruction, malicious remote control of lawbreakers on the intelligent household appliance is avoided, and the safety of the remote control instruction is ensured.
According to the technical scheme, the operation execution terminal comprises a time recording unit, a ventilation fan, a door opening execution mechanism and a temperature adjusting unit;
the time recording unit is used for recording the time point when the articles in the intelligent household appliance are placed, and further recording the time length of the articles stored in the intelligent household appliance, so that whether the articles are stored for too long or not is ensured, and the articles in the intelligent household appliance are not influenced with each other; the ventilation fan is used for ventilating and removing peculiar smell when peculiar smell occurs in the intelligent household appliance; the door opening executing mechanism is used for automatically opening a door of the intelligent household appliance, so that the air exchange operation inside the intelligent household appliance is further realized; the temperature adjusting unit is used for adjusting the temperature inside the intelligent household appliance, and the stored articles are ensured to be at a temperature which can not deteriorate and be damaged;
the intelligent household appliance is a refrigerator;
the output end of the image acquisition unit is connected with the input end of the time recording unit, so that the time point of image acquisition can be recorded when each image acquisition is carried out, and the output end of the time recording unit is connected with the input end of the system control unit.
Through the technical scheme, the operation of the remote control instruction can be executed, the articles stored in the refrigerator are controlled, the articles deteriorated in the refrigerator are prevented from affecting the storage of other articles, and the environment in the refrigerator is cleaner.
An intelligent household appliance remote control method based on the internet comprises the following steps:
s1, collecting, processing and analyzing the image information in the refrigerator by using the monitoring analysis module, and comparing the image information at different time points;
s2, the central management module sends the condition inside the refrigerator to the remote control module in the form of feedback information according to the comparison result of the monitoring analysis module;
s3, checking the internal condition of the refrigerator by using the remote control module, and issuing a remote control instruction for the refrigerator;
s4, encrypting the control instruction by using the remote control module, and sending the feedback information as an encrypted ciphertext to the central management module;
s5, the central management module splits the encrypted control command and compares the feedback information II serving as the ciphertext with the initial feedback information I;
and S6, the central management module controls the operation instruction terminal to execute corresponding operation according to the comparison result and the control instruction, so as to realize remote control of the refrigerator.
According to the technical scheme, in S1, an image acquisition unit is used for acquiring image information inside the refrigerator to obtain pictures inside the refrigerator, and when the image acquisition unit acquires images, a time recording unit is used for recording the acquired time point T1
Extracting feature points of the obtained picture by using an image processing unit, wherein the extracted feature points are the outlines of the articles in the refrigerator, and obtaining an outline map of the articles in the refrigerator;
establishing a two-dimensional rectangular coordinate system of the contour map by using the image analysis unit, and giving each contour point a coordinateValues, the contour points of each article forming a set of coordinate values
Figure 756115DEST_PATH_IMAGE001
Wherein k represents the kth item stored in the refrigerator, and n represents that the outline of the item is composed of n characteristic points;
using image analysis units to set PExtracting the coordinate value with the maximum middle ordinate to form a set
Figure 211236DEST_PATH_IMAGE002
The image analysis unit sets the image pairs according to the following formula
Figure 875566DEST_PATH_IMAGE003
The distance between each two coordinate values in (1) is calculated:
Figure 495291DEST_PATH_IMAGE004
,i≠j;
wherein i represents a set
Figure 2496DEST_PATH_IMAGE003
The ith contour point, j represents the set
Figure 746461DEST_PATH_IMAGE003
The jth contour point in (a);
extraction of
Figure 514566DEST_PATH_IMAGE005
Maximum value of
Figure 318574DEST_PATH_IMAGE006
Figure 47495DEST_PATH_IMAGE006
The coordinate values of the corresponding two characteristic points are
Figure 47681DEST_PATH_IMAGE007
And
Figure 748921DEST_PATH_IMAGE008
through the calculation formula, the length of the upper surface of the article stored in the refrigerator can be calculated and analyzed;
using image analysis units to set PExtracting the coordinate value with the minimum middle ordinate to form a set
Figure 520568DEST_PATH_IMAGE009
And a + b < n, the image analysis unit calculates the distance between each two coordinate values in the set according to the following formula:
Figure 189315DEST_PATH_IMAGE010
,o≠p;
wherein o represents a set
Figure 212766DEST_PATH_IMAGE011
The o-th contour point in (m), p denotes a set
Figure 8991DEST_PATH_IMAGE011
The p-th contour point in (1);
extraction of
Figure 217118DEST_PATH_IMAGE012
Maximum value of
Figure 795998DEST_PATH_IMAGE013
Figure 934725DEST_PATH_IMAGE013
The coordinate values of the corresponding two characteristic points are
Figure 407294DEST_PATH_IMAGE014
And
Figure 724006DEST_PATH_IMAGE015
through the calculation formula, the length of the lower surface of the article stored in the refrigerator can be calculated and analyzed;
calculating the included angle between the outline and the side edge of the article according to the following formula:
Figure 39450DEST_PATH_IMAGE016
wherein the content of the first and second substances,
Figure 467020DEST_PATH_IMAGE017
representing the angle between the upper contour line and the side edges of the article,
Figure 59675DEST_PATH_IMAGE018
representing characteristic points
Figure 796556DEST_PATH_IMAGE007
And
Figure 84449DEST_PATH_IMAGE008
the vector formed between the two vectors is,
Figure 567908DEST_PATH_IMAGE019
representing characteristic points
Figure 15069DEST_PATH_IMAGE008
And
Figure 673584DEST_PATH_IMAGE015
the vector formed therebetween;
the included angle between the upper surface and the side edge of the articles stored in the refrigerator can be calculated and analyzed through the calculation formula, and because the containers for storing dishes are usually containers such as bowls and dishes, whether the containers placed in the refrigerator are bowls or dishes can be judged through the calculation formula, and whether the dishes stored in the containers are not suitable for long-time storage is further judged;
when in use
Figure 963620DEST_PATH_IMAGE020
And is
Figure 732993DEST_PATH_IMAGE021
And is
Figure 34661DEST_PATH_IMAGE022
When the food is stored, the food is stored in the container for a long time; the image analysis unit sends an analysis result to the image comparison unit;
the image comparison unit compares the digital images at different time points, and the image comparison unit compares the two digital images at different time points in a superposition comparison mode, wherein the specific comparison steps are as follows:
s101, overlapping two digital pictures at different time points;
s102, calculating the area of a non-overlapping area of the same area in the two pictures by using a fixed integral;
s103, when the area of the non-overlapping area of the same area exceeds a set threshold, indicating that the articles in the area are displaced or the types of the articles stored in the area are changed;
and S104, the image comparison unit sends the image comparison result to the system control unit.
According to the above technical solution, in S2-S3, the system control unit is used to receive the picture comparison result of the image comparison unit, and the digitized picture processed by the image processing unit is sent to the image display unit through the system control unit for display, when the system control unit receives the comparison result of the image comparison unit, the comparison result shows that the container for storing food does not change or move in position after a certain time threshold, because the image comparison unit does not move after the certain time threshold exceeds the certain time threshold, the food stored in the container does not move within a certain time limit, at this time, the food stored in the container may have been deteriorated, the information feedback unit is used to feed back the comparison result of the image comparison unit to the information receiving unit, and at the same time, the information feedback unit feeds back the comparison result of the image comparison unit to the information comparison unit, the comparison result is used as a first feedback information, the first feedback information is respectively sent to the image display unit and the information packaging unit by the information receiving unit, the image display unit displays the first feedback information, a user issues a control command in the image display unit, the information packaging unit packages the first feedback information to obtain second feedback information, the first feedback information and the second feedback information have the same essence, the feedback information is converted into the second feedback information through the information packaging unit, so that the form of the feedback information is changed, the transmission of the feedback information is safer through one-round form conversion, the image display unit and the information packaging unit respectively send the control instruction and the feedback information II to the instruction sending unit, and the instruction sending unit integrates the control instruction and the feedback information II and sends the integrated control instruction and the feedback information II to the instruction splitting unit.
Through the technical scheme, the remote control instruction is not simply issued, but feedback information fed back by the system control unit is added, so that the control instruction is sent more safely and reliably.
According to the technical scheme, the content of the first feedback information and the second feedback information is the area value of the non-overlapping area of the same area in the two pictures, in S4-S5, the control command sent by the command sending unit and the integrated content of the second feedback information are split by the command splitting unit to respectively obtain the control command and the second feedback information, the instruction splitting unit sends the control instruction to the system control unit to wait for executing the operation of the control instruction, the instruction splitting unit sends the feedback information II to the information comparison unit, the information comparison unit compares the feedback information I with the feedback information II, the information comparison unit compares the area values of the non-overlapping regions in the same region in the two pictures between the first feedback information and the second feedback information, and sends the comparison result to the system control unit;
when the area values of the first feedback information and the second feedback information are completely equal, the fact that the control instruction is made after the first feedback information is obtained is shown, the control instruction is made for the user, and the intelligent household appliance is not remotely controlled by a lawbreaker maliciously;
when the area values of the first feedback information and the second feedback information are not equal, the fact that the control instruction is not made after the first feedback information is obtained is shown, the control instruction is sent out at will, the control instruction is not made by the user aiming at the first feedback information, and the intelligent household appliance is remotely controlled by a lawbreaker maliciously.
Through the technical scheme, the system control unit can judge the authenticity of the control instruction by comparing the feedback information I with the feedback information II, so that the authenticity of the control instruction is ensured, and the safety of remote control of the intelligent household appliance is ensured.
According to the technical scheme, in S6, when the comparison result of the information comparison unit is that the area values are matched, the system control unit correspondingly controls the ventilating fan, the door opening execution mechanism and the temperature adjustment unit of the operation execution terminal according to the control instruction;
and when the comparison result of the information comparison unit is that the area values are not matched, the system control unit does not execute the operation of the control instruction and feeds back the result to the remote control module again.
Through the technical scheme, the control instruction issued by the user is ensured to be used for each remote control of the intelligent household appliance, and the safety of executing the control instruction is ensured.
Compared with the prior art, the invention has the beneficial effects that:
1. the refrigerator internal storage system is provided with the monitoring analysis module, so that the image acquisition, processing, analysis and comparison can be carried out on the internal condition of the refrigerator, the monitoring analysis module can replace a user to monitor the internal condition of the refrigerator, and the monitoring result is timely fed back to the user in a digital mode, so that the user can conveniently carry out remote control on the refrigerator in time according to the monitoring result, the intelligent degree of the refrigerator is improved, the cleanness degree of the internal storage environment of the refrigerator is ensured, and the condition that the refrigerator is rotten to generate peculiar smell due to long-time food storage is avoided.
2. The intelligent household appliance remote control system is provided with the central management module and the remote control module, the image comparison result can be fed back by the information feedback unit, the feedback information is packaged by the information packaging unit, an encryption password serving as a control instruction is sent together with the control instruction, the control instruction and the feedback information are split by the instruction splitting unit, the split feedback information is verified, and the system control unit executes the control instruction after verification is correct, so that the remote control module can control the intelligent household appliance more safely, and potential safety hazards caused by malicious remote control of the intelligent household appliance by lawless persons are avoided.
Drawings
FIG. 1 is a schematic diagram of the module composition of the Internet-based intelligent household appliance remote control system of the present invention;
FIG. 2 is a schematic view of the work flow of the remote control method for the Internet-based intelligent household appliances of the present invention;
fig. 3 is a control flow diagram of control instructions of the internet-based intelligent household appliance remote control method of the present invention;
fig. 4 is a schematic flow chart illustrating steps of the internet-based remote control method for intelligent household appliances according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1 to 4, the present invention provides a technical solution, an internet-based intelligent household appliance remote control system, which includes a monitoring analysis module, a central management module, a remote control module and an operation execution terminal;
the monitoring and analyzing module is used for collecting, processing and analyzing image information in the intelligent household appliance and comparing the image information at different time points, so that the types of articles stored in the refrigerator can be confirmed, and the articles which are not suitable for being stored for a long time can be monitored conveniently; the central management module is used for carrying out intelligent management on the whole remote control system; the remote control module is used for issuing a remote encryption control instruction according to an analysis result of the monitoring analysis module and remotely controlling the intelligent household appliance, so that a user can be reminded of remotely controlling the intelligent household appliance according to self monitoring of the intelligent household appliance, and the intelligent degree of the intelligent household appliance is improved; the operation execution terminal is used for executing the control instruction of the remote control module and carrying out corresponding operation on the remote control instruction;
the output end of the monitoring and analyzing module is connected with the input ends of the central management module and the operation execution terminal, the central management module is electrically connected with the remote control module, and the output end of the central management module is connected with the input end of the operation execution terminal.
Through the technical scheme, the user can remotely control the intelligent household appliance according to self monitoring and information feedback of the intelligent household appliance, the intelligent degree of the intelligent household appliance is improved, and the operation difficulty and the use difficulty of the user are reduced.
The monitoring analysis module comprises an image acquisition unit, an image processing unit, an image analysis unit and an image comparison unit;
the image acquisition unit is an acquisition camera and is used for acquiring image information inside the intelligent household appliance to obtain a scene picture inside the intelligent household appliance; the image processing unit is used for carrying out digital processing on the scene picture acquired by the image acquisition unit, extracting characteristic points in the scene picture and forming a plurality of object outlines, so that the scene picture can be analyzed in a digital form, and the analysis result of the scene picture is more accurate; the image analysis unit is used for analyzing the digitized scene picture, confirming the types of different article outlines in the digitized scene picture, and annotating each article outline, wherein the content of the annotation comprises article types, storage time points, storage duration and the like, so that each article stored can be monitored, the phenomenon of decay caused by long-time storage is avoided, and the cleanness degree of the interior of the intelligent household appliance is ensured; the image comparison unit is used for comparing the digital images at different time points and confirming the article change condition in the intelligent household appliance, so that the current situation of each article can be accurately judged;
the output of image acquisition unit connects image processing unit's input, image processing unit's output is connected image analysis unit's input, image analysis unit's output is connected the output of image comparison unit, the input of central management module is connected to the output of image comparison unit, image analysis unit's input is connected to image analysis unit's output, for image acquisition unit with feedback signal, the signal that image analysis unit analysis was accomplished promptly, image processing unit's output is connected the input of image comparison unit for when carrying out the secondary comparison, reduce image analysis's step, only need to compare the digital picture after handling can.
Through the technical scheme, the scene picture inside the intelligent household appliance can be digitally processed, so that the scene inside the intelligent household appliance can be analyzed and judged in a digital mode, the scene inside the intelligent household appliance can be analyzed more accurately, the state of the article inside the intelligent household appliance can be analyzed more accurately, and more accurate feedback information can be given to a user.
The central management module comprises a system control unit, an information feedback unit, an instruction splitting unit and an information comparison unit;
the system control unit is used for executing the control instruction of the remote control module to intelligently control the operation execution terminal; the information feedback unit is used for feeding back information to the remote control module according to the picture comparison result of the picture comparison unit, so that the remote control module can remotely know the internal condition of the intelligent household appliance; the instruction splitting unit is used for splitting the encrypted control instruction issued by the remote control module to obtain a control instruction and feedback information II, so that the remote control of the control instruction is safer and more reliable, and the transmission safety of the control instruction is ensured; the information comparison unit is used for comparing feedback information II obtained after the encryption control instruction is split by the instruction splitting unit with feedback information I sent by the information feedback unit, so that the remote control instruction can be ensured to be a control instruction which is sent after the feedback information I is received, the intelligent household appliance is not maliciously remotely controlled, and the safety of the control instruction is ensured;
the image is compared the input of the output connected system control unit of unit, the input of the output connection information feedback unit of system control unit, the input of remote control module is connected to the output of system control unit and information feedback unit, the input of unit is compared to the output connection information of information feedback unit, the input of instruction split unit is connected to the output of remote control module, the input of unit is compared to the output connected system control unit of instruction split unit and information, the input of unit is compared to the output connected system control unit of unit to information.
Through the technical scheme, the remote control instruction can be encrypted through the feedback information, the encrypted remote control instruction is split, the initial feedback information I and the feedback information II after the split are compared, the safety of the remote control instruction is ensured, and the intelligent household appliance is safer to use.
The remote control module comprises an information receiving unit, an image display unit, an instruction sending unit and an information packaging unit;
the information receiving unit is used for receiving the feedback information I sent by the information feedback unit, the image display unit is used for displaying the digital picture processed by the image processing unit, and the image display unit is also used for issuing a remote control instruction by a user, so that the user can intuitively know the specific condition in the intelligent household appliance; the information packaging unit is used for packaging the feedback information I received by the information receiving unit to obtain feedback information II, so that the feedback information II can be used for encrypting the remote control instruction, and the safety of the remote control instruction is ensured; the instruction sending unit is used for merging and sending the control instruction generated by the graphic display unit and the feedback information II generated by the information packaging unit;
the output end of the system control unit is connected with the input end of the image display unit, the output end of the information feedback unit is connected with the input end of the information receiving unit, the output end of the information receiving unit is connected with the output ends of the image display unit and the information packaging unit, and the output ends of the image display unit and the information packaging unit are connected with the input end of the instruction sending unit, so that the feedback information II can be used as the encrypted content of the control instruction, the transmission safety of the control instruction is ensured, and the output end of the instruction sending unit is connected with the input end of the instruction splitting unit.
Through the technical scheme, the feedback information I is packaged to obtain the feedback information II, and the feedback information II is used as a cipher of the control instruction, so that the control instruction is more stable in the transmission process, the system control unit can distinguish the control instruction, malicious remote control of lawbreakers on the intelligent household appliance is avoided, and the safety of the remote control instruction is ensured.
The operation execution terminal comprises a time recording unit, a ventilation fan, a door opening execution mechanism and a temperature adjusting unit;
the time recording unit is used for recording the time point when the articles in the intelligent household appliance are placed, and further recording the time length of the articles stored in the intelligent household appliance, so that whether the articles are stored for too long or not is ensured, and the articles in the intelligent household appliance are not influenced with each other; the ventilation fan is used for ventilating and removing peculiar smell when peculiar smell occurs in the intelligent household appliance; the door opening executing mechanism is used for automatically opening a door of the intelligent household appliance, so that the air exchange operation inside the intelligent household appliance is further realized; the temperature adjusting unit is used for adjusting the temperature inside the intelligent household appliance, and the stored articles are ensured to be at a temperature which can not deteriorate and be damaged;
the intelligent household appliance is a refrigerator;
the output end of the image acquisition unit is connected with the input end of the time recording unit, so that the time point of image acquisition can be recorded when each image acquisition is carried out, and the output end of the time recording unit is connected with the input end of the system control unit.
Through the technical scheme, the operation of the remote control instruction can be executed, the articles stored in the refrigerator are controlled, the articles deteriorated in the refrigerator are prevented from affecting the storage of other articles, and the environment in the refrigerator is cleaner.
An intelligent household appliance remote control method based on the internet comprises the following steps:
s1, collecting, processing and analyzing the image information in the refrigerator by using the monitoring analysis module, and comparing the image information at different time points;
s2, the central management module sends the condition inside the refrigerator to the remote control module in the form of feedback information according to the comparison result of the monitoring analysis module;
s3, checking the internal condition of the refrigerator by using the remote control module, and issuing a remote control instruction for the refrigerator;
s4, encrypting the control instruction by using the remote control module, and sending the feedback information as an encrypted ciphertext to the central management module;
s5, the central management module splits the encrypted control command and compares the feedback information II serving as the ciphertext with the initial feedback information I;
and S6, the central management module controls the operation instruction terminal to execute corresponding operation according to the comparison result and the control instruction, so as to realize remote control of the refrigerator.
In S1, an image acquisition unit is usedThe method comprises the steps of collecting image information in the refrigerator to obtain pictures in the refrigerator, and recording collected time points T by using a time recording unit when the image collecting unit collects images1
Extracting feature points of the obtained picture by using an image processing unit, wherein the extracted feature points are the outlines of the articles in the refrigerator, and obtaining an outline map of the articles in the refrigerator;
establishing a two-dimensional rectangular coordinate system of the profile by using an image analysis unit, giving each profile point a coordinate value, and forming a set of coordinate values by the profile point of each article
Figure 316607DEST_PATH_IMAGE001
Wherein k represents the kth item stored in the refrigerator, and n represents that the outline of the item is composed of n characteristic points;
using image analysis units to set PExtracting the coordinate value with the maximum middle ordinate to form a set
Figure 641409DEST_PATH_IMAGE002
The image analysis unit sets the image pairs according to the following formula
Figure 276789DEST_PATH_IMAGE003
The distance between each two coordinate values in (1) is calculated:
Figure 885494DEST_PATH_IMAGE004
,i≠j;
wherein i represents a set
Figure 823494DEST_PATH_IMAGE003
The ith contour point, j represents the set
Figure 887790DEST_PATH_IMAGE003
The jth contour point in (a);
extraction of
Figure 61282DEST_PATH_IMAGE005
Maximum value of
Figure 478488DEST_PATH_IMAGE006
Figure 898974DEST_PATH_IMAGE006
The coordinate values of the corresponding two characteristic points are
Figure 260685DEST_PATH_IMAGE007
And
Figure 175552DEST_PATH_IMAGE008
through the calculation formula, the length of the upper surface of the article stored in the refrigerator can be calculated and analyzed;
using image analysis units to set PExtracting the coordinate value with the minimum middle ordinate to form a set
Figure 696532DEST_PATH_IMAGE009
And a + b < n, the image analysis unit calculates the distance between each two coordinate values in the set according to the following formula:
Figure 38651DEST_PATH_IMAGE010
,o≠p;
wherein o represents a set
Figure 622079DEST_PATH_IMAGE011
The o-th contour point in (m), p denotes a set
Figure 589904DEST_PATH_IMAGE011
The p-th contour point in (1);
extraction of
Figure 981703DEST_PATH_IMAGE012
Maximum value of
Figure 557040DEST_PATH_IMAGE013
Figure 817645DEST_PATH_IMAGE013
The coordinate values of the corresponding two characteristic points are
Figure 11997DEST_PATH_IMAGE014
And
Figure 304307DEST_PATH_IMAGE015
through the calculation formula, the length of the lower surface of the article stored in the refrigerator can be calculated and analyzed;
calculating the included angle between the outline and the side edge of the article according to the following formula:
Figure 50546DEST_PATH_IMAGE023
wherein the content of the first and second substances,
Figure 811829DEST_PATH_IMAGE017
representing the angle between the upper contour line and the side edges of the article,
Figure 793560DEST_PATH_IMAGE018
representing characteristic points
Figure 956688DEST_PATH_IMAGE007
And
Figure 873829DEST_PATH_IMAGE008
the vector formed between the two vectors is,
Figure 106096DEST_PATH_IMAGE019
representing characteristic points
Figure 642250DEST_PATH_IMAGE008
And
Figure 923801DEST_PATH_IMAGE015
betweenThe formed vector;
the included angle between the upper surface and the side edge of the articles stored in the refrigerator can be calculated and analyzed through the calculation formula, and because the containers for storing dishes are usually containers such as bowls and dishes, whether the containers placed in the refrigerator are bowls or dishes can be judged through the calculation formula, and whether the dishes stored in the containers are not suitable for long-time storage is further judged;
when in use
Figure 277422DEST_PATH_IMAGE020
And is
Figure 685401DEST_PATH_IMAGE021
And is
Figure 336831DEST_PATH_IMAGE022
When the food is stored, the food is stored in the container for a long time;
the image analysis unit sends an analysis result to the image comparison unit;
the image comparison unit compares the digital images at different time points, and the image comparison unit compares the two digital images at different time points in a superposition comparison mode, wherein the specific comparison steps are as follows:
s101, overlapping two digital pictures at different time points;
s102, calculating the area of a non-overlapping area of the same area in the two pictures by using a fixed integral;
s103, when the area of the non-overlapping area of the same area exceeds a set threshold, indicating that the articles in the area are displaced or the types of the articles stored in the area are changed;
and S104, the image comparison unit sends the image comparison result to the system control unit.
In S2-S3, the system control unit receives the comparison result of the image comparison unit, and sends the digitized image processed by the image processing unit to the image display unit for display, when the system control unit receives the comparison result of the image comparison unit, the comparison result shows that the container for storing food does not change or move in position after a certain time threshold, because the image comparison unit does not move after the certain time threshold exceeds the certain time threshold, the food stored in the container does not move within a certain time limit, at this time, the food stored in the container may go bad, the information feedback unit feeds the comparison result of the image comparison unit back to the information receiving unit, and at the same time, the information feedback unit feeds the comparison result of the image comparison unit back to the information comparison unit, the comparison result is used as a first feedback information, the first feedback information is respectively sent to the image display unit and the information packaging unit by the information receiving unit, the image display unit displays the first feedback information, a user issues a control command in the image display unit, the information packaging unit packages the first feedback information to obtain second feedback information, the first feedback information and the second feedback information have the same essence, the feedback information is converted into the second feedback information through the information packaging unit, so that the form of the feedback information is changed, the transmission of the feedback information is safer through one-round form conversion, the image display unit and the information packaging unit respectively send the control instruction and the feedback information II to the instruction sending unit, and the instruction sending unit integrates the control instruction and the feedback information II and sends the integrated control instruction and the feedback information II to the instruction splitting unit.
Through the technical scheme, the remote control instruction is not simply issued, but feedback information fed back by the system control unit is added, so that the control instruction is sent more safely and reliably.
The content of the first feedback information and the second feedback information is the area value of a non-overlapping area of the same area in the two pictures, in S4-S5, an instruction splitting unit is used for splitting the integrated content of a control instruction and the second feedback information sent by an instruction sending unit to respectively obtain the control instruction and the second feedback information, the instruction splitting unit sends the control instruction to a system control unit to wait for execution of operation of the control instruction, the instruction splitting unit sends the second feedback information to an information comparison unit, the information comparison unit compares the first feedback information with the second feedback information, the information comparison unit compares the area value of the non-overlapping area of the same area in the two pictures between the first feedback information and the second feedback information, and sends the comparison result to the system control unit;
when the area values of the first feedback information and the second feedback information are completely equal, the fact that the control instruction is made after the first feedback information is obtained is shown, the control instruction is made for the user, and the intelligent household appliance is not remotely controlled by a lawbreaker maliciously;
when the area values of the first feedback information and the second feedback information are not equal, the fact that the control instruction is not made after the first feedback information is obtained is shown, the control instruction is sent out at will, the control instruction is not made by the user aiming at the first feedback information, and the intelligent household appliance is remotely controlled by a lawbreaker maliciously.
Through the technical scheme, the system control unit can judge the authenticity of the control instruction by comparing the feedback information I with the feedback information II, so that the authenticity of the control instruction is ensured, and the safety of remote control of the intelligent household appliance is ensured.
In S6, when the comparison result of the information comparison unit is that the area values match, the system control unit correspondingly controls the ventilator, the door opening actuator, and the temperature adjustment unit of the operation execution terminal according to the control instruction;
and when the comparison result of the information comparison unit is that the area values are not matched, the system control unit does not execute the operation of the control instruction and feeds back the result to the remote control module again.
Through the technical scheme, the control instruction issued by the user is ensured to be used for each remote control of the intelligent household appliance, and the safety of executing the control instruction is ensured.
The first embodiment is as follows:
refrigerator using image acquisition unitThe method comprises the steps that internal image information is collected to obtain a picture in the refrigerator, and when the image collection unit collects the image, a time recording unit is used for recording a collected time point T120/05/2021;
extracting feature points of the obtained picture by using an image processing unit, wherein the extracted feature points are the outlines of the articles in the refrigerator, and obtaining an outline map of the articles in the refrigerator;
establishing a two-dimensional rectangular coordinate system of the profile by using an image analysis unit, giving each profile point a coordinate value, and forming a set of coordinate values by the profile point of each article
Figure 271289DEST_PATH_IMAGE001
Wherein k denotes a k-th item stored in the refrigerator, and n =50 denotes that the outline of the item is composed of 50 feature points;
using image analysis units to set PExtracting the coordinate value with the maximum middle ordinate to form a set
Figure 467915DEST_PATH_IMAGE002
A =20 the image analysis unit calculates a distance between each two coordinate values in the set according to the following formula:
Figure 612457DEST_PATH_IMAGE004
,i≠j;
wherein i represents a set
Figure 146207DEST_PATH_IMAGE003
The ith contour point, j represents the set
Figure 607275DEST_PATH_IMAGE003
The jth contour point in (a);
extraction of
Figure 427332DEST_PATH_IMAGE005
Maximum value of
Figure 872220DEST_PATH_IMAGE006
=18,
Figure 678502DEST_PATH_IMAGE006
The coordinate values of the corresponding two characteristic points are
Figure 511853DEST_PATH_IMAGE007
And
Figure 253544DEST_PATH_IMAGE008
using image analysis units to set PExtracting the coordinate value with the minimum middle ordinate to form a set
Figure 169417DEST_PATH_IMAGE009
B =10, a + b =30 < n =50, the image analysis unit collecting pairs of images according to the following formula
Figure 44969DEST_PATH_IMAGE011
The distance between each two coordinate values in (1) is calculated:
Figure 215050DEST_PATH_IMAGE010
,o≠p;
wherein o represents a set
Figure 376910DEST_PATH_IMAGE011
The o-th contour point in (m), p denotes a set
Figure 858707DEST_PATH_IMAGE011
The p-th contour point in (1);
extraction of
Figure 944475DEST_PATH_IMAGE012
Maximum value of
Figure 687172DEST_PATH_IMAGE013
=10,
Figure 832982DEST_PATH_IMAGE013
The coordinate values of the corresponding two characteristic points are
Figure 536496DEST_PATH_IMAGE014
And
Figure 678152DEST_PATH_IMAGE015
calculating the included angle between the outline and the side edge of the article according to the following formula:
Figure 26088DEST_PATH_IMAGE023
=45°;
wherein the content of the first and second substances,
Figure 592067DEST_PATH_IMAGE017
=45 deg. indicates the angle between the upper profile line and the side edge of the article,
Figure 782877DEST_PATH_IMAGE018
representing characteristic points
Figure 210447DEST_PATH_IMAGE007
And
Figure 927736DEST_PATH_IMAGE008
the vector formed between the two vectors is,
Figure 477666DEST_PATH_IMAGE019
representing characteristic points
Figure 827876DEST_PATH_IMAGE008
And
Figure 511667DEST_PATH_IMAGE015
the vector formed therebetween;
Figure 896512DEST_PATH_IMAGE020
and is
Figure 617344DEST_PATH_IMAGE021
And is
Figure 707047DEST_PATH_IMAGE022
The article is a container for loading food and can not be stored for a long time, and the article is a container for loading food and can not be stored for a long time;
the image analysis unit sends an analysis result to the image comparison unit;
the image comparison unit compares the digital images at different time points, and the image comparison unit compares the two digital images at different time points in a superposition comparison mode, wherein the specific comparison steps are as follows:
s101, overlapping two digital pictures at different time points;
s102, calculating the area of the non-overlapping area of the same area in the two pictures by using a fixed integral to obtain that the area of the non-overlapping area of a certain area is 0;
s103, showing that the article in the area is not displaced or changed, and the time points of the two pictures compared by the image comparison unit are T respectively120/05/20/18/32/2021 and T2=2021 year, 05 month, 23 days, 19: 02;
and S104, the image comparison unit sends the image comparison result to the system control unit.
The container for storing food is not moved in the refrigerator for more than three days, the stored food is probably deteriorated, the system control unit feeds back a monitoring analysis result to the remote control module through the information feedback unit, and the remote control module carries out remote control on the refrigerator.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.

Claims (9)

1. An intelligent household electrical appliance remote control method based on the Internet is characterized in that: the remote control method comprises the following steps:
s1, collecting, processing and analyzing the image information in the refrigerator by using the monitoring analysis module, and comparing the image information at different time points;
s2, the central management module sends the condition inside the refrigerator to the remote control module in the form of feedback information according to the comparison result of the monitoring analysis module;
s3, checking the internal condition of the refrigerator by using the remote control module, and issuing a remote control instruction for the refrigerator;
s4, encrypting the control instruction by using the remote control module, and sending the feedback information as an encrypted ciphertext to the central management module;
s5, the central management module splits the encrypted control command and compares the feedback information II serving as the ciphertext with the initial feedback information I;
s6, the central management module controls the operation instruction terminal to execute corresponding operation according to the comparison result and the control instruction, and remote control of the refrigerator is realized;
the monitoring analysis module comprises an image acquisition unit, an image processing unit, an image analysis unit and an image comparison unit; the central management module comprises a system control unit, an information feedback unit, an instruction splitting unit and an information comparison unit;
in S1, the image information of the inside of the refrigerator is collected by an image collecting unit to obtain the picture of the inside of the refrigerator, and the time recording unit records the collected time point T when the image collecting unit collects the image1
Extracting feature points of the obtained picture by using an image processing unit, wherein the extracted feature points are the outlines of the articles in the refrigerator, and obtaining an outline map of the articles in the refrigerator;
establishing a two-dimensional rectangular coordinate system of the profile by using an image analysis unit, giving each profile point a coordinate value, and forming a set of coordinate values by the profile point of each article
Figure DEST_PATH_IMAGE002
Wherein k represents the kth item stored in the refrigerator, and n represents that the outline of the item is composed of n characteristic points;
using image analysis units to set PExtracting the coordinate value with the maximum middle ordinate to form a set
Figure DEST_PATH_IMAGE004
The image analysis unit sets the image pairs according to the following formula
Figure DEST_PATH_IMAGE006
The distance between each two coordinate values in (1) is calculated:
Figure DEST_PATH_IMAGE008
,i≠j;
wherein i represents a set
Figure 545651DEST_PATH_IMAGE006
The ith contour point, j represents the set
Figure 541420DEST_PATH_IMAGE006
The jth contour point in (a);
extraction of
Figure DEST_PATH_IMAGE010
Maximum value of
Figure DEST_PATH_IMAGE012
Figure 665365DEST_PATH_IMAGE012
The coordinate values of the corresponding two characteristic points are
Figure DEST_PATH_IMAGE014
And
Figure DEST_PATH_IMAGE016
using image analysis units to set PExtracting the coordinate value with the minimum middle ordinate to form a set
Figure DEST_PATH_IMAGE018
And a + b < n, the image analysis unit calculates the distance between each two coordinate values in the set according to the following formula:
Figure DEST_PATH_IMAGE020
,o≠p;
wherein o represents a set
Figure DEST_PATH_IMAGE022
The o-th contour point in (m), p denotes a set
Figure 139202DEST_PATH_IMAGE022
The p-th contour point in (1);
extraction of
Figure DEST_PATH_IMAGE024
Maximum value of
Figure DEST_PATH_IMAGE026
Figure 184867DEST_PATH_IMAGE026
The coordinate values of the corresponding two characteristic points are
Figure DEST_PATH_IMAGE028
And
Figure DEST_PATH_IMAGE030
calculating the included angle between the outline and the side edge of the article according to the following formula:
Figure DEST_PATH_IMAGE032
wherein the content of the first and second substances,
Figure DEST_PATH_IMAGE034
representing the angle between the upper contour line and the side edges of the article,
Figure DEST_PATH_IMAGE036
representing characteristic points
Figure 554800DEST_PATH_IMAGE014
And
Figure 634883DEST_PATH_IMAGE016
the vector formed between the two vectors is,
Figure DEST_PATH_IMAGE038
representing characteristic points
Figure 974728DEST_PATH_IMAGE016
And
Figure 705924DEST_PATH_IMAGE030
the vector formed therebetween;
when in use
Figure DEST_PATH_IMAGE040
And is
Figure DEST_PATH_IMAGE042
And is
Figure DEST_PATH_IMAGE044
When the food is stored, the food is stored in the container for a long time;
the image analysis unit sends an analysis result to the image comparison unit;
the image comparison unit compares the digital images at different time points, and the image comparison unit compares the two digital images at different time points in a superposition comparison mode, wherein the specific comparison steps are as follows:
s101, overlapping two digital pictures at different time points;
s102, calculating the area of a non-overlapping area of the same area in the two pictures by using a fixed integral;
s103, when the area of the non-overlapping area of the same area exceeds a set threshold, indicating that the articles in the area are displaced or the types of the articles stored in the area are changed;
and S104, the image comparison unit sends the image comparison result to the system control unit.
2. The internet-based intelligent home appliance device remote control method of claim 1, wherein: the remote control module comprises an information receiving unit, an image display unit, an instruction sending unit and an information packaging unit;
in S2-S3, the system control unit is used for receiving the picture comparison result of the image comparison unit, the digitized picture processed by the image processing unit is sent to the image display unit through the system control unit for display, when the system control unit receives the comparison result of the image comparison unit, the comparison result shows that a certain container for storing food does not change or move in position after a certain time threshold value, the information feedback unit is used for feeding back the comparison result of the image comparison unit to the information receiving unit, meanwhile, the information feedback unit feeds back the comparison result of the image comparison unit to the information comparison unit, the comparison result is used as feedback information I, the information receiving unit respectively sends the feedback information I to the image display unit and the information packaging unit, and the image display unit displays the feedback information I, a user issues a control instruction in an image display unit, an information packaging unit packages first feedback information to obtain second feedback information, the first feedback information and the second feedback information are the same in nature, the image display unit and the information packaging unit respectively send the control instruction and the second feedback information to an instruction sending unit, and the instruction sending unit integrates the control instruction and the second feedback information and sends the control instruction and the second feedback information to an instruction splitting unit.
3. The internet-based intelligent home appliance device remote control method of claim 2, wherein: the content of the first feedback information and the second feedback information is an area value of a non-overlapping area of the same area in the two pictures, in S4-S5, an instruction splitting unit is used for splitting a control instruction sent by an instruction sending unit and the integrated content of the second feedback information to respectively obtain the control instruction and the second feedback information, the instruction splitting unit sends the control instruction to a system control unit to wait for execution of operation of the control instruction, the instruction splitting unit sends the second feedback information to an information comparison unit, the information comparison unit compares the first feedback information with the second feedback information, and sends a comparison result to the system control unit;
when the area values of the first feedback information and the second feedback information are completely equal, the fact that the control instruction is made after the first feedback information is obtained is shown, the control instruction is made for the user, and the intelligent household appliance is not remotely controlled by a lawbreaker maliciously;
when the area values of the first feedback information and the second feedback information are not equal, the fact that the control instruction is not made after the first feedback information is obtained is shown, the control instruction is sent out at will, the control instruction is not made by the user aiming at the first feedback information, and the intelligent household appliance is remotely controlled by a lawbreaker maliciously.
4. The internet-based intelligent home appliance device remote control method of claim 3, wherein: in S6, when the comparison result of the information comparison unit is that the area values match, the system control unit correspondingly controls the ventilator, the door opening actuator, and the temperature adjustment unit of the operation execution terminal according to the control instruction;
and when the comparison result of the information comparison unit is that the area values are not matched, the system control unit does not execute the operation of the control instruction and feeds back the result to the remote control module again.
5. A remote control system for implementing the internet-based intelligent home appliance device remote control method of claim 1, characterized in that: the remote control system comprises a monitoring analysis module, a central management module, a remote control module and an operation execution terminal;
the monitoring analysis module is used for collecting, processing and analyzing image information in the intelligent household appliance and comparing the image information at different time points; the central management module is used for carrying out intelligent management on the whole remote control system; the remote control module is used for issuing a remote encryption control instruction according to an analysis result of the monitoring analysis module and remotely controlling the intelligent household appliance; the operation execution terminal is used for executing the control instruction of the remote control module and carrying out corresponding operation on the remote control instruction;
the output end of the monitoring and analyzing module is connected with the input ends of the central management module and the operation execution terminal, the central management module is electrically connected with the remote control module, and the output end of the central management module is connected with the input end of the operation execution terminal.
6. The remote control system according to claim 5, wherein: the monitoring analysis module comprises an image acquisition unit, an image processing unit, an image analysis unit and an image comparison unit;
the image acquisition unit is an acquisition camera and is used for acquiring image information inside the intelligent household appliance to obtain a scene picture inside the intelligent household appliance; the image processing unit is used for carrying out digital processing on the scene picture acquired by the image acquisition unit and extracting characteristic points in the scene picture to form a plurality of object outlines; the image analysis unit is used for analyzing the digitized scene picture, confirming the types of different article outlines in the digitized scene picture and annotating each article outline; the image comparison unit is used for comparing the digital images at different time points and confirming the article change condition in the intelligent household appliance;
the output of image acquisition unit connects the input of image processing unit, the input of image analysis unit is connected to the output of image processing unit, the output of image analysis unit is connected the output of image comparison unit, the input of central management module is connected to the output of image comparison unit, the input of image acquisition unit is connected to the output of image analysis unit, the input of image comparison unit is connected to the output of image processing unit.
7. The remote control system according to claim 6, wherein: the central management module comprises a system control unit, an information feedback unit, an instruction splitting unit and an information comparison unit;
the system control unit is used for executing the control instruction of the remote control module to intelligently control the operation execution terminal; the information feedback unit is used for feeding back information to the remote control module according to the picture comparison result of the picture comparison unit; the instruction splitting unit is used for splitting an encryption control instruction issued by the remote control module to obtain a control instruction and feedback information II; the information comparison unit is used for comparing feedback information II obtained after the encryption control instruction is split by the instruction splitting unit with feedback information I sent by the information feedback unit;
the image is compared the input of the output connected system control unit of unit, the input of the output connection information feedback unit of system control unit, the input of remote control module is connected to the output of system control unit and information feedback unit, the input of unit is compared to the output connection information of information feedback unit, the input of instruction split unit is connected to the output of remote control module, the input of unit is compared to the output connected system control unit of instruction split unit and information, the input of unit is compared to the output connected system control unit of unit to information.
8. The remote control system according to claim 7, wherein: the remote control module comprises an information receiving unit, an image display unit, an instruction sending unit and an information packaging unit;
the information receiving unit is used for receiving the first feedback information sent by the information feedback unit, the image display unit is used for displaying the digital picture processed by the image processing unit, and the image display unit is also used for issuing a remote control instruction by a user; the information packaging unit is used for packaging the feedback information I received by the information receiving unit to obtain feedback information II; the instruction sending unit is used for merging and sending the control instruction generated by the graphic display unit and the feedback information II generated by the information packaging unit;
the output end of the system control unit is connected with the input end of the image display unit, the output end of the information feedback unit is connected with the input end of the information receiving unit, the output end of the information receiving unit is connected with the input ends of the image display unit and the information packaging unit, the output ends of the image display unit and the information packaging unit are connected with the input end of the instruction sending unit, and the output end of the instruction sending unit is connected with the input end of the instruction splitting unit.
9. The remote control system according to claim 8, wherein: the operation execution terminal comprises a time recording unit, a ventilation fan, a door opening execution mechanism and a temperature adjusting unit;
the time recording unit is used for recording the time point of putting articles in the intelligent household appliance, and further recording the time length of the articles stored in the intelligent household appliance; the ventilation fan is used for ventilating and removing peculiar smell when peculiar smell occurs in the intelligent household appliance; the door opening executing mechanism is used for automatically opening a door of the intelligent household appliance, so that the air exchange operation inside the intelligent household appliance is further realized; the temperature adjusting unit is used for adjusting the temperature inside the intelligent household appliance;
the intelligent household appliance is a refrigerator;
the output end of the image acquisition unit is connected with the input end of the time recording unit, and the output end of the time recording unit is connected with the input end of the system control unit.
CN202110878428.6A 2021-08-02 2021-08-02 Intelligent household electrical appliance remote control system and method based on Internet Active CN113341758B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110878428.6A CN113341758B (en) 2021-08-02 2021-08-02 Intelligent household electrical appliance remote control system and method based on Internet

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110878428.6A CN113341758B (en) 2021-08-02 2021-08-02 Intelligent household electrical appliance remote control system and method based on Internet

Publications (2)

Publication Number Publication Date
CN113341758A CN113341758A (en) 2021-09-03
CN113341758B true CN113341758B (en) 2021-11-12

Family

ID=77480527

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110878428.6A Active CN113341758B (en) 2021-08-02 2021-08-02 Intelligent household electrical appliance remote control system and method based on Internet

Country Status (1)

Country Link
CN (1) CN113341758B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116558220A (en) * 2023-05-16 2023-08-08 广东美科冷链科技有限公司 Control system and control method for making smoothie

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104503252A (en) * 2014-12-16 2015-04-08 广东美的厨房电器制造有限公司 Household appliance, control method thereof, and information interaction system for household appliance
CN105758108B (en) * 2016-03-09 2018-12-28 北京京东尚科信息技术有限公司 Information feedback method and device for intelligent refrigerated equipment
DE202017107386U1 (en) * 2017-12-05 2017-12-19 Zhiqiang Liu Smart home system
CN108173720B (en) * 2017-12-07 2020-09-04 无锡小净共享网络科技有限公司 Control method and system of household appliance and household appliance system
CN108286851A (en) * 2018-03-26 2018-07-17 盐城工学院 A kind of intelligent refrigerator and its control system
CN112595019A (en) * 2020-12-16 2021-04-02 珠海格力电器股份有限公司 Method and device for cleaning food, storage medium, electronic equipment and refrigerator

Also Published As

Publication number Publication date
CN113341758A (en) 2021-09-03

Similar Documents

Publication Publication Date Title
CN108269363B (en) Express item processing method and device based on intelligent express cabinet
CN113341758B (en) Intelligent household electrical appliance remote control system and method based on Internet
US10768682B2 (en) Detection-based wakeup of detection devices
CN107468048A (en) Cooking apparatus and its control method
WO2017035949A1 (en) Intelligent home device interaction method and system based on intelligent television video scene
CN107657361A (en) Materials intelligent management and Intelligent Production System
CN108036479A (en) Control method, system, vision controller and the storage medium of air conditioner
CN107481471A (en) Terminal alarms method, apparatus and computer-readable recording medium
CN106709400A (en) Sense organ opening and closing state recognition method, sense organ opening and closing state recognition device and client
CN108919882A (en) A kind of equipment active safety operating method and system based on AR technology
CN113408495B (en) Safety guard system for security
WO2020078076A1 (en) Method and system for controlling air conditioner, air conditioner, and household appliance
US9091592B2 (en) Temperature-detecting system and temperature-detecting method
CN107544355A (en) A kind of intelligent kitchen control system based on cloud platform
CN108983620B (en) Control method and device and electronic equipment
CN110569937A (en) Tool management method, system and equipment
CN105100898B (en) A kind of TV set intelligent open method and system
CN108647608A (en) A kind of implementation method of the smart home burglary-resisting system based on Identification of Images
CN106900165A (en) Transformer station&#39;s communication apparatus temperature monitoring system
CN112036217A (en) Person state detection method and device based on mouth information
CN109192128A (en) Myopia prevention display device and method based on cloud control
CN107197374A (en) The user identification method and system of set-top box device
CN107168183A (en) A kind of apparatus control method and device
CN114048237A (en) Tea storage method, storage medium and tea storage device
CN107704845A (en) A kind of method and system of set top box body-sensing Intelligent Recognition stranger

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant