CN111176124A - System and method for realizing household intelligence - Google Patents
System and method for realizing household intelligence Download PDFInfo
- Publication number
- CN111176124A CN111176124A CN201811335922.2A CN201811335922A CN111176124A CN 111176124 A CN111176124 A CN 111176124A CN 201811335922 A CN201811335922 A CN 201811335922A CN 111176124 A CN111176124 A CN 111176124A
- Authority
- CN
- China
- Prior art keywords
- door
- unit
- sensing
- human
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 230000003993 interaction Effects 0.000 claims abstract description 92
- 238000004891 communication Methods 0.000 claims abstract description 44
- 230000036541 health Effects 0.000 claims abstract description 6
- 230000003111 delayed effect Effects 0.000 claims description 7
- 230000002159 abnormal effect Effects 0.000 claims description 6
- 230000001133 acceleration Effects 0.000 claims description 5
- 238000013135 deep learning Methods 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 4
- 230000001934 delay Effects 0.000 claims 1
- 230000003287 optical effect Effects 0.000 claims 1
- 241000227653 Lycopersicon Species 0.000 description 6
- 235000007688 Lycopersicon esculentum Nutrition 0.000 description 6
- 235000015278 beef Nutrition 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 230000008014 freezing Effects 0.000 description 2
- 238000007710 freezing Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000000172 allergic effect Effects 0.000 description 1
- 208000010668 atopic eczema Diseases 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000000994 depressogenic effect Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 235000013305 food Nutrition 0.000 description 1
- 235000012055 fruits and vegetables Nutrition 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The invention discloses a system and a method for realizing household intelligence, which can realize the intelligence of household property management including personal health, medical treatment and other information. The system comprises human-computer interaction equipment and sensing equipment, wherein the human-computer interaction equipment comprises a processing unit, a storage unit, a communication unit, an audio unit and a power supply unit, and also comprises a display unit and a camera unit, and the sensing equipment comprises a processing unit, a storage unit, a sensing unit, a communication unit and a power supply unit. The system may be further expanded, the expanded system further comprising a central controller comprising a processing unit, a storage unit, a communication unit and a power supply unit. The method comprises the following steps: a. establishing a database; b. inputting various information into a database; c. establishing the contact between each sensing device and the human-computer interaction device, and establishing the contact between the human-computer interaction device and the central controller; d. the sensing equipment detects that the storage device or the space door is opened and sends a door opening signal to the human-computer interaction equipment; e. the operation process of the human-computer interaction equipment after receiving the door opening signal; f. when various storage devices or space doors are closed, the sensing equipment detects that the doors are closed and sends a door closing signal to the human-computer interaction equipment; g. and the human-computer interaction equipment operates after receiving the door closing signal.
Description
Technical Field
The invention relates to the technical field of Internet of things, in particular to a system and a method for realizing household intelligence.
Background
The intelligent home is based on the Internet of things technology and aims to realize home intelligence. Although the concept has been proposed for many years, and a plurality of intelligent home products and solutions are also appeared in the market, we have seen that none of the products can realize real intelligence of home, especially none of the products has proposed the concept of intelligent information management of home property management including personal health and medical treatment, and naturally none of the products has appeared, but the demand of people is very urgent. In reality, everyone can often encounter the situation that things can not be found when needing to be found, the situation that people forget to place things after long-term storage, even the situation that people have no impression of placing some things in the mind, or the situation that people forget to buy things in a market, a supermarket or the like, do not need to buy things, can be depressed because things needing to be found can not be found, and even can get mad because people can not be found when needing to be found; the doctor can also be influenced by forgetting medical files with medical histories, images and the like during doctor visit and remembering which symptoms and how the patients are diagnosed and which medicines are allergic and the like; therefore, it is very useful and necessary to realize intellectualization of home property management including health and medical information.
Disclosure of Invention
In view of the above situation, the invention provides a system and a method for realizing household intelligence, which enable people to feel convenience, rapidness, novelty and intelligence brought by intelligent management of household property management including health and medical information and the like.
The household intelligent system consists of man-machine interaction equipment and sensing equipment, and can also be expanded, wherein the expanded system comprises a central controller.
The man-machine interaction equipment comprises a processing unit, a storage unit, a communication unit, an audio unit, a power supply unit, a display unit and a camera unit, wherein all the units are connected with the processing unit; the communication unit comprises one or more of short-distance wireless modules such as WiFi, ZigBee, Bluetooth and Zwave, and also comprises one or more of long-distance wireless modules such as 4G, and also comprises a wired network port; wherein the display unit may be provided with a touch screen. The software system comprises a voice module, a database, a code scanning program or/and an article recognition program, wherein the voice module also comprises a voiceprint recognition program.
The sensing equipment comprises a processing unit, a storage unit, a sensing unit, a communication unit and a power supply unit, wherein each unit is connected with the processing unit, the sensing unit comprises a light sensor and can also use or add sensors such as acceleration, and the communication unit can adopt one of short-distance modules such as ZigBee, Bluetooth and Zwave.
The central controller comprises a processing unit, a storage unit, a communication unit and a power supply unit, wherein each unit is connected with the processing unit, the communication unit comprises one or more short-distance modules such as WiFi and the like, can also comprise one or more long-distance modules such as 4G and the like, and can also comprise a wired network port; the software system comprises a database.
In the household intelligent system, human-computer interaction equipment is placed in a required room or position, sensing equipment is placed on the inner wall of doors of various storage devices or spaces (such as various cabinets, boxes, drawers, refrigerators, storage rooms and the like), and a central controller is placed in a living room or a place close to internet access equipment in an expanded system. The man-machine interaction equipment and the sensor equipment work together, and each sensor equipment and the man-machine interaction equipment in the same room or position or nearby can communicate in a one-to-one or many-to-one mode, and in the expanded system, the man-machine interaction equipment and the central controller communicate in a one-to-one or many-to-one mode.
Building a family property database in a human-computer interaction device or a central controller in advance, and inputting information such as the types of various storage devices or spaces (such as a wardrobe, a cabinet, a refrigerator and the like), information such as the specific shapes and the structures of each storage device or space (such as several doors or compartments of each cabinet, the numbering of each door or compartment from top to bottom and from left to right or in the sequence, specific numbering and the like) and the rooms or positions where the doors or the compartments are placed into the database; inputting the specific placement position of each sensing device into a database; the existing property information of the family is input into a database, such as the category, the name, the quantity, the production time, the shopping time and place, the shopping cost and the like, and various other data of the consumption condition outside the family, the physical health information of the user, the medical archive and the like are also input into the database, and the user can communicate with the system at any time and place to inquire the various information, so that the home intelligent simplified version is realized. We can build a table of personal specific items and information in the database for managing personal items and information, and can also build a personal specific database.
When people open and close the doors of various storage devices or spaces, the sensing equipment detects the action and judges whether people really use the storage devices to take things or open and close the doors by mistake or other conditions, for example, the doors are closed only by seeing that no things need to be found at a glance; and when the door is judged to be actually used, sending a door opening signal to the man-machine interaction equipment, and sending a door closing signal to the man-machine interaction equipment when the door of each storage device is closed after the operation is finished. The man-machine interaction device starts the voice module to carry out dialogue communication with people after receiving the door opening signal, operates a database program, identifies which specific place of which storage device the people prepare for operation, and can also start a code scanning program or/and an article identification program to automatically identify the type and the quantity of articles and automatically record the type and the quantity of the articles. In the expanded system, after receiving a door opening signal, the man-machine interaction equipment starts a voice module to converse and communicate with a user, the man-machine interaction equipment is connected with the central controller, the central controller runs a database program to identify which specific place of which storage device the user is to operate, and after receiving the door opening signal, the man-machine interaction equipment can also start a code scanning program or/and an article identification program. When the man-machine interaction device is in conversation with people, the man-machine interaction device asks people whether to put in or take out or find out things, what the things are, what the quantity of the things are, and the like, and can tell people where the things are put when the things are not found out. When the operation is finished and the doors of various storage devices are closed, the sensing device sends a door closing signal to the man-machine interaction device, the man-machine interaction device inquires whether the operation is finished or not, inquires the information such as what is put in, the quantity of each object and the specific position where the object is placed when the answer is finished, or inquires the information such as the type and the quantity of the taken out object, the quantity or the proportion of the taken out part of the taken out object and the position where the taken out part is put back after the taken out part of the object is taken out, automatically records all the information of the operation including the date and the time, and simultaneously updates the corresponding data in the database.
The user may leave the refrigerator without closing the door or even forgetting to close the door after the taking and placing operation is completed, the problems of large power consumption, food deterioration, damage to a compressor and the like in the continuous operation of the refrigerator can be caused if the refrigerator is used, and the user may mistakenly think that the household is stolen if other storage devices are used; to prevent such a situation from occurring, a judgment can be made as to the kind of situation. We can predetermine the time values of several take and put operations, and these fixed values should cover most of the operation behaviors basically. The man-machine interaction equipment predicts that the operation is finished within a certain fixed value according to the type and the quantity of the things to be taken and put, and starts to time after the people finish the operation; when the door closing signal is not received after the fixed value is exceeded, the fact that the door closing signal is not completed is inquired, if the door closing signal is answered, the operation is delayed for a period of time and then inquired (the delay time is a certain value smaller than the estimated fixed value, can be a certain nearest fixed value or can be other values), if the door closing signal is answered, the fact that the door is in an unclosed state or sensing equipment works abnormally is judged, the fact that whether the door is unclosed or sensing equipment in the door is out of power or fails is inquired, and specific information including date and time is recorded after the fact that the sensing equipment works abnormally is checked and found; if the inquiry does not receive the response, the inquiry is continued, if the response is not obtained yet, a message that the door closing is abnormal is sent to mobile equipment such as a mobile phone, and the message is sent through a central controller in an enlarged system. The estimated time and the time delayed will be recorded by the system and used for deep learning to be more accurate in the future.
The voice module of the man-machine interaction device can contain a voiceprint recognition program, and the voiceprint recognition program is called to recognize the identity of the user when the user communicates with the user through voice, so that the user can communicate with the user more sensitively and inquire personal articles and information of the user more quickly. We may have personal privacy requirements, such as certain personal items do not want others at home to know where to place, in which case we can enable privacy protection; if we tell that the device can only know what we are in, the system makes a record in the personal specific data table or in the specific database so that others do not tell it when they ask the system.
If necessary, the user can preset voice communication and simultaneously lighten the display screen to display the inventory information of the storage device to be operated, and the display screen can also be displayed with the man-machine interaction equipment at any time, so that the user can communicate with the man-machine interaction equipment through the touch screen.
Drawings
FIG. 1 is a block diagram of a human interaction device;
FIG. 2 is a block diagram of a sensing device;
FIG. 3 is a block diagram of a central controller;
FIG. 4 is a diagram of a home intelligent system;
FIG. 5 is an enlarged home intelligence system diagram;
FIG. 6 is a diagram of steps of a method for implementing the home intelligent system;
FIG. 7 is a flow chart of the sensing device operation;
detailed description of the invention
The household intelligent system consists of a human-computer interaction device and a sensing device, and the human-computer interaction device and the sensing device work in a matched mode.
Human-computer interaction equipment
As shown in fig. 1, the human-computer interaction device comprises the following units: the device comprises a processing unit, a storage unit, a communication unit, an audio unit, a power supply unit, a display unit and a camera unit, wherein all the units are connected with the processing unit; the communication unit adopts WiFi and ZigBee, the display unit is matched with a touch screen, the storage unit can adopt LPDDR and FLASH chips, and a high-integration SoC scheme is preferentially adopted. The software system comprises a voice module and a database, and also comprises a code scanning program and an article recognition program, wherein the voice module comprises a voiceprint recognition program.
Second, sensing equipment
As shown in fig. 2, the sensing apparatus includes the following units: the device comprises a processing unit, a storage unit, a sensing unit, a communication unit and a power supply unit, wherein each unit is connected with the processing unit; the communication unit adopts ZigBee, the sensing unit adopts a photosensitive sensor or/and an acceleration sensor, and a high-integration SoC chip is preferentially adopted.
Third, the method of implementation
As shown in fig. 4, in the home intelligent system, the human-computer interaction device is placed in a living room, a kitchen, each bedroom, a study room and other rooms; the sensing device is placed on the inner wall of the door of various storage devices in each room, and the like. For a storage device or a space, such as a double-door wardrobe or an upper and lower drawer, in which the interior is divided into two compartments, but the brightness of one compartment door is changed or the state of the other compartment door is changed (such as shaking or vibration), a sensing device can be placed in only one compartment door, so that the number of the sensing devices required can be reduced.
As shown in fig. 6, a family property database is established, and information is entered; information such as wardrobe: a main lying wardrobe: a left door, a right door, and a left door inner upper drawer and a left door inner lower drawer; such as specific location information of the sensing device 1: kitchen refrigerator cold rooms, such as the existing items in the home-mr. blue jeans: is placed at the right lower part of the middle layer of the right door of the main horizontal wardrobe.
And establishing many-to-one contact between each sensing device and the man-machine interaction device in the room or the position where the sensing device is located.
When a user opens or closes the door of the storage device, a photosensitive sensor of a sensing unit in the sensing device detects the change of illumination intensity, or an acceleration sensor detects the change of state, and the change is converted into different electric signals by the sensing unit and is transmitted to a processing unit of the sensing device to be processed as follows:
1. the processing unit starts timing after receiving the door opening electric signal, judges that the door is opened or closed by mistake or other conditions if the door closing electric signal is received within a certain time (for example, 1.5 seconds), does not send a signal to the human-computer interaction equipment, and finishes timing;
2. if the door closing electric signal is not received within a certain time (for example, 1.5 seconds) after the timing is started, judging that the user needs to normally take and put things when the door is opened, sending a door opening signal to the man-machine interaction equipment through the communication unit, and timing to finish;
3. and when the processing unit receives the door closing electric signal of the sensing unit after sending the door opening signal, the door is judged to be closed, and the door closing signal is sent to the man-machine interaction equipment through the communication unit.
The communication unit of the man-machine interaction equipment receives the door opening signal and then sends the door opening signal to the processing unit, the processing unit calls the voice module to carry out conversation communication with people, inquires whether people need to put in or take out or find out things, what things are put in, taken out or found, what quantity of things are, and the like, runs a database program, identifies which specific position of the storage device the door is opened, and can tell where the things are put when people cannot find out; code scanning or/and article identification programs can be started to automatically identify the taken and placed articles and the quantity of the articles; after the operation is completed, information such as the number and the position of the things, the date and the time of taking and putting, and the like are recorded. For example: when a female owner opens the refrigerating chamber door of the refrigerator, the human-computer interaction device can ask: "lady, what you want to find", the homeowner says: "where tomato and beef" the device tells: "tomato is in the left back position in the fruit and vegetable box of the refrigerating chamber, beef is in the innermost and bottommost of the middle grid of the refrigerating chamber"; when she took two tomatoes to close the door of the refrigerating chamber and opened the door of the freezing chamber to take out a slice of beef and then closed the door of the freezing chamber, the human-computer interaction device asks again: "lady has you finished with a bar, how many tomatoes and beef woollen we help you remember", the female owner tells the device: "two tomatoes and a serving of beef" are taken, the equipment will ask again: "take nothing, have nothing put in, she answers: "none", the device will automatically record this operation information including date and time etc. and update the database information of the articles in the refrigerator, then answer: "good, i have remembered". The device can also record the information of the object by scanning the code or identifying the object by directing the object to the camera. If the user presets the storage device in conversation and communication and the display screen displays the inventory of things in the specific position of the storage device, the user can also communicate with the human-computer interaction device through the touch screen.
In order to prevent the situation that the door is not closed or even forgotten to be closed after the operation is finished, and the trouble is caused, we can determine 5 operating time values in advance: the operation time is estimated to be one of 60 seconds, 45 seconds, 30 seconds, 20 seconds and 10 seconds respectively by the human-computer interaction device according to the type and the quantity of the things which are said to be taken and placed, for example, the tomato and the beef are expected to be taken, the operation time is estimated to be 10 seconds due to small quantity, when the door closing signal is not received for more than 10 seconds, the fact that the operation is not finished is inquired, if the operation is not finished, the time is delayed for 5 seconds, the operation is inquired again, if the operation is finished, whether the door is not closed or the sensing device is abnormal is judged, whether the door is not closed is inquired, when the door closing signal is received by the human-computer interaction device after the door closing signal is checked and found to be not closed timely: "this is a pass", if we find it really a pass: "how you get back" is good, the human-computer interaction device may say: the owner asks the sensing equipment to check whether the sensing equipment is out of power or bad, and when the owner tells the man-machine interaction equipment about the specific situation after checking, the equipment records the specific situation, date and time and other information of the abnormal working of the sensing equipment. The estimated time and the time delayed will be recorded by the system and used for deep learning to be more accurate in the future.
Detailed description of the invention
The enlarged home intelligent system consists of a man-machine interaction device, a sensing device and a central controller, and the man-machine interaction device, the sensing device and the central controller work in a matched mode.
Human-computer interaction equipment
Hardware as shown in fig. 1, the human-computer interaction device comprises the following units: the device comprises a processing unit, a storage unit, a communication unit, an audio unit, a power supply unit, a display unit and a camera unit, wherein all the units are connected with the processing unit; the communication unit adopts WiFi and Bluetooth, the display unit is matched with a touch screen, the storage unit can adopt LPDDR and FLASH chips, and a high-integration SoC scheme is preferentially adopted. The software system comprises a code scanning program and an article identification program, but does not comprise a database, and the voice module comprises a voiceprint identification program.
Second, sensing equipment
As shown in fig. 2, the sensing apparatus includes the following units: the device comprises a processing unit, a storage unit, a sensing unit, a communication unit and a power supply unit, wherein each unit is connected with the processing unit; wherein the communication unit adopts the bluetooth, and photosensitive sensor is chooseed for use to the sensing unit, preferentially adopts the SoC chip of high integrated level.
Three, central controller
As shown in fig. 3, the central controller includes a processing unit, a storage unit, a communication unit, and a power supply unit, each of which is connected to the processing unit; the storage unit can adopt an LPDDR and FLASH chip, the communication unit adopts WiFi, and a high-integration SoC scheme is preferentially adopted; the software system includes a database.
Fourth, the method of implementation
As shown in fig. 5, the human-computer interaction device in the home intelligent system is placed in rooms such as a living room, a kitchen, each bedroom and a study room; the sensing equipment is placed on the inner wall of the door of various storage devices in each room, and the central controller is placed in the living room or close to the internet access equipment. For some storage devices with multiple compartments, the interior of the multi-door cabinet is divided into multiple compartments, but the brightness of one or more other compartments is changed or the state of the one or more compartments is affected (e.g., vibration), and after testing, it is determined that only one sensing device is placed in each of a few compartments, so that the number of sensing devices required can be reduced.
As shown in fig. 6, a family property database is established, and information is entered; information such as cabinet: the cabinet 1: from left to right, respectively coded as No. 1, 2, 3 and 4 gates; such as the specific location information of the sensing device 12: a drawer on the left side of the television cabinet.
And establishing many-to-one contact between each sensing device and the man-machine interaction device in the room or the position where the sensing device is located, and establishing many-to-one contact between each man-machine interaction device and the central controller.
When a user opens or closes the door of the storage device, the photosensitive sensor of the sensing unit in the sensing device detects the change of the illumination intensity, and the change is converted into different electric signals by the sensing unit and is sent to the processing unit of the sensing device to be processed as follows:
1. the processing unit starts timing after receiving the door opening electric signal, judges that the door is opened or closed by mistake or other conditions if the door closing electric signal is received within a certain time (for example, 1.5 seconds), does not send a signal to the human-computer interaction equipment, and finishes timing;
2. if the door closing electric signal is not received within a certain time (for example, 1.5 seconds) after the timing is started, judging that the user needs to normally take and put things when the door is opened, sending a door opening signal to the man-machine interaction equipment through the communication unit, and timing to finish;
3. and when the processing unit receives the door closing electric signal of the sensing unit after sending the door opening signal, the door is judged to be closed, and the door closing signal is sent to the man-machine interaction equipment through the communication unit.
The door opening signal is sent to the man-machine interaction device in the same room, the communication unit of the man-machine interaction device receives the signal and then sends the signal to the processing unit, the processing unit starts the voice module to communicate with people, inquires whether the people need to put or take out the objects or find the objects, and whether the objects are put, taken or found, the quantity of the objects is large, and the like, requests the central controller to perform database operation, inquires which specific position of the storage device the door is opened, and can tell where the objects are put when the objects cannot be found; and a code scanning program and/or an article identification program can be started to automatically identify the taken and placed articles and the quantity thereof. After the operation is completed, information such as the number and the position of the things, the date and the time of taking and putting, and the like are recorded. For example: when the cabinet is opened neatly, the human-computer interaction device can ask: "Small and beautiful, what you want to take or put on, and beautiful: "just buy something and want to put in the cupboard", the equipment can say: "all are something, have forgotten to tell me, she replies: "good", when the cabinet door is closed after the placement is completed, the equipment will ask: "show is good", she answers saying "show is good", the device asks: "what things are put, how many things are put, and where the things are put, after being told by the small pieces, the central controller can automatically record all operation information including the information of date, time and the like, and update the data in the database. If the kidn does not tell someone, the database system records all information of the operation of the certain object into a kidn-dedicated related table, if the kidn does not have the dedicated related table before, one information is created and recorded, so that when being inquired by other people, the system does not tell the operation of the kidn about the information, but the same object taken by the kidn at other times and the same object taken by other people at any time can still be told by the system without being influenced by the fact. The device can also automatically identify and record the information of the object by scanning a code or/and identifying the object by directing the object to the camera. We can also say to a human-computer interaction device: and if the display screen is displayed, the display screen can be automatically lightened and can display the article information of a specific place of the storage device which is required to be operated by people, and therefore the people can communicate with the human-computer interaction equipment through the touch screen.
In order to prevent the trouble caused by the situation that the door is not closed or even forgotten to be closed, the 5-gear operation time value is determined in advance: the time periods are respectively 60 seconds, 45 seconds, 30 seconds, 20 seconds and 10 seconds, the human-computer interaction device can estimate one of the operation time periods according to the type and the quantity of the things which are supposed to be taken and put by us, for example, the quantity of the things which are supposed to be taken and put by us is estimated to be 60 seconds because the quantity of the things which are supposed to be taken and put by us is estimated to be 60 seconds, when the time period exceeds 60 seconds, the situation that the operation is not finished is inquired, if the situation that the operation is finished is answered by us, the time period is delayed for 30 seconds, if the situation that the operation is finished is answered by us, the situation that the door is not closed or the sensing device works abnormally is judged, the situation that the door is not closed is inquired, when the situation that the door is closed after: "this is a pass", if we find it really a pass: "how you get back" is good, the human-computer interaction device may say: the master asks the sensing equipment to check whether the sensing equipment is out of power or bad, and when the master tells the man-machine interaction equipment about the specific situation after checking, the central controller records the specific situation, date and time and other information of the abnormal working of the sensing equipment. The estimated time and the time delayed will be recorded by the system and used for deep learning to be more accurate in the future.
The first and second embodiments are provided only for reference, and many more implementation methods can be provided based on the two embodiments, and these methods will fall into the protection scope of the present invention.
Claims (12)
1. The household intelligent system is characterized by comprising human-computer interaction equipment and sensing equipment, wherein the human-computer interaction equipment and the sensing equipment work in a matched mode.
2. The home intelligent system according to claim 1, wherein there are a plurality of human-computer interaction devices and sensing devices, the sensing devices are placed on various storage devices or on the inner wall of a door of a space, the human-computer interaction devices are placed in a desired room or location, and each sensing device communicates with the human-computer interaction devices in the same room or location or nearby in a one-to-one or many-to-one manner.
3. The human-computer interaction device in the home intelligent system according to claim 1, comprising a processing unit, a storage unit, a communication unit, an audio unit, a power unit, a display unit, a touch screen of the display unit, and a camera unit, wherein each unit is connected with the processing unit; the communication unit comprises one or more of short-distance communication modules such as WiFi, ZigBee, Bluetooth and Zwave, and also comprises one or more of long-distance communication modules such as 4G; the software system comprises a voice module and a database, and also can comprise a code scanning program or/and an article recognition program, wherein the voice module can comprise a voiceprint recognition program.
4. The sensing equipment in the home intelligent system according to claim 1, comprising a processing unit, a storage unit, a sensing unit, a communication unit and a power supply unit, wherein each unit is connected with the processing unit; wherein the sensing unit adopts optical sensor or/and acceleration sensor, and the communication unit adopts one of short range communication module such as zigBee, bluetooth, Zwave.
5. The home intelligent system according to claim 1, further expandable to a larger system including a central controller, wherein in the expanded system the human-computer interaction device communicates with the central controller in a one-to-one or many-to-one manner, and the sensing device, the human-computer interaction device and the central controller work in cooperation; the central controller is placed in a place convenient for accessing the Internet, and the man-machine interaction equipment software system does not contain a database.
6. The central controller in the home intelligent system according to claim 5, comprising a processing unit, a storage unit, a communication unit and a power supply unit, wherein each unit is connected with the processing unit; the communication unit comprises one or more short-distance modules such as WiFi and the like, can also comprise one or more long-distance modules such as 4G and the like, and can also comprise a wired network port; the software system comprises a database.
7. The implementation method of the home intelligent system according to claim 1 or 5, comprising the following steps:
a. establishing a database, wherein a personal special related table can be established in the database for the management of personal articles and information, and a personal special database can also be established;
b. inputting information such as the types, shapes and structures of various storage devices or spaces and the room or position information in which the storage devices or spaces are placed into a database, inputting the specific placement position of each sensing device into the database, inputting various information of the existing properties of a family into the database, and also inputting other information such as personal health data and medical files into the database;
c. establishing one-to-one or many-to-one relation between each sensing device and the man-machine interaction device in the room or the position where the sensing device is located, and establishing one-to-one or many-to-one relation between the man-machine interaction device and the central controller in the enlarged system;
d. the sensing equipment detects that the storage device or the space door is opened and then sends an opening signal to the human-computer interaction equipment;
e. after receiving the door opening signal, the man-machine interaction equipment starts a voice module to carry out conversation communication with people, runs a database program, identifies which specific place of which storage device the people prepare for operation, and can also start a code scanning program or/and an article identification program to carry out automatic identification and recording on articles; in the expanded system, after receiving a door opening signal, the man-machine interaction equipment starts a voice module to carry out dialogue communication with a user, the man-machine interaction equipment is connected with the central controller in parallel, the central controller runs a database program to identify which specific place of which storage device the user is to operate, and after receiving the door opening signal, the man-machine interaction equipment can also start a code scanning program or/and an article identification program;
f. when the operation is finished and the various storage devices or the space door is closed, the sensing equipment detects that the door is closed and then sends a door closing signal to the human-computer interaction equipment;
g. after receiving the door closing signal, the man-machine interaction equipment calls a voice module to carry out dialogue communication with people, and database operation is carried out; in the expanded system, the man-machine interaction equipment receives a door closing signal and then converses with people, and requests the central controller to carry out database operation.
8. The implementation method of the home intelligent system according to claim 7, wherein the method for the sensing device to detect whether the storage device or the space door is opened or closed and respectively send the door opening signal and the door closing signal comprises the following steps: when the storage device or the space door is opened or closed, the light sensor of the sensing unit in the sensing equipment detects that the light intensity changes or/and the acceleration sensor detects that the motion state changes, the changes are converted into different electric signals by the sensing unit and transmitted to the processing unit of the sensing equipment, and the processing unit sends corresponding door opening or closing signals to the human-computer interaction equipment through the communication unit after processing.
9. The method for implementing the home intelligent system according to claim 8, wherein when the sensing device detects that the storage device or the space door is opened or closed and sends the door opening signal and the door closing signal respectively, the sensing device further makes a judgment to determine whether the storage device is actually used to take things or whether the storage device is mistakenly opened or closed or other situations, and the method comprises the following steps:
a. the processing unit starts timing after receiving the door opening electric signal, judges that the door is opened or closed by mistake or other conditions if the door closing electric signal is received within a short time, does not send a signal to the human-computer interaction equipment, and finishes timing;
b. if the electric signal for closing the door is not received within a short time after the timing is started, judging that the user needs to normally take and put things when the door is opened, sending a door opening signal to the man-machine interaction equipment through the communication unit, and timing to finish;
c. and when the processing unit receives the door closing electric signal of the sensing unit after sending the door opening signal, the door is judged to be closed, and the door closing signal is sent to the man-machine interaction equipment through the communication unit.
10. The method for implementing intelligent home system according to claim 7, wherein the voice module of the human-computer interaction device further comprises a voiceprint recognition program, and in step e of the method, the human-computer interaction device can call the voiceprint recognition program to recognize our identity at the beginning of the conversation with us, so as to communicate with us more emotionally and manage and query personal items more conveniently.
11. The method for implementing the home intelligent system according to claim 10, wherein when people have a need for taking and placing personal articles in privacy, a privacy requirement is provided when the people communicate with the human-computer interaction device, the system stores all information related to the privacy requirement of the operation in a personal privacy-specific related table in the database, if no related table exists before, all information of the privacy operation is automatically created and recorded, or stored in the personal-specific database, and the privacy information is not told to others by the system; however, the same things taken at other times and the privacy of the time and the same things taken by others at any time can still be told by the system without being affected by the same things.
12. The method for implementing the home intelligent system according to claim 7, wherein in order to prevent the occurrence of trouble caused by the fact that the door is not closed or even forgotten to be closed after the operation is completed, the method may further include a step of determining whether the operation is completed or not and an abnormal condition of closing the door, and the method includes: the time values of a plurality of object taking and placing operations are preset, the man-machine interaction device predicts that the operations are finished within a certain fixed value according to the types and the number of the objects to be taken and placed, and starts to time after the people finish the operations; when the door closing signal is not received after the fixed value is exceeded, the user is inquired that the operation is not finished, if the user answers and says that the operation is not finished, the user delays for a period of time and inquires again, and the delay time is a certain value smaller than the estimated fixed value, can be the closest fixed value or other values; if we answer that the operation is completed, the door is judged to be in an unclosed state or the sensing equipment works abnormally, we are asked whether the door is unclosed or whether the sensing equipment in the door is out of power or has a fault, and specific information including date and time is recorded after we check the specific condition that the sensing equipment works abnormally; if the inquiry does not obtain the response of the user, the inquiry is continued, if the response is not obtained yet, a message that the door closing is abnormal is sent to mobile equipment such as a mobile phone, and the message is sent out through a central controller in an expanded system; the estimated time and the time delayed will be recorded by the system and used for deep learning to be more accurate in the future.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811335922.2A CN111176124A (en) | 2018-11-11 | 2018-11-11 | System and method for realizing household intelligence |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811335922.2A CN111176124A (en) | 2018-11-11 | 2018-11-11 | System and method for realizing household intelligence |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111176124A true CN111176124A (en) | 2020-05-19 |
Family
ID=70651778
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811335922.2A Pending CN111176124A (en) | 2018-11-11 | 2018-11-11 | System and method for realizing household intelligence |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111176124A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112187592A (en) * | 2020-09-23 | 2021-01-05 | 江西玉祥智能装备制造有限公司 | Management system of electrical appliance |
| CN113302564A (en) * | 2021-02-10 | 2021-08-24 | 朱保东 | Composition and method for realizing whole-house intelligent home system |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1355411A (en) * | 2000-12-01 | 2002-06-26 | 王建刚 | Method for knowing weight of substance stored in refrigerator and its associated refrigerator |
| CN201748733U (en) * | 2010-05-31 | 2011-02-16 | 施国学 | Intelligent freezing device |
| CN103679442A (en) * | 2013-09-03 | 2014-03-26 | 常州大学 | A supermarket payment system based on an NFC technique and a payment method thereof |
| US20140108019A1 (en) * | 2012-10-08 | 2014-04-17 | Fluential, Llc | Smart Home Automation Systems and Methods |
| CN104504315A (en) * | 2014-11-29 | 2015-04-08 | 韩少茹 | Multilateral interaction method of power consumption information of smart power grid |
| CN105590250A (en) * | 2015-12-17 | 2016-05-18 | 唐语灏 | Intelligent management apparatus and system and management method thereof |
| CN106408781A (en) * | 2016-11-28 | 2017-02-15 | 韦尚仁 | Natatorium article storage cabinet control system with fingerprint recognition function and method thereof |
| CN106790537A (en) * | 2016-12-22 | 2017-05-31 | 天津恒辉创意科技有限公司 | Safety-protection system and its implementation based on internet and sensor door |
| CN107045678A (en) * | 2017-02-08 | 2017-08-15 | 陈东 | Automatic batch quickly matches somebody with somebody goods system and method |
| CN107067675A (en) * | 2017-06-06 | 2017-08-18 | 深圳正品创想科技有限公司 | A kind of alarm method and device based on cabinet door of selling goods |
-
2018
- 2018-11-11 CN CN201811335922.2A patent/CN111176124A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1355411A (en) * | 2000-12-01 | 2002-06-26 | 王建刚 | Method for knowing weight of substance stored in refrigerator and its associated refrigerator |
| CN201748733U (en) * | 2010-05-31 | 2011-02-16 | 施国学 | Intelligent freezing device |
| US20140108019A1 (en) * | 2012-10-08 | 2014-04-17 | Fluential, Llc | Smart Home Automation Systems and Methods |
| CN103679442A (en) * | 2013-09-03 | 2014-03-26 | 常州大学 | A supermarket payment system based on an NFC technique and a payment method thereof |
| CN104504315A (en) * | 2014-11-29 | 2015-04-08 | 韩少茹 | Multilateral interaction method of power consumption information of smart power grid |
| CN105590250A (en) * | 2015-12-17 | 2016-05-18 | 唐语灏 | Intelligent management apparatus and system and management method thereof |
| CN106408781A (en) * | 2016-11-28 | 2017-02-15 | 韦尚仁 | Natatorium article storage cabinet control system with fingerprint recognition function and method thereof |
| CN106790537A (en) * | 2016-12-22 | 2017-05-31 | 天津恒辉创意科技有限公司 | Safety-protection system and its implementation based on internet and sensor door |
| CN107045678A (en) * | 2017-02-08 | 2017-08-15 | 陈东 | Automatic batch quickly matches somebody with somebody goods system and method |
| CN107067675A (en) * | 2017-06-06 | 2017-08-18 | 深圳正品创想科技有限公司 | A kind of alarm method and device based on cabinet door of selling goods |
Non-Patent Citations (1)
| Title |
|---|
| 吕显朋 等: "基于物联网的智能家居系统设计", 《电视技术》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112187592A (en) * | 2020-09-23 | 2021-01-05 | 江西玉祥智能装备制造有限公司 | Management system of electrical appliance |
| CN113302564A (en) * | 2021-02-10 | 2021-08-24 | 朱保东 | Composition and method for realizing whole-house intelligent home system |
| WO2022170555A1 (en) * | 2021-02-10 | 2022-08-18 | 朱保东 | Composition of home system for realizing whole house intelligence, and method for realizing whole house intelligence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10992491B2 (en) | Smart home automation systems and methods | |
| CN103712410A (en) | Electric product | |
| US20070208736A1 (en) | Search article estimation apparatus and method and server for search article estimation apparatus | |
| CN105841436B (en) | The food control method and food management system of intelligent refrigerator | |
| CN108257320A (en) | Picking method and marketing system based on warehousing cabinet | |
| CN111176124A (en) | System and method for realizing household intelligence | |
| WO2019029442A1 (en) | Item storage method for shared refrigerator, and shared refrigerator | |
| KR20210134092A (en) | How to manage refrigerators and items in refrigerators | |
| CN104949465A (en) | Refrigerator with face recognition function and article storing and taking method | |
| US20200149797A1 (en) | Food management system | |
| CN105823778A (en) | Article identification method, and apparatus and system thereof | |
| US20120320215A1 (en) | Method of Creating a Room Occupancy System by Executing Computer-Executable Instructions Stored on a Non-Transitory Computer-Readable Medium | |
| CN112784664A (en) | Semantic map construction and operation method, autonomous mobile device and storage medium | |
| KR102017980B1 (en) | Refrigerator with displaying image by identifying goods using artificial intelligence and method of displaying thereof | |
| CN107305350A (en) | The control method and its intelligent domestic system of intelligent domestic system | |
| CN210154156U (en) | Refrigerator and refrigerator system | |
| JP2023138720A (en) | refrigerator | |
| US20210089769A1 (en) | Refrigerator appliances and methods for tracking stored items | |
| KR101812524B1 (en) | Crouding management system of controlling home appliance and driving method thereof for refrigerator having artificial intelligence | |
| JP2019184167A (en) | Household electrical appliance, refrigerator | |
| CN114562845B (en) | Control method of refrigeration and freezing equipment and refrigeration and freezing equipment | |
| CN108626959A (en) | Approaches to IM, system, intelligent refrigerated equipment and intelligent domestic system | |
| CN109997006A (en) | Domestic system and method for running domestic system | |
| JP2012236716A (en) | Existence/location information management system | |
| CN111724542A (en) | Self-service goods taking system of grid cabinet and using method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200519 |
|
| RJ01 | Rejection of invention patent application after publication |