CN114415528A - Intelligent household equipment reminding method and device, computer equipment and storage medium - Google Patents
Intelligent household equipment reminding method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN114415528A CN114415528A CN202111490994.6A CN202111490994A CN114415528A CN 114415528 A CN114415528 A CN 114415528A CN 202111490994 A CN202111490994 A CN 202111490994A CN 114415528 A CN114415528 A CN 114415528A
- Authority
- CN
- China
- Prior art keywords
- face
- reminding
- face data
- analysis result
- family member
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 82
- 230000001815 facial effect Effects 0.000 claims abstract description 23
- 230000002996 emotional effect Effects 0.000 claims abstract description 21
- 230000004044 response Effects 0.000 claims description 21
- 238000004590 computer program Methods 0.000 claims description 15
- 230000008451 emotion Effects 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims description 8
- 235000005911 diet Nutrition 0.000 claims description 5
- 238000012790 confirmation Methods 0.000 claims description 4
- 230000037213 diet Effects 0.000 claims description 4
- 230000036555 skin type Effects 0.000 claims description 4
- 230000002159 abnormal effect Effects 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 abstract description 9
- 238000005516 engineering process Methods 0.000 abstract description 5
- 230000008901 benefit Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000014509 gene expression Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 2
- 210000001508 eye Anatomy 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 210000000697 sensory organ Anatomy 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 208000002874 Acne Vulgaris Diseases 0.000 description 1
- 208000006981 Skin Abnormalities Diseases 0.000 description 1
- 206010000496 acne Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000000378 dietary effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 239000011148 porous material Substances 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 235000021259 spicy food Nutrition 0.000 description 1
- 230000037303 wrinkles Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Alarm Systems (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention discloses a method and a device for reminding intelligent household equipment, computer equipment and a storage medium, wherein the intelligent household equipment is provided with a camera device, and the method comprises the following steps: the intelligent household equipment acquires the face data of the personnel passing through the intelligent household equipment through a camera device of the intelligent household equipment; performing face analysis on the face data to obtain a face analysis result, wherein the face analysis result at least comprises an emotional state; and performing corresponding reminding based on the face analysis result. By applying the reminding method and device for the intelligent home equipment, the computer equipment and the storage medium, disclosed by the invention, through the organic combination of the camera device and the intelligent home, not only can the traditional monitoring equipment be replaced to carry out real-time monitoring on the home environment and save the economic cost, but also the facial condition of the owner can be analyzed through some mature face recognition technologies, and the reminding is sent to the corresponding family members, so that the intelligent home equipment can provide comfortable and convenient service for the user more like a manager.
Description
Technical Field
The invention relates to the technical field of intelligent home, in particular to an intelligent home equipment reminding method and device, computer equipment and a storage medium.
Background
With the development of science and technology, intelligent camera devices become indispensable equipment for people to record daily life, and people's interests, hobbies, professional specialties and the like can be obtained by analyzing pictures recorded by the camera devices; in addition, facial feature analysis can be performed on the face in the photo to obtain expression data, facial data and the like. Conceivably, if the intelligent camera device is embedded into intelligent household equipment (such as an intelligent refrigerator, an intelligent air conditioner and the like), the intelligent camera device can replace the traditional monitoring equipment, can also analyze the facial features of the photographed person, and can further send corresponding reminding to the owner. Therefore, the camera device and the intelligent household equipment are skillfully combined to wipe unusual sparks.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: the intelligent household equipment reminding scheme is characterized in that facial feature analysis is carried out by using a camera device of the intelligent household equipment, and corresponding reminding is sent to a user, so that the traditional monitoring equipment is replaced.
In order to solve the technical problem, the invention provides a method for reminding intelligent household equipment, wherein the intelligent household equipment is provided with a camera device, and the method comprises the following steps:
the intelligent household equipment acquires the face data of the personnel passing through the intelligent household equipment through a camera device of the intelligent household equipment; wherein the person comprises a family member and/or a stranger;
performing face analysis on the face data to obtain a face analysis result, wherein the face analysis result at least comprises an emotional state;
and performing corresponding reminding based on the face analysis result.
Optionally, before performing the facial analysis on the face data, the method further includes:
judging whether the face data is matched with prestored face data in a preset face library or not;
and if the face data is matched with the face data, the person is a family member, and the step of performing face analysis on the face data to obtain a face analysis result is executed.
Optionally, when the person is a family member, the performing a corresponding reminder based on the facial analysis result includes:
and in response to the face analysis result that the emotion state is painful, sending reminding information to a reserved contact and/or making an emergency call to remind the reserved contact to rescue family members corresponding to the face data and/or seek rescue by making the emergency call.
Optionally, when the response to the face analysis result includes that the emotional state is painful, further comprising:
sending reminding information to the family members corresponding to the face data to inquire whether the family members need help or not;
and if the family member feeds back the information needing rescue, executing the step of sending reminding information to the reserved contact and/or dialing the emergency call.
Optionally, when the person is a family member, the reminding based on the facial analysis result includes:
and when the face analysis result includes that the emotion state is the casualty, reminding family members corresponding to the face data to perform emotion management in a short message sending mode.
Optionally, the facial analysis result further includes skin-type information;
when the person is a family member, the corresponding reminding based on the face analysis result comprises:
and when the face analysis result comprises abnormal skin, reminding the family member corresponding to the face data of diet cautionary matters and/or providing hospitalizing information.
Optionally, the smart home devices include a smart home device located at a doorway;
the performing corresponding reminding based on the face analysis result comprises:
and detecting whether the family member corresponding to the face data wears the mask or not, and reminding the family member to wear the mask when the detection result is that the mask is not worn.
Optionally, the method further comprises:
and responding to the fact that the face data are not matched with the pre-stored face data in the preset face library, and sending stranger reminding to family members and/or reserved contacts if the person is a stranger.
Optionally, the method further comprises:
and responding to the family member confirmation information sent by any family member based on the stranger prompt, and adding the face data of the stranger to the preset face library to serve as the face data of the family member prestored in the preset face library.
In order to solve the technical problem, the invention provides an intelligent household equipment reminding device, which comprises:
the intelligent home equipment comprises a face data acquisition module, a face data acquisition module and a control module, wherein the face data acquisition module is used for acquiring face data of personnel passing through the intelligent home equipment by the intelligent home equipment through a camera device of the intelligent home equipment; wherein the person comprises a family member and/or a stranger;
the face analysis module is used for carrying out face analysis on the face data to obtain a face analysis result, wherein the face analysis result at least comprises an emotional state;
and the reminding module is used for carrying out corresponding reminding based on the face analysis result.
Optionally, the system further comprises a face matching module, configured to determine whether the face data matches pre-stored face data in a preset face library before performing face analysis on the face data; and if the face data is matched with the face data, the person is a family member, and the face analysis module is triggered to perform face analysis on the face data to obtain a face analysis result.
Optionally, when the person is a family member, the prompting module is configured to send a prompting message and/or make an emergency call to a reserved contact in response to that the facial analysis result includes that the emotional state is painful, so as to prompt the reserved contact to rescue the family member corresponding to the face data and/or seek rescue by making an emergency call.
Optionally, the prompting module is further configured to send prompting information to a family member corresponding to the face data to inquire whether the family member needs to be rescued or not in response to that the face analysis result includes that the emotional state is painful; and if the family member feeds back the information needing rescue, sending reminding information to the reserved contact person and/or dialing an emergency call.
Optionally, when the person is a family member, the reminding module is configured to, in response to that the face analysis result includes that the emotional state is an impaired state, remind the family member corresponding to the face data to perform emotion management in a manner of sending a short message.
Optionally, the facial analysis result further includes skin-type information;
and when the person is a family member, the reminding module is used for reminding the family member corresponding to the face data to pay attention to diet and/or provide medical information in response to the fact that the face analysis result comprises skin anomaly.
Optionally, the position of the smart home device includes a doorway;
and the reminding module is used for detecting whether the family member corresponding to the face data wears the mask or not and reminding the family member to wear the mask when the detection result is that the mask is not worn.
Optionally, the face matching module is further configured to respond to that the face data is not matched with pre-stored face data in a preset face library, and the person is a stranger and sends stranger reminding to family members and/or reserved contacts.
Optionally, the system further comprises a face database updating module, configured to add, in response to a family member confirmation message sent by any family member based on the stranger prompt, the face data of the stranger to the preset face database, where the face data is used as the face data of the family member prestored in the preset face database.
In order to solve the technical problem, the invention provides an intelligent home device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the computer program to realize the method.
To solve the above technical problem, the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the above method.
Compared with the prior art, one or more embodiments in the above scheme can have the following advantages or beneficial effects:
by applying the reminding method and device for the intelligent home equipment, the computer equipment and the storage medium, disclosed by the invention, through the organic combination of the camera device and the intelligent home, not only can the traditional monitoring equipment be replaced to carry out real-time monitoring on the home environment and save the economic cost, but also the facial condition of the owner can be analyzed through some mature face recognition technologies, and the reminding is sent to the corresponding family members, so that the intelligent home equipment can provide comfortable and convenient service for the user more like a manager.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a first flowchart of a reminding method for smart home devices according to an embodiment of the present invention;
fig. 2 is a second flowchart of a reminding method for smart home devices according to an embodiment of the present invention;
fig. 3 is a third flowchart of a reminding method of smart home devices according to an embodiment of the present invention;
fig. 4 is a fourth flowchart of a reminding method of smart home devices according to an embodiment of the present invention;
fig. 5 is a fifth flowchart of a reminding method for smart home devices according to an embodiment of the present invention;
fig. 6 is a structural diagram of an intelligent home device reminding apparatus according to an embodiment of the present invention;
fig. 7 is another structural diagram of the reminding device of the smart home equipment according to the embodiment of the invention;
fig. 8 is another structural diagram of the reminding apparatus of smart home devices according to the embodiment of the present invention;
fig. 9 is a block diagram of a computer device provided by the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides a method and a device for reminding intelligent household equipment, computer equipment and a storage medium, wherein the method and the device are used for carrying out facial feature analysis by utilizing a camera device of the intelligent household equipment and sending corresponding reminding to a user so as to replace the traditional monitoring equipment.
The following describes a method for reminding the smart home device provided by the embodiment of the invention.
Example one
As shown in fig. 1, a first flowchart of a method for reminding a smart home device provided by the present invention is shown, where the smart home device has a camera apparatus, and the method may include the following steps:
step S101: the method comprises the steps that the intelligent household equipment obtains face data of people passing through the intelligent household equipment through a camera device of the intelligent household equipment; wherein the person comprises a family member and/or a stranger.
Step S102: and performing face analysis on the face data to obtain a face analysis result, wherein the face analysis result at least comprises an emotional state.
Specifically, when face data is subjected to face analysis, 128-dimensional face codes of a face can be obtained by using a Github open source project face _ registration, key point information of the face, including eyes, a nose, a mouth, a chin and the like, is identified by calling a face _ landworks () method, the obtained face codes are in a matrix form, and the face codes are converted into a character string form and stored in a database to serve as the basis for matching of subsequent face data. Furthermore, based on the geometric features of the face, that is, the position relationship between facial organs, such as eyes, nose, mouth, and the like, spatial geometric information such as the size, position, mutual ratio between five sense organs, and the like of the five sense organs can be obtained to identify the emotion of the face, the ratio parameters are designed according to actual conditions, and when a set threshold is reached, the ratio parameters are judged to be corresponding expressions.
Step S103: and performing corresponding reminding based on the face analysis result.
In one case, when the person is a family member, in response to the face analysis result including that the emotional state is painful, sending a reminding message to a reserved contact and/or making an emergency call to remind the reserved contact to rescue the family member corresponding to the face data and/or to seek rescue by making an emergency call.
In another case, when the face analysis result includes that the emotional state is painful, the method further includes: sending reminding information to the family members corresponding to the face data to inquire whether the family members need help or not; and if the family member feeds back the information needing rescue, executing the step of sending reminding information to the reserved contact and/or dialing the emergency call.
In practical application, the smart home devices may include, but are not limited to, smart home devices having a camera device, such as a smart refrigerator and a smart air conditioner, and the smart home devices may automatically recognize face data of people in a nearby range, upload the face data to a certain server, obtain a face analysis result through server analysis, and send a corresponding prompt to a family member. For example, the owner makes a very painful expression, and after capturing the expression, the intelligent home device analyzes the expression to obtain that the owner is painful, so that the intelligent home device can send reminding information to the reserved contact person, can directly make an emergency call, and can send the reminding information to the reserved contact person and make an emergency call at the same time; in addition, the smart home device may also ask the owner whether the owner needs to contact relatives or obtain help from the hospital. It should be noted that the face data stored in the server can be stored in other intelligent home environments in a data synchronization manner, so that the same housekeeper experience effect as that of the current intelligent home environment can be obtained.
In one case, when the person is a family member, in response to that the face analysis result includes that the emotional state is casualty, the family member corresponding to the face data is reminded to perform emotion management in a short message sending mode.
By organically combining the camera device and the smart home, the method for reminding the smart home equipment can replace the traditional monitoring equipment to monitor the home environment in real time, save the economic cost, analyze the face condition of the owner through some mature face recognition technologies, and remind the corresponding family members, so that the smart home equipment can provide comfortable and convenient service for users more like a manager.
Example two
As shown in fig. 2, a second flowchart of the reminding method for smart home devices provided by the present invention is shown, where the smart home devices have a camera apparatus, and the method may include the following steps:
step S201: the intelligent household equipment acquires the face data of the personnel passing through the intelligent household equipment through a camera device of the intelligent household equipment; wherein the person comprises a family member and/or a stranger.
Step S202: judging whether the face data is matched with prestored face data in a preset face library or not; if so, go to step S203.
In one implementation, a face image file to be recorded may be prepared (corresponding to face data pre-stored in a preset face library), and the face codes of the faces in each image file are obtained by using the aforementioned face _ encodings () method of the face _ registration face recognition library, where the method returns a coding list, and thus the coding list needs to be converted into a character string form to be stored in the database.
Step S203: the person is a family member.
Step S204: and performing face analysis on the face data to obtain a face analysis result, wherein the face analysis result at least comprises an emotional state.
Step S205: and performing corresponding reminding based on the face analysis result.
It should be noted that the method embodiment shown in fig. 2 has all the benefits of the method embodiment shown in fig. 1, in addition, before performing face analysis, the method embodiment shown in fig. 2 determines whether the detected face data is a pre-stored face database, and this step is mainly used to detect whether a person is a family member, and is helpful to specifically provide corresponding reminders of the smart home devices for the family members.
EXAMPLE III
As shown in fig. 3, a third flowchart of a method for reminding a smart home device according to an embodiment of the present invention is shown, where the smart home device has a camera apparatus, and the method may include the following steps:
step S301: the intelligent household equipment acquires the face data of the personnel passing through the intelligent household equipment through a camera device of the intelligent household equipment; wherein the person comprises a family member and/or a stranger.
Step S302: judging whether the face data is matched with prestored face data in a preset face library or not; if so, go to step S306.
It should be noted that steps S303 to S305 in the method embodiment shown in fig. 3 are similar to steps S203 to S205 in the method embodiment shown in fig. 2, and are not repeated here.
Step S306: the person is a stranger.
Step S307: stranger reminders are sent to family members and/or reserved contacts.
Further, in response to the fact that any family member confirms information sent by the stranger based on the stranger prompt, the face data of the stranger is added into the preset face library and serves as the face data of the family member prestored in the preset face library.
It should be noted that the method embodiment shown in fig. 3 has all the advantages of the method embodiment shown in fig. 2, in addition, before performing face analysis, the method embodiment shown in fig. 3 determines whether the detected face data is a pre-stored face database, and this step is mainly used to detect whether a person is a family member, and when the face data is not matched with the pre-stored face data in the pre-stored face database, it indicates that the person is a stranger, and sends a stranger reminder to the family member and/or the reserved contact person, so as to provide a housekeeping reminder service for the user.
Example four
As shown in fig. 4, a fourth flowchart of a method for reminding a smart home device according to an embodiment of the present invention is shown, where the smart home device has a camera apparatus, and the method may include the following steps:
step S401: the intelligent household equipment acquires the face data of the personnel passing through the intelligent household equipment through a camera device of the intelligent household equipment; wherein the person comprises a family member and/or a stranger.
Step S402: and performing face analysis on the face data to obtain a face analysis result, wherein the face analysis result at least comprises emotional state and skin information.
Specifically, a skin index evaluation algorithm is adopted for skin analysis, and pore detection is realized by a dynamic threshold segmentation method based on an Otsu algorithm; wrinkle and roughness detection is realized based on Tamura classical theory and Fourier transform; and separating skin oil light extraction characteristics by using an index mode of the image to establish a model so as to realize color spot and skin color index evaluation and the like. It should be noted that the present invention is not limited to a specific way of detecting the skin information, and those skilled in the art can set the method according to the specific situation in the practical application.
Step S403: and when the face analysis result comprises abnormal skin, reminding the family member corresponding to the face data of diet cautionary matters and/or providing hospitalizing information.
For example, after the intelligent home device analyzes the face data, the intelligent home device finds that acne appears on the face of the owner, can remind the owner of eating less spicy food, doing more sports or suggesting the owner to seek medical advice recently, and can provide hospital recommendation information and registration service for the owner and housekeeping service for the user.
It should be noted that the method embodiment shown in fig. 4 has all the advantages of the method embodiment shown in fig. 1, and in addition, the method embodiment shown in fig. 4 can also perform skin condition information reminding on the user, so as to improve the user experience of the user.
EXAMPLE five
As shown in fig. 5, a fifth flowchart of a method for reminding a smart home device according to the present invention is shown, where the smart home device has a camera apparatus, and the smart home device includes a smart home device located at a doorway, and the method may include the following steps:
step S501: the intelligent household equipment acquires the face data of the personnel passing through the intelligent household equipment through a camera device of the intelligent household equipment; wherein the person comprises a family member and/or a stranger.
Step S502: and performing face analysis on the face data to obtain a face analysis result, wherein the face analysis result at least comprises an emotional state.
Step S503: and detecting whether the family member corresponding to the face data wears the mask or not, and reminding the family member to wear the mask when the detection result is that the mask is not worn.
In addition to the full advantages of the method embodiment shown in fig. 1, the method embodiment shown in fig. 5 can also remind the user of going out, for example, remind the user of going out to wear a mask, thereby improving the user experience.
The following describes an intelligent home device reminding device provided by the embodiment of the invention.
EXAMPLE six
As shown in fig. 6, a structure diagram of an intelligent household device reminding apparatus provided in an embodiment of the present invention includes:
a face data obtaining module 610, configured to obtain, by the smart home device through a camera device of the smart home device, face data of a person passing through the smart home device; wherein the person comprises a family member and/or a stranger;
a face analysis module 620, configured to perform face analysis on the face data to obtain a face analysis result, where the face analysis result at least includes an emotional state;
a reminding module 630, configured to perform corresponding reminding based on the facial analysis result.
In one case, as shown in fig. 7, the system further includes a face matching module 640, configured to determine whether the face data matches pre-stored face data in a pre-set face database before performing face analysis on the face data; if the face data is matched with the face data, the person is a family member, and the face analysis module 620 is triggered to perform face analysis on the face data to obtain a face analysis result.
In another case, the face matching module 640 is further configured to respond that the face data is not matched with pre-stored face data in a preset face library, and the person is a stranger and sends a stranger reminder to family members and/or reserved contacts.
In one case, when the person is a family member, the reminding module 630 is configured to send a reminding message and/or make an emergency call to a reserved contact in response to that the facial analysis result includes that the emotional state is painful, so as to remind the reserved contact to rescue the family member corresponding to the face data and/or seek rescue by making an emergency call.
In another case, the reminding module 630 is further configured to send reminding information to the family member corresponding to the face data to inquire whether the family member needs to be rescued or not in response to that the face analysis result includes that the emotional state is painful; and if the family member feeds back the information needing rescue, sending reminding information to the reserved contact person and/or dialing an emergency call.
In another case, when the person is a family member, the reminding module 630 is configured to, in response to that the face analysis result includes that the emotional state is a casualty, remind the family member corresponding to the face data to perform emotion management in a manner of sending a short message.
In one implementation, the facial analysis results further include skin type information; when the person is a family member, the reminding module 630 is configured to, in response to that the facial analysis result includes skin abnormality, remind the family member of dietary cautionary matters corresponding to the face data and/or provide medical information.
In another implementation manner, the smart home devices include a smart home device located at a doorway; and the reminding module 630 is used for detecting whether the family member corresponding to the face data wears the mask or not, and reminding the family member to wear the mask when the detection result indicates that the mask is not worn.
In one case, as shown in fig. 8, the system further includes a face database updating module 650, configured to add, in response to the family member confirmation information sent by any family member based on the stranger reminder, the face data of the stranger to the preset face database, where the face data is taken as the face data of the family member pre-stored in the preset face database.
By organically combining the camera device and the smart home, the intelligent home equipment reminding device can replace the traditional monitoring equipment to monitor the home environment in real time, save the economic cost, analyze the face condition of the owner through some mature face recognition technologies, and remind the corresponding family members, so that the intelligent home equipment can provide comfortable and convenient service for users more like a manager.
Practice ofExample seven
In order to solve the technical problem, the present invention provides an intelligent home device, as shown in fig. 9, including a memory 710, a processor 720, and a computer program stored in the memory and capable of running on the processor, where the processor executes the computer program to implement the method described above, and the intelligent home device further includes a camera device 730 connected to the processor and configured to obtain face data of a person passing through the intelligent home device.
The computer device can be a desktop computer, a notebook, a palm computer, a cloud server and other computing devices. The computer device may include, but is not limited to, a processor 720, a memory 710. Those skilled in the art will appreciate that fig. 9 is merely an example of a computing device and is not intended to be limiting and may include more or fewer components than those shown, or some of the components may be combined, or different components, e.g., the computing device may also include input output devices, network access devices, buses, etc.
The Processor 720 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The storage 710 may be an internal storage unit of the computer device, such as a hard disk or a memory of the computer device. The memory 710 may also be an external storage device of a computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), etc. provided on the computer device. Further, the memory 710 may also include both internal storage units and external storage devices of the computer device. The memory 710 is used for storing the computer program and other programs and data required by the computer device. The memory 710 may also be used to temporarily store data that has been output or is to be output.
Example eight
The embodiment of the present application further provides a computer-readable storage medium, which may be a computer-readable storage medium contained in the memory in the foregoing embodiment; or it may be a computer-readable storage medium that exists separately and is not incorporated into a computer device. The computer-readable storage medium stores one or more computer programs which, when executed by a processor, implement the methods described above.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method of the embodiments described above can be realized by a computer program, which can be stored in a computer-readable storage medium and can realize the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory 710, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
For system or apparatus embodiments, since they are substantially similar to method embodiments, they are described in relative simplicity, and reference may be made to some descriptions of method embodiments for related points.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
It is to be understood that the terminology used in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to a determination" or "in response to a detection". Similarly, the phrase "if it is determined" or "if a described condition or event is detected" may be interpreted, depending on the context, to mean "upon determining" or "in response to determining" or "upon detecting a described condition or event" or "in response to detecting a described condition or event".
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (12)
1. The intelligent household equipment reminding method is characterized in that the intelligent household equipment is provided with a camera device, and the method comprises the following steps:
the intelligent household equipment acquires the face data of the personnel passing through the intelligent household equipment through a camera device of the intelligent household equipment; wherein the person comprises a family member and/or a stranger;
performing face analysis on the face data to obtain a face analysis result, wherein the face analysis result at least comprises an emotional state;
and performing corresponding reminding based on the face analysis result.
2. The intelligent home device reminding method according to claim 1, wherein before the facial analysis of the face data, the method further comprises:
judging whether the face data is matched with prestored face data in a preset face library or not;
and if the face data is matched with the face data, the person is a family member, and the step of performing face analysis on the face data to obtain a face analysis result is executed.
3. The intelligent home device reminding method according to claim 2, wherein when the person is a family member, the corresponding reminding based on the facial analysis result comprises:
and in response to the face analysis result that the emotion state is painful, sending reminding information to a reserved contact and/or making an emergency call to remind the reserved contact to rescue family members corresponding to the face data and/or seek rescue by making the emergency call.
4. The smart home device reminding method according to claim 3, wherein when the response to the facial analysis result includes that the emotional state is painful, the method further comprises:
sending reminding information to the family members corresponding to the face data to inquire whether the family members need help or not;
and if the family member feeds back the information needing rescue, executing the step of sending reminding information to the reserved contact and/or dialing the emergency call.
5. The intelligent home device reminding method according to claim 2, wherein when the person is a family member, the reminding based on the facial analysis result comprises:
and when the face analysis result includes that the emotion state is the casualty, reminding family members corresponding to the face data to perform emotion management in a short message sending mode.
6. The intelligent home device reminding method according to claim 2, wherein the facial analysis result further includes skin type information;
when the person is a family member, the corresponding reminding based on the face analysis result comprises:
and when the face analysis result comprises abnormal skin, reminding the family member corresponding to the face data of diet cautionary matters and/or providing hospitalizing information.
7. The intelligent home device reminding method according to claim 2, wherein when the person is a family member, the intelligent home device comprises an intelligent home device located at a doorway;
the performing corresponding reminding based on the face analysis result comprises:
and detecting whether the family member corresponding to the face data wears the mask or not, and reminding the family member to wear the mask when the detection result is that the mask is not worn.
8. The intelligent household equipment reminding method according to claim 2, further comprising:
and responding to the fact that the face data are not matched with the pre-stored face data in the preset face library, and sending stranger reminding to family members and/or reserved contacts if the person is a stranger.
9. The intelligent household equipment reminding method according to claim 8, further comprising:
and responding to the family member confirmation information sent by any family member based on the stranger prompt, and adding the face data of the stranger to the preset face library to serve as the face data of the family member prestored in the preset face library.
10. The utility model provides an intelligent household equipment reminding device which characterized in that includes:
the intelligent home equipment comprises a face data acquisition module, a face data acquisition module and a control module, wherein the face data acquisition module is used for acquiring face data of personnel passing through the intelligent home equipment by the intelligent home equipment through a camera device of the intelligent home equipment; wherein the person comprises a family member and/or a stranger;
the face analysis module is used for carrying out face analysis on the face data to obtain a face analysis result, wherein the face analysis result at least comprises an emotional state;
and the reminding module is used for carrying out corresponding reminding based on the face analysis result.
11. An intelligent household device, comprising a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor implements the method according to any one of claims 1 to 9 when executing the computer program, and the intelligent household device further comprises a camera device connected with the processor and configured to obtain face data of a person passing through the intelligent household device.
12. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, carries out the method according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111490994.6A CN114415528A (en) | 2021-12-08 | 2021-12-08 | Intelligent household equipment reminding method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111490994.6A CN114415528A (en) | 2021-12-08 | 2021-12-08 | Intelligent household equipment reminding method and device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114415528A true CN114415528A (en) | 2022-04-29 |
Family
ID=81265869
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111490994.6A Pending CN114415528A (en) | 2021-12-08 | 2021-12-08 | Intelligent household equipment reminding method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114415528A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102929660A (en) * | 2012-10-09 | 2013-02-13 | 广东欧珀移动通信有限公司 | Control method of mood theme of terminal device and terminal device |
| CN104994335A (en) * | 2015-06-11 | 2015-10-21 | 广东欧珀移动通信有限公司 | Alarm method and terminal |
| CN106361356A (en) * | 2016-08-24 | 2017-02-01 | 北京光年无限科技有限公司 | Emotion monitoring and early warning method and system |
| CN108734096A (en) * | 2018-04-11 | 2018-11-02 | 北京搜狗科技发展有限公司 | A kind of data processing method, device and the device for data processing |
| CN111523380A (en) * | 2020-03-11 | 2020-08-11 | 浙江工业大学 | Mask wearing condition monitoring method based on face and posture recognition |
| CN112364696A (en) * | 2020-10-13 | 2021-02-12 | 特斯联科技集团有限公司 | Method and system for improving family safety by using family monitoring video |
| CN112818899A (en) * | 2021-02-22 | 2021-05-18 | 招联消费金融有限公司 | Face image processing method and device, computer equipment and storage medium |
| CN113096808A (en) * | 2021-04-23 | 2021-07-09 | 深圳壹账通智能科技有限公司 | Event prompting method and device, computer equipment and storage medium |
| CN113241199A (en) * | 2021-06-17 | 2021-08-10 | 立信(重庆)数据科技股份有限公司 | Smart home old-age-care health management system |
| CN113486730A (en) * | 2021-06-17 | 2021-10-08 | 深圳市修远文化创意有限公司 | Intelligent reminding method based on face recognition and related device |
-
2021
- 2021-12-08 CN CN202111490994.6A patent/CN114415528A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102929660A (en) * | 2012-10-09 | 2013-02-13 | 广东欧珀移动通信有限公司 | Control method of mood theme of terminal device and terminal device |
| CN104994335A (en) * | 2015-06-11 | 2015-10-21 | 广东欧珀移动通信有限公司 | Alarm method and terminal |
| CN106361356A (en) * | 2016-08-24 | 2017-02-01 | 北京光年无限科技有限公司 | Emotion monitoring and early warning method and system |
| CN108734096A (en) * | 2018-04-11 | 2018-11-02 | 北京搜狗科技发展有限公司 | A kind of data processing method, device and the device for data processing |
| CN111523380A (en) * | 2020-03-11 | 2020-08-11 | 浙江工业大学 | Mask wearing condition monitoring method based on face and posture recognition |
| CN112364696A (en) * | 2020-10-13 | 2021-02-12 | 特斯联科技集团有限公司 | Method and system for improving family safety by using family monitoring video |
| CN112818899A (en) * | 2021-02-22 | 2021-05-18 | 招联消费金融有限公司 | Face image processing method and device, computer equipment and storage medium |
| CN113096808A (en) * | 2021-04-23 | 2021-07-09 | 深圳壹账通智能科技有限公司 | Event prompting method and device, computer equipment and storage medium |
| CN113241199A (en) * | 2021-06-17 | 2021-08-10 | 立信(重庆)数据科技股份有限公司 | Smart home old-age-care health management system |
| CN113486730A (en) * | 2021-06-17 | 2021-10-08 | 深圳市修远文化创意有限公司 | Intelligent reminding method based on face recognition and related device |
Non-Patent Citations (2)
| Title |
|---|
| 钱雯等: "基于人工智能和大数据分析的4G报警系统", 《电脑知识与技术》, vol. 16, no. 26, 30 September 2020 (2020-09-30), pages 182 - 184 * |
| 魏荣耀: "工业监控中人员面部识别与行为预警系统", 《中国优秀硕士学位论文全文数据库信息科技辑》, no. 5, 15 May 2021 (2021-05-15), pages 138 - 1253 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111899878B (en) | Old person health detection system, method, computer device and readable storage medium | |
| Kim et al. | Emergency situation monitoring service using context motion tracking of chronic disease patients | |
| Hassan et al. | Automatic detection of pain from facial expressions: a survey | |
| Thiyaneswaran et al. | Early detection of melanoma images using gray level co‐occurrence matrix features and machine learning techniques for effective clinical diagnosis | |
| CN111241883B (en) | Method and device for preventing cheating of remote tested personnel | |
| CN111814646B (en) | AI vision-based monitoring method, device, equipment and medium | |
| US11589803B2 (en) | Methods and systems for improving human facial skin conditions by leveraging vehicle cameras and skin data AI analytics | |
| TW202115622A (en) | Face attribute recognition method, electronic device and computer-readable storage medium | |
| CN111967311B (en) | Emotion recognition method and device, computer equipment and storage medium | |
| CN112819548A (en) | User portrait generation method and device, readable storage medium and electronic equipment | |
| KR20200052175A (en) | An apparatus for managing user health and method thereof | |
| Huang et al. | Artificial intelligence‐based intelligent surveillance for reducing nurses' working hours in nurse–patient interaction: a two‐wave study | |
| Yfantidou et al. | Beyond accuracy: a critical review of fairness in machine learning for mobile and wearable computing | |
| US20210406698A1 (en) | Identifying anomalous activity from thermal images | |
| US20230386255A1 (en) | Method and system for verifying image identification | |
| CN114415528A (en) | Intelligent household equipment reminding method and device, computer equipment and storage medium | |
| WO2019227374A1 (en) | Alarm method, apparatus and system, and electronic device | |
| US20230187064A1 (en) | Methods and systems for comprehensive patient screening | |
| US20230005574A1 (en) | Methods and systems for comprehensive symptom analysis | |
| KR102351169B1 (en) | Big data and AI-based color recognition measurement platform and method using the same | |
| CN113486730A (en) | Intelligent reminding method based on face recognition and related device | |
| Sharara et al. | Prediction of the VDT Worker's Headache Using Convolutional Neural Network with Class Activation Mapping | |
| Vargiu et al. | Experimenting quality of life telemonitoring in a real scenario. | |
| JP5210808B2 (en) | Age estimation apparatus and method | |
| JP7183232B2 (en) | Physical condition evaluation system, server, program and method of providing physical condition evaluation service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |