CN112541398A - Method, device, processor and water heater for identifying user based on gait - Google Patents
Method, device, processor and water heater for identifying user based on gait Download PDFInfo
- Publication number
- CN112541398A CN112541398A CN202011287545.7A CN202011287545A CN112541398A CN 112541398 A CN112541398 A CN 112541398A CN 202011287545 A CN202011287545 A CN 202011287545A CN 112541398 A CN112541398 A CN 112541398A
- Authority
- CN
- China
- Prior art keywords
- user
- point cloud
- water heater
- radar
- identity information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 title claims abstract description 96
- 230000005021 gait Effects 0.000 title claims abstract description 72
- 238000000034 method Methods 0.000 title claims abstract description 66
- 238000003860 storage Methods 0.000 claims abstract description 16
- 230000001133 acceleration Effects 0.000 claims description 17
- 239000007921 spray Substances 0.000 claims description 15
- 238000012790 confirmation Methods 0.000 claims description 11
- 230000001131 transforming effect Effects 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 9
- 210000000689 upper leg Anatomy 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 8
- 238000001228 spectrum Methods 0.000 claims description 7
- 230000000875 corresponding effect Effects 0.000 description 30
- 238000010586 diagram Methods 0.000 description 17
- 238000004590 computer program Methods 0.000 description 11
- 238000003287 bathing Methods 0.000 description 7
- 238000013527 convolutional neural network Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 238000000605 extraction Methods 0.000 description 4
- 230000036544 posture Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000010438 heat treatment Methods 0.000 description 3
- 238000005507 spraying Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000010453 quartz Substances 0.000 description 2
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N silicon dioxide Inorganic materials O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000000919 ceramic Substances 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000005485 electric heating Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000011229 interlayer Substances 0.000 description 1
- 239000010410 layer Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000003595 mist Substances 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 229920003023 plastic Polymers 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000009423 ventilation Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/23—Recognition of whole body movements, e.g. for sport training
- G06V40/25—Recognition of walking or running movements, e.g. gait recognition
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24H—FLUID HEATERS, e.g. WATER OR AIR HEATERS, HAVING HEAT-GENERATING MEANS, e.g. HEAT PUMPS, IN GENERAL
- F24H9/00—Details
- F24H9/20—Arrangement or mounting of control or safety devices
- F24H9/2007—Arrangement or mounting of control or safety devices for water heaters
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- Molecular Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Thermal Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Radar Systems Or Details Thereof (AREA)
Abstract
The embodiment of the invention provides a method, a device, a processor, a water heater and a storage medium for identifying a user based on gait. The method comprises the following steps: acquiring radar data associated with a user; stacking the radar data to obtain a corresponding radar point cloud picture; inputting the radar point cloud image into a gait recognition model to extract the part characteristics of the user in the radar point cloud image; the identity information of the user is determined according to the part characteristics, so that the identity of the user can be quickly and accurately identified in a bathroom scene under the condition that the privacy of the user is not involved.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method, a device, a processor and a water heater for identifying a user based on gait.
Background
With the development of computer technology, people have higher and higher requirements on intelligent household appliances. When a user enters a bathroom, it is a current problem to be studied to identify the user and adjust parameters related to the temperature of water in the bathroom.
However, due to the sensitivity of users to the privacy of the home environment, conventional cameras are not typically installed in bathrooms to avoid exposing the privacy of the users.
Disclosure of Invention
The embodiment of the invention aims to provide a method, a device, a processor, a water heater and a storage medium for identifying a user based on gait.
In order to achieve the above object, a first aspect of the present invention provides a method for identifying a user based on gait, including:
acquiring radar data associated with a user;
stacking the radar data to obtain a corresponding radar point cloud picture;
inputting the radar point cloud image into a gait recognition model to extract the part characteristics of the user in the radar point cloud image;
and determining the identity information of the user according to the part characteristics.
In the embodiment of the invention, the extracting of the part characteristics of the user in the radar point cloud picture comprises the following steps: extracting the speed of each part of the body of the user; the acceleration of each part is determined according to the speed of each part.
In an embodiment of the present invention, determining the identity information of the user according to the location characteristics includes: and determining the identity information of the user according to the speeds and accelerations of all parts.
In an embodiment of the present invention, the part includes at least one of a torso, an arm, and a thigh.
In an embodiment of the invention, the method further comprises: after the identity information of the user is determined according to the part characteristics, matching the identity information with the user information prestored in the database; acquiring user preferences associated with the identity information if the matching is successful; adjusting the state of the water heater according to user preferences.
In embodiments of the present invention, the user preferences include a preferred temperature; adjusting the state of the water heater according to the user preference includes: and adjusting the outlet water temperature of the water heater to the preference temperature.
In an embodiment of the invention, the user preference comprises a preference shower spray mode of the water heater, and adjusting the state of the water heater according to the user preference comprises adjusting the shower to the preference shower spray mode.
In an embodiment of the invention, the method further comprises: acquiring user preferences associated with the identity information if the matching is successful; acquiring a user name corresponding to the identity information; starting a voice question-answer according to the name of the user so as to inquire whether the user adjusts the state of the water heater according to the preference of the user; and after the confirmation information fed back by the user according to the voice question and answer is acquired, the state of the water heater is adjusted according to the preference of the user.
In an embodiment of the invention, the method further comprises: starting a stranger intrusion alarm mode under the condition of failed matching; and calling a preset communication number under the condition that the alarm release instruction is not acquired within the preset time.
In an embodiment of the invention, the method further comprises: starting a new user registration mode under the condition that an alarm release instruction is obtained within preset time; acquiring a user name input by a user; and recording the data of the water heater used by the user and storing the data in association with the user name.
In an embodiment of the invention, the method further comprises:
after stacking the radar data to obtain a corresponding radar point cloud picture, transforming the radar point cloud picture from a space domain picture to a frequency domain picture; analyzing an image frequency spectrum of the radar point cloud picture, and filtering a high-frequency signal of the radar point cloud picture; transforming the frequency domain graph into a spatial domain graph through Fourier transform; and inputting the radar point cloud image transformed into the airspace image into a gait recognition model.
A second aspect of the present invention provides a processor configured to perform the above-mentioned method of identifying a user based on gait.
A third aspect of the present invention provides a device for identifying a user based on gait, comprising:
a radar device to collect radar data associated with a user;
a processor.
The fourth aspect of the invention provides a water heater, which comprises the device for identifying the user based on the gait.
A fifth aspect of the invention provides a machine-readable storage medium having stored thereon instructions that, when executed by a processor, cause the processor to be configured to perform the method of identifying a user based on gait described above.
By the technical scheme, the radar data associated with the user can be acquired, the radar data are stacked to obtain the corresponding radar point cloud picture, the radar point cloud picture is input into the gait recognition model to extract the part characteristics of the user in the radar point cloud picture, and therefore the identity information of the user is determined according to the part characteristics, and the identity of the user can be rapidly and accurately recognized in the bathroom scene under the condition that the privacy of the user is not involved.
Additional features and advantages of embodiments of the invention will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the embodiments of the invention without limiting the embodiments of the invention. In the drawings:
FIG. 1 schematically illustrates a flow diagram of a method of identifying a user based on gait according to an embodiment of the invention;
FIG. 2 schematically illustrates a flow diagram of a method of identifying a user based on gait according to another embodiment of the invention;
FIG. 3 schematically shows a flow chart of further included steps according to an embodiment of the invention;
fig. 4 is a block diagram schematically illustrating a structure of an apparatus for recognizing a user based on gait according to an embodiment of the present invention;
fig. 5 is a block diagram schematically illustrating a structure of an apparatus for recognizing a user based on gait according to another embodiment of the present invention;
FIG. 6 schematically illustrates a block diagram of a water heater according to an embodiment of the present invention;
fig. 7 schematically shows an internal configuration diagram of a computer apparatus according to an embodiment of the present invention.
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating embodiments of the invention, are given by way of illustration and explanation only, not limitation.
Fig. 1 schematically shows a flow chart of a method for identifying a user based on gait according to an embodiment of the invention. As shown in fig. 1, in an embodiment of the present invention, a method for identifying a user based on gait is provided, which includes the following steps:
And step 102, stacking the radar data to obtain a corresponding radar point cloud picture.
And 103, inputting the radar point cloud image into a gait recognition model to extract the part characteristics of the user in the radar point cloud image.
And step 104, determining the identity information of the user according to the part characteristics.
The radar data can be acquired by a pre-installed radar device. The radar equipment can be millimeter wave radar equipment, and the method for identifying the user based on the gait can be used for determining the identity information of the user according to the gait information of the user in a bathroom, and the millimeter wave radar has strong capability of penetrating through barriers such as plastics, ceramics, glass and shower curtains and detecting at a long distance, can be well adapted to various spatial patterns, and therefore can accurately determine the identity information of the user. Millimeter wave radars are radars that operate in the millimeter wave band (millimeter wave) for detection. Usually, the millimeter wave is in the frequency domain of 30 to 300GHz (with a wavelength of 1 to 10 mm). Millimeter-wave radar has some of the advantages of both microwave and photoelectric radar because the wavelength of millimeter-wave waves is intermediate between microwave and centimeter waves.
The radar data associated with the user refers to radar data of the user collected by the radar device after the user enters the sensing range of the radar device. After the server acquires the radar data associated with the user, the radar data can be stacked to obtain a corresponding radar point cloud picture. That is, a corresponding radar point cloud plot may be formed from the coordinates of multiple radar data. After the radar point cloud picture is input into the gait recognition model, the identity information of the user can be determined through the gait recognition model. The gait recognition means identity recognition according to the walking posture of a person. The gait recognition essence is the distance matching of the gait characteristics, the characteristics of the person are extracted under the conditions of multiple angles and multiple walks, the individual-based gait characteristics are obtained, and the characteristics are compared with other individuals, so that the specific identity of the individual is recognized. In this embodiment, the motion information of the person is emphasized by a model-based method, so that a gait recognition model needs to be established in advance, and model parameters are obtained by matching the model with an image sequence and are used as gait features for classification. Wherein the gait recognition model can be a deep convolutional neural network. The convolutional neural network is a feedforward neural network which comprises convolutional calculation and has a deep structure, and is one of representative algorithms of deep learning. Convolutional neural networks have a characteristic learning ability, and can perform translation invariant classification on input information according to a hierarchical structure thereof, and are also called "translation invariant artificial neural networks". The convolutional neural network is constructed by imitating a visual perception mechanism of a living being, and can be used for supervised learning and unsupervised learning, and the parameter sharing of convolution kernels in hidden layers and the sparsity of interlayer connection enable the convolutional neural network to learn lattice characteristics such as pixels and audio with small calculation amount, have stable effect and have no additional characteristic engineering requirement on data. The gait feature extraction uses a deep convolutional neural network as a basic structure, uses a multi-task learning target, and randomly samples a large amount of time sequence gait data to perform model learning. The gait feature extraction method can be used for gait feature extraction in family environments and monitoring scenes, the features of different extracted individuals have good distinguishing performance, the features of the same individual have good cohesion, and the speed of the gait feature extraction method can reach the millisecond level.
Specifically, the features of each part of the user in the radar cloud image can be extracted through the gait recognition model, and the identity information of the user is determined according to the part features. The part includes at least one of a torso, an arm, and a thigh.
In one embodiment, extracting the part features of the user in the radar point cloud picture comprises: extracting the speed of each part of the body of the user; the acceleration of each part is determined according to the speed of each part.
Further, the gait recognition model can extract the speed of each part of the body of the user, and determine the acceleration of each part according to the speed of each part. Therefore, the speeds of the trunk, the arms and the thighs of the user can be extracted, so that the corresponding acceleration is determined according to the speeds, and the identity information of the user is determined according to the speeds and the accelerations of all parts.
In one embodiment, the method further comprises: after the identity information of the user is determined according to the part characteristics, matching the identity information with the user information prestored in the database; acquiring user preferences associated with the identity information if the matching is successful; adjusting the state of the water heater according to user preferences.
After the identity information of the user is determined, the identity information of the user can be matched with the user information prestored in the database. It is understood that the user information pre-stored in the database is pre-registered and stored information, which may include walking postures, running postures, standing postures, and the like, pre-entered by the user. Therefore, after the gait recognition model determines the identity information of the user, it can be confirmed whether the user has previously entered relevant user information, such as user preferences and the like. If the identity information is successfully matched with the user information prestored in the database, the user can be considered to be registered, the user preference associated with the identity information can be directly acquired, and the state of the water heater can be adjusted according to the user preference.
In one embodiment, the user preferences include a preferred temperature; adjusting the state of the water heater according to the user preference includes: and adjusting the outlet water temperature of the water heater to the preference temperature.
The user preference includes a preference temperature item, and the preference temperature refers to the outlet water temperature more suitable for the user during bathing or washing. Therefore, when the state of the water heater is adjusted according to the preference of the user, the outlet water temperature of the water heater can be actually adjusted to the preference temperature, so that the outlet water temperature of the water heater can be more suitable for the user, and the comfort level of the user is improved.
In one embodiment, the user preferences include a preferred shower spray mode of the water heater, and adjusting the state of the water heater according to the user preferences includes adjusting the shower to the preferred shower spray mode.
Wherein, the user preference can also include the preferred shower spray mode of the water heater. Wherein, the gondola water faucet has multiple spray mode, for example following several: firstly, the most basic shower water flow for bathing; secondly, continuously discharging water one by one in a rainwater mode; thirdly, the water flowers are powerful and powerful in a massage mode, and continuously pour, so that the body is relaxed; fourthly, the water flow is light, continuous and fine; single-strand type, a water column with concentrated water flow, and the like. Therefore, after the user preference associated with the identity information of the user is acquired, the state of the water heater can be adjusted according to the user preference, and specifically, the spraying mode of the shower head of the water heater can be adjusted to the preferred shower head spraying mode corresponding to the user preference. For example, if the user prefers that the spray flow be smaller, the position of the shower head of the water heater can be adjusted to the lowest position.
In one embodiment, the user preferences further include a bathing pattern of the user; the indoor temperature and/or indoor humidity is/are adjusted according to the bathing mode.
Wherein, the user preference may also include the bathing mode of the user. The bathing pattern of the user includes at least one of a preferred indoor temperature and indoor humidity. For example, the preferred indoor temperature in the user's bathing mode is 27 degrees, and the current indoor temperature is only 20 degrees, so that the bathroom heater in the bathroom can be controlled to be turned on, the bathroom heater refers to a multifunctional heater installed in the bathroom, such as a more common bulb series bathroom heater, and a purpose-made infrared quartz heating bulb is used as a heat source to heat the indoor air through direct radiation, so that the heating effect in a wide range can be obtained instantly without preheating. The multifunctional electric heating lamp has the functions of heating, ventilation and illumination, adopts 2 or 4 275W hard quartz explosion-proof bulbs to heat, has concentrated effect, can heat by turning on the lamp, and does not need preheating. For the bathroom heater, the number of the bathroom heaters to be turned on can be further determined according to the temperature difference between the current temperature and the preferred indoor temperature. Similarly, the humidity in the bathroom can be adjusted according to the indoor humidity preferred by the user, and if the current humidity in the bathroom is higher, the function of clearing damp can be controlled to be started.
In one embodiment, as shown in fig. 2, there is also provided a method of identifying a user based on gait, comprising:
at step 201, radar data associated with a user is acquired.
And 202, stacking the radar data to obtain a corresponding radar point cloud picture.
And 203, inputting the radar point cloud image into a gait recognition model to extract the part characteristics of the user in the radar point cloud image.
And step 204, determining the identity information of the user according to the part characteristics.
In case the matching is successful, user preferences associated with the identity information are obtained, step 206.
And step 209, after the confirmation information fed back by the user according to the voice question and answer is obtained, adjusting the state of the water heater according to the preference of the user.
In this embodiment, the radar data may be acquired by a pre-installed radar device. The radar device may be a millimeter wave radar device. The radar data associated with the user refers to radar data of the user collected by the radar device after the user enters the sensing range of the radar device. After the server acquires the radar data associated with the user, the radar data may be stacked to obtain a corresponding radar point cloud map, that is, the corresponding radar point cloud map may be formed according to coordinates of a plurality of radar data. After the radar point cloud picture is input into the gait recognition model, the identity information of the user can be determined through the gait recognition model. Specifically, the features of each part of the user in the radar cloud image can be extracted through the gait recognition model, and the identity information of the user is determined according to the part features. The part includes at least one of a torso, an arm, and a thigh.
The gait recognition model can extract the speed of each part of the body of the user and determine the acceleration of each part according to the speed of each part. Therefore, the speeds of the trunk, the arms and the thighs of the user can be extracted, so that the corresponding acceleration is determined according to the speeds, and the identity information of the user is determined according to the speeds and the accelerations of all parts. After the identity information of the user is determined, the identity information of the user can be matched with the user information prestored in the database, so as to determine whether the user has previously entered relevant user information, such as user preferences and the like. If the identity information is successfully matched with the user information prestored in the database, the user can be considered to be registered, and the user preference associated with the identity information can be directly acquired.
Further, a user name corresponding to the identity information may be obtained, where the user name is a name that is input by the user at the time of registration. The operation of input is not limited to voice input or import by a specific APP or the like. The voice input means that in the registration process, the input can be performed through voice, for example, the voice prompt: "please say the user name you want to enter", then the user can reply to his desired name by voice, for example, "zhang san". After receiving the voice data of the user, the server can perform voice recognition on the voice data and convert the voice data into characters, so that the name and the identity information of the user are stored in a correlated manner, and after subsequently acquiring the identity information of the user, the server can acquire the name of the user according to the identity information.
After the user name corresponding to the identity information is acquired, a voice question answer can be started according to the user name so as to inquire whether the user adjusts the state of the water heater according to the user preference. For example, to initiate a voice question-and-answer: three, ask whether the water temperature of the water heater needs to be adjusted to 35 degrees which you like. Or, starting: the owner asks whether the current indoor temperature needs to be adjusted to 30 degrees. The content and format of the voice question and answer can be set by the developer in a self-defined way, and the content and format are not limited here.
The voice question and answer can inquire whether the user adjusts the state of the water heater according to the preference of the user, and the user can also perform real-time interaction according to the voice question and answer to confirm whether corresponding adjustment is needed. Specifically, after the confirmation information fed back by the user according to the voice question and answer is acquired, the state of the water heater can be adjusted according to the user preference of the user, for example, if the user answers "good" or "yes" in a voice, it can be indicated that the user confirms that the adjustment can be performed, and the server can control the state of the water heater to perform corresponding adjustment. If the user answers feedback information of unconfirmed adjustment, such as ' not needed ', ' don't care ', ' wait for a while ', and the like, the state of the water heater does not need to be adjusted. It should be understood that, when asking and answering through the pronunciation, can confirm the matters of a plurality of preferences adjustment with the user, for example whether need to adjust the temperature of water heater to preference temperature, whether need to adjust the gondola water faucet to preference gondola water faucet spraying mode, whether need to adjust indoor temperature or humidity etc. can also carry out the custom setting through the matters of asking and answering processing, do not do the restriction here yet.
In one embodiment, the method further comprises: starting a stranger intrusion alarm mode under the condition of failed matching; and calling a preset communication number under the condition that the alarm release instruction is not acquired within the preset time.
Under the condition that the identity information is successfully matched with the user information prestored in the database, the user preference associated with the identity information can be acquired, and the state of the water heater is adjusted to the user preference. And under the condition that the identity information is unsuccessfully matched with the user information prestored in the database, a stranger intrusion alarm mode can be started. For example, an alarm may be activated to alert a stranger to leave as soon as possible. Or voice broadcast reminding can be started, such as 'not the owner of the house, please leave quickly', and the like. In the case that the alarm release instruction is not obtained within the preset time, the server may start to call a preset communication number, such as a police alarm phone, or a pre-bound number of a cell phone of a homeowner.
In one embodiment, the method further comprises: starting a new user registration mode under the condition that an alarm release instruction is obtained within preset time; acquiring a user name input by the user; and recording the data of the water heater used by the user and storing the data in association with the user name.
If the alarm release instruction is not acquired within the preset time, the server can start to call a preset communication number; if an alarm release instruction is obtained within a preset time, for example, a user triggered alarm off button, a new user registration mode may be started. Specifically, the voice registration mode may be triggered, for example, after entering a new user registration mode, the following may be broadcasted: "welcome to enter the smart bathroom monitoring system please say your user name", so the user can input his user name according to the voice prompt, for example, the user can reply to his desired name by voice, for example, "zhang san". Meanwhile, the server records relevant data of the user using the bathroom at this time, such as water temperature data, a water temperature change curve, indoor temperature data and the like. Further, data related to the user, including data of the water heater, can be stored in association with the user name.
In one embodiment, as shown in fig. 3, the method further comprises:
And step 302, analyzing the image frequency spectrum of the radar point cloud picture, and filtering the high-frequency signal of the radar point cloud picture.
And step 304, inputting the radar point cloud image transformed into the airspace image into a gait recognition model.
The millimeter wave radar can effectively capture a plurality of common signals of the user walking, namely a plurality of radar data associated with the user, and stack the radar data to obtain a corresponding radar point cloud chart. The space domain diagram of the radar point cloud image can be transformed into a frequency domain diagram through Fourier transform, the image frequency spectrum of the radar point cloud image is analyzed, and a filter is used for filtering high-frequency signals of the radar point cloud image. Further, the filter for filtering may be a Butterworth filter, which is one of the electronic filters, also called maximum flattening filters. The characteristic of the butterworth filter is that the frequency response curve in the pass band is maximally flat without ripples, and gradually drops to zero in the stop band. On a wave plot of the logarithm of the amplitude against the angular frequency, starting from a certain boundary angular frequency, the amplitude gradually decreases with increasing angular frequency, tending to be negative infinite. The attenuation ratio of the first order butterworth filter is 6 db per octave and 20 db per decade. The attenuation rate of the second order butterworth filter is 12 db per octave, the attenuation rate of the third order butterworth filter is 18 db per octave, and so on. The butterworth filter has a monotonically decreasing amplitude versus diagonal frequency and is also the only filter that retains the same shape regardless of order, amplitude versus diagonal frequency curve. Except that the higher the filter order, the faster the amplitude attenuation speed in the stop band. Other filters have different shapes for the amplitude versus angular frequency plot of the higher order and the amplitude versus angular frequency of the lower order. Therefore, the high-frequency signal of the radar point cloud chart can be effectively filtered through the Butterworth filter. Then, the frequency domain of the radar point cloud picture can be converted back to the airspace picture through inverse Fourier transform, and the radar point cloud picture converted to the airspace picture can be input to a gait recognition model for analysis, so that noise and interference caused by water mist, shielding and the like in a bathroom can be eliminated.
According to the method for identifying the user based on the gait, the radar data associated with the user can be acquired, the radar data are stacked to obtain the corresponding radar point cloud picture, the radar point cloud picture is input into the gait identification model to extract the part characteristics of the user in the radar point cloud picture, and therefore the identity information of the user is determined according to the part characteristics, and therefore the identity of the user can be quickly and accurately identified in the bathroom scene under the condition that the privacy of the user is not involved.
In one embodiment, as shown in fig. 4, there is provided an apparatus 400 for identifying a user based on gait, comprising:
a radar data acquisition module 401, configured to acquire radar data associated with a user.
A point cloud image obtaining module 402, configured to stack the radar data to obtain a corresponding radar point cloud image.
An identity information confirmation module 403, configured to input the radar cloud image into a gait recognition model, so as to extract a part feature of the user in the radar cloud image, and determine identity information of the user according to the part feature.
In one embodiment, the identity information confirmation module 403 is further configured to extract the speed of each part of the body of the user; the acceleration of each part is determined according to the speed of each part.
In one embodiment, the identity information confirmation module 403 is further configured to determine the identity information of the user according to the velocities and accelerations of all parts.
In one embodiment, the part includes at least one of a torso, an arm, and a thigh.
In one embodiment, as shown in fig. 4, the device 400 for identifying a user based on gait further includes a user preference obtaining module 404, configured to match the identity information with user information pre-stored in a database; acquiring user preferences associated with the identity information if the matching is successful; adjusting a state of the water heater according to user preferences.
In one embodiment, the user preferences include a preferred temperature. The user preference obtaining module 404 is further configured to adjust the outlet water temperature of the water heater to the preferred temperature.
In one embodiment, the user preferences include a preferred shower spray mode of the water heater; the user preference acquisition module 404 is further configured to adjust the state of the water heater according to user preferences including adjusting the showerhead to the preferred showerhead spray mode.
In one embodiment, the user preference obtaining module 404 is further configured to obtain a user preference associated with the identity information if the matching is successful; acquiring a user name corresponding to the identity information; starting a voice question-answer according to the user name so as to inquire whether a user adjusts the state of the water heater according to user preference; and after the confirmation information fed back by the user according to the voice question and answer is acquired, adjusting the state of the water heater according to the preference of the user.
In one embodiment, the user preference obtaining module 404 is further configured to initiate a stranger intrusion alert mode if the matching fails; and calling a preset communication number under the condition that the alarm release instruction is not acquired within the preset time.
In one embodiment, the user preference obtaining module 404 is further configured to, in a case that the alarm release instruction is obtained within a preset time, start a new user registration mode; acquiring a user name input by the user; and recording the data of the water heater used by the user and storing the data in association with the user name.
In one embodiment, the point cloud image obtaining module 402 is further configured to transform the radar point cloud image from a spatial domain image to a frequency domain image; analyzing an image frequency spectrum of the radar point cloud picture, and filtering a high-frequency signal of the radar point cloud picture; transforming the frequency domain graph into a spatial domain graph through Fourier transform; the identity information confirmation module 403 is further configured to input the radar dot cloud image transformed into the airspace map into the gait recognition model.
The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. The kernel can be set to be one or more, and gait-based identification of the user is achieved by adjusting kernel parameters.
The embodiment of the invention provides a processor, which is used for running a program, wherein the program executes the method for identifying the user based on the gait when running.
In one embodiment, as shown in fig. 5, there is also provided an apparatus 500 for identifying a user based on gait, the apparatus comprising:
a radar device 501 for collecting radar data associated with a user.
A processor 502 configured to perform a method of identifying a user based on gait.
In one embodiment, as shown in fig. 6, a water heater 600 is provided that includes the gait recognition based user device 500 described above.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
An embodiment of the present invention provides a storage medium having a program stored thereon, where the program, when executed by a processor, implements the above-mentioned method for identifying a user based on gait.
In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 7. The computer device includes a processor a01, a network interface a02, a memory (not shown), and a database (not shown) connected by a system bus. Wherein processor a01 of the computer device is used to provide computing and control capabilities. The memory of the computer device comprises an internal memory a03 and a non-volatile storage medium a 04. The non-volatile storage medium a04 stores an operating system B01, a computer program B02, and a database (not shown in the figure). The internal memory a03 provides an environment for the operation of the operating system B01 and the computer program B02 in the nonvolatile storage medium a 04. The database of the computer device is used to store radar data of the user. The network interface a02 of the computer device is used for communication with an external terminal through a network connection. The computer program B02 is executed by the processor a01 to implement a method of identifying a user based on gait.
Those skilled in the art will appreciate that the architecture shown in fig. 7 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
The embodiment of the invention provides equipment, which comprises a processor, a memory and a program which is stored on the memory and can run on the processor, wherein the processor executes the program and realizes the following steps: acquiring radar data associated with a user; stacking the radar data to obtain a corresponding radar point cloud picture; inputting the radar point cloud image into a gait recognition model to extract the part characteristics of the user in the radar point cloud image; and determining the identity information of the user according to the part characteristics.
In one embodiment, extracting the part features of the user in the radar point cloud picture comprises: extracting the speed of each part of the body of the user; the acceleration of each part is determined according to the speed of each part.
In one embodiment, determining identity information of the user based on the location characteristics comprises: and determining the identity information of the user according to the speeds and accelerations of all parts.
In one embodiment, the part includes at least one of a torso, an arm, and a thigh.
In one embodiment, the method further comprises: after the identity information of the user is determined according to the part characteristics, matching the identity information with the user information prestored in the database; acquiring user preferences associated with the identity information if the matching is successful; adjusting the state of the water heater according to user preferences.
In one embodiment, the user preferences include a preferred temperature; adjusting the state of the water heater according to the user preference includes: and adjusting the outlet water temperature of the water heater to the preference temperature.
In one embodiment, the user preferences include a preferred shower spray mode of the water heater, and adjusting the state of the water heater according to the user preferences includes adjusting the shower to the preferred shower spray mode.
In one embodiment, the method further comprises: acquiring user preferences associated with the identity information if the matching is successful; acquiring a user name corresponding to the identity information; starting a voice question-answer according to the name of the user so as to inquire whether the user adjusts the state of the water heater according to the preference of the user; and after the confirmation information fed back by the user according to the voice question and answer is acquired, the state of the water heater is adjusted according to the preference of the user.
In one embodiment, the method further comprises: starting a stranger intrusion alarm mode under the condition of failed matching; and calling a preset communication number under the condition that the alarm release instruction is not acquired within the preset time.
In one embodiment, the method further comprises: starting a new user registration mode under the condition that an alarm release instruction is obtained within preset time; acquiring a user name input by a user; and recording the data of the water heater used by the user and storing the data in association with the user name.
In one embodiment, the method further comprises: after stacking the radar data to obtain a corresponding radar point cloud picture, transforming the radar point cloud picture from a space domain picture to a frequency domain picture; analyzing an image frequency spectrum of the radar point cloud picture, and filtering a high-frequency signal of the radar point cloud picture; transforming the frequency domain graph into a spatial domain graph through Fourier transform; and inputting the radar point cloud image transformed into the airspace image into a gait recognition model.
The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device: acquiring radar data associated with a user; stacking the radar data to obtain a corresponding radar point cloud picture; inputting the radar point cloud image into a gait recognition model to extract the part characteristics of the user in the radar point cloud image; and determining the identity information of the user according to the part characteristics.
In one embodiment, extracting the part features of the user in the radar point cloud picture comprises: extracting the speed of each part of the body of the user; the acceleration of each part is determined according to the speed of each part.
In one embodiment, determining identity information of the user based on the location characteristics comprises: and determining the identity information of the user according to the speeds and accelerations of all parts.
In one embodiment, the part includes at least one of a torso, an arm, and a thigh.
In one embodiment, the method further comprises: after the identity information of the user is determined according to the part characteristics, matching the identity information with the user information prestored in the database; acquiring user preferences associated with the identity information if the matching is successful; adjusting the state of the water heater according to user preferences.
In one embodiment, the user preferences include a preferred temperature; adjusting the state of the water heater according to the user preference includes: and adjusting the outlet water temperature of the water heater to the preference temperature.
In one embodiment, the user preferences include a preferred shower spray mode of the water heater, and adjusting the state of the water heater according to the user preferences includes adjusting the shower to the preferred shower spray mode.
In one embodiment, the method further comprises: acquiring user preferences associated with the identity information if the matching is successful; acquiring a user name corresponding to the identity information; starting a voice question-answer according to the name of the user so as to inquire whether the user adjusts the state of the water heater according to the preference of the user; and after the confirmation information fed back by the user according to the voice question and answer is acquired, the state of the water heater is adjusted according to the preference of the user.
In one embodiment, the method further comprises: starting a stranger intrusion alarm mode under the condition of failed matching; and calling a preset communication number under the condition that the alarm release instruction is not acquired within the preset time.
In one embodiment, the method further comprises: starting a new user registration mode under the condition that an alarm release instruction is obtained within preset time; acquiring a user name input by a user; and recording the data of the water heater used by the user and storing the data in association with the user name.
In one embodiment, the method further comprises: after stacking the radar data to obtain a corresponding radar point cloud picture, transforming the radar point cloud picture from a space domain picture to a frequency domain picture; analyzing an image frequency spectrum of the radar point cloud picture, and filtering a high-frequency signal of the radar point cloud picture; transforming the frequency domain graph into a spatial domain graph through Fourier transform; and inputting the radar point cloud image transformed into the airspace image into a gait recognition model.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (15)
1. A method of identifying a user based on gait, the method comprising:
acquiring radar data associated with a user;
stacking the radar data to obtain a corresponding radar point cloud picture;
inputting the radar point cloud image into a gait recognition model to extract the part characteristics of the user in the radar point cloud image;
and determining the identity information of the user according to the part characteristics.
2. The method of claim 1, wherein the extracting the user's location features in the radar point cloud map comprises:
extracting the speed of each part of the body of the user;
the acceleration of each part is determined according to the speed of each part.
3. The method of claim 2, wherein determining identity information of the user based on the location features comprises:
and determining the identity information of the user according to the speeds and accelerations of all parts.
4. The method of any one of claims 1 to 3, wherein the part comprises at least one of a torso, an arm, and a thigh.
5. The method of claim 1, further comprising:
after the identity information of the user is determined according to the part features, matching the identity information with user information prestored in a database;
acquiring user preferences associated with the identity information if the matching is successful;
adjusting a state of the water heater according to user preferences.
6. The method of claim 5, wherein the user preferences include a preferred temperature; the adjusting the state of the water heater according to the user preference includes: adjusting the outlet water temperature of the water heater to the preferred temperature.
7. The method of claim 5, wherein the user preference comprises a preferred shower spray mode of the water heater, and wherein adjusting the state of the water heater according to the user preference comprises adjusting the shower to the preferred shower spray mode.
8. The method of claim 5, further comprising:
acquiring user preferences associated with the identity information if the matching is successful;
acquiring a user name corresponding to the identity information;
starting a voice question-answer according to the user name so as to inquire whether a user adjusts the state of the water heater according to user preference;
and after the confirmation information fed back by the user according to the voice question and answer is acquired, adjusting the state of the water heater according to the preference of the user.
9. The method of claim 5, further comprising:
starting a stranger intrusion alarm mode under the condition of failed matching;
and calling a preset communication number under the condition that the alarm release instruction is not acquired within the preset time.
10. The method of claim 9, further comprising:
starting a new user registration mode under the condition that an alarm release instruction is obtained within preset time;
acquiring a user name input by the user;
and recording the data of the water heater used by the user and storing the data in association with the user name.
11. The method of claim 1, further comprising:
after stacking the radar data to obtain a corresponding radar point cloud picture, transforming the radar point cloud picture from a space domain picture to a frequency domain picture;
analyzing the image frequency spectrum of the radar point cloud picture, and filtering the high-frequency signal of the radar point cloud picture;
transforming the frequency domain graph into a spatial domain graph through Fourier transform;
inputting the radar point cloud image transformed into the airspace image into the gait recognition model.
12. A processor configured to perform the method of identifying a user based on gait according to any one of claims 1 to 11.
13. An apparatus for identifying a user based on gait, the apparatus comprising:
a radar device to collect radar data associated with a user;
the processor of claim 12.
14. A water heater comprising the gait recognition based user device of claim 13.
15. A machine-readable storage medium having instructions stored thereon, which when executed by a processor, cause the processor to be configured to perform a method of identifying a user based on gait according to any one of claims 1 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011287545.7A CN112541398A (en) | 2020-11-17 | 2020-11-17 | Method, device, processor and water heater for identifying user based on gait |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011287545.7A CN112541398A (en) | 2020-11-17 | 2020-11-17 | Method, device, processor and water heater for identifying user based on gait |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112541398A true CN112541398A (en) | 2021-03-23 |
Family
ID=75014166
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011287545.7A Pending CN112541398A (en) | 2020-11-17 | 2020-11-17 | Method, device, processor and water heater for identifying user based on gait |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112541398A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113221709A (en) * | 2021-04-30 | 2021-08-06 | 芜湖美的厨卫电器制造有限公司 | Method and device for recognizing user movement and water heater |
| CN113591760A (en) * | 2021-08-09 | 2021-11-02 | 路晟悠拜(重庆)科技有限公司 | Far-field multi-human-body gait monitoring method based on millimeter waves |
| WO2023116244A1 (en) * | 2021-12-24 | 2023-06-29 | 芜湖美的厨卫电器制造有限公司 | Control device, water heater system and control method and apparatus therefor, and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109448713A (en) * | 2018-11-13 | 2019-03-08 | 平安科技（深圳）有限公司 | Audio recognition method, device, computer equipment and storage medium |
| CN109613834A (en) * | 2018-10-26 | 2019-04-12 | 深圳市赛亿科技开发有限公司 | A kind of Intelligent bathroom system and its control method for the elderly |
| CN111625794A (en) * | 2019-02-28 | 2020-09-04 | 广东美的制冷设备有限公司 | Input method, operation control module, household appliance, system and storage medium |
| CN111738060A (en) * | 2020-05-07 | 2020-10-02 | 复旦大学 | Human gait recognition system based on millimeter wave radar |
-
2020
- 2020-11-17 CN CN202011287545.7A patent/CN112541398A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109613834A (en) * | 2018-10-26 | 2019-04-12 | 深圳市赛亿科技开发有限公司 | A kind of Intelligent bathroom system and its control method for the elderly |
| CN109448713A (en) * | 2018-11-13 | 2019-03-08 | 平安科技（深圳）有限公司 | Audio recognition method, device, computer equipment and storage medium |
| CN111625794A (en) * | 2019-02-28 | 2020-09-04 | 广东美的制冷设备有限公司 | Input method, operation control module, household appliance, system and storage medium |
| CN111738060A (en) * | 2020-05-07 | 2020-10-02 | 复旦大学 | Human gait recognition system based on millimeter wave radar |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113221709A (en) * | 2021-04-30 | 2021-08-06 | 芜湖美的厨卫电器制造有限公司 | Method and device for recognizing user movement and water heater |
| CN113221709B (en) * | 2021-04-30 | 2022-11-25 | 芜湖美的厨卫电器制造有限公司 | Method and device for identifying user motion and water heater |
| CN113591760A (en) * | 2021-08-09 | 2021-11-02 | 路晟悠拜(重庆)科技有限公司 | Far-field multi-human-body gait monitoring method based on millimeter waves |
| CN113591760B (en) * | 2021-08-09 | 2024-01-05 | 路晟悠拜(重庆)科技有限公司 | Gait monitoring method of far-field multiple human bodies based on millimeter waves |
| WO2023116244A1 (en) * | 2021-12-24 | 2023-06-29 | 芜湖美的厨卫电器制造有限公司 | Control device, water heater system and control method and apparatus therefor, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112541398A (en) | Method, device, processor and water heater for identifying user based on gait | |
| US20200162701A1 (en) | Identifying and locating objects by associating video data of the objects with signals identifying wireless devices belonging to the objects | |
| US20180232902A1 (en) | Computationally-efficient human-identifying smart assistant computer | |
| US10891839B2 (en) | Customizable intrusion zones associated with security systems | |
| US20180176512A1 (en) | Customizable intrusion zones associated with security systems | |
| US9928435B2 (en) | System and method for providing an on-chip context aware contact list | |
| WO2019217008A1 (en) | Electronic devices capable of communicating over multiple networks | |
| US11232685B1 (en) | Security system with dual-mode event video and still image recording | |
| US10769909B1 (en) | Using sensor data to detect events | |
| CN112051743A (en) | Device control method, conflict processing method, corresponding devices and electronic device | |
| CN108600202A (en) | A kind of information processing method and device, computer readable storage medium | |
| US10666913B1 (en) | Input functionality for audio/video recording and communication doorbells | |
| WO2018157092A1 (en) | Identification of suspicious persons using audio/video recording and communication devices | |
| US11349707B1 (en) | Implementing security system devices as network nodes | |
| CN112556193B (en) | Control method and device for water heater, processor and water heater | |
| CN110415694A (en) | A kind of method that more intelligent sound boxes cooperate | |
| CN112699808A (en) | Dense target detection method, electronic equipment and related product | |
| US10791607B1 (en) | Configuring and controlling light emitters | |
| EP3729428A1 (en) | System and method for determining occupancy | |
| CN112581723A (en) | Method and device for recognizing user gesture, processor and water heater | |
| US20220067090A1 (en) | Systems, methods, and apparatuses for intelligent audio event detection | |
| CN114267105A (en) | Doorbell control method, intelligent doorbell and related equipment | |
| US10490033B1 (en) | Customized notifications based on device characteristics | |
| CN113723369A (en) | Control method, control device, electronic equipment and storage medium | |
| US10914811B1 (en) | Locating a source of a sound using microphones and radio frequency communication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210323 |
|
| RJ01 | Rejection of invention patent application after publication |