CN113610023A - Device control method, device and storage medium - Google Patents
Device control method, device and storage medium Download PDFInfo
- Publication number
- CN113610023A CN113610023A CN202110925749.7A CN202110925749A CN113610023A CN 113610023 A CN113610023 A CN 113610023A CN 202110925749 A CN202110925749 A CN 202110925749A CN 113610023 A CN113610023 A CN 113610023A
- Authority
- CN
- China
- Prior art keywords
- information
- human body
- body contour
- echo signal
- acquiring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000009471 action Effects 0.000 claims abstract description 82
- 238000013527 convolutional neural network Methods 0.000 claims description 13
- 238000013507 mapping Methods 0.000 claims description 12
- 230000008859 change Effects 0.000 claims description 11
- 238000004891 communication Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 8
- 210000003127 knee Anatomy 0.000 claims description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011982 device technology Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
- G06F18/253—Fusion techniques of extracted features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application relates to a device control method, a device, equipment and a storage medium, and relates to the technical field of intelligent equipment. The equipment control method comprises the following steps: acquiring echo signal information, wherein the echo signal information is acquired by a microwave radar receiving module; identifying human body contour information according to the echo signal information; identifying action information according to the human body contour information; acquiring intelligent equipment and a control instruction corresponding to the action information; and controlling the intelligent equipment to execute the operation corresponding to the control instruction. The method and the device are used for solving the problem that the privacy of the user is easily revealed by gesture recognition through image recognition.
Description
Technical Field
The present application relates to the field of intelligent device technologies, and in particular, to a device control method, apparatus, device, and storage medium.
Background
With the continuous progress of science and technology, people have higher and higher control requirements on household appliances, which not only requires convenient control, but also requires high confidentiality on personal information of the people.
The common modes of intelligent control in the market at present are App control, voice recognition and gesture control. App control is almost the same as remote control, and the device is not portable compared with the remote control; voice control requires a wake-up word to prevent false control, which is somewhat embarrassing for some people. Most of gesture recognition equipment in the market is image recognition, and hidden danger exists for personal privacy safety of users.
Disclosure of Invention
The application provides a device control method, a device, equipment and a storage medium, which are used for solving the problem that user privacy is easily revealed when gesture recognition is carried out through image recognition.
In a first aspect, an embodiment of the present application provides an apparatus control method, including:
acquiring echo signal information, wherein the echo signal information is acquired by a microwave radar receiving module;
identifying human body contour information according to the echo signal information;
identifying action information according to the human body contour information;
acquiring intelligent equipment and a control instruction corresponding to the action information;
and controlling the intelligent equipment to execute the operation corresponding to the control instruction.
Optionally, the human body contour information is a human body skeleton formed by connecting human body key parts, wherein the human body key parts comprise at least one of a head, a neck, shoulders, a waist, a knee, a foot, an elbow and a hand.
Optionally, before the identifying motion information according to the human body contour information, the method further includes:
obtaining position information of a hand and position information of a control area according to the human body contour information;
and determining that the hand is positioned in the control area according to the position information of the hand and the position information of the control area.
Optionally, the obtaining position information of the hand and position information of the control area according to the human body contour information includes:
obtaining position information of a hand and position information of a chest according to the human body contour information;
and obtaining the position information of the control area according to the position information of the chest, wherein the height of the control area is greater than or equal to the height of the chest.
Optionally, the identifying motion information according to the human body contour information includes:
and extracting the characteristics of the human body posture in the human body contour information, and determining the action information according to the characteristics of the human body posture.
Optionally, the extracting the features of the human body posture in the human body contour information, and determining the action information according to the features of the human body posture include:
inputting the human body contour information into a pre-trained convolutional neural network model;
sequentially extracting the characteristics of the N convolutional layers of the human body contour information through the N convolutional layers in the convolutional neural network model, fusing the characteristics of the N convolutional layers to obtain the characteristics of the human body posture, and determining the action information according to the characteristics of the human body posture, wherein N is greater than 1.
Optionally, the acquiring echo signal information includes:
periodically acquiring the echo signal information;
the identifying human body contour information according to the echo signal information comprises:
identifying at least two pieces of human body contour information according to at least two pieces of echo signal information acquired within a preset time length;
the recognizing the action information according to the human body contour information comprises the following steps:
obtaining human body position information change data according to at least two pieces of human body contour information;
and identifying the action information according to the human body position information change data.
Optionally, the acquiring the intelligent device and the control instruction corresponding to the action information includes:
acquiring intelligent equipment corresponding to the action information according to the action information and the first mapping relation of each intelligent equipment;
and acquiring the control instruction corresponding to the action information according to the second mapping relation between the action information and each control instruction.
In a second aspect, an embodiment of the present application provides an apparatus control device, including:
the microwave radar communication system comprises a first acquisition module, a second acquisition module and a microwave radar receiving module, wherein the first acquisition module is used for acquiring echo signal information, and the echo signal information is acquired by the microwave radar receiving module;
the first identification module is used for identifying human body contour information according to the echo signal information;
the second identification module is used for identifying action information according to the human body contour information;
the second acquisition module is used for acquiring the intelligent equipment and the control instruction corresponding to the action information;
and the processing module is used for controlling the intelligent equipment to execute the operation corresponding to the control instruction.
Optionally, the human body contour information is a human body skeleton formed by connecting human body key parts, wherein the human body key parts comprise at least one of a head, a neck, shoulders, a waist, a knee, a foot, an elbow and a hand.
Optionally, the device control apparatus further includes a third obtaining module and an analyzing module;
the third acquisition module is used for acquiring the position information of the hand and the position information of the control area according to the human body contour information;
and the analysis module is used for determining that the hand is positioned in the control area according to the position information of the hand and the position information of the control area.
Optionally, the third obtaining module includes a first obtaining unit and a second obtaining unit;
the first acquisition unit is used for acquiring position information of a hand and position information of a chest according to the human body contour information;
the second obtaining unit is configured to obtain position information of the control area according to the position information of the chest, where a height of the control area is greater than or equal to a height of the chest.
Optionally, the second recognition module is configured to extract features of a human body posture in the human body contour information, and determine the action information according to the features of the human body posture.
Optionally, the second identification module comprises an input unit and a processing unit;
the input unit is used for inputting the human body contour information to a pre-trained convolutional neural network model;
the processing unit is used for sequentially extracting the characteristics of the N convolutional layers of the human body contour information through the N convolutional layers in the convolutional neural network model, fusing the characteristics of the N convolutional layers to obtain the characteristics of the human body posture, and determining the action information according to the characteristics of the human body posture, wherein N is larger than 1.
Optionally, the first obtaining module is configured to periodically obtain the echo signal information;
the first identification module is used for identifying at least two pieces of human body contour information according to at least two pieces of echo signal information acquired within a preset time length;
the second identification module comprises a third acquisition unit and an identification unit;
the third acquisition unit is used for acquiring human body position information change data according to at least two pieces of human body contour information;
and the identification unit is used for identifying the action information according to the human body position information change data.
Optionally, the second obtaining module includes a fourth obtaining unit and a fifth obtaining unit;
the fourth obtaining unit is configured to obtain the intelligent device corresponding to the action information according to the action information and the first mapping relationship of each intelligent device;
and the fifth acquiring unit is used for acquiring the control instruction corresponding to the action information according to the second mapping relation between the action information and each control instruction.
In a third aspect, an embodiment of the present application provides an electronic device, including: the system comprises a processor, a memory and a communication bus, wherein the processor and the memory are communicated with each other through the communication bus;
the memory for storing a computer program;
the processor is configured to execute the program stored in the memory, and implement the device control method according to the first aspect.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and the computer program, when executed by a processor, implements the device control method according to the first aspect.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages: according to the method provided by the embodiment of the application, echo signal information is acquired by a microwave radar receiving module, human body contour information is identified according to the echo signal information, action information is identified according to the human body contour information, intelligent equipment and a control instruction corresponding to the action information are acquired, and the intelligent equipment is controlled to execute operation corresponding to the control instruction. Compared with the prior art that gesture recognition is carried out through image recognition, user images are shot, user privacy is easy to reveal, the user image recognition method and device do not need to acquire the user images, can recognize human body contour information according to echo signal information, further recognize action information according to the human body contour information, can avoid revealing the user images, further protect the user privacy, and solve the problem that the user privacy is easy to reveal when gesture recognition is carried out through image recognition.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
FIG. 1 is a schematic flow chart of an apparatus control method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of human body contour information in an embodiment of the present application;
FIG. 3 is a schematic flow chart of an apparatus control method according to an embodiment of the present application;
FIG. 4 is a schematic flow chart of an apparatus control method according to an embodiment of the present application;
FIG. 5 is a schematic structural diagram of a device control apparatus according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the embodiment of the present application, an apparatus control method is provided, and the method may be applied to a server, and of course, may also be applied to other electronic apparatuses, such as a terminal (a mobile phone, a tablet computer, and the like). In the embodiment of the present application, the method is described as being applied to a server.
In the embodiment of the present application, as shown in fig. 1, a flow of an apparatus control method mainly includes:
Wherein the echo signal information includes an amplitude of the echo signal and a time when the echo signal is received.
And constructing a microwave radar antenna array, wherein a transmitting module in the microwave radar antenna array transmits a microwave radar signal, and the microwave radar signal is reflected after contacting the surface of a human body to form an echo signal. And a receiving module of the microwave radar antenna array receives the reflected echo signal and sends echo signal information to the server.
In one embodiment, acquiring echo signal information includes: the echo signal information is acquired periodically, for example, every 1 second.
The server can acquire echo signal information sent by the microwave radar antenna array in real time, and can also periodically acquire the echo signal information sent by the microwave radar antenna array. The echo signal information is periodically acquired, so that the data volume received by the server can be reduced, the data volume processed by the server is further reduced, and the operating pressure of the server is reduced.
And 102, identifying human body contour information according to the echo signal information.
The human body contour information can be position information of a human body contour, and can also be a human body skeleton formed by connecting human body key parts, wherein the human body key parts comprise at least one of a head, a neck, shoulders, a waist, a knee, a foot and an elbow and a hand. The position information may be two-dimensional coordinates or three-dimensional coordinates.
In one embodiment, as shown in FIG. 2, the body contour information is a body skeleton formed by the connection of the head, neck, shoulders, waist, knees, feet, elbows and hands.
The human body contour information is a human body skeleton formed by connecting human body key parts, the position information of the human body key parts can be identified only according to the echo signal information, the data volume contained in the human body contour information can be reduced, the operation pressure of identifying the action information according to the human body contour information is further reduced, and the operation speed of identifying the action information according to the human body contour information can be increased.
In one embodiment, identifying the human body contour information according to the echo signal information comprises: and identifying at least two human body contour information according to at least two echo signal information acquired within a preset time length. The preset time length may be an empirical value or a numerical value set by a user. For example: the preset time period may be 3 seconds.
The motion information may be gesture information or motion information of other parts of the human body. The present application takes gesture information as an example for explanation, but the motion information is not limited to only gesture information. The gesture information may be a static gesture obtained from one human body contour information, such as fist making, palm opening, and the like, or a movement trajectory of a hand obtained from at least two human body contour information, such as palm left movement, palm right movement, and the like.
And 103, identifying the action information according to the human body contour information.
In an embodiment, as shown in fig. 3, before identifying the motion information according to the human body contour information, the apparatus control method further includes:
Specifically, obtaining position information of the hand and position information of the control area according to the human body contour information includes: obtaining position information of hands, waist and shoulders according to the contour information of the human body; and obtaining the position information of the control area according to the position information of the waist and the position information of the shoulders, wherein the height of the control area is greater than the height of the waist and less than the height of the shoulders.
For example: according to the human body contour information, the height of a hand is 1.2 meters, the height of a waist is 1 meter, the height of a shoulder is 1.4 meters, the height of a control area is more than 1 meter and less than 1.4 meters, and the hand is in the control area; for another example, according to the human body contour information, the height of the hand is 0.8 m, the height of the waist is 1 m, the height of the shoulder is 1.4 m, the height of the control area is more than 1 m and less than 1.4 m, and the hand is not in the control area.
When the user walks at ordinary times, the height of hand is generally less than the height of waist, sets up the height of control area to be greater than the height of waist and be less than the height of shoulder, and the motion of hand causes smart machine's error control when can preventing that the user from daily walking.
The position information of the hand and the position information of the chest can also be obtained according to the contour information of the human body, and the position information of the control area can be obtained according to the position information of the chest, wherein the height of the control area is greater than or equal to the height of the chest.
The height of the control area is set to be larger than or equal to the height of a chest, the position information of a head and the position information of feet are obtained through the human body contour information, the height of a user is obtained according to the position information of the head and the position information of the feet, the height of the chest is obtained by multiplying the height of the user by a preset proportion, when the height of a hand is larger than the height of the chest, the gesture is the control gesture, gesture information needs to be recognized, and when the height of the hand is smaller than or equal to the height of the chest, the gesture is a non-control gesture, and gesture information does not need to be recognized. The control area has other setting modes, the setting mode of the control area is not limited, and the error control of the intelligent device can be realized only if the error control of the intelligent device caused by the movement of the daily hand of the user can be prevented.
When the hand is determined to be in the control area, the gesture is the control gesture, gesture information needs to be recognized, and when the hand is not in the control area, the gesture is a non-control gesture, gesture information does not need to be recognized, false control of the intelligent device caused by daily hand movement of a user can be prevented, and the data size of gesture information recognition calculation can be reduced by determining the gesture as the control gesture.
In one embodiment, identifying the motion information according to the human body contour information includes: and extracting the characteristics of the human body posture in the human body contour information, and determining action information according to the characteristics of the human body posture.
Specifically, the method for extracting the human body posture features in the human body contour information and determining the action information according to the human body posture features comprises the following steps: inputting human body contour information into a pre-trained convolutional neural network model; the method comprises the steps of sequentially extracting the characteristics of N convolutional layers of human body contour information through the N convolutional layers in a convolutional neural network model, fusing the characteristics of the N convolutional layers to obtain the characteristics of a human body posture, and determining action information according to the characteristics of the human body posture, wherein N is larger than 1.
According to the characteristics of the human body posture, determining action information, specifically: and calculating the probability that the features of the human body posture belong to each action information, and taking the action information with the maximum probability as target action information.
The action information is determined through the pre-trained convolutional neural network model, and the determined action information can be more accurate.
In one embodiment, identifying the motion information according to the human body contour information includes: obtaining human body position information change data according to at least two pieces of human body contour information; and identifying the action information according to the change data of the human body position information. For example, the human body position information change data obtained from the at least two human body contour information indicates that the palm is opened and moved from the first position to the second position, and the abscissa of the first position is smaller than the abscissa of the second position, and the motion information indicates that the palm moves rightward.
And 104, acquiring the intelligent equipment and the control instruction corresponding to the action information.
In a specific embodiment, the acquiring the intelligent device and the control instruction corresponding to the action information includes: acquiring intelligent equipment corresponding to the action information according to the action information and the first mapping relation of each intelligent equipment; and acquiring the control instruction corresponding to the action information according to the second mapping relation between the action information and each control instruction.
The first mapping relation between the action information and each intelligent device can be that one finger is stretched to represent a television, two fingers are stretched to represent an air conditioner, and three fingers are stretched to represent a washing machine. The second mapping relation between the action information and each control instruction can be that the palm is opened to the right to indicate that the page is turned forward, the palm is opened to the left to indicate that the page is turned backward, the fist making indication is determined, the fist making right indicates that the page is turned up, the fist making left indicates that the page is turned down, and the palm is pushed back and forth twice to indicate the popup menu.
The action information in the intelligent device and the control instruction corresponding to the action information is acquired, wherein the action information may be at least two pieces of action information, the intelligent device is determined by at least one piece of action information, and the control instruction is determined by at least another piece of action information.
In a specific embodiment, a page including each intelligent device icon is displayed on the intelligent screen, after the intelligent device icon is selected through gesture information, each control instruction corresponding to the intelligent device and a gesture information schematic diagram corresponding to the control instruction are displayed, and the control instruction is determined through the gesture information.
And 105, controlling the intelligent equipment to execute the operation corresponding to the control instruction.
In a specific embodiment, as shown in fig. 4, the flow of the device control method mainly includes:
And 402, identifying human body contour information according to the echo signal information, wherein the human body contour information is a human body skeleton formed by connecting key parts of a human body.
Wherein the key parts of the human body comprise at least one of the head, neck, shoulders, waist, knees, feet, elbows and hands.
And step 403, acquiring the height of the hand and the height of the chest according to the human body contour information.
And 405, determining the gesture as a control gesture, constructing a menu of the household electrical appliance on the intelligent screen, inputting the human body contour information to a pre-trained convolutional neural network model, and obtaining gesture information output by the convolutional neural network model.
In step 406, the gesture is determined to be a non-control gesture.
And step 408, controlling the intelligent device to execute the operation corresponding to the control instruction.
In summary, the method provided by the embodiment of the application acquires echo signal information, wherein the echo signal information is acquired by a microwave radar receiving module, the human body contour information is identified according to the echo signal information, the action information is identified according to the human body contour information, the intelligent device and the control instruction corresponding to the action information are acquired, and the intelligent device is controlled to execute the operation corresponding to the control instruction. Compared with the prior art that gesture recognition is carried out through image recognition, user images are shot, user privacy is easy to reveal, the user image recognition method and device do not need to acquire the user images, can recognize human body contour information according to echo signal information, further recognize action information according to the human body contour information, can avoid revealing the user images, further protect the user privacy, and solve the problem that the user privacy is easy to reveal when gesture recognition is carried out through image recognition.
Based on the same concept, an apparatus control device is provided in the embodiments of the present application, and specific implementation of the apparatus may refer to the description of the method embodiment, and repeated descriptions are omitted, as shown in fig. 5, the apparatus mainly includes:
the first obtaining module 501 is configured to obtain echo signal information, where the echo signal information is acquired by a microwave radar receiving module;
a first identification module 502, configured to identify human body contour information according to the echo signal information;
a second identification module 503, configured to identify motion information according to the human body contour information;
a second obtaining module 504, configured to obtain the intelligent device and the control instruction corresponding to the action information;
and the processing module 505 is configured to control the intelligent device to execute an operation corresponding to the control instruction.
Optionally, the human body contour information is a human body skeleton formed by connecting human body key parts, wherein the human body key parts comprise at least one of a head, a neck, shoulders, a waist, a knee, a foot, an elbow and a hand.
Optionally, the device control apparatus further includes a third obtaining module and an analyzing module;
the third acquisition module is used for acquiring the position information of the hand and the position information of the control area according to the human body contour information;
and the analysis module is used for determining that the hand is positioned in the control area according to the position information of the hand and the position information of the control area.
Optionally, the third obtaining module includes a first obtaining unit and a second obtaining unit;
the first acquisition unit is used for acquiring position information of a hand and position information of a chest according to the human body contour information;
the second obtaining unit is configured to obtain position information of the control area according to the position information of the chest, where a height of the control area is greater than or equal to a height of the chest.
Optionally, the second recognition module is configured to extract features of a human body posture in the human body contour information, and determine the action information according to the features of the human body posture.
Optionally, the second identification module comprises an input unit and a processing unit;
the input unit is used for inputting the human body contour information to a pre-trained convolutional neural network model;
the processing unit is used for sequentially extracting the characteristics of the N convolutional layers of the human body contour information through the N convolutional layers in the convolutional neural network model, fusing the characteristics of the N convolutional layers to obtain the characteristics of the human body posture, and determining the action information according to the characteristics of the human body posture, wherein N is larger than 1.
Optionally, the first obtaining module is configured to periodically obtain the echo signal information;
the first identification module is used for identifying at least two pieces of human body contour information according to at least two pieces of echo signal information acquired within a preset time length;
the second identification module comprises a third acquisition unit and an identification unit;
the third acquisition unit is used for acquiring human body position information change data according to at least two pieces of human body contour information;
and the identification unit is used for identifying the action information according to the human body position information change data.
Optionally, the second obtaining module includes a fourth obtaining unit and a fifth obtaining unit;
the fourth obtaining unit is configured to obtain the intelligent device corresponding to the action information according to the action information and the first mapping relationship of each intelligent device;
and the fifth acquiring unit is used for acquiring the control instruction corresponding to the action information according to the second mapping relation between the action information and each control instruction.
Based on the same concept, an embodiment of the present application further provides an electronic device, as shown in fig. 6, the electronic device mainly includes: a processor 601, a memory 602, and a communication bus 603, wherein the processor 601 and the memory 602 communicate with each other via the communication bus 603. The memory 602 stores a program executable by the processor 601, and the processor 601 executes the program stored in the memory 602 to implement the following steps:
acquiring echo signal information, wherein the echo signal information is acquired by a microwave radar receiving module; identifying human body contour information according to the echo signal information; identifying action information according to the human body contour information; acquiring intelligent equipment and a control instruction corresponding to the action information; and controlling the intelligent equipment to execute the operation corresponding to the control instruction.
The communication bus 603 mentioned in the above electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus 603 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 6, but this is not intended to represent only one bus or type of bus.
The Memory 602 may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Alternatively, the memory may be at least one storage device located remotely from the processor 601.
The Processor 601 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like, and may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic devices, discrete gates or transistor logic devices, and discrete hardware components.
In still another embodiment of the present application, there is also provided a computer-readable storage medium having stored therein a computer program which, when run on a computer, causes the computer to execute the apparatus control method described in the above-described embodiment.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wirelessly (e.g., infrared, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that includes one or more of the available media. The available media may be magnetic media (e.g., floppy disks, hard disks, tapes, etc.), optical media (e.g., DVDs), or semiconductor media (e.g., solid state drives), among others.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (11)
1. An apparatus control method characterized by comprising:
acquiring echo signal information, wherein the echo signal information is acquired by a microwave radar receiving module;
identifying human body contour information according to the echo signal information;
identifying action information according to the human body contour information;
acquiring intelligent equipment and a control instruction corresponding to the action information;
and controlling the intelligent equipment to execute the operation corresponding to the control instruction.
2. The apparatus control method according to claim 1, wherein the human body contour information is a human body skeleton formed by connecting human body key parts including at least one of a head, a neck, a shoulder, a waist, a knee, a foot, an elbow, and a hand.
3. The device control method according to claim 1, wherein before identifying motion information from the human body contour information, the method further comprises:
obtaining position information of a hand and position information of a control area according to the human body contour information;
and determining that the hand is positioned in the control area according to the position information of the hand and the position information of the control area.
4. The device control method according to claim 3, wherein the obtaining position information of the hand and position information of the control area from the human body contour information includes:
obtaining position information of a hand and position information of a chest according to the human body contour information;
and obtaining the position information of the control area according to the position information of the chest, wherein the height of the control area is greater than or equal to the height of the chest.
5. The device control method according to claim 1, wherein the identifying motion information based on the human body contour information includes:
and extracting the characteristics of the human body posture in the human body contour information, and determining the action information according to the characteristics of the human body posture.
6. The device control method according to claim 5, wherein the extracting features of the human body posture from the human body contour information and determining the motion information according to the features of the human body posture comprises:
inputting the human body contour information into a pre-trained convolutional neural network model;
sequentially extracting the characteristics of the N convolutional layers of the human body contour information through the N convolutional layers in the convolutional neural network model, fusing the characteristics of the N convolutional layers to obtain the characteristics of the human body posture, and determining the action information according to the characteristics of the human body posture, wherein N is greater than 1.
7. The apparatus control method according to any one of claims 1 to 4, wherein the acquiring echo signal information includes:
periodically acquiring the echo signal information;
the identifying human body contour information according to the echo signal information comprises:
identifying at least two pieces of human body contour information according to at least two pieces of echo signal information acquired within a preset time length;
the recognizing the action information according to the human body contour information comprises the following steps:
obtaining human body position information change data according to at least two pieces of human body contour information;
and identifying the action information according to the human body position information change data.
8. The device control method according to claim 1, wherein the acquiring of the smart device and the control instruction corresponding to the action information includes:
acquiring intelligent equipment corresponding to the action information according to the action information and the first mapping relation of each intelligent equipment;
and acquiring the control instruction corresponding to the action information according to the second mapping relation between the action information and each control instruction.
9. An apparatus control device, characterized by comprising:
the microwave radar communication system comprises a first acquisition module, a second acquisition module and a microwave radar receiving module, wherein the first acquisition module is used for acquiring echo signal information, and the echo signal information is acquired by the microwave radar receiving module;
the first identification module is used for identifying human body contour information according to the echo signal information;
the second identification module is used for identifying action information according to the human body contour information;
the second acquisition module is used for acquiring the intelligent equipment and the control instruction corresponding to the action information;
and the processing module is used for controlling the intelligent equipment to execute the operation corresponding to the control instruction.
10. An electronic device, comprising: the system comprises a processor, a memory and a communication bus, wherein the processor and the memory are communicated with each other through the communication bus;
the memory for storing a computer program;
the processor is configured to execute the program stored in the memory to implement the device control method according to any one of claims 1 to 8.
11. A computer-readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the device control method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110925749.7A CN113610023A (en) | 2021-08-12 | 2021-08-12 | Device control method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110925749.7A CN113610023A (en) | 2021-08-12 | 2021-08-12 | Device control method, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113610023A true CN113610023A (en) | 2021-11-05 |
Family
ID=78308340
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110925749.7A Pending CN113610023A (en) | 2021-08-12 | 2021-08-12 | Device control method, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113610023A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115826427A (en) * | 2023-01-31 | 2023-03-21 | 黑龙江八一农垦大学 | Man-machine interaction system applied to smart home |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108399367A (en) * | 2018-01-31 | 2018-08-14 | 深圳市阿西莫夫科技有限公司 | Hand motion recognition method, apparatus, computer equipment and readable storage medium storing program for executing |
| CN108469760A (en) * | 2018-02-12 | 2018-08-31 | 普天智能照明研究院有限公司 | Sanitary ware |
| CN109857251A (en) * | 2019-01-16 | 2019-06-07 | 珠海格力电器股份有限公司 | Gesture identification control method, device, storage medium and the equipment of intelligent appliance |
| CN111158246A (en) * | 2019-12-06 | 2020-05-15 | 珠海格力电器股份有限公司 | Intelligent household appliance control system, device, method, medium and equipment |
| CN112241001A (en) * | 2020-10-10 | 2021-01-19 | 深圳大学 | Radar human body action recognition method and device, electronic equipment and storage medium |
| CN112633196A (en) * | 2020-12-28 | 2021-04-09 | 浙江大华技术股份有限公司 | Human body posture detection method and device and computer equipment |
| CN112987933A (en) * | 2021-03-25 | 2021-06-18 | 北京市商汤科技开发有限公司 | Device control method, device, electronic device and storage medium |
-
2021
- 2021-08-12 CN CN202110925749.7A patent/CN113610023A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108399367A (en) * | 2018-01-31 | 2018-08-14 | 深圳市阿西莫夫科技有限公司 | Hand motion recognition method, apparatus, computer equipment and readable storage medium storing program for executing |
| CN108469760A (en) * | 2018-02-12 | 2018-08-31 | 普天智能照明研究院有限公司 | Sanitary ware |
| CN109857251A (en) * | 2019-01-16 | 2019-06-07 | 珠海格力电器股份有限公司 | Gesture identification control method, device, storage medium and the equipment of intelligent appliance |
| CN111158246A (en) * | 2019-12-06 | 2020-05-15 | 珠海格力电器股份有限公司 | Intelligent household appliance control system, device, method, medium and equipment |
| CN112241001A (en) * | 2020-10-10 | 2021-01-19 | 深圳大学 | Radar human body action recognition method and device, electronic equipment and storage medium |
| CN112633196A (en) * | 2020-12-28 | 2021-04-09 | 浙江大华技术股份有限公司 | Human body posture detection method and device and computer equipment |
| CN112987933A (en) * | 2021-03-25 | 2021-06-18 | 北京市商汤科技开发有限公司 | Device control method, device, electronic device and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115826427A (en) * | 2023-01-31 | 2023-03-21 | 黑龙江八一农垦大学 | Man-machine interaction system applied to smart home |
| CN115826427B (en) * | 2023-01-31 | 2024-02-09 | 黑龙江八一农垦大学 | Man-machine interaction system applied to intelligent home |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106598335B (en) | A kind of touch screen control method, device and mobile terminal of mobile terminal | |
| Moon et al. | Multiple kinect sensor fusion for human skeleton tracking using Kalman filtering | |
| US10115286B2 (en) | Method for providing health service and refrigerator therefor | |
| CN107643828B (en) | Vehicle and method of controlling vehicle | |
| CN110674696B (en) | Monitoring method, device, system, monitoring equipment and readable storage medium | |
| US8279039B2 (en) | Using touches to transfer information to a device | |
| CN111105852B (en) | Electronic medical record recommendation method, device, terminal and storage medium | |
| CN109005336B (en) | Image shooting method and terminal equipment | |
| CN106681636B (en) | Method and device for preventing false touch and mobile terminal | |
| CN104881122A (en) | Somatosensory interactive system activation method and somatosensory interactive method and system | |
| CN113918019A (en) | Gesture recognition control method and device for terminal equipment, terminal equipment and medium | |
| US20220202112A1 (en) | Smart fabric that recognizes objects and touch input | |
| CN108021897A (en) | Picture answering method and device | |
| CN113610023A (en) | Device control method, device and storage medium | |
| Čopič Pucihar et al. | The missing interface: micro-gestures on augmented objects | |
| CN111103981B (en) | Control instruction generation method and device | |
| CN106598422B (en) | hybrid control method, control system and electronic equipment | |
| CN111383138A (en) | Catering data processing method and device, computer equipment and storage medium | |
| WO2015164518A1 (en) | Depth-based mode switching for touchless gestural interfaces | |
| CN112818733B (en) | Information processing method, device, storage medium and terminal | |
| CN108983956B (en) | Somatosensory interaction method and device | |
| CN109712085B (en) | Image processing method and terminal equipment | |
| CN112613490B (en) | Behavior recognition method and device, machine readable medium and equipment | |
| CN112540686A (en) | Intelligent ring, method for determining working mode of ring and electronic equipment | |
| CN110163185B (en) | Vein image acquisition method and related product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |