CN111258419B - Electronic device control method and device, electronic device and computer readable storage medium - Google Patents
Electronic device control method and device, electronic device and computer readable storage medium Download PDFInfo
- Publication number
- CN111258419B CN111258419B CN202010021741.3A CN202010021741A CN111258419B CN 111258419 B CN111258419 B CN 111258419B CN 202010021741 A CN202010021741 A CN 202010021741A CN 111258419 B CN111258419 B CN 111258419B
- Authority
- CN
- China
- Prior art keywords
- image
- target
- millimeter waves
- limb
- control instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
Abstract
The application relates to an electronic equipment control method and device, electronic equipment and a computer readable storage medium, which are applied to the electronic equipment and used for transmitting millimeter waves through an antenna module, wherein the millimeter waves are used for detecting limb actions aiming at the electronic equipment. And receiving target millimeter waves through the antenna module, wherein the target millimeter waves are obtained by reflecting the millimeter waves through limb actions. And imaging the limb action according to the target millimeter wave, acquiring a target control instruction based on the image of the limb action, and controlling the electronic equipment to execute the target control instruction. The millimeter waves are transmitted through the antenna module, the target millimeter waves reflected by the limb actions are captured through the antenna module, and the limb actions are imaged according to the target millimeter waves by utilizing the strong space resolution and imaging capability of the millimeter waves. And finally, acquiring a target control instruction based on the image of the limb action, and controlling the electronic equipment to execute the target control instruction. The method and the device realize that the user can more quickly and accurately control the electronic equipment under the condition of not touching the electronic equipment.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to an electronic device control method and apparatus, an electronic device, and a computer-readable storage medium.
Background
With the continuous development of the related technologies of the intelligent terminal, the intelligent terminal plays an indispensable important role in daily life and work of people. The intelligent terminal is used more and more frequently, the man-machine interaction of the existing intelligent terminal is mostly realized through a touch screen, but the man-machine interaction is difficult to realize and fast to realize when a user inconveniently uses the touch screen under some conditions.
Disclosure of Invention
The embodiment of the application provides an electronic device control method and device, an electronic device and a computer readable storage medium, which can more accurately realize control on the electronic device.
An electronic device control method, the electronic device including an antenna module, the method comprising:
emitting millimeter waves through the antenna module, wherein the millimeter waves are used for detecting limb actions aiming at the electronic equipment;
receiving target millimeter waves through the antenna module, wherein the target millimeter waves are obtained by reflecting the millimeter waves through the limb actions;
imaging the limb action according to the target millimeter waves, acquiring a target control instruction based on the image of the limb action, and controlling the electronic equipment to execute the target control instruction.
An electronic device control apparatus applied to an electronic device, the apparatus comprising:
the millimeter wave transmitting module is used for transmitting millimeter waves through the antenna module, and the millimeter waves are used for detecting the limb action of the electronic equipment;
the millimeter wave receiving module is used for receiving target millimeter waves through the antenna module, and the target millimeter waves are obtained by reflecting the millimeter waves through the limb actions;
and the control module is used for imaging the limb action according to the target millimeter wave, acquiring a target control instruction based on the image of the limb action, and controlling the electronic equipment to execute the target control instruction.
An electronic device comprises an antenna module for transmitting and receiving millimeter waves, a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to execute the steps of the electronic device control method.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the electronic device control method as described above.
The electronic equipment control method and device, the electronic equipment and the computer readable storage medium are applied to the electronic equipment, and the millimeter waves are transmitted through the antenna module and used for detecting the limb movement of the electronic equipment. And receiving target millimeter waves through the antenna module, wherein the target millimeter waves are obtained by reflecting the millimeter waves through limb actions. And imaging the limb action according to the target millimeter wave, acquiring a target control instruction based on the image of the limb action, and controlling the electronic equipment to execute the target control instruction. The millimeter waves are transmitted through the antenna module, the target millimeter waves reflected by the limb actions are captured through the antenna module, and the limb actions are imaged according to the target millimeter waves by utilizing the strong space resolution and imaging capability of the millimeter waves. And finally, acquiring a target control instruction based on the image of the limb action, and controlling the electronic equipment to execute the target control instruction. By imaging the millimeter waves reflected by the limb movement, the image of the limb movement can be accurately obtained. Because the accuracy of the limb movement identified by the millimeter waves is higher, the accuracy of controlling the electronic equipment according to the target control instruction corresponding to the limb movement is further improved. Therefore, the electronic equipment can be controlled more quickly and accurately through the motion of the limbs separated from the space under the condition that the user does not touch the electronic equipment.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram showing an internal structure of an electronic apparatus according to an embodiment;
FIG. 2 is a diagram showing an application environment of a control method of an electronic device according to an embodiment;
FIG. 3 is a flow chart of a method for controlling an electronic device according to an embodiment;
FIG. 4 is a flowchart of a method for imaging a limb movement according to the target millimeter waves, acquiring a target control command based on the limb movement image, and controlling the electronic device to execute the target control command in FIG. 3;
FIG. 5 is a flowchart illustrating a method for receiving target millimeter waves via the antenna module shown in FIG. 3;
FIG. 6 is a flow chart of a method for controlling an electronic device in accordance with an exemplary embodiment;
FIG. 7 is a block diagram showing the construction of an electronic device control apparatus according to an embodiment;
FIG. 8 is a block diagram of the control module of FIG. 7;
fig. 9 is a block diagram showing a structure of an electronic device control apparatus in another embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Fig. 1 is a schematic diagram of an internal structure of an electronic device in one embodiment. As shown in fig. 1, the electronic device includes a processor and a memory connected by a system bus. Wherein, the processor is used for providing calculation and control capability and supporting the operation of the whole electronic equipment. The memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program can be executed by a processor to implement an electronic device control method provided in the following embodiments. The internal memory provides a cached execution environment for the operating system computer programs in the non-volatile storage medium. The electronic equipment can be various mobile phones, computers, portable equipment and the like.
Fig. 2 is a diagram of an application scenario of the control method of the electronic device. The electronic device 220 includes an antenna module 222, where the antenna module 222 includes at least one millimeter wave transceiver antenna disposed inside a display screen of the electronic device or in a frame region of the electronic device, and the millimeter wave transceiver antenna is configured to transmit millimeter waves and receive target millimeter waves formed by the millimeter waves reflected by the limbs. The antenna module 222 may further include at least one millimeter wave transmitting antenna and at least one millimeter wave receiving antenna, where the millimeter wave transmitting antenna and the millimeter wave receiving antenna are disposed inside a display screen of the electronic device or in a frame region of the electronic device, the millimeter wave transmitting antenna is configured to transmit millimeter waves, and the millimeter wave receiving antenna is configured to receive target millimeter waves formed by the millimeter waves reflected by the limbs. Due to the high working frequency of the millimeter wave, large signal bandwidth (such as gigahertz magnitude) and Doppler frequency shift can be obtained, which is beneficial to improving the measurement precision and resolution capability of distance and speed and analyzing the detail characteristics of the target. Meanwhile, the millimeter wave energy can distinguish and identify very small targets, and can simultaneously identify a plurality of targets, so that the millimeter wave energy has very strong spatial resolution and imaging capability. Therefore, the limb movement can be accurately imaged according to the target millimeter waves, and the accuracy of controlling the electronic equipment through the limb movement is improved.
Fig. 3 is a flowchart of an electronic device control method applied to an electronic device according to an embodiment, and as shown in fig. 3, the electronic device control method includes steps 320 to 360.
And 320, transmitting millimeter waves through the antenna module, wherein the millimeter waves are used for detecting the limb movement of the electronic equipment.
The millimeter wave is a section of radio wave, and generally, an electromagnetic wave with a wavelength of 1-10 mm is called millimeter wave, and the millimeter wave is located in a wavelength range where microwave and far-infrared wave are overlapped, so that the millimeter wave has the characteristics of two spectrums. The millimeter wave can distinguish and identify small targets, can simultaneously identify a plurality of targets, and has strong spatial resolution and imaging capabilities, so that the millimeter waves are transmitted through the antenna module, and the millimeter waves can detect the limb actions aiming at the electronic equipment. The limb movement is a movement realized by the coordinated movement of human body parts such as the head, eyes, neck, hands, elbows, arms, body, crotch, feet and the like of the user. The limb actions in the embodiment of the present application refer to the isolated gesture of the user, and certainly, other limb actions of the user may also be included, which is not limited in the present application.
And 340, receiving the target millimeter wave through the antenna module, wherein the target millimeter wave is obtained by reflecting the millimeter wave through limb actions.
The millimeter waves transmitted by the antenna module form target millimeter waves after being reflected by limb actions. And receiving the target millimeter wave through the antenna module. Millimeter waves can sense all limb movements within the spatial range covered, but partial limb movements are not effective limb movements. For example, if it is set in the electronic device that only the limb motion of the corresponding target user is the effective limb motion, the antenna module can be used as the target millimeter wave only when receiving the millimeter wave reflected by the limb motion of the target user.
And step 360, imaging the limb action according to the target millimeter waves, acquiring a target control instruction based on the image of the limb action, and controlling the electronic equipment to execute the target control instruction.
The limb movement can be imaged through the target millimeter waves, and an image of the limb movement is obtained. The electronic device stores the corresponding relation between the preset limb movement and the corresponding target control instruction in advance, so that the target control instruction can be acquired based on the image of the limb movement. And controlling the electronic equipment to execute the target control instruction.
And conventionally, some conventional ways determine whether the limb movement of the user is consistent with the limb movement stored in the electronic device, for example, by calculating power data of the reflected millimeter waves, and trigger a corresponding control instruction. Since the millimeter waves are easily absorbed by oxygen, water vapor, rainfall and the like in the atmosphere to cause serious signal attenuation, it is obviously impossible to ensure that the heights of oxygen concentration, humidity and the like in the test environment and the actual use environment are consistent in practice, the calculated millimeter wave power is easily influenced by external factors to greatly change, and the control instruction corresponding to the limb action of the user cannot be accurately acquired according to the millimeter wave power.
The target millimeter waves reflected by the limb actions are received, the limb actions are imaged according to the target millimeter waves, and finally, the images of the limb actions imaged by the millimeter waves are obtained. Because the image has more characteristics and more information relative to the millimeter wave power, and can dilute the external interference in the imaging process, the external interference in the millimeter wave imaging process is relatively small, and the accuracy of finally acquiring the target control instruction is high.
In the embodiment of the application, millimeter waves are transmitted through the antenna module and used for detecting the limb action of the electronic equipment. And receiving target millimeter waves through the antenna module, wherein the target millimeter waves are obtained by reflecting the millimeter waves through limb actions. And imaging the limb action according to the target millimeter wave, acquiring a target control instruction based on the image of the limb action, and controlling the electronic equipment to execute the target control instruction. The millimeter waves are transmitted through the antenna module, the target millimeter waves reflected by the limb actions are captured through the antenna module, and the limb actions are imaged according to the target millimeter waves by utilizing the strong space resolution and imaging capability of the millimeter waves. And finally, acquiring a target control instruction based on the image of the limb action, and controlling the electronic equipment to execute the target control instruction. The millimeter waves reflected by the limb movement are imaged, so that the image of the limb movement can be accurately obtained. Because the accuracy of the limb movement identified by the millimeter waves is higher, the accuracy of controlling the electronic equipment according to the target control instruction corresponding to the limb movement is further improved. Therefore, the electronic equipment can be controlled more quickly and accurately through the motion of the limbs separated from the space under the condition that the user does not touch the electronic equipment.
In one embodiment, as shown in fig. 4, step 360, imaging the limb movement according to the target millimeter wave, acquiring a target control command based on the image of the limb movement, and controlling the electronic device to execute the target control command includes:
362, imaging the limb movement according to the target millimeter wave to obtain an image of the limb movement;
364, judging whether the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold value;
366, when the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold value, acquiring a control instruction corresponding to the image of the preset limb movement as a target control instruction;
368, the control electronics execute the target control instructions.
Specifically, after the target millimeter waves are received through the antenna module, the limb movement can be imaged according to the target millimeter waves, and an image of the limb movement is obtained. Since the corresponding relationship between the preset limb movement and the target control command is pre-stored in the electronic device, it is necessary to determine whether the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold. When the similarity between the image of the limb action and the image of the preset limb action is higher than a set threshold value, the similarity between the limb action reflecting the millimeter waves and the preset limb action meets the requirement, and at the moment, a control instruction corresponding to the image of the preset limb action is acquired as a target control instruction to control the electronic equipment to execute the target control instruction. The preset threshold may be set according to the situation, for example, the preset threshold may be set to 80%, and of course, other reasonable values may also be used, which is not limited in this application.
The electronic device stores a corresponding relationship between the preset limb action and the target control instruction in advance, for example, the electronic device stores a corresponding relationship between the preset limb action, the hand cranking and the hanging up telephone in advance, so that when a call comes from the electronic device, the electronic device transmits millimeter waves through the antenna module and receives target millimeter waves. If the target millimeter waves received by the electronic equipment are reflected by the limb movement of the target user when the target user shakes the hands, the target millimeter waves are received by the electronic equipment, and the target millimeter waves are used for imaging the limb movement to obtain an image of the limb movement. And then judging that the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold value. And acquiring a control instruction corresponding to the image of the preset limb action-hand cranking as a target control instruction, and then controlling the electronic equipment to execute a call hanging-up instruction.
And receiving the target millimeter waves reflected by the limb movement, imaging the limb movement according to the target millimeter waves, and finally obtaining an image of imaging the limb movement through the millimeter waves. Because the image contains more features, the external interference in the imaging process can be diluted, so that the external interference in the millimeter wave imaging process is relatively small. Then, the similarity of the millimeter wave imaged limb movement image and the preset limb movement image is compared, so that the accuracy of finally obtaining the target control instruction is higher.
In the embodiment of the application, because the corresponding relation between the preset limb action and the target control instruction is stored in the electronic device in advance, after the target millimeter waves are obtained, the similarity comparison is performed between the limb action image corresponding to the target millimeter waves and the image of the preset limb action. And judging whether to acquire a control instruction corresponding to the image of the preset limb movement according to the similarity comparison result, and executing the control instruction. Therefore, the electronic equipment is controlled remotely through the isolated limb actions of the user without directly controlling the electronic equipment through a touch screen or pressing a button and the like by the user.
In one embodiment, there is provided an electronic device control method, further comprising:
imaging the preset limb action through millimeter waves to obtain an image of the preset limb action, and recording the image of the preset limb action into the electronic equipment;
establishing a corresponding relation between the image of the preset limb action and the corresponding control instruction;
when the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold, acquiring a control instruction corresponding to the image of the preset limb movement as a target control instruction, wherein the control instruction comprises the following steps:
and when the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold value, acquiring a control instruction corresponding to the image of the preset limb movement as a target control instruction according to the corresponding relation between the image of the preset limb movement and the corresponding control instruction.
Specifically, before the electronic device is remotely controlled through the limb movement of the user, firstly, shooting and recording the preset limb movement into the electronic device through millimeter waves. For example, the preset limb motions include a preset gesture motion, a preset arm motion, a preset head motion, a preset facial five sense organ motion, and the like. The preset gesture actions include hand shaking, hand waving, OK gesture making, single-finger sliding in a certain direction and the like. The preset head actions include head shaking, head nodding, and the like. The preset facial five sense organs actions comprise blinking, mouth opening and the like.
Secondly, establishing a corresponding relation between the image of the preset limb action and the corresponding control command in the electronic equipment. For a preset gesture action, for example, establishing a corresponding relation between a hand crank and a control instruction of hanging up a telephone; establishing a corresponding relation between control instructions of waving hands, making OK gestures and making a call; and establishing a corresponding relation between the control instruction of sliding the single finger to the right and unlocking the screen, and the like. The method is not exhaustive, and can also establish more corresponding relations between limb actions and control instructions, so that a user can still freely use the electronic equipment when the user inconveniently adopts a touch screen or key mode.
After the corresponding relation between the preset limb action image and the corresponding control instruction is established, when millimeter waves are transmitted and received through an antenna module on the electronic equipment, the limb action is imaged according to the target millimeter waves. And judging whether the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold value, and when the similarity between the image of the limb movement and the image of the preset limb movement is higher than the set threshold value, acquiring a control instruction corresponding to the image of the preset limb movement as a target control instruction according to the corresponding relation between the image of the preset limb movement and the corresponding control instruction, and controlling the electronic equipment to execute the target control instruction.
In the embodiment of the application, the preset limb action is shot and recorded into the electronic equipment through the millimeter waves, and the corresponding relation between the image of the preset limb action and the corresponding control instruction is established. And when the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold value, acquiring a control instruction corresponding to the image of the preset limb movement as a target control instruction according to the corresponding relation between the image of the preset limb movement and the corresponding control instruction. Because the similarity is judged, and the limb actions are matched based on the corresponding relation, the user can accurately and remotely control the electronic equipment in a remote way and in a way of separating the limb actions, and the phenomenon that the limb actions are mistakenly identified and mistaken control is carried out is avoided.
In one embodiment, there is provided an electronic device control method, further comprising:
shooting and recording the limb actions controlled by the alarm clock into the electronic equipment;
establishing a corresponding relation between an image of the limb action controlled by the alarm clock and an alarm clock control instruction;
when the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold, acquiring a control instruction corresponding to the image of the preset limb movement as a target control instruction, wherein the control instruction comprises the following steps:
and when the similarity between the image of the limb movement and the image of the limb movement controlled by the alarm clock is higher than a set threshold value, acquiring an alarm clock control instruction corresponding to the image of the limb movement controlled by the alarm clock as a target control instruction according to the corresponding relation between the image of the limb movement controlled by the alarm clock and the alarm clock control instruction.
Specifically, in an application scenario of controlling an alarm clock on the electronic device, firstly, the limb movement controlled by the alarm clock is shot and recorded into the electronic device. For example, alarm clock controlled limb movements include gesture movements, arm movements, head movements, facial five sense organ movements, and the like. The gesture actions include hand shaking, hand waving, OK gesture making, single-finger sliding in a certain direction and the like. Head movements include shaking the head, nodding the head, etc. Facial five sense organs movements include blinking, mouth opening, etc.
And secondly, establishing a corresponding relation between the image of the limb action controlled by the alarm clock and the corresponding control instruction in the electronic equipment. For gesture actions, for example, establishing a corresponding relation between a hand crank and a control instruction for turning off an alarm clock; establishing the corresponding relation between the waving hand, the OK gesture and the later reminding of the control instruction, and the like. The method is not exhaustive, and can also establish more corresponding relations between limb actions and control instructions, so that a user can still control the alarm clock on the electronic equipment when the user inconveniently adopts a touch screen or key pressing mode.
After the corresponding relation between the image of the limb action controlled by the alarm clock and the corresponding control instruction is established, when millimeter waves are transmitted and received through an antenna module on the electronic equipment, the limb action is imaged according to target millimeter waves. And judging whether the similarity between the image of the limb movement and the image of the limb movement controlled by the alarm clock is higher than a set threshold value, and when the similarity between the image of the limb movement and the image of the limb movement controlled by the alarm clock is higher than the set threshold value, acquiring a control instruction corresponding to the image of the limb movement controlled by the alarm clock as a target control instruction according to the corresponding relation between the image of the limb movement controlled by the alarm clock and the corresponding control instruction, and controlling the electronic equipment to execute the target control instruction.
In the embodiment of the application, firstly, the alarm clock is generally used for waking up a user, so when the electronic equipment is not beside the user and is placed at a place far away from the bed, the user needs to get up to find the electronic equipment, and then the alarm clock is operated in a touch screen or key pressing mode. If the user does not want to get up at this moment, the alarm clock cannot be operated, so that the alarm clock continuously influences rest of other people. By adopting the method, the remote control of the electronic equipment is realized by detecting the limb movement through the millimeter waves, so that the real-time control of the alarm clock is more conveniently realized. And the millimeter waves can penetrate through the wall, so that the partition wall can be used for controlling the electronic equipment. Secondly, because the similarity between the image of the limb action detected by the millimeter waves and the image of the limb action controlled by the alarm clock is judged, and then the matching of the limb action is carried out based on the corresponding relation, the alarm clock on the electronic equipment is accurately and remotely controlled by a user in a remote way and in a way of separating the limb action, and the phenomenon that the limb action is mistakenly identified and mistakenly controlled is avoided.
In one embodiment, as shown in fig. 5, in step 340, receiving the target millimeter wave through the antenna module, where the target millimeter wave is obtained by reflecting the millimeter wave through the body motion, and the step includes:
The antenna module receives the millimeter waves transmitted by the face area first and images the face area. Or the antenna module receives the millimeter waves reflected in the space covered by the millimeter waves, and the human face is imaged through the millimeter waves.
In step 344, it is determined whether the similarity between the face image and the target face image is higher than a set threshold.
After the face in the space covered by the millimeter waves is imaged, whether the similarity between the face image and the target face image is higher than a set threshold value or not is judged. The target face image is recorded in advance through the camera and stored on the electronic equipment. In general, the target face image is a face image of a target user of the electronic device, for example, a face image of a registrant of the electronic device, and the number of the target face images may be one or more.
And sequentially comparing the similarity of the plurality of face images in the space covered by the millimeter waves with the target face image to obtain the face image with the similarity higher than a set threshold value. Because the millimeter waves are continuously emitted and imaging is also carried out in real time, after a face image with the similarity higher than a set threshold value is acquired, the limb action of a person corresponding to the face is locked to carry out millimeter wave imaging, namely the millimeter waves reflected by the limb action corresponding to the face are determined to be target millimeter waves, and the target millimeter waves are received through the antenna module. For example, the direction of the target user is not known at first, so that the millimeter wave is transmitted in all directions first. After a target user is determined from a plurality of face images in the space covered by the millimeter waves, the millimeter waves can be directly emitted to the direction of the target user in a directional mode, and the limb action of the target person is locked to perform millimeter wave imaging. Because the attenuation of the millimeter waves is small during directional transmission, the millimeter waves can be transmitted farther and the signal strength is improved at the same time, and therefore the limb actions of the target user can be accurately acquired by adopting a directional transmission mode after the target user is determined.
In the embodiment of the application, when the antenna module receives millimeter waves reflected by the limb motions of the multiple main bodies, whether the millimeter waves are reflected by the limb motions of the target user of the electronic device is accurately judged. Firstly, a human face corresponding to millimeter waves received by an antenna module is imaged. Secondly, whether the similarity between the face image and the target face image is higher than a set threshold value or not is judged, and when the similarity between the face image and the target face image is higher than the set threshold value, the face image is the face image of the target user. And finally, receiving the millimeter waves reflected by the limb actions corresponding to the target user through the antenna module to serve as target millimeter waves. Thus, the determined target millimeter wave is not only reflected by the preset limb action, but also reflected by the preset limb action of the target user. Furthermore, the accuracy of controlling the electronic equipment through the limb actions is improved, and the control of the electronic equipment by other users is prevented from being interfered.
In one embodiment, transmitting millimeter waves through an antenna module comprises:
and transmitting the millimeter waves to the preset direction through the antenna module in the preset time period.
Specifically, because the antenna module needs to consume more energy to transmit the millimeter waves, the antenna module is allowed to transmit the millimeter waves only when necessary. For example, in an application scenario of controlling an alarm clock on an electronic device, after the alarm clock sounds for a preset duration, if the alarm clock is not controlled by a user through a touch screen or a button, an antenna module is started to transmit millimeter waves. And the time length for starting the antenna module to transmit the millimeter waves is also set as the fixed time length, so that the power waste for transmitting the millimeter waves caused by not receiving the body actions for a long time is avoided. The preset time for the alarm clock to sound can be set to be 2 minutes or other time, and the application does not limit the time. The time period for transmitting the millimeter wave may be set to 5 minutes or other time periods, which is not limited in this application.
In addition, the millimeter waves can be transmitted to the preset direction through the antenna module in the preset time period, and the preset direction can be set according to the use scene. For example, in an application scenario of controlling an alarm clock on an electronic device, a general antenna module emits millimeter waves in a direction of a bedroom, because a target user of the electronic device generally takes a rest in the bedroom. Of course, if the target user is stationary and will have a rest in the main lying position, the antenna module may be set to emit millimeter waves in the main lying direction. There are, of course, other situations that exist and are not intended to be limiting of the present application.
In the embodiment of the application, because the antenna module needs to consume more energy for transmitting the millimeter waves, the millimeter waves can be transmitted to the preset direction through the antenna module in the preset time period when the millimeter waves are transmitted through the antenna module. Therefore, the time period and the direction for transmitting the millimeter waves can be set, so that the electric quantity waste caused by the transmission of the millimeter waves for a long time in a large range is reduced while the target millimeter waves are captured more accurately.
In one embodiment, the control instructions include a screen-up/screen-down instruction, a listen/hang-up instruction, and an unlock/lock instruction.
Specifically, the preset limb actions are shot and recorded into the electronic equipment, and the corresponding relation between the images of the preset limb actions and the corresponding control instructions is established. For example, the control instruction includes a screen-on/screen-off instruction, a listening/hanging-up instruction, an unlocking/locking instruction, etc., and may also include other more complex control instructions, so as to replace the traditional touch screen or key operation. The problem that when a user is inconvenient to perform touch screen or key operation (for example, when the user is wet hands or takes both hands) is solved, limb actions are adopted to perform remote control on the electronic device.
In the embodiment of the application, the preset limb actions are shot and recorded into the electronic equipment, and the corresponding relation between the images of the preset limb actions and the corresponding control instructions is established. The control instructions comprise screen lightening/screen turning-off instructions, answering/hanging-up instructions, unlocking/locking instructions and the like, and can also comprise other more complex control instructions so as to replace the traditional touch screen or key operation. The problem that a user adopts limb actions to remotely control the electronic equipment when the user is inconvenient to touch a screen or press keys is solved. Meanwhile, the operation mode of man-machine interaction is more diversified and interesting.
In a specific embodiment, as shown in fig. 6, there is provided an electronic device control method, applied in a scenario of controlling an alarm clock on an electronic device, including the following steps:
step 602, shooting and recording the limb actions controlled by the alarm clock into the electronic equipment through millimeter waves;
step 604, establishing a corresponding relation between the alarm clock control instruction and the image of the limb movement controlled by the alarm clock;
at step 618, the control electronics execute the target control command.
In the embodiment of the application, the body action controlled by the alarm clock is shot in advance and recorded into the electronic equipment, and the corresponding relation between the image of the body action controlled by the alarm clock and the alarm clock control instruction is established. And then, in an application scene of controlling the alarm clock on the electronic equipment, transmitting millimeter waves to a preset direction through the antenna module at a preset time period. Further, the millimeter waves reflected not only by the preset limb movement but also by the preset limb movement of the target user are acquired as target millimeter waves. And the strong space resolution and imaging capability of the millimeter waves are utilized to image the limb actions according to the target millimeter waves. And finally, acquiring a target control instruction based on the image of the limb action, and controlling the electronic equipment to execute the target control instruction. The remote control of the electronic equipment is realized under the condition that a user does not touch the electronic equipment.
In one embodiment, as shown in fig. 7, there is also provided an electronic device control apparatus 700, including:
the millimeter wave transmitting module 720 is used for transmitting millimeter waves through the antenna module, and the millimeter waves are used for detecting limb actions aiming at the electronic equipment;
the millimeter wave receiving module 740 is configured to receive a target millimeter wave through the antenna module, where the target millimeter wave is obtained by reflecting the millimeter wave through a limb action;
and the control module 760 is configured to image the limb movement according to the target millimeter wave, acquire a target control instruction based on the image of the limb movement, and control the electronic device to execute the target control instruction.
In one embodiment, as shown in FIG. 8, the control module 760 includes:
a limb action imaging unit 762 for imaging the limb action according to the target millimeter wave to obtain an image of the limb action;
an image similarity determination unit 764 for determining whether the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold;
the target control instruction obtaining unit 766 is used for obtaining a control instruction corresponding to the image of the preset limb action as a target control instruction when the similarity between the image of the limb action and the image of the preset limb action is higher than a set threshold;
and a target control instruction execution unit 768 configured to control the electronic device to execute the target control instruction.
In one embodiment, as shown in fig. 9, there is also provided an electronic device control apparatus 700, further comprising: the corresponding relationship establishing module 780 is configured to image a preset limb action through millimeter waves to obtain an image of the preset limb action, and record the image of the preset limb action into the electronic device; establishing a corresponding relation between the image of the preset limb action and the corresponding control instruction;
the target control instruction obtaining unit 766 is further configured to, when the similarity between the image of the limb movement and the image of the preset limb movement is higher than the set threshold, obtain, according to the correspondence between the image of the preset limb movement and the corresponding control instruction, the control instruction corresponding to the image of the preset limb movement as the target control instruction.
In one embodiment, the correspondence establishing module 790 is further configured to shoot and record the limb movement controlled by the alarm clock into the electronic device; establishing a corresponding relation between an image of the limb action controlled by the alarm clock and an alarm clock control instruction;
the target control instruction obtaining unit 766 is further configured to, when the similarity between the image of the limb movement and the image of the limb movement controlled by the alarm clock is higher than a set threshold, obtain, according to the corresponding relationship between the image of the limb movement controlled by the alarm clock and the alarm clock control instruction, an alarm clock control instruction corresponding to the image of the limb movement controlled by the alarm clock as the target control instruction.
In an embodiment, the millimeter wave receiving module 740 is further configured to image a face corresponding to the millimeter waves received by the antenna module; judging whether the similarity between the face image and the target face image is higher than a set threshold value or not; when the similarity between the face image and the target face image is higher than a set threshold value, determining millimeter waves reflected by limb actions corresponding to the face as target millimeter waves; and receiving the target millimeter wave through the antenna module.
In an embodiment, the millimeter wave transmitting module 720 is further configured to transmit the millimeter wave to the preset direction through the antenna module in the preset time period.
In one embodiment, the control instructions include a screen-up/screen-down instruction, a listen/hang-up instruction, and an unlock/lock instruction.
The division of each module in the electronic device control apparatus is only used for illustration, and in other embodiments, the electronic device control apparatus may be divided into different modules as needed to complete all or part of the functions of the electronic device control apparatus.
The implementation of each module in the electronic device control apparatus provided in the embodiments of the present application may be in the form of a computer program. The computer program may be run on a terminal or a server. The program modules constituted by the computer program may be stored on the memory of the terminal or the server. Which when executed by a processor, performs the steps of the method described in the embodiments of the present application.
The process of the electronic device implementing the electronic device control method is as described in the above embodiments, and is not described herein again.
The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps of the electronic device control method.
A computer program product containing instructions which, when run on a computer, cause the computer to perform an electronic device control method.
Any reference to memory, storage, database, or other medium used by embodiments of the present application may include non-volatile and/or volatile memory. Suitable non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).
The above examples only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. An electronic device control method, wherein the electronic device includes an antenna module, the method comprising:
directionally transmitting millimeter waves to the position of the target user through the antenna module, wherein the millimeter waves are used for detecting the body action of the target user aiming at the electronic equipment;
receiving target millimeter waves through the antenna module, wherein the target millimeter waves are obtained by reflecting the millimeter waves through the limb actions;
imaging the limb action according to the target millimeter waves to obtain an image of the limb action;
judging whether the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold value or not;
when the similarity between the image of the limb action and the image of the preset limb action is higher than a set threshold value, acquiring a control instruction corresponding to the image of the preset limb action as a target control instruction;
and controlling the electronic equipment to execute the target control instruction.
2. The method of claim 1, further comprising:
imaging a preset limb action through millimeter waves to obtain an image of the preset limb action, and recording the image of the preset limb action into the electronic equipment;
establishing a corresponding relation between the image of the preset limb action and the corresponding control instruction;
when the similarity between the image of the limb action and the image of the preset limb action is higher than a set threshold, acquiring a control instruction corresponding to the image of the preset limb action as a target control instruction, including:
and when the similarity between the image of the limb action and the image of the preset limb action is higher than a set threshold value, acquiring a control instruction corresponding to the image of the preset limb action as a target control instruction according to the corresponding relation between the image of the preset limb action and the corresponding control instruction.
3. The method of claim 1, further comprising:
shooting and recording the limb actions controlled by the alarm clock into the electronic equipment;
establishing a corresponding relation between the image of the limb action controlled by the alarm clock and an alarm clock control instruction;
when the similarity between the image of the limb action and the image of the preset limb action is higher than a set threshold, acquiring a control instruction corresponding to the image of the preset limb action as a target control instruction, including:
and when the similarity between the limb movement image and the alarm clock controlled limb movement image is higher than a set threshold value, acquiring an alarm clock control instruction corresponding to the alarm clock controlled limb movement image as a target control instruction according to the corresponding relation between the alarm clock controlled limb movement image and the alarm clock control instruction.
4. The method of claim 1, wherein the receiving, by the antenna module, a target millimeter wave, the target millimeter wave being reflected by the millimeter wave through the limb movement, comprises:
imaging the face corresponding to the millimeter waves received by the antenna module;
judging whether the similarity between the face image and a target face image is higher than a set threshold value or not;
when the similarity between the face image and a target face image is higher than a set threshold value, determining millimeter waves reflected by limb actions corresponding to the face as target millimeter waves;
and receiving the target millimeter wave through the antenna module.
5. The method according to any one of claims 1 to 4, wherein the transmitting millimeter waves through the antenna module comprises:
and transmitting the millimeter waves to a preset direction through the antenna module in a preset time period.
6. The method of claim 1, wherein the control commands comprise a screen-on/screen-off command, a listen/hang-up command, and an unlock/lock command.
7. An electronic device control apparatus, applied to an electronic device, the apparatus comprising:
the millimeter wave transmitting module is used for directionally transmitting millimeter waves to the position of a target user through the antenna module, and the millimeter waves are used for detecting the body action of the target user on the electronic equipment;
the millimeter wave receiving module is used for receiving target millimeter waves through the antenna module, and the target millimeter waves are obtained by reflecting the millimeter waves through the limb actions;
the control module is used for imaging the limb action according to the target millimeter waves to obtain an image of the limb action; judging whether the similarity between the image of the limb movement and the image of the preset limb movement is higher than a set threshold value or not; when the similarity between the image of the limb action and the image of the preset limb action is higher than a set threshold value, acquiring a control instruction corresponding to the image of the preset limb action as a target control instruction; and controlling the electronic equipment to execute the target control instruction.
8. The apparatus of claim 7, wherein the apparatus comprises:
the corresponding relation establishing module is used for imaging the preset limb action through millimeter waves to obtain an image of the preset limb action, and recording the image of the preset limb action into the electronic equipment; establishing a corresponding relation between the image of the preset limb action and the corresponding control instruction;
and the control module is used for acquiring a control instruction corresponding to the image of the preset limb action as a target control instruction according to the corresponding relation between the image of the preset limb action and the corresponding control instruction when the similarity between the image of the limb action and the image of the preset limb action is higher than a set threshold value.
9. An electronic device, comprising an antenna module for transmitting and receiving millimeter waves, a memory and a processor, the memory having stored therein a computer program, wherein the computer program, when executed by the processor, causes the processor to perform the steps of the electronic device control method according to any one of claims 1 to 6.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the electronic device control method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010021741.3A CN111258419B (en) | 2020-01-09 | 2020-01-09 | Electronic device control method and device, electronic device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010021741.3A CN111258419B (en) | 2020-01-09 | 2020-01-09 | Electronic device control method and device, electronic device and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111258419A CN111258419A (en) | 2020-06-09 |
| CN111258419B true CN111258419B (en) | 2022-04-12 |
Family
ID=70948625
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010021741.3A Active CN111258419B (en) | 2020-01-09 | 2020-01-09 | Electronic device control method and device, electronic device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111258419B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105607745A (en) * | 2016-03-16 | 2016-05-25 | 京东方科技集团股份有限公司 | Display control circuit, display control method and display device |
| CN106537173A (en) * | 2014-08-07 | 2017-03-22 | 谷歌公司 | Radar-based gesture recognition |
| CN107979696A (en) * | 2017-11-21 | 2018-05-01 | 珠海市魅族科技有限公司 | A kind of alarm clock control method, device, computer installation and computer-readable recording medium |
| CN109188414A (en) * | 2018-09-12 | 2019-01-11 | 北京工业大学 | A kind of gesture motion detection method based on millimetre-wave radar |
| CN109407833A (en) * | 2018-09-30 | 2019-03-01 | Oppo广东移动通信有限公司 | Manipulate method, apparatus, electronic equipment and the storage medium of electronic equipment |
| CN109710078A (en) * | 2019-01-14 | 2019-05-03 | 极目光(深圳)科技有限公司 | Intelligent control method, system, receiving device and storage medium |
| CN109857251A (en) * | 2019-01-16 | 2019-06-07 | 珠海格力电器股份有限公司 | Gesture identification control method, device, storage medium and the equipment of intelligent appliance |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9335825B2 (en) * | 2010-01-26 | 2016-05-10 | Nokia Technologies Oy | Gesture control |
| KR20120051212A (en) * | 2010-11-12 | 2012-05-22 | 엘지전자 주식회사 | Method for user gesture recognition in multimedia device and multimedia device thereof |
| US9440144B2 (en) * | 2011-04-21 | 2016-09-13 | Sony Interactive Entertainment Inc. | User identified to a controller |
| US10088908B1 (en) * | 2015-05-27 | 2018-10-02 | Google Llc | Gesture detection and interactions |
| CN105955481B (en) * | 2016-04-29 | 2018-11-13 | 广东美的制冷设备有限公司 | Control method, device and the equipment of infrared gesture identifying device |
| KR20180097403A (en) * | 2017-02-23 | 2018-08-31 | 삼성전자주식회사 | Method for obtaining biometric information and appratus therefor |
| CN110174024B (en) * | 2019-03-29 | 2020-09-15 | 宋九宏 | Safety control system for portable weapon |
-
2020
- 2020-01-09 CN CN202010021741.3A patent/CN111258419B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106537173A (en) * | 2014-08-07 | 2017-03-22 | 谷歌公司 | Radar-based gesture recognition |
| CN105607745A (en) * | 2016-03-16 | 2016-05-25 | 京东方科技集团股份有限公司 | Display control circuit, display control method and display device |
| CN107979696A (en) * | 2017-11-21 | 2018-05-01 | 珠海市魅族科技有限公司 | A kind of alarm clock control method, device, computer installation and computer-readable recording medium |
| CN109188414A (en) * | 2018-09-12 | 2019-01-11 | 北京工业大学 | A kind of gesture motion detection method based on millimetre-wave radar |
| CN109407833A (en) * | 2018-09-30 | 2019-03-01 | Oppo广东移动通信有限公司 | Manipulate method, apparatus, electronic equipment and the storage medium of electronic equipment |
| CN109710078A (en) * | 2019-01-14 | 2019-05-03 | 极目光(深圳)科技有限公司 | Intelligent control method, system, receiving device and storage medium |
| CN109857251A (en) * | 2019-01-16 | 2019-06-07 | 珠海格力电器股份有限公司 | Gesture identification control method, device, storage medium and the equipment of intelligent appliance |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111258419A (en) | 2020-06-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110799927B (en) | Gesture recognition method, terminal and storage medium | |
| CN111736147B (en) | Detection device, detection method and device, and storage medium | |
| US9103899B2 (en) | Adaptive control of a personal electronic device responsive to a micro-impulse radar | |
| KR101801073B1 (en) | Non-contact gesture control method, and electronic terminal device | |
| CN107589725B (en) | Smart home equipment control method and control equipment based on built-in antenna | |
| US10921866B2 (en) | Access to high frame-rate radar data via a circular buffer | |
| CN110286744B (en) | Information processing method and device, electronic equipment and computer readable storage medium | |
| CN109284081B (en) | Audio output method and device and audio equipment | |
| US20210232228A1 (en) | Adaptive thresholding and noise reduction for radar data | |
| CN111479011A (en) | Power adjustment method, device, storage medium and electronic equipment | |
| CN111387978B (en) | Method, device, equipment and medium for detecting action segment of surface electromyographic signal | |
| WO2022110614A1 (en) | Gesture recognition method and apparatus, electronic device, and storage medium | |
| WO2021017927A1 (en) | Method and device for controlling apparatus, electronic apparatus, and storage medium | |
| EP2945156A1 (en) | Audio signal recognition method and electronic device supporting the same | |
| CN109029252B (en) | Object detection method, object detection device, storage medium, and electronic apparatus | |
| CN103581446A (en) | Scene mode switching method and electronic terminal | |
| CN111008671B (en) | Gesture recognition method and apparatus, electronic device, and computer-readable storage medium | |
| CN114422705A (en) | Electronic equipment and control method and device thereof | |
| CN111258419B (en) | Electronic device control method and device, electronic device and computer readable storage medium | |
| Wang et al. | Enabling non-invasive and real-time human-machine interactions based on wireless sensing and fog computing | |
| CN113343195A (en) | Electronic equipment and fingerprint unlocking method and fingerprint unlocking device thereof | |
| CN108027693B (en) | Method, apparatus, and computer-readable storage medium for identifying user | |
| CN111638522A (en) | Proximity detection method and electronic device | |
| CN113542606B (en) | Shooting control method, shooting control device, electronic equipment and storage medium | |
| CN113542597B (en) | Focusing method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |