CN113918012A - Control interface switching processing method and device, intelligent equipment and terminal - Google Patents
Control interface switching processing method and device, intelligent equipment and terminal Download PDFInfo
- Publication number
- CN113918012A CN113918012A CN202111131558.XA CN202111131558A CN113918012A CN 113918012 A CN113918012 A CN 113918012A CN 202111131558 A CN202111131558 A CN 202111131558A CN 113918012 A CN113918012 A CN 113918012A
- Authority
- CN
- China
- Prior art keywords
- user
- wireless network
- interface
- intelligent equipment
- control program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 7
- 230000006399 behavior Effects 0.000 claims description 52
- 238000000034 method Methods 0.000 claims description 44
- 238000012545 processing Methods 0.000 claims description 23
- 230000009471 action Effects 0.000 claims description 22
- 230000008859 change Effects 0.000 claims description 20
- 238000004458 analytical method Methods 0.000 claims description 8
- 238000003062 neural network model Methods 0.000 claims description 7
- 230000009467 reduction Effects 0.000 claims description 5
- 230000001960 triggered effect Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000000513 principal component analysis Methods 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 230000010247 heart contraction Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72406—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by software upgrading or downloading
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Telephone Function (AREA)
Abstract
The application relates to a switching processing method of control interfaces, a device, intelligent equipment and a terminal, belonging to the technical field of intelligent equipment control, in the practical application of the application, a control program in a user terminal can establish wireless connection with a plurality of intelligent equipment, each intelligent equipment is triggered by establishing the wireless connection to identify the human behavior of a user using the user terminal by utilizing wireless network signals, the human behavior of the user can indicate which intelligent equipment is a target object of the user, when a certain intelligent equipment determines that the target object of the user is the user through the identified human behavior, the certain intelligent equipment sends interface switching instruction information to the control program, the control program switches the program interface to the control interface controlling the certain intelligent equipment based on the interface switching instruction information sent by the certain intelligent equipment, thereby realizing the automatic switching of the control interface in the control program, the switching is not required to be manually operated by a user.
Description
Technical Field
The application belongs to the technical field of intelligent device control, and particularly relates to a switching processing method and device of a control interface, an intelligent device and a terminal.
Background
In the related art, a user may utilize a control program for an intelligent device in a user terminal (e.g., a smart phone) of the user to execute a corresponding control instruction by performing a control operation on the control program. In the practical application, there is a problem that, for the control operation of different intelligent devices, a user needs to manually switch to a corresponding control interface, for example, an air conditioner, a television and other intelligent devices are added to the control program, if the current program interface of the control program is a control interface for the television, when the user wants to control the air conditioner, the user needs to select the air conditioner first, switch the current program interface to the control interface for the air conditioner, and then control the air conditioner, which increases the operation steps of the user.
Disclosure of Invention
Therefore, the application provides a switching processing method and device of a control interface, an intelligent device and a terminal, so as to solve the problem that a user needs to manually switch to a corresponding control interface to increase user operation steps aiming at control operations of different intelligent devices.
In order to achieve the purpose, the following technical scheme is adopted in the application:
in a first aspect, the present application provides a method for switching a control interface, where the method is applied to an intelligent device, and the method includes:
after establishing wireless network connection with a control program in a user terminal, identifying human body behaviors of a user using the user terminal based on wireless network signals, and determining whether a target object of the user is the intelligent equipment or not by using the human body behaviors of the user;
and if so, sending interface switching instruction information to the control program so that the control program switches the program interface to the control interface aiming at the intelligent equipment based on the interface switching instruction information.
Further, the control program is in the form of an applet.
Further, after establishing a wireless network connection with a control program in a user terminal, identifying a human behavior of a user using the user terminal based on a wireless network signal, and determining whether a target object of the user is the smart device by using the human behavior of the user, includes:
after wireless network connection with the control program is established, positioning recognition, action posture recognition and orientation recognition are carried out on the user by utilizing wireless network signals;
if the position of the user relative to the intelligent device is determined to be within a preset position range and the distance between the user and the intelligent device is determined to be within a preset distance range based on the positioning recognition, and if the preset action gesture exists in the user based on the action gesture recognition, the user is determined to be towards the intelligent device based on the orientation recognition, and then the target object of the user is determined to be the intelligent device.
Further, the identifying human body behavior of the user using the user terminal based on the wireless network signal includes:
extracting a characteristic value of wireless network signal waveform change aiming at a wireless network signal;
and based on the characteristic value, utilizing a trained neural network model to identify the human body behaviors of the user.
Further, the extracting, for the wireless network signal, a characteristic value of a wireless network signal waveform change includes:
carrying out frequency analysis on the channel state information by discrete wavelet transform aiming at wireless network signals;
aiming at the frequency analysis result, obtaining an upper limit cut-off frequency and a center frequency by using a percentile algorithm;
and determining the upper limit cut-off frequency and the center frequency as the characteristic value of the wireless network signal waveform change.
Further, before extracting the characteristic value of the wireless network signal waveform change, the method further comprises:
and performing noise reduction processing and/or redundancy removal processing on the wireless network signals.
In a second aspect, the present application provides a switching processing apparatus for a control interface, where the apparatus is applied to an intelligent device, and the apparatus includes:
the identification determining module is used for identifying human body behaviors of a user using the user terminal based on wireless network signals after establishing wireless network connection with a control program in the user terminal, and determining whether a target object of the user is the intelligent equipment or not by using the human body behaviors of the user;
and the interface switching instruction sending module is used for sending interface switching instruction information to the control program if the interface switching instruction information is received, so that the control program switches the program interface to the control interface aiming at the intelligent equipment based on the interface switching instruction information.
In a third aspect, the present application provides a smart device, comprising:
a memory having an executable program stored thereon;
a processor for executing the executable program in the memory to implement the steps of the method of any one of the above applied to a smart device.
In a fourth aspect, the present application provides a method for switching a control interface, where the method is applied to a control program for an intelligent device in a user terminal, and the method includes:
establishing wireless network connection with the intelligent equipment to trigger the intelligent equipment to recognize human body behaviors of a user using the user terminal based on wireless network signals, and sending interface switching instruction information to the control program when the target object of the user is determined to be the intelligent equipment by using the human body behaviors of the user;
and when the interface switching instruction information is received, switching a program interface to a control interface aiming at the intelligent equipment based on the interface switching instruction information.
Further, the control program is in the form of an applet.
In a fifth aspect, the present application provides a device for switching a control interface, where the device is applied to a control program for an intelligent device in a user terminal, and the device includes:
the connection establishment triggering module is used for establishing wireless network connection with the intelligent equipment so as to trigger the intelligent equipment to identify human behaviors of a user using the user terminal based on wireless network signals, and sending interface switching instruction information to the control program when the target object of the user is determined to be the intelligent equipment by using the human behaviors of the user;
and the interface switching instruction module is used for switching a program interface to a control interface aiming at the intelligent equipment based on the interface switching instruction information when the interface switching instruction information is received.
In a sixth aspect, the present application provides a user terminal, including:
a memory having an executable program stored thereon;
a processor for executing the executable program in the memory to implement the steps of the method as applied to a control program in any of the above.
This application adopts above technical scheme, possesses following beneficial effect at least:
in practical application of the application, the control program in the user terminal can establish wireless connection with a plurality of intelligent devices, trigger each intelligent device to utilize wireless network signals by establishing wireless connection, the human behavior of the user using the user terminal is identified, the human behavior of the user can indicate which intelligent device the target object of the user is, when a certain intelligent device determines that the target object of the user is the user through the recognized human behavior, the certain intelligent device sends interface switching instruction information to the control program, the control program switches the program interface to the control interface for controlling the certain intelligent device based on the interface switching instruction information sent by the certain intelligent device, therefore, automatic switching of a control interface in the control program is realized, manual operation switching of a user is not needed, the control intelligence of the intelligent equipment can be improved, and the use experience of the user on the control program is further improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow diagram illustrating a method for switching processing of a control interface in accordance with an exemplary embodiment;
FIG. 2 is a flowchart illustrating an implementation of step S11 of FIG. 1 according to an exemplary embodiment;
FIG. 3 is a block diagram illustrating a switch handling apparatus of a control interface in accordance with an exemplary embodiment;
FIG. 4 is a block diagram schematic diagram illustrating a smart device in accordance with an exemplary embodiment;
FIG. 5 is a flow diagram illustrating a method for switching processing of a control interface in accordance with another exemplary embodiment;
FIG. 6 is a block diagram illustration of a switch handling device of a control interface according to another exemplary embodiment;
fig. 7 is a block diagram illustrating a user terminal according to an example embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail below. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the examples given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for switching a control interface according to an exemplary embodiment, where the method is applied to an intelligent device, and the method includes the following steps:
step S11, after establishing wireless network connection with a control program in a user terminal, identifying human body behaviors of a user using the user terminal based on wireless network signals, and determining whether a target object of the user is the intelligent device or not by using the human body behaviors of the user;
and step S12, if yes, sending interface switching instruction information to the control program, so that the control program switches the program interface to the control interface for the intelligent device based on the interface switching instruction information.
In practical applications of the present application, the smart device includes but is not limited to: air conditioners, televisions, washing machines, and the like. User terminals include, but are not limited to: cell phones, pads, etc. And the control program is used for controlling the intelligent terminal. The control program can be downloaded and installed in the intelligent terminal, the control program can also be in the form of an applet, the applet is an application program which can be used without downloading and installing, the applet runs on the host application program, and a user can open the applet in the host application program by scanning or searching the applet.
The wireless network connection between the intelligent equipment and the control program in the user terminal can adopt WiFi connection, and the user can add the intelligent equipment to the control program to establish WiFi P2P local area network communication between the control program and the intelligent equipment. If the user adds the air conditioner and the television on the control program, the control program establishes WiFi P2P communication with the air conditioner and the television respectively. When the control program establishes WiFi connection with the air conditioner and the television respectively, the air conditioner and the television are triggered to respectively identify human behaviors of a user using the user terminal by using wireless network signals, so that whether a target object of the user is the user or not is determined. The human behavior of the user can indicate which smart device the target object of the user is, such as when the user wants to control the air conditioner, the human behavior may include but is not limited to: the user is facing the air conditioner, the user is approaching the air conditioner, the user is holding the user terminal towards the air conditioner, and so on. The air conditioner end can determine that the target object of the user is the air conditioner according to the human behavior, and the television end determines that the target object of the user is not the television according to the human behavior. In practical application, when the air conditioner determines that the target object of the user is the air conditioner, the air conditioner sends interface switching instruction information to the control program, and the control program switches the program interface to the control interface for the air conditioner based on the interface switching instruction information sent by the air conditioner. And when the television determines that the target object of the user is the television, the television sends interface switching instruction information to the control program, and the control program switches the program interface to the control interface aiming at the television based on the interface switching instruction information sent by the television.
According to the scheme, automatic switching of the control interfaces in the control program can be achieved, manual operation switching of a user is not needed, control operation for different intelligent devices can be achieved, the problem that the user needs to manually switch to the corresponding control interfaces at first is solved, and user operation steps are increased, so that the intelligence of intelligent device control can be improved, and the user experience of the user on the control program is improved.
Referring to fig. 2, fig. 2 is a flowchart illustrating an implementation of step S11 in fig. 1 according to an exemplary embodiment, and for step S11, the following steps may be included:
and step S111, after the wireless network connection with the control program is established, positioning recognition, action gesture recognition and orientation recognition are carried out on the user by utilizing wireless network signals.
Specifically, the human behavior of the user affects the propagation of the wireless network signal (such as a WiFi signal), which may cause the wireless network signal to generate a waveform change. By utilizing the wireless network signals, the positioning recognition, the action gesture recognition and the orientation recognition can be carried out on the user through the change of the waveform of the wireless network signals.
Step S112, if it is determined that the position of the user relative to the smart device is within a preset position range based on the positioning recognition, and it is determined that the distance between the user and the smart device is within a preset distance range, and if it is determined that the user has a preset action gesture based on the action gesture recognition, and if it is determined that the user is facing the smart device based on the orientation recognition, it is determined that the target object of the user is the smart device.
Specifically, for positioning identification, the human body behavior of the user affects the propagation of wireless network signals (such as WiFi signals), which may cause waveform changes of the wireless network signals. Interference points can be formed in the waveform, and positioning and identification of users can be realized through the information of the interference points in the waveform at different moments. The preset action gesture can be a specific action gesture of a user holding the intelligent terminal, the intelligent device identifies the action gesture of the user, and can identify the action gesture of the user, and if the identified action gesture is the action gesture of the holding intelligent terminal, the user is determined to have the preset action gesture. For orientation identification, the human body outline can be identified through the wireless network signal, the human heart can be identified through the wireless network signal based on the influence of the human heart beating on the waveform change of the wireless network signal, and the orientation of the user can be determined according to the identified human body outline and the human heart. For orientation recognition, it may also be determined whether a user facial expression action is recognized.
According to the scheme, in practical application, if a certain intelligent device recognizes that a user approaches to the self within a preset distance range by holding a mobile phone, faces the self within a preset direction range, and has a gesture for operating a mobile phone pre-control device, the certain intelligent device determines that a target object of the user is the self, interface switching instruction information is generated, the interface switching instruction information is sent to a mobile phone end control program through WiFi P2P communication, and the mobile phone end control program switches a program interface to a control interface aiming at the certain intelligent device after receiving the interface switching instruction information.
For step S11, the method for recognizing human body behavior of the user using the user terminal based on the wireless network signal may include the following steps in terms of specific recognition processing of the wireless network signal to obtain human body behavior:
extracting a characteristic value of wireless network signal waveform change aiming at a wireless network signal;
and based on the characteristic value, utilizing a trained neural network model to identify the human body behaviors of the user.
The human behavior of the user affects the propagation of wireless network signals (such as WiFi signals), which causes waveform changes of the wireless network signals. For wireless network signals, characteristic values of wireless network signal waveform changes can be extracted to indicate human body behaviors. For the trained neural network model, a mapping relation between various human behaviors and corresponding characteristic values is established through learning and training. And in practical application, the extracted characteristic values are input into a trained neural network model, and the neural network model outputs the recognition of human body behaviors.
In one embodiment, the extracting the characteristic value of the wireless network signal waveform change for the wireless network signal may include the following steps:
carrying out frequency analysis on the channel state information by discrete wavelet transform aiming at wireless network signals;
aiming at the frequency analysis result, obtaining an upper limit cut-off frequency and a center frequency by using a percentile algorithm;
and determining the upper limit cut-off frequency and the center frequency as the characteristic value of the wireless network signal waveform change.
Specifically, Channel State Information (CSI) is used as information of a physical layer, and can measure amplitude and phase information of each subcarrier, and the CSI has a certain multipath resolution capability. Taking the WiFi signal as an example, the smart device may obtain the CSI measurement value of the WiFi signal from the transmitting end to the receiving end through the configured WiFi module. The discrete wavelet transform can analyze and process the time frequency of the signal and can show the local characteristics of the subcarrier change corresponding to each action prominently. Then, the spectrogram is processed by using Percentiles (Percentiles) to obtain an upper limit cut-off frequency and a central frequency, and the upper limit cut-off frequency and the central frequency are used as characteristic values of the wireless network signal waveform change.
In one embodiment, before extracting the characteristic value of the wireless network signal waveform change, the method further comprises: and performing noise reduction processing and/or redundancy removal processing on the wireless network signals.
In practical application, a hamming window low-pass filter, for example, may be used to perform a preliminary denoising process on the channel state information, and then a PCA (principal component analysis) technique is used to perform a dimensionality reduction and redundancy removal on the (channel state information) data stream, so as to eliminate interference and highlight signal variation differences.
Referring to fig. 3, fig. 3 is a block diagram illustrating a switching processing apparatus of a control interface according to an exemplary embodiment, where the switching processing apparatus 3 of the control interface is applied to an intelligent device, and the switching processing apparatus 3 of the control interface includes:
an identification determining module 31, configured to, after establishing a wireless network connection with a control program in a user terminal, identify a human behavior of a user using the user terminal based on a wireless network signal, and determine whether a target object of the user is the smart device by using the human behavior of the user;
and an interface switching instruction sending module 32, configured to send interface switching instruction information to the control program if the control interface is a control interface for the smart device, so that the control program switches the program interface to the control interface for the smart device based on the interface switching instruction information.
Further, the control program is in the form of an applet.
Further, the identification determining module 31 specifically includes:
the identification unit is used for carrying out positioning identification, action gesture identification and orientation identification on the user by utilizing a wireless network signal after establishing wireless network connection with the control program;
a determining unit, configured to determine that the position of the user relative to the smart device is within a preset position range and that the distance between the user and the smart device is within a preset distance range based on the positioning recognition, determine that the user has a preset action gesture based on the action gesture recognition, and determine that the target object of the user is the smart device if the user is oriented toward the smart device based on the orientation recognition.
Further, in the identification determining module 31, the identifying human behavior of the user using the user terminal based on the wireless network signal includes:
extracting a characteristic value of wireless network signal waveform change aiming at a wireless network signal;
and based on the characteristic value, utilizing a trained neural network model to identify the human body behaviors of the user.
Further, in the identification determining module 31, the extracting, for the wireless network signal, a characteristic value of a waveform change of the wireless network signal includes:
carrying out frequency analysis on the channel state information by discrete wavelet transform aiming at wireless network signals;
aiming at the frequency analysis result, obtaining an upper limit cut-off frequency and a center frequency by using a percentile algorithm;
and determining the upper limit cut-off frequency and the center frequency as the characteristic value of the wireless network signal waveform change.
Further, before extracting the characteristic value of the wireless network signal waveform change, the identification determination module 31 is further configured to: and performing noise reduction processing and/or redundancy removal processing on the wireless network signals.
With regard to the switching processing device 3 of the control interface in the above embodiment, the specific manner of the operation performed by each module thereof has been described in detail in the above embodiment of the related method, and will not be elaborated herein.
Referring to fig. 4, fig. 4 is a block diagram illustrating an intelligent device according to an exemplary embodiment, where the intelligent device 4 includes:
a memory 41 having an executable program stored thereon;
a processor 42 for executing the executable program in the memory 41 to implement the steps of any of the above methods.
Specifically, the smart device 4 may include, but is not limited to: air conditioners, televisions, washing machines, and the like. The intelligent device determines whether a target object of a user is the intelligent device or not by identifying human body behaviors of the user, and when the target object is determined to be the intelligent device, interface switching instruction information is sent to a control program of a user terminal, and the control program switches the program interface to the control interface aiming at the intelligent device based on the interface switching instruction information sent by the intelligent device, so that automatic switching of the control interface in the control program is realized, and manual operation switching of the user is not needed. The specific way in which the processor 42 of the smart device 4 executes the program in the memory 41 has been described in detail in relation to the embodiment of the method, and will not be elaborated upon here.
Referring to fig. 5, fig. 5 is a flowchart illustrating a method for switching a control interface according to another exemplary embodiment, where the method is applied to a control program for an intelligent device in a user terminal, and the method includes the following steps:
step S51, establishing wireless network connection with the intelligent device to trigger the intelligent device to recognize human body behaviors of a user using the user terminal based on wireless network signals, and sending interface switching instruction information to the control program when the target object of the user is determined to be the intelligent device by using the human body behaviors of the user;
and step S52, when the interface switching instruction information is received, switching a program interface to a control interface aiming at the intelligent equipment based on the interface switching instruction information.
Further, the control program is in the form of an applet.
It can be understood that, for the above method applied to the intelligent device side, the specific application description thereof may refer to the above related application description applied to the intelligent device side, and will not be repeatedly described herein.
Referring to fig. 6, fig. 6 is a block diagram illustrating a switching processing apparatus of a control interface according to another exemplary embodiment, where the switching processing apparatus 6 of the control interface is applied to an intelligent device, and the switching processing apparatus 6 of the control interface includes:
a connection establishment triggering module 61, configured to establish a wireless network connection with the smart device, so as to trigger the smart device to perform human behavior identification on a user using the user terminal based on a wireless network signal, and send interface switching instruction information to the control program when it is determined that a target object of the user is the smart device by using the human behavior of the user;
and an interface switching instruction module 62, configured to switch a program interface to a control interface for the intelligent device based on the interface switching instruction information when the interface switching instruction information is received.
Further, the control program is in the form of an applet.
It can be understood that, for the specific application description of the switching processing apparatus 6 applied to the control interface of the intelligent device side, reference may be made to the related application description applied to the intelligent device side, which is not repeated herein.
Referring to fig. 7, fig. 7 is a block diagram illustrating a user terminal according to an exemplary embodiment, where the user terminal 7 includes:
a memory 71 having an executable program stored thereon;
a processor 72 for executing the executable program in the memory 71 to implement the steps of any of the above methods.
Specifically, the user terminal 7 includes but is not limited to: cell phones, pads, etc. And the control program is used for controlling the intelligent terminal. The control program can be downloaded and installed in the intelligent terminal, the control program can also be in the form of an applet, the applet is an application program which can be used without downloading and installing, the applet runs on the host application program, and a user can open the applet in the host application program by scanning or searching the applet.
The specific way in which the processor 72 of the user terminal 7 executes the program in the memory 71 has been described in detail in the embodiments of the method described above and will not be described in detail here.
It is understood that the same or similar parts in the above embodiments may be mutually referred to, and the same or similar parts in other embodiments may be referred to for the content which is not described in detail in some embodiments.
It should be noted that, in the description of the present application, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In addition, in the description of the present application, the meaning of "plurality" means at least two unless otherwise specified.
It will be understood that when an element is referred to as being "secured to" or "disposed on" another element, it can be directly on the other element or intervening elements may also be present; when an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present, and further, as used herein, connected may include wirelessly connected; the term "and/or" is used to include any and all combinations of one or more of the associated listed items.
Any process or method descriptions in flow charts or otherwise described herein may be understood as: represents modules, segments or portions of code which include one or more executable instructions for implementing specific logical functions or steps of a process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present application.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (12)
1. A switching processing method of a control interface is applied to intelligent equipment, and comprises the following steps:
after establishing wireless network connection with a control program in a user terminal, identifying human body behaviors of a user using the user terminal based on wireless network signals, and determining whether a target object of the user is the intelligent equipment or not by using the human body behaviors of the user;
and if so, sending interface switching instruction information to the control program so that the control program switches the program interface to the control interface aiming at the intelligent equipment based on the interface switching instruction information.
2. The method of claim 1, wherein the control program is in the form of an applet.
3. The method according to claim 1, wherein the identifying human body behavior of the user using the user terminal based on a wireless network signal after establishing a wireless network connection with a control program in the user terminal, and determining whether the target object of the user is the smart device by using the human body behavior of the user comprises:
after wireless network connection with the control program is established, positioning recognition, action posture recognition and orientation recognition are carried out on the user by utilizing wireless network signals;
if the position of the user relative to the intelligent device is determined to be within a preset position range and the distance between the user and the intelligent device is determined to be within a preset distance range based on the positioning recognition, and if the preset action gesture exists in the user based on the action gesture recognition, the user is determined to be towards the intelligent device based on the orientation recognition, and then the target object of the user is determined to be the intelligent device.
4. The method according to any one of claims 1-3, wherein the identifying human behavior of the user using the user terminal based on the wireless network signal comprises:
extracting a characteristic value of wireless network signal waveform change aiming at a wireless network signal;
and based on the characteristic value, utilizing a trained neural network model to identify the human body behaviors of the user.
5. The method of claim 4, wherein the extracting the characteristic value of the wireless network signal waveform change for the wireless network signal comprises:
carrying out frequency analysis on the channel state information by discrete wavelet transform aiming at wireless network signals;
aiming at the frequency analysis result, obtaining an upper limit cut-off frequency and a center frequency by using a percentile algorithm;
and determining the upper limit cut-off frequency and the center frequency as the characteristic value of the wireless network signal waveform change.
6. The method of claim 4, wherein before extracting the eigenvalues of the wireless network signal waveform variations, the method further comprises:
and performing noise reduction processing and/or redundancy removal processing on the wireless network signals.
7. A switching processing device of a control interface is applied to intelligent equipment and comprises:
the identification determining module is used for identifying human body behaviors of a user using the user terminal based on wireless network signals after establishing wireless network connection with a control program in the user terminal, and determining whether a target object of the user is the intelligent equipment or not by using the human body behaviors of the user;
and the interface switching instruction sending module is used for sending interface switching instruction information to the control program if the interface switching instruction information is received, so that the control program switches the program interface to the control interface aiming at the intelligent equipment based on the interface switching instruction information.
8. A smart device, comprising:
a memory having an executable program stored thereon;
a processor for executing the executable program in the memory to implement the steps of the method of any one of claims 1-6.
9. A switching processing method of a control interface is applied to a control program for intelligent equipment in a user terminal, and comprises the following steps:
establishing wireless network connection with the intelligent equipment to trigger the intelligent equipment to recognize human body behaviors of a user using the user terminal based on wireless network signals, and sending interface switching instruction information to the control program when the target object of the user is determined to be the intelligent equipment by using the human body behaviors of the user;
and when the interface switching instruction information is received, switching a program interface to a control interface aiming at the intelligent equipment based on the interface switching instruction information.
10. The method of claim 9, wherein the control program is in the form of an applet.
11. A switching processing device of a control interface is applied to a control program for an intelligent device in a user terminal, and comprises:
the connection establishment triggering module is used for establishing wireless network connection with the intelligent equipment so as to trigger the intelligent equipment to identify human behaviors of a user using the user terminal based on wireless network signals, and sending interface switching instruction information to the control program when the target object of the user is determined to be the intelligent equipment by using the human behaviors of the user;
and the interface switching instruction module is used for switching a program interface to a control interface aiming at the intelligent equipment based on the interface switching instruction information when the interface switching instruction information is received.
12. A user terminal, comprising:
a memory having an executable program stored thereon;
a processor for executing the executable program in the memory to implement the steps of the method of any of claims 9-10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111131558.XA CN113918012A (en) | 2021-09-26 | 2021-09-26 | Control interface switching processing method and device, intelligent equipment and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111131558.XA CN113918012A (en) | 2021-09-26 | 2021-09-26 | Control interface switching processing method and device, intelligent equipment and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113918012A true CN113918012A (en) | 2022-01-11 |
Family
ID=79236284
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111131558.XA Pending CN113918012A (en) | 2021-09-26 | 2021-09-26 | Control interface switching processing method and device, intelligent equipment and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113918012A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114963676A (en) * | 2022-06-23 | 2022-08-30 | 长虹美菱股份有限公司 | Intelligent refrigerator and noise reduction control method thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107330450A (en) * | 2017-06-15 | 2017-11-07 | 珠海格力电器股份有限公司 | A kind of terminal equipment control method and device |
| EP3399702A1 (en) * | 2015-12-29 | 2018-11-07 | Huizhou TCL Mobile Communication Co., Ltd. | Smart watch-based smart home control method and smart watch |
| CN110363143A (en) * | 2019-07-16 | 2019-10-22 | 珠海格力电器股份有限公司 | Monitoring method, device and system |
| CN110737201A (en) * | 2019-10-11 | 2020-01-31 | 珠海格力电器股份有限公司 | monitoring method, device, storage medium and air conditioner |
| US20200064444A1 (en) * | 2015-07-17 | 2020-02-27 | Origin Wireless, Inc. | Method, apparatus, and system for human identification based on human radio biometric information |
| CN111459268A (en) * | 2020-03-06 | 2020-07-28 | 北京金茂绿建科技有限公司 | Method and system for controlling intelligent equipment through gestures |
-
2021
- 2021-09-26 CN CN202111131558.XA patent/CN113918012A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200064444A1 (en) * | 2015-07-17 | 2020-02-27 | Origin Wireless, Inc. | Method, apparatus, and system for human identification based on human radio biometric information |
| EP3399702A1 (en) * | 2015-12-29 | 2018-11-07 | Huizhou TCL Mobile Communication Co., Ltd. | Smart watch-based smart home control method and smart watch |
| CN107330450A (en) * | 2017-06-15 | 2017-11-07 | 珠海格力电器股份有限公司 | A kind of terminal equipment control method and device |
| CN110363143A (en) * | 2019-07-16 | 2019-10-22 | 珠海格力电器股份有限公司 | Monitoring method, device and system |
| CN110737201A (en) * | 2019-10-11 | 2020-01-31 | 珠海格力电器股份有限公司 | monitoring method, device, storage medium and air conditioner |
| CN111459268A (en) * | 2020-03-06 | 2020-07-28 | 北京金茂绿建科技有限公司 | Method and system for controlling intelligent equipment through gestures |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114963676A (en) * | 2022-06-23 | 2022-08-30 | 长虹美菱股份有限公司 | Intelligent refrigerator and noise reduction control method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10453457B2 (en) | Method for performing voice control on device with microphone array, and device thereof | |
| CN109346061B (en) | Audio detection method, device and storage medium | |
| EP3637290B1 (en) | Unlocking control method and related product | |
| KR20150110403A (en) | Automatic tuning of haptic effects | |
| CN105302373A (en) | Method and system for achieving operation of mobile terminal according to touch signals and mobile terminal | |
| US11599608B2 (en) | Unlocking control method and related products | |
| JP2013532876A (en) | User touch operation mode adaptation method and apparatus | |
| CN104360736A (en) | Gesture-based terminal control method and system | |
| WO2022148477A1 (en) | Wifi-based human body detection method, and smart device | |
| US10732724B2 (en) | Gesture recognition method and apparatus | |
| CN105807640A (en) | Terminal control method and terminal control system | |
| CN104866226A (en) | Terminal device and method for controlling same | |
| CN103682640A (en) | Terminal and method for adjusting working mode of terminal antenna | |
| CN113918012A (en) | Control interface switching processing method and device, intelligent equipment and terminal | |
| CN109104521B (en) | Method and device for correcting approaching state, mobile terminal and storage medium | |
| CN104898839A (en) | Terminal device and control method thereof | |
| CN108924908B (en) | WiFi scanning method and device and electronic device | |
| CN111148182B (en) | Device control method, device, storage medium and electronic device | |
| KR20220020871A (en) | Terminal, system for transmitting data and method applied to the same | |
| CN107832714B (en) | Living body identification method and device and storage equipment | |
| CN109740430A (en) | Fingerprint input method and relevant device | |
| CN106648040B (en) | Terminal control method and device | |
| CN107404402B (en) | Function configuration method and device of router | |
| CN106775308B (en) | proximity sensor switching method and device and terminal | |
| CN105792105B (en) | Data transmission method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |