CN109308159B - Intelligent device control method, device and system, electronic device and storage medium - Google Patents
Intelligent device control method, device and system, electronic device and storage medium Download PDFInfo
- Publication number
- CN109308159B CN109308159B CN201810960717.9A CN201810960717A CN109308159B CN 109308159 B CN109308159 B CN 109308159B CN 201810960717 A CN201810960717 A CN 201810960717A CN 109308159 B CN109308159 B CN 109308159B
- Authority
- CN
- China
- Prior art keywords
- gesture
- effective
- gestures
- touch
- control instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Abstract
The invention discloses an intelligent device control method, an intelligent device control device, an intelligent device control system, an electronic device and a computer readable storage medium. The method comprises the following steps: receiving a touch gesture drawn by a user on a gesture drawing interface of the terminal equipment; matching and searching in the effective gestures stored in the gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures; acquiring a related control instruction according to the effective gesture matched with the touch gesture; and sending the control instruction to the intelligent device to control the intelligent device to execute a plurality of corresponding actions. By the method, when the user needs to adjust the intelligent device to a specific state, the user only needs to draw the touch gesture by one step, and the problem of multiple operation steps in the prior art is solved.
Description
Technical Field
The present invention relates to the field of device control technologies, and in particular, to a method, an apparatus, a system, an electronic device, and a computer-readable storage medium for controlling an intelligent device.
Background
Under the trend of household appliance intellectualization, intelligent devices such as intelligent air conditioners and intelligent washing machines gradually replace traditional household appliances and become a part of an intelligent home network, and users can remotely control the intelligent devices through corresponding application programs on mobile terminals such as tablet computers and smart phones.
Currently, a plurality of virtual keys are arranged on an intelligent device control interface of an application program, and an intelligent air conditioner control interface is taken as an example and comprises a temperature adjustment virtual key, an operation mode adjustment virtual key, a wind direction adjustment virtual key and a wind power adjustment virtual key.
The user needs to respectively adjust the temperature, the operation mode, the wind direction and the wind power of the intelligent air conditioner through the virtual keys, and for some users who switch among different temperatures, operation modes, wind directions and wind power configurations according to needs, the adjusting process has the problem of more steps, for example, when the temperature is 27 ℃, refrigeration, automatic wind direction, wind power is switched to 25 ℃, refrigeration, wind direction is fixed and wind power is two, the temperature needs to be adjusted by 2 ℃ through the temperature adjusting virtual keys, the wind direction is switched through the wind direction adjusting virtual keys, and the wind power is switched through the wind force adjusting virtual keys.
Therefore, in the existing intelligent device control method, the problem of multiple operation steps in the adjusting process exists.
Disclosure of Invention
In order to solve the technical problem of multiple operation steps in the related art, the invention provides an intelligent device control method, an intelligent device control device, an intelligent device control system, an electronic device and a computer-readable storage medium.
An intelligent device control method is applied to a terminal device, and comprises the following steps:
receiving a touch gesture drawn by a user on a gesture drawing interface of the terminal equipment;
matching and searching in the effective gestures stored in the gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
acquiring an associated control instruction according to the effective gesture matched with the touch gesture;
and sending the control instruction to the intelligent device to control the intelligent device to execute a plurality of corresponding actions.
In an exemplary embodiment, the receiving, at a gesture drawing interface of a terminal device, a touch gesture drawn by a user includes:
receiving the touch gesture on a third-party gesture drawing interface displayed on the terminal equipment;
correspondingly, the obtaining of the associated control instruction according to the effective gesture matched with the touch gesture includes:
and the intelligent equipment control application running in the background of the terminal equipment acquires the control instruction according to the effective gesture.
In an exemplary embodiment, the receiving, at a gesture drawing interface of a terminal device, a user-drawn touch gesture includes:
tracking drawing operation triggered by a user in the gesture drawing interface;
in the process that the drawing operation is tracked, acquiring a track sequence of a touch point corresponding to the drawing operation when the touch point moves in the gesture drawing interface;
and generating the corresponding touch gesture according to the track sequence storage.
In an exemplary embodiment, the performing matching search in valid gestures stored in a gesture library according to the touch gesture to obtain a valid gesture matched with the touch gesture includes:
traversing effective gestures in the gesture library, and matching track sequences corresponding to the traversed effective gestures with track sequences corresponding to the touch gestures to obtain the similarity between the traversed effective gestures and the touch gestures;
and taking the effective gesture with the highest similarity with the touch gesture in the terminal equipment as the matched effective gesture of the touch gesture.
In an exemplary embodiment, the method further comprises:
comparing the highest similarity with a specified threshold value according to the similarity between the traversed effective gesture and the touch gesture;
and if the highest similarity is smaller than the specified threshold, judging that the touch gesture is an invalid gesture.
In an exemplary embodiment, the obtaining the associated control instruction according to the valid gesture matched with the touch gesture includes:
acquiring a gesture identification, wherein the gesture identification corresponds to an effective gesture matched with the touch gesture;
obtaining a key value associated with the gesture identification, wherein the key value indicates a corresponding action executed by the intelligent device;
and generating the control instruction according to the indication of the key value.
In an exemplary embodiment, before the obtaining the gesture identification, the method further includes:
receiving a selection operation triggered by a user, and configuring a key value for the corresponding action corresponding to the selection operation;
acquiring effective gestures drawn by a user in a gesture input interface triggered by the selection operation, and configuring gesture identifications for the acquired effective gestures;
and performing association storage of the gesture identification and the key value.
An intelligent device control method is applied to a server side, and comprises the following steps:
acquiring a touch gesture drawn by a user on terminal equipment;
matching and searching in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
acquiring an associated control instruction according to the effective gesture matched with the touch gesture;
and sending the control instruction to the intelligent device to control the intelligent device to execute a plurality of corresponding actions.
The utility model provides a smart machine controlling means installs in terminal equipment, the device includes:
the receiving module is used for receiving a touch gesture drawn by a user on a gesture drawing interface of the terminal equipment;
the searching module is used for performing matching searching in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
the instruction acquisition module is used for acquiring a related control instruction according to the effective gesture matched with the touch gesture;
and the control module is used for sending the control instruction to the intelligent equipment so as to control the intelligent equipment to execute a plurality of corresponding actions.
The utility model provides a smart machine controlling means installs in the server side, the device includes:
the acquisition module is used for acquiring a touch gesture drawn by a user on the terminal equipment;
the matching module is used for performing matching search in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
the instruction fetching module is used for acquiring a related control instruction according to the effective gesture matched with the touch gesture;
and the sending module is used for sending the control instruction to the intelligent equipment so as to control the intelligent equipment to execute a plurality of corresponding actions.
A smart device control system, the system comprising:
the terminal equipment is used for receiving a touch gesture drawn by a user;
the server acquires the touch gesture from the terminal equipment through network connection established between the server and the terminal equipment;
the server is configured to perform:
matching and searching in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
acquiring a related control instruction according to the effective gesture matched with the touch gesture;
and sending the control instruction to the intelligent device to control the intelligent device to execute a plurality of corresponding actions.
An electronic device, the electronic device comprising:
a processor;
a memory having stored thereon computer readable instructions which, when executed by the processor, implement the method as previously described.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method as set forth above.
The technical scheme provided by the embodiment of the invention can have the following beneficial effects:
according to the method, the corresponding effective gesture is found in the gesture library according to the touch control gesture drawn by the user, and the control instruction related to the effective gesture is sent to the intelligent equipment to control the intelligent equipment, so that the intelligent equipment executes a plurality of corresponding actions. By the method, when the user needs to adjust the intelligent device to a specific state, the user only needs to draw the touch gesture by one step, and the problem of multiple operation steps in the prior art is solved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a schematic diagram of an implementation environment shown in accordance with an exemplary embodiment;
FIG. 2 is a schematic diagram of an implementation environment shown in accordance with another illustrative embodiment;
FIG. 3 is a block diagram illustrating an apparatus in accordance with an exemplary embodiment;
FIG. 4 is a flow chart illustrating a smart device control method in accordance with an exemplary embodiment;
FIG. 5 is a flowchart illustrating details of step 310 according to a corresponding embodiment of FIG. 4;
FIG. 6 is a flowchart illustrating details of step 330 according to the corresponding embodiment of FIG. 4;
FIG. 7 is a flow diagram illustrating a method for controlling a smart device according to a corresponding embodiment of FIG. 6;
FIG. 8 is a flowchart illustrating details of step 350 according to the corresponding embodiment of FIG. 4;
FIG. 9 is a flow chart illustrating a smart device control method according to the corresponding embodiment of FIG. 8;
FIG. 10 is a block diagram illustrating an intelligent device control apparatus in accordance with an exemplary embodiment;
fig. 11 is a block diagram illustrating details of a receiving module according to the corresponding embodiment of fig. 10.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as described in the claims below.
Firstly, the invention discloses an intelligent device control method, and by implementing the method, a user can control the intelligent device by drawing a touch gesture on a terminal device. The following description will be made of an embodiment of the present invention.
FIG. 1 is a schematic diagram illustrating one implementation environment in accordance with an example embodiment. The implementation environment includes a terminal device 110, a gateway 150, and a smart device 130 connected to the gateway 150.
The terminal device 110 is an electronic device capable of implementing network connection and touch control, and may be a tablet computer or a smart phone, which is not limited herein.
The terminal device 110 and the gateway 150 establish a network connection, for example, the terminal device 110 and the gateway 150 establish a network connection through 2G/3G/4G/5G, wi-Fi, and interact with the gateway 150 through the network connection, so that a user can control the smart device 130 connected to the gateway 150 to perform an action by means of the terminal device 110.
The intelligent device 130 communicates with the gateway 150 through its own configured communication module, and realizes interaction with the gateway 150. For example, a local area network is established by the gateway 150, and the intelligent device 130 accesses the local area network established by the gateway 150 by connecting to the gateway 150. The local area network includes: zigBee, bluetooth.
The smart device 130 may be a smart printer, a smart fax machine, a smart air conditioner, a sensing device (e.g., a human body sensor, a door and window sensor, a temperature and humidity sensor, a smoke alarm) configured with a communication module (e.g., a ZigBee module, a Wi-Fi module, a bluetooth module), and is not limited herein.
Based on the interaction among the terminal device 110, the intelligent device 130, and the gateway 150, the user can implement touch operation on the terminal device 110 to control the gateway 150, and implement control on the intelligent device 130 by controlling the gateway 150, so that the intelligent device 130 completes an action corresponding to the touch operation implemented by the user. Therefore, remote control of the gateway 150 and the intelligent device 130 by the user touch gestures is realized.
FIG. 2 is a schematic diagram of an implementation environment shown in accordance with another illustrative embodiment. The implementation environment includes a terminal device 110, a server 140, a gateway 150, and a smart device 130 connected to the gateway 150.
As shown in fig. 2, a network connection is established between the terminal device 110, the server 140 and the gateway 150, and the intelligent device 130 is connected to the gateway 150.
The server 140 may be one server, a server cluster including a plurality of servers, or a cloud computing center including a plurality of servers, and is not limited herein.
The server 140 performs data interaction with the terminal device 110 and the gateway 150 through network connection with the gateway 150 and the terminal device 110. Terminal device 110 interacts with gateway 150 through a network connection with gateway 150.
FIG. 3 is a block diagram illustrating an apparatus in accordance with an example embodiment. As shown in fig. 3, the apparatus 200 may include one or more of the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, a sensor component 214, and a communication component 216. The apparatus 200 may be the terminal device 110 described above.
The processing component 202 generally controls overall operation of the device 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations, among others. The processing components 202 may include one or more processors 218 to execute instructions to perform all or a portion of the steps of the methods described below. Further, the processing component 202 can include one or more modules that facilitate interaction between the processing component 202 and other components. For example, the processing component 202 can include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.
The memory 204 is configured to store various types of data to support operations at the device 200. Examples of such data include instructions for any application or method operating on the apparatus 200. The Memory 204 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically Erasable Programmable Read-Only Memory (EEPROM), erasable Programmable Read-Only Memory (EPROM), programmable Read-Only Memory (PROM), read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk or optical disk. Also stored in memory 204 are one or more modules configured to be executed by the one or more processors 218 to perform all or a portion of the steps of the methods described below.
A power supply component 206 provides power to the various components of the device 200. The power components 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 200.
The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a touch panel. If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. The screen may further include an Organic Light Emitting Display (OLED for short).
The audio component 210 is configured to output and/or input audio signals. For example, the audio component 210 includes a Microphone (MIC) configured to receive external audio signals when the device 200 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 204 or transmitted via the communication component 216. In some embodiments, audio component 210 also includes a speaker for outputting audio signals.
The sensor assembly 214 includes one or more sensors for providing various aspects of status assessment for the device 200. For example, the sensor assembly 214 may detect the open/closed status of the device 200, the relative positioning of the components, the change in position of the device 200 or a component of the device 200, and the change in temperature of the device 200. In some embodiments, the sensor assembly 214 may also include a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 216 is configured to facilitate wired or wireless communication between the apparatus 200 and other devices. The device 200 may access a Wireless network based on a communication standard, such as WiFi (Wireless-Fidelity). In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the Communication component 216 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared Data Association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth technology, and other technologies.
In an exemplary embodiment, the apparatus 200 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital signal processors, digital signal processing devices, programmable logic devices, field programmable gate arrays, controllers, microcontrollers, microprocessors or other electronic components for performing the methods described below.
Fig. 4 is a flow chart illustrating a smart device control method according to an example embodiment. The method is applied to a terminal device, as shown in fig. 4, and the method includes the following steps, which may be executed by the apparatus 200 shown in fig. 3, or may be executed by the terminal device 110 in the implementation environment described above, so as to implement remote control on the smart device 130.
The intelligent device control application runs on the terminal device, and provides a plurality of interactive interfaces for a user through the terminal device, wherein the interactive interfaces comprise gesture drawing interfaces.
When the interactive interface is displayed on the terminal equipment, the terminal equipment receives user operation, and executes a corresponding instruction under the trigger of the user operation, so that one-time interaction between the user and the terminal equipment is completed.
The user controls the terminal device to be switched to the gesture drawing interface in order to realize control over the intelligent device through drawing of the specific gesture. When the terminal device displays the gesture drawing interface, the touch gesture drawn by the user on the terminal device is sensed. The touch gesture is generated according to a touch point corresponding to the user touch terminal equipment.
In another exemplary embodiment, the gesture drawing interface may also be an interactive interface of a third party, and the touch gesture drawn by the user is received through the interactive interface of the third party.
And step 330, performing matching search in the effective gestures stored in the gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures.
And comparing the touch control gesture drawn by the user on the gesture drawing interface with the effective gestures in the gesture library to obtain the effective gesture matched with the touch control gesture.
The valid gestures can be stored in the terminal device, and can also be stored in a gateway and a server. The storage area for storing the valid gestures is a gesture library, and the invention is not limited to whether the gesture library is in the terminal device or other devices.
The valid gesture may be entered into the gesture library by the user before step 310, or may be generated by the smart device control application before step 310, and stored in the gesture library, which is not limited herein.
Unlike the invalid gesture, the valid gesture is stored in a gesture library and is associated with the control instructions described below.
And 350, acquiring a related control instruction according to the effective gesture matched with the touch gesture.
The control instruction is a computer instruction for triggering the terminal device to control the intelligent device/gateway to execute a corresponding action, and may be stored in the terminal device, or may be stored in the server, which is not limited herein. The control command in the terminal device may be generated according to the user operation configuration before step 310, or may be automatically generated by the smart device control application before step 310, which is not limited herein.
The control instructions are configured to be associated with active gestures in a gesture library, different active gestures may be associated with the same control instruction. For example, all latin letter gestures (a, b, c, d, e, \8230;) can be associated with control command a (switching air conditioner configuration to 27 ℃, cooling, automatic wind direction, wind force one), so that the user can trigger the control command a by drawing any latin letter with little memory burden.
And after an effective gesture matched with the touch gesture is obtained, a corresponding control instruction is obtained according to the effective gesture.
In an exemplary embodiment, step 310 includes: and receiving the touch gesture on a third-party gesture drawing interface displayed on the terminal equipment.
The third-party gesture drawing interface is an interactive interface provided by a third-party application (which can be any application except a smart device control application) running on the terminal device.
Accordingly, step 350 includes: and the intelligent equipment control application running in the background of the terminal equipment acquires the control instruction according to the effective gesture.
After the effective gesture matched with the touch gesture is obtained, the third-party application where the third-party gesture drawing interface is located transmits the obtained effective gesture to the intelligent device control application, and the intelligent device control application obtains a corresponding control instruction according to the effective gesture.
In this embodiment, when the user uses the third-party application, if the smart device needs to be controlled, the user can directly use the third-party gesture drawing interface to control the smart device, and switching between the third-party application and the smart device control application is not needed.
And step 370, controlling the intelligent device to execute corresponding actions according to the control instruction.
The terminal device is controlled by the control instruction, transmits data to the gateway through the data transmission connection between the terminal device and the gateway, controls the gateway to transmit corresponding control signals to the intelligent device, and the intelligent device is controlled by the control signals to execute corresponding actions.
The control instructions may be:
1. controlling a plurality of intelligent devices to be turned off/on;
2. controlling a plurality of intelligent devices to be respectively switched to a specified configuration, for example, controlling an air conditioner to be switched to 27 ℃, refrigerating, automatic wind direction and wind power I, and controlling illumination to be switched to low brightness of a living room lamp and high brightness of a bathroom lamp;
for another example, the air conditioner is controlled to be switched to be automatically turned on when the room temperature is higher than 28 ℃, and the lamps of the corresponding area are turned off when the infrared sensor does not detect a human body within 30 minutes.
In an exemplary embodiment, the terminal device is controlled by the control instruction, and transmits data to the gateway through the data transmission connection with the gateway, so as to control the gateway to perform a corresponding action, for example, start a buzzer installed in the gateway.
In another exemplary embodiment, the terminal device directly establishes a connection with the smart device, and the terminal device is controlled by the control instruction to directly transmit the control signal to the smart device, so as to control the smart device to execute a corresponding action.
According to the method and the device, the user can control the intelligent equipment to be switched to the specified configuration by drawing the one-time touch gesture, when the intelligent equipment is controlled to be switched to the specific configuration, the virtual key is not needed to be used for carrying out multiple operations, in addition, the user can control the intelligent equipment to be respectively switched to the corresponding configuration by the one-time touch gesture, the switching between control interfaces of different intelligent equipment is not needed, and the operation steps are reduced.
Fig. 5 is a flowchart illustrating details of step 310 according to a corresponding embodiment of fig. 4. As shown in fig. 5, step 310 includes:
and 311, tracking the drawing operation triggered by the user in the gesture drawing interface.
When the gesture drawing interface is displayed, the terminal device senses touch operation of a user, coordinates of a touch point corresponding to the touch operation on the gesture drawing interface change along with the touch operation, and the touch operation is drawing operation.
And 313, acquiring a track sequence when the touch point corresponding to the drawing operation moves in the gesture drawing interface in the process of tracking the drawing operation.
In the process that the drawing operation is tracked, coordinates of touch points corresponding to the drawing operation on a gesture drawing interface are obtained, coordinates of a plurality of touch points are collected to serve as discrete points in a track sequence corresponding to the drawing operation, the track sequence is obtained, and the more discrete points are collected, the higher the precision of the obtained track sequence is. The discrete points may be collected once at a certain distance or at a certain time, and are not limited herein.
The trajectory of the drawing operation may be continuous, for example, a "1" shaped trajectory, or discontinuous, for example, a "10" shaped trajectory. The present invention does not define the trajectory of the drawing operation, which may be chinese character strokes (e.g., "one", "i",8230; \8230;), arabic numerals (e.g., "1", "2",8230; \8230;), latin letters (e.g., "a", "b",8230; ", 8230;), geometric figures (e.g.," delta "," "\9633;", \8230; 8230;), irregular figures/symbols (e.g., "v", ">", "\8230;" 8230;).
And step 315, generating a corresponding touch gesture according to the track sequence storage.
Fig. 6 is a flowchart illustrating details of step 330 according to a corresponding embodiment of fig. 4. As shown in fig. 6, step 330 includes:
and 331, traversing the effective gestures in the gesture library, and matching the track sequence corresponding to the traversed effective gestures with the track sequence corresponding to the touch control gestures to obtain the similarity between the traversed effective gestures and the touch control gestures.
The similarity between the traversed effective gesture and the touch gesture can be obtained by calculating the minimum cosine value between the track sequences, or by calculating the squared euclidean distance between the track sequences, which is not limited herein.
And 333, taking the effective gesture with the highest similarity to the touch gesture in the terminal device as the matching effective gesture of the touch gesture.
In order to avoid the error that the number "1" is determined as the letter "l", for example, the similarities of the touch gesture and all effective gestures in the gesture library are respectively calculated, and the effective gesture corresponding to the highest similarity in the obtained similarities is taken as the effective gesture matched with the touch gesture, that is, the matched effective gesture of the touch gesture.
In another exemplary embodiment, to reduce the amount of computation, the similarity between the touch gesture and the valid gestures in the gesture library is sequentially computed, and when the similarity between the touch gesture and the polled valid gestures is greater than a specified value (e.g., 95%), it is determined that the touch gesture matches the valid gesture.
Fig. 7 is a flowchart illustrating a smart device control method according to a corresponding embodiment of fig. 6. As shown in fig. 7, the smart device control method further includes the following steps.
In step 410, the highest similarity is compared with a specified threshold for the similarity between the traversed valid gesture and the touch gesture.
The user may draw a touch gesture that has a low degree of similarity to the active gestures in the gesture library, and therefore, in an exemplary embodiment, the highest degree of similarity is compared to a specified threshold (e.g., 90%) in addition to traversing the active gestures in the gesture library.
In step 430, if the highest similarity is smaller than the specified threshold, it is determined that the touch gesture is an invalid gesture.
And for the touch gestures which are determined to be invalid gestures, prohibiting the touch gestures drawn by the user from triggering the generation of control signals.
When the highest similarity between the touch gesture drawn by the user and the effective gesture in the gesture library is low, for example, 60%, a control signal is not generated for the touch gesture trigger, so that the operation state of the intelligent device is prevented from being changed due to misoperation of the user.
Fig. 8 is a flowchart illustrating details of step 350 according to a corresponding embodiment of fig. 4. As shown in fig. 8, step 350 includes:
in step 351, a gesture identifier is obtained, where the gesture identifier corresponds to an effective gesture matched with the touch gesture.
The effective gestures in the gesture library have gesture identifications respectively, and different effective gestures have different gesture identifications.
And searching the key values corresponding to the gesture identifications through the association relationship between the gesture identifications and the key values, wherein the key values associated with different gesture identifications are different.
The key value corresponds to a control instruction. After the control instruction is generated, the intelligent device is controlled by the control signal corresponding to the control instruction to execute a plurality of corresponding actions.
Fig. 9 is a flowchart illustrating a smart device control method according to the corresponding embodiment of fig. 8. As shown in fig. 9, before step 351, the smart device control method further includes the following steps.
The selection operation is an operation for setting an action to be triggered by a gesture before the user enters the gesture. In an exemplary embodiment, a plurality of interactive interfaces are provided for a user, and the user performs operation on the interactive interfaces and sets an action to be triggered.
And under the trigger of the selection operation, assigning a key value to the action executed by the intelligent equipment corresponding to the selection operation.
And under the trigger of the selection operation, the gesture drawn by the user in the gesture input interface is also collected and stored in a gesture library as an effective gesture, and when the gesture is stored in the gesture library, a gesture identifier is allocated to the gesture.
At the gesture entry interface, the more discrete points collected, the higher the precision. The discrete points may be collected once at a certain distance or at a certain time, and are not limited herein.
And step 550, performing association storage of the gesture identification and the key value.
When the gestures drawn by the user are stored in the gesture library, the gesture identification allocated to the gestures is stored in association with the key values, and indirect association between the effective gestures and the actions executed by the intelligent equipment is established.
In an exemplary embodiment, the present invention further provides an intelligent device control method, which is applied to a server and can be executed by the server 140 in the implementation environment to implement remote control on the intelligent device 130. The method comprises the following steps:
acquiring a touch gesture drawn by a user on terminal equipment;
matching and searching in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
acquiring a related control instruction according to the effective gesture matched with the touch gesture;
and sending the control instruction to the intelligent device to control the intelligent device to execute a plurality of corresponding actions.
According to the method, the server side obtains the control command according to the touch gesture, and the time from drawing of the touch gesture by the user to controlled execution of the intelligent device can be shortened.
Correspondingly, the invention provides an intelligent device control system, which comprises:
the terminal equipment is used for receiving a touch gesture drawn by a user;
the server acquires the touch gesture from the terminal equipment through network connection established between the server and the terminal equipment;
the server is configured to perform:
matching and searching in the effective gestures stored in the gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
acquiring an associated control instruction according to the effective gesture matched with the touch gesture;
and sending the control instruction to the intelligent device to control the intelligent device to execute a plurality of corresponding actions.
The following apparatus embodiments may be used to perform the above method embodiments.
Fig. 10 is a block diagram illustrating an intelligent device control apparatus according to an example embodiment. The device is installed in a terminal device, and as shown in fig. 10, the device comprises the following modules.
The receiving module 610 is configured to receive a touch gesture drawn by a user on a gesture drawing interface of the terminal device.
The searching module 630 is configured to perform matching search in the valid gestures stored in the gesture library according to the touch gesture, so as to obtain a valid gesture matched with the touch gesture.
And the instruction acquisition module 650 is configured to acquire the associated control instruction according to the valid gesture matched with the touch gesture.
And the control module 670 is configured to control the intelligent device to execute a corresponding action according to the control instruction.
Fig. 11 is a block diagram illustrating details of a receiving module according to the corresponding embodiment of fig. 10. As shown in fig. 11, the receiving module 610 includes the following units.
The tracking unit 611 is configured to track a drawing operation triggered by the user in the gesture drawing interface.
A track obtaining unit 613, configured to obtain a track sequence when a touch point corresponding to the drawing operation moves in the gesture drawing interface in a process that the drawing operation is tracked.
And a storage unit 615, configured to generate the corresponding touch gesture according to the track sequence.
The invention also provides an intelligent device control device, which is arranged at the server side, and the device comprises:
the acquisition module is used for acquiring a touch gesture drawn by a user on the terminal equipment;
the matching module is used for performing matching search in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
the instruction fetching module is used for acquiring a related control instruction according to the effective gesture matched with the touch gesture;
and the sending module is used for sending the control instruction to the intelligent equipment so as to control the intelligent equipment to execute a plurality of corresponding actions.
Optionally, the present invention further provides an electronic device, where the electronic device includes:
a processor;
a memory having stored thereon computer readable instructions which, when executed by the processor, implement the method as previously described.
The electronic device may be the apparatus 200 shown in fig. 3.
In an exemplary embodiment, a computer-readable storage medium is also provided, on which a computer program is stored which, when being executed by a processor, carries out the method as set forth above.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (11)
1. An intelligent device control method is applied to terminal equipment and is characterized by comprising the following steps:
receiving a touch gesture drawn by a user on a third-party gesture drawing interface displayed on the terminal equipment;
matching and searching in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
the intelligent device control application running in the background of the terminal device acquires control instructions according to the effective gestures, different effective gestures are associated with the same control instruction, and one control instruction corresponds to at least one action for controlling the intelligent device to execute; the control instruction comprises a plurality of intelligent devices and a plurality of control commands, wherein the plurality of intelligent devices are controlled to be turned off/on and are respectively switched to a specified configuration;
the terminal equipment is controlled by the control instruction, transmits data to the gateway through data transmission connection between the terminal equipment and the gateway, and the control gateway sends the control instruction to the intelligent equipment to control the intelligent equipment to execute a plurality of corresponding actions;
the method for acquiring the control instruction by the intelligent device control application running in the background of the terminal device according to the effective gesture comprises the following steps:
acquiring a gesture identifier, wherein the gesture identifier corresponds to an effective gesture matched with the touch gesture, and is distributed when the corresponding effective gesture is stored in the gesture library;
obtaining a key value associated with the gesture identification based on a corresponding gesture identification and a corresponding key value which are stored in an associated manner when a corresponding effective gesture is stored in the gesture library, wherein the key value indicates a corresponding action executed by the intelligent device;
and generating the control instruction according to the indication of the key value.
2. The method according to claim 1, wherein the receiving a user-drawn touch gesture at a third-party gesture drawing interface displayed on a terminal device comprises:
tracking drawing operation triggered by a user in the third-party gesture drawing interface;
in the process that the drawing operation is tracked, acquiring a track sequence of a touch point corresponding to the drawing operation when the touch point moves in the gesture drawing interface;
and generating the corresponding touch gesture according to the track sequence storage.
3. The method according to claim 1, wherein the performing matching search in valid gestures stored in a gesture library according to the touch gesture to obtain a valid gesture matched with the touch gesture comprises:
traversing effective gestures in the gesture library, and matching track sequences corresponding to the traversed effective gestures with track sequences corresponding to the touch gestures to obtain the similarity between the traversed effective gestures and the touch gestures;
and taking the effective gesture with the highest similarity with the touch gesture in the terminal equipment as the matched effective gesture of the touch gesture.
4. The method of claim 3, further comprising:
comparing the highest similarity with a specified threshold value according to the similarity between the traversed effective gesture and the touch gesture;
and if the highest similarity is smaller than the specified threshold, judging that the touch gesture is an invalid gesture.
5. The method of claim 1, wherein prior to obtaining the gesture identification, the method further comprises:
receiving a selection operation triggered by a user, and configuring a key value for the corresponding action corresponding to the selection operation;
triggering the collection of effective gestures drawn by a user in a gesture input interface according to the selection operation, and configuring gesture identification for the effective gestures drawn by the user;
and performing associated storage of the gesture identification and the key value.
6. An intelligent device control method is applied to a server side, and is characterized by comprising the following steps:
acquiring a touch gesture drawn by a user on a third-party gesture drawing interface displayed on the terminal equipment;
matching and searching in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
acquiring associated control instructions according to effective gestures matched with the touch gestures, wherein different effective gestures are associated with the same control instruction, and one control instruction corresponds to at least one action for controlling the intelligent equipment to execute; the control instruction comprises a plurality of intelligent devices and a control instruction, wherein the intelligent devices are controlled to be turned off/on, and the intelligent devices are controlled to be respectively switched to appointed configurations;
the terminal equipment is controlled by the control instruction, transmits data to the gateway through data transmission connection between the terminal equipment and the gateway, and the control gateway sends the control instruction to the intelligent equipment to control the intelligent equipment to execute a plurality of corresponding actions;
wherein, the obtaining of the associated control instruction according to the effective gesture matched with the touch gesture comprises:
acquiring a gesture identifier, wherein the gesture identifier corresponds to an effective gesture matched with the touch gesture and is distributed when the corresponding effective gesture is stored in the gesture library;
obtaining a key value associated with the gesture identification based on a corresponding gesture identification and a corresponding key value stored in association when a corresponding effective gesture is stored in the gesture library, wherein the key value indicates a corresponding action executed by the intelligent device;
and generating the control instruction according to the indication of the key value.
7. The utility model provides a smart machine controlling means installs in terminal equipment, its characterized in that, the device includes:
the receiving module is used for receiving a touch gesture drawn by a user on a third-party gesture drawing interface displayed on the terminal equipment;
the searching module is used for performing matching searching in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
the intelligent device control application running in the background of the terminal device acquires the control instruction according to the effective gestures, different effective gestures are associated with the same control instruction, and one control instruction corresponds to at least one action for controlling the intelligent device to execute; the control instruction comprises a plurality of intelligent devices and a control instruction, wherein the intelligent devices are controlled to be turned off/on, and the intelligent devices are controlled to be respectively switched to appointed configurations;
the terminal equipment is controlled by the control instruction, transmits data to the gateway through data transmission connection between the terminal equipment and the gateway, and the control gateway sends the control instruction to the intelligent equipment so as to control the intelligent equipment to execute a plurality of corresponding actions;
the instruction acquisition module acquires the control instruction in the following way:
acquiring a gesture identifier, wherein the gesture identifier corresponds to an effective gesture matched with the touch gesture, and is distributed when the corresponding effective gesture is stored in the gesture library;
obtaining a key value associated with the gesture identification based on a corresponding gesture identification and a corresponding key value stored in association when a corresponding effective gesture is stored in the gesture library, wherein the key value indicates a corresponding action executed by the intelligent device;
and generating the control instruction according to the indication of the key value.
8. The utility model provides an intelligent equipment controlling means installs in the server side, its characterized in that, the device includes:
the acquisition module is used for acquiring a touch gesture drawn by a user on a third-party gesture drawing interface displayed on the terminal equipment;
the matching module is used for performing matching search in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
the instruction fetching module is used for acquiring related control instructions according to effective gestures matched with the touch gestures, different effective gestures are related to the same control instruction, and one control instruction corresponds to at least one action for controlling the intelligent equipment to execute; the control instruction comprises a plurality of intelligent devices and a plurality of control commands, wherein the plurality of intelligent devices are controlled to be turned off/on and are respectively switched to a specified configuration;
the terminal equipment is controlled by the control instruction, transmits data to the gateway through data transmission connection between the terminal equipment and the gateway, and the control gateway transmits the control instruction to the intelligent equipment so as to control the intelligent equipment to execute a plurality of corresponding actions;
the instruction fetching module obtains the control instruction in the following way:
acquiring a gesture identifier, wherein the gesture identifier corresponds to an effective gesture matched with the touch gesture, and is distributed when the corresponding effective gesture is stored in the gesture library;
obtaining a key value associated with the gesture identification based on a corresponding gesture identification and a corresponding key value which are stored in an associated manner when a corresponding effective gesture is stored in the gesture library, wherein the key value indicates a corresponding action executed by the intelligent device;
and generating the control instruction according to the indication of the key value.
9. A smart device control system, the system comprising:
the terminal equipment is used for receiving a touch gesture drawn by a user;
the server acquires the touch gesture from the terminal equipment through network connection established between the server and the terminal equipment;
the server is configured to perform:
matching and searching in effective gestures stored in a gesture library according to the touch gestures to obtain effective gestures matched with the touch gestures;
obtaining associated control instructions according to effective gestures matched with the touch gestures, wherein different effective gestures are associated with the same control instruction, and one control instruction corresponds to at least one action for controlling the intelligent equipment to execute; the control instruction comprises a plurality of intelligent devices and a plurality of control commands, wherein the plurality of intelligent devices are controlled to be turned off/on and are respectively switched to a specified configuration;
the terminal equipment is controlled by the control instruction, transmits data to the gateway through data transmission connection between the terminal equipment and the gateway, and the control gateway sends the control instruction to the intelligent equipment to control the intelligent equipment to execute a plurality of corresponding actions;
the intelligent device control application running in the background of the terminal device obtains the control instruction according to the effective gesture, and the method comprises the following steps:
acquiring a gesture identifier, wherein the gesture identifier corresponds to an effective gesture matched with the touch gesture, and is distributed when the corresponding effective gesture is stored in the gesture library;
obtaining a key value associated with the gesture identification based on a corresponding gesture identification and a corresponding key value which are stored in an associated manner when a corresponding effective gesture is stored in the gesture library, wherein the key value indicates a corresponding action executed by the intelligent device;
and generating the control instruction according to the indication of the key value.
10. An electronic device, characterized in that the electronic device comprises:
a processor;
a memory having stored thereon computer readable instructions which, when executed by the processor, implement the method of any one of claims 1 to 6.
11. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810960717.9A CN109308159B (en) | 2018-08-22 | 2018-08-22 | Intelligent device control method, device and system, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810960717.9A CN109308159B (en) | 2018-08-22 | 2018-08-22 | Intelligent device control method, device and system, electronic device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109308159A CN109308159A (en) | 2019-02-05 |
| CN109308159B true CN109308159B (en) | 2023-01-17 |
Family
ID=65223928
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810960717.9A Active CN109308159B (en) | 2018-08-22 | 2018-08-22 | Intelligent device control method, device and system, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109308159B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110110616A (en) * | 2019-04-19 | 2019-08-09 | 出门问问信息科技有限公司 | A kind of electronic equipment and control method |
| CN112732154A (en) * | 2019-10-29 | 2021-04-30 | 福建天泉教育科技有限公司 | Method for extending touch function in remote control and storage medium |
| CN113050435A (en) * | 2019-12-27 | 2021-06-29 | 施德朗（广州）电气科技有限公司 | Control method, device and system for Internet of things and smart home and storage medium |
| CN112306235B (en) * | 2020-09-25 | 2023-12-29 | 北京字节跳动网络技术有限公司 | Gesture operation method, device, equipment and storage medium |
| CN112486379B (en) * | 2020-11-10 | 2022-08-30 | 佛山市百斯特电器科技有限公司 | Control method of washing equipment and washing equipment |
| CN112489413B (en) * | 2020-11-27 | 2022-01-11 | 京东方科技集团股份有限公司 | Control method and system of remote controller, storage medium and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309612A (en) * | 2013-05-30 | 2013-09-18 | 北京小米科技有限责任公司 | Method, device and equipment for processing information of graphic interface text field of mobile equipment |
| CN105393205A (en) * | 2013-06-04 | 2016-03-09 | 三星电子株式会社 | Electronic device and method for controlling applications in the electronic device |
| CN105791927A (en) * | 2014-12-16 | 2016-07-20 | 上海天脉聚源文化传媒有限公司 | Smart television gesture control method and system |
| CN106681499A (en) * | 2016-12-14 | 2017-05-17 | 珠海格力电器股份有限公司 | Method and device for automobile control based on mobile terminal and electronic device |
-
2018
- 2018-08-22 CN CN201810960717.9A patent/CN109308159B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309612A (en) * | 2013-05-30 | 2013-09-18 | 北京小米科技有限责任公司 | Method, device and equipment for processing information of graphic interface text field of mobile equipment |
| CN105393205A (en) * | 2013-06-04 | 2016-03-09 | 三星电子株式会社 | Electronic device and method for controlling applications in the electronic device |
| CN105791927A (en) * | 2014-12-16 | 2016-07-20 | 上海天脉聚源文化传媒有限公司 | Smart television gesture control method and system |
| CN106681499A (en) * | 2016-12-14 | 2017-05-17 | 珠海格力电器股份有限公司 | Method and device for automobile control based on mobile terminal and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109308159A (en) | 2019-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109308159B (en) | Intelligent device control method, device and system, electronic device and storage medium | |
| CN109379261B (en) | Control method, device, system, equipment and storage medium of intelligent equipment | |
| US20170045866A1 (en) | Methods and apparatuses for operating an appliance | |
| CN103529778B (en) | A kind of intelligent home furnishing control method, device and system | |
| US10175671B2 (en) | Method and apparatus for controlling intelligent device | |
| US10015245B2 (en) | Method and apparatus for grouping smart device in smart home system | |
| CN105605792B (en) | Method and device for controlling water heater | |
| CN106527160B (en) | Equipment control method and device | |
| KR102231105B1 (en) | control device and method for controlling the same | |
| CN108023934B (en) | Electronic device and control method thereof | |
| CN105706395B (en) | Control apparatus and control method thereof | |
| CN105160854A (en) | Equipment control method, device and terminal equipment | |
| CN111508483A (en) | Equipment control method and device | |
| EP3099017B1 (en) | A method and a device for controlling a smart home power supply | |
| CN112073273B (en) | Device state control method, device state control apparatus, and storage medium | |
| CN103557580A (en) | Intelligent energy-saving thermostat | |
| WO2017166066A1 (en) | Infrared remote control method, terminal and apparatus | |
| KR102269387B1 (en) | Information sharing method depends on a situation and electronic device supporting the same | |
| CN105872655A (en) | Device control methods and apparatuses, and electronic devices | |
| CN106775377B (en) | Gesture recognition device, equipment and control method of gesture recognition device | |
| CN114019807A (en) | Data processing method, device, system, equipment and readable storage medium | |
| CN112229037A (en) | Control method of air conditioner, terminal, air conditioner and storage medium | |
| CN115268293A (en) | Touch screen control panel based on whole-house intelligent household appliance control | |
| EP3779618A1 (en) | Smart apparatus control method, apparatus, computer storage medium, and smart apparatus control apparatus | |
| CN116184851A (en) | Sleep mode adjusting method, device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |