CN113156827A - Intelligent equipment control method and system based on semantics - Google Patents
Intelligent equipment control method and system based on semantics Download PDFInfo
- Publication number
- CN113156827A CN113156827A CN202110359565.9A CN202110359565A CN113156827A CN 113156827 A CN113156827 A CN 113156827A CN 202110359565 A CN202110359565 A CN 202110359565A CN 113156827 A CN113156827 A CN 113156827A
- Authority
- CN
- China
- Prior art keywords
- intelligent
- input
- semantic
- semantics
- functions
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000006870 function Effects 0.000 claims abstract description 95
- 239000000284 extract Substances 0.000 claims abstract description 7
- 238000012216 screening Methods 0.000 claims description 2
- 230000003993 interaction Effects 0.000 abstract description 20
- 230000007246 mechanism Effects 0.000 abstract description 9
- 238000005516 engineering process Methods 0.000 abstract description 6
- 230000002452 interceptive effect Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 2
- 238000004378 air conditioning Methods 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 229910052802 copper Inorganic materials 0.000 description 2
- 239000010949 copper Substances 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 230000003340 mental effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000002269 spontaneous effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Manufacturing & Machinery (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Selective Calling Equipment (AREA)
Abstract
The invention provides a semantic-based intelligent device control method and a semantic-based intelligent device control system, which comprise the following steps: constructing an internet of things comprising intelligent equipment and a control end, wherein the control end extracts the functions of the intelligent equipment; the control end extracts input semantics of a user through an input sensor, screens functions of the intelligent equipment based on the input semantics to obtain a function alternative set only matched with the input semantics, and controls the intelligent equipment to execute corresponding functions according to the functions selected by the user in the alternative set. Compared with the prior art, the input association mechanism based on the semantics can reduce the complexity of the interaction task, and can be applied to various ubiquitous input technologies.
Description
Technical Field
The invention relates to the technical field of human-computer interaction and intelligent device input, in particular to a semantic-based intelligent device control method and system.
Background
With the development of the internet of things in recent years, more and more intelligent devices appear in the lives of people and play an important role. The input interaction mode with the intelligent equipment mainly comprises the following steps: voice input, gesture input, etc. A control command for an intelligent device can be divided into three parts: (1) equipment: refers to a device, such as a light, a television, a computer, etc., with which a user is to interact. (2) The device atomic function: what the user wants to operate with and cannot be further subdivided is called a device atomic function, hereinafter simply referred to as "function". Such as a light switch, a "last channel" button on a television, a volume slider on a computer. (3) And (3) input function control: it is referred to how the user wants to operate a function, which is hereinafter referred to as "input" for short, such as turning on/off a lamp, tuning to the last channel of a television, sliding a volume bar so that the volume of the computer is brought to a certain value.
Most of the existing various control commands are composed of the three parts, and the control flow of the traditional intelligent device can be summarized as follows: after the user generates the interactive intention, the user selects the equipment to be controlled, selects the function to be controlled and inputs a specific control value. As shown in figure 1, a user feels hot air temperature, then wants to lower the air temperature, selects air conditioning equipment, selects a temperature control function, and finally operates input temperature reduction to be used as function control, and the total number of the steps is 5. Based on this way of interaction, the most critical issue is how to pair with the device to be controlled. There are various forms, for example, the most common devices are each equipped with a remote controller or an operation panel for control; in an intelligent home environment, all devices are generally controlled by one APP, and the device to be controlled is selected and then specifically controlled; photographing by using a smart phone and identifying an object by using a computer vision algorithm to bind equipment; and capturing the direction of the user's gaze by using a front camera of the mobile phone as a basis for binding the equipment. In addition, device identification is also performed based on user location or contextual context.
"naturalness" and "efficiency" are the goals of interactive process optimization. The mode of firstly carrying out equipment and then carrying out functions is really the most suitable for the input habit of the user, however, as the technology of the internet of things is gradually integrated into the life of people, more and more intelligent equipment is provided. This approach has the following problems:
the first disadvantage is that: a redundant control device or a complicated device pairing method is required, and development and learning costs are high. Conventional control flow requires first associating context with a particular device or application and then associating inputs and functions. How to solve the problems of device, function and input association is still a problem. As described in the related background, the present methods predetermine the relationships between input technologies, interfaces, and functions, which do not meet the requirements of ubiquitous input systems in the context of the present internet of things. Or a novel pairing technology needs to be developed, although the interaction efficiency or experience can be improved, the requirement on environment or operation is high mostly, or a user needs to learn a new interaction mode additionally, so that the requirement on a ubiquitous system is difficult to be met.
The second disadvantage is that: the equipment association method greatly influences the interactive experience, and the interaction lacks spontaneity. Currently, most steps of device, function and input association are still used as an additional interaction step, and such an interaction paradigm requires a user to explicitly select a device, so that the interaction process is lack of spontaneity. In addition, different device association methods and effects will greatly affect the interactive experience.
Disclosure of Invention
The invention aims to solve the problems that the traditional equipment input association mode is complex in association method, low in interaction efficiency and not spontaneous in interaction, and provides an intelligent equipment control method based on semantics.
Aiming at the defects of the prior art, the invention provides a semantic-based intelligent device control method, which comprises the following steps:
step 1, constructing an internet of things comprising intelligent equipment and a control end, wherein the control end extracts the functions of the intelligent equipment;
and 2, the control end extracts input semantics of the user through the input sensor, screens the functions of the intelligent equipment based on the input semantics to obtain a function alternative set only matched with the input semantics, and controls the intelligent equipment to execute corresponding functions according to the functions selected by the user in the alternative set.
The intelligent equipment control method based on the semantics is characterized in that a display device is arranged in or externally connected with the control end to display the functions of the intelligent equipment; and the display device displays the functions of the intelligent device.
The intelligent equipment control method based on the semantics is characterized in that a display device is arranged in or externally connected with the control end to display the functions of the intelligent equipment; and the step 2 comprises: and continuously triggering the input sensor to switch the current function displayed by the display device.
The intelligent device control method based on the semantics, wherein the input sensor comprises: a forward button, a back button, a ok button, and a touch slide, the forward button and the back button representing a "previous" and "next" semantic, respectively, the ok button representing an "ok" semantic, and the relative sliding of the touch slide representing an "increase" or "decrease" semantic.
The intelligent equipment control method based on the semantics is characterized in that the intelligent equipment is a refrigerator, a sound box, a television and a desk lamp with the function of the Internet of things.
The intelligent device control method based on the semantics is characterized in that the control end comprises a Bluetooth transceiver module which is used for connecting the intelligent device.
The intelligent equipment control method based on the semantics is characterized in that the display device is an intelligent watch.
The intelligent device control method based on the semantics is characterized in that the content displayed by the display device comprises the name of the current intelligent device, the function of the current intelligent device and the state of the function of the current intelligent device.
The invention also provides a semantic-based intelligent device control system, which comprises:
the intelligent equipment has the function of the Internet of things and a control end connected with the intelligent equipment;
the control end is used for extracting the functions of the intelligent equipment, extracting the input semantics of the user through the input sensor, screening the functions of the intelligent equipment based on the input semantics to obtain a function alternative set only matched with the input semantics, and controlling the intelligent equipment to execute the corresponding functions according to the functions selected by the user in the alternative set.
According to the scheme, the invention has the advantages that:
compared with the prior art, the semantic-based input association mechanism can reduce the complexity of interaction tasks, and can be applied to various ubiquitous input technologies, particularly resource-limited ubiquitous input interfaces. According to the mechanism, an input system is realized, the system utilizes a smart watch and a semantic-based input association mechanism, and presents advantages compared with a traditional device-based input mode, and the application potential of the technology is shown.
Drawings
FIG. 1 is a diagram illustrating an interaction method of inputting after a device functions in the prior art;
FIG. 2 is a diagram illustrating a function-before-input interaction of the present invention;
fig. 3 is a schematic structural diagram of the controller according to the present invention.
Fig. 4a to c are schematic diagrams of an embodiment of the present invention.
Detailed Description
Based on the problems, the invention utilizes the semantic information hidden in the function to invent a semantic-based input association mechanism. The semantics are easy to understand, express and extract, and can be used for controlling the equipment of the Internet of things. For example, buttons imply discrete binary inputs, such as on/off of a light, on/off of a microphone; the state switching input implies discrete state switching selection, such as last song/next song selection of a sound box; while a slider bar implies a continuous change of value, for example to adjust the volume of a television. Different equipment functions contain different semantics, and by utilizing the characteristics, the invention provides an interaction mode of firstly inputting the function and then inputting the function, associates the equipment selection with the function through the function semantics, reduces the interaction complexity and the equipment specificity, reduces the learning cost of a user, and improves the interaction efficiency of multiple intelligent equipment in an intelligent environment. As shown in fig. 2, the user feels hot air temperature, then wants to lower the air temperature, and then operates the input cooling as function control, and inputs the function control to the air conditioning equipment for 4 steps in total.
By using the invention, the user can select from the semantically matched function subsets, thereby improving the interaction efficiency and reducing the interaction burden of the user. In order to achieve the technical effects, the application comprises the following key technical points:
the key point 1 is an input association mechanism based on semantics; the technical effects are as follows: performing device association through semantic implicit functions;
the key point 2 is based on a semantic input system of the intelligent watch; the technical effect is that an input system is realized by utilizing an intelligent table and a semantic-based input association mechanism, and the input system can be used as an input mode of intelligent equipment.
Specifically, the invention provides a semantic-based intelligent device control method, which comprises the following steps:
step 1s, constructing an internet of things comprising intelligent equipment and a control end, wherein a display device is arranged in or externally connected to the controller to display the functions of the intelligent equipment;
and 2s, the controller comprises at least one input sensor, the input sensor is used for representing specific semantics, and the user completes the control of the current display function of the display device by triggering the input sensor.
The intelligent equipment control method based on the semantics is characterized in that the display device displays the functions of the intelligent equipment.
The intelligent device control method based on the semantics, wherein the step 2 comprises the following steps: and continuously triggering the input sensor to switch the current function displayed by the display device.
The intelligent device control method based on the semantics, wherein the input sensor comprises: a forward button, a back button, a ok button, and a touch slide, the forward button and the back button representing a "previous" and "next" semantic, respectively, the ok button representing an "ok" semantic, and the relative sliding of the touch slide representing an "increase" or "decrease" semantic.
The intelligent equipment control method based on the semantics is characterized in that the intelligent equipment is a refrigerator, a sound box, a television and a desk lamp with the function of the Internet of things.
The intelligent device control method based on the semantics is characterized in that the control end comprises a Bluetooth transceiver module which is used for connecting the intelligent device.
The intelligent equipment control method based on the semantics is characterized in that the display device is an intelligent watch.
The intelligent device control method based on the semantics is characterized in that the content displayed by the display device comprises the name of the current intelligent device, the function of the current intelligent device and the state of the function of the current intelligent device.
In order to make the aforementioned features and effects of the present invention more comprehensible, embodiments accompanied with figures are described in detail below.
The following embodiments are mainly based on the semantic input system of the smart watch, but it should be noted that the present application is not limited to the semantic input mode of the smart watch, and for example, the AR-based spaced gesture operation is also possible.
(1) Designing touch interactive interface
The touch interactive interface determines how the user will express the semantics that they want to input. In the present system, we design users to touch different widgets to express their input semantics.
As shown in fig. 3, it is designed for the touch interface of the present system. The touch interface includes one bluetooth transceiver module (byte E73-2G4M04S1B embedded in NRF52832 chip, powered using CR 2032) and four copper touch widgets. The touch widgets are made of thin and soft copper strips, can be easily deployed on the surfaces of different objects, and are convenient to fuse with other ubiquitous input interfaces. The touch widget is connected with an analog input pin of the Bluetooth module and used for self-capacitance sensing.
In the system, three types of touch widgets are designed, and three types of semantics are included. (1) The user can touch the "previous" button to indicate that "up/forward/previous" etc. contain the semantics of "previous"; touching the "next" button to indicate that "down/back/next" etc. contain the semantics of "next"; (2) touching the "confirm" button to indicate that "confirm/allow" and the like contain the semantics of "confirm"; (3) touching the "slider bar" and sliding to the right means that "increase" or the like contains the semantics of "increase"; touching the "slider bar" and sliding to the left means "decrease" or the like contains the semantic of "decrease".
Three types of information are encoded as bluetooth broadcast information, broadcast every 20 ms. The smart watch may continuously scan the bluetooth broadcast and decode the touch state of each touch widget. And the instruction for specifically controlling the intelligent device can be generated by the intelligent watch and directly or indirectly sent to the intelligent device, or generated by the control end and directly or indirectly sent to the intelligent device.
2) Design selection display interface and selection mechanism
In the present system, a smart watch is used as a display device of the system. The reason for selecting the watch is that the watch can be worn on the wrist of the user, normal function selection of the user is not affected, and when the user touches a small component, attention does not need to be transferred between the touch interface and the display interface, so that one-hand touch input can be supported.
On the screen of the intelligent watch, one function is displayed at a time, each function is sequentially displayed within fixed time, and the circular progress bar at the edge of the screen is used for displaying time progress.
As shown in fig. 4a, the display layout consists of three parts. (1) The top is the name of the device currently to be manipulated. (2) The middle is an icon of a function, occupying a larger position in the layout. (3) The bottom most is the state of the function. The above display design makes it sufficient for the user to recognize the currently displayed device, function, and state at a glance, reducing the mental burden on the user.
In the present system, the selection of devices has been integrated into the selection of functions using a semantic-based input mechanism, avoiding additional effort by the user.
In the primitive system, the selection of a function is triggered by the pressing of a widget, a release or drag event, in which events semantics are included, which in turn correspond to the function. For example, as shown in fig. 4a to 4c, when the user presses the "confirm" widget, the system detects the behavior, the display interface of the watch uses a recommendation algorithm (making a recommendation according to context, user location, history information, etc.), and the recommendation includes a "confirm" semantic correspondence function (e.g., a function that does not include a binary semantic "confirm" and does not appear in the recommendation list). At the same time, the circle at the edge of the watch screen will indicate a countdown, if not the function the user wants to select is currently displayed, the user will keep holding the widget's action. The countdown ending system may recommend the next function until the user releases the touch widget, indicating that the user confirms the selection.
Specifically, in fig. 4a, when a user wants to control the switching of the desk lamp, he needs to press the confirmation button first, and at this time, the wristwatch may display a control interface of the television switching function, and continue to press the confirmation button, and the control interface is switched from the television switching function to the desk lamp switching function, and at this time, the desk lamp can be turned on or off by releasing the button;
fig. 4b shows that when the user wants to watch the tv program of the next channel, he needs to press the "next" button first, and at this time, a control interface for playing the next song by the speaker may be displayed on the wristwatch, and then the "next" button is pressed continuously, and the control interface switches from the function of playing the next song by the speaker to the function of the next channel of the tv, and at this time, the user can switch the tv program to the next program by releasing the button;
fig. 4c shows that, when a user wants to increase the sound volume of the sound box, the user needs to first press the sliding bar and slide the sliding bar along the specific direction of the sliding bar, at this time, a control interface which may display the brightness of the desk lamp is displayed on the wristwatch, the sliding bar is continuously pressed, the control interface is switched from the brightness of the desk lamp to the sound box volume, at this time, the sliding bar is released, the sound box volume can be increased, if the user forgets to slide the sliding bar along the specific direction of the sliding bar before, the user waits to switch to the sound box volume, and then the sliding bar is released after sliding along the specific direction of the sliding bar, so that the sound box volume can be increased.
The following are system examples corresponding to the above method examples, and this embodiment can be implemented in cooperation with the above embodiments. The related technical details mentioned in the above embodiments are still valid in this embodiment, and are not described herein again in order to reduce repetition. Accordingly, the related-art details mentioned in the present embodiment can also be applied to the above-described embodiments.
The invention also provides a semantic-based intelligent device control system which is characterized by comprising an intelligent device and a control end connected with the intelligent device, wherein a display device is arranged in or externally connected with the controller to display the function of matching the input semantics of the user, the controller comprises at least one input sensor, the input sensor is used for representing specific semantics, and the user can control the display function of the display device by triggering the input sensor.
And the display device periodically displays the function of matching the semantics input by the user. And continuously triggering the input sensor to switch the current function displayed by the display device. The input sensor includes: a forward button, a back button, a ok button, and a touch slide, the forward button and the back button representing a "previous" and "next" semantic, respectively, the ok button representing an "ok" semantic, and the relative sliding of the touch slide representing an "increase" or "decrease" semantic. The intelligent device can be a device with the function of the Internet of things, such as a refrigerator, a sound box, a television, a desk lamp and the like. The control end comprises a Bluetooth transceiver module used for connecting intelligent equipment. The display device is a smart watch. The content displayed by the display device comprises the name of the intelligent device, the function of the intelligent device and the state of the function of the intelligent device, wherein the name of the intelligent device matches the input semantics of the user.
Claims (9)
1. A semantic-based intelligent device control method is characterized by comprising the following steps:
step 1, constructing an internet of things comprising intelligent equipment and a control end, wherein the control end extracts the functions of the intelligent equipment;
and 2, the control end extracts input semantics of the user through the input sensor, screens the functions of the intelligent equipment based on the input semantics to obtain a function alternative set only matched with the input semantics, and controls the intelligent equipment to execute corresponding functions according to the functions selected by the user in the alternative set.
2. The intelligent device control method based on semantics as claimed in claim 1, wherein the control end is internally or externally connected with a display device to display functions of the intelligent device; and the display device displays the functions of the intelligent device.
3. The intelligent device control method based on semantics as claimed in claim 1, wherein the control end is internally or externally connected with a display device to display functions of the intelligent device; and the step 2 comprises: and continuously triggering the input sensor to switch the current function displayed by the display device.
4. The semantic-based smart device control method of claim 1, wherein the input sensor comprises: a forward button, a back button, a ok button, and a touch slide, the forward button and the back button representing a "previous" and "next" semantic, respectively, the ok button representing an "ok" semantic, and the relative sliding of the touch slide representing an "increase" or "decrease" semantic.
5. The semantic-based intelligent device control method of claim 1, wherein the intelligent device is a refrigerator, a sound box, a television and a desk lamp with internet of things.
6. The semantic-based smart device control method of claim 1, wherein the control end comprises a bluetooth transceiver module for connecting to the smart device.
7. The semantic-based smart device control method of claim 1, wherein the display device is a smart watch.
8. The semantic-based smart device control method according to claim 1, wherein the content displayed by the display means includes a name of the current smart device, a function of the current smart device, and a status of the function of the current smart device.
9. A semantic-based smart device control system, comprising:
the intelligent equipment has the function of the Internet of things and a control end connected with the intelligent equipment;
the control end is used for extracting the functions of the intelligent equipment, extracting the input semantics of the user through the input sensor, screening the functions of the intelligent equipment based on the input semantics to obtain a function alternative set only matched with the input semantics, and controlling the intelligent equipment to execute the corresponding functions according to the functions selected by the user in the alternative set.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110359565.9A CN113156827B (en) | 2021-04-02 | 2021-04-02 | Intelligent device control method and system based on semantics |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110359565.9A CN113156827B (en) | 2021-04-02 | 2021-04-02 | Intelligent device control method and system based on semantics |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113156827A true CN113156827A (en) | 2021-07-23 |
CN113156827B CN113156827B (en) | 2023-06-20 |
Family
ID=76886244
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110359565.9A Active CN113156827B (en) | 2021-04-02 | 2021-04-02 | Intelligent device control method and system based on semantics |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113156827B (en) |
Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120144299A1 (en) * | 2010-09-30 | 2012-06-07 | Logitech Europe S.A. | Blind Navigation for Touch Interfaces |
CN104363154A (en) * | 2014-11-27 | 2015-02-18 | 小米科技有限责任公司 | Smart home device control method and device |
EP2889256A1 (en) * | 2013-12-30 | 2015-07-01 | STILL GmbH | Industrial truck with display and operating device |
CN104834224A (en) * | 2015-05-13 | 2015-08-12 | 上海锳科迩电子股份有限公司 | Method for controlling intelligent household by use of buttons of intelligent mobile phone |
CN104977902A (en) * | 2014-04-02 | 2015-10-14 | 昆山研达电脑科技有限公司 | Remote managing and controlling system for household electrical appliance |
CN105573130A (en) * | 2015-12-15 | 2016-05-11 | 意诺科技有限公司 | Control panel and control method |
CN106647292A (en) * | 2015-10-30 | 2017-05-10 | 霍尼韦尔国际公司 | Wearable gesture control device and method for intelligent household system |
US20170192409A1 (en) * | 2016-01-06 | 2017-07-06 | Samsung Electronics Co., Ltd. | Electronic device and method for controlling the same |
CN107422943A (en) * | 2017-04-14 | 2017-12-01 | 阿里巴巴集团控股有限公司 | Button Activiation method and device |
CN108432213A (en) * | 2016-01-06 | 2018-08-21 | 三星电子株式会社 | Electronic equipment and its control method |
CN109032721A (en) * | 2018-06-27 | 2018-12-18 | 阿里巴巴集团控股有限公司 | A kind of background image switching method and device |
CN110268371A (en) * | 2017-01-03 | 2019-09-20 | 布里连特家居技术公司 | Home equipment controller with touch control slot |
CN110892342A (en) * | 2018-05-31 | 2020-03-17 | 深圳市蚂蚁雄兵物联技术有限公司 | Intelligent key function configuration method and intelligent key |
CN112506065A (en) * | 2020-12-09 | 2021-03-16 | 创维集团有限公司 | Resource playing method based on intelligent household intelligent control system |
-
2021
- 2021-04-02 CN CN202110359565.9A patent/CN113156827B/en active Active
Patent Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120144299A1 (en) * | 2010-09-30 | 2012-06-07 | Logitech Europe S.A. | Blind Navigation for Touch Interfaces |
EP2889256A1 (en) * | 2013-12-30 | 2015-07-01 | STILL GmbH | Industrial truck with display and operating device |
CN104977902A (en) * | 2014-04-02 | 2015-10-14 | 昆山研达电脑科技有限公司 | Remote managing and controlling system for household electrical appliance |
CN104363154A (en) * | 2014-11-27 | 2015-02-18 | 小米科技有限责任公司 | Smart home device control method and device |
CN104834224A (en) * | 2015-05-13 | 2015-08-12 | 上海锳科迩电子股份有限公司 | Method for controlling intelligent household by use of buttons of intelligent mobile phone |
CN106647292A (en) * | 2015-10-30 | 2017-05-10 | 霍尼韦尔国际公司 | Wearable gesture control device and method for intelligent household system |
CN105573130A (en) * | 2015-12-15 | 2016-05-11 | 意诺科技有限公司 | Control panel and control method |
US20170192409A1 (en) * | 2016-01-06 | 2017-07-06 | Samsung Electronics Co., Ltd. | Electronic device and method for controlling the same |
CN108432213A (en) * | 2016-01-06 | 2018-08-21 | 三星电子株式会社 | Electronic equipment and its control method |
CN110268371A (en) * | 2017-01-03 | 2019-09-20 | 布里连特家居技术公司 | Home equipment controller with touch control slot |
CN107422943A (en) * | 2017-04-14 | 2017-12-01 | 阿里巴巴集团控股有限公司 | Button Activiation method and device |
CN110892342A (en) * | 2018-05-31 | 2020-03-17 | 深圳市蚂蚁雄兵物联技术有限公司 | Intelligent key function configuration method and intelligent key |
CN109032721A (en) * | 2018-06-27 | 2018-12-18 | 阿里巴巴集团控股有限公司 | A kind of background image switching method and device |
CN112506065A (en) * | 2020-12-09 | 2021-03-16 | 创维集团有限公司 | Resource playing method based on intelligent household intelligent control system |
Non-Patent Citations (1)
Title |
---|
聂波等: "手持移动设备中多通道交互的通用开发框架", 《计算机应用研究》 * |
Also Published As
Publication number | Publication date |
---|---|
CN113156827B (en) | 2023-06-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104750440B (en) | Window management method, electronic installation and the computer program product of multi-screen | |
CN101482790B (en) | Electronic device capable of transferring object between two display elements and its control method | |
CN102075709B (en) | Touchpad television remote controller and touch control method thereof | |
US20160306438A1 (en) | Physical and virtual input device integration | |
CN109491562B (en) | Interface display method of voice assistant application program and terminal equipment | |
US20190187808A1 (en) | System and method for multi-mode command input | |
CN107278368A (en) | Screen control method and device | |
CN102141851A (en) | Multi-display device and method for controlling the same | |
CN103475919A (en) | Remote control method and system based on side face sliding touch and remote control | |
JP2013518316A (en) | Eye tracker based context action | |
JP2011154559A (en) | Haptic feedback device and haptic feedback method | |
CN103197759A (en) | Method, device and equipment for controlling external equipment on mobile equipment | |
US20070211038A1 (en) | Multifunction touchpad for a computer system | |
CN112817443A (en) | Display interface control method, device and equipment based on gestures and storage medium | |
CN101470575B (en) | Electronic device and its input method | |
CN106354273B (en) | A kind of method and smart machine manipulating smart machine | |
CN113156827B (en) | Intelligent device control method and system based on semantics | |
CN103456150A (en) | Remote control system and remote control method thereof | |
TW201317881A (en) | Method for editing on-screen display menu by touch module | |
TWI831966B (en) | Remote control | |
KR20090089707A (en) | Method and apparatus for zoom in/out using touch-screen | |
CN108733731A (en) | Convenient method, device and the electronic equipment of multimedia resource in a kind of change document | |
US20150106764A1 (en) | Enhanced Input Selection | |
CN113608635B (en) | Touch display device and control method thereof | |
CN107665053A (en) | Wearable electronic equipment and the man-machine interaction method suitable for it |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |