CN114527924A - Control method based on double-screen device, storage medium and device - Google Patents
Control method based on double-screen device, storage medium and device Download PDFInfo
- Publication number
- CN114527924A CN114527924A CN202210143022.8A CN202210143022A CN114527924A CN 114527924 A CN114527924 A CN 114527924A CN 202210143022 A CN202210143022 A CN 202210143022A CN 114527924 A CN114527924 A CN 114527924A
- Authority
- CN
- China
- Prior art keywords
- screen
- instruction
- gesture
- control instruction
- double
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 239000004973 liquid crystal related substance Substances 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 6
- 238000010801 machine learning Methods 0.000 claims description 3
- 230000009977 dual effect Effects 0.000 claims 1
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- Artificial Intelligence (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Computation (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Medical Informatics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Life Sciences & Earth Sciences (AREA)
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a control method, a storage medium and a device based on a double-screen device.
Description
Technical Field
The invention relates to the technical field of electronic equipment, in particular to a control method based on double-screen equipment, a storage medium and equipment.
Background
With the rapid development of electronic devices such as smart phones and tablet computers, more and more users choose to use the electronic devices for learning, working or entertainment. At present, double-screen equipment gradually appears on the market, and double-screen application of an ink screen and a liquid crystal screen also starts to enter the visual field of people. Gesture recognition control is a common control method, but currently, a better gesture recognition control scheme suitable for a dual-screen device is lacked.
Disclosure of Invention
In view of the defects in the prior art, the present invention aims to provide a control method, a storage medium and a device based on a dual-screen device.
In order to achieve the purpose, the invention adopts the following technical scheme:
a control method based on double-screen equipment is disclosed, wherein the screen of the double-screen equipment at least comprises an ink screen and a liquid crystal screen; the method comprises the following steps:
the double-screen equipment can acquire gesture data of a user and recognize specific gestures through one or more of a radar sensor, an infrared gesture sensor and a camera;
the method comprises the steps that the relation between different gestures and different control instructions is stored in the double-screen equipment in advance; the control instruction is divided into three types of a common instruction, a distinguishing instruction and a characteristic instruction; the common instruction refers to a control instruction aiming at other aspects irrelevant to the screen in the double-screen equipment without distinguishing the left hand from the right hand, the distinguishing instruction refers to a control instruction which needs to distinguish the left hand from the right hand and is only executed aiming at one screen at the same time, and the characteristic instruction refers to an instruction which does not need to distinguish the left hand from the right hand and is only applicable to a certain specific screen;
the method comprises the steps that a user selects a specific control instruction to be set, when the control instruction to be set by the user is a common instruction or a characteristic instruction, a corresponding gesture is input by one hand, when the control instruction to be set by the user is a distinguishing instruction, the corresponding relation between the left hand and the right hand and the ink screen and the liquid crystal screen is determined, and then for the same gesture, a gesture of the left hand and a gesture of the right hand are input respectively to correspond to the control instruction of the ink screen and the control instruction of the corresponding liquid crystal screen;
when a user makes a gesture towards the double-screen device, the double-screen device recognizes a specific gesture shape and judges a control instruction corresponding to the gesture after acquiring gesture data through one or more of a radar sensor, an infrared gesture sensor and a camera, if the control instruction is a common instruction or a characteristic instruction, the control instruction is directly executed, and if the control instruction is a distinguishing instruction, whether the current gesture is made is a left hand or a right hand is further judged, so that the control instruction is judged to be executed on an ink screen or a liquid crystal screen.
Furthermore, in the double-screen device, a large number of pictures of different gestures of the left hand and the right hand are collected in advance to serve as training samples, a preliminary gesture recognition model is obtained through machine learning algorithm training, when a user sets a gesture and a control instruction, the pictures of the left hand and the right hand of the user who make different gestures are further collected for further training, and a final gesture recognition model is obtained.
The present invention provides a computer-readable storage medium having stored therein a computer program which, when executed by a processor, implements the above-described method.
The invention provides a dual-screen device, comprising a processor and a memory, wherein the memory is used for storing a computer program; the processor is configured to implement the above method when executing the computer program.
The invention has the beneficial effects that: according to the invention, the control instructions are classified, and different gesture input and recognition mechanisms are adopted for different types of control instructions, so that the control of the double-screen equipment is clearer, the situation of error control is reduced, the operation required by a user is reduced, and the inconvenience brought to the user is reduced.
Detailed Description
The present invention will be further described below, and it should be noted that the present embodiment is based on the technical solution, and a detailed implementation manner and a specific operation process are provided, but the protection scope of the present invention is not limited to the present embodiment.
The embodiment provides a control method based on a double-screen device, wherein the screen of the double-screen device at least comprises an ink screen and a liquid crystal screen; the dual-screen device can be a smart watch, a student tablet and the like.
The double-screen equipment can acquire gesture data of a user and recognize specific gestures through one or more of a radar sensor, an infrared gesture sensor and a camera;
the method comprises the steps that the relation between different gestures and different control instructions is stored in the double-screen equipment in advance; the control instruction is divided into three types of a common instruction, a distinguishing instruction and a characteristic instruction; the common command refers to a control command (such as volume adjustment) aiming at other aspects unrelated to the screen in the dual-screen device without distinguishing the left hand from the right hand, the distinguishing command refers to a control command (such as a sleep/wake-up function aiming at one screen) which needs to distinguish the left hand from the right hand and is only executed aiming at one screen at the same time, and the characteristic command refers to a command (such as a global refresh command only suitable for an ink screen and not effective for a liquid crystal screen) which does not need to distinguish the left hand from the right hand and is only suitable for a certain specific screen;
the method comprises the steps that a user selects a specific control instruction to be set, when the control instruction to be set by the user is a common instruction or a characteristic instruction, a corresponding gesture is input by one hand, when the control instruction to be set by the user is a distinguishing instruction, the corresponding relation between the left hand and the right hand and the ink screen and the liquid crystal screen is determined, and then for the same gesture, a gesture of the left hand and a gesture of the right hand are input respectively to correspond to the control instruction of the ink screen and the control instruction of the corresponding liquid crystal screen;
when a user makes a gesture towards the double-screen device, the double-screen device recognizes a specific gesture shape and judges a control instruction corresponding to the gesture after acquiring gesture data through one or more of a radar sensor, an infrared gesture sensor and a camera, if the control instruction is a common instruction or a characteristic instruction, the control instruction is directly executed, and if the control instruction is a distinguishing instruction, whether the current gesture is made is a left hand or a right hand is further judged, so that the control instruction is judged to be executed on an ink screen or a liquid crystal screen.
Furthermore, in the double-screen device, a large number of pictures of different gestures of the left hand and the right hand are collected in advance to serve as training samples, a preliminary gesture recognition model is obtained through machine learning algorithm training, when a user sets a gesture and a control instruction, the pictures of the left hand and the right hand of the user who make different gestures are further collected for further training, and a final gesture recognition model is obtained.
Various corresponding changes and modifications can be made by those skilled in the art based on the above technical solutions and concepts, and all such changes and modifications should be included in the protection scope of the present invention.
Claims (4)
1. A control method based on double-screen equipment is disclosed, wherein the screen of the double-screen equipment at least comprises an ink screen and a liquid crystal screen; the method is characterized by comprising the following steps:
the double-screen equipment can acquire gesture data of a user and recognize specific gestures through one or more of a radar sensor, an infrared gesture sensor and a camera;
the method comprises the steps that the relation between different gestures and different control instructions is stored in the double-screen equipment in advance; the control instruction is divided into three types of a common instruction, a distinguishing instruction and a characteristic instruction; the common instruction refers to a control instruction aiming at other aspects irrelevant to the screen in the double-screen equipment without distinguishing the left hand from the right hand, the distinguishing instruction refers to a control instruction which needs to distinguish the left hand from the right hand and is only executed aiming at one screen at the same time, and the characteristic instruction refers to an instruction which does not need to distinguish the left hand from the right hand and is only applicable to a certain specific screen;
the method comprises the steps that a user selects a specific control instruction to be set, when the control instruction to be set by the user is a common instruction or a characteristic instruction, a corresponding gesture is input by one hand, when the control instruction to be set by the user is a distinguishing instruction, the corresponding relation between the left hand and the right hand and the ink screen and the liquid crystal screen is determined, and then for the same gesture, a gesture of the left hand and a gesture of the right hand are input respectively to correspond to the control instruction of the ink screen and the control instruction of the corresponding liquid crystal screen;
when a user makes a gesture towards the double-screen device, the double-screen device recognizes a specific gesture shape and judges a control instruction corresponding to the gesture after acquiring gesture data through one or more of a radar sensor, an infrared gesture sensor and a camera, if the control instruction is a common instruction or a characteristic instruction, the control instruction is directly executed, and if the control instruction is a distinguishing instruction, whether the current gesture is made is a left hand or a right hand is further judged, so that the control instruction is judged to be executed on an ink screen or a liquid crystal screen.
2. The method according to claim 1, characterized in that in the double-screen device, a large number of pictures of different gestures of the left hand and the right hand are collected as training samples in advance, a preliminary gesture recognition model is obtained through machine learning algorithm training, and when a user sets a gesture and a control instruction, pictures of different gestures made by the left hand and the right hand of the user are further collected for further training, so that a final gesture recognition model is obtained.
3. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method of any one of claims 1-2.
4. A dual screen device comprising a processor and a memory, the memory for storing a computer program; the processor is adapted to carry out the method of any of claims 1-2 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210143022.8A CN114527924A (en) | 2022-02-16 | 2022-02-16 | Control method based on double-screen device, storage medium and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210143022.8A CN114527924A (en) | 2022-02-16 | 2022-02-16 | Control method based on double-screen device, storage medium and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114527924A true CN114527924A (en) | 2022-05-24 |
Family
ID=81622243
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210143022.8A Pending CN114527924A (en) | 2022-02-16 | 2022-02-16 | Control method based on double-screen device, storage medium and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114527924A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140101578A1 (en) * | 2012-10-10 | 2014-04-10 | Samsung Electronics Co., Ltd | Multi display device and control method thereof |
| US20140258880A1 (en) * | 2013-03-07 | 2014-09-11 | Nokia Corporation | Method and apparatus for gesture-based interaction with devices and transferring of contents |
| CN107507469A (en) * | 2017-08-27 | 2017-12-22 | 广州慈华信息科技有限公司 | A kind of children of double screen paint the implementation method of this electronic reading device |
| CN110164440A (en) * | 2019-06-03 | 2019-08-23 | 清华大学 | Electronic equipment, method and medium are waken up based on the interactive voice for sealing mouth action recognition |
| CN110231866A (en) * | 2019-05-29 | 2019-09-13 | 中国第一汽车股份有限公司 | Vehicular screen control method, system, vehicle and storage medium |
| CN112069914A (en) * | 2020-08-14 | 2020-12-11 | 杭州鸿泉物联网技术股份有限公司 | Vehicle control method and system |
| CN112639714A (en) * | 2020-03-20 | 2021-04-09 | 华为技术有限公司 | Method, device and system for executing gesture instruction and storage medium |
| CN112905004A (en) * | 2021-01-21 | 2021-06-04 | 浙江吉利控股集团有限公司 | Gesture control method and device for vehicle-mounted display screen and storage medium |
-
2022
- 2022-02-16 CN CN202210143022.8A patent/CN114527924A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140101578A1 (en) * | 2012-10-10 | 2014-04-10 | Samsung Electronics Co., Ltd | Multi display device and control method thereof |
| US20140258880A1 (en) * | 2013-03-07 | 2014-09-11 | Nokia Corporation | Method and apparatus for gesture-based interaction with devices and transferring of contents |
| CN107507469A (en) * | 2017-08-27 | 2017-12-22 | 广州慈华信息科技有限公司 | A kind of children of double screen paint the implementation method of this electronic reading device |
| CN110231866A (en) * | 2019-05-29 | 2019-09-13 | 中国第一汽车股份有限公司 | Vehicular screen control method, system, vehicle and storage medium |
| CN110164440A (en) * | 2019-06-03 | 2019-08-23 | 清华大学 | Electronic equipment, method and medium are waken up based on the interactive voice for sealing mouth action recognition |
| CN112639714A (en) * | 2020-03-20 | 2021-04-09 | 华为技术有限公司 | Method, device and system for executing gesture instruction and storage medium |
| CN112069914A (en) * | 2020-08-14 | 2020-12-11 | 杭州鸿泉物联网技术股份有限公司 | Vehicle control method and system |
| CN112905004A (en) * | 2021-01-21 | 2021-06-04 | 浙江吉利控股集团有限公司 | Gesture control method and device for vehicle-mounted display screen and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR20130128412A (en) | Multi-character continuous handwriting input method | |
| US20130154947A1 (en) | Determining a preferred screen orientation based on known hand positions | |
| CN109284059A (en) | Person's handwriting method for drafting, device, interactive intelligent tablet computer and storage medium | |
| JP2014502399A (en) | Handwriting input method by superimposed writing | |
| CN109062433A (en) | Method, apparatus, smart machine and the storage medium of touch data processing | |
| CN107193519A (en) | Display control method and device, computer installation and computer-readable recording medium | |
| US20180224997A1 (en) | Method and system for one-handed operations of mobile terminal | |
| CN103455292A (en) | Business data display and processing method and device and user equipment | |
| CN111857484B (en) | Screen brightness adjusting method and device, electronic equipment and readable storage medium | |
| US9588678B2 (en) | Method of operating electronic handwriting and electronic device for supporting the same | |
| CN102402275A (en) | Portable electronic equipment and holding gesture detection method | |
| CN109191547A (en) | element adsorption method, device, equipment and storage medium | |
| WO2019019818A1 (en) | Method and apparatus for accelerating black screen gesture processing, storage medium, and mobile terminal | |
| CN111045577A (en) | Horizontal and vertical screen switching method, wearable device and device with storage function | |
| CN106293462B (en) | A kind of character displaying method and device | |
| CN104182161A (en) | Method and device for opening screen functional area | |
| CN106959805A (en) | display control method and terminal device | |
| US10402144B2 (en) | Portable electronic device and operation method thereof | |
| CN106569716A (en) | One-hand operation and control method and control system | |
| CN103914228A (en) | Mobile terminal and touch screen operating method thereof | |
| CN114489331A (en) | Method, apparatus, device and medium for interaction of separated gestures distinguished from button clicks | |
| CN114527924A (en) | Control method based on double-screen device, storage medium and device | |
| CN110297592B (en) | Processing method and electronic equipment | |
| CN111857338A (en) | Method suitable for using mobile application on large screen | |
| CN103809909A (en) | Information processing method and electronic devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |