CN102799297B - Gestural control method and electronic installation - Google Patents
Gestural control method and electronic installation Download PDFInfo
- Publication number
- CN102799297B CN102799297B CN201110140087.9A CN201110140087A CN102799297B CN 102799297 B CN102799297 B CN 102799297B CN 201110140087 A CN201110140087 A CN 201110140087A CN 102799297 B CN102799297 B CN 102799297B
- Authority
- CN
- China
- Prior art keywords
- gesture
- plug
- program
- touch screen
- electronic installation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
A kind of gestural control method and electronic installation.This electronic installation has Touch Screen, and the method installs a plug-in program in the application program of electronic installation, and when this application program launching, start plug-in program to detect the gesture that user touches Touch Screen simultaneously, and utilize plug-in program this gesture to be converted to the steering order of the function of executive utility, and this steering order is sent to application program, perform this function with controlling application program.
Description
Technical field
The present invention relates to a kind of gestural control method and electronic installation, particularly relate to and a kind ofly utilize plug-in program to detect gesture and the method for controlling application program n-back test and electronic installation according to this.
Background technology
Nowadays consumers is light, thin, short, little for the requirement tendency of electronic installation external form, and this requirement makes the volume of electronic installation be subject to suitable restriction.For the devices such as desk-top computer, notebook computer or flat computer, to simultaneously configuration screen and keyboard on device, certainly will must reduce the size of screen.In order to configure larger screen in a limited space, recently develop a kind of Touch Screen, it simultaneously as display and the inputting interface of electronic installation, and can economize the cost of configure conventional keyboard and shared area.
The support of the operating system of action need device (the window operating system of such as MS) of Touch Screen own, then needs cooperatively interacting between application program, operating system and Touch Screen to be just achieved for the detection of touch points on Touch Screen and the identification of corresponding gesture thereof.
For example, Fig. 1 is the Organization Chart of known electronic.Please refer to Fig. 1, electronic installation 10 utilizes touch-control hardware/firmware (i.e. Touch Screen) 11 to detect the multiple touch points touched by user, after the identification of these touch points multi-point touch software library (multi-touchsoftware stack) in via operating system 12, namely can be converted to the gesture preset in operating system 12.This gesture, after sending application program 13 to, controlling application program 13 can perform corresponding function.
But, the prerequisite that above-mentioned gesture operation is operated is that application program 13 needs to operating system registration gesture operation function, or the process function having use corresponding in application program 13, even if otherwise user utilizes Touch Screen to make gesture in the window of application program 13, electronic installation 10 does not have any reaction yet.
Summary of the invention
The invention provides a kind of gestural control method and electronic installation, touch the gesture of Touch Screen by plug-in program identification user, and controlling application program can perform function corresponding to gesture.
The invention provides a kind of gestural control method, be applicable to the electronic installation with Touch Screen.The method installs a plug-in program in the application program of electronic installation, and when this application program launching, start plug-in program to detect the gesture that user touches Touch Screen simultaneously, and utilize plug-in program this gesture to be converted to the steering order of the function of executive utility, and this steering order is sent to application program, perform this function with controlling application program.
In one embodiment of this invention, above-mentioned startup plug-in program comprises with the step detecting user and touch the gesture of Touch Screen and utilizes plug-in program to open the full screen transparent window being positioned at the Touch Screen the superiors, to detect the gesture that user touches Touch Screen.
In one embodiment of this invention, above-mentioned startup plug-in program comprises with the step detecting user and touch the gesture of Touch Screen and utilizes plug-in program to register a gesture function to the operating system of electronic installation, wherein operating system can receive the position of multiple touch points that Touch Screen detects, and judge that user touches the gesture of Touch Screen according to this, then utilize the position that plug-in program receives the touch points that operating system receives and the gesture judged.
In one embodiment of this invention, above-mentioned startup plug-in program also comprises with the step detecting user and touch the gesture of Touch Screen the operating mode utilizing plug-in program to detect application program, and when detecting that the operating mode of application program is converted to bulletin play mode, start to detect the gesture that user touches Touch Screen.
In one embodiment of this invention, whether above-mentioned startup plug-in program also comprises with the step detecting user and touch the gesture of Touch Screen the window utilizing plug-in program to detect application program and is enabled, and when detecting that the window of application program is enabled, start to detect the gesture that user touches Touch Screen.
The present invention proposes a kind of electronic installation, and it comprises Touch Screen, application module and plug-in module.Wherein, Touch Screen is in order to detect multiple touch points of user's touching.Application module is installed on electronic installation, and plug-in module is installed on application module.Wherein, when applying module and starting, plug-in module also starts to detect the gesture that user touches Touch Screen simultaneously, and this gesture is converted to the steering order of the function performing application module, and this steering order is sent to application module, to control to apply the function described in module execution.
In one embodiment of this invention, above-mentioned plug-in module opens the full screen transparent window being positioned at the Touch Screen the superiors, to detect the gesture that user touches Touch Screen.
In one embodiment of this invention, above-mentioned electronic installation also comprises operating system module, its position of multiple touch points in order to receive Touch Screen and detect, and judges that user touches the gesture of Touch Screen according to this.Wherein, plug-in module also registers a gesture function to operating system module, with the position receiving the touch points that operating system module receives and the gesture judged.
In one embodiment of this invention, above-mentioned plug-in module also detects the operating mode of application module, and when detecting that the operating mode of application module is converted to bulletin play mode, starts to detect the gesture that user touches Touch Screen.
In one embodiment of this invention, whether the window that above-mentioned plug-in module also detects application module is enabled, and when detecting that the window of application module is enabled, starts to detect the gesture that user touches Touch Screen.
Based on above-mentioned, gestural control method of the present invention and electronic installation install plug-in program by application program, and after application program launching, start plug-in program to detect the gesture of user simultaneously, and controlling application program according to this, and then application program can be supported, and gesture controls.
For above-mentioned feature and advantage of the present invention can be become apparent, special embodiment below, and coordinate accompanying drawing to be described in detail below.
Accompanying drawing explanation
Fig. 1 is the Organization Chart of known electronic.
Fig. 2 is the schematic diagram according to the electronic installation framework shown in one embodiment of the invention.
Fig. 3 is the block scheme according to the electronic installation shown in one embodiment of the invention.
Fig. 4 is the process flow diagram according to the gestural control method shown in one embodiment of the invention.
Fig. 5 is the block scheme according to the electronic installation shown in one embodiment of the invention.
Fig. 6 is the process flow diagram according to the gestural control method shown in one embodiment of the invention.
Reference numeral:
10,20,30,50: electronic installation
11,21: touch-control hardware/firmware
12,22: operating system
13,23: application program
24: plug-in program
31,51: Touch Screen
32,52: application module
33,53: plug-in module
54: operating system module
S41 ~ S44: the step of the gestural control method of one embodiment of the invention
S61 ~ S65: the step of the gestural control method of one embodiment of the invention
Embodiment
The present invention is directed to the electronic installation with Touch Screen and gesture controlling functions is provided, by in application program, a plug-in program is installed, to detect the gesture that user touches on Touch Screen in the process performed in application program, and be converted to the steering order of application program in good time, and controlling application program can perform corresponding function.By this, for the application program controlled for not supporting gesture, the present invention can provide a solution to control to realize gesture.
Fig. 2 is the schematic diagram according to the electronic installation framework shown in one embodiment of the invention.Please refer to Fig. 2, the electronic installation 20 of the present embodiment utilizes touch-control hardware/firmware (i.e. Touch Screen) 21 to detect the multiple touch points touched by user, these touch points via the identification of multi-point touch software library in operating system 22 (multi-touch software stack), can be converted to the gesture that operating system 22 is preset.
With known technology unlike, the present embodiment can receive the position of touch points from operating system 22 except allowing application program 23, also in application program 23, a plug-in program 24 is installed, use and receive its gesture detected from operating system 22, or judge gesture voluntarily again after operating system 22 receives touch points position.
And via the conversion of plug-in program 24, namely the gesture operation of user on Touch Screen can be exchanged into the steering order of application program 23, and perform corresponding function in order to controlling application program 23, and then reach effect that gesture controls.Below then describe in detail for embodiment.
Fig. 3 is the block scheme according to the electronic installation shown in one embodiment of the invention.Please refer to Fig. 3, the electronic installation 30 of the present embodiment is such as the devices such as notebook computer, desk-top computer or flat computer, wherein the Storage Media (not shown) such as hard disk, storer or solid state storage device be can comprise, and program or other application programs of the operating system of stored electrons device 30 can be used to.
Electronic installation 30 comprises Touch Screen 31, application module 32 and plug-in module 33.Wherein, Touch Screen 31 is such as the display and input media integrated by the touching sensing element of resistance-type, condenser type or other kinds and LCD screen.Application module 32 is such as mounted in the program in the operating system of electronic installation 30, and it via the operation of user, can perform the various kinds functions such as bulletin broadcasting, web page browsing, multimedia.Plug-in module 33 is such as mounted in the auxiliary routine on application module 32, and it can perform the function originally cannot supported by assistance application module 32, such as gesture controlling functions.
It should be noted that, above-mentioned application module 32 and plug-in module 33 are such as the hardware units combined with logic circuit component, and can perform gesture controlling functions.These modules also can be stored in the program in the storer of electronic installation 30 or hard disk, and it can be loaded into the processor of electronic installation 30, and performs gesture controlling functions.Below only illustrate with the form of software (i.e. application program and plug-in program) detailed step that electronic installation 30 realizes gesture and controls.
Fig. 4 is the process flow diagram according to the gestural control method shown in one embodiment of the invention.Please refer to Fig. 4, the method for the present embodiment is applicable to the electronic installation 30 of Fig. 3, the detailed step of the every component description gestural control method in electronic installation 30 of namely arranging in pairs or groups below:
First, the application program of electronic installation 30 installs a plug-in program (step S41).This plug-in program be such as by manufacturer for application program function designed by a kind of converse routine, its can CD, portable disk form be supplied to user, and be arranged on electronic installation 30 voluntarily by user, or in the mode that network is shared, manually downloaded by user or automatically downloaded by electronic installation 30, to be arranged on electronic installation 30, do not limit at this.
When application program launching, namely electronic installation 30 starts plug-in program simultaneously and detects the gesture (step S42) that user touches Touch Screen.In detail, electronic installation 30 is such as utilize plug-in program to open to be positioned at the full screen transparent window of Touch Screen 31 the superiors, and because of full screen transparent window be for this reason be positioned at the superiors, therefore can receive all touch points.By this, plug-in program according to the position of received touch points, can judge that user touches the gesture of Touch Screen 31.
Then, plug-in program is utilized detected gesture to be converted to the steering order (step S43) of the function of executive utility by electronic installation 30.In detail, plug-in program such as received touch points is intact can be supplied to application program, and only changes for received gesture, makes it can correspond to specific function in application program.
Finally, utilize plug-in program that the steering order after conversion is sent to application program by electronic installation 30, the function (step S44) described in performing with controlling application program.By this, the effect that gesture controls can be reached.
For example, the word processor Word of Microsoft does not still support that flicking (flickrightwards) to the right controls with the gesture of flicking (flick leftwards) left at present.The plug-in program of the present embodiment then can receive and detect these two kinds of gestures that user makes, and be converted to the predefined operating function of user, use and control word processor execution corresponding function, such as, control word processor and switch to previous file or next file.
It should be noted that, in the above-described embodiments, plug-in program is the gesture judging user according to the position of received touch points voluntarily, and in another embodiment, plug-in program also can directly to the operating system registration gesture function of electronic installation, to obtain the gestures detection result that operating system identification touch points obtains, and then be converted to the steering order of application program.Below then describe in detail for an embodiment again.
Fig. 5 is the block scheme according to the electronic installation shown in one embodiment of the invention.Please refer to Fig. 5, the electronic installation 50 of the present embodiment is such as the devices such as notebook computer, desk-top computer or flat computer, wherein the Storage Media (not shown) such as hard disk, storer or solid state storage device be can comprise, and operating system or other programs of stored electrons device 50 can be used to.
Electronic installation 50 comprises Touch Screen 51, application module 52, plug-in module 53 and operating system module 54.Wherein, Touch Screen 31 is such as the display and input media integrated by the touching sensing element of resistance-type, condenser type or other kinds and LCD screen.Application module 52, plug-in module 53 and operating system module 54 are such as the hardware units combined with logic circuit component, and can perform gesture controlling functions.These modules also can be stored in the program in the storer of electronic installation 50 or hard disk, and it can be loaded into the processor of electronic installation 50, and performs gesture controlling functions.Below only illustrate that electronic installation 50 performs the detailed step of gesture controlling functions with the form of software (i.e. application program, plug-in program and operating system).
Fig. 6 is the process flow diagram according to the gestural control method shown in one embodiment of the invention.Please refer to Fig. 6, the method for the present embodiment is applicable to the electronic installation 50 of Fig. 5, the detailed step of the every component description gestural control method in electronic installation 50 of namely arranging in pairs or groups below:
First, the application program of electronic installation 50 installs a plug-in program (step S61).Wherein, when application program launching, namely electronic installation 50 starts plug-in program simultaneously and detects the gesture that user touches Touch Screen 51.
With previous embodiment unlike, the present embodiment is before detection gesture, plug-in program first can detect the operating mode (step S62) of application program, and when plug-in Programmable detection is converted to bulletin play mode to the operating mode of application program, just start to detect the gesture (step S63) that user touches Touch Screen 51.Wherein, plug-in program such as in advance to the operating system registration gesture function of electronic installation 50, therefore when detecting that application program is converted to bulletin play mode, namely directly obtains gestures detection result from operating system.
It should be noted that, plug-in program can obtain touch points and the gesture of universe from operating system, and whether the window that can detect application program is further enabled.And when detecting that the window of application program is enabled, just can detect the gesture that user touches Touch Screen 51, otherwise under the state be not enabled at the window of application program, just ignore and do not process.
Then, plug-in program is utilized detected gesture to be converted to the steering order (step S64) of the function of executive utility by electronic installation 50, then the steering order after conversion is sent to application program, the function (step S65) described in performing with controlling application program.By this, the effect that gesture controls can be reached.
For example, the presentation software PowerPoint of Microsoft still cannot support that gesture controls at present under the environment of window operating system Windows7, and the plug-in program of the present embodiment then can head it off.This plug-in program also and then can start while presentation software is activated, and when presentation software enters the bulletin play mode of full screen, plug-in program just can start the gesture detecting user.Once gesture be detected, be namely converted to corresponding steering order at once, and send presentation software to, perform corresponding function to control presentation software.Such as, when plug-in program detects the gesture of upwards flicking (flick up), namely control presentation software and translate into page up; And when plug-in program detects the gesture of flicking (flick down) downwards, then control presentation software and translate into lower one page.
In sum, gestural control method of the present invention and electronic installation install plug-in program by application program, and utilize plug-in program detect the gesture of user or receive its gesture detected from operating system, and then convert the steering order of application program to, gesture can be controlled to be applied in the application program of any kind by this.
Although the present invention with embodiment disclose as above, so itself and be not used to limit the present invention, any person of an ordinary skill in the technical field, when doing a little change and retouching, and does not depart from the spirit and scope of the present invention.
Claims (8)
1. a gestural control method, be applicable to an electronic installation with a Touch Screen, the method comprises the following steps:
One plug-in program is installed in an application program of this electronic installation;
When the application starts, start this plug-in program to detect the gesture that a user touches this Touch Screen simultaneously;
This plug-in program is utilized to change this gesture for performing a steering order of a function of this application program; And
Transmit this steering order to this application program, perform this function to control this application program,
Wherein start this plug-in program to comprise with the step detecting this user and touch this gesture of this Touch Screen:
This plug-in program is utilized to detect an operating mode of this application program; And
When detecting that this operating mode of this application program is converted to a bulletin play mode, start to detect this gesture that this user touches this Touch Screen.
2. gestural control method according to claim 1, wherein starts this plug-in program and comprises with the step detecting this user and touch this gesture of this Touch Screen:
This plug-in program is utilized to open the full screen transparent window being positioned at these Touch Screen the superiors, to detect this gesture that this user touches this Touch Screen.
3. gestural control method according to claim 1, wherein starts this plug-in program and comprises with the step detecting this user and touch this gesture of this Touch Screen:
Utilize this plug-in program to register a gesture function to an operating system of this electronic installation, wherein this operating system receives the position of multiple touch points that this Touch Screen detects, and judges that this user touches this gesture of this Touch Screen according to this; And
This gesture utilizing this plug-in program to receive this operating system to judge.
4. gestural control method according to claim 1, wherein starts this plug-in program and also comprises with the step detecting this user and touch this gesture of this Touch Screen:
Whether the window utilizing this plug-in program to detect this application program is enabled; And
When detecting that this window of this application program is enabled, start to detect this gesture that this user touches this Touch Screen.
5. an electronic installation, comprising:
One Touch Screen, detects multiple touch points of user's touching;
One application module, is installed on this electronic installation; And
One plug-in module, is installed on this application module, wherein
When this application module starts, start this plug-in module to detect the gesture that this user touches this Touch Screen simultaneously, change the steering order that this gesture is the function performing this application module, and transmit this steering order to this application module, this function is performed to control this application module
Wherein this plug-in module comprises the operating mode detecting this application module, and when detecting that this operating mode of this application module is converted to a bulletin play mode, starts to detect this gesture that this user touches this Touch Screen.
6. electronic installation according to claim 5, wherein this plug-in module comprises the full screen transparent window opened and be positioned at these Touch Screen the superiors, to detect this gesture that this user touches this Touch Screen.
7. electronic installation according to claim 5, wherein also comprises:
One operating system module, receives the position of multiple touch points that this Touch Screen detects, and judges that this user touches this gesture of this Touch Screen according to this, wherein
This plug-in module also comprises registers a gesture function to this operating system module, to receive this gesture that this operating system module judges.
8. electronic installation according to claim 5, wherein whether this plug-in module also comprises and detects a window of this application module and be enabled, and when detecting that this window of this application module is enabled, start to detect this gesture that this user touches this Touch Screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110140087.9A CN102799297B (en) | 2011-05-27 | 2011-05-27 | Gestural control method and electronic installation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110140087.9A CN102799297B (en) | 2011-05-27 | 2011-05-27 | Gestural control method and electronic installation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102799297A CN102799297A (en) | 2012-11-28 |
| CN102799297B true CN102799297B (en) | 2015-08-19 |
Family
ID=47198421
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110140087.9A Active CN102799297B (en) | 2011-05-27 | 2011-05-27 | Gestural control method and electronic installation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102799297B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104238794B (en) * | 2013-06-24 | 2019-07-16 | 腾讯科技（深圳）有限公司 | The response method and terminal, mobile terminal of a kind of pair of contact action |
| US10120639B2 (en) | 2014-07-04 | 2018-11-06 | Huawei Technologies Co., Ltd. | Multimedia playing application control method and terminal |
| CN104123164B (en) * | 2014-07-31 | 2018-01-16 | 广东欧珀移动通信有限公司 | A kind of startup method and apparatus of application program |
| CN105843672A (en) * | 2015-01-16 | 2016-08-10 | 阿里巴巴集团控股有限公司 | Control method, device and system for application program |
| CN108021418A (en) * | 2016-11-02 | 2018-05-11 | 中兴通讯股份有限公司 | A kind of control method, device and terminal |
| CN114529977A (en) * | 2020-11-02 | 2022-05-24 | 青岛海尔多媒体有限公司 | Gesture control method and device for intelligent equipment and intelligent equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1397882A (en) * | 2002-07-29 | 2003-02-19 | 无敌科技(西安)有限公司 | Method for applying external fonts to portable electronic communication device |
| CN101114193A (en) * | 2006-07-25 | 2008-01-30 | 曹英 | Universal externally hung type wireless input-output system and method thereof |
| CN101498973A (en) * | 2008-01-30 | 2009-08-05 | 义隆电子股份有限公司 | Touch control interpretation structure and method for executing touch control application program by multi-finger gesture |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW201109994A (en) * | 2009-09-10 | 2011-03-16 | Acer Inc | Method for controlling the display of a touch screen, user interface of the touch screen, and electronics using the same |
-
2011
- 2011-05-27 CN CN201110140087.9A patent/CN102799297B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1397882A (en) * | 2002-07-29 | 2003-02-19 | 无敌科技(西安)有限公司 | Method for applying external fonts to portable electronic communication device |
| CN101114193A (en) * | 2006-07-25 | 2008-01-30 | 曹英 | Universal externally hung type wireless input-output system and method thereof |
| CN101498973A (en) * | 2008-01-30 | 2009-08-05 | 义隆电子股份有限公司 | Touch control interpretation structure and method for executing touch control application program by multi-finger gesture |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102799297A (en) | 2012-11-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102799297B (en) | Gestural control method and electronic installation | |
| US8922476B2 (en) | Information handling devices with touch-based reflective display | |
| US9904510B2 (en) | Information handling devices with touch-based reflective display | |
| US9035883B2 (en) | Systems and methods for modifying virtual keyboards on a user interface | |
| CN101454762B (en) | Plug and play peripheral storing driver | |
| JP5010714B2 (en) | Electronic device, input control program, and input control method | |
| US20090128504A1 (en) | Touch screen peripheral device | |
| US20080055256A1 (en) | Touch screen controller with embedded overlay | |
| CN102693063B (en) | Operation control method and device and electronic equipment | |
| US20090315841A1 (en) | Touchpad Module which is Capable of Interpreting Multi-Object Gestures and Operating Method thereof | |
| US20100265209A1 (en) | Power reduction for touch screens | |
| CN102880332A (en) | Local control method and system of touch panel | |
| US20140181746A1 (en) | Electrionic device with shortcut function and control method thereof | |
| US20120098772A1 (en) | Method and apparatus for recognizing a gesture in a display | |
| US20100001961A1 (en) | Information Handling System Settings Adjustment | |
| US20130093712A1 (en) | Touch sensing method and electronic apparatus using the same | |
| US20130159917A1 (en) | Dynamic user interface based on connected devices | |
| US20150138127A1 (en) | Electronic apparatus and input method | |
| CN103150108A (en) | Equipment screen component moving method and device, and electronic equipment | |
| CN105556463A (en) | Selecting operating systems based on a computing device mode | |
| KR20200051783A (en) | Method and terminal for displaying multiple content cards | |
| US20170031464A1 (en) | Information Handling System Virtualized Pointing Device Support Between Multiple Protocols | |
| CN102778966B (en) | Mouse emulation is utilized to touch method and the device of input | |
| KR20110005434A (en) | Auxiliary touch monitor system capable of independent touch input and independent touch input method of the auxiliary touch monitor | |
| US20130154957A1 (en) | Snap to center user interface navigation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |