CN101976143A - Touch screen operation gesture management system and method - Google Patents

Touch screen operation gesture management system and method Download PDF

Info

Publication number
CN101976143A
CN101976143A CN2010102993701A CN201010299370A CN101976143A CN 101976143 A CN101976143 A CN 101976143A CN 2010102993701 A CN2010102993701 A CN 2010102993701A CN 201010299370 A CN201010299370 A CN 201010299370A CN 101976143 A CN101976143 A CN 101976143A
Authority
CN
China
Prior art keywords
gesture
module
information
feature information
touch
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2010102993701A
Other languages
Chinese (zh)
Inventor
张�杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NANJING DIANMIAN PHOTOELECTRICITY CO Ltd
Original Assignee
NANJING DIANMIAN PHOTOELECTRICITY CO Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NANJING DIANMIAN PHOTOELECTRICITY CO Ltd filed Critical NANJING DIANMIAN PHOTOELECTRICITY CO Ltd
Priority to CN2010102993701A priority Critical patent/CN101976143A/en
Publication of CN101976143A publication Critical patent/CN101976143A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention discloses a touch screen operation gesture management method comprising the step of adding an operation gesture and deleting an operation gesture: selecting the step of adding or deleting an operation gesture; inputting the gesture via the touch screen by a user; obtaining gesture data input via the touch screen by the user; extracting gesture characteristic information; if selecting to add an operation gesture, matching the extracted gesture characteristic information with predefined gesture characteristic information in a system; if the information is same, inputting the gesture again, and otherwise, adding the gesture characteristic information into the system; if selecting to delete the operation gesture, matching the extracted gesture characteristic information with predefined gesture characteristic information; and if the information is same, deleting the predefined gesture characteristic information in the system, and otherwise inputting the gesture again. The management method can cause the gesture operation of the touch screen to more conform to user use custom, shortens the respond time of gesture operation and improves accuracy. The invention also discloses a management system based on the touch screen operation gesture management method.

Description

A kind of touch screen operation gesture management system and method
Technical field
The present invention relates to touch screen technology, be meant a kind of management system and management method of operating gesture especially.
Background technology
In life, people usually make to use gesture and represent the intention that certain is specific.No matter in daily communication act, still in the man-machine interaction activity, gesture all has a very important role.The gesture operation technology is a kind of novel man-machine interaction mode, being different from traditional is the man-machine interaction mode at center with the machine, man-machine interaction is the interaction technique of multiple medium, various modes, it emphasizes customer-centric more, use meets the Computer Control Technology that nature exchanges custom, yet provides one from effective human-computer interaction interface for the user.
The gesture operation technology is as human-computer interaction technology, be mainly used in the embedded intelligence electronic product, for example PC, game machine, portable terminal, industrial control equipment etc., it mainly is to realize by software, its software both can be realized by operating system, can realize by application program again, or realize that by the bottom chip layer (chip must be programmable, its program code space needs enough big, generally is not less than 8Kbyte).
The initial research of gesture operation technology mainly concentrates on to be done a kind of special hardware and imports, data glove for example, gesture operation system based on data glove, require gesture person to wear special gloves, be to utilize data glove and Position Tracking to measure gesture at the track of spatial movement with time sequence information calculates and gesture identification, the advantage of this method is the discrimination height of system; Shortcoming is that the operator will wear complicated data glove and position tracker, brings very big inconvenience to the operator, and input equipment is relatively more expensive in addition, is difficult to promote.Developed gesture operation system afterwards again based on computer vision, promptly, utilize computer vision technique that the image of catching is analyzed again, extract the images of gestures feature based on catching images of gestures by one or more video camera, compare and analysis and judgement, thereby realize gesture operation.The advantage of this technology is to a kind of natural comfortable user of user interface, but because its data volume that need handle is very big, the time of gesture operation response can be very long, and certain hysteresis quality is arranged; Also very high to the hardware configuration requirement simultaneously, domestic consumer is difficult to accept.Need to prove, more than two kinds of gesture operation technology all be under the situation of no touch, to realize.
Also has a kind of gesture operation technology that touch-screen touches that just is based on, this technology is used simple, do not need loaded down with trivial details hardware device, only need a touch-screen as the man-machine interface interface, but also there is weak point in present this gesture operation technology, as gesture-type is that predefine is good, and different with use habit because each user's gesture motion has nothing in common with each other make the use initial stage of equipment need the exercise of user's long period to adapt to the use of gesture operation.
In addition, as Chinese patent application numbers 200910050645.5, a kind of method that can be defined gesture by the user has voluntarily been proposed in " identification and operation method of touch screen interface gestures ", and the defined gesture feature of user is stored in the gesture graphic data base, because the space of database is limited, therefore add gesture simply and will certainly cause the space of database to take, the words of adding gesture this moment again will cause loss of data or the damage in the database, cause system crash; Even the space of database is enough big, when the gesture data amount of adding is very big, the calculated amount that system is used for the gesture identification operation will increase greatly, thereby make that the response time of gesture operation is slack-off, also can increase simultaneously the redundant data of gesture, make gesture operation have very big interference, the accuracy meeting reduces greatly.
Based on above-mentioned analysis, the inventor studies improvement at the operating gesture management method that is used for touch-screen at present, and this case produces thus.
Summary of the invention
Fundamental purpose of the present invention is to provide a kind of touch screen operation gesture management system and method, and it can make the gesture operation of touch-screen meet user's custom, and shortens the response time of gesture operation, the accuracy that improves gesture operation.
In order to reach above-mentioned purpose, solution of the present invention is:
A kind of touch screen operation gesture management method, comprise and add operating gesture step and deletion action gesture step: (1) selects to add operating gesture step or deletion action gesture step; (2) user imports gesture by touch-screen; (3) obtain the gesture data of user by the touch-screen input; (4) extract gesture feature information; (5) be to add the operating gesture step if step (1) selects, then predefined gesture feature information in middle gesture feature information of extracting of step (2) and the system is mated, if the identical step (2) of then returning is re-entered gesture and is added, otherwise gesture feature information is added in the system; If what step (1) was selected is deletion action gesture step, then predefined gesture feature information in middle gesture feature information of extracting of step (4) and the system is mated, if predefined gesture feature information in the identical then deletion system, re-enter gesture and delete otherwise will return step (2).
The concrete steps of above-mentioned steps (3) are: judge that gesture information is that irregular motion track changes or clocklike motion track changes, (2) re-enter gesture if the former then returns step, if the latter then regards as gesture, enter step (2).
The concrete steps of above-mentioned steps (4) are: remove the noise information in the gesture data that obtains in the step (3), and filter out the information of some from the useful information that remains, form gesture feature information.
A kind of touch screen operation gesture management system comprises gesture judge module, gesture processing module, gesture feature extraction module, gesture identification module, gesture interpolation module, gesture removing module, system's gesture predefine module; Wherein, the gesture judge module is judged whether gesture of the action of user on touch-screen; When the gesture judge module is regarded as gesture, promptly the gesture information that obtains is passed to the gesture processing module and handle; The gesture processing module is carried out data processing to the gesture information that the gesture judge module obtains, and the gesture information after handling is passed to the gesture feature extraction module; The gesture feature extraction module extracts gesture feature information from the gesture information that the gesture processing module transmits, and sends into the gesture identification module; The gesture identification module also is connected with system gesture predefine module, the gesture feature information and the system's gesture predefine module that receive are carried out matching ratio, and send into the gesture that is attached thereto respectively and add module or gesture removing module, according to circumstances carry out gesture interpolation or gesture deletion.
After adopting such scheme, the present invention is except the gesture that can add user oneself at any time and like is in the system, also increased the function of gesture deletion, make things convenient for the user operating gesture in the system to be managed according to custom and actual demand, can increase essential operating gesture so on the one hand, the operating gesture mode of oneself being accustomed to is set, can also delete unwanted operating gesture in the system on the other hand, reduce the data volume of operating gesture in the system, match time when shortening gesture operation, improve the probability of gesture coupling, thereby improve the response time and the accuracy rate of touch-screen gesture operation.
Description of drawings
Fig. 1 is a process flow diagram of the present invention;
Fig. 2 is an integrated stand composition of the present invention.
Embodiment
Below with reference to drawings and the specific embodiments, the structure of the present invention and the course of work are elaborated.
At first see shown in Figure 2, the invention provides a kind of touch screen operation gesture management system, comprise gesture judge module 1, gesture processing module 2, gesture feature extraction module 3, gesture identification module 4, gesture interpolation module 5, gesture removing module 6 and system's gesture predefine module 7, respectively its annexation and function are introduced below.
Gesture judge module 1 is used to judge whether gesture of the action of user on touch-screen, specifically, gesture judge module 1 is to be whether the motion track of finger on touch-screen be regular by judgement, if finger discontinuous move or invalid gesture is then thought in the touching of other foreign matter on touch-screen, otherwise regard as gesture, and will send into gesture processing module 2 at the gesture data that touch-screen collects.
Gesture processing module 2 is used for the gesture data of touch-screen input is handled, and removes noise information wherein, sends into gesture feature extraction module 3 then.
Gesture feature extraction module 3 is used for extracting gesture feature information from the gesture data that carries out noise processed, promptly the data of extracting some from gesture data are as gesture feature information, and the gesture feature information of being extracted is sent to gesture identification module 4.
Gesture identification module 4 receives the gesture feature information from gesture feature extraction module 3, and predefined gesture feature information in this gesture feature information and the system's gesture predefine module 7 mated, export the result who matches to gesture and add module 5 or gesture removing module 6.
Gesture is added module 5 and is used for adding gesture to system's predefine gesture module 7, when in the user wants system, adding own required gesture, after the input of front gesture, gesture processing, gesture feature extraction, a series of processes of gesture identification, as gesture identification result when being identical, then think and had this gesture in the system, can not add again, need input gesture interpolation on touch-screen again; Otherwise can add the gesture of touch-screen input in system's gesture predefine module 7 to, transfer use for the user.
Gesture removing module 6 is used for carrying out the deletion to the gesture of system's gesture predefine module 7 storages, when the user oneself do not need in the system of deleting to want or during the gesture of uncomfortable operation, equally through after the input of front gesture, gesture processing, gesture feature extraction, a series of processes of gesture identification, when the gesture identification result can delete predefined gesture in the system when identical, otherwise think no gesture and touch-screen input gesture coupling in system's predefine, can't delete the predefined gesture of system, need on touch-screen, to import gesture again and mate deletion.
System's gesture predefine module 7 is used to deposit user's operating gesture, and operating gesture wherein has system to reserve in advance, has plenty of that user oneself adds as required, and the user also can delete own unwanted operating gesture at any time certainly.
Cooperate shown in Figure 1ly again, a kind of touch screen operation gesture management method that the present invention discloses comprises and adds operating gesture step and deletion action gesture step, is specially:
(1) enters touch screen operation gesture management system interface;
(2) select to enter interpolation operating gesture or deletion action gesture interface;
(3) user's gesture of desiring to manage by touch-screen input;
(4) obtain the gesture data of user by the touch-screen input; Specifically, the gesture information of collection touch judges that this gesture information is that irregular motion track changes or clocklike motion track changes, if the former repeating step (3) then if the latter then regards as gesture, enters step (5);
(5) extract gesture feature information; Specifically,, remove noise information wherein, and from the useful data that remains, filter out the data of some, form gesture feature information for the gesture data of the user who collects by the touch-screen input;
(6) if selection is to add the operating gesture interface in the step (2), then predefined gesture feature information in middle gesture feature information of extracting of step (5) and the system is mated, if the identical step (3) of then returning is re-entered gesture and is added, otherwise gesture feature information is added in the system; If what step (2) was selected is deletion action gesture interface, then predefined gesture feature information in middle gesture feature information of extracting of abovementioned steps (5) and the system is mated, should coupling gesture feature information if predefined in the identical then deletion system, re-enter gesture and delete otherwise will return step (3).
Need to prove, utilize disclosed touch screen operation gesture management system and method, when the touch-screen product when dispatching from the factory, can in system's gesture predefine module, store abundant operating gesture, different users can be according to the deletion of needs separately operating gesture wherein, so both can satisfy the operational requirements of different user, also guarantee the high efficiency work of entire product touch-screen.
Above embodiment only for explanation technological thought of the present invention, can not limit protection scope of the present invention with this, every technological thought that proposes according to the present invention, and any change of being done on the technical scheme basis all falls within the protection domain of the present invention.

Claims (4)

1. touch screen operation gesture management method is characterized in that comprising and adds operating gesture step and deletion action gesture step:
(1) selects to add operating gesture step or deletion action gesture step;
(2) user imports gesture by touch-screen;
(3) obtain the gesture data of user by the touch-screen input;
(4) extract gesture feature information;
(5) be to add the operating gesture step if step (1) selects, then predefined gesture feature information in middle gesture feature information of extracting of step (2) and the system is mated, if the identical step (2) of then returning is re-entered gesture and is added, otherwise gesture feature information is added in the system; If what step (1) was selected is deletion action gesture step, then predefined gesture feature information in middle gesture feature information of extracting of step (4) and the system is mated, if predefined gesture feature information in the identical then deletion system, re-enter gesture and delete otherwise will return step (2).
2. a kind of touch screen operation gesture management method as claimed in claim 1, it is characterized in that: the concrete steps of described step (3) are: judge that gesture information is that irregular motion track changes or clocklike motion track changes, (2) re-enter gesture if the former then returns step, if the latter then regards as gesture, enter step (2).
3. a kind of touch screen operation gesture management method as claimed in claim 1, it is characterized in that: the concrete steps of described step (4) are: remove the noise information in the gesture data that obtains in the step (3), and from the useful information that remains, filter out the information of some, form gesture feature information.
4. a touch screen operation gesture management system is characterized in that: comprise gesture judge module (1), gesture processing module (2), gesture feature extraction module (3), gesture identification module (4), gesture interpolation module (5), gesture removing module (6), system's gesture predefine module (7); Wherein, gesture judge module (1) is judged whether gesture of the action of user on touch-screen; When gesture judge module (1) when regarding as gesture, promptly the gesture information that obtains is passed to gesture processing module (2) and handle; Gesture processing module (2) is carried out data processing to the gesture information that gesture judge module (1) obtains, and the gesture information after handling is passed to gesture feature extraction module (3); Gesture feature extraction module (3) extracts gesture feature information from the gesture information that gesture processing module (2) transmits, and sends into gesture identification module (4); Gesture identification module (4) also is connected with system's gesture predefine module (7), the gesture feature information and the system's gesture predefine module (7) that receive are carried out matching ratio, and send into the gesture that is attached thereto respectively and add module (5) or gesture removing module (6), according to circumstances carry out gesture interpolation or gesture deletion.
CN2010102993701A 2010-09-27 2010-09-27 Touch screen operation gesture management system and method Pending CN101976143A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010102993701A CN101976143A (en) 2010-09-27 2010-09-27 Touch screen operation gesture management system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010102993701A CN101976143A (en) 2010-09-27 2010-09-27 Touch screen operation gesture management system and method

Publications (1)

Publication Number Publication Date
CN101976143A true CN101976143A (en) 2011-02-16

Family

ID=43576031

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010102993701A Pending CN101976143A (en) 2010-09-27 2010-09-27 Touch screen operation gesture management system and method

Country Status (1)

Country Link
CN (1) CN101976143A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102799353A (en) * 2012-06-18 2012-11-28 上海鼎为软件技术有限公司 Instruction action acknowledgement method, instruction device and electronic device
CN102841712A (en) * 2012-07-11 2012-12-26 广州市久邦数码科技有限公司 Method and system for identifying and editing gestures
CN102968270A (en) * 2012-11-01 2013-03-13 广东欧珀移动通信有限公司 Data deleting method and terminal equipment thereof
CN103024144A (en) * 2012-11-16 2013-04-03 深圳桑菲消费通信有限公司 Method and device for deleting files by mobile terminal
CN103324415A (en) * 2012-03-22 2013-09-25 百度在线网络技术(北京)有限公司 Mobile terminal and input switching method of mobile terminal
CN104270498A (en) * 2014-08-28 2015-01-07 小米科技有限责任公司 Method and device for inputting communication number into communication interface
CN105426108A (en) * 2015-11-30 2016-03-23 上海斐讯数据通信技术有限公司 Method and system for using customized gesture, and electronic equipment
CN105892917A (en) * 2016-03-30 2016-08-24 努比亚技术有限公司 Mobile terminal and method for processing user input information
CN106445945A (en) * 2015-08-06 2017-02-22 阿里巴巴集团控股有限公司 Search result processing method and apparatus
CN110850982A (en) * 2019-11-11 2020-02-28 南方科技大学 AR-based human-computer interaction learning method, system, device and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1263302A (en) * 2000-03-13 2000-08-16 中国科学院软件研究所 Pen and signal based manuscript editing technique
CN101546233A (en) * 2009-05-05 2009-09-30 上海华勤通讯技术有限公司 Identification and operation method of touch screen interface gestures
CN101763219A (en) * 2010-02-03 2010-06-30 北京优视动景网络科技有限公司 User interface method and device for operating web browser by using touch liquid crystal display (LCD)
CN101819505A (en) * 2010-04-26 2010-09-01 威盛电子股份有限公司 Electronic system with touch control screen and operation method thereof

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1263302A (en) * 2000-03-13 2000-08-16 中国科学院软件研究所 Pen and signal based manuscript editing technique
CN101546233A (en) * 2009-05-05 2009-09-30 上海华勤通讯技术有限公司 Identification and operation method of touch screen interface gestures
CN101763219A (en) * 2010-02-03 2010-06-30 北京优视动景网络科技有限公司 User interface method and device for operating web browser by using touch liquid crystal display (LCD)
CN101819505A (en) * 2010-04-26 2010-09-01 威盛电子股份有限公司 Electronic system with touch control screen and operation method thereof

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324415A (en) * 2012-03-22 2013-09-25 百度在线网络技术(北京)有限公司 Mobile terminal and input switching method of mobile terminal
CN103324415B (en) * 2012-03-22 2016-11-23 百度在线网络技术(北京)有限公司 input method switching method in mobile terminal and mobile terminal
CN102799353A (en) * 2012-06-18 2012-11-28 上海鼎为软件技术有限公司 Instruction action acknowledgement method, instruction device and electronic device
CN102841712B (en) * 2012-07-11 2015-11-25 广州市久邦数码科技有限公司 A kind of gesture identification and edit methods and system
CN102841712A (en) * 2012-07-11 2012-12-26 广州市久邦数码科技有限公司 Method and system for identifying and editing gestures
CN102968270A (en) * 2012-11-01 2013-03-13 广东欧珀移动通信有限公司 Data deleting method and terminal equipment thereof
CN103024144A (en) * 2012-11-16 2013-04-03 深圳桑菲消费通信有限公司 Method and device for deleting files by mobile terminal
CN104270498A (en) * 2014-08-28 2015-01-07 小米科技有限责任公司 Method and device for inputting communication number into communication interface
CN106445945A (en) * 2015-08-06 2017-02-22 阿里巴巴集团控股有限公司 Search result processing method and apparatus
CN105426108A (en) * 2015-11-30 2016-03-23 上海斐讯数据通信技术有限公司 Method and system for using customized gesture, and electronic equipment
CN105892917A (en) * 2016-03-30 2016-08-24 努比亚技术有限公司 Mobile terminal and method for processing user input information
CN110850982A (en) * 2019-11-11 2020-02-28 南方科技大学 AR-based human-computer interaction learning method, system, device and storage medium
CN110850982B (en) * 2019-11-11 2024-03-29 南方科技大学 AR-based man-machine interaction learning method, system, equipment and storage medium

Similar Documents

Publication Publication Date Title
CN101976143A (en) Touch screen operation gesture management system and method
CN105893827B (en) A kind of applicative notifications message inspection method and terminal
CN102402369B (en) Electronic equipment and its operation indicating mark moving method
CN105955587B (en) A kind of hiden application icon display method and device
CN109463001A (en) Activity and body-building update
CN103200327B (en) A kind of method that mouse function is realized on mobile phone
CN102117165A (en) Touch input processing method and mobile terminal
CN104881122A (en) Somatosensory interactive system activation method and somatosensory interactive method and system
CN102693075B (en) On-screen data management system and method
CN105867821A (en) Icon arranging method and device and terminal
CN107003907A (en) A kind of data processing method and data processing equipment
CN106598405A (en) Terminal device and method for dynamically adjusting control position by terminal device
CN104915004A (en) Somatosensory control screen rolling method, somatosensory interaction system and electronic equipment
CN103221968A (en) Information notification system, information notification method, information processing device and control method for same, and control program
CN106775367A (en) The operating method and device of terminal touch-control
CN106815509A (en) A kind of multimedia file guard method, device and electronic equipment
CN107798011A (en) A kind of searching method and device, a kind of device for being used to search for
CN111125523A (en) Searching method, searching device, terminal equipment and storage medium
CN110109609A (en) Display control apparatus and method and image display
CN104346073B (en) A kind of information processing method and electronic equipment
CN107870705A (en) A kind of change method and device of the picture mark position of application menu
CN105335216A (en) Communication terminal application management method and system
WO2016045500A1 (en) Method, apparatus and system for selecting target object in target library
CN108399042A (en) A kind of touch control identification method, device and system
CN107943359A (en) A kind of method, terminal and the computer-readable medium of the control of application program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20110216