CN103576900B - Seamless link method chosen by Writing-painting based on a multi-parameter information and menu - Google Patents

Seamless link method chosen by Writing-painting based on a multi-parameter information and menu Download PDF

Info

Publication number
CN103576900B
CN103576900B CN201310576560.7A CN201310576560A CN103576900B CN 103576900 B CN103576900 B CN 103576900B CN 201310576560 A CN201310576560 A CN 201310576560A CN 103576900 B CN103576900 B CN 103576900B
Authority
CN
China
Prior art keywords
pen
menu
user
writing
tab
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201310576560.7A
Other languages
Chinese (zh)
Other versions
CN103576900A (en
Inventor
辛义忠
马燕飞
李岩
袁伟强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenyang University of Technology
Original Assignee
Shenyang University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenyang University of Technology filed Critical Shenyang University of Technology
Priority to CN201310576560.7A priority Critical patent/CN103576900B/en
Publication of CN103576900A publication Critical patent/CN103576900A/en
Application granted granted Critical
Publication of CN103576900B publication Critical patent/CN103576900B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The present invention provides a kind of Writing-painting based on a multi-parameter information and menu to choose seamless link method, and this invention disclosure satisfy that user need not mobile nib and may be selected by the demand of function menu in toolbar when Free Writing is painted.The method is possible not only to realize choosing based on the menu that nib is motionless, and can solve the problem that the inferior position of giant-screen medium and long distance menu selection operation inconvenience.

Description

Seamless link method chosen by Writing-painting based on a multi-parameter information and menu
Technical field
The invention belongs to field of human-computer interaction, be specifically related to utilize the multi-parameter information of pen to control in nib current location A kind of method that menu is chosen, by Writing-painting pattern and menu control pattern seamless link in a kind of pen-based interaction interface Menu choosing method.
Background technology
Traditional pen type operation interface only relies upon movement locus (time series positional information x (t) of two dimension, the y of nib (t)) realize input.Therefore, when performing menu selection operation, if not having other aids, then user needs to stop The Writing-painting task carried out, then moves nib and goes to click on menu item to realize menu selection operation.Such as user is drawing During one width is drawn, the color of paintbrush, line weight can be changed frequently and choose different drawing instruments etc., thus leading Cause pen device to toggle between district and command area (menu chosen area) writing, easily cause limbs fatigue and time Between waste.
Additionally, in giant-screen operates, menu distance is remote, inconvenience manipulation, waste time and energy, and easily produce ambiguity, i.e. hold Caused motion track chosen by row menu can not be determined whether the part for Writing-painting by equipment.At present, there is people Study based on the motionless menu setecting mode of nib, as Toolglass (Bier, E.A., Stone, M.C., Pier, K., Buxton,W., Derose,T.D., Toolglass and magic lenses: The see-through Interface. In Proc. SIGGRAPH 1933,73-80.) and Tilt Menu (Tian, F., Xu, L., Wang, H., Zhang, X., Liu, Y., Setlur,V. and Dai, G. (2008). Tilt menu: using the 3D orientation information of pen devices to extend the selection Capability of pen-based user interfaces. Proc.CHI, 1371-1380.), but this menu sets Count alternative menu limited amount, be limited only to the several menu options commonly used, be not well positioned to meet the need of user Ask.
Summary of the invention
Goal of the invention: the present invention provides a kind of Writing-painting based on a multi-parameter information and menu to choose seamless link side Method, its objective is that the complex operation solving to utilize pen-based input equipment existing when carrying out menu selection operation under conventional situation is asked Topic.
Technical scheme: the present invention is achieved through the following technical solutions:
Seamless link method chosen by a kind of Writing-painting based on a multi-parameter information and menu, it is characterised in that: the party Specifically comprising the following steps that of method
(1) pressure utilizing internal system monitors the ginsengs such as the inclination angle of pen, the anglec of rotation and pressure in real time with angular transducer Number information, user in handwriting pad Free Writing drawing time, if a certain menu item need to be selected, then in nib current location penholder Tilt to become the state within 30 ° with operation planar, will be in the range of the inclination angle of pen be placed in 0 °~30 °, the pattern that can trigger turns Change operation, pen is converted to menu by input pattern and chooses command mode;
(2), after patten transformation command triggers, signal processing is utilized to select according in current Writing-painting interface with control module 30 °~150 ° of available tilt angles scopes are carried out decile by the number of item card, and the tilt angle ranges after decile are processed, and make Obtain different tilt angle ranges and be mapped to different tab;User needs penholder to browse to carry out target, when target is selected When item card is highlighted, tab is confirmed by user by increasing pen point pressure;
(3), after step (2) confirms, signal processing and control module is utilized to monitor the current rotary angle information of pen and incite somebody to action The quantity of 0 °~360 ° available rotation angle foundation one-level submenu carries out decile, and is sequentially mapped to different angles scope institute Corresponding submenu.If the one-level submenu that user's tab to be selected is comprised, then by pen clockwise or counterclockwise around an axle Rotate;After user is according to highlighted prompting locator menu, increases pen pressure and option is confirmed.
When user selects secondary sub-menu on the basis of " (3) " step, choose the operation of mode and one-level submenu Mode is identical.
Utilize signal processing and control module every 20ms gather the current inclination angle of primary electron writing pencil, the anglec of rotation and Pressure and other parameters information also provides signal processing results: as an inclination angle < 30 °, triggers pattern conversion command, when 30 °≤ During inclination angle≤150 °, carry out the selection operation of tab;After using pen pressure to confirm tab, if Submenu Items need to be selected, Then signal processing can carry out Submenu Items according to a currently monitored rotary angle information with control module and browses;When confirming target dish After single choice takes, pen will be converted back input pattern by command mode, and user can proceed with Writing-painting operation.
The mode of the inclination angle selection tab using pen described by step (2) is: utilizes signal processing and controls mould The available tilt angles scope 30 °~150 ° of pen is split by block according to the number of tab in current Writing-painting interface, and Different intervals, inclination angle is corresponding in turn in different tab;The tilt values that monitoring pen is current the most in real time, and judge The inclination angle at the tilt values place going out current pen is interval;Finally tab corresponding for this interval, inclination angle is highlighted, for User provides visual feedback to confirm to select for user.
The mode of the anglec of rotation selection sub-menu option utilizing pen described by step (3) is: signal processing and control mould The available anglec of rotation 0 °~360 ° of pen is split by block according to the number of submenu under current tab, each after segmentation Anglec of rotation interval is corresponding in turn to each Submenu Items comprised in tab;The rotation angle values that monitoring pen is current the most in real time, And judge that the anglec of rotation at the rotation angle values place of current pen is interval;Finally by highlighted for Submenu Items corresponding for this anglec of rotation interval Display, provides the user visual feedback and confirms to select for user.Body rotates to turn clockwise and also can rotate counterclockwise, can Realize being highlighted successively of menu item on two rightabouts respectively.
Confirm that the pen point pressure used during menu item is greater than pressure present during user's normal Free Writing drawing Scope, i.e. uses the power much larger than 4N to confirm selected menu.
The mode of a judgement body direction of rotation is: utilize information processing and control module to gather once the rotation of pen every 20ms Corner information also carries out sample record, is contrasted by the angular dimension of adjacent twice record, if the latter is more than the former, it is judged that Currently turn clockwise to pen operation for user, in like manner, if the former is more than the latter, it is judged that currently carry out pen for user Rotation process counterclockwise.
Advantage and effect: the present invention provides a kind of Writing-painting based on a multi-parameter information and menu to choose seamless link Method, this invention disclosure satisfy that user need not mobile nib and may be selected by function dish in toolbar when Free Writing is painted Single demand.The method is possible not only to realize choosing based on the menu that nib is motionless, and can solve the problem that giant-screen medium and long distance The inferior position of menu selection operation inconvenience.
The present invention sufficiently and reasonably make use of multi-parameter information based on pen in pen-based interaction equipment to carry out control command menu Selection operation, save user and the most repeatedly select the time spent by menu item and distance, improve efficiency.The present invention exists The more aobvious advantage of remote menu is selected under giant-screen operating environment.
Accompanying drawing illustrates:
4 parameter informations (respectively pressure, inclination angle, azimuth, rotation of the pen that Fig. 1 is used by the inventive method Angle) schematic diagram.
Fig. 2 is that the present invention utilizes the inclination angle (azimuth can be arbitrarily) of 0 °~30 ° scope to trigger showing of mode change operation It is intended to.
Fig. 3 is that the present invention utilizes the inclination angle of pen to carry out the schematic diagram of tab selection operation, utilizes pen point pressure to choosing Select item to confirm.
Fig. 4 is that the present invention utilizes the anglec of rotation of pen to perform the selection schematic diagram of further menu, and uses pen pressure to confirm.
Fig. 5 be the present invention turn clockwise perform second-level menu selection schematic diagram, and use pen pressure confirm.
Fig. 6 is that the present invention rotates execution second-level menu selection schematic diagram counterclockwise, and uses pen pressure to confirm.
Detailed description of the invention:
For the ease of being better understood from, below in conjunction with the accompanying drawings the using method of the present invention is described below in detail:
The present invention provides a kind of Writing-painting based on a multi-parameter information and menu to choose seamless link method, its feature It is: the multi-parameter information used is inclination angle as shown in Figure 1, the anglec of rotation, azimuth information.Wherein, an inclination angle Refer to the angle α between pen-based input equipment plane and a body as shown in Figure 1, can be by equipment identification by azimuth auxiliary Tilt angle ranges is expanded to 30 °~150 ° by 30 °~90 °.Azimuth refers to that pen is in pen-based input equipment as shown in Figure 1 The angle β between projection and the north of pen-based input equipment in plane, using interval is 0 °~360 °, and this angular interval is same Time be applicable to left and right strong hand user.The anglec of rotation refers to the angle rotated along shaft of a writing brush radial axle, use interval be 0 °~ 360 °, the f in Fig. 1 is the mark of the signal anglec of rotation.
The specifically used step of the present invention is as follows:
According to research (Xin, Y., Bi, X., Ren, X., the Natural Use Profiles for that we are previous Pen:An Empirical Exploration of Pressure, Tilt, and Azimuth.CHI2012,ACM Press (2012), 801-804.), drawn user pressure, inclination angle, azimuth and rotation when using pen to carry out nature Writing-painting The usual range at angle, therefore, chooses loaded down with trivial details problem based on the current set of menu, the multi-parameter information of our abundant Appropriate application pen, if Count following Writing-painting and menu and choose seamless link method:
(1) user uses pen to carry out Free Writing drawing or during free operant in pen-based interaction interface, if needing to select A certain menu item, then user is without lifting and moving nib, and the multi-parameter information that just can utilize pen in nib current location is real Existing menu selection operation.As in figure 2 it is shown, user carries out menu item selection operation wanting in writing, then work as proparea at nib Pen is tilted to 0 °~30 ° of scopes by territory, after signal processing analyzes and processes, trigger mode change operation with control module, by pen It is transformed into menu by input pattern and chooses command mode.
(2) with reference to Fig. 3, have five tab, after user triggers patten transformation, utilize signal processing and control mould The interval, inclination angle of 30 °~150 ° is divided into interval, five parts of inclinations angle according to the quantity of current tab by tuber, and is corresponding in turn to In five tab;Then is sampled in inclination angle in real time with the frequency of 20ms, it is judged which choosing the current tilt values of pen belongs to Inclination angle corresponding to item card is interval;When pen is tilted in the range of 78 °~102 ° by user, now corresponding to the 3rd option Card is highlighted, and user increases pen point pressure according to visual feedback and i.e. can confirm that the 3rd tab of selection.
(3) after confirming that tab selects, if need to continue to select second submenu of subordinate, the most as shown in Figure 4, user Turn clockwise pen, and rotates an anglec of rotation to the angular interval corresponding to second submenu.Signal processing and control mould The same step of the processing mode (2) of block, increases pen point pressure after target menu is highlighted and confirms to select.
(4) if user's selection is certain menu item in secondary sub-menu, then as it is shown in figure 5, user need to be again by pen Body rotates along shaft of a writing brush radial axle.The corresponding different submenu in different anglec of rotation intervals is highlighted.When target submenu When being highlighted, increase pen point pressure and confirm to select.In like manner, three grades of submenus select the selection mode one with secondary sub-menu Sample.
Use an anglec of rotation to carry out menu when choosing, manipulate for convenience, turn clockwise and rotate counterclockwise the most right Answer being highlighted successively of menu item in two opposite direction.During as it is shown in figure 5, turn clockwise, menu is the most successively It is highlighted;As shown in Figure 6, during rotary pen counterclockwise, menu is highlighted the most successively.
Proposed by the invention method Writing-painting and menu being chosen seamless link based on a multi-parameter information, it is possible to Make user remove to choose target menu item without moving repeatedly nib in Free Writing painting process, especially solve giant-screen behaviour Make the problem that remote menu under environment is difficult to manipulation.The method is the most time-consuming, user-friendly, and does not easily causes Limbs are tired.

Claims (5)

1. a Writing-painting based on a multi-parameter information chooses seamless link method with menu, it is characterised in that: the method Step as follows:
(1) pressure utilizing internal system monitors the inclination angle of pen, the anglec of rotation and pressure parameter letter in real time with angular transducer Breath, when user's Free Writing drawing in handwriting pad, if a certain menu item need to be selected, then inclines penholder in nib current location Tiltedly to becoming the state within 30 ° with operation planar, patten transformation behaviour will be triggered in the range of the inclination angle of pen is placed in 0 °~30 ° Make, pen is converted to menu by input pattern and chooses command mode;
(2), after patten transformation command triggers, utilize signal processing and control module according to tab in current Writing-painting interface Number 30 °~150 ° of available tilt angles scopes are carried out decile, and the tilt angle ranges after decile is processed so that no Same tilt angle ranges is mapped to different tab;User needs penholder to browse to carry out target, when targets option card When being highlighted, tab is confirmed by user by increasing pen point pressure;
(3) after step (2) confirms, utilize signal processing and control module to monitor the current rotary angle information of pen and by 0 °~ 360 ° of available rotation angle carry out decile according to the quantity of one-level submenu, and are sequentially mapped to corresponding to different angles scope Submenu;If the one-level submenu that user's tab to be selected is comprised, then pen is rotated around an axle clockwise or counterclockwise; After user is according to highlighted prompting locator menu, increases pen pressure and option is confirmed;
When user selects secondary sub-menu on the basis of " (3) " step, choose the mode of operation of mode and one-level submenu Identical;
Signal processing is utilized to gather, every 20ms, inclination angle, the anglec of rotation and the pressure that primary electron writing pencil is current with control module Parameter information also provides signal processing results: as an inclination angle < 30 °, triggers pattern conversion command, when 30 °≤inclinations angle When≤150 °, carry out the selection operation of tab;After using pen pressure to confirm tab, if Submenu Items, then signal need to be selected Process can carry out Submenu Items according to a currently monitored rotary angle information with control module and browse;When confirming that target menu is chosen Afterwards, pen will be converted back input pattern by command mode, and user can proceed with Writing-painting operation.
Seamless link method chosen by Writing-painting based on a multi-parameter information the most according to claim 1 and menu, its It is characterised by: the mode of the inclination angle selection tab using pen described by step (2) is: utilizes signal processing and controls mould The available tilt angles scope 30 °~150 ° of pen is split by block according to the number of tab in current Writing-painting interface, and Different intervals, inclination angle is corresponding in turn in different tab;The tilt values that monitoring pen is current the most in real time, and judge The inclination angle at the tilt values place going out current pen is interval;Finally tab corresponding for this interval, inclination angle is highlighted, for User provides visual feedback to confirm to select for user.
Seamless link method chosen by Writing-painting based on a multi-parameter information the most according to claim 1 and menu, its It is characterised by: the mode of the anglec of rotation selection sub-menu option utilizing pen described by step (3) is: signal processing and control mould The available anglec of rotation 0 °~360 ° of pen is split by block according to the number of submenu under current tab, each after segmentation Anglec of rotation interval is corresponding in turn to each Submenu Items comprised in tab;The rotation angle values that monitoring pen is current the most in real time, And judge that the anglec of rotation at the rotation angle values place of current pen is interval;Finally by highlighted for Submenu Items corresponding for this anglec of rotation interval Display, provides the user visual feedback and confirms to select for user;Body rotates to turn clockwise and also can rotate counterclockwise, can Realize being highlighted successively of menu item on two rightabouts respectively.
Seamless link method chosen by Writing-painting based on a multi-parameter information the most according to claim 1 and menu, its It is characterised by: confirm that the pen point pressure used during menu item is greater than pressure present during user's normal Free Writing drawing Scope.
Seamless link method chosen by Writing-painting based on a multi-parameter information the most according to claim 3 and menu, its It is characterised by: the mode of a judgement body direction of rotation is: utilize information processing and control module to gather once pen every 20ms Rotary angle information also carries out sample record, is contrasted by the angular dimension of adjacent twice record, if the latter is more than the former, sentences Break the operation that currently pen turned clockwise for user, in like manner, if the former is more than the latter, it is judged that currently pen is entered for user Row rotation process counterclockwise.
CN201310576560.7A 2013-11-14 2013-11-14 Seamless link method chosen by Writing-painting based on a multi-parameter information and menu Expired - Fee Related CN103576900B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310576560.7A CN103576900B (en) 2013-11-14 2013-11-14 Seamless link method chosen by Writing-painting based on a multi-parameter information and menu

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310576560.7A CN103576900B (en) 2013-11-14 2013-11-14 Seamless link method chosen by Writing-painting based on a multi-parameter information and menu

Publications (2)

Publication Number Publication Date
CN103576900A CN103576900A (en) 2014-02-12
CN103576900B true CN103576900B (en) 2016-09-14

Family

ID=50048848

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310576560.7A Expired - Fee Related CN103576900B (en) 2013-11-14 2013-11-14 Seamless link method chosen by Writing-painting based on a multi-parameter information and menu

Country Status (1)

Country Link
CN (1) CN103576900B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104156143A (en) * 2014-07-31 2014-11-19 天津三星通信技术研究有限公司 Mobile terminal, device and method for quickly calling function menu of handwriting pen
JP6543960B2 (en) * 2015-02-27 2019-07-17 セイコーエプソン株式会社 Display device, display control method and program
CN108334247B (en) * 2018-01-29 2021-11-19 宁波视睿迪光电有限公司 Signal collector applied to display device and working method
CN108446036B (en) 2018-03-27 2021-10-01 京东方科技集团股份有限公司 Intelligent writing equipment and intelligent writing system
CN109240526B (en) * 2018-07-26 2021-08-20 苏州佳世达电通有限公司 Same-screen display system and measurement and control method thereof

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101504586A (en) * 2009-03-25 2009-08-12 中国科学院软件研究所 Instruction method based on stroke tail gesture
CN102135823A (en) * 2011-04-28 2011-07-27 华南理工大学 Intelligent electronic handwriting pen
CN102609116A (en) * 2011-02-11 2012-07-25 微软公司 Multi-touch input device with orientation sensing

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8253686B2 (en) * 2007-11-26 2012-08-28 Electronics And Telecommunications Research Institute Pointing apparatus capable of providing haptic feedback, and haptic interaction system and method using the same

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101504586A (en) * 2009-03-25 2009-08-12 中国科学院软件研究所 Instruction method based on stroke tail gesture
CN102609116A (en) * 2011-02-11 2012-07-25 微软公司 Multi-touch input device with orientation sensing
CN102135823A (en) * 2011-04-28 2011-07-27 华南理工大学 Intelligent electronic handwriting pen

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Stylus Enhancement to Enrich Interaction with Computers;Yu Suzuki等;《Human-Computer Interaction.Interaction Platforms and Techniques》;20070727;第4551卷;第133-142页 *

Also Published As

Publication number Publication date
CN103576900A (en) 2014-02-12

Similar Documents

Publication Publication Date Title
CN103576900B (en) Seamless link method chosen by Writing-painting based on a multi-parameter information and menu
CN104246672B (en) Multi-point touch screen device
US9201520B2 (en) Motion and context sharing for pen-based computing inputs
CN104679246A (en) Wearable type equipment based on interactive interface human hand roaming control and interactive interface human hand roaming control method
Song et al. GaFinC: Gaze and Finger Control interface for 3D model manipulation in CAD application
CN103105945A (en) Man-machine interaction ring supporting multi-point touch gestures
CN107756398A (en) Robot vision bootstrap technique, device and equipment
CN106774872A (en) Virtual reality system, virtual reality exchange method and device
WO2010110573A3 (en) Multi-telepointer, virtual object display device, and virtual object control method
US10281996B2 (en) Touch sensitive system and stylus for commanding by maneuvering and method thereof
CN107870723A (en) A kind of suspension button display methods and terminal device
CN103793683A (en) gesture recognition method and electronic device
CN104331154A (en) Man-machine interaction method and system for realizing non-contact mouse control
CN102799273B (en) Interaction control system and method
CN103440033A (en) Method and device for achieving man-machine interaction based on bare hand and monocular camera
CN106648152B (en) It is a kind of to be based on rotation angle and the three-dimensional pen-based interaction interface Zoom method of distance
CN104462691A (en) Method and device for implementation of intelligent drawing with mouse in dynamic geometric software
CN205050078U (en) A wearable apparatus
CN103455262A (en) Pen-based interaction method and system based on mobile computing platform
CN103927024B (en) A kind of command sets extension method based on nib Yu a body track in pen based user interface
CN105404384A (en) Gesture operation method, method for positioning screen cursor by gesture, and gesture system
Wang et al. Wheeled robot control based on gesture recognition using the Kinect sensor
CN103197761B (en) Gesture identification method and device
CN103019417A (en) Electronic handwriting pen for identifying finger pen scratching and knocking actions and input method thereof
CN201522696U (en) Touch control device based on optical sensing

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160914

Termination date: 20181114

CF01 Termination of patent right due to non-payment of annual fee