WO2016112813A1 - 一种实现多个位置动态被动确定按键之方法 - Google Patents

一种实现多个位置动态被动确定按键之方法 Download PDF

Info

Publication number
WO2016112813A1
WO2016112813A1 PCT/CN2016/070222 CN2016070222W WO2016112813A1 WO 2016112813 A1 WO2016112813 A1 WO 2016112813A1 CN 2016070222 W CN2016070222 W CN 2016070222W WO 2016112813 A1 WO2016112813 A1 WO 2016112813A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
finger
button
pressed
mobile phone
Prior art date
Application number
PCT/CN2016/070222
Other languages
English (en)
French (fr)
Inventor
李永贵
Original Assignee
李永贵
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201510014843.1A external-priority patent/CN104571571A/zh
Priority claimed from CN201510861828.0A external-priority patent/CN105335008A/zh
Application filed by 李永贵 filed Critical 李永贵
Priority to US15/149,074 priority Critical patent/US20160274790A1/en
Priority to CN201680032702.5A priority patent/CN107735753A/zh
Publication of WO2016112813A1 publication Critical patent/WO2016112813A1/zh
Priority to US15/356,639 priority patent/US20170083109A1/en
Priority to CN201611051849.7A priority patent/CN107046591A/zh
Priority to US15/817,301 priority patent/US20180074699A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/169Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/169Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes
    • G06F1/1692Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547Touch pads, in which fingers can move on a surface
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04104Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger

Definitions

  • the invention relates to a method for realizing a plurality of position dynamic passive determination keys on a multi-touch panel/touch screen.
  • touch points are generated when a finger of one or both of the user's fingers is held or touched onto the multi-touch pad/touch screen.
  • the touch point as a button and connecting the finger one by one through the touch point and the button, the touch point and its coordinates are recovered due to the operation of the corresponding finger or the coordinates of the touch point are represented.
  • the value of the coordinate of the finger pressure value is changed by the operation of the corresponding finger as the operation of the corresponding button, and a plurality of positions dynamically passively determined on the multi-touch panel/touch screen can be realized.
  • the button operation is finished, the above finger is still held or touched on the touchpad/touch screen.
  • buttons it is not necessary to align the fingers with each button before the operation, such as a button with a fixed position, and there is no need to worry about pressing the wrong button during operation because one finger
  • the button will always be pressed to the correct button, because the position of a button is determined after the corresponding finger is pressed.
  • the side keys provided on the multi-touch pad/touch screen are the above-mentioned buttons.
  • Figure 1 is a right front view of a mobile phone
  • Figure 2 is a left side view of the mobile phone
  • Figure 3 is a right side view of the mobile phone
  • Figure 4 is a front view of the mobile phone
  • Figure 5 and Figure 6 are the mobile phone Another type of side key layout
  • FIG. 7 to FIG. 14 are keyboard layouts corresponding to the combination of the side key and the side key of the mobile phone.
  • Figure 15 is a front view of another mobile phone;
  • Figure 16 is a left side view of the mobile phone;
  • Figure 17 is a right side view of the mobile phone;
  • Figure 18 is a rear view of the mobile phone.
  • FIG. 19 is a right front view of a curved screen mobile phone;
  • FIG. 20 is a left front view of the mobile phone; and
  • FIG. 21 to FIG. 30 are keyboard layouts corresponding to the mobile phone side key and the side key combination.
  • Figure 31 is a right front view of a slider phone.
  • FIGS. 33 to 38 are keyboard layouts corresponding to a side key and a side key combination of the mobile phone.
  • FIG. 40 is a left front view of the flat plate
  • FIG. 41 is a rear view of the flat plate
  • FIGS. 43 to 48 are keyboard layouts corresponding to a partial side key and a side key combination of the flat plate.
  • Figure 42 is a left front view of another type of tablet;
  • Figures 49 to 52 are keyboard layouts corresponding to a combination of partial side keys and side keys of the tablet.
  • Figure 53 is a front view of a plate
  • Figure 54 is a left front view of the plate
  • Figure 55 is a back view of the plate.
  • Figure 56 is a left front view of another type of plate.
  • 57 to 64 are front views of a touch panel mouse.
  • 65 to 68 are front views of a large-sized touch display device.
  • Figure 1 is a mobile phone 1, 2 * 4 array of physical keyboard 2 is set in the lower part, side keys Shift and 2Hands are set on the left side, side keys En1, En2, Num and Punc are set on the right side Multi-touch panel 4 on.
  • a keyboard dynamic mapping area 10 is provided on the touch display screen of the mobile phone 1. Based on the currently operated side and side key combinations, the mapping area 10 dynamically displays the keyboard layout of Figures 7 through 14 to prompt the user to operate on the keyboard 2.
  • the mapping area 10 itself can also be a touch keyboard.
  • the side key indicator 6 is used to indicate the side key or side key combination of the current operation.
  • the button 7 is used to close or open the mapping area 10. 5 is the case when the mapping area 10 is closed.
  • the thumb of the left hand is held on the Shift key
  • the index finger, the middle finger, the ring finger and the little finger of the left hand are held on the touchpad.
  • the touch point of the finger on the touchpad 4 is the side key, and the 2Hands is naturally pressed by the protrusion of the root of the left thumb.
  • the index finger of the left hand corresponds to En1, and so on.
  • En1 and En2 are used to input 26 English letters
  • Num is mainly used to input numbers
  • Punc is mainly used to input punctuation
  • Shift is the same as Shift on PC keyboard.
  • the side button is released by first releasing the finger corresponding to the side button, and then pressing back again. When the finger is pressed back, the corresponding side button is pressed. After a side button is pressed, the keyboard firmware determines whether it is "released” based on the operation of the other side buttons. For example, if En1 and Shift are marked as pressed by the keyboard firmware (in this case, En1, Shift and other side keys are pressed), then if En2 is operated, the keyboard firmware will be pressed at the mark En2. At the same time, the markers En1 and Shift are released (although the fingers of En1 and Shift are not released). For another example, if only En1 is marked as pressed, if Shift is operated next, the keyboard firmware only marks Shift, so that the side key combination En1+Shift can be implemented. Other analogies.
  • the 2Hands key is touched to trigger the keyboard firmware to detect if the Shift key is touched and whether four touch points are formed on the touchpad 4. If it is, it indicates that the mobile phone 1, Shift and the touchpad 4 are correctly held, and the keyboard firmware refers to the coordinate system 8 to sort the four touch points by the x value from large to small (ie, from top to bottom), and sorts them.
  • the subsequent touch points are saved as pIndex, pMiddle, pRing and pLittle, and then the average avg of the distance between the adjacent two points in the sorted touch points along the x-axis is calculated and saved, and then pIndex, pMiddle, pRing and pLittle are respectively associated with the index finger, the middle finger, the ring finger and the little finger of the left hand and the side keys En1, En2, Num and Punc on the touchpad 4, and the index finger, the middle finger, the ring finger and the little finger of the left hand are pressed.
  • the keyboard firmware then activates the side button, and the default side button currently pressed is En1, that is, the keyboard firmware mark En1 is pressed, and the other side keys are marked for release, even though all the side keys are touched by the five fingers of the left hand at this time. .
  • the keyboard firmware deactivates the side key, and waits for the appearance of the side key activation condition again.
  • the touch point is equal to 3, indicating that only one finger on the touchpad 4 is released, and a side key is operated.
  • the keyboard firmware sorts the detected three touch points from the largest to the smallest, resulting in three points p31, p32, p33.
  • avg can also be replaced by 20mm, in order to overcome the user's finger holding gesture on the touchpad 4 is too random, avg is not allowed. 20mm is the average value of the adult finger width of various races, which is an empirical value. The avg can also be verified by the user when using the mobile phone for the first time), indicating that the index finger of the left hand is released, and the index finger is touched on the touchpad 4. The point and its coordinates are lost, and the keyboard marks the left index finger release. If no, continue with step (2).
  • step (3) If p33.x>pRing.x-avg*50%, it means that the little finger of the left hand is released, the touch point of the little finger on the touchpad 4 and its coordinates are lost, and the keyboard marks the release of the left hand little finger. If no, continue with step (3).
  • the keyboard firmware detects that four touch points have been regenerated on the touchpad 4, it means that the finger that was just released is pressed back again, and the touch point of the finger and its coordinates are recovered, and the keyboard firmware is re-marked.
  • the finger is pressed while the side key corresponding to the finger is pressed, and at the same time it is determined whether the side key previously marked as pressed is re-marked as released.
  • the keyboard firmware sorts the re-detected four touch points from the largest to the smallest, and obtains p41, p42, p43, and p44, and uses them to update pIndex, pMiddle, pRing, and pLittle, respectively. After that, the keyboard firmware is continuously looped and processed as described above.
  • the initial positions of the respective side keys on the touch panel 4 are determined by the initial positions of the touch points of the respective fingers of the user on the touch panel 4, they are not determined in advance, and the positions of the side keys are also in operation. It will change as the position of these touch points changes. Therefore, the multi-touch panel is used to make a plurality of side keys, so that it is not necessary to align the respective fingers to the respective side keys before the operation, such as the side keys with fixed operation positions, and it is not necessary to accidentally press the wrong side keys during operation. Because these fingers will always press the correct side button, the reason is that the position of a side button is determined after the corresponding finger is pressed.
  • FIGS. 5 and 6 When the fingers of the left hand double click, the side key layout is as shown in FIGS. 5 and 6. Among them, Home is used as the home button; Recent is used to display the recently opened application; Back, Forward is used for navigation; cMenu is the abbreviation of context menu, used to open and close the current application menu (toolbar).
  • the middle two rows of keys 11 correspond to two rows of keys of the keyboard 2, and the mark 212 indicates that each key of the row is pressed and released by the corresponding two keys on the keyboard 2 at the same time.
  • the i key is implemented by pressing and releasing the corresponding a and b keys simultaneously.
  • the flag 413 indicates that each key of the row in which it is located is simultaneously pressed and released by the corresponding four keys on the keyboard 2.
  • the BS key is implemented by simultaneously pressing and releasing the four keys a, b, c, and d.
  • the rest of the keys and the rest of the keyboard layout are analogous.
  • the side key or side key combination corresponding to the keyboard layout of Figures 7 to 14 is indicated in the upper left corner of each layout.
  • Figure 15 is also a mobile phone 14 having side keys cMenu and 2Hands as shown on the left side of Figure 16, and a side key Back, Forward on the right side of Figure 17 and the middle of the back as shown in Figure 18 on the multi-touch panel. , Recent and Home.
  • a touchpad is provided on the back of the mobile phone 14 to facilitate the user to hold and operate the mobile phone with one hand (left or right hand).
  • the missing cMenu button can be double-clicked on the back touchpad by the index finger.
  • the thumb of the hand will touch the touch display on the front side, and the touch action occurring at the same time as the operation on the back touchpad should be ignored.
  • the keyboard firmware activates the side buttons on the touchpad when it detects that four touch points are generated on the back touchpad.
  • FIG. 19 and FIG. 20 are a curved screen mobile phone 16, and the curved screen is a multi-touch screen.
  • On the left side of the curved screen are side keys Shift and 2Hands, and on the right side of the curved screen are side keys Rmt, Ctrl, En1, En2, Num, Punc and Alt.
  • the mobile phone 16 and the side keys are held and operated by the left hand, the Ctrl and Rmt are shifted by the left hand food, and the Alt is operated by the left hand with a small pointing downward (if the left hand uses the mobile phone 16, the side keys of the left and right sides of the curved screen are swapped. You can).
  • the keyboard 17 is a 4*4 matrix touch keyboard provided on the curved screen, and its layout is dynamically changed according to the currently operated side key or side key combination.
  • 21 to 30 show the keyboard layout corresponding to the side key or side key combination of the mobile phone 16.
  • the mobile phone 16 When the mobile phone 16 is held by the left hand, the left thumb is held on the left side of the curved screen, and the remaining four fingers of the left hand are evenly held on the right side of the curved screen.
  • the mobile phone 16 detects that six touch points are generated on both sides of the curved screen, the four touch points on the right side are sorted by reference to the coordinate system 20 from the largest to the smallest, and the sorted touch points are calculated. The spacing dist along the x-axis between adjacent two points and the average avg and sum ttl of these spacings are saved and saved.
  • wdth represents the average width of the user's finger, predetermined to be 20mm
  • the phone 16 detects whether the vertical distance from the first touch point to the top edge of the curved screen is greater than 2.5*avg, and the fourth touch point to the bottom of the curved screen. Whether the vertical distance of the edge is greater than 1.5*avg. If so, the handset 16 activates the side button.
  • the mobile phone 16 saves the above four tap points as pIndex, pMiddle, pRing and pLittle, and respectively pairs them with the index finger, the middle finger, the ring finger and the little finger of the left hand and the En1, En2, Num and the right side of the curved screen. Punc is matched one by one, and the index finger, middle finger, ring finger and little finger of the left hand are marked as pressed.
  • the mobile phone 16 associates the upper touch point with the left thumb and Shift, and the lower touch point corresponds to 2Hands.
  • the mobile phone 16 defaults to the En1 press, marking the other side key release (except 2Hands).
  • the mobile phone 16 marks the left index finger release. If, after that, the mobile phone 16 detects that 4 touch points are regenerated on the right side of the curved screen, it means that the index finger of the left hand is pressed back again, and the touch point of the left index finger on the right side of the curved screen and its coordinates are recovered, and the mobile phone 16 is recovered. Relabel the left index finger to press. At the same time, the mobile phone 16 sorts the four touch points regenerated on the right side of the curved screen from the largest to the smallest, and obtains p41, p42, p43 and p44.
  • the handset 16 updates pIndex, pMiddle, pRing and pLittle with p41, p42, p43 and p44.
  • the handset 16 updates pIndex, pMiddle, pRing and pLittle with p41, p42, p43 and p44.
  • the handset 16 marks the En2 as pressed while the left left hand is marked, and marks the other side keys to be released in addition to Ctrl and Alt. That is, after En2 is pressed, the corresponding side key and side key combination may be: En2, Ctrl+En2, Alt+En2 or Ctrl+Alt+En2 (if Ctrl and/or Alt have been marked as pressed before).
  • the handset 16 marks the Num press while the left-hand ring finger is pressed, and marks the other side keys to be released in addition to Ctrl and Alt. That is, after the Num is pressed, the corresponding side key and side key combination may be: Num, Ctrl+Num, Alt+Num or Ctrl+Alt+Num (if Ctrl and/or Alt have been marked as pressed before).
  • the handset 16 updates pIndex, pMiddle, pRing and pLittle with p41, p42, p43 and p44.
  • the operation "Shift, En1, En2 can be operated by first pressing the finger corresponding to the side button to press the button and immediately relax to the natural grip state". Num and Punc. At this time, the touch point of the finger on the curved screen is represented by (x, y, p), and p represents the pressure value applied by the finger at the touch point. After the finger is pressed and relaxed, the corresponding side button is marked as pressed, and when the side button is "released", the side button according to the subsequent operation is determined by the mobile phone 16. For details, refer to the description of the first part and the second part. . The steps of the handset 16 prior to activating the side button are described with reference to the second portion above.
  • the phone 16 After the side key is activated, if none of the Rmt, Ctrl, and Alt is marked as pressed, if the phone 16 detects that the touch point on the right side of the curved screen is four and the p value of the touched point has changed After being pressed hard, the four touch points are sorted by the x value from large to small, and p41, p42, p43 and p44 are obtained.
  • Capital P is a predefined value that correctly distinguishes the finger's misoperation and correct operation, it can also be verified by the user when the user first uses the phone.
  • the new value or p41.p>P1*fct, indicates that the left hand index finger is forced to press the position of En1, and the mark En1 is pressed hard;
  • the mobile phone 16 After that, if the mobile phone 16 detects that the p value of the touch point on the right side of the curved screen has changed, and the four fingers are restored to the natural holding state, the side is cancelled. The force of the key presses the mark and marks the side key as pressed, and at the same time determines whether the other side keys marked as pressed are marked as released. Next, the mobile phone 16 sorts the re-detected four touch points from the largest to the smallest, and obtains p41, p42, p43, and p44, and updates pIndex, pMiddle, pRing, and pLittle with them.
  • the phone 16 After the side button is activated, if the phone 16 detects that there are only 3 touch points on the right side of the curved screen, it means that one finger on the right side of the curved screen is released. The mobile phone 16 sorts the detected three touch points from the largest to the smallest, and obtains three points p31, p32, p33.
  • the handset 16 updates pIndex, pMiddle, pRing and pLittle with p41, p42, p43 and p44.
  • the handset 16 updates pIndex, pMiddle, pRing and pLittle with p41, p42, p43 and p44.
  • Figure 31 is a slide phone, which is provided with a 3*5 array physical keyboard.
  • the side key layout is the same as that of the mobile phone 1, and the keyboard layout corresponding to the partial side key and the side key combination is shown in Figs. 33 to 38.
  • 32 is a flip phone, which is provided with a 4*4 array physical keyboard, the side key layout is the same as that of the mobile phone 1, and the keyboard layout corresponding to the side key and the side key combination is as shown in FIG. 21 to FIG. 28.
  • Figure 39 shows a flat panel 24 with a 2*6 array physical keyboard at the bottom, Shift on the left upper corner of the frame, 2Hands on the left side, and multiple points on the left side of the back.
  • the touchpad 28 is provided with a keyboard dynamic mapping area on the touch display screen, and the keyboard layout corresponding to the partial side key and the side key combination is as shown in FIG. 43 to FIG. 48.
  • the user's left hand is held on the left side of the tablet 24, the left thumb is held at the Shift, the 2Hands is naturally pressed by the protrusion of the left thumb root, and the left index finger, middle finger, ring finger and little finger are held on the left side of the tablet.
  • the four touch points formed on the touch panel correspond to the side keys En1, En2, Num and Punc, respectively.
  • Figure 42 is a frameless flat panel 29 with a 2*5 array physical keyboard at the bottom, and a touch screen display with a keyboard dynamic mapping area.
  • the side key layout is the same as that of the tablet 24 except that Shift is placed in the upper left corner of its touch display screen.
  • the keyboard layout corresponding to some of the side key and side key combinations is shown in FIGS. 49 to 52.
  • the pinch of the borderless tablet disclosed in the PCT application published as WO/2014/101519 can be regarded as the Shift key of the tablet, and the touch action at the pinch point is regarded as the operation of the Shift key.
  • Figure 53 is a flip hard keyboard plate 35.
  • the keyboard 36 is a 3*5 array that is connected to the panel by a strap and can be flipped over to the back of the panel when not in use. If the keyboard 36 is transparent, the keyboard layout shown in Figures 33 through 38 and other keyboard layouts not shown can be dynamically displayed on the touch display screen thereunder.
  • the side key layout of the flat plate 35 is the same as that of the flat plate 24.
  • Figure 56 is a frameless flip hard keyboard panel 40.
  • the keyboard 41 is a 4*4 array.
  • the side key layout of the flat panel 40 is the same as that of the flat panel 29, and the keyboard layout corresponding to the side key and the side key combination is as shown in FIGS. 21 to 28.
  • the above-mentioned side keys used as keyboards can be used as other keys in a non-editing state or a non-shortcut mode, or can be used as other keys by double-clicking or even three-stroke.
  • the side keys provided on the trackpad do not have to be used as side keys for the keyboard.
  • the invention is also applicable to similar handheld digital devices other than cell phones and tablets.
  • the size of the handheld digital device is large, the index finger or/and the little finger of the left hand cannot reach the touchpad disposed on the right side, it is impossible to set at least four side keys on the touchpad, and the touchpad can be held by hand.
  • the back of the digital device is properly extended so that the index finger or / and the little finger can reach. As long as the touchpad is placed on the left or back side of the handheld digital device, it can be applied to the left-hander.
  • 57 to 64 are a touchpad mouse 42 on which a plurality of fingers can be simultaneously slid, held, rotated, and the like.
  • Fig. 57, Fig. 58, and Fig. 59 show the case where 3/4/5 mouse keys are realized with 3/4/5 fingers of the right hand, respectively.
  • R1, R2, R3, R4, and R5 in the figure represent the thumb, index finger, middle finger, ring finger, and little finger of the right hand, respectively.
  • L1, L2, L3, L4, and L5 respectively represent the thumb, index finger, middle finger, ring finger, and little finger of the left hand. Since all fingers or most of the fingers rest on the mouse pad, and the wrist does not need to flex upwards, the fatigue of the fingers and wrists can be greatly alleviated.
  • Definitions R1, R2, R3, R4, and R5 correspond to the fourth mouse button, the left mouse button, the middle mouse button, the right mouse button, and the fifth mouse button, respectively.
  • the mouse firmware sorts the p51 to p55 reference coordinate system 43 by the value of x from small to large to obtain pX1, pX2, pX3, pX4, and pX5, and sorts the y values from large to small to obtain pY1, pY2, pY3, pY4, and pY5, and marks R1. , R2, R3, R4 and R5 are pressed.
  • the initial touch gesture of the right hand is as shown in FIG. 59, so pX1, pX2, pX3, pX4, and pX5 correspond to the touch points of R1, R2, R3, R4, and R5, respectively.
  • the mouse firmware saves pX1, pX2, pX3, pX4, and pX5 as pThumb, pIndex, pMiddle, pRing, and pLittle, and activates the mouse button.
  • the initial touch gesture of the right hand is as shown in FIG. 60, so pY5, pY4, pX3, pX4, and pX5 correspond to the touch points of R1, R2, R3, R4, and R5, respectively.
  • the mouse firmware saves pY5, pY4, pX3, pX4, and pX5 as pThumb, pIndex, pMiddle, pRing, and pLittle, and activates the mouse button.
  • the initial touch gesture of the right hand is as shown in Fig. 61, so pY5, pY4, pY3, pY2, and pY1 correspond to the touch points of R1, R2, R3, R4, and R5, respectively.
  • the mouse firmware saves pY5, pY4, pY3, pY2, and pY1 as pThumb, pIndex, pMiddle, pRing, and pLittle, and activates the mouse button.
  • the initial touch gesture of the right hand is as shown in FIG. 62, so pX1, pX2, pX3, pY4, and pY5 correspond to the touch points of R1, R2, R3, R4, and R5, respectively.
  • the mouse firmware saves pX1, pX2, pX3, pY4, and pY5 as pThumb, pIndex, pMiddle, pRing, and pLittle, and activates the mouse button.
  • the initial touch gesture of the right hand is as shown in FIG. 63, so pY1, pY2, pY3, pY4, and pY5 correspond to the touch points of R1, R2, R3, R4, and R5, respectively.
  • the mouse firmware saves pY1, pY2, pY3, pY4, and pY5 as pThumb, pIndex, pMiddle, pRing, and pLittle, and activates the mouse button.
  • the mouse firmware After the mouse button is activated, as each finger moves over the mouse pad 42, the mouse firmware continuously refreshes pThumb, pIndex, pMiddle, pRing, and pLittle or continuously updates pThumb, pIndex, pMiddle, pRing, and pLittle through the above steps.
  • the coordinates of each touch point are represented by (x, y, p).
  • the mouse firmware cyclically matches the detected four touch points p41, p42, p43, and p44 with pThumb, pIndex, pMiddle, pRing, and pLittle, respectively. (ie, compare whether x and y of the two touch points are equal at the same time), get the touch point without matching, then determine the finger just released according to the touch point on the no match, and mark the finger as release. For example, if pIndex is not matched, then R2 is released and flag R2 is released.
  • the mouse firmware When the mouse firmware re-detects that 5 touch points are generated on the mouse board 42, it indicates that the R2 just released is pressed back again, and the mouse firmware mark R2 is pressed, and a command of left mouse click is issued. Then, update pThumb, pIndex, pMiddle, pRing and the newly detected touch points. pLittle.
  • the mouse firmware detects that the p value of the touch point has changed, the finger of the current operation is judged by referring to the description of the third part above, and the corresponding mouse button instruction is issued. For example, if the mouse firmware detects that the p-value of pRing has changed, and R4 performs an afterburner press, it indicates that R4 has just been operated; when the p-value of pRing is detected, it changes again, and R4 naturally touches the mouse pad. After 42, the mouse firmware issues a right-click command and updates pThumb, pIndex, pMiddle, pRing, and pLittle. It can be seen that for a touchpad supporting 3D touch, the buttons can be operated in two ways at the same time.
  • the mouse can be simulated with a finger on a touch display supporting multi-touch function; or a tablet supporting multi-touch function can be transformed into a mouse, for some tablets, for example, support Tablets with Bluetooth 4.0 or higher, even just write a special mouse app to interpret the finger operation on the flat touch screen as a mouse operation.
  • 65 to 68 are a large-sized touch display device 44.
  • the user is prompted to touch the device 44 with two hands as shown in FIG. 65, and then two arcs aL0 and aR0 are virtualized according to each of the five touch points of the user's left and right hands, and then calculated.
  • the average value r0 of the aL0 and aR0 radii is stored in device 44.
  • the device 44 After the user normally uses the device 44, when it is detected that 10 touch points are generated on the touch display screen, the device 44 refers to the coordinate system 45 to sort the 10 touch points from small to large to obtain pL1, pL2, pL3. , pL4, pL5 and pR1, pR2, pR3, pR4, pR5. Then, two arcs aL and aR are virtualized according to pL1 to pL5 and pR1 to pR5, and then compared with r0 by the radii rL and rR of aL and aR, respectively.
  • both rL and rR are close to r0, and the center of aL is on the left side of aL, and the center of aR is on the right side of aR, it indicates that the touch gesture of both hands on device 44 is correct as shown in FIG.
  • pL1, pL2, pL3, pL4, pL5, and pR1, pR2, pR3, pR4, and pR5 are respectively subjected to the method of the sixth part and L1, L2, L3, L4, L5, and R1, respectively.
  • R2, R3, R4, and R5 are associated with each other, and in subsequent operations, the coordinates of the corresponding touch points of each finger are updated in time as each finger moves continuously.
  • buttons When you do not need to set as many buttons as you want on a multi-touch trackpad/touchscreen, you can ignore unused buttons.
  • the touchpad mouse shown in Figure 59 can ignore the unused mouse button when it does not require five mouse buttons.
  • the above description of the multi-touch panel is equally applicable to multi-touch screens and vice versa.
  • the above method for realizing a button on a multi-touch panel or a multi-touch screen not only realizes the dynamic passive determination of the button position, but also enables the user to specify the button, that is, the user only needs to remember the button represented by the corresponding finger, correspondingly The action of the finger is the operation of the corresponding button.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

一种实现多个位置动态被动确定按键的方法。当用户的一只手或两只手的若干手指握持或触按到多点触控板/触摸屏上时会生成多个触按点。通过把触按点当做按键;并把手指通过触按点和按键一一对应起来;以及把每个触按点及其坐标因相应手指的操作失而复得,或者把每个触按点的坐标中代表手指压力值的坐标之值因相应手指的操作发生改变,当作对对应按键的操作,就可以在多点触控板/触摸屏上实现多个位置动态被动确定的按键。在按键操作结束之后,上述手指依然是握持或者触按在上述触控板/触摸屏上的。

Description

一种实现多个位置动态被动确定按键之方法 技术领域
本发明涉及一种在多点触控板/触摸屏上实现多个位置动态被动确定按键的方法。
背景技术
公布号为WO 2014/023118 A1的PCT申请,披露了触控板可以用作手持数字设备键盘的侧键,但没有详细披露具体的实现方法。
发明内容
当用户的一只或者两只手的若干手指握持或者触按到多点触控板/触摸屏上时会生成若干触按点。在本发明中,通过把触按点当作按键,并把手指通过触按点和按键一一对应起来,把触按点及其坐标因相应手指的操作失而复得或者把触按点的坐标中代表手指压力值的坐标之值因相应手指的操作发生改变当作对对应按键的操作,就可以在多点触控板/触摸屏上实现多个位置动态被动确定的按键。在按键操作结束之后,上述手指依然是握持或者触按在上述触控板/触摸屏上的。
采用多点触控板/触摸屏做若干按键,不仅不需要像操作位置固定的按键那样在操作前先要把各个手指对准各个按键,而且也不用顾忌在操作中会按错按键,因为一个手指会永远按到正确的按键上,原因就在于一个按键的位置是在相应的手指按下后才确定的。在以下的部分叙述中,在多点触控板/触摸屏上设置的侧键就是上述的按键。
附图说明
图1为一种手机的右前视图;图2为该手机的左侧面图;图3为该手机的右侧面图;图4是该手机的正面图;图5和图6为该手机的另一种侧键布局;图7到图14为该手机侧键和侧键组合对应的键盘布局。
图15为另一种手机的正面图;图16为该手机的左侧面图;图17为该手机的右侧面图;图18为该手机的背部视图。
[根据细则91更正 05.03.2016] 
图19为一种曲面屏手机的右前视图;图20为该手机的左前视图;图21到图30为该手机侧键和侧键组合对应的键盘布局。
[根据细则91更正 05.03.2016] 
图31为一种滑盖手机的右前视图。
[根据细则91更正 05.03.2016] 
图32为一种翻盖手机的右前视图;图33到图38为该手机部分侧键和侧键组合对应的键盘布局。
[根据细则91更正 05.03.2016] 
图39为一种平板的正面图;图40为该平板的左前视图;图41为该平板的背面视图;图43到图48为该平板的部分侧键和侧键组合对应的键盘布局。
[根据细则91更正 05.03.2016] 
图42为另一种平板的左前视图;图49到图52为该平板的部分侧键和侧键组合对应的键盘布局。
图53为一种平板的正面图;图54为该平板的左前视图;图55为该平板的背部视图。
图56为另一种平板的左前视图。
图57到图64为一种触控板鼠标的正面图。
图65到图68为一种大尺寸触摸显示设备的正面图。
具体实施方式
一、图1为一种手机1,2*4阵列的实体键盘2设在其下部,侧键Shift和2Hands设在其左侧面,侧键En1、En2、Num和Punc设在其右侧面多点触控板4上。在手机1的触摸显示屏上设有键盘动态映射区10。根据当前操作的侧键和侧键组合,映射区10动态显示图7到图14的键盘布局,以提示用户在键盘2上操作。映射区10本身也可以是一触摸键盘。侧键指示器6用于指示当前操作的侧键或侧键组合。按钮7用于关闭或打开映射区10。5是映射区10关闭时的情形。
用户左手的5个手指在握持手机1时,左手的拇指握持在Shift键上,左手的食指、中指、无名指和小指握持在触控板 4上,手指在触控板4上的触按点即是侧键,2Hands由左手拇指根部的突起自然靠压。左手握持手机1和侧键并操作侧键,右手操作键盘2。左手的食指对应En1,其它类推。En1和En2用来输入26个英文字母,Num主要用来输入数字,Punc主要用来输入标点符号,Shift键的作用同于PC键盘上的Shift键。
侧键采用先释放与欲按侧键对应的手指,马上再按回去的方法进行操作,当手指重新按回去后,对应的侧键就被按下了。在一个侧键被按下后,键盘固件根据接下来其它侧键的操作决定其是否被“释放”。例如,在En1和Shift被键盘固件标记为按下(此时En1、Shift和其他侧键都是被按着的)的情况下,接下来如果En2被操作,键盘固件将在标记En2按下的同时标记En1和Shift释放(尽管按着En1和Shift的手指并没有释放)。又比如,在只有En1标记为按下的情况下,如果接下来Shift被操作,则键盘固件仅标记Shift按下,这样就可以实现侧键组合En1+Shift。其它类推。
2Hands键被触按将触发键盘固件检测Shift键是否被触按以及是否在触控板4上形成四个触按点。如果是则表明手机1、Shift和触控板4被正确握持,键盘固件参照坐标系8把这四个触按点按x值从大到小(即从上到下)排序,并把排序后的触按点保存为pIndex,pMiddle,pRing和pLittle,然后计算这些排序后的触按点中相邻两个点之间沿x轴间距的平均值avg并保存起来,接着把pIndex,pMiddle,pRing和pLittle分别与左手的食指、中指、无名指和小指以及触控板4上的侧键En1、En2、Num和Punc一一对应起来,并标记左手的食指、中指、无名指和小指为按下。
键盘固件接着激活侧键,并默认当前按下的侧键是En1,即键盘固件标记En1按下,标记其他侧键为释放,尽管此时所有的侧键都被左手的五个手指触按着。
在侧键激活之后,如果触控板4上触按点的个数发生了变化:(a)触按点少于3个多于0个,则说明触控板4上的多个手指同时操作,为简单起见,这种情形不在下面描述;(b)触按点等于0个,则说明触控板4上的手指全部释放,键盘固件去激活侧键,并重新等待侧键激活条件的出现;(c)触按点等于3个,则说明触控板4上只有一个手指释放了,在操作某个侧键。键盘固件把检测到的三个触按点按x值从大到小排序,得到三个点p31,p32,p33。
(一)如果p31.x<=pMiddle.x+avg*50%(avg也可以用20mm来代替,以克服用户的手指在触控板4上的握持手势过于随意,avg不准的情况。20mm是各种人种成人手指宽度的平均值,是一个经验值。avg还可以在用户初次使用手机时经过校验确定),则说明左手的食指释放了,食指在触控板4上的触按点及其坐标失去,键盘标记左手食指释放。如果为否,则继续第(二)步。
(二)如果p33.x>pRing.x-avg*50%,则说明左手的小指释放了,小指在触控板4上的触按点及其坐标失去,键盘标记左手小指释放。如果为否,则继续第(三)步。
(三)如果pMiddle.x-avg*50%<p32.x<=pMiddle.x+avg*50%,说明左手的无名指释放了,键盘固件标记左手无名指释放,否则说明左手中指释放了,键盘固件标记左手中指释放。
如果其后,键盘固件检测到在触控板4上重新生成了四个触按点,则说明刚才释放的手指又按回去了,对应该手指的触按点及其坐标失而复得,键盘固件重新标记该手指按下,同时标记与该手指对应的侧键按下,并同时决定是否对以前标记为按下的侧键重新标记为释放。接着,键盘固件把重新检测到的四个触按点按x值从大到小排序,得到p41,p42,p43和p44,并用它们分别更新pIndex,pMiddle,pRing和pLittle。之后,键盘固件如上述不断循环检测与处理。
由于触控板4上各个侧键的初始位置是由用户的各个手指在触控板4上触按点的初始位置确定的,不是预先就确定的,而且这些侧键的位置在操作过程中还会随着这些触按点位置的不断变化而变化。因此采用多点触控板做若干侧键,不仅不需要像操作位置固定的侧键那样在操作前先要把各个手指对准各个侧键,而且也不用顾忌在操作中会按错侧键,因为这些手指会永远按到正确的侧键上,原因就在于一个侧键的位置是在相应的手指按下后才确定的。
当左手的各个手指双击时,侧键布局如图5和图6所示。其中,Home用作主页键;Recent用于显示最近打开的应用;Back,Forward用于导航;cMenu是context menu的缩写,用于打开和关闭当前应用的菜单(工具栏)。
在触控板4上用左手食指向上滑动根据手机1当前应用的不同或增加音量或者向上翻页,用左手食指向下滑动根据手机1当前应用的不同或减小音量或向下翻页。
图7为手机1侧键En1对应的键盘布局,中间两行键11对应键盘2的两行键,标记②12表示其所在行的每一个键是由键盘2上对应两键同时按下和释放实现。比如,i键是由对应的a和b键同时按下和释放实现。标记④13表示其所在行的每一个键是由键盘2上对应的四个键同时按下和释放实现。如,BS键是由a、b、c和d四个键同时按下和释放实现。其余键和其余键盘布局的情形类推可得。图7到图14键盘布局所对应的侧键或侧键组合标示在各个布局的左上角。
图15也是一种手机14,在其左侧如图16设有侧键cMenu和2Hands,在其右侧如图17和背部中间如图18的多点触控板上设有侧键Back,Forward,Recent和Home。
在手机14的背部设置触控板,便于用户单手(左手或右手)握持并操作手机,在这种情形下,缺失的cMenu键,可以通过食指在背部触控板上双击实现。当握持手机14手的手指在背部触控板上操作时,该手的拇指会触按到正面的触摸显示屏上,这种与背部触控板上的操作同时发生的触摸动作应该被忽略。键盘固件在检测到背部触控板上生成四个触按点时,激活触控板上的侧键。
[根据细则91更正 05.03.2016] 
二、图19和图20是一种曲面屏手机16,其曲面屏是一块多点触摸屏。在曲面屏的左边设有侧键Shift和2Hands,在曲面屏的右边设有侧键Rmt、Ctrl、En1、En2、Num、Punc和Alt。手机16和侧键由左手握持并操作,Ctrl和Rmt由左手食指向上位移操作,Alt由左手小指向下位移操作(如果是左撇子使用手机16,则曲面屏左右两侧的侧键布局互换即可)。键盘17为设在曲面屏上的4*4矩阵触摸键盘,其布局会根据当前操作的侧键或侧键组合动态改变。图21到图30为手机16的侧键或侧键组合对应的键盘布局。
当左手握持手机16时,左手拇指握在曲面屏的左侧,左手的其余四指均匀地握在曲面屏的右侧。当手机16检测到在曲面屏的两侧生成6个触按点时,把右侧四个触按点参照坐标系20按x值从大到小排序,并计算这些排序后的触按点中相邻两个点之间沿x轴的间距dist以及这些间距的平均值avg和总和ttl并把它们保存起来。如果每一个dist都在avg*(1±25%)的范围内,且ttl在wdth*3*(1±20%)的范围内(wdth表示用户手指的平均宽度,预定为20mm,可以在用户初次使用手机时经过校验为其确定一个新值),则手机16接着检测第一个触按点到曲面屏顶边的垂直距离是否大于2.5*avg,第四个触按点到曲面屏底边的垂直距离是否大于1.5*avg。如果是,则手机16激活侧键。
接下来,手机16保存上述排序后的四个触按点为pIndex,pMiddle,pRing和pLittle,并把它们分别与左手的食指、中指、无名指和小指以及曲面屏右侧的En1、En2、Num和Punc一一对应起来,并标记左手的食指、中指、无名指和小指为按下。与此同时,对于曲面屏左侧生成的两个触按点,手机16把上面的触按点与左手拇指和Shift对应起来,把下面的触按点与2Hands对应起来。接着,手机16默认标记En1按下,标记其他侧键释放(2Hands除外)。
对于Shift、En1、En2、Num和Punc采用先释放与欲按侧键对应的手指,马上再按回去的方法进行操作。在侧键激活之后,如果手机16检测到曲面屏右侧只有3个触按点(其它数量触按点的情形参照第一部分的描述),则说明曲面屏右侧有一个手指释放了,在操作某个侧键。手机16把检测到的三个触按点按x值从大到小排序,得到三个点p31,p32,p33。
(一)如果p31.x<=pMiddle.x+avg*50%,则说明左手的食指释放了,左手食指在曲面屏右侧的触按点及其坐标失去,手机16标记左手食指释放。如果其后,手机16检测到在曲面屏右侧重新生成了4个触按点,则说明左手的食指又按回去了,左手食指在曲面屏右侧的触按点及其坐标失而复得,手机16重新标记左手食指按下。与此同时,手机16把曲面屏右侧重新生成的四个触按点按x值从大到小排序,得到p41,p42,p43和p44。
如果pMiddle.x+avg*50%<p41.x<=pMiddle.x+avg*150%,则说明左手食指按在了En1的位置,手机16标记En1按下,标记其他侧键除Alt外为释放。也就是En1被按下后,可能对应的侧键和侧键组合是:En1或者Alt+En1(如果此前Alt已经标记为按下的话);
如果pMiddle.x+avg*150%<p41.x<=pMiddle.x+avg*250%,则说明左手食指按在了Ctrl的位置,手机16标记Ctrl和En1按下,标记其他侧键除Alt外为释放。也就是Ctrl被按下后,对应的侧键和侧键组合可能是:Ctrl+En1,Ctrl+Alt+En1(如果此前Alt已经标记为按下的话)。
如果p41.x>pMiddle.x+avg*250%,则说明左手食指按在了Rmt的位置,手机16标记Rmt按下,标记其他侧键释放。
接着,手机16用p41,p42,p43和p44更新pIndex,pMiddle,pRing和pLittle。
(二)如果p33.x>pRing.x-avg*50%,则说明左手的小指释放了,左手小指在曲面屏右侧的触按点及其坐标失去,手机16标记左手小指释放。如果其后,手机16检测到曲面屏右侧重新生成了4个触按点,则说明左手的小指又按回去了,左手小指在曲面屏右侧的触按点及其坐标失而复得,手机16重新标记左手小指按下。与此同时,手机16把曲面屏右侧重新生成的四个触按点按x值从大到小排序,得到p41,p42,p43和p44。
如果pRing.x-avg*150%<p44.x<=pRing.x-avg*50%,则说明左手小指按在了Punc的位置,手机16标记Punc按下,标记其他侧键除Ctrl外为释放。也就是Punc被按下后,可能对应的侧键和侧键组合是:Punc或者Ctrl+Punc(如果此前Ctrl已经标记为按下的话);
如果p44.x<=pRing.x-avg*150%,则说明左手小指按在了Alt的位置,手机16标记Alt和Punc按下,标记其他侧键除Ctrl外释放。也就是Alt被按下后,对应的侧键和侧键组合可能是:Alt+Punc,Ctrl+Alt+Punc(如果此前Ctrl已经标记为按下的话)。
接着,手机16用p41,p42,p43和p44更新pIndex,pMiddle,pRing和pLittle。
(三)如果pMiddle.x-avg*50%<p32.x<=pMiddle.x+avg*50%,说明左手无名指释放了,手机16标记无名指释放,否则说明左手中指释放了,手机16标记左手中指释放。如果其后,手机16检测到曲面屏右侧重新生成了4个触按点,则说明左手的中指或者无名指又按回去了,左手中指或者无名指在曲面屏右侧的触按点及其坐标失而复得。
如果此前左手中指标记为释放,则手机16在标记左手中指为按下的同时标记En2为按下,标记其他侧键除Ctrl和Alt外为释放。也就是En2被按下后,可能对应的侧键和侧键组合是:En2,Ctrl+En2,Alt+En2或者Ctrl+Alt+En2(如果此前Ctrl和/或Alt已经标记为按下的话)。
如果此前左手无名指标记为释放,则手机16在标记左手无名指为按下的同时标记Num按下,标记其他侧键除Ctrl和Alt外为释放。也就是Num被按下后,可能对应的侧键和侧键组合是:Num,Ctrl+Num,Alt+Num或者Ctrl+Alt+Num(如果此前Ctrl和/或Alt已经标记为按下的话)。
接着,手机16用p41,p42,p43和p44更新pIndex,pMiddle,pRing和pLittle。
三、如果手机16的曲面屏是3D touch屏,则可以采用“先用与欲按侧键对应的手指加力按一下,马上再放松到自然握持状态”的方法操作Shift、En1、En2、Num和Punc。这时,手指在曲面屏上的触按点用(x,y,p)表示,p代表手指在触按点施加的压力值。手指在加力按下又放松后,相应侧键标记为按下,该侧键什么时候“释放”根据后续操作的侧键由手机16决定,具体情况还可以参照上述第一、二部分的描述。手机16在激活侧键之前的步骤参照上述第二部分的描述。
在侧键激活之后,在Rmt、Ctrl和Alt中没有任何一个标记为按下的情况下,如果手机16检测到曲面屏右侧触按点为四个且有触按点的p值发生了变化,被进行了加力按,则对这四个触按点按x值从大到小排序,得到p41,p42,p43和p44。
如果(p41.p-pIndex.p)/pIndex.p>P(大写P是能够正确区分手指的误操作和正确操作的预定义值,还可以在用户初次使用手机时经过校验为其确定一个新值),或者p41.p>P1*fct,说明左手食指加力按在了En1的位置,标记En1被加力按;
如果(p42.p-pMiddle.p)/pMiddle.p>P,或者p42.p>P2*fct,说明左手中指加力按在了En2的位置,标记En2被加力按;
如果(p43.p-pRing.p)/pRing.p>P,或者p43.p>P3*fct,说明左手无名指加力按在了Num的位置,标记Num被加力按;
如果(p44.p-pLittle.p)/pLittle.p>P,或者p44.p>P4*fct(上述大写的P1、P2、P3和P4分别是用户左手食指、中指、无名指和小指自然握持在曲面屏右侧时施加在触按点上的压力值,fct是能够正确区分手指的误操作和正确操作的预定义因子,可以在用户初次使用手机时经过校验为它们指定具体的值),说明左手小指加力按在了Punc的位置,标记Punc被加力按。
之后,如果手机16检测到曲面屏右侧有触按点的p值发生了变化,四个手指都恢复到了自然握持状态,则取消刚才侧 键的加力按标记,并标记该侧键为按下,并同时决定是否对其它先前标记为按下的侧键标记为释放。接着,手机16把重新检测到的四个触按点按x值从大到小排序,得到p41,p42,p43和p44,并用它们更新pIndex,pMiddle,pRing和pLittle。
在侧键激活之后,如果手机16检测到曲面屏右侧只有3个触按点,则说明曲面屏右侧有一个手指释放了。手机16把检测到的三个触按点按x值从大到小排序,得到三个点p31,p32,p33。
(一)如果p31.x<=pMiddle.x+avg*50%,则说明左手的食指释放了,手机16标记左手食指释放。如果其后,手机16检测到在曲面屏右侧重新生成了四个触按点,则说明左手的食指又按回去了,手机16标记左手食指按下。然后,手机16把这四个触按点按x值从大到小排序,得到p41,p42,p43和p44。
如果pMiddle.x+avg*50%<p41.x<=pMiddle.x+avg*150%,则说明左手食指按在了En1所在的位置,标记En1按下。
如果pMiddle.x+avg*150%<p41.x<=pMiddle.x+avg*250%,则说明左手食指按在了Ctrl所在的位置,标记Ctrl和En1按下。
如果p41.x>pMiddle.x+avg*250%,则说明左手食指按在了Rmt所在的位置,标记Rmt按下。
在上述相应的侧键标记为按下后,还要决定是否对其它先前标记为按下的侧键标记为释放。接着,手机16用p41,p42,p43和p44更新pIndex,pMiddle,pRing和pLittle。
(二)如果p33.x>pRing.x-avg*50%,则说明左手的小指释放了,标记左手小指释放。如果其后,检测到在曲面屏右侧重新生成了四个触按点,则说明左手的小指又按回去了,标记左手小指按下。手机16把这四个触按点按x值从大到小排序,得到p41,p42,p43和p44。
如果pRing.x-avg*150%<p44.x<=pRing.x-avg*50%,则说明左手小指按在了Punc所在的位置,标记Punc按下。
如果p44.x<=pRing.x-avg*150%,则说明左手小指按在了Alt所在的位置,标记Alt和Punc按下
在上述相应的侧键标记为按下后,还要决定是否对其它先前标记为按下的侧键标记为释放。接着,手机16用p41,p42,p43和p44更新pIndex,pMiddle,pRing和pLittle。
在上述三部分的说明中,虽然没有描述单个侧键双击、三击和多个侧键被同时操作的情形,但很显然本发明也是可以实现这些操作的。本发明可应用于更多的侧键操作方法,在背景技术中提到的PCT申请文件记载了更多可用的侧键操作方法,可以参考。
[根据细则91更正 05.03.2016] 
四、图31为滑盖手机,设置有3*5阵列的实体键盘,其侧键布局与手机1一样,其部分侧键和侧键组合对应的键盘布局如图33到图38。图32为翻盖手机,设置有4*4阵列的实体键盘,其侧键布局与手机1一样,其侧键和侧键组合对应的键盘布局如图21到图28。
[根据细则91更正 05.03.2016] 
五、图39为一款平板24,其底部设有2*6阵列实体键盘,在其左上角的边框上设有Shift,在其左侧面设有2Hands,在其背部左侧设有多点触控板28,在其触摸显示屏上设有键盘动态映射区,其部分侧键和侧键组合对应的键盘布局如图43到图48所示。用户的左手握在平板24的左侧,左手的拇指握在Shift处,2Hands由左手拇指根部的突起自然靠压,左手的食指、中指、无名指和小指握在平板背部左侧的触控板28上,在该触控板上形成的四个触按点分别对应侧键En1、En2、Num和Punc。
[根据细则91更正 05.03.2016] 
图42为一款无边框平板29,其底部设有2*5阵列实体键盘,其触摸显示屏上设有键盘动态映射区。除Shift设在其触摸显示屏的左上角外,其侧键布局与平板24的相同。其部分侧键和侧键组合对应的键盘布局如图49到图52所示。可以把公布号为WO/2014/101519的PCT申请披露的无边框平板的夹点当作该款平板的Shift键,并把夹点处的触按动作当作对Shift键的操作。
[根据细则91更正 05.03.2016] 
图53是一款翻转硬键盘平板35。键盘36采用3*5的阵列,通过束带与平板连接,在不用的时候可以翻转到平板的背部。如果键盘36是透明的,则可以在其下的触摸显示屏上动态显示图33到图38所示的键盘布局以及其它没有示出的键盘布局。平板35的侧键布局与平板24的一样。
[根据细则91更正 05.03.2016] 
图56为一款无边框翻转硬键盘平板40。键盘41采用4*4阵列。平板40的侧键布局与平板29的一样,其侧键和侧键组合对应的键盘布局如图21到图28所示。
上述用作键盘的侧键,在非编辑状态下或者非快捷键模式下可以转用作其他键,或者通过双击甚至三击转用作其他键。正如手机14所示,设置在触控板上的侧键不一定非得用作键盘的侧键。显然,本发明也适用于除手机和平板以外的其他类似手持数字设备。当手持数字设备尺寸较大,左手的食指或/和小指够不到设置在右侧的触控板时,就不可能在触控板上设置至少四个侧键,可以把触控板向手持数字设备的背部适当延伸以便食指或/和小指能够够着。只要把触控板设置在手持数字设备的左侧或背部右侧就可适用于左撇子。
六、对于独立的多点触控板或者多点触摸屏,一样可以实现多个位置动态被动确定的按键。图57到图64为一种触控板鼠标42,多个手指可以在其上同时滑动、握放、旋转等。图57、图58和图59分别是用右手的3/4/5个手指实现3/4/5个鼠标键的情形。图中的R1、R2、R3、R4、R5分别表示右手的拇指、食指、中指、无名指和小指。图64为用户用左手五指在触控板鼠标42上实现五个鼠标键的情形,其中,L1、L2、L3、L4、L5分别表示左手的拇指、食指、中指、无名指和小指。由于所有手指或大部分手指都搁置在鼠标板上,而且手腕不用向上屈曲,因此可以大大缓解手指和手腕的疲劳。
以下以用右手在鼠标板42上实现5个鼠标键的情形进行说明。定义R1、R2、R3、R4和R5分别对应第四鼠标键、鼠标左键、鼠标中键、鼠标右键和第五鼠标键。当右手五个手指触按到鼠标板42上时,生成5个触按点p51、p52、p53、p54和p55。鼠标固件对p51到p55参照坐标系43按x值从小到大排序得到pX1、pX2、pX3、pX4和pX5,按y值从大到小排序得到pY1、pY2、pY3、pY4和pY5,同时标记R1、R2、R3、R4和R5为按下。
如果pY1=pX3,则说明右手的初始触按手势如图59所示,因此pX1、pX2、pX3、pX4和pX5分别对应R1、R2、R3、R4、R5的触按点。接着,鼠标固件把pX1、pX2、pX3、pX4和pX5保存为pThumb、pIndex、pMiddle、pRing和pLittle,并激活鼠标键。
如果pY1=pX4,则说明右手的初始触按手势如图60所示,因此pY5、pY4、pX3、pX4和pX5分别对应R1、R2、R3、R4、R5的触按点。接着,鼠标固件把pY5、pY4、pX3、pX4和pX5保存为pThumb、pIndex、pMiddle、pRing和pLittle,并激活鼠标键。
如果pY3=pX1,则说明右手的初始触按手势如图61所示,因此pY5、pY4、pY3、pY2和pY1分别对应R1、R2、R3、R4、R5的触按点。接着,鼠标固件把pY5、pY4、pY3、pY2和pY1保存为pThumb、pIndex、pMiddle、pRing和pLittle,并激活鼠标键。
如果pY1=pX2,则说明右手的初始触按手势如图62所示,因此pX1、pX2、pX3、pY4和pY5分别对应R1、R2、R3、R4、R5的触按点。接着,鼠标固件把pX1、pX2、pX3、pY4和pY5保存为pThumb、pIndex、pMiddle、pRing和pLittle,并激活鼠标键。
如果pY3=pX5,则说明右手的初始触按手势如图63所示,因此pY1、pY2、pY3、pY4和pY5分别对应R1、R2、R3、R4、R5的触按点。接着,鼠标固件把pY1、pY2、pY3、pY4和pY5保存为pThumb、pIndex、pMiddle、pRing和pLittle,并激活鼠标键。
在激活鼠标键之后,随着各个手指在鼠标板42上的移动,鼠标固件不断刷新pThumb、pIndex、pMiddle、pRing和pLittle或者通过上述步骤不断更新pThumb、pIndex、pMiddle、pRing和pLittle。
假定鼠标板42是一块3D touch鼠标板,每个触按点的坐标用(x,y,p)表示。
当有一个手指释放,触按点由5个变成4个时,鼠标固件把检测到的4个触按点p41、p42、p43和p44分别与pThumb、pIndex、pMiddle、pRing和pLittle进行循环匹配(即同时比较两个触按点的x和y是否均相等),得到没有匹配上的触按点,接着根据没有匹配上的触按点确定刚才释放的手指,并标记该手指为释放。比如,如果pIndex没有被匹配上,则说明R2释放了,标记R2为释放。当鼠标固件重新检测到鼠标板42上又生成了5个触按点时,说明刚才释放的R2又按回去了,鼠标固件标记R2按下,同时发出鼠标左击的指令。然后,用新检测到的触按点更新pThumb、pIndex、pMiddle、pRing和 pLittle。
或者当鼠标固件检测到有触按点的p值发生了变化时,通过参照上述第三部分的描述,判断当前操作的手指,并发出相应的鼠标键指令。比如,如果鼠标固件检测到了pRing的p值发生了变化,R4进行了加力按,则说明刚才R4进行了操作;在检测到pRing的p值又发生了变化,R4又自然触按在鼠标板42上后,鼠标固件发出鼠标右击的指令,并同时更新pThumb、pIndex、pMiddle、pRing和pLittle。可见,对于支持3D touch的触控板,可以同时用两种方法来操作按键。
图57、图58和图64的情形一样可以通过上述方法实现。
按照上述办法,还可以在一块支持多点触控功能的触摸显示屏上,用手指模拟鼠标;也可以把一个支持多点触控功能的平板电脑改造成为一个鼠标,对于有些平板电脑,比如支持蓝牙4.0以上的平板,甚至只要编写一个专门的鼠标app把平板触摸屏上的手指操作解释成为鼠标操作就可以了。
七、对于大尺寸的多点触摸屏或者多点触控板,还可以同时用双手的部分或者全部十个手指触按到触摸屏或触控板上,在实现滑动、握放和旋转等操作的同时,实现更多位置动态被动确定的按键。
图65到图68是一种大尺寸的触摸显示设备44。在用户初次使用设备44时,提示用户如图65那样用两只手触按在设备上44上,然后分别根据用户左右手的各5个触按点虚拟出两个圆弧aL0和aR0,然后计算aL0和aR0半径的平均值r0,保存在设备44里。
在用户正常使用设备44之后,当检测到在触摸显示屏上生成10个触按点时,设备44参照坐标系45把10个触按点按x值从小到大排序,得到pL1、pL2、pL3、pL4、pL5和pR1、pR2、pR3、pR4、pR5。接着根据pL1到pL5和pR1到pR5虚拟出两个圆弧aL和aR,然后用aL和aR的半径rL和rR分别与r0进行比较。
如果rL和rR有一个或者两个都与r0差距较大,则说明双手在设备44上的触按手势如图67所示,不正确,提示用户改正。
如果rL和rR两个都与r0接近,但aL的圆心在aL的右侧且aR的圆心在aR的左侧,则说明双手在设备44上的触按手势如图68所示,不正确,提示用户改正。
如果rL和rR两个都与r0接近,且aL和aR的圆心分别在aL和aR的下面,则说明双手在设备44上的触按手势如图65所示,正确。
如果rL和rR两个都与r0接近,且aL的圆心在aL的左侧,aR的圆心在aR的右侧,则说明双手在设备44上的触按手势如图65所示,正确。
在确定用户的触按手势正确后,把pL1、pL2、pL3、pL4、pL5和pR1、pR2、pR3、pR4、pR5分别按照上述第六部分的方法与L1、L2、L3、L4、L5和R1、R2、R3、R4、R5对应起来,并在后续的操作中,随着各个手指的不断移动及时更新各个手指对应触按点的坐标。当有手指进行按键操作时,参照上述第一、二、三和六部分的方法,先确定动作的手指,然后再确定操作的按键。
当不需要在多点触控板/触摸屏上设置和触按点一样多的按键时,可以忽略用不到的按键。比如,图59所示的触控板鼠标,当不需要5个鼠标键时,就可以忽略用不到的鼠标键。正如曲面屏手机16所示,以上关于多点触控板上的描述同样适用于多点触摸屏,反之亦然。
上述在多点触控板或者多点触摸屏上实现按键的方法,不仅实现了按键位置的动态被动确定,而且也做到了以手指定按键,即用户只要记住相应手指代表的按键即可,相应手指的动作就是对相应按键的操作。

Claims (9)

  1. 一种实现多个位置动态被动确定按键的方法,当一只手的若干手指握持或者触按到多点触控板/触摸屏上时,会生成多个触按点,其特征是:把上述触按点当做按键;把上述手指通过上述触按点与上述按键一一对应起来;把上述任一触按点及其坐标因相应手指的操作失而复得,或者把上述任一触按点的坐标中代表手指压力值的坐标之值因相应手指的操作发生改变,当作对对应按键的操作;在按键操作结束之后,上述手指依然是握持或者触按在上述触控板/触摸屏上的。
  2. 根据权利要求1所述的实现多个位置动态被动确定按键的方法,其特征是:把食指和/或小指释放后,按回到多点触控板/触摸屏上上述食指或小指通常握持或触按位置以外的位置时形成的触按点,当作按键。
  3. 根据权利要求1所述的实现多个位置动态被动确定按键的方法,其特征是:忽略用不着的按键。
  4. 根据权利要求1所述的实现多个位置动态被动确定按键的方法,其特征是:把多点触控板/触摸屏用作手持数字设备的若干侧面按键或者背部按键。
  5. 根据权利要求1所述的实现多个位置动态被动确定按键的方法,其特征是:把多点触控板/触摸屏用作鼠标。
  6. 根据权利要求1所述的实现多个位置动态被动确定按键的方法,其特征是:把支持多点触控功能的平板电脑改造成鼠标。
  7. 根据权利要求1所述的实现多个位置动态被动确定按键的方法,其特征是:在支持多点触控功能的触摸显示屏上,用手指模拟鼠标。
  8. 根据权利要求4所述的方法,其特征是:用食指在多点触控板/触摸屏上的上下滑动来调节音量或者翻页。
  9. 根据权利要求1所述的实现多个位置动态被动确定按键的方法,其特征是:同时用两只手的若干手指握持或者触按在一块多点触控板/触摸屏上,以实现更多的按键和操作。
PCT/CN2016/070222 2012-08-09 2016-01-06 一种实现多个位置动态被动确定按键之方法 WO2016112813A1 (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US15/149,074 US20160274790A1 (en) 2015-01-12 2016-01-06 Method realizing a plurality of keys/buttons which positions are determined dynamically and passively
CN201680032702.5A CN107735753A (zh) 2015-11-30 2016-01-06 一种实现多个位置动态被动确定按键之方法
US15/356,639 US20170083109A1 (en) 2013-05-20 2016-11-20 Keyboard and mouse of handheld digital device
CN201611051849.7A CN107046591A (zh) 2015-11-30 2016-11-24 一种实现多个位置动态被动确定按键之方法
US15/817,301 US20180074699A1 (en) 2012-08-09 2017-11-20 Method for dynamically configuring positions of multiple key buttons

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201510014843.1 2015-01-12
CN201510014843.1A CN104571571A (zh) 2015-01-12 2015-01-12 手持数字设备键盘
CN201510861828.0A CN105335008A (zh) 2015-11-30 2015-11-30 在多点触控板上实现多个位置动态被动确定的按键的方法
CN201510861828.0 2015-11-30

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/149,074 Continuation-In-Part US20160274790A1 (en) 2012-08-09 2016-01-06 Method realizing a plurality of keys/buttons which positions are determined dynamically and passively

Publications (1)

Publication Number Publication Date
WO2016112813A1 true WO2016112813A1 (zh) 2016-07-21

Family

ID=56405242

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/070222 WO2016112813A1 (zh) 2012-08-09 2016-01-06 一种实现多个位置动态被动确定按键之方法

Country Status (2)

Country Link
US (1) US20160274790A1 (zh)
WO (1) WO2016112813A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108108035A (zh) * 2015-11-30 2018-06-01 李永贵 一种动态配置按键位置的方法
CN108156300A (zh) * 2015-11-30 2018-06-12 李永贵 一种实现多个位置动态被动确定按键之方法

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180134668A (ko) * 2017-06-09 2018-12-19 엘지전자 주식회사 이동 단말기 및 그 제어방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001016635A (ja) * 1999-06-30 2001-01-19 Sanyo Electric Co Ltd 携帯電話機
CN201259733Y (zh) * 2008-07-18 2009-06-17 上海杰康通信科技有限公司 具有握持方式检测器的遥控器
CN101685342A (zh) * 2008-09-26 2010-03-31 联想(北京)有限公司 一种动态虚拟键盘的实现方法及装置
CN103152457A (zh) * 2012-08-09 2013-06-12 李永贵 手机键盘与鼠标
CN104571571A (zh) * 2015-01-12 2015-04-29 李永贵 手持数字设备键盘

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7800592B2 (en) * 2005-03-04 2010-09-21 Apple Inc. Hand held electronic device with multiple touch sensing devices
US8482530B2 (en) * 2006-11-13 2013-07-09 Apple Inc. Method of capacitively sensing finger position
US9141284B2 (en) * 2009-05-28 2015-09-22 Microsoft Technology Licensing, Llc Virtual input devices created by touch input
WO2012024022A2 (en) * 2010-08-20 2012-02-23 University Of Massachusetts Hand and finger registration for control applications
KR101199970B1 (ko) * 2010-10-29 2012-11-12 전남대학교산학협력단 멀티 터치 특징정보 추출방법 및 그 멀티 터치 특징정보를 이용한 멀티 터치 제스처 인식방법
US20130257732A1 (en) * 2012-03-29 2013-10-03 Robert Duffield Adaptive virtual keyboard
CA2925693C (en) * 2013-09-27 2021-10-19 Sensel, Inc. Capacitive touch sensor system and method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001016635A (ja) * 1999-06-30 2001-01-19 Sanyo Electric Co Ltd 携帯電話機
CN201259733Y (zh) * 2008-07-18 2009-06-17 上海杰康通信科技有限公司 具有握持方式检测器的遥控器
CN101685342A (zh) * 2008-09-26 2010-03-31 联想(北京)有限公司 一种动态虚拟键盘的实现方法及装置
CN103152457A (zh) * 2012-08-09 2013-06-12 李永贵 手机键盘与鼠标
CN104571571A (zh) * 2015-01-12 2015-04-29 李永贵 手持数字设备键盘

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108108035A (zh) * 2015-11-30 2018-06-01 李永贵 一种动态配置按键位置的方法
CN108156300A (zh) * 2015-11-30 2018-06-12 李永贵 一种实现多个位置动态被动确定按键之方法
CN108268094A (zh) * 2015-11-30 2018-07-10 李永贵 一种实现多个位置动态被动确定按键之方法
CN108282573A (zh) * 2015-11-30 2018-07-13 李永贵 一种实现多个位置动态被动确定按键之方法

Also Published As

Publication number Publication date
US20160274790A1 (en) 2016-09-22

Similar Documents

Publication Publication Date Title
US10444989B2 (en) Information processing apparatus, and input control method and program of information processing apparatus
CN104331182B (zh) 具有辅助触摸屏的便携式终端
US20120268389A1 (en) Ergonomic motion detection for receiving character input to electronic devices
WO2014023118A1 (zh) 手机键盘与鼠标
CN103207758B (zh) 键盘按键排列方法及应用该方法的手持式电子装置
CN104656963A (zh) 一种基于指纹识别技术的信息输入方法
KR20130044162A (ko) 휴대용 전자 장치
US20130194190A1 (en) Device for typing and inputting symbols into portable communication means
WO2016112813A1 (zh) 一种实现多个位置动态被动确定按键之方法
CN105335008A (zh) 在多点触控板上实现多个位置动态被动确定的按键的方法
CN104571571A (zh) 手持数字设备键盘
CN104317420A (zh) 快速鼻韵母手机汉字输入法
CN103455172A (zh) 触摸式鼠标及其操作方法
CN103677298A (zh) 一种智能终端及智能终端键盘输入方法
WO2013093409A1 (en) Multi finger touch input methodology
CN105072224A (zh) 一种后盖触摸操作的手机及实现手机后盖触摸操作的方法
CN103123538B (zh) 一种键盘功能的实现方法及一种电子设备
US20130271376A1 (en) Touch Keyboard
CN204667334U (zh) 手持数字设备键盘
KR101454896B1 (ko) 터치 패널을 이용한 한글 입력 장치 및 그의 한글 입력 방법
CN204406340U (zh) 一种带有触控键的键盘
CN104375659A (zh) 一种信息处理方法及电子设备
CN103189818A (zh) 使用一只手的所有手指的输入方法
WO2019025878A1 (zh) 一种多点触控应用裝置
KR101550140B1 (ko) 터치스크린을 이용한 문자입력방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16737039

Country of ref document: EP

Kind code of ref document: A1

WPC Withdrawal of priority claims after completion of the technical preparations for international publication

Ref document number: 201510014843.1

Country of ref document: CN

Date of ref document: 20161102

Free format text: WITHDRAWN AFTER TECHNICAL PREPARATION FINISHED

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16737039

Country of ref document: EP

Kind code of ref document: A1