WO2012083499A1 - A new touch screen keyboard design for mobile devices - Google Patents

A new touch screen keyboard design for mobile devices Download PDF

Info

Publication number
WO2012083499A1
WO2012083499A1 PCT/CN2010/002130 CN2010002130W WO2012083499A1 WO 2012083499 A1 WO2012083499 A1 WO 2012083499A1 CN 2010002130 W CN2010002130 W CN 2010002130W WO 2012083499 A1 WO2012083499 A1 WO 2012083499A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch screen
mobile device
measurement
keyboard
screen keyboard
Prior art date
Application number
PCT/CN2010/002130
Other languages
French (fr)
Inventor
Xiaorui XU
Original Assignee
Intel Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corporation filed Critical Intel Corporation
Priority to PCT/CN2010/002130 priority Critical patent/WO2012083499A1/en
Priority to JP2013543483A priority patent/JP2014501460A/en
Priority to US13/997,013 priority patent/US9658769B2/en
Priority to CN2010800708725A priority patent/CN103262009A/en
Priority to KR1020137015434A priority patent/KR101496602B1/en
Priority to EP10861003.1A priority patent/EP2656184A4/en
Publication of WO2012083499A1 publication Critical patent/WO2012083499A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements

Definitions

  • the present invention is generally related to the field of keyboard designs. More particularly, the present invention is related to a new touch screen keyboard design for mobile devices. Description
  • MIDs mobile internet devices
  • PDAs Personal Digital Assistants
  • Such devices display a full touch screen keyboard having small buttons for each letter or a combination of several letters on one small button that requires an individual to touch the button several times until the appropriate letter appears. This requires one to move their fingers carefully to touch the correct button to input a letter.
  • FIG. 1 illustrates a conventional mobile device.
  • FIG. 2 illustrates a definition of the ⁇ , ⁇ , ⁇ axis of a mobile device according to an embodiment of the present invention.
  • FIGs. 3A and 3B illustrate exemplary right and left virtual keyboard layouts according to embodiments of the present invention.
  • FIG. 4 is a flow diagram describing an exemplary method for changing a display of a touch screen virtual keyboard layout on a mobile device according to an embodiment of the present invention.
  • FIG. 5 illustrates a definition of the ⁇ , ⁇ , ⁇ axis of a mobile device according to an embodiment of the present invention.
  • FIGs. 6 A, 6B, and 6C are exemplary illustrations of a mobile device in a non- rotational position and two rotational positions, respectively.
  • FIGs. 7 A and 7B are exemplary illustrations of a mobile device being rotated about the Y-axis according to embodiments of the present invention.
  • FIG. 8 is a flow diagram describing an exemplary method for changing a display of a touch screen virtual keyboard layout on a mobile device according to an embodiment of the present invention.
  • FIG. 9 is a block diagram illustrating a mobile device directed to an exemplary computer system in which certain aspects of embodiments of the present invention may be implemented.
  • Embodiments of the present invention are directed to methods, apparatuses, and articles of manufacture associated with a virtual touch screen keyboard for a mobile device that changes the keyboard layout based on the movement of the mobile device.
  • virtual touch screen keyboard layouts provide larger key displays by only displaying a portion of a full keyboard at any given time.
  • a sensor may be used to detect the movement of the mobile device. The sensor provides a measurement indicative of the movement of the mobile device to the virtual touch screen keyboard. The virtual touch screen keyboard uses this measurement to determine whether a positive or a negative change in the position of the mobile device has occurred. When a pre-defined positive change in the position of the mobile device occurs, a first virtual keyboard layout may be displayed.
  • a second virtual keyboard layout may be displayed.
  • the first virtual keyboard layout may be the right portion of the virtual keyboard and the second virtual keyboard layout may be the left portion of the virtual keyboard.
  • the first virtual keyboard layout may be the left portion of the virtual keyboard and the second virtual keyboard layout may be the right portion of the virtual keyboard.
  • a mobile device may have an accelerometer sensor (also referred to as a gravity sensor), and the accelerometer sensor may be used to detect the movement ⁇ i.e., acceleration) of the mobile device.
  • a mobile device may have a tilt sensor or a rotation sensor, and the tilt sensor or the rotation sensor may be used to detect the movement ⁇ i.e., tilt or rotation angle) of the mobile device.
  • the present invention is described using an accelerometer, gravity sensor, tilt sensor, or rotation sensor, the invention is not limited to these devices.
  • One skilled in the relevant art(s) would know that other types of devices that are capable of detecting the movement, i.e., acceleration/tilt angle/rotation angle/etc, of the mobile device may be used as well.
  • Embodiments of the present invention are described as providing two virtual keyboard layouts for one virtual touch screen keyboard.
  • the present invention is not limited to two virtual keyboard layouts for one virtual touch screen keyboard, One skilled in the relevant art(s) would know that more than two virtual keyboard layouts may be implemented by defining additional pre-defined positions of the mobile device for each layout.
  • embodiments of the present invention are described showing exemplary virtual keyboard layouts.
  • the present invention is also not limited to the keyboard layouts presented.
  • each key may represent two letters, but only one of the letters is displayed based on the movement of the mobile device.
  • apparatuses may be endowed with hardware and/or software configured to practice one or more aspects of the above described embodiments of the methods of the present invention.
  • an article of manufacture with a tangible, non-transitory computer-readable storage medium may be provided with programming instructions configured to cause a processor of the apparatus, in response to the execution of the programming instructions by the processor, to practice one or more aspects of the above described embodiments of the methods of the present invention.
  • FIG. 1 illustrates a conventional mobile device 100.
  • Mobile device 100 may be a smart phone, a MID (mobile Internet device), or any other small form factor device.
  • Mobile device 100 is shown having a small screen 102 and displaying a conventional full touch screen keyboard 104 comprised of small buttons 106 as an input device.
  • a user To input a letter, a user must move his or her finger very carefully to exactly touch the small button indicating the letter, making the input experience inconvenient and frustrating for the user.
  • Embodiments of the present invention take advantage of accelerometers and other sensors, such as, for example, a tilt sensor, a rotation sensor, or any other sensor providing a measurement indicative of a position, currently found in mobile devices to provide a virtual touch screen keyboard that displays a first portion of the virtual touch screen keyboard when the accelerometer/tilt sensor detects a predefined first acceleration/tilt angle position of the mobile device and displays a second portion of the virtual touch screen keyboard when the accelerometer/tilt sensor detects a predefined second acceleration/tilt angle position of the mobile device.
  • the virtual keyboard of a touch screen mobile device may change its keyboard layout by detecting a change in the position of the mobile device. By splitting the keyboard into at least two keyboard layouts, the area of each key in the virtual keyboard layout may be enlarged or at least doubled.
  • FIG. 2 illustrates a definition of the ⁇ , ⁇ , ⁇ axis of a mobile device 200 according to an embodiment of the present invention.
  • Mobile device 200 includes an accelerometer (not explicitly shown).
  • an ⁇ , ⁇ , ⁇ coordinate system is placed on top of the mobile device 200.
  • the origin of the ⁇ , ⁇ , ⁇ coordinate system is where an X-axis 202, a Y-axis 204, and a Z-axis 206 all meet.
  • the X-axis 202 is shown along the width of the mobile device 200.
  • the Y-axis 204 is shown along the length of the mobile device 200.
  • the Z-axis 206 is shown along the depth of the mobile device 200.
  • the mobile device 200 will return an acceleration of the device in a direction in which the device has moved in the ⁇ , ⁇ , ⁇ axes, represented using triples ( ⁇ , ⁇ , ⁇ ). For example, an acceleration of (2,0,0) indicates an acceleration of 2 in the X-axis direction and no or zero (0) acceleration in the direction of the Y and Z axes.
  • a mobile device having an accelerometer may change the virtual touch screen keyboard display when an absolute value of the acceleration of the mobile device 200 in the X- axis direction exceeds a pre- defined value (X-Acc).
  • This pre-defined value (X-Acc) may be set as part of an initial setup process for the mobile device 200.
  • the pre-defined value (X-Acc) may be set by the manufacturer of the mobile device as the actual X-Acc value or as a default value.
  • the user of the mobile device may set the predefined value (X-Acc). In such an instance, the user may have the ability to set the X-Acc value during an initial set-up of the mobile device 200 as well as the ability to change the setting of the X-Acc value at any time thereafter.
  • the virtual keyboard layout may be designed in two parts, with both parts comprising the full virtual keyboard.
  • the portion of the virtual keyboard to be initially displayed may be the virtual keyboard layout that was previously displayed.
  • the portion of the virtual keyboard to be initially displayed may be the right side of the virtual keyboard.
  • the left side of the virtual keyboard may be initially displayed.
  • FIG. 3A shows one exemplary virtual keyboard 300 comprising two virtual keyboard layouts according to an embodiment of the present invention.
  • Exemplary virtual keyboard 300 includes a left virtual keyboard layout 302 and a right virtual keyboard layout 304.
  • the left virtual keyboard layout 302 is substantially similar to the left side of a conventional keyboard and the right virtual keyboard layout 304 is substantially similar to right side of a conventional keyboard.
  • the virtual keyboard 300 of FIG. 3A is similar to a conventional keyboard that has been divided down the middle.
  • the Shift, Back, Space, and Enter keys are common to both the left (302) and the right (304) virtual keyboard layouts.
  • FIG. 3B shows another exemplary virtual keyboard 305 according to an embodiment of the present invention.
  • Exemplary virtual keyboard 305 includes a left virtual keyboard layout 306 and a right virtual keyboard layout 308.
  • the left (306) and right (308) virtual keyboard layouts shown in FIG. 3B provide a different keyboard layout from a conventional keyboard.
  • all odd number keys are displayed on a left virtual keyboard layout 306 and all even number keys are displayed on a right virtual keyboard layout 308.
  • Each column of keys shown is substantially similar to those of a conventional keyboard having the number key at the top of the column.
  • the Shift, Back, Space, and Enter keys are common to both the left (306) and the right (308) virtual keyboards.
  • the virtual keyboard layouts 302, 304, and 306, 308 are shown as examples. Embodiments of the present invention are not limited to these examples. One skilled in the relevant art(s) would know that other virtual keyboard layouts may be used without departing from the scope of the present invention.
  • another virtual keyboard layout may be to have each key represent two characters, with one character being displayed for each key when the left virtual keyboard layout is to be displayed and the other character being displayed for each key when the right virtual keyboard layout is to be displayed.
  • multiple virtual keyboard layouts may be used, wherein a user of the mobile device 200 may select the virtual keyboard layout that best suits the user.
  • more than two virtual keyboard layouts may be used to represent a full keyboard. In this instance, more than one pre-defined value (such as, for example, Xl -Acc, X2-Acc, etc.) may be used, depending on the number of virtual keyboard layouts that comprise one complete virtual keyboard.
  • embodiments of the present invention provide a virtual touch screen keyboard layout that provides larger key displays by displaying a portion of a virtual keyboard at any given time.
  • the portion of the virtual keyboard that is displayed may be based on the acceleration of the mobile device.
  • a first portion of the virtual keyboard is displayed to allow the user to begin inputting data ⁇ i.e., characters).
  • the user To display a second portion of the virtual keyboard, the user must tilt or move (accelerate) the mobile device by an amount in which the absolute value of that amount exceeds a pre-defined acceleration value in the X axis direction (X- Acc). For example, a first portion of a virtual touch screen keyboard is being displayed.
  • the mobile device may be tilted or moved, causing the keyboard interface to obtain current readings of the acceleration of the mobile device.
  • the user wants or needs the second portion of the virtual touch screen keyboard to be displayed in order to type characters from the second portion of the virtual touch screen keyboard, the user must tilt/move the mobile device in a manner that provides a large enough acceleration value in the +X or -X direction to cause the virtual keyboard to change the keyboard display from the first portion of the virtual touch screen keyboard to a second portion of the virtual touch screen keyboard.
  • the virtual keyboard layout will be changed to display the second portion of the virtual touch screen keyboard.
  • the user may tilt the mobile device far enough to the left to have the left portion of the virtual keyboard displayed so the user may type the characters "d-e-”. The user may then tilt the mobile device far enough to the right to have the right portion of the virtual keyboard displayed to type the characters "v-i”. Then the user may tilt the mobile device far enough back to the left to have the left portion of the virtual keyboard displayed to type the characters "c-e" to complete the word "device”.
  • FIG. 4 is a flow diagram 400 describing an exemplary method for changing a display of a touch screen virtual keyboard layout on a mobile device according to an embodiment of the present invention.
  • the invention is not limited to the embodiment described herein with respect to flow diagram 400. Rather ⁇ it will be apparent to persons skilled in the relevant art(s) after reading the teachings provided herein that other functional flow diagrams are within the scope of the invention.
  • the process begins with block 402, where the process immediately proceeds to block 404.
  • a left or right portion of a virtual keyboard layout is displayed.
  • the virtual keyboard layout displayed is the same portion of a virtual keyboard that was previously or lastly displayed by the mobile device.
  • the virtual keyboard layout displayed is the left portion of a virtual keyboard.
  • the right portion of a virtual keyboard is displayed. The process then proceeds to block 406.
  • the process remains at block 406 until a movement with the mobile device occurs.
  • the process proceeds to block 408.
  • the movement may include the user tilting the mobile device as well as moving the device mobile device.
  • movement of the device triggers the virtual keyboard of the mobile device to obtain a current acceleration measurement from the accelerometer of the mobile device. The process then proceeds to decision block 410.
  • decision block 410 it is determined whether the absolute value of the current X acceleration measurement of the ( ⁇ , ⁇ , ⁇ ) acceleration measurement is larger than the pre-defined value of X-Acc. If the absolute value of the X acceleration measurement is larger than the pre-defined value of X-Acc, then the process proceeds to decision block 412.
  • decision block 412 it is determined whether the X acceleration measurement is positive. If the X acceleration measurement is positive, the right portion of the virtual keyboard is displayed. The user is now allowed to input characters displayed on the right portion of the virtual keyboard. The process then proceeds back to block 406 where it remains until another movement of the mobile device is made.
  • a mobile device may include a tilt sensor or a rotation sensor.
  • the tilt sensor or the rotation sensor may also be used to implement embodiments of the present invention.
  • a tilt sensor or a rotation sensor in a mobile device may detect the tilt or rotation angle (in degrees) by which a user of the mobile device has tilted or rotated the mobile device.
  • the absolute value of a tilt angle or rotation angle that exceeds a pre-determined tilt or rotation angle value may cause the virtual touch screen keyboard layout to be changed.
  • FIG. 5 illustrates a definition of the ⁇ , ⁇ , ⁇ axis of a mobile device 500 according to an embodiment of the present invention.
  • FIG. 5 is similar to FIG. 2 except the mobile device of FIG. 5 includes a tilt or rotation sensor (not explicitly shown).
  • an ⁇ , ⁇ , ⁇ coordinate system is placed on top of the mobile device 500.
  • the origin of the ⁇ , ⁇ , ⁇ coordinate system is where an X-axis 502, a Y-axis 504, and a Z- axis 506 all meet.
  • the X-axis 502 is shown along the width of the mobile device 500.
  • the Y-axis 504 is shown along the length of the mobile device 500.
  • the Z-axis 506 is shown along the depth of the mobile device 500.
  • the ⁇ , ⁇ , ⁇ axes, as shown in FIG. 5, represent the relative location of the mobile device 500.
  • the mobile device 500 includes one of a tilt sensor (not explicitly shown) or a rotation sensor (not explicitly shown)
  • the mobile device 500 is capable of providing a tilt angle or rotation angle, respectively, in the direction in which the mobile device has been tilted or rotated, respectively, represented by a triple (XRotation, YRotation, ZRotation).
  • XRotation, YRotation,ZRotation represents the angles measured, starting from the x-axis, y-axis, z-axis, respectively.
  • the values of XRotation, YRotation, ZRotation range from -180 to 180 degrees.
  • FIGs. 6A, 6B, and 6C are exemplary illustrations of mobile device 500 in a non-rotational position and two rotational positions, respectively.
  • FIG. 6A illustrates a mobile device 500 in which the rotation angle, represented by a triple (0,0,0), is zero. In other words, the XRotation, YRotation, and ZRotation values are all zero, indicating that the mobile device 500 has not been rotated or tilted in any direction.
  • FIG. 6B illustrates a mobile device 500 in which the rotation angle, represented by a triple (90,0,0) has been rotated or tilted 90 degrees in the X-axis only. As shown in FIG.
  • FIG. 6C illustrates a mobile device 500 in which the rotation angle, represented by a triple (90,0,90), has been rotated or tilted 90 degrees in both the X-axis and the Z-axis.
  • rotating the ZRotation (along with the XRotation) also does not provide a convenient method for inputting characters and changing the keyboard layout.
  • the rotation of mobile device 500 about the X-axis or the Z-axis does not provide a convenient method of inputting characters from a virtual keyboard while having the ability to change the virtual keyboard display based on the rotation angle.
  • FIGs. 7 A and 7B are exemplary illustrations of mobile device 500 being rotated about the Y-axis according to embodiments of the present invention.
  • rotating the mobile device about the Y-axis provides a convenient method of inputting characters from a virtual keyboard while rotating the mobile device 500 to effect a change in the virtual keyboard display.
  • the rotation angle of mobile device 500 shown as triple (0,-30,0)
  • the rotation angle of mobile device 500 shown as triple (0,30,0)
  • the rotation angle of mobile device 500, shown as triple (0,30,0) is 30 degrees for the Y-axis only.
  • the X-axis and the Z-axis are zero.
  • a rotation of the mobile device 500 about the Y-axis that results in a negative YRotation value may display the left portion of the virtual touch screen keyboard and a rotation of the mobile device 500 about the Y-axis that results in a positive YRotation value may display the right portion of the virtual touch screen keyboard.
  • a mobile device having a tilt or rotation sensor may change the virtual keyboard display when an absolute value of the tilt or rotation of the mobile device 500 about the Y-axis (YRotation of (XRotation,YRotation,ZRotation)) exceeds a pre-defined value (YRotation Pre).
  • This pre-defined value (YRotation Pre) may be set as part of an initial set-up process for the mobile device 500.
  • the pre-defined value (YRotation Pre) may be set by the manufacturer of the mobile device 500 as the actual YRotation Pre value or as a default value.
  • the user of the mobile device 500 may set the predefined value (YRotation_Pre). In such an instance, the user may have the ability to set the YRotation_Pre value during an initial set-up of the mobile device 500 as well as the ability to change the setting of the YRotationJPre value at any time thereafter.
  • FIG. 8 is a flow diagram 800 describing an exemplary method for changing a display of a touch screen virtual keyboard layout on a mobile device according to an embodiment of the present invention.
  • the invention is not limited to the embodiment described herein with respect to flow diagram 800. Rather, it will be apparent to persons skilled in the relevant art(s) after reading the teachings provided herein that other functional flow diagrams are within the scope of the invention.
  • the process begins with block 802, where the process immediately proceeds to block 804.
  • a left or right portion of a virtual keyboard layout is displayed.
  • the virtual keyboard layout displayed is the same portion of a virtual keyboard that was previously or lastly displayed by the mobile device.
  • the virtual keyboard layout displayed by the mobile device is the left portion of a virtual keyboard.
  • the right portion of a virtual keyboard is displayed. The process then proceeds to block 806.
  • the process remains at block 806 until a movement with the mobile device occurs.
  • the process proceeds to block 808.
  • the movement may include the user tilting or rotating the mobile device about the Y-axis.
  • movement of the mobile device triggers the virtual keyboard of the mobile device to obtain a current tilt or rotation angle measurement from the tilt or rotation sensor of the mobile device. The process then proceeds to decision block 810.
  • decision block 810 it is determined whether the absolute value of the current YRotation measurement in the tilt/rotation measurement value (XRotation,YRotation,ZRotation) from the tilt/rotation sensor is larger than the predefined value YRotation Pre. If the absolute value of the YRotation from the (XRotation,YRotation,ZRotation) tilt/rotation measurement is larger than the pre-defined value of YRotation Pre, then the process proceeds to decision block 812.
  • decision block 812 it is determined whether the YRotation measurement value is positive. If the YRotation measurement value is positive, the right portion of the virtual keyboard (a right portion keyboard layout) is displayed. The user is now allowed to input characters displayed on the right portion of the virtual keyboard. The process then proceeds back to block 806 where the process remains until another movement of the mobile device is detected.
  • the left portion of the virtual keyboard (a left portion keyboard layout) is displayed. The user is now allowed to input characters displayed on the left portion of the virtual keyboard. The process then proceeds back to block 806, where the process remains until another movement of the mobile device is detected.
  • Embodiments of the present invention may be implemented using hardware, software, or a combination thereof and may be implemented in a mobile device, such as mobile devices 200 or 500, directed toward one or more computer systems capable of carrying out the functionality described here.
  • a mobile device such as mobile devices 200 or 500
  • An example implementation of a computer system 900 for a mobile device is shown in FIG. 9.
  • Various embodiments of mobile devices 200 or 500 are described in terms of this exemplary computer system 900. After reading this description, it will be apparent to a person skilled in the relevant art how to implement the invention using other computer systems and/or computer architectures for mobile devices 200 or 500.
  • Computer system 900 includes one or more processors or processor cores 902, and system memory 904.
  • processors or processor cores 902 For the purpose of this application, including the claims, the terms “Processor” and “processor cores” may be considered synonymous, unless the context clearly requires otherwise.
  • computing system 900 includes mass storage devices 906 (such as a diskette, hard drive, compact disc read only memory (CDROM) and so forth), input/output devices 908 (such as a display, virtual touch screen keyboard, cursor control, and so forth), sensors 910 (such as an accelerometer, tilt sensor, rotation sensor and so forth), and communication interfaces 912 (such as network interface cards and so forth).
  • the elements are coupled to each other via system bus 914, which represents one or more buses. In the case of multiple buses, they are bridged by one or more bus bridges (not shown).
  • system memory 904 and mass storage 906 may be employed to store a working copy and a permanent copy of the programming instructions (922) implementing the various components of the present invention.
  • the various components may be implemented by assembler instructions supported by processor(s) 902 or high-level languages, such as, for example, C, that can be compiled into such instructions.
  • the permanent copy of the programming instructions may be placed into permanent storage 906 in the factory, or in the field, through, for example, a distribution medium (not shown), such as a compact disc (CD), or through communication interface 912 (from a distribution server (not shown)).
  • a distribution medium such as a compact disc (CD)
  • CD compact disc
  • communication interface 912 from a distribution server (not shown)
  • the virtual keyboard of input/output devices 908 includes an interface (not shown) that communicates with sensors 910 to obtain the position of mobile device 200, 500 as described above.

Abstract

Methods, apparatuses, and articles of manufacture for a virtual touch screen keyboard. The method includes waiting for a movement of a mobile device. Upon movement of the device, the keyboard receives a measurement representing a position of the device from a sensor of the device. The keyboard determines whether an absolute value of the received measurement is greater than a pre-defined value. If the absolute value of the received measurement is greater than the pre-defined value, and the received measurement is negative, the keyboard displays a first portion of the virtual touch screen keyboard. If the absolute value of the received measurement is greater than the pre- defined value, and the received measurement is positive, the keyboard displays a second portion of the virtual touch screen keyboard. The first portion and the second portion of the virtual touch screen keyboard provide keys that are at least double in size to the keys provided on a conventional touch screen keyboard.

Description

A NEW TOUCH SCREEN KEYBOARD DESIGN FOR MOBILE DEVICES
BACKGROUND OF THE INVENTION
Field of the Invention
The present invention is generally related to the field of keyboard designs. More particularly, the present invention is related to a new touch screen keyboard design for mobile devices. Description
Many mobile devices, such as, but not limited to, smart phones, mobile internet devices (MIDs), Personal Digital Assistants (PDAs), etc. have small displays without having external keyboards. Such devices display a full touch screen keyboard having small buttons for each letter or a combination of several letters on one small button that requires an individual to touch the button several times until the appropriate letter appears. This requires one to move their fingers carefully to touch the correct button to input a letter.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are incorporated herein and form part of the specification, illustrate embodiments of the present invention and, together with the description, further serve to explain the principles of the invention and to enable a person skilled in the pertinent art(s) to make and use the invention. In the drawings, like reference numbers generally indicate identical, functionally similar, and/or structurally similar elements. The drawing in which an element first appears is indicated by the leftmost digit(s) in the corresponding reference number.
FIG. 1 illustrates a conventional mobile device.
FIG. 2 illustrates a definition of the Χ,Υ,Ζ axis of a mobile device according to an embodiment of the present invention.
FIGs. 3A and 3B illustrate exemplary right and left virtual keyboard layouts according to embodiments of the present invention.
FIG. 4 is a flow diagram describing an exemplary method for changing a display of a touch screen virtual keyboard layout on a mobile device according to an embodiment of the present invention.
FIG. 5 illustrates a definition of the Χ,Υ,Ζ axis of a mobile device according to an embodiment of the present invention.
FIGs. 6 A, 6B, and 6C are exemplary illustrations of a mobile device in a non- rotational position and two rotational positions, respectively.
FIGs. 7 A and 7B are exemplary illustrations of a mobile device being rotated about the Y-axis according to embodiments of the present invention.
FIG. 8 is a flow diagram describing an exemplary method for changing a display of a touch screen virtual keyboard layout on a mobile device according to an embodiment of the present invention.
FIG. 9 is a block diagram illustrating a mobile device directed to an exemplary computer system in which certain aspects of embodiments of the present invention may be implemented. DETAILED DESCRIPTION
While the present invention is described herein with reference to illustrative embodiments for particular applications, it should be understood that the invention is not limited thereto. Those skilled in the relevant art(s) with access to the teachings provided herein will recognize additional modifications, applications, and embodiments within the scope thereof and additional fields in which embodiments of the present invention would be of significant utility.
Reference in the specification to "one embodiment", "an embodiment" or "another embodiment" of the present invention means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrase "in one embodiment" appearing in various places throughout the specification are not necessarily all referring to the same embodiment.
Embodiments of the present invention are directed to methods, apparatuses, and articles of manufacture associated with a virtual touch screen keyboard for a mobile device that changes the keyboard layout based on the movement of the mobile device. In embodiments of the present invention, virtual touch screen keyboard layouts provide larger key displays by only displaying a portion of a full keyboard at any given time. In embodiments of the present invention, a sensor may be used to detect the movement of the mobile device. The sensor provides a measurement indicative of the movement of the mobile device to the virtual touch screen keyboard. The virtual touch screen keyboard uses this measurement to determine whether a positive or a negative change in the position of the mobile device has occurred. When a pre-defined positive change in the position of the mobile device occurs, a first virtual keyboard layout may be displayed. When predefined negative change in the position of the mobile device occurs, a second virtual keyboard layout may be displayed. In one embodiment, the first virtual keyboard layout may be the right portion of the virtual keyboard and the second virtual keyboard layout may be the left portion of the virtual keyboard. In an alternative embodiment, the first virtual keyboard layout may be the left portion of the virtual keyboard and the second virtual keyboard layout may be the right portion of the virtual keyboard. Thus, as a user is typing input characters into the mobile device, the virtual touch screen keyboard may receive a measurement from the sensor that is indicative of a change in the position of the mobile device, and if that change in position requires a different virtual keyboard layout, the virtual keyboard will change the virtual keyboard layout accordingly.
In one embodiment, a mobile device may have an accelerometer sensor (also referred to as a gravity sensor), and the accelerometer sensor may be used to detect the movement {i.e., acceleration) of the mobile device. In another embodiment, a mobile device may have a tilt sensor or a rotation sensor, and the tilt sensor or the rotation sensor may be used to detect the movement {i.e., tilt or rotation angle) of the mobile device. Although the present invention is described using an accelerometer, gravity sensor, tilt sensor, or rotation sensor, the invention is not limited to these devices. One skilled in the relevant art(s) would know that other types of devices that are capable of detecting the movement, i.e., acceleration/tilt angle/rotation angle/etc, of the mobile device may be used as well.
Embodiments of the present invention are described as providing two virtual keyboard layouts for one virtual touch screen keyboard. The present invention is not limited to two virtual keyboard layouts for one virtual touch screen keyboard, One skilled in the relevant art(s) would know that more than two virtual keyboard layouts may be implemented by defining additional pre-defined positions of the mobile device for each layout. Also, embodiments of the present invention are described showing exemplary virtual keyboard layouts. The present invention is also not limited to the keyboard layouts presented. One skilled in the relevant art(s) would know that other keyboard layouts may be used without departing from the scope of the present invention. For example, in one keyboard layout, each key may represent two letters, but only one of the letters is displayed based on the movement of the mobile device.
In various embodiments, apparatuses may be endowed with hardware and/or software configured to practice one or more aspects of the above described embodiments of the methods of the present invention. In various embodiments, an article of manufacture with a tangible, non-transitory computer-readable storage medium may be provided with programming instructions configured to cause a processor of the apparatus, in response to the execution of the programming instructions by the processor, to practice one or more aspects of the above described embodiments of the methods of the present invention.
FIG. 1 illustrates a conventional mobile device 100. Mobile device 100 may be a smart phone, a MID (mobile Internet device), or any other small form factor device. Mobile device 100 is shown having a small screen 102 and displaying a conventional full touch screen keyboard 104 comprised of small buttons 106 as an input device. To input a letter, a user must move his or her finger very carefully to exactly touch the small button indicating the letter, making the input experience inconvenient and frustrating for the user.
Embodiments of the present invention take advantage of accelerometers and other sensors, such as, for example, a tilt sensor, a rotation sensor, or any other sensor providing a measurement indicative of a position, currently found in mobile devices to provide a virtual touch screen keyboard that displays a first portion of the virtual touch screen keyboard when the accelerometer/tilt sensor detects a predefined first acceleration/tilt angle position of the mobile device and displays a second portion of the virtual touch screen keyboard when the accelerometer/tilt sensor detects a predefined second acceleration/tilt angle position of the mobile device. In other words, the virtual keyboard of a touch screen mobile device may change its keyboard layout by detecting a change in the position of the mobile device. By splitting the keyboard into at least two keyboard layouts, the area of each key in the virtual keyboard layout may be enlarged or at least doubled.
FIG. 2 illustrates a definition of the Χ,Υ,Ζ axis of a mobile device 200 according to an embodiment of the present invention. Mobile device 200 includes an accelerometer (not explicitly shown). As shown in FIG. 2, an Χ,Υ,Ζ coordinate system is placed on top of the mobile device 200. The origin of the Χ,Υ,Ζ coordinate system is where an X-axis 202, a Y-axis 204, and a Z-axis 206 all meet. The X-axis 202 is shown along the width of the mobile device 200. The Y-axis 204 is shown along the length of the mobile device 200. The Z-axis 206 is shown along the depth of the mobile device 200. The Χ,Υ,Ζ axes, as shown in FIG. 2, represent the relative location of the mobile device 200. In an embodiment of the present invention in which mobile device 200 includes an accelerometer (not explicitly shown), the mobile device 200 will return an acceleration of the device in a direction in which the device has moved in the Χ,Υ,Ζ axes, represented using triples (Χ,Υ,Ζ). For example, an acceleration of (2,0,0) indicates an acceleration of 2 in the X-axis direction and no or zero (0) acceleration in the direction of the Y and Z axes.
In one embodiment of the present invention, a mobile device having an accelerometer may change the virtual touch screen keyboard display when an absolute value of the acceleration of the mobile device 200 in the X- axis direction exceeds a pre- defined value (X-Acc). This pre-defined value (X-Acc) may be set as part of an initial setup process for the mobile device 200. In one embodiment, the pre-defined value (X-Acc) may be set by the manufacturer of the mobile device as the actual X-Acc value or as a default value. In another embodiment, the user of the mobile device may set the predefined value (X-Acc). In such an instance, the user may have the ability to set the X-Acc value during an initial set-up of the mobile device 200 as well as the ability to change the setting of the X-Acc value at any time thereafter.
In one embodiment of the present invention, the virtual keyboard layout may be designed in two parts, with both parts comprising the full virtual keyboard. In one embodiment, the portion of the virtual keyboard to be initially displayed may be the virtual keyboard layout that was previously displayed. In another embodiment, the portion of the virtual keyboard to be initially displayed may be the right side of the virtual keyboard. In yet another embodiment, the left side of the virtual keyboard may be initially displayed.
Exemplary right and left virtual keyboard layouts 300 and 305 according to embodiments of the present invention are shown in FIGs. 3A and 3B. FIG. 3A shows one exemplary virtual keyboard 300 comprising two virtual keyboard layouts according to an embodiment of the present invention. Exemplary virtual keyboard 300 includes a left virtual keyboard layout 302 and a right virtual keyboard layout 304. The left virtual keyboard layout 302 is substantially similar to the left side of a conventional keyboard and the right virtual keyboard layout 304 is substantially similar to right side of a conventional keyboard. In other words, the virtual keyboard 300 of FIG. 3A is similar to a conventional keyboard that has been divided down the middle. The Shift, Back, Space, and Enter keys are common to both the left (302) and the right (304) virtual keyboard layouts.
FIG. 3B shows another exemplary virtual keyboard 305 according to an embodiment of the present invention. Exemplary virtual keyboard 305 includes a left virtual keyboard layout 306 and a right virtual keyboard layout 308. The left (306) and right (308) virtual keyboard layouts shown in FIG. 3B provide a different keyboard layout from a conventional keyboard. Here, all odd number keys are displayed on a left virtual keyboard layout 306 and all even number keys are displayed on a right virtual keyboard layout 308. Each column of keys shown is substantially similar to those of a conventional keyboard having the number key at the top of the column. Again, the Shift, Back, Space, and Enter keys are common to both the left (306) and the right (308) virtual keyboards.
Note that the virtual keyboard layouts 302, 304, and 306, 308 are shown as examples. Embodiments of the present invention are not limited to these examples. One skilled in the relevant art(s) would know that other virtual keyboard layouts may be used without departing from the scope of the present invention. As previously indicated, another virtual keyboard layout may be to have each key represent two characters, with one character being displayed for each key when the left virtual keyboard layout is to be displayed and the other character being displayed for each key when the right virtual keyboard layout is to be displayed. In other embodiments, multiple virtual keyboard layouts may be used, wherein a user of the mobile device 200 may select the virtual keyboard layout that best suits the user. In other embodiments of the present invention, more than two virtual keyboard layouts may be used to represent a full keyboard. In this instance, more than one pre-defined value (such as, for example, Xl -Acc, X2-Acc, etc.) may be used, depending on the number of virtual keyboard layouts that comprise one complete virtual keyboard.
As previously indicated, embodiments of the present invention provide a virtual touch screen keyboard layout that provides larger key displays by displaying a portion of a virtual keyboard at any given time. In one embodiment, the portion of the virtual keyboard that is displayed may be based on the acceleration of the mobile device. When an application that requires input data from a keyboard is selected by a user of the mobile device, a first portion of the virtual keyboard is displayed to allow the user to begin inputting data {i.e., characters). To display a second portion of the virtual keyboard, the user must tilt or move (accelerate) the mobile device by an amount in which the absolute value of that amount exceeds a pre-defined acceleration value in the X axis direction (X- Acc). For example, a first portion of a virtual touch screen keyboard is being displayed. As a user is typing characters from the first portion of the virtual touch screen keyboard, the mobile device may be tilted or moved, causing the keyboard interface to obtain current readings of the acceleration of the mobile device. When the user wants or needs the second portion of the virtual touch screen keyboard to be displayed in order to type characters from the second portion of the virtual touch screen keyboard, the user must tilt/move the mobile device in a manner that provides a large enough acceleration value in the +X or -X direction to cause the virtual keyboard to change the keyboard display from the first portion of the virtual touch screen keyboard to a second portion of the virtual touch screen keyboard. Thus, based on an absolute value of an acceleration measurement in the X-axis direction that exceeds the pre-defined value of X-Acc, the virtual keyboard layout will be changed to display the second portion of the virtual touch screen keyboard.
Using the virtual touch screen keyboard layout shown in FIG. 3 A or FIG. 3B, if the user wants to type the word "d-e-v-i-c-e", the user may tilt the mobile device far enough to the left to have the left portion of the virtual keyboard displayed so the user may type the characters "d-e-". The user may then tilt the mobile device far enough to the right to have the right portion of the virtual keyboard displayed to type the characters "v-i". Then the user may tilt the mobile device far enough back to the left to have the left portion of the virtual keyboard displayed to type the characters "c-e" to complete the word "device".
FIG. 4 is a flow diagram 400 describing an exemplary method for changing a display of a touch screen virtual keyboard layout on a mobile device according to an embodiment of the present invention. The invention is not limited to the embodiment described herein with respect to flow diagram 400. Rather^ it will be apparent to persons skilled in the relevant art(s) after reading the teachings provided herein that other functional flow diagrams are within the scope of the invention. The process begins with block 402, where the process immediately proceeds to block 404.
In block 404, upon the selection of an application requiring a keyboard by the user, a left or right portion of a virtual keyboard layout is displayed. In one embodiment, the virtual keyboard layout displayed is the same portion of a virtual keyboard that was previously or lastly displayed by the mobile device. In another embodiment, the virtual keyboard layout displayed is the left portion of a virtual keyboard. In yet another embodiment of the present invention, the right portion of a virtual keyboard is displayed. The process then proceeds to block 406.
In block 406, the process remains at block 406 until a movement with the mobile device occurs. Upon a movement of the mobile device, the process proceeds to block 408. The movement may include the user tilting the mobile device as well as moving the device mobile device.
In block 408, movement of the device triggers the virtual keyboard of the mobile device to obtain a current acceleration measurement from the accelerometer of the mobile device. The process then proceeds to decision block 410.
In decision block 410, it is determined whether the absolute value of the current X acceleration measurement of the (Χ,Υ,Ζ) acceleration measurement is larger than the pre-defined value of X-Acc. If the absolute value of the X acceleration measurement is larger than the pre-defined value of X-Acc, then the process proceeds to decision block 412.
In decision block 412, it is determined whether the X acceleration measurement is positive. If the X acceleration measurement is positive, the right portion of the virtual keyboard is displayed. The user is now allowed to input characters displayed on the right portion of the virtual keyboard. The process then proceeds back to block 406 where it remains until another movement of the mobile device is made.
Returning to decision block 412, if the X acceleration measurement is not positive (i.e. , negative), then the left portion of the virtual keyboard is displayed. The user is now allowed to input characters displayed on the left portion of the virtual keyboard. The process then proceeds back to block 406, where the process remains until another movement of the mobile device is made.
Returning to decision block 410, if it is determined that the absolute value of the X acceleration measurement is not larger than the pre-defined value of X-Acc, then the movement is not large enough, and the virtual keyboard layout is not changed. The process then proceeds back to block 406, where the process remains until another movement of the mobile device is made.
As previously indicated, other embodiments of a mobile device may include a tilt sensor or a rotation sensor. The tilt sensor or the rotation sensor may also be used to implement embodiments of the present invention. In one embodiment, a tilt sensor or a rotation sensor in a mobile device may detect the tilt or rotation angle (in degrees) by which a user of the mobile device has tilted or rotated the mobile device. In embodiments implementing the tilt sensor or the rotation sensor, the absolute value of a tilt angle or rotation angle that exceeds a pre-determined tilt or rotation angle value may cause the virtual touch screen keyboard layout to be changed.
FIG. 5 illustrates a definition of the Χ,Υ,Ζ axis of a mobile device 500 according to an embodiment of the present invention. FIG. 5 is similar to FIG. 2 except the mobile device of FIG. 5 includes a tilt or rotation sensor (not explicitly shown). As shown in FIG. 5, an Χ,Υ,Ζ coordinate system is placed on top of the mobile device 500. The origin of the Χ,Υ,Ζ coordinate system is where an X-axis 502, a Y-axis 504, and a Z- axis 506 all meet. The X-axis 502 is shown along the width of the mobile device 500. The Y-axis 504 is shown along the length of the mobile device 500. The Z-axis 506 is shown along the depth of the mobile device 500. The Χ,Υ,Ζ axes, as shown in FIG. 5, represent the relative location of the mobile device 500. In an embodiment of the present invention in which the mobile device 500 includes one of a tilt sensor (not explicitly shown) or a rotation sensor (not explicitly shown), the mobile device 500 is capable of providing a tilt angle or rotation angle, respectively, in the direction in which the mobile device has been tilted or rotated, respectively, represented by a triple (XRotation, YRotation, ZRotation). XRotation, YRotation,ZRotation represents the angles measured, starting from the x-axis, y-axis, z-axis, respectively. The values of XRotation, YRotation, ZRotation range from -180 to 180 degrees.
FIGs. 6A, 6B, and 6C are exemplary illustrations of mobile device 500 in a non-rotational position and two rotational positions, respectively. FIG. 6A illustrates a mobile device 500 in which the rotation angle, represented by a triple (0,0,0), is zero. In other words, the XRotation, YRotation, and ZRotation values are all zero, indicating that the mobile device 500 has not been rotated or tilted in any direction. FIG. 6B illustrates a mobile device 500 in which the rotation angle, represented by a triple (90,0,0) has been rotated or tilted 90 degrees in the X-axis only. As shown in FIG. 6B, rotating the XRotation value does not provide a convenient method for inputting characters and changing the keyboard layout. FIG. 6C illustrates a mobile device 500 in which the rotation angle, represented by a triple (90,0,90), has been rotated or tilted 90 degrees in both the X-axis and the Z-axis. As shown in FIG. 6C, rotating the ZRotation (along with the XRotation) also does not provide a convenient method for inputting characters and changing the keyboard layout. Thus, as can be seen from each of FIGs. 6 A, 6B, and 6C, the rotation of mobile device 500 about the X-axis or the Z-axis does not provide a convenient method of inputting characters from a virtual keyboard while having the ability to change the virtual keyboard display based on the rotation angle.
FIGs. 7 A and 7B are exemplary illustrations of mobile device 500 being rotated about the Y-axis according to embodiments of the present invention. As shown in FIGs. 7 A and 7B, rotating the mobile device about the Y-axis provides a convenient method of inputting characters from a virtual keyboard while rotating the mobile device 500 to effect a change in the virtual keyboard display. In FIG. 7 A, the rotation angle of mobile device 500, shown as triple (0,-30,0), is -30 degrees for the Y-axis only and in FIG. 7B, the rotation angle of mobile device 500, shown as triple (0,30,0), is 30 degrees for the Y-axis only. In other words, the X-axis and the Z-axis are zero. By using the rotation of the Y-axis (and ignoring the X-axis and the Z-axis), one can easily change the virtual touch screen keyboard layout based on a change in YRotation (the rotation of the Y-axis). A rotation of the mobile device 500 about the Y-axis that results in a negative YRotation value may display the left portion of the virtual touch screen keyboard and a rotation of the mobile device 500 about the Y-axis that results in a positive YRotation value may display the right portion of the virtual touch screen keyboard.
In one embodiment of the present invention, a mobile device having a tilt or rotation sensor may change the virtual keyboard display when an absolute value of the tilt or rotation of the mobile device 500 about the Y-axis (YRotation of (XRotation,YRotation,ZRotation)) exceeds a pre-defined value (YRotation Pre). This pre-defined value (YRotation Pre) may be set as part of an initial set-up process for the mobile device 500. In one embodiment, the pre-defined value (YRotation Pre) may be set by the manufacturer of the mobile device 500 as the actual YRotation Pre value or as a default value. In another embodiment, the user of the mobile device 500 may set the predefined value (YRotation_Pre). In such an instance, the user may have the ability to set the YRotation_Pre value during an initial set-up of the mobile device 500 as well as the ability to change the setting of the YRotationJPre value at any time thereafter.
FIG. 8 is a flow diagram 800 describing an exemplary method for changing a display of a touch screen virtual keyboard layout on a mobile device according to an embodiment of the present invention. The invention is not limited to the embodiment described herein with respect to flow diagram 800. Rather, it will be apparent to persons skilled in the relevant art(s) after reading the teachings provided herein that other functional flow diagrams are within the scope of the invention. The process begins with block 802, where the process immediately proceeds to block 804.
In block 804, upon the selection of an application requiring a keyboard by the user, a left or right portion of a virtual keyboard layout is displayed. In one embodiment, the virtual keyboard layout displayed is the same portion of a virtual keyboard that was previously or lastly displayed by the mobile device. In another embodiment, the virtual keyboard layout displayed by the mobile device is the left portion of a virtual keyboard. In yet another embodiment of the present invention, the right portion of a virtual keyboard is displayed. The process then proceeds to block 806.
In block 806, the process remains at block 806 until a movement with the mobile device occurs. Upon a movement of the mobile device, the process proceeds to block 808. The movement may include the user tilting or rotating the mobile device about the Y-axis.
In block 808, movement of the mobile device triggers the virtual keyboard of the mobile device to obtain a current tilt or rotation angle measurement from the tilt or rotation sensor of the mobile device. The process then proceeds to decision block 810.
In decision block 810, it is determined whether the absolute value of the current YRotation measurement in the tilt/rotation measurement value (XRotation,YRotation,ZRotation) from the tilt/rotation sensor is larger than the predefined value YRotation Pre. If the absolute value of the YRotation from the (XRotation,YRotation,ZRotation) tilt/rotation measurement is larger than the pre-defined value of YRotation Pre, then the process proceeds to decision block 812.
In decision block 812, it is determined whether the YRotation measurement value is positive. If the YRotation measurement value is positive, the right portion of the virtual keyboard (a right portion keyboard layout) is displayed. The user is now allowed to input characters displayed on the right portion of the virtual keyboard. The process then proceeds back to block 806 where the process remains until another movement of the mobile device is detected.
Returning to decision block 812, if the YRotation measurement value is not positive (i.e., negative), then the left portion of the virtual keyboard (a left portion keyboard layout) is displayed. The user is now allowed to input characters displayed on the left portion of the virtual keyboard. The process then proceeds back to block 806, where the process remains until another movement of the mobile device is detected.
Returning to decision block 810, if it is determined that the absolute value of the YRotation measurement is not larger than the pre-defined YRotation Pre value, then the movement is not large enough, and the virtual keyboard layout is not changed. The process then proceeds back to block 806 where the process remains until another movement of the mobile device is detected.
Embodiments of the present invention may be implemented using hardware, software, or a combination thereof and may be implemented in a mobile device, such as mobile devices 200 or 500, directed toward one or more computer systems capable of carrying out the functionality described here. An example implementation of a computer system 900 for a mobile device is shown in FIG. 9. Various embodiments of mobile devices 200 or 500 are described in terms of this exemplary computer system 900. After reading this description, it will be apparent to a person skilled in the relevant art how to implement the invention using other computer systems and/or computer architectures for mobile devices 200 or 500.
Computer system 900 includes one or more processors or processor cores 902, and system memory 904. For the purpose of this application, including the claims, the terms "Processor" and "processor cores" may be considered synonymous, unless the context clearly requires otherwise. Additionally, computing system 900 includes mass storage devices 906 (such as a diskette, hard drive, compact disc read only memory (CDROM) and so forth), input/output devices 908 (such as a display, virtual touch screen keyboard, cursor control, and so forth), sensors 910 (such as an accelerometer, tilt sensor, rotation sensor and so forth), and communication interfaces 912 (such as network interface cards and so forth). The elements are coupled to each other via system bus 914, which represents one or more buses. In the case of multiple buses, they are bridged by one or more bus bridges (not shown).
Each of these elements performs it conventional functions known in the art and/or as described above with respect to embodiments of the present invention. In particular, system memory 904 and mass storage 906 may be employed to store a working copy and a permanent copy of the programming instructions (922) implementing the various components of the present invention. The various components may be implemented by assembler instructions supported by processor(s) 902 or high-level languages, such as, for example, C, that can be compiled into such instructions.
The permanent copy of the programming instructions may be placed into permanent storage 906 in the factory, or in the field, through, for example, a distribution medium (not shown), such as a compact disc (CD), or through communication interface 912 (from a distribution server (not shown)).
The virtual keyboard of input/output devices 908 includes an interface (not shown) that communicates with sensors 910 to obtain the position of mobile device 200, 500 as described above.
The constitution of elements 902-914 are known in the art, and accordingly will not be further described.
While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example only, and not limitation. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. Thus, the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined in accordance with the following claims and their equivalents.

Claims

What Is Claimed Is:
1. A method for a virtual touch screen keyboard, comprising.
waiting for a movement of a mobile device,
upon the movement of the mobile device, receiving, from a sensor of the mobile device, a measurement representing a current position of the mobile device;
determining whether an absolute value of the received measurement is greater than a pre-defined value;
if the absolute value of the received measurement is greater than the pre-defined value, and the received measurement is a negative value, displaying a first portion of the virtual touch screen keyboard to allow a user to input characters from the first portion of the virtual touch screen keyboard; and
if the absolute value of the received measurement is greater than the pre-defined value, and the received measurement is a positive value, displaying a second portion of the virtual touch screen keyboard to allow a user to input characters from the second portion of the virtual touch screen keyboard.
2. The method of claim 1 , wherein if the absolute value of the received measurement is not greater than the pre-defined value, continuing to wait for a movement of the mobile device.
3. The method of claim 1 , wherein prior to waiting for a movement of a mobile device, displaying a keyboard layout upon a user selection of an application requiring input from a keyboard.
4. The method of claim 3, wherein the keyboard layout displayed is the same as a last displayed keyboard layout.
5. The method of claim 3, wherein the keyboard layout displayed is the first portion of the virtual touch screen keyboard.
6. The method of claim 3, wherein the keyboard layout displayed is the second portion of the virtual touch screen keyboard.
7. The method of claim 1 , wherein the sensor comprises an accelerometer, and the measurement representing the position of the mobile device comprises an acceleration measurement.
8. The method of claim 7, wherein the acceleration measurement comprises X, Y, and Z acceleration components, wherein only the X acceleration component is used to determine whether the pre-defined value is exceeded.
9. The method of claim 1 , wherein the sensor comprises a tilt sensor, and the measurement representing the position of the mobile device comprises a tilt angle measurement.
10. The method of claim 9, wherein the tilt sensor measurement comprises XRotation, YRotation, and ZRotation components, wherein only the YRotation component is used to determine whether the pre-defined value is exceeded.
1 1. The method of claim 1 , wherein the sensor comprises a rotation sensor, and the measurement representing the position of the mobile device comprises a rotation angle measurement.
12. The method of claim 1 1 , wherein the rotation sensor measurement comprises XRotation, YRotation, and ZRotation components, wherein only the YRotation component is used to determine whether the pre-defined value is exceeded.
13. The method of claim 1 , wherein the first portion of the virtual touch screen keyboard and the second portion of the virtual touch screen keyboard each comprise one half of the virtual touch screen keyboard, and wherein the area of a displayed key for the first portion or the second portion is double the area of a key for a conventional touch screen keyboard displaying an entire keyboard.
14. An article of manufacture comprising:
a tangible, non-transitory processor-readable storage medium; and a plurality of programming instructions, configured to cause a processor, in response to execution of the programming instructions by the processor, to perform operations including
waiting for a movement of a mobile device;
upon the movement of the mobile device, receiving, from a sensor of the mobile device, a measurement representing a current position of the mobile device;
determining whether an absolute value of the received measurement is greater than a pre-defined value;
if the absolute value of the received measurement is greater than the pre-defined value, and the received measurement is a negative value, displaying a first portion of the virtual touch screen keyboard to allow a user to input characters from the first portion of the virtual touch screen keyboard; and
if the absolute value of the received measurement is greater than the pre-defined value, and the received measurement is a positive value, displaying a second portion of the virtual touch screen keyboard to allow a user to input characters from the second portion of the virtual touch screen keyboard.
15. The article of claim 14, wherein if the absolute value of the received measurement is not greater than the pre-defined value, further causing the processor to perform operations including continuing to wait for a movement of the mobile device.
16. The article of claim 14, wherein prior to waiting for a movement of a mobile device, further causing the processor to perform operations including displaying a keyboard layout upon a user selection of an application requiring input from a keyboard.
17. The article of claim 16, wherein the keyboard layout displayed is the same as a last displayed keyboard layout.
18. The article of claim 16, wherein the keyboard layout displayed is the first portion of the virtual touch screen keyboard.
19. The article of claim 16, wherein the keyboard layout displayed is the second portion of the virtual touch screen keyboard.
20. The article of claim 14, wherein the sensor comprises an accelerometer, and the measurement representing the position of the mobile device comprises an acceleration measurement.
21 . The article of claim 20, wherein the acceleration measurement comprises X, Y, and Z acceleration components, wherein only the X acceleration component is used to determine whether the pre-defined value is exceeded.
22. The article of claim 14, wherein the sensor comprises a tilt sensor, and the measurement representing the position of the mobile device comprises a tilt angle measurement.
23. The article of claim 22, wherein the tilt sensor measurement comprises XRotation, YRotation, and ZRotation components, wherein only the YRotation component is used to determine whether the pre-defined value is exceeded.
24. The article of claim 14, wherein the sensor comprises a rotation sensor, and the measurement representing the position of the mobile device comprises a rotation angle measurement.
25. The article of claim 24, wherein the rotation sensor measurement comprises XRotation, YRotation, and ZRotation components, wherein only the YRotation component is used to determine whether the pre-defined value is exceeded.
26. The article of claim 14, wherein the first portion of the virtual touch screen keyboard and the second portion of the virtual touch screen keyboard each comprise one half of the virtual touch screen keyboard, and wherein the area of a displayed key for the first portion or the second portion is double the area of a key for a conventional touch screen keyboard displaying an entire keyboard.
27. An apparatus comprising:
a mobile device having a sensor, wherein when the mobile device moves, the sensor to provide a virtual touch screen keyboard with a measurement representing the position of the mobile device, wherein the virtual touch screen keyboard to determine whether an absolute value of the received measurement is greater than a pre-defined value; if the absolute value of the received measurement is greater than the pre-defined value, and the received measurement is a negative value, the virtual touch screen keyboard to display a first portion of the virtual touch screen keyboard to allow a user to input characters from the first portion of the virtual touch screen keyboard; and
if the absolute value of the received measurement is greater than the pre-defined value, and the received measurement is a positive value, the virtual touch screen keyboard to display a second portion of the virtual touch screen keyboard to allow a user to input characters from the second portion of the virtual touch screen keyboard.
28. The apparatus of claim 27, wherein the sensor comprises an accelerometer and the measurement representing the position of the mobile device comprises an acceleration measurement, wherein the acceleration measurement comprises X, Y, and Z acceleration components, and wherein only the X acceleration component is used to determine whether the pre-defined value is exceeded.
29. The apparatus of claim 27, wherein the sensor comprises a tilt sensor or a rotation sensor and the measurement representing the position of the mobile device comprises a tilt angle or rotation angle measurement, wherein the tilt angle or rotation angle measurement comprises XRotation, YRotation, and ZRotation components, and wherein only the YRotation component is used to determine whether the pre-defined value is exceeded.
30. The apparatus of claim 27, wherein the first portion of the virtual touch screen keyboard and the second portion of the virtual touch screen keyboard each comprise one half of the virtual touch screen keyboard, and wherein the area of a displayed key for the first portion or the second portion is double the area of a key for a conventional touch screen keyboard displaying an entire keyboard.
PCT/CN2010/002130 2010-12-22 2010-12-22 A new touch screen keyboard design for mobile devices WO2012083499A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
PCT/CN2010/002130 WO2012083499A1 (en) 2010-12-22 2010-12-22 A new touch screen keyboard design for mobile devices
JP2013543483A JP2014501460A (en) 2010-12-22 2010-12-22 New touch screen keyboard for mobile devices
US13/997,013 US9658769B2 (en) 2010-12-22 2010-12-22 Touch screen keyboard design for mobile devices
CN2010800708725A CN103262009A (en) 2010-12-22 2010-12-22 A new touch screen keyboard design for mobile devices
KR1020137015434A KR101496602B1 (en) 2010-12-22 2010-12-22 Method for displaying a virtual touch screen keyboard, and a mobile device using the method
EP10861003.1A EP2656184A4 (en) 2010-12-22 2010-12-22 A new touch screen keyboard design for mobile devices

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2010/002130 WO2012083499A1 (en) 2010-12-22 2010-12-22 A new touch screen keyboard design for mobile devices

Publications (1)

Publication Number Publication Date
WO2012083499A1 true WO2012083499A1 (en) 2012-06-28

Family

ID=46313000

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/002130 WO2012083499A1 (en) 2010-12-22 2010-12-22 A new touch screen keyboard design for mobile devices

Country Status (6)

Country Link
US (1) US9658769B2 (en)
EP (1) EP2656184A4 (en)
JP (1) JP2014501460A (en)
KR (1) KR101496602B1 (en)
CN (1) CN103262009A (en)
WO (1) WO2012083499A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103488400A (en) * 2013-09-27 2014-01-01 京东方科技集团股份有限公司 Method and device for building virtual keyboard
WO2014003876A1 (en) * 2012-06-29 2014-01-03 Apple Inc. Device, method, and graphical user interface for displaying a virtual keyboard
US8648823B2 (en) 2010-11-05 2014-02-11 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
WO2014088160A1 (en) * 2012-12-06 2014-06-12 Kang Dong Sung Terminal provided with movable keyboard, and movable keyboard display method thereof
US8842082B2 (en) 2011-01-24 2014-09-23 Apple Inc. Device, method, and graphical user interface for navigating and annotating an electronic document
US9092132B2 (en) 2011-01-24 2015-07-28 Apple Inc. Device, method, and graphical user interface with a dynamic gesture disambiguation threshold
US9128614B2 (en) 2010-11-05 2015-09-08 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
EP3002661A1 (en) * 2014-09-30 2016-04-06 Advanced Digital Broadcast S.A. System and method for controlling a virtual input interface
US9442654B2 (en) 2010-01-06 2016-09-13 Apple Inc. Apparatus and method for conditionally enabling or disabling soft buttons
US9658769B2 (en) 2010-12-22 2017-05-23 Intel Corporation Touch screen keyboard design for mobile devices

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103677632A (en) * 2013-11-19 2014-03-26 三星电子(中国)研发中心 Virtual keyboard adjustment method and mobile terminal
JP6409165B2 (en) * 2014-12-08 2018-10-24 富士通コネクテッドテクノロジーズ株式会社 Electronic device and handwritten character input program
US20170003872A1 (en) * 2015-07-02 2017-01-05 International Business Machines Corporation Touch-encoded keyboard
JP6214618B2 (en) * 2015-11-25 2017-10-18 レノボ・シンガポール・プライベート・リミテッド Information processing apparatus, software keyboard display method, and program
WO2017131728A1 (en) * 2016-01-29 2017-08-03 Hewlett Packard Enterprise Development Lp Cursor movement based on context
US10706810B2 (en) * 2018-09-26 2020-07-07 Rosemount Inc. Software-rotatable display layout for labelling buttons
CN110874147B (en) * 2019-10-23 2024-04-02 维沃移动通信有限公司 Display method and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030201972A1 (en) 2002-04-25 2003-10-30 Sony Corporation Terminal apparatus, and character input method for such terminal apparatus
CN101384977A (en) * 2005-09-16 2009-03-11 苹果公司 Operation of a computer with touch screen interface
US20100156798A1 (en) 2008-12-19 2010-06-24 Verizon Data Services, Llc Accelerometer Sensitive Soft Input Panel
CN101763200A (en) * 2008-12-23 2010-06-30 三星电子株式会社 Large size capacitive touch screen panel
CN101770330A (en) * 2009-01-07 2010-07-07 倚天资讯股份有限公司 Hand-held electronic device and operation method thereof
JP2010282459A (en) 2009-06-05 2010-12-16 Funai Electric Co Ltd Mobile terminal device

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060033724A1 (en) * 2004-07-30 2006-02-16 Apple Computer, Inc. Virtual input device placement on a touch screen user interface
CN1704871B (en) * 2004-05-31 2010-04-28 深圳市朗科科技股份有限公司 Portable digital devices and input method therefor
JP2007025808A (en) * 2005-07-12 2007-02-01 Canon Inc Virtual keyboard system and its control method
US20090278806A1 (en) * 2008-05-06 2009-11-12 Matias Gonzalo Duarte Extended touch-sensitive control area for electronic device
JP2008140064A (en) 2006-11-30 2008-06-19 Toshiba Corp Information processor
US20080247128A1 (en) * 2007-04-03 2008-10-09 Soon Huat Khoo Composite Two Screen Digital Device
KR100913962B1 (en) * 2007-05-14 2009-08-26 삼성전자주식회사 Method and apparatus of inputting character in Mobile communication terminal
CN101581973A (en) * 2008-05-14 2009-11-18 诚实科技股份有限公司 Portable electronic device and switching method of input modes for same
CN101620474A (en) * 2008-07-04 2010-01-06 华硕电脑股份有限公司 Motion-sensing input device of computer system
US20100053089A1 (en) * 2008-08-27 2010-03-04 Research In Motion Limited Portable electronic device including touchscreen and method of controlling the portable electronic device
US8860632B2 (en) * 2008-09-08 2014-10-14 Qualcomm Incorporated Multi-panel device with configurable interface
JP4743267B2 (en) 2008-12-12 2011-08-10 ソニー株式会社 Information processing apparatus, information processing method, and program
US8441441B2 (en) * 2009-01-06 2013-05-14 Qualcomm Incorporated User interface for mobile devices
CN202142005U (en) * 2009-07-22 2012-02-08 罗技欧洲公司 System for long-distance virtual screen input
US20110210922A1 (en) * 2010-02-26 2011-09-01 Research In Motion Limited Dual-screen mobile device
US20110242138A1 (en) * 2010-03-31 2011-10-06 Tribble Guy L Device, Method, and Graphical User Interface with Concurrent Virtual Keyboards
US8842080B2 (en) * 2010-10-01 2014-09-23 Z124 User interface with screen spanning icon morphing
CN103262009A (en) 2010-12-22 2013-08-21 英特尔公司 A new touch screen keyboard design for mobile devices

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030201972A1 (en) 2002-04-25 2003-10-30 Sony Corporation Terminal apparatus, and character input method for such terminal apparatus
CN101384977A (en) * 2005-09-16 2009-03-11 苹果公司 Operation of a computer with touch screen interface
US20100156798A1 (en) 2008-12-19 2010-06-24 Verizon Data Services, Llc Accelerometer Sensitive Soft Input Panel
CN101763200A (en) * 2008-12-23 2010-06-30 三星电子株式会社 Large size capacitive touch screen panel
CN101770330A (en) * 2009-01-07 2010-07-07 倚天资讯股份有限公司 Hand-held electronic device and operation method thereof
JP2010282459A (en) 2009-06-05 2010-12-16 Funai Electric Co Ltd Mobile terminal device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2656184A4 *

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9442654B2 (en) 2010-01-06 2016-09-13 Apple Inc. Apparatus and method for conditionally enabling or disabling soft buttons
US9141285B2 (en) 2010-11-05 2015-09-22 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US8648823B2 (en) 2010-11-05 2014-02-11 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US8659562B2 (en) 2010-11-05 2014-02-25 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US8754860B2 (en) 2010-11-05 2014-06-17 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US9128614B2 (en) 2010-11-05 2015-09-08 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US9146673B2 (en) 2010-11-05 2015-09-29 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US9658769B2 (en) 2010-12-22 2017-05-23 Intel Corporation Touch screen keyboard design for mobile devices
US10365819B2 (en) 2011-01-24 2019-07-30 Apple Inc. Device, method, and graphical user interface for displaying a character input user interface
US8842082B2 (en) 2011-01-24 2014-09-23 Apple Inc. Device, method, and graphical user interface for navigating and annotating an electronic document
US9092132B2 (en) 2011-01-24 2015-07-28 Apple Inc. Device, method, and graphical user interface with a dynamic gesture disambiguation threshold
US9250798B2 (en) 2011-01-24 2016-02-02 Apple Inc. Device, method, and graphical user interface with a dynamic gesture disambiguation threshold
US10042549B2 (en) 2011-01-24 2018-08-07 Apple Inc. Device, method, and graphical user interface with a dynamic gesture disambiguation threshold
WO2014003876A1 (en) * 2012-06-29 2014-01-03 Apple Inc. Device, method, and graphical user interface for displaying a virtual keyboard
WO2014088160A1 (en) * 2012-12-06 2014-06-12 Kang Dong Sung Terminal provided with movable keyboard, and movable keyboard display method thereof
US10209885B2 (en) 2013-09-27 2019-02-19 Boe Technology Group Co., Ltd. Method and device for building virtual keyboard
CN103488400A (en) * 2013-09-27 2014-01-01 京东方科技集团股份有限公司 Method and device for building virtual keyboard
EP3002661A1 (en) * 2014-09-30 2016-04-06 Advanced Digital Broadcast S.A. System and method for controlling a virtual input interface

Also Published As

Publication number Publication date
JP2014501460A (en) 2014-01-20
KR20130109190A (en) 2013-10-07
EP2656184A1 (en) 2013-10-30
US20150046865A1 (en) 2015-02-12
EP2656184A4 (en) 2016-07-13
US9658769B2 (en) 2017-05-23
KR101496602B1 (en) 2015-02-26
CN103262009A (en) 2013-08-21

Similar Documents

Publication Publication Date Title
US9658769B2 (en) Touch screen keyboard design for mobile devices
JP4093823B2 (en) View movement operation method
US8009146B2 (en) Method, apparatus and computer program product for facilitating data entry via a touchscreen
JP4743267B2 (en) Information processing apparatus, information processing method, and program
KR20100041867A (en) Method, apparatus and computer program product for facilitating data entry using an offset connection element
KR20110014891A (en) Method and apparatus for inputting letter in portable terminal having a touch screen
EP2332023A2 (en) Two-thumb qwerty keyboard
KR101679379B1 (en) Method and device for force sensing gesture recognition
CN104461336B (en) Electronic device and unlocking method thereof
JP2011227854A (en) Information display device
KR20170026391A (en) Application swap based on smart device position
US20120311506A1 (en) Selector
US9367169B2 (en) Method, circuit, and system for hover and gesture detection with a touch screen
TWI514243B (en) System and method for controlling virtual keyboards
KR20140138101A (en) Mobile terminal based on 3D function key and Method for converting of display 3D function key
WO2013047023A1 (en) Display apparatus, display method, and program
JP2012238128A (en) Information device having back-face input function, back-face input method, and program
JP5636584B2 (en) Character input device, character input method, and character input program
KR20140114145A (en) Operation method of personal portable device having touch panel
JP5692796B2 (en) Information terminal, input method and program
JP2013003601A (en) Display input device
KR101165388B1 (en) Method for controlling screen using different kind of input devices and terminal unit thereof
KR20150013404A (en) Method of inputting character in mobile terminal and mobile terminal using the same
Lee et al. NAVIGATING USER INTERFACES ON A MOBILE COMPUTING DEVICE
JP2022023367A (en) Electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10861003

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 20137015434

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2013543483

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 13997013

Country of ref document: US