WO2015127731A1 - Procédé d'ajustement de la disposition d'un clavier virtuel et appareil associé - Google Patents

Procédé d'ajustement de la disposition d'un clavier virtuel et appareil associé Download PDF

Info

Publication number
WO2015127731A1
WO2015127731A1 PCT/CN2014/080319 CN2014080319W WO2015127731A1 WO 2015127731 A1 WO2015127731 A1 WO 2015127731A1 CN 2014080319 W CN2014080319 W CN 2014080319W WO 2015127731 A1 WO2015127731 A1 WO 2015127731A1
Authority
WO
WIPO (PCT)
Prior art keywords
soft keyboard
user
coordinate value
finger
finger tip
Prior art date
Application number
PCT/CN2014/080319
Other languages
English (en)
Chinese (zh)
Inventor
曾慧琼
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2015127731A1 publication Critical patent/WO2015127731A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Definitions

  • the present invention relates to the field of computer technologies, and in particular, to a soft keyboard layout adjustment method and apparatus. Background technique
  • a mobile device equipped with a touch screen usually adopts a soft keyboard input mode, and the soft keyboard layout can select a full keyboard or a traditional 12-key keyboard.
  • a traditional 12-key keyboard one button is shared by three to four letters, often multiple clicks to filter the target value.
  • the full keyboard layout each letter has a separate button corresponding to it, and the target value can be obtained with a single click, which improves the input efficiency.
  • the individual keys of the full keyboard are usually too narrow.
  • portable electronic computing devices with limited width such as mobile phones.
  • the narrow button size is easy to cause the wrong button to be pressed, which improves the input error rate and reduces the input efficiency.
  • the present invention has been made in order to provide a soft keyboard layout adjustment method and apparatus.
  • the embodiment of the invention provides a soft keyboard layout adjustment method, including:
  • the finger movement information when the user inputs the soft keyboard is collected, the coordinate value set of the finger movement of the user finger is calculated according to the finger movement information, and the displacement direction of the finger finger end of the user on the soft keyboard is determined according to the coordinate value set. ;
  • the coordinate value set and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved is determined, and the keys in the target soft keyboard area are enlarged, and the keys in the remaining soft keyboard areas are reduced. And display it.
  • the information about the finger movement when the user inputs the soft keyboard includes: Adjusting the terminal's own camera is capable of capturing the soft keyboard input angle, and taking the action of the user's fingertip when taking the soft keyboard input by the self-contained camera to form the finger movement information of the video data format.
  • the coordinate value set of the finger movement of the user finger is calculated according to the finger movement information, and the displacement direction of the finger finger end of the user on the soft keyboard is determined according to the coordinate value set, specifically: calculating the video data by using a graphic processing algorithm The coordinate value of the user's finger pointing end of each frame of video data, and acquiring a coordinate value set of the user's finger finger movement within a predetermined time, and determining the displacement direction of the user's finger finger end on the soft keyboard according to the coordinate value set.
  • determining the target soft keyboard area to which the user's fingertip is to be moved specifically includes:
  • the target soft keyboard area to which the user's fingertip is to be moved is determined.
  • the above method further comprises: turning off or turning on the soft keyboard layout adjustment function of the terminal according to the operation of the user.
  • the embodiment of the invention further provides a soft keyboard layout adjusting device, comprising:
  • the collection module is configured to collect finger movement information when the user inputs the soft keyboard in the terminal;
  • the calculation module is configured to calculate a coordinate value set of the movement of the fingertip of the user within a predetermined time according to the movement information of the finger, and determine according to the coordinate value set The direction of displacement of the user's finger on the soft keyboard;
  • the processing module is configured to determine, according to the pre-divided soft keyboard partition, the coordinate value set and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved, and enlarge the button in the target soft keyboard area, and the remaining soft keyboard area The button in the button is zoomed out and displayed.
  • the collection module is specifically configured to: adjust the terminal self-contained camera to be able to capture the soft keyboard input angle, and take the action of the user's fingertip when the soft keyboard input is performed by the self-contained camera to form the finger movement information of the video data format.
  • the calculating module is specifically configured to: calculate, by using a graphics processing algorithm, coordinate values of a user's fingertips of each frame of video data in the video data, and acquire coordinates of the fingertip movement of the user within a predetermined time
  • the set of values, and the direction of displacement of the fingertip of the user on the soft keyboard is determined according to the set of coordinate values.
  • the processing module is specifically configured to: determine, according to a coordinate value of a current user finger finger end in the coordinate value set, and a coordinate value of the pre-divided soft keyboard partition, determine a soft keyboard area where the current user finger finger end is located; according to the current user The soft keyboard area where the finger is pointed and the direction of displacement determine the target soft keyboard area to which the user's fingertip is to be moved.
  • the device further includes: a selection module, configured to select to turn off or turn on the soft keyboard layout adjustment function of the terminal according to a user operation.
  • a selection module configured to select to turn off or turn on the soft keyboard layout adjustment function of the terminal according to a user operation.
  • the error of the full keyboard input caused by the narrow key is solved in the prior art.
  • the problem can reduce the probability of the user pressing the wrong key and improve the efficiency of the user's text input.
  • FIG. 1 is a flowchart of a method for adjusting a soft keyboard layout according to an embodiment of the present invention
  • FIG. 2 is a flowchart of detailed processing of a soft keyboard layout adjustment method according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a soft keyboard partition according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram showing the layout of the soft keyboard automatically adjusted to the left button in the embodiment of the present invention
  • FIG. 5 is a schematic diagram showing the layout of the soft keyboard automatically adjusted to the right button in the embodiment of the present invention
  • FIG. 6 is a soft keyboard according to an embodiment of the present invention
  • Schematic diagram of the layout adjustment device
  • the present invention provides a soft keyboard layout adjustment method and device.
  • the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. . It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
  • FIG. 1 is a flowchart of a soft keyboard layout adjustment method according to an embodiment of the present invention, which includes the following processing:
  • Step 101 Collect finger movement information when the user inputs the soft keyboard, calculate a coordinate value set of the finger movement of the user finger within a predetermined time according to the finger movement information, and collect according to the coordinate value
  • the finger movement information of the user when performing the soft keyboard input specifically includes: adjusting the terminal self-contained camera to be able to capture the soft keyboard input angle, and photographing the user finger when performing the soft keyboard input by the self-contained camera
  • the action of the fingertip forms the finger movement information in the video data format.
  • step 101 the set of coordinate values of the fingertip movement of the user within a predetermined time is calculated according to the finger movement information, and the direction of displacement of the fingertip of the user on the soft keyboard according to the coordinate value set specifically includes:
  • Step 102 Determine, according to the pre-divided soft keyboard partition, the coordinate value set, and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved, and enlarge the button in the target soft keyboard area, and the remaining soft keyboard area The button is zoomed out and displayed.
  • step 102 according to the pre-divided soft keyboard partition, the coordinate value set, and the displacement direction, determining the target soft keyboard area to which the user's fingertip is to be moved specifically includes:
  • the target soft keyboard area to which the user's fingertip is to be moved is determined.
  • the soft keyboard layout adjustment function of the terminal may be turned off or on according to the operation of the user.
  • the terminal must have at least the following components: a touch sensitive display (ie, a touch screen), a camera, and a computing control module.
  • a touch sensitive display ie, a touch screen
  • the camera is located above the touch screen and can be rotated; if the camera is not rotatable, but the angle is fixed to an angle at which the touch screen can be captured.
  • the above computing control module includes one or more calculators, controllers, and memories of the device. The technical solution of the embodiment of the present invention preliminarily judges the input intention by photographing the finger motion, and then dynamically adjusts the soft keyboard layout.
  • the camera located above the touch screen collects video data that the finger moves on the keyboard.
  • the video data of the finger movement collected by the ⁇ is sent to the calculation control module, and the coordinate value of the finger finger end in the single frame video is calculated by the graphics processing algorithm.
  • the calculation control module calculates the recorded array of fingertip coordinate values, and calculates the displacement direction of the fingertip coordinates for a continuous period of time, thereby judging that the finger is moving in the direction of the screen.
  • the calculation control module determines which area of the screen the fingertip is located by comparing the fingertip coordinate value with the screen partition coordinate value. And combined with the direction of the finger displacement obtained before, comprehensively determine which area of the screen the finger will move.
  • the calculation control module adjusts the layout of the soft keyboard, enlarges the button of the target area where the finger is moved, and the keys of the remaining areas are correspondingly reduced, and the adjusted layout is refreshed, and the new keyboard layout is displayed by the touch screen.
  • whether the keyboard layout is dynamically adjusted at the time of input can be selectively turned on or off by the user.
  • the soft keyboard dynamically adjusts the button size according to the pre-divided keyboard partition, and the sub-area is uniformly and dynamically adjusted, that is, the button size of the target area is uniformly enlarged, and the button size of other non-target areas is uniformly reduced.
  • the partition can be determined based on the camera module's collection speed and the processor's calculation speed. Generally, the higher the processing speed of image collection and system, the more partitions can be divided, and the number of buttons in a single area is small. Therefore, the size of a single button can be enlarged. On the contrary, the number of partitions is small, and the number of buttons in a single area is large. The size that can be enlarged will be smaller.
  • the design principle is to ensure that the keyboard partition is minimized and the burden of the computing system is reduced by ensuring that a single button is zoomed in to greatly reduce the false touch rate.
  • FIG. 2 is a flowchart of detailed processing of a method for adjusting a soft keyboard layout according to an embodiment of the present invention. As shown in FIG. 2, the following specifically includes the following processing:
  • Step 201 The system detects that the text input box obtains focus, and starts the soft keyboard startup process. Turn the camera above the touch screen to a predetermined angle and turn on the camera. The predetermined angle is designed to ensure that the camera can capture the soft keyboard area below the screen.
  • Step 202 displaying a soft keyboard interface.
  • Step 203 The camera captures a finger motion image.
  • the collected video data is sent to the processor for corresponding graphics algorithm calculation.
  • Step 204 Acquire coordinate values of the fingertips in the image by calculation and record them in an array. Steps 203 and 204 are executed cyclically, and the coordinate data of the finger end is continuously acquired and the coordinate value array is updated.
  • Step 205 Calculate the finger end displacement direction by using a plurality of coordinate points continuously recorded.
  • Step 206 Determine whether the finger end horizontal coordinate is to the left of the screen horizontal center line and whether the current finger end displacement direction is to the left. If the result of the determination is true, then the process proceeds to step 207, and the result of the determination is otherwise to step 208.
  • Step 207 If the result of the determination in step 206 is true, the system determines that the user wants to click the button on the left side of the keyboard, and automatically adjusts the full keyboard layout.
  • FIG. 3 is a schematic diagram of a soft keyboard partition according to an embodiment of the present invention.
  • the keyboard is divided into two areas, left and right, which are respectively identified by black and white colors.
  • the middle gray area is the area where the left and right areas overlap.
  • the buttons on the left white area and the middle gray area in the keyboard layout of Fig. 3 are widened, and the keys on the right black area are narrowed. The result is shown in Fig. 4. Then go back to step 205.
  • Step 208 Determine whether the finger end horizontal coordinate is on the right side of the screen horizontal center line and whether the current finger end displacement direction is to the right. If the result of the determination is true, the process goes to step 209, and the result of the determination is otherwise, and the process returns to step 205.
  • Step 209 If the result of the determination in step 208 is true, the system determines that the user wants to click the button on the right side of the keyboard, and automatically adjusts the full keyboard layout. In the keyboard layout of Figure 3, the buttons on the right black area and the middle gray area will be widened, and the buttons on the left white area will be narrowed. The result is shown in Figure 5. Then go back and repeat step 205.
  • the technical solution described in the embodiment of the present invention can pre-determine the intention of the user's button, and dynamically increase the local button of the keyboard according to the user's intention, widen the target button, and reduce the probability of the user pressing the wrong button. Improve the efficiency of text input.
  • FIG. 6 is a schematic structural diagram of a soft keyboard layout adjustment apparatus according to an embodiment of the present invention. As shown in FIG. 6, the soft keyboard layout adjustment according to an embodiment of the present invention is shown.
  • the device includes: a collection module 60, a calculation module 62, and a processing module 64. The respective modules of the embodiments of the present invention are described in detail below.
  • the collection module 60 is configured to collect finger movement information when the user inputs the soft keyboard at the terminal; preferably, the collection module 60 is specifically configured to: adjust the terminal self-equipped camera to be able to capture the soft keyboard The input angle is used to capture the movement of the finger of the user in the video data format by taking the action of the user's fingertip when the soft keyboard is input.
  • the calculating module 62 is configured to calculate a coordinate value set of the fingertip movement of the user within a predetermined time according to the finger movement information, and determine a displacement direction of the finger finger end of the user on the soft keyboard according to the coordinate value set; 5 preferably, the calculation module 62 is specifically configured to: calculate a coordinate value of a user finger finger end of each frame of video data in the video data by using a graphics processing algorithm, and acquire a coordinate value set of the finger finger movement of the user within a predetermined time, and determine the user finger finger according to the coordinate value set; The direction of displacement on the soft keyboard.
  • the processing module 64 is configured to determine, according to the pre-divided soft keyboard partition, the coordinate value set, and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved, and press the 10 key in the target soft keyboard area to enlarge the rest.
  • the buttons in the soft keyboard area are zoomed out and displayed.
  • the processing module 64 is specifically configured to: determine, according to a coordinate value of a current user finger finger end in the coordinate value set, and a coordinate value of the pre-divided soft keyboard partition, determine a soft keyboard area where the current user finger finger end is located; The soft keyboard area where the user's fingertip is located, and the direction of displacement determine the target soft keyboard area to which the user's fingertip is to be moved.
  • the apparatus according to the embodiment of the present invention further comprises: a selection module for selecting to disable or turn on the soft keyboard layout adjustment function of the terminal according to the user's operation.
  • the terminal has at least the following components, and the collection module can be a touch-sensitive display (ie, a touch screen) and a camera; the calculation module, the processing module, and the selection module can be one or more calculators, controllers, and Memory.
  • the camera is located above the touch screen and can be rotated; if the camera is not rotated, the angle is fixed to the angle at which the touch screen can be captured.
  • the technical solution of the embodiment of the present invention determines the target soft keyboard area to which the user's fingertip is to be moved according to the finger movement information when the user inputs the soft keyboard at the terminal, and performs the release of the target soft keyboard area.
  • the full keyboard input is easy to input and error caused by the narrow button, which can reduce the probability of the user pressing the wrong key and improve the efficiency of the user's text input.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Input From Keyboards Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un procédé d'ajustement de la disposition d'un clavier virtuel et un appareil associé. Le procédé comprend les étapes consistant à : collecter des informations sur le mouvement d'un doigt lorsqu'un utilisateur réalise une entrée de clavier virtuel sur un terminal, calculer un ensemble de valeurs de coordonnées du mouvement du bout du doigt de l'utilisateur pendant un temps prédéfini en fonction des informations sur le mouvement du doigt et déterminer une direction de déplacement du bout du doigt de l'utilisateur sur un clavier virtuel en fonction de l'ensemble de valeurs de coordonnées ; et déterminer une zone de clavier virtuel cible vers laquelle le bout du doigt de l'utilisateur se déplacera en fonction des zones de clavier virtuel prédivisées, de l'ensemble de valeurs de coordonnées et de la direction de déplacement, agrandir les touches dans la zone de clavier virtuel cible, réduire les touches dans d'autres zones du clavier virtuel et procéder à l'affichage.
PCT/CN2014/080319 2014-02-27 2014-06-19 Procédé d'ajustement de la disposition d'un clavier virtuel et appareil associé WO2015127731A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410069278.4 2014-02-27
CN201410069278.4A CN104881200A (zh) 2014-02-27 2014-02-27 软键盘布局调整方法及装置

Publications (1)

Publication Number Publication Date
WO2015127731A1 true WO2015127731A1 (fr) 2015-09-03

Family

ID=53948714

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/080319 WO2015127731A1 (fr) 2014-02-27 2014-06-19 Procédé d'ajustement de la disposition d'un clavier virtuel et appareil associé

Country Status (2)

Country Link
CN (1) CN104881200A (fr)
WO (1) WO2015127731A1 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105242825B (zh) * 2015-09-09 2018-11-20 北京新美互通科技有限公司 终端控制方法及装置
CN105404456B (zh) * 2015-12-22 2019-01-22 厦门美图移动科技有限公司 一种移动终端拨号键盘管理方法及装置
CN107239218A (zh) * 2017-04-28 2017-10-10 努比亚技术有限公司 移动终端的控制方法、移动终端及计算机可读存储介质
CN108363541A (zh) * 2018-02-09 2018-08-03 长沙联远电子科技有限公司 触控屏输入控制方法、装置、设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050110756A1 (en) * 2003-11-21 2005-05-26 Hall Bernard J. Device and method for controlling symbols displayed on a display device
CN101630223A (zh) * 2009-07-25 2010-01-20 深圳华为通信技术有限公司 一种调整界面的方法及终端
CN102360249A (zh) * 2011-09-29 2012-02-22 上海汉翔信息技术有限公司 分立式键盘布局系统和设置方法、相应的便携电子设备及控制方法
CN103150105A (zh) * 2013-01-17 2013-06-12 苏州佳世达电通有限公司 虚拟键盘的调整方法及系统
CN103577033A (zh) * 2012-08-07 2014-02-12 百度在线网络技术（北京）有限公司 一种输入法面板的设置方法和系统

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050020325A1 (en) * 2003-07-24 2005-01-27 Motorola, Inc. Multi-configuration portable electronic device and method for operating the same
US20050071778A1 (en) * 2003-09-26 2005-03-31 Nokia Corporation Method for dynamic key size prediction with touch displays and an electronic device using the method
US9274551B2 (en) * 2005-02-23 2016-03-01 Zienon, Llc Method and apparatus for data entry input
CN101589355A (zh) * 2006-11-08 2009-11-25 库比克设计工作室有限责任公司 非对称性重组的键盘
CN102681670A (zh) * 2012-04-09 2012-09-19 中兴通讯股份有限公司 一种移动终端及移动终端虚拟键盘的设置方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050110756A1 (en) * 2003-11-21 2005-05-26 Hall Bernard J. Device and method for controlling symbols displayed on a display device
CN101630223A (zh) * 2009-07-25 2010-01-20 深圳华为通信技术有限公司 一种调整界面的方法及终端
CN102360249A (zh) * 2011-09-29 2012-02-22 上海汉翔信息技术有限公司 分立式键盘布局系统和设置方法、相应的便携电子设备及控制方法
CN103577033A (zh) * 2012-08-07 2014-02-12 百度在线网络技术（北京）有限公司 一种输入法面板的设置方法和系统
CN103150105A (zh) * 2013-01-17 2013-06-12 苏州佳世达电通有限公司 虚拟键盘的调整方法及系统

Also Published As

Publication number Publication date
CN104881200A (zh) 2015-09-02

Similar Documents

Publication Publication Date Title
US10565437B2 (en) Image processing device and method for moving gesture recognition using difference images
US9933850B2 (en) Information processing apparatus and program
US10628010B2 (en) Quick review of captured image data
CN109428969B (zh) 双屏终端的边缘触控方法、装置及计算机可读存储介质
US20150035746A1 (en) User Interface Device
US20150220150A1 (en) Virtual touch user interface system and methods
US20130257736A1 (en) Gesture sensing apparatus, electronic system having gesture input function, and gesture determining method
JP2009140368A (ja) 入力装置、表示装置、入力方法、表示方法及びプログラム
US8462113B2 (en) Method for executing mouse function of electronic device and electronic device thereof
US10095384B2 (en) Method of receiving user input by detecting movement of user and apparatus therefor
WO2017059734A1 (fr) Procédé de zoom avant/arrière d'image et dispositif électronique
US10754446B2 (en) Information processing apparatus and information processing method
CN112565613B (zh) 预览图像显示控制方法、装置、电子设备及介质
US20150241968A1 (en) Method for Processing Information and Electronic Device
CN105824553A (zh) 一种触控方法及移动终端
WO2015127731A1 (fr) Procédé d'ajustement de la disposition d'un clavier virtuel et appareil associé
US10656746B2 (en) Information processing device, information processing method, and program
CN112911147A (zh) 显示控制方法、显示控制装置及电子设备
CN104898880A (zh) 一种控制方法及电子设备
CN113655929A (zh) 界面显示的适配处理方法、装置和电子设备
CN105302459B (zh) 终端的单手控制方法及装置
US10318131B2 (en) Method for scaling down effective display area of screen, and mobile terminal
WO2023169499A1 (fr) Procédé de commande avec une seule main et appareil de commande pour écran tactile, dispositif électronique et support de stockage
WO2019201223A1 (fr) Procédé et appareil de commutation d'affichage d'écran et support d'informations
TWI603226B (zh) 體感偵測器之手勢辨識方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14883739

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14883739

Country of ref document: EP

Kind code of ref document: A1