WO2011088793A1 - Terminal and input method thereof - Google Patents

Terminal and input method thereof Download PDF

Info

Publication number
WO2011088793A1
WO2011088793A1 PCT/CN2011/070422 CN2011070422W WO2011088793A1 WO 2011088793 A1 WO2011088793 A1 WO 2011088793A1 CN 2011070422 W CN2011070422 W CN 2011070422W WO 2011088793 A1 WO2011088793 A1 WO 2011088793A1
Authority
WO
WIPO (PCT)
Prior art keywords
keyboard
input
terminal
button
distance
Prior art date
Application number
PCT/CN2011/070422
Other languages
French (fr)
Chinese (zh)
Inventor
刘俊峰
马文超
Original Assignee
北京联想软件有限公司
联想(北京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京联想软件有限公司, 联想(北京)有限公司 filed Critical 北京联想软件有限公司
Publication of WO2011088793A1 publication Critical patent/WO2011088793A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers

Definitions

  • the present invention relates to the field of input control technologies, and in particular, to a terminal and an input method thereof. Background technique
  • the computer includes an external input device such as a keyboard or a mouse, and an external input device can input specific information to the computer. For example, characters and various control commands can be input through the keyboard, and the movement of the cursor on the display desktop of the computer can be controlled by moving the mouse, and other commands can be further input by clicking or pressing the left and right buttons of the mouse.
  • a touchpad (TouchPad) is usually configured on a portable notebook, and the user can perform a mouse-like operation by sliding a finger on the touchpad. Summary of the invention
  • a technical problem to be solved by embodiments of the present invention is to provide a terminal and an input method thereof for inputting information to a computer.
  • An input method is applied to a terminal having a keyboard and an image collection unit, wherein an upper surface of the keyboard is located in a collection area of the image collection unit, and the keyboard includes at least one button, wherein Input methods include:
  • An input command is generated based on the movement trajectory.
  • the step of determining whether the distance between the input body and the upper surface of the keyboard is less than a predetermined value comprises:
  • the determining input body and the upper surface of the keyboard The steps of whether the distance is less than a predetermined value include:
  • the terminal has a keyboard pointing input mode and a keyboard key input mode, and before the step of determining whether the distance between the input body and the upper surface of the keyboard is less than a predetermined value, the method further includes:
  • the input command is a cursor control command.
  • the input command is a cursor control command
  • the input method further includes: receiving the button signal, and performing a left mouse button operation at a current position of the cursor according to the button signal.
  • the terminal includes a display unit, and when the moving track of the input body is on the upper surface of the keyboard, the input method further includes:
  • the set includes a first image of the input body
  • the first image is added to an original display image of the display unit.
  • the embodiment of the invention further provides a terminal, including:
  • keyboard comprising at least one button
  • a first determining unit configured to determine whether a distance between the input body and an upper surface of the keyboard is smaller than a predetermined value
  • a second determining unit configured to determine whether the at least one button generates a button signal, and an image collecting unit, wherein an upper surface of the keyboard is located in a collection area of the image collecting unit, and the distance is smaller than the Determining a predetermined value, and when the button signal is not generated, collecting a movement trajectory of the input body on an upper surface of the keyboard;
  • a command generating unit configured to generate an input command according to the moving track.
  • the first determining unit includes:
  • a first detecting unit configured to detect a change in a quantity of the electric quantity of the conductive layer disposed on the keyboard; and a third determining unit, configured to determine, when detecting that the change in the quantity of the electric quantity meets a predetermined condition The distance between the input body and the upper surface of the keyboard is less than the predetermined value.
  • the first determining unit includes:
  • a second detecting unit configured to detect whether an optical signal whose distance from the upper surface of the keyboard and the upper surface is less than the predetermined value is blocked
  • a fourth determining unit configured to determine that a distance between the input body and an upper surface of the keyboard is less than the predetermined value when detecting that the optical signal is occluded.
  • the terminal has a keyboard pointing input mode and a keyboard key input mode, and the terminal further includes:
  • a receiving unit configured to receive a control signal for instructing to enter the keyboard pointing input mode
  • a first control unit configured to control the terminal to enter the keyboard pointing input mode according to the control signal
  • the input command is a cursor control command
  • the terminal further includes:
  • a second control unit configured to: after the terminal enters the keyboard pointing input mode, receive the button signal, and perform a left mouse button operation at a current position of the cursor according to the button signal.
  • the image collection unit is further configured to collect a first image including the input body
  • the terminal further includes:
  • an adding unit configured to add the first image to an original display image of the display unit.
  • a terminal and an input method thereof are provided by using an upper surface of a keyboard as a keyboard input area, and the keyboard surface can provide a larger surface than a touch panel of a conventional portable notebook.
  • the input area is therefore convenient for the user's input operation.
  • the distance detection and the moving track set by combining the distance detection and the moving track set, after detecting that the distance between the user and the upper surface of the keyboard is less than a predetermined value, the movement track of the input body on the upper surface of the keyboard is started, and the distance detection and control are controlled. The timing of moving the trajectory is collected to obtain a true and accurate movement trajectory desired by the user, thereby improving the accuracy of the input and avoiding the problem of input misoperation.
  • the embodiment of the invention can not only realize the movement of the control cursor, but also realize various operations of the mouse, as well as text/character input (handwriting recognition), multi-touch input, scrolling operation and the like.
  • the embodiment of the invention also provides an input mode of the physical switch control terminal.
  • FIG. 1 is a schematic flow chart of an input method of a computer according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a keyboard pointing input area according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a light detection mode according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a camera detection mode according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a method for detecting a capacitive sensor according to an embodiment of the present invention
  • FIG. 6 is a schematic diagram showing the position of a camera that collects a moving track in an embodiment of the present invention
  • FIG. 8 is a schematic structural diagram of a terminal according to Embodiment 3 of the present invention.
  • FIG. 9a is a schematic structural diagram of a keyboard of a terminal according to an embodiment of the present invention.
  • 9b is a schematic structural diagram of a keyboard of a terminal according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a keyboard input mode controlled by a palm rest area according to an embodiment of the present invention
  • FIG. 11 is another schematic diagram of a keyboard input mode controlled by a palm rest area according to an embodiment of the present invention.
  • An embodiment of the present invention provides a method for inputting a terminal, where the terminal includes a keyboard and an image collection unit, and an upper surface of the keyboard is located in a collection area of the image collection unit and includes at least one button.
  • the input method determines whether a distance between the input body (such as a user's finger or a stylus pen) and the upper surface of the keyboard is less than a predetermined value, and determines whether the at least one button generates a button signal, where the distance is less than the predetermined value And when the button signal is not generated, the movement track of the input body on the upper surface of the keyboard is collected, and an input command is generated according to the movement track.
  • the input method of the computer in this embodiment includes the following steps:
  • Step 11 Determine whether a distance between the input body and the upper surface of the keyboard is less than a predetermined value, and whether a button of the keyboard generates a button signal.
  • the distance between the input body and the upper surface of the keyboard is less than a predetermined value, which means that the input body comes into contact with the upper surface of the keyboard, but the button on the keyboard is not pressed, or the button is pressed, but only the button is pressed. Part of it does not produce a button
  • the signal, or the input body and the upper surface of the keyboard are not in contact, but the distance between the two is small.
  • this embodiment uses the upper surface of the keyboard (the dotted line in the figure) as the keyboard pointing input area, which is obviously larger than the touch panel of the conventional notebook computer.
  • the input body which can be the user's finger, or other input components, such as a stylus, etc.
  • the upper surface of the keyboard There are several ways to determine the distance between the input body (which can be the user's finger, or other input components, such as a stylus, etc.) and the upper surface of the keyboard:
  • Light detecting mode detecting whether an optical signal whose distance from the upper surface of the keyboard and the upper surface is less than a predetermined value is blocked; when detecting that the optical signal is blocked, determining the input body and the The distance between the upper surfaces of the keyboard is less than a predetermined value.
  • the determination method may be the light detection method shown in FIG. 3 or the camera detection method shown in FIG. 4.
  • the light source 11 and the light receiver 23 are respectively disposed on both sides of the keyboard 21, and the light signal emitted by the light source 22 passes parallel to the upper surface of the keyboard, and finally reaches the light receiver 23.
  • the optical signal may also pass through the upper surface of the keyboard in parallel, but at a certain angle (small angle) with the upper surface of the keyboard, and then reach the optical receiver 23.
  • the optical signal it can be determined that the distance between the input body and the upper surface of the keyboard is less than the predetermined value; otherwise, if the optical receiver 23 can receive the optical signal, it is determined between the input body and the upper surface of the keyboard. The distance is greater than the predetermined value.
  • a camera 24 and a shielding plate 241 opposite to the camera 24 are respectively disposed on both sides of the keyboard 21, and the camera 24 captures the opposite shielding plate 241 from the side of the keyboard through the upper surface of the keyboard.
  • the principle of the camera 24 capturing the shutter 241 is also to receive the light signal reflected by the shutter 241. Therefore, it is assumed that the distance between a reflected light signal and the upper surface of the keyboard is a predetermined value, and the distance between the input body and the upper surface of the keyboard is smaller than When the predetermined value is described, the reflected optical signal is blocked by the input body, and the camera 24 receives the optical signal reflected by the input body, so that the background image including the input body can be captured.
  • the camera 24 cannot capture the input body, and only the background image including only the shielding plate 241 can be captured. Therefore, by setting the height of the shutter and the camera, you can Based on the captured image of the camera, it is determined whether the distance between the input body and the upper surface of the keyboard is less than the predetermined value.
  • Capacitance detection mode detecting a change in the electric quantity of the conductive layer provided on the keyboard; determining that the distance between the input body and the upper surface of the keyboard is less than a predetermined time when detecting that the change in the electric quantity satisfies a predetermined condition value. At this time, the capacitive sensor detection method shown in FIG.
  • a conductive layer 25 is disposed on the keyboard 21, and when the input body (such as a user's finger) comes into contact with the upper surface of the keyboard or the input body (such as a user's finger) approaches When the upper surface of the keyboard, the weak current transmission between the human body and the conductive layer 25 is caused, thereby causing a change in the electric quantity of the conductive layer 25 (such as a decrease in the amount of electricity); by detecting the change in the amount of electricity generated by the input body, and further When the change satisfies the predetermined condition, it is judged that the distance between the input body and the upper surface of the keyboard is smaller than the predetermined value.
  • Step 12 When the distance between the input body and the upper surface of the keyboard is less than the predetermined value, and the button signal is not generated, the moving track of the input body on the upper surface of the keyboard is collected.
  • this embodiment can set a camera on a computer (FIG. 6 takes a portable notebook as an example, and the principle is the same for other types of computers), the camera (the circle in FIG. 6 represents the same)
  • the camera is placed above the keyboard (such as directly above or above) to capture the entire upper surface of the keyboard.
  • the step of collecting the movement trajectory of the input body on the upper surface of the keyboard is: when the input body (such as a finger) moves on the upper surface of the keyboard, the camera recognizes the collected image, and obtains an input.
  • the position coordinates of the body, and then the movement trajectory of the input body is calculated according to the position coordinates.
  • the embodiment of the present invention can also collect the trajectory of the input body on the upper surface of the keyboard by other means.
  • Step 1 3 Generate an input command according to the movement track.
  • the input control of (touchpad) is similar: by moving the input body on the surface of the keyboard, the cursor of the mouse is displayed on the computer to display the motion track on the desktop. For example, according to the moving direction, speed and distance of the input body on the keyboard surface, the moving direction, speed and distance of the cursor on the display desktop are controlled accordingly, thereby implementing a cursor control command to the computer through the keyboard pointing operation, for controlling the cursor The purpose of the move.
  • the input command described in this embodiment may also be a gesture command.
  • a gesture command For example, when the movement track of the input body on the keyboard is a closed circle, a gesture for locking the screen is generated. When the movement of the input body on the keyboard is an "X" shape, a gesture command for closing the current window is generated.
  • the terminal has a keyboard key input mode and a keyboard pointing input mode at the same time, and the distance between the input body and the upper surface of the keyboard is less than the predetermined value, and the button signal is not generated.
  • the terminal operates according to the keyboard pointing input mode, and generates an input command according to the moving track. If, in the above process, the input body presses any button on the keyboard and generates a corresponding button signal, the terminal will operate in accordance with the normal keyboard key input mode to receive and process the button signal.
  • the image collection unit (such as the camera;) is turned on; and when the terminal performs the key input, the image collection unit (such as the camera) and the touch keyboard detection system are turned off to save Terminal power consumption.
  • the image collection unit can always work, but the terminal does not perform the conversion of the movement track and the input command when there is no finger input.
  • the physical switch mode can also be used to control the terminal to switch between the keyboard key input mode and the keyboard finger input mode, so that the terminal works only in one mode at the same time.
  • the embodiment further includes:
  • Step 10 Receive a control signal for instructing to enter a keyboard pointing input mode; and according to the control signal, controlling the terminal to enter the keyboard pointing input mode.
  • the above control signal is input through a physical switch.
  • the physical switch can be an additional manual dial switch or push button switch that controls the terminal to enter different keyboard input modes by dialing in different directions or pressing/pressing the switch.
  • the physical switch can also be implemented by using a light detection mode or a capacitance detection method similar to the detection of the distance between the input body and the upper surface of the keyboard in the above step 11: Referring to FIG. 10 and FIG. 11, the terminal is pre- Set the two palm rest areas 31, 32 (the two palm rest areas are set under the keyboard, that is, the two palm rest areas are set on the host between the keyboard and the user), and the first contact body 33 and the first palm are judged.
  • the keyboard input mode is automatically switched to the keyboard key input.
  • the automatic switching keyboard input mode is Keyboard pointing input mode formula.
  • the terminal when When the user puts both hands on the two palm rest areas on the keyboard, the terminal will enter the keyboard key input mode; when the user only places one hand on a palm rest area on the keyboard, the terminal will enter the keyboard pointing input mode.
  • the contact body here is different from the aforementioned input body, and the contact body is controlled to enter the keyboard key input mode by contact with the palm rest area.
  • the contact body may be the user's wrist; the aforementioned input body and the upper surface of the keyboard Contact or not is a control condition of the trajectory set.
  • the input body is usually a user's finger or a stylus.
  • the image gathering unit (such as a camera) is turned on; after the computer exits the keyboard pointing input mode, the camera and the touch keyboard detecting system are turned off (or only one of them is turned off), Save equipment power consumption.
  • the image collection unit can always work, but the terminal does not perform the conversion of the movement track and the input command when there is no finger input.
  • the embodiment may further receive a button signal generated after the button on the keyboard is pressed, and perform a corresponding operation according to the button signal.
  • a button signal generated when any button on the keyboard is pressed is received, and after receiving the button signal, a left mouse button operation is performed at a current position of the cursor.
  • the left mouse button operation includes a left click and a left button double click operation, for example, if the button signal is received only once within a predetermined time, a left mouse click operation is performed; if the button is received twice within a predetermined time When the button signal is pressed, the left mouse button double click operation is performed.
  • the mouse drag operation may be performed according to the button signal, that is, the object at the cursor position is dragged when the button signal is initially received.
  • one (or one type of) button may be preset to correspond to the left mouse button, and the other (or another type) button is set to correspond to the right mouse button.
  • the left mouse button operation also includes a left click and a double click operation
  • the right mouse button operation also includes a right click and a double click operation. If the button signal generated by the one (or one type) button is continuously received, the mouse drag operation can also be performed according to the button signal generated by the one (or one type) button.
  • this embodiment has the following advantages:
  • the upper surface of the keyboard is used as the keyboard input area.
  • the touchpad input of the notebook, the upper surface of the keyboard of the embodiment can provide a larger input area, and thus can facilitate the input operation of the user.
  • the embodiment can provide the input accuracy and avoid the problem of input misoperation, because the prior art only passes the camera.
  • the movement path of the input body for example, when the user wants to control the right movement of the mouse, moves the input body to the right to attempt to input a trajectory that moves to the right. Since the user action usually has a "reciprocating" feature, it is customary to return the input body to the initial position after moving the input body to the right. In this case, the camera cannot determine when to start the collection and when to stop the collection movement, so the camera may collect a reciprocating movement trajectory that does not match the trajectory that the user wants to input to the right.
  • the input body approaches or touches the upper surface of the keyboard and does not generate a button signal, and the set of the moving track is triggered at this time; when the user wants to stop the input, the input body is input. Away from the upper surface of the keyboard, the stop movement trajectory set can be triggered, so that the trajectory collected by the ⁇ conforms to the user's expectation, and the problem of input misoperation is reduced.
  • the terminal in this embodiment may further include a display unit, and the input method may further add an image of the input body to the display image by superimposing the display manner.
  • Fig. 7 shows an application scenario of the above-described superimposed display processing, and when the user operates on the upper surface of the keyboard by the hand, an image including the control of the user's hand directly to the operation target can be seen on the display unit.
  • the input method of the embodiment when used to collect the moving track of the input body on the upper surface of the keyboard, the method further includes:
  • Step 21 The set includes the first image of the input body.
  • the image capturing unit 71 may be used to collect an image of the input body (such as the user's hand 72 in FIG. 7), position the input body, and analyze the motion of the input body. It is also possible to control the image collection unit 71 to collect the first image including the input body only when the distance between the input body and the upper surface of the keyboard is less than a predetermined value and the key signal is not generated.
  • the image collected in the image includes a background image, such as a keyboard image, in addition to the input body.
  • the image collected by the image collection unit 71 may be directly used as the first image; the image collected by the image collection unit 71 may be further processed to filter out the background image, and only the image is retained.
  • An image of the input body as the first image.
  • Step 22 Add the first image to an original display image of the display unit.
  • the original display image may be a real image on the desktop, such as a shortcut icon or a window on the desktop, or may be a virtual content generated by the terminal, for the user to operate and observe, such as a picture to be operated by the user.
  • the original display image may be controlled to be correspondingly changed according to the motion of the input body, for example, according to the movement trajectory of the input body.
  • the drag mode changes the position of the original display image, and changes the size of the original display image.
  • the image collection unit collects the input body and draws an "X" on the surface of the keyboard.
  • the image of the input body is synchronously displayed on the display unit, and the input body draws an "X" on the current window.
  • the action is displayed, and then the corresponding current window close command is generated according to "X" to close the current window.
  • the moving track itself can be superimposed and displayed on the original display image, that is, the "X" type moving track is displayed in the window until the user ends the input.
  • the embodiment provides a terminal.
  • the terminal includes:
  • keyboard comprising at least one button
  • a first determining unit configured to determine whether a distance between the input body and an upper surface of the keyboard is smaller than a predetermined value
  • a second determining unit configured to determine whether the at least one button generates a button signal, and an image collecting unit, wherein an upper surface of the keyboard is located in a collection area of the image collecting unit, and the distance is smaller than the Determining a predetermined value, and when the button signal is not generated, collecting a movement trajectory of the input body on an upper surface of the keyboard;
  • a command generating unit configured to generate an input command according to the moving track.
  • the first determining unit includes:
  • a first detecting unit configured to detect a change in the amount of the electric quantity of the conductive layer disposed on the keyboard; and a third determining unit, configured to determine the input body and the keyboard when detecting that the change in the electric quantity meets a predetermined condition The distance between the surfaces is less than the predetermined value.
  • FIG. 9a a structure of the keyboard of the terminal in this embodiment is as shown in FIG. 9a.
  • At least one button is mounted on the circuit board 91.
  • the circuit board is used to generate a button signal when the button is fully pressed.
  • the specific principle is the same as that of the ordinary keyboard, and details are not described herein. Only one button is shown in Figure 9a.
  • the button includes a plastic keycap 92, an elastic conductive rubber member 93, and a button holder 96 (for example, an X-type button holder;).
  • the inner surface of the key cap 92 is covered with a first conductive layer (such as a plated metal layer) 95, and the upper surface of the circuit board 91 is covered with a second conductive layer 94.
  • the upper end of the elastic conductive rubber member 93 is connected to the first conductive layer 95, and the lower end is connected to the second conductive layer 94.
  • the upper end of the button holder 96 is connected to the key cap 92, and the lower end is connected to the bottom plate located under the circuit board 91.
  • the second conductive layer 94 is electrically connected to the first conductive layer 95 through the elastic conductive rubber member 93.
  • the second conductive layer 94 is connected to a first detecting unit (such as an IC), and the first detecting unit is configured to detect a change in the amount of electricity on the second conductive layer 94.
  • a first detecting unit such as an IC
  • the first detecting unit is configured to detect a change in the amount of electricity on the second conductive layer 94.
  • each of the first conductive layers 95 on the keycap of each of the keys is connected to the second conductive layer 94 of the circuit board 91 through the elastic conductive rubber member, it is only necessary to provide one and the second conductive layer 94.
  • the connected first detecting unit can detect the contact between the input body and any button, and does not need to set a first detecting unit for each button, thereby saving hardware cost and simplifying structural design.
  • the conductive layer disposed on the keyboard comprises: a first conductive layer, a second conductive layer and a conductive connection.
  • the first conductive layer 95 is exemplified by a metal layer
  • the setting manner comprises: the key cap itself is a metal; or the key cap itself is a painted metal; or the metal layer is placed under the plastic key cap; or the metal layer is placed Painted plastic under the key cap.
  • the conductive connecting portion can also use the keyboard bracket.
  • a structure of the keyboard of the terminal in this embodiment can also be as shown in FIG. 9b.
  • at least one button is mounted on the circuit board 91, and the circuit board is configured to generate a button signal when the button is fully pressed. Only one button is shown in Figure 9b.
  • the button includes a plastic key cap 92, an elastic rubber member 93 and a conductive button bracket 96 (specifically, a metal bracket or a metal plated plastic bracket).
  • the upper end of the elastic rubber member 93 is connected to the inner surface of the key cap 92, and the lower end is connected to the circuit board 91. The upper surface is connected.
  • the inner surface of the keycap 92 is covered with a first conductive layer (such as a plated metal layer) 95, and a second conductive layer 94 (such as a metal shoe) is disposed under the circuit board 91.
  • the upper end of the conductive button holder 96 is connected to the first conductive layer 95, and the lower end is connected to the second conductive layer 94.
  • the second conductive layer 94 is electrically connected to the first conductive layer 95 through the conductive button holder 96.
  • the second conductive layer 94 is connected to a first detecting unit (such as an IC), and the first detecting unit is configured to detect a change in the amount of electricity on the second conductive layer 94.
  • the third determining unit can determine the input according to the change in the amount of electricity.
  • the body is in contact with the upper surface of the keyboard or the distance therebetween is less than a predetermined value.
  • the first conductive layers 95 on the keycap of each button is connected to the second conductive layer 94 through the conductive button holder, only one of the second conductive layers 94 needs to be electrically connected.
  • the first detecting unit can detect the contact between the input body and any button, and does not need to provide a first detecting unit for each button, thereby saving hardware cost and simplifying structural design.
  • a plurality of second conductive layers and a plurality of first detecting units may also be provided.
  • the first determining unit includes:
  • a second detecting unit configured to detect whether an optical signal whose distance from the upper surface of the keyboard and the upper surface is less than a predetermined value is blocked
  • a fourth determining unit configured to determine that a distance between the input body and an upper surface of the keyboard is less than the predetermined value when detecting that the optical signal is occluded.
  • the terminal has a keyboard pointing input mode and a keyboard key input mode, and the terminal further includes:
  • a receiving unit configured to receive a control signal for instructing to enter the keyboard pointing input mode
  • a first control unit configured to control the terminal to enter the keyboard pointing input mode according to the control signal
  • the input command is a cursor control command
  • the terminal further includes:
  • a second control unit configured to: after the terminal enters the keyboard pointing input mode, receive the button signal, and perform a left mouse click operation at a current position of the cursor according to the button signal.
  • the image collection unit is further configured to collect the first image including the input body.
  • the terminal further includes:
  • an adding unit configured to add the first image to an original display image of the display unit.
  • the embodiments of the present invention provide a terminal input method and a terminal, which can input a control command for a cursor and input a corresponding mouse operation.

Abstract

A terminal and an input method thereof are provided. The method comprises: determining whether the distance between an input object and the upper surface of a keyboard is less than a predetermined value; determining whether a keying signal is generated by at least a press key; when the distance is less than the predetermined value and there is no keying signal generated, collecting the motion trail of the input object on the upper surface of the keyboard; and generating an input command based on the motion trail. The method provides a new way to input information to the terminal.

Description

一种终端及其输入方法 技术领域  Terminal and input method thereof
本发明涉及输入控制技术领域, 具体涉及一种终端及其输入方法。 背景技术  The present invention relates to the field of input control technologies, and in particular, to a terminal and an input method thereof. Background technique
目前, 计算机包括有键盘、 鼠标等外部输入设备, 通过外部输入设备可 以向计算机输入特定的信息。例如,通过键盘可以输入字符和各种控制命令, 通过移动鼠标可以控制计算机的显示桌面上的光标的移动,通过鼠标左右键 的点击或按压操作, 还可以进一步输入其它命令。 在便携式笔记本电脑上通 常会配置有触摸板(TouchPad ), 用户通过在触摸板上滑动手指, 可以进行 类似移动鼠标的操作。 发明内容  Currently, the computer includes an external input device such as a keyboard or a mouse, and an external input device can input specific information to the computer. For example, characters and various control commands can be input through the keyboard, and the movement of the cursor on the display desktop of the computer can be controlled by moving the mouse, and other commands can be further input by clicking or pressing the left and right buttons of the mouse. A touchpad (TouchPad) is usually configured on a portable notebook, and the user can perform a mouse-like operation by sliding a finger on the touchpad. Summary of the invention
本发明实施例所要解决的技术问题是提供一种终端及其输入方法,用以 向计算机输入信息。  A technical problem to be solved by embodiments of the present invention is to provide a terminal and an input method thereof for inputting information to a computer.
为解决上述技术问题, 本发明实施例提供方案如下:  To solve the above technical problem, the solution provided by the embodiment of the present invention is as follows:
一种输入方法, 应用于具有键盘和图像釆集单元的终端, 所述键盘的上 表面位于所述图像釆集单元的釆集区域内, 所述键盘包括至少一个按键, 其 特征在于, 所述输入方法包括:  An input method is applied to a terminal having a keyboard and an image collection unit, wherein an upper surface of the keyboard is located in a collection area of the image collection unit, and the keyboard includes at least one button, wherein Input methods include:
判断输入体与所述键盘的上表面之间的距离是否小于预定值;  Determining whether a distance between the input body and an upper surface of the keyboard is less than a predetermined value;
判断所述至少一个按键是否产生按键信号;  Determining whether the at least one button generates a button signal;
在所述距离小于所述预定值, 并且未产生所述按键信号时, 釆集所述输 入体在所述键盘的上表面的移动轨迹;  And when the distance is less than the predetermined value, and the button signal is not generated, collecting a movement trajectory of the input body on an upper surface of the keyboard;
根据所述移动轨迹, 生成输入命令。  An input command is generated based on the movement trajectory.
优选地, 上述输入方法中, 所述判断输入体与所述键盘的上表面之间的 距离是否小于预定值的步骤包括:  Preferably, in the above input method, the step of determining whether the distance between the input body and the upper surface of the keyboard is less than a predetermined value comprises:
检测所述键盘上设置的导电层的电量变化;  Detecting a change in the amount of electricity of the conductive layer disposed on the keyboard;
在检测到所述电量变化满足预定条件时,判断所述输入体与所述键盘的 上表面之间的距离小于所述预定值。  When it is detected that the change in the electric quantity satisfies a predetermined condition, it is judged that the distance between the input body and the upper surface of the keyboard is smaller than the predetermined value.
优选地, 上述输入方法中, 所述判断输入体与所述键盘的上表面之间的 距离是否小于预定值的步骤包括: Preferably, in the above input method, the determining input body and the upper surface of the keyboard The steps of whether the distance is less than a predetermined value include:
检测所述键盘的上表面上方与所述上表面距离小于所述预定值的光信 号是否被遮挡;  Detecting whether an optical signal having a distance from the upper surface above the upper surface of the keyboard that is less than the predetermined value is blocked;
在检测到所述光信号被遮挡时,判断所述输入体与所述键盘的上表面之 间的距离小于所述预定值。  Upon detecting that the optical signal is occluded, it is determined that the distance between the input body and the upper surface of the keyboard is less than the predetermined value.
优选地, 上述输入方法中, 所述终端具有键盘指点输入模式和键盘按键 输入模式,在所述判断输入体与所述键盘的上表面之间的距离是否小于预定 值的步骤之前, 还包括:  Preferably, in the above input method, the terminal has a keyboard pointing input mode and a keyboard key input mode, and before the step of determining whether the distance between the input body and the upper surface of the keyboard is less than a predetermined value, the method further includes:
接收用于指示进入所述键盘指点输入模式的控制信号;  Receiving a control signal for instructing entry into the keyboard pointing input mode;
4艮据所述控制信号, 控制所述终端进入所述键盘指点输入模式。  4, according to the control signal, controlling the terminal to enter the keyboard pointing input mode.
优选地, 上述输入方法中, 所述输入命令为光标控制命令。  Preferably, in the above input method, the input command is a cursor control command.
优选地, 上述输入方法中, 所述输入命令为光标控制命令;  Preferably, in the above input method, the input command is a cursor control command;
在控制所述终端进入所述键盘指点输入模式后, 所述输入方法还包括: 接收所述按键信号,根据所述按键信号, 在光标当前位置处执行鼠标左 键操作。  After controlling the terminal to enter the keyboard pointing input mode, the input method further includes: receiving the button signal, and performing a left mouse button operation at a current position of the cursor according to the button signal.
优选地, 上述输入方法中, 所述终端包括显示单元, 在釆集所述输入体 在所述键盘的上表面的移动轨迹时, 所述输入方法还包括:  Preferably, in the above input method, the terminal includes a display unit, and when the moving track of the input body is on the upper surface of the keyboard, the input method further includes:
釆集包括所述输入体的第一图像;  The set includes a first image of the input body;
将所述第一图像添加到所述显示单元的原始显示图像中。  The first image is added to an original display image of the display unit.
本发明实施例还提供了一种终端, 包括:  The embodiment of the invention further provides a terminal, including:
键盘, 所述键盘包括至少一个按键;  a keyboard, the keyboard comprising at least one button;
第一判断单元,用于判断输入体与所述键盘的上表面之间的距离是否小 于预定值;  a first determining unit, configured to determine whether a distance between the input body and an upper surface of the keyboard is smaller than a predetermined value;
第二判断单元, 用于判断所述至少一个按键是否产生按键信号; 图像釆集单元, 所述键盘的上表面位于所述图像釆集单元的釆集区域 内, 用于在所述距离小于所述预定值, 并且未产生所述按键信号时, 釆集所 述输入体在所述键盘的上表面的移动轨迹;  a second determining unit, configured to determine whether the at least one button generates a button signal, and an image collecting unit, wherein an upper surface of the keyboard is located in a collection area of the image collecting unit, and the distance is smaller than the Determining a predetermined value, and when the button signal is not generated, collecting a movement trajectory of the input body on an upper surface of the keyboard;
命令生成单元, 用于根据所述移动轨迹, 生成输入命令。  And a command generating unit, configured to generate an input command according to the moving track.
优选地, 上述终端中, 所述第一判断单元包括:  Preferably, in the foregoing terminal, the first determining unit includes:
第一检测单元, 用于检测所述键盘上设置的导电层的电量变化; 第三判断单元, 用于在检测到所述电量变化满足预定条件时, 判断所述 输入体与所述键盘的上表面之间的距离小于所述预定值。 a first detecting unit, configured to detect a change in a quantity of the electric quantity of the conductive layer disposed on the keyboard; and a third determining unit, configured to determine, when detecting that the change in the quantity of the electric quantity meets a predetermined condition The distance between the input body and the upper surface of the keyboard is less than the predetermined value.
优选地, 上述终端中, 所述第一判断单元包括:  Preferably, in the foregoing terminal, the first determining unit includes:
第二检测单元,用于检测所述键盘的上表面上方与所述上表面距离小于 所述预定值的光信号是否被遮挡;  a second detecting unit, configured to detect whether an optical signal whose distance from the upper surface of the keyboard and the upper surface is less than the predetermined value is blocked;
第四判断单元, 用于在检测到所述光信号被遮挡时, 判断所述输入体与 所述键盘的上表面之间的距离小于所述预定值。  And a fourth determining unit, configured to determine that a distance between the input body and an upper surface of the keyboard is less than the predetermined value when detecting that the optical signal is occluded.
优选地, 上述终端中, 所述终端具有键盘指点输入模式和键盘按键输入 模式, 所述终端还包括:  Preferably, in the terminal, the terminal has a keyboard pointing input mode and a keyboard key input mode, and the terminal further includes:
接收单元, 用于接收用于指示进入所述键盘指点输入模式的控制信号; 第一控制单元, 用于根据所述控制信号,控制所述终端进入所述键盘指 点输入模式。  a receiving unit, configured to receive a control signal for instructing to enter the keyboard pointing input mode; and a first control unit, configured to control the terminal to enter the keyboard pointing input mode according to the control signal.
优选地, 上述终端中, 所述输入命令为光标控制命令;  Preferably, in the terminal, the input command is a cursor control command;
所述终端还包括:  The terminal further includes:
第二控制单元, 用于在所述终端进入所述键盘指点输入模式后,接收所 述按键信号, 根据所述按键信号, 在光标当前位置处执行鼠标左键操作。  And a second control unit, configured to: after the terminal enters the keyboard pointing input mode, receive the button signal, and perform a left mouse button operation at a current position of the cursor according to the button signal.
优选地, 上述终端中,  Preferably, in the above terminal,
所述图像釆集单元还用于釆集包括所述输入体的第一图像;  The image collection unit is further configured to collect a first image including the input body;
所述终端还包括:  The terminal further includes:
显示单元;  Display unit;
添加单元, 用于将所述第一图像添加到所述显示单元的原始显示图像 中。  And an adding unit, configured to add the first image to an original display image of the display unit.
从以上所述可以看出, 本发明实施例提供的一种终端及其输入方法, 釆 用键盘上表面作为键盘指点输入的区域,相对于传统的便携式笔记本的触摸 板, 键盘表面能够提供更大的输入面积, 因此能够方便用户的输入操作。 本 发明实施例通过将距离检测和移动轨迹釆集相结合,在检测到用户与键盘上 表面的距离小于预定值后, 才开始釆集输入体在键盘上表面的移动轨迹, 通 过距离检测, 控制移动轨迹釆集的时机, 以获取到用户期望输入的真实、 准 确的移动轨迹, 从而可以提高输入的准确性, 并可避免输入误操作的问题。 本发明实施例不仅可以实现控制光标的移动, 还可以实现鼠标的多种操作, 以及文字 /字符输入(手写识别)、 多点触控输入、 滚屏操作等。 本发明实施 例还提供了物理开关控制终端的输入模式。 附图说明 It can be seen from the above that a terminal and an input method thereof are provided by using an upper surface of a keyboard as a keyboard input area, and the keyboard surface can provide a larger surface than a touch panel of a conventional portable notebook. The input area is therefore convenient for the user's input operation. In the embodiment of the present invention, by combining the distance detection and the moving track set, after detecting that the distance between the user and the upper surface of the keyboard is less than a predetermined value, the movement track of the input body on the upper surface of the keyboard is started, and the distance detection and control are controlled. The timing of moving the trajectory is collected to obtain a true and accurate movement trajectory desired by the user, thereby improving the accuracy of the input and avoiding the problem of input misoperation. The embodiment of the invention can not only realize the movement of the control cursor, but also realize various operations of the mouse, as well as text/character input (handwriting recognition), multi-touch input, scrolling operation and the like. The embodiment of the invention also provides an input mode of the physical switch control terminal. DRAWINGS
图 1为本发明实施例所述计算机的输入方法的流程示意图;  1 is a schematic flow chart of an input method of a computer according to an embodiment of the present invention;
图 2为本发明实施例中键盘指点输入区域的示意图;  2 is a schematic diagram of a keyboard pointing input area according to an embodiment of the present invention;
图 3为本发明实施例中光检测方式的示意图;  3 is a schematic diagram of a light detection mode according to an embodiment of the present invention;
图 4为本发明实施例中摄像头检测方式的示意图;  4 is a schematic diagram of a camera detection mode according to an embodiment of the present invention;
图 5为本发明实施例中电容传感器检测方式的示意图;  FIG. 5 is a schematic diagram of a method for detecting a capacitive sensor according to an embodiment of the present invention; FIG.
图 6为本发明实施例中釆集移动轨迹的摄像头的位置示意图;  6 is a schematic diagram showing the position of a camera that collects a moving track in an embodiment of the present invention;
图 7为本发明实施例中叠加显示的流程示意图;  7 is a schematic flowchart of superimposed display in an embodiment of the present invention;
图 8为本发明实施例 3所述终端的结构示意图;  8 is a schematic structural diagram of a terminal according to Embodiment 3 of the present invention;
图 9a为本发明实施例所述终端的键盘的一种结构示意图;  9a is a schematic structural diagram of a keyboard of a terminal according to an embodiment of the present invention;
图 9b为本发明实施例所述终端的键盘的一种结构示意图;  9b is a schematic structural diagram of a keyboard of a terminal according to an embodiment of the present invention;
图 10为本发明实施例中通过掌托区域控制键盘输入模式的示意图; 图 11为本发明实施例中通过掌托区域控制键盘输入模式的另一示意 图。 具体实施方式  FIG. 10 is a schematic diagram of a keyboard input mode controlled by a palm rest area according to an embodiment of the present invention; FIG. 11 is another schematic diagram of a keyboard input mode controlled by a palm rest area according to an embodiment of the present invention. detailed description
本发明实施例提供了一种终端的输入方法,该终端包括键盘和图像釆集 单元, 所述键盘的上表面位于所述图像釆集单元的釆集区域内, 且包括至少 一个按键。 该输入方法判断输入体 (如用户的手指或输入笔等 )与键盘上表 面之间的距离是否小于预定值, 以及判断所述至少一个按键是否产生按键信 号, 在所述距离小于所述预定值, 并且未产生所述按键信号时, 釆集所述输 入体在所述键盘的上表面的移动轨迹, 进而根据所述移动轨迹, 生成输入命 令。  An embodiment of the present invention provides a method for inputting a terminal, where the terminal includes a keyboard and an image collection unit, and an upper surface of the keyboard is located in a collection area of the image collection unit and includes at least one button. The input method determines whether a distance between the input body (such as a user's finger or a stylus pen) and the upper surface of the keyboard is less than a predetermined value, and determines whether the at least one button generates a button signal, where the distance is less than the predetermined value And when the button signal is not generated, the movement track of the input body on the upper surface of the keyboard is collected, and an input command is generated according to the movement track.
以下将结合附图, 通过具体实施例对本发明作进一步的说明。 以下实施 例中, 以计算机作为终端进行说明。  The present invention will be further described by way of specific embodiments with reference to the accompanying drawings. In the following embodiments, a computer will be described as a terminal.
请参照图 1 , 本实施例所述计算机的输入方法包括以下步骤:  Referring to FIG. 1, the input method of the computer in this embodiment includes the following steps:
步骤 11 , 判断输入体与所述键盘的上表面之间的距离是否小于预定值, 以及所述键盘的按键是否产生按键信号。 这里, 输入体与键盘上表面之间的 距离小于预定值, 是指输入体与键盘上表面发生了接触, 但是没有按下键盘 上的按键、 或者是虽然按下了按键, 但只是按下了一部分, 并没有产生按键 信号、 或者是输入体与键盘上表面虽然没有发生接触, 但是两者之间的距离 很小。 Step 11: Determine whether a distance between the input body and the upper surface of the keyboard is less than a predetermined value, and whether a button of the keyboard generates a button signal. Here, the distance between the input body and the upper surface of the keyboard is less than a predetermined value, which means that the input body comes into contact with the upper surface of the keyboard, but the button on the keyboard is not pressed, or the button is pressed, but only the button is pressed. Part of it does not produce a button The signal, or the input body and the upper surface of the keyboard are not in contact, but the distance between the two is small.
如图 2所示, 以便携式笔记本电脑为例, 本实施例将键盘上表面(图中 虚线部分)作为键盘指点输入区域, 该区域显然大于传统的笔记本电脑的触 摸板。 输入体(可以是用户的手指、 或其它输入部件, 如手写笔等)与键盘 上表面之间的距离的判断方式有多种:  As shown in Fig. 2, taking a portable notebook computer as an example, this embodiment uses the upper surface of the keyboard (the dotted line in the figure) as the keyboard pointing input area, which is obviously larger than the touch panel of the conventional notebook computer. There are several ways to determine the distance between the input body (which can be the user's finger, or other input components, such as a stylus, etc.) and the upper surface of the keyboard:
( 1 )光检测方式: 检测所述键盘的上表面上方与所述上表面距离小于 预定值的光信号是否被遮挡; 在检测到所述光信号被遮挡时, 判断所述输入 体与所述键盘的上表面之间的距离小于预定值。  (1) Light detecting mode: detecting whether an optical signal whose distance from the upper surface of the keyboard and the upper surface is less than a predetermined value is blocked; when detecting that the optical signal is blocked, determining the input body and the The distance between the upper surfaces of the keyboard is less than a predetermined value.
这种判断方式具体可以釆用图 3所示的光检测方式或图 4所示的摄像头 检测方式。  Specifically, the determination method may be the light detection method shown in FIG. 3 or the camera detection method shown in FIG. 4.
其中, 图 3所示的光检测方式中, 通过在键盘 21两侧分别设置光源 11 和光接收器 23 , 该光源 22发出的光信号平行经过键盘上表面的上方, 最终 到达光接收器 23。 当然, 光信号也可以不是平行地经过键盘上表面的上方, 而是与键盘上表面呈现一定的夹角 (角度较小), 然后到达光接收器 23。 这 样, 假设光信号与键盘上表面之间的距离是预定值, 当输入体与键盘上表面 之间的距离小于所述预定值时, 光信号将被输入体遮挡, 光接收器 23不能 接收到光信号时, 此时能够判断出输入体与键盘上表面之间的距离小于所述 预定值; 反之, 如果光接收器 23能够接收到光信号时, 则判断输入体与键 盘上表面之间的距离大于所述预定值。  In the light detecting mode shown in FIG. 3, the light source 11 and the light receiver 23 are respectively disposed on both sides of the keyboard 21, and the light signal emitted by the light source 22 passes parallel to the upper surface of the keyboard, and finally reaches the light receiver 23. Of course, the optical signal may also pass through the upper surface of the keyboard in parallel, but at a certain angle (small angle) with the upper surface of the keyboard, and then reach the optical receiver 23. Thus, assuming that the distance between the optical signal and the upper surface of the keyboard is a predetermined value, when the distance between the input body and the upper surface of the keyboard is less than the predetermined value, the optical signal will be blocked by the input body, and the optical receiver 23 cannot receive the optical signal. In the case of the optical signal, it can be determined that the distance between the input body and the upper surface of the keyboard is less than the predetermined value; otherwise, if the optical receiver 23 can receive the optical signal, it is determined between the input body and the upper surface of the keyboard. The distance is greater than the predetermined value.
其中, 图 4所示的摄像头检测方式中, 在键盘 21的两侧分别设置一摄 像头 24和与摄像头 24相对的遮挡板 241 ,该摄像头 24从键盘侧面经过键盘 上表面拍摄对面的遮挡板 241。摄像头 24拍摄遮挡板 241的原理也是接收遮 挡板 241反射的光信号, 因此, 假设某个反射的光信号与键盘上表面的距离 是预定值, 当输入体与键盘上表面之间的距离小于所述预定值时, 该反射的 光信号将被输入体遮挡, 摄像头 24将接收到输入体反射的光信号, 从而能 够拍摄到包含有该输入体的背景图像。 于是, 通过判断拍摄到的背景图像的 差异(即无输入体时的初始背景图像和有输入体时的背景图像), 判断出输 入体与键盘上表面之间的距离是否小于所述预定值; 反之, 在该输入体远离 键盘上表面时, 该摄像头 24不能拍摄到该输入体, 而只能拍摄到仅包含有 遮挡板 241的背景图像。 因此, 通过设置好遮挡板和摄像头的高度, 就可以 根据该摄像头的拍摄图像, 判断输入体与键盘上表面之间的距离是否小于所 述预定值。 In the camera detection method shown in FIG. 4, a camera 24 and a shielding plate 241 opposite to the camera 24 are respectively disposed on both sides of the keyboard 21, and the camera 24 captures the opposite shielding plate 241 from the side of the keyboard through the upper surface of the keyboard. The principle of the camera 24 capturing the shutter 241 is also to receive the light signal reflected by the shutter 241. Therefore, it is assumed that the distance between a reflected light signal and the upper surface of the keyboard is a predetermined value, and the distance between the input body and the upper surface of the keyboard is smaller than When the predetermined value is described, the reflected optical signal is blocked by the input body, and the camera 24 receives the optical signal reflected by the input body, so that the background image including the input body can be captured. Therefore, by judging the difference of the captured background image (ie, the initial background image when there is no input body and the background image when there is an input body), it is determined whether the distance between the input body and the upper surface of the keyboard is less than the predetermined value; On the other hand, when the input body is away from the upper surface of the keyboard, the camera 24 cannot capture the input body, and only the background image including only the shielding plate 241 can be captured. Therefore, by setting the height of the shutter and the camera, you can Based on the captured image of the camera, it is determined whether the distance between the input body and the upper surface of the keyboard is less than the predetermined value.
( 2 ) 电容检测方式: 检测所述键盘上设置的导电层的电量变化; 在检 测到所述电量变化满足预定条件时, 判断所述输入体与所述键盘的上表面之 间的距离小于预定值。 此时, 可以釆用图 5所示的电容传感器检测方式: 在 键盘 21上布置一层导电层 25 , 当输入体(如用户手指)与键盘上表面发生 接触或输入体(如用户手指)接近键盘上表面时, 将引发人体与导电层 25 之间的微弱电流传输, 从而导致导电层 25的电量变化(如电量减少); 通过 检测到所述输入体引发的电量变化, 进而在所述电量变化满足预定条件时, 判断输入体与键盘上表面之间的距离小于所述预定值。  (2) Capacitance detection mode: detecting a change in the electric quantity of the conductive layer provided on the keyboard; determining that the distance between the input body and the upper surface of the keyboard is less than a predetermined time when detecting that the change in the electric quantity satisfies a predetermined condition value. At this time, the capacitive sensor detection method shown in FIG. 5 can be used: a conductive layer 25 is disposed on the keyboard 21, and when the input body (such as a user's finger) comes into contact with the upper surface of the keyboard or the input body (such as a user's finger) approaches When the upper surface of the keyboard, the weak current transmission between the human body and the conductive layer 25 is caused, thereby causing a change in the electric quantity of the conductive layer 25 (such as a decrease in the amount of electricity); by detecting the change in the amount of electricity generated by the input body, and further When the change satisfies the predetermined condition, it is judged that the distance between the input body and the upper surface of the keyboard is smaller than the predetermined value.
步骤 12 , 在输入体与所述键盘的上表面之间的距离小于所述预定值, 并且未产生所述按键信号时, 釆集所述输入体在所述键盘的上表面的移动轨 迹。  Step 12: When the distance between the input body and the upper surface of the keyboard is less than the predetermined value, and the button signal is not generated, the moving track of the input body on the upper surface of the keyboard is collected.
这里,如图 6所示,例如,本实施例可以在计算机上设置一个摄像头(图 6以便携式笔记本为例, 对于其它类型的计算机, 原理相同 ), 该摄像头(图 6中的圓形代表该摄像头)置于键盘的上方(如正上方或前上方), 能够拍摄 整个键盘上表面。 这里, 所述釆集所述输入体在所述键盘的上表面的移动轨 迹的步骤是, 当输入体(如手指)在键盘上表面移动时, 摄像头对釆集到的 图像进行识别, 获取输入体的位置坐标, 进而根据所述位置坐标, 计算得到 所述输入体的移动轨迹。 当然, 本领域技术人员可以理解, 本发明的实施例 也可以釆用其它方式来釆集所述输入体在所述键盘的上表面的移动轨迹。  Here, as shown in FIG. 6, for example, this embodiment can set a camera on a computer (FIG. 6 takes a portable notebook as an example, and the principle is the same for other types of computers), the camera (the circle in FIG. 6 represents the same) The camera is placed above the keyboard (such as directly above or above) to capture the entire upper surface of the keyboard. Here, the step of collecting the movement trajectory of the input body on the upper surface of the keyboard is: when the input body (such as a finger) moves on the upper surface of the keyboard, the camera recognizes the collected image, and obtains an input. The position coordinates of the body, and then the movement trajectory of the input body is calculated according to the position coordinates. Of course, those skilled in the art can understand that the embodiment of the present invention can also collect the trajectory of the input body on the upper surface of the keyboard by other means.
步骤 1 3 , 根据所述移动轨迹, 生成输入命令。 计算机的显示内容上的移动。 此时的光标控制与通常的笔记本触摸板  Step 1 3: Generate an input command according to the movement track. The movement of the computer's display content. Cursor control at this time with the usual notebook touchpad
( touchpad )的输入控制相类似: 通过将输入体在键盘表面的移动轨迹, 映 射到鼠标的光标在计算机显示桌面上的运动轨迹。 例如, 根据输入体在键盘 表面的移动方向、 速度和距离, 相应地控制光标在显示桌面上的移动方向、 速度和距离, 进而实现通过键盘指点操作, 向计算机输入光标控制命令, 用 以控制光标移动的目的。  The input control of (touchpad) is similar: by moving the input body on the surface of the keyboard, the cursor of the mouse is displayed on the computer to display the motion track on the desktop. For example, according to the moving direction, speed and distance of the input body on the keyboard surface, the moving direction, speed and distance of the cursor on the display desktop are controlled accordingly, thereby implementing a cursor control command to the computer through the keyboard pointing operation, for controlling the cursor The purpose of the move.
本实施例中所述的输入命令还可以是手势命令, 例如, 当所述输入体在 键盘上的移动轨迹为一个封闭的圓形时, 则生成一个用于锁定屏幕的手势命 令; 当所述输入体在键盘上的移动轨迹为一个 " X " 形时, 则生成一个用于 关闭当前窗口的手势命令。 The input command described in this embodiment may also be a gesture command. For example, when the movement track of the input body on the keyboard is a closed circle, a gesture for locking the screen is generated. When the movement of the input body on the keyboard is an "X" shape, a gesture command for closing the current window is generated.
本实施例在上述流程中,终端同时具有键盘按键输入模式和键盘指点输 入模式, 在满足输入体与所述键盘的上表面之间的距离小于所述预定值, 并 且未产生所述按键信号的条件时, 终端按照键盘指点输入模式工作, 根据所 述移动轨迹, 生成输入命令。 如果在上述流程中, 输入体按下键盘上的任意 按键并产生了对应的按键信号 , 则终端将按照正常的键盘按键输入模式工 作, 接收并处理上述按键信号。  In the above process, the terminal has a keyboard key input mode and a keyboard pointing input mode at the same time, and the distance between the input body and the upper surface of the keyboard is less than the predetermined value, and the button signal is not generated. In the condition, the terminal operates according to the keyboard pointing input mode, and generates an input command according to the moving track. If, in the above process, the input body presses any button on the keyboard and generates a corresponding button signal, the terminal will operate in accordance with the normal keyboard key input mode to receive and process the button signal.
本实施例中,在终端进行指点输入时,才开启图像釆集单元(如摄像头;); 而在终端进行按键输入时, 关闭图像釆集单元(如摄像头)以及触摸键盘的 检测系统, 以节约终端功耗。 当然, 如果不考虑功耗的问题, 图像釆集单元 也可以一直工作, 只不过终端在没有指点输入时不进行移动轨迹的釆集和输 入命令的转化。  In this embodiment, when the terminal performs the finger input, the image collection unit (such as the camera;) is turned on; and when the terminal performs the key input, the image collection unit (such as the camera) and the touch keyboard detection system are turned off to save Terminal power consumption. Of course, if the power consumption problem is not considered, the image collection unit can always work, but the terminal does not perform the conversion of the movement track and the input command when there is no finger input.
本实施例还可以通过物理开关方式,来控制终端在键盘按键输入模式和 键盘指点输入模式之间切换, 使得终端在同一时刻只工作在其中一种模式 下。 此时, 本实施例在上述步骤 11之前, 还包括:  In this embodiment, the physical switch mode can also be used to control the terminal to switch between the keyboard key input mode and the keyboard finger input mode, so that the terminal works only in one mode at the same time. At this time, before the step 11 above, the embodiment further includes:
步骤 10 , 接收用于指示进入键盘指点输入模式的控制信号; 根据所述 控制信号 , 控制所述终端进入所述键盘指点输入模式。  Step 10: Receive a control signal for instructing to enter a keyboard pointing input mode; and according to the control signal, controlling the terminal to enter the keyboard pointing input mode.
这里, 上述控制信号是通过物理开关输入的。 物理开关可以是额外的手 动拨码开关或按键开关, 通过向不同方向拨动或按下 /按出开关, 控制终端 进入不同的键盘输入模式。 物理开关还可以釆用类似于上述步骤 11中检测 输入体与键盘上表面之间的距离时所釆用的光检测方式或电容检测方式实 现: 请参照图 10和图 11所示, 终端上预先设置的两个掌托区域 31、 32 (该 两个掌托区域设置在键盘下方, 即将两个掌托区域设置在键盘和用户之间的 主机上), 判断第一接触体 33与第一掌托区域 31的距离、 以及第二接触体 34与第二掌托区域 32的距离是否都小于预设门限值 (两个接触体可以是用 户的两个手掌 /手腕); 在第一接触体 33与第一掌托区域 31的距离小于预设 门限值、 且第二接触体 34与第二掌托区域 32的距离也小于预设门限值时, 自动切换键盘输入模式为键盘按键输入模式; 在只有一个接触体(接触体 33 或接触体 34 )与相应的一个掌托区域 (掌托区域 31或掌托区域 32 )的距离 小于预设门限值时, 自动切换键盘输入模式为键盘指点输入模式。 这样, 当 用户两手分别放在键盘上的两个掌托区域时, 终端将进入键盘按键输入模 式; 当用户仅一只手放在键盘上的一个掌托区域时, 终端将进入键盘指点输 入模式。 这里的接触体和前述的输入体不同, 接触体通过与掌托区域的接触 与否, 控制进入键盘按键输入模式, 实际应用中该接触体可以是用户手腕; 前述的输入体与键盘上表面的接触与否, 是轨迹釆集的一个控制条件, 实际 应用中输入体通常为用户手指或输入笔等。 Here, the above control signal is input through a physical switch. The physical switch can be an additional manual dial switch or push button switch that controls the terminal to enter different keyboard input modes by dialing in different directions or pressing/pressing the switch. The physical switch can also be implemented by using a light detection mode or a capacitance detection method similar to the detection of the distance between the input body and the upper surface of the keyboard in the above step 11: Referring to FIG. 10 and FIG. 11, the terminal is pre- Set the two palm rest areas 31, 32 (the two palm rest areas are set under the keyboard, that is, the two palm rest areas are set on the host between the keyboard and the user), and the first contact body 33 and the first palm are judged. Whether the distance of the bracket region 31 and the distance between the second contact body 34 and the second palm rest region 32 are less than a preset threshold value (the two contact bodies may be two palms/wrists of the user); When the distance between the first palm rest area 31 and the first palm rest area 31 is less than the preset threshold value, and the distance between the second contact body 34 and the second palm rest area 32 is also less than the preset threshold value, the keyboard input mode is automatically switched to the keyboard key input. Mode; when only one contact body (contact body 33 or contact body 34) and the corresponding one of the palm rest area (the palm rest area 31 or the palm rest area 32) are less than a preset threshold, the automatic switching keyboard input mode is Keyboard pointing input mode formula. In this way, when When the user puts both hands on the two palm rest areas on the keyboard, the terminal will enter the keyboard key input mode; when the user only places one hand on a palm rest area on the keyboard, the terminal will enter the keyboard pointing input mode. The contact body here is different from the aforementioned input body, and the contact body is controlled to enter the keyboard key input mode by contact with the palm rest area. In practical applications, the contact body may be the user's wrist; the aforementioned input body and the upper surface of the keyboard Contact or not is a control condition of the trajectory set. In practical applications, the input body is usually a user's finger or a stylus.
本实施例中,在计算机进入键盘指点输入模式后,开启图像釆集单元(如 摄像头); 在计算机退出键盘指点输入模式后, 关闭摄像头以及触摸键盘的 检测系统(或者只关闭其中一个), 以节约设备功耗。 当然, 如果不考虑功 耗的问题, 图像釆集单元也可以一直工作, 只不过终端在没有指点输入时不 进行移动轨迹的釆集和输入命令的转化。  In this embodiment, after the computer enters the keyboard pointing input mode, the image gathering unit (such as a camera) is turned on; after the computer exits the keyboard pointing input mode, the camera and the touch keyboard detecting system are turned off (or only one of them is turned off), Save equipment power consumption. Of course, if the problem of power consumption is not considered, the image collection unit can always work, but the terminal does not perform the conversion of the movement track and the input command when there is no finger input.
在通过物理开关,控制终端进入键盘指点输入模式后, 本实施例还可以 接收键盘上的按键被按下后产生的按键信号, 并根据所述按键信号, 执行对 应的操作。  After the control terminal enters the keyboard pointing input mode through the physical switch, the embodiment may further receive a button signal generated after the button on the keyboard is pressed, and perform a corresponding operation according to the button signal.
具体的, 作为一种实施方式, 本实施例中可以接收键盘上的任意按键被 按下后产生的按键信号, 并在接收到所述按键信号后, 在光标当前位置处执 行鼠标左键操作。 鼠标左键操作包括左键单击和左键双击操作, 例如, 在预 定时间内只接收到一次所述按键信号, 则执行鼠标左键单击操作; 如果在预 定时间内接收到两次所述按键信号, 则执行鼠标左键双击操作。 这里, 如果 持续接收到所述按键信号, 则还可以根据所述按键信号执行鼠标拖拽操作, 即, 对初始接收到所述按键信号时所述光标位置处的对象进行拖拽。  Specifically, as an embodiment, in this embodiment, a button signal generated when any button on the keyboard is pressed is received, and after receiving the button signal, a left mouse button operation is performed at a current position of the cursor. The left mouse button operation includes a left click and a left button double click operation, for example, if the button signal is received only once within a predetermined time, a left mouse click operation is performed; if the button is received twice within a predetermined time When the button signal is pressed, the left mouse button double click operation is performed. Here, if the button signal is continuously received, the mouse drag operation may be performed according to the button signal, that is, the object at the cursor position is dragged when the button signal is initially received.
作为另一种实施方式, 本实施例可以预先设置一个(或一类)按键对应 于鼠标左键, 设置另一个(或另一类)按键对应于鼠标右键。 这样, 在接收 到所述一个(或一类)按键产生的按键信号后, 在光标当前位置处执行鼠标 左键操作; 在接收到所述另一个(或另一类)按键产生的按键信号后, 在光 标当前位置处执行鼠标右键操作。 同样的, 这里鼠标左键操作也包括左键单 击、 双击操作, 鼠标右键操作也包括右键单击、 双击操作。 如果持续接收到 所述一个(或一类)按键产生的按键信号, 则还可以根据所述一个(或一类) 按键产生的按键信号执行鼠标拖拽操作。  As another embodiment, in this embodiment, one (or one type of) button may be preset to correspond to the left mouse button, and the other (or another type) button is set to correspond to the right mouse button. In this way, after receiving the button signal generated by the one (or one type of) button, performing a left mouse button operation at the current position of the cursor; after receiving the button signal generated by the other (or another type) button , Perform the right mouse button operation at the current position of the cursor. Similarly, the left mouse button operation also includes a left click and a double click operation, and the right mouse button operation also includes a right click and a double click operation. If the button signal generated by the one (or one type) button is continuously received, the mouse drag operation can also be performed according to the button signal generated by the one (or one type) button.
从以上所述可以看出, 本实施例具有以下优点:  As can be seen from the above, this embodiment has the following advantages:
1 ) 由于釆用键盘上表面作为键盘指点输入的区域, 相对于传统的便携 式笔记本的触摸板输入, 本实施例的键盘上表面能够提供更大的输入面积, 因此能够方便用户的输入操作。 1) Compared to the traditional portable area, the upper surface of the keyboard is used as the keyboard input area. The touchpad input of the notebook, the upper surface of the keyboard of the embodiment can provide a larger input area, and thus can facilitate the input operation of the user.
2 )相对于仅釆用摄像头釆集移动轨迹, 进而控制光标移动的方式, 本 实施例能够提供输入的准确性, 并可避免输入误操作的问题, 其原因在于: 现有技术只通过摄像头釆集输入体的移动轨迹, 例如当用户想控制鼠标右移 时, 会将输入体向右移动, 以试图输入一个向右移动的轨迹。 由于用户动作 通常具有 "往复" 的特点, 在将输入体向右移动后, 通常又会习惯性地将输 入体返回到初始位置。 这种情况下, 摄像头无法确定何时开始釆集以及何时 停止釆集移动轨迹, 因此摄像头釆集到的可能是一个往复的移动轨迹, 与用 户想要输入的向右移动的轨迹不相符。 而本实施例中, 用户在想进行键盘指 点输入时, 将输入体接近或接触键盘上表面且不产生按键信号, 此时将触发 移动轨迹的釆集; 当用户想停止输入时, 将输入体远离键盘上表面, 即可触 发停止移动轨迹釆集, 从而使得釆集到的轨迹符合用户预期, 减少了输入误 操作的问题。  2) Compared with the method of only collecting the moving track by the camera and controlling the movement of the cursor, the embodiment can provide the input accuracy and avoid the problem of input misoperation, because the prior art only passes the camera. The movement path of the input body, for example, when the user wants to control the right movement of the mouse, moves the input body to the right to attempt to input a trajectory that moves to the right. Since the user action usually has a "reciprocating" feature, it is customary to return the input body to the initial position after moving the input body to the right. In this case, the camera cannot determine when to start the collection and when to stop the collection movement, so the camera may collect a reciprocating movement trajectory that does not match the trajectory that the user wants to input to the right. In this embodiment, when the user wants to perform keyboard pointing input, the input body approaches or touches the upper surface of the keyboard and does not generate a button signal, and the set of the moving track is triggered at this time; when the user wants to stop the input, the input body is input. Away from the upper surface of the keyboard, the stop movement trajectory set can be triggered, so that the trajectory collected by the 符合 conforms to the user's expectation, and the problem of input misoperation is reduced.
更进一步的, 本实施例所述终端还可以包括显示单元, 所述输入方法还 可以进一步通过叠加显示的方式, 将输入体的图像添加到显示图像中。 图 7 示出了上述叠加显示处理的一种应用场景, 当用户通过手部在键盘上表面上 操作时, 在显示单元上能够看到包括用户手部直接对操作目标的控制的图 像。 此时, 本实施例所述输入方法, 在釆集所述输入体在键盘的上表面的移 动轨迹时, 还包括:  Further, the terminal in this embodiment may further include a display unit, and the input method may further add an image of the input body to the display image by superimposing the display manner. Fig. 7 shows an application scenario of the above-described superimposed display processing, and when the user operates on the upper surface of the keyboard by the hand, an image including the control of the user's hand directly to the operation target can be seen on the display unit. In this case, when the input method of the embodiment is used to collect the moving track of the input body on the upper surface of the keyboard, the method further includes:
步骤 21 , 釆集包括所述输入体的第一图像。  Step 21: The set includes the first image of the input body.
这里, 可以通过图像釆集单元 71 , 釆集包括所述输入体(如图 7中的 用户手部 72 )的图像, 定位所述输入体的位置, 分析所述输入体的运动。 也 可以在输入体与键盘的上表面之间的距离小于预定值, 并且未产生按键信号 时, 才开始控制图像釆集单元 71去釆集包括输入体的第一图像。  Here, the image capturing unit 71 may be used to collect an image of the input body (such as the user's hand 72 in FIG. 7), position the input body, and analyze the motion of the input body. It is also possible to control the image collection unit 71 to collect the first image including the input body only when the distance between the input body and the upper surface of the keyboard is less than a predetermined value and the key signal is not generated.
图像釆集单元 71对输入体进行图像釆集时, 釆集到的图像中除了所述 输入体外还包括背景图像, 如键盘图像。 本实施例可以直接将图像釆集单元 71釆集到的图像, 作为所述第一图像; 也可以对图像釆集单元 71釆集到的 图像进行进一步处理, 滤除其中的背景图像, 仅保留所述输入体的图像, 作 为所述第一图像。  When the image collection unit 71 performs image collection on the input body, the image collected in the image includes a background image, such as a keyboard image, in addition to the input body. In this embodiment, the image collected by the image collection unit 71 may be directly used as the first image; the image collected by the image collection unit 71 may be further processed to filter out the background image, and only the image is retained. An image of the input body as the first image.
步骤 22 , 将所述第一图像添加到所述显示单元的原始显示图像中。 这里, 所述原始显示图像可以是桌面上的真实图像, 如桌面上的快捷方 式图标或窗口, 还可以是终端产生的虚拟内容, 用以供用户操作和观察, 如 待用户操作的图片等。 Step 22: Add the first image to an original display image of the display unit. Here, the original display image may be a real image on the desktop, such as a shortcut icon or a window on the desktop, or may be a virtual content generated by the terminal, for the user to operate and observe, such as a picture to be operated by the user.
这里, 将所述输入体的图像添加到所述原始显示图像中时,还可以根据 所述输入体的运动, 控制所述原始显示图像进行相应的变化, 例如, 根据输 入体的移动轨迹, 通过拖拽方式改变原始显示图像的位置, 以及改变原始显 示图像的大小等。 再例如, 图像釆集单元釆集到输入体在键盘上表面画了一 个 " X " , 此时在显示单元将同步地显示该输入体的图像, 并且该输入体在 当前窗口上画 " X " 的动作显示出来, 然后再根据 " X " 生成对应的当前窗 口关闭命令, 将当前窗口关闭。 进一步, 还可以将移动轨迹本身叠加显示在 原始显示图像上, 即在窗口中显示 " X "型的移动轨迹, 直到用户结束输入。  Here, when the image of the input body is added to the original display image, the original display image may be controlled to be correspondingly changed according to the motion of the input body, for example, according to the movement trajectory of the input body. The drag mode changes the position of the original display image, and changes the size of the original display image. For another example, the image collection unit collects the input body and draws an "X" on the surface of the keyboard. At this time, the image of the input body is synchronously displayed on the display unit, and the input body draws an "X" on the current window. The action is displayed, and then the corresponding current window close command is generated according to "X" to close the current window. Further, the moving track itself can be superimposed and displayed on the original display image, that is, the "X" type moving track is displayed in the window until the user ends the input.
最后,基于以上实施例所述的终端的输入方法,本实施例提供一种终端, 如图 8所示, 该终端包括:  Finally, based on the input method of the terminal in the foregoing embodiment, the embodiment provides a terminal. As shown in FIG. 8, the terminal includes:
键盘, 所述键盘包括至少一个按键;  a keyboard, the keyboard comprising at least one button;
第一判断单元,用于判断输入体与所述键盘的上表面之间的距离是否小 于预定值;  a first determining unit, configured to determine whether a distance between the input body and an upper surface of the keyboard is smaller than a predetermined value;
第二判断单元, 用于判断所述至少一个按键是否产生按键信号; 图像釆集单元, 所述键盘的上表面位于所述图像釆集单元的釆集区域 内, 用于在所述距离小于所述预定值, 并且未产生所述按键信号时, 釆集所 述输入体在所述键盘的上表面的移动轨迹;  a second determining unit, configured to determine whether the at least one button generates a button signal, and an image collecting unit, wherein an upper surface of the keyboard is located in a collection area of the image collecting unit, and the distance is smaller than the Determining a predetermined value, and when the button signal is not generated, collecting a movement trajectory of the input body on an upper surface of the keyboard;
命令生成单元, 用于根据所述移动轨迹, 生成输入命令。  And a command generating unit, configured to generate an input command according to the moving track.
在釆用电容检测方式时, 所述第一判断单元包括:  When the capacitance detection mode is used, the first determining unit includes:
第一检测单元, 用于检测所述键盘上设置的导电层的电量变化; 第三判断单元, 用于在检测到所述电量变化满足预定条件时, 判断所述 输入体与所述键盘的上表面之间的距离小于所述预定值。  a first detecting unit, configured to detect a change in the amount of the electric quantity of the conductive layer disposed on the keyboard; and a third determining unit, configured to determine the input body and the keyboard when detecting that the change in the electric quantity meets a predetermined condition The distance between the surfaces is less than the predetermined value.
釆用上述电容检测方式时, 本实施例所述终端的键盘的一种结构如图 9a所示。 其中, 电路板 91上安装有至少一个按键, 所述电路板用于在按键 被完全按下时产生按键信号, 具体原理同于普通键盘, 在此不再赘述。 图 9a 中仅示出了一个按键。 按键包括有塑料键帽 92、 弹性导电橡胶件 93和按键 支架 96 (以 X型按键支架为例;)。本实施例在键帽 92的内表面覆盖有第一导 电层(比如电镀金属层) 95 , 在电路板 91的上表面覆盖有第二导电层 94。 弹性导电橡胶件 93的上端与第一导电层 95连接, 下端与第二导电层 94连 接; 按键支架 96的上端与键帽 92的连接, 下端与位于电路板 91下方的底 托连接。通过弹性导电橡胶件 93 , 第二导电层 94与第一导电层 95形成电连 接。 第二导电层 94与第一检测单元(比如 IC )连接, 第一检测单元用以检 测第二导电层 94上的电量变化。 当输入体(如用户手指)与键帽 92外表面 发生接触时, 导致第一导电层 95和第二导电层 94上的电量变化, 第三判断 单元根据该电量变化, 能够判断出所述输入体与所述键盘的上表面发生了接 触或其间的距离小于预定值。 When the capacitance detecting method is used, a structure of the keyboard of the terminal in this embodiment is as shown in FIG. 9a. At least one button is mounted on the circuit board 91. The circuit board is used to generate a button signal when the button is fully pressed. The specific principle is the same as that of the ordinary keyboard, and details are not described herein. Only one button is shown in Figure 9a. The button includes a plastic keycap 92, an elastic conductive rubber member 93, and a button holder 96 (for example, an X-type button holder;). In this embodiment, the inner surface of the key cap 92 is covered with a first conductive layer (such as a plated metal layer) 95, and the upper surface of the circuit board 91 is covered with a second conductive layer 94. The upper end of the elastic conductive rubber member 93 is connected to the first conductive layer 95, and the lower end is connected to the second conductive layer 94. The upper end of the button holder 96 is connected to the key cap 92, and the lower end is connected to the bottom plate located under the circuit board 91. The second conductive layer 94 is electrically connected to the first conductive layer 95 through the elastic conductive rubber member 93. The second conductive layer 94 is connected to a first detecting unit (such as an IC), and the first detecting unit is configured to detect a change in the amount of electricity on the second conductive layer 94. When the input body (such as a user's finger) comes into contact with the outer surface of the keycap 92, the amount of electricity on the first conductive layer 95 and the second conductive layer 94 changes, and the third determining unit can determine the input according to the change in the amount of electricity. The body is in contact with the upper surface of the keyboard or the distance therebetween is less than a predetermined value.
图 9a中由于每个按键的键帽上的每个第一导电层 95通过弹性导电橡胶 件, 都和电路板 91的第二导电层 94连接, 因此只需要设置一个与第二导电 层 94电连接的第一检测单元, 即可检测到输入体与任意按键的接触, 而不 需要针对各个按键均设置一个第一检测单元, 从而可以节约硬件成本, 简化 结构设计。  In Fig. 9a, since each of the first conductive layers 95 on the keycap of each of the keys is connected to the second conductive layer 94 of the circuit board 91 through the elastic conductive rubber member, it is only necessary to provide one and the second conductive layer 94. The connected first detecting unit can detect the contact between the input body and any button, and does not need to set a first detecting unit for each button, thereby saving hardware cost and simplifying structural design.
可见, 键盘上设置的导电层包括: 第一导电层、 第二导电层和导电连接 部。 其中, 第一导电层 95以金属层为例, 其设置方式包括: 键帽本身就是 金属; 或者键帽本身是喷漆的金属; 或者将金属层置于塑料键帽下; 或者将 金属层置于喷漆的塑料键帽下。  It can be seen that the conductive layer disposed on the keyboard comprises: a first conductive layer, a second conductive layer and a conductive connection. Wherein, the first conductive layer 95 is exemplified by a metal layer, and the setting manner comprises: the key cap itself is a metal; or the key cap itself is a painted metal; or the metal layer is placed under the plastic key cap; or the metal layer is placed Painted plastic under the key cap.
同样的, 导电连接部也可以使用键盘支架, 本实施例所述终端的键盘的 一种结构还可以如图 9b所示。 其中, 电路板 91上安装有至少一个按键, 所 述电路板用于在按键被完全按下时产生按键信号。 图 9b中仅示出了一个按 键。 按键包括有塑料键帽 92、 弹性橡胶件 93和导电按键支架 96 (具体可以 是金属支架或者电镀金属的塑料支架), 弹性橡胶件 93的上端与键帽 92内 表面连接, 下端与电路板 91的上表面连接。 键帽 92的内表面覆盖有第一导 电层(比如电镀金属层) 95 , 在电路板 91下方设置有第二导电层 94 (比如 金属底托)。 导电按键支架 96的上端与第一导电层 95连接, 下端与第二导 电层 94连接。 通过导电按键支架 96 , 第二导电层 94与第一导电层 95形成 电连接。 第二导电层 94与第一检测单元(比如 IC )连接, 第一检测单元用 以检测第二导电层 94上的电量变化。 当输入体(如用户手指)与键帽 92外 表面发生接触时, 导致第一导电层 95和第二导电层 94上的电量变化, 第三 判断单元根据该电量变化, 能够判断出所述输入体与所述键盘的上表面发生 了接触或其间的距离小于预定值。 同样的,图 9b中由于每个按键的键帽上的每个第一导电层 95通过导电 按键支架, 都和第二导电层 94连接, 因此只需要设置一个与第二导电层 94 电连接的第一检测单元, 即可检测到输入体与任意按键的接触, 而不需要针 对各个按键均设置一个第一检测单元, 从而可以节约硬件成本, 简化结构设 计。 当然如果不考虑成本, 在如图 9a和图 9b所示的实施例中, 也可以设置 多个第二导电层和多个第一检测单元。 Similarly, the conductive connecting portion can also use the keyboard bracket. A structure of the keyboard of the terminal in this embodiment can also be as shown in FIG. 9b. Wherein, at least one button is mounted on the circuit board 91, and the circuit board is configured to generate a button signal when the button is fully pressed. Only one button is shown in Figure 9b. The button includes a plastic key cap 92, an elastic rubber member 93 and a conductive button bracket 96 (specifically, a metal bracket or a metal plated plastic bracket). The upper end of the elastic rubber member 93 is connected to the inner surface of the key cap 92, and the lower end is connected to the circuit board 91. The upper surface is connected. The inner surface of the keycap 92 is covered with a first conductive layer (such as a plated metal layer) 95, and a second conductive layer 94 (such as a metal shoe) is disposed under the circuit board 91. The upper end of the conductive button holder 96 is connected to the first conductive layer 95, and the lower end is connected to the second conductive layer 94. The second conductive layer 94 is electrically connected to the first conductive layer 95 through the conductive button holder 96. The second conductive layer 94 is connected to a first detecting unit (such as an IC), and the first detecting unit is configured to detect a change in the amount of electricity on the second conductive layer 94. When the input body (such as a user's finger) comes into contact with the outer surface of the keycap 92, the amount of electricity on the first conductive layer 95 and the second conductive layer 94 changes, and the third determining unit can determine the input according to the change in the amount of electricity. The body is in contact with the upper surface of the keyboard or the distance therebetween is less than a predetermined value. Similarly, in FIG. 9b, since each of the first conductive layers 95 on the keycap of each button is connected to the second conductive layer 94 through the conductive button holder, only one of the second conductive layers 94 needs to be electrically connected. The first detecting unit can detect the contact between the input body and any button, and does not need to provide a first detecting unit for each button, thereby saving hardware cost and simplifying structural design. Of course, if the cost is not considered, in the embodiment shown in Figures 9a and 9b, a plurality of second conductive layers and a plurality of first detecting units may also be provided.
在釆用光学检测方式时, 所述第一判断单元包括:  When the optical detection mode is used, the first determining unit includes:
第二检测单元,用于检测所述键盘的上表面上方与所述上表面距离小于 预定值的光信号是否被遮挡;  a second detecting unit, configured to detect whether an optical signal whose distance from the upper surface of the keyboard and the upper surface is less than a predetermined value is blocked;
第四判断单元, 用于在检测到所述光信号被遮挡时, 判断所述输入体与 所述键盘的上表面之间的距离小于所述预定值。  And a fourth determining unit, configured to determine that a distance between the input body and an upper surface of the keyboard is less than the predetermined value when detecting that the optical signal is occluded.
优选地, 所述终端具有键盘指点输入模式和键盘按键输入模式, 所述终 端还包括:  Preferably, the terminal has a keyboard pointing input mode and a keyboard key input mode, and the terminal further includes:
接收单元, 用于接收用于指示进入所述键盘指点输入模式的控制信号; 第一控制单元, 用于根据所述控制信号,控制所述终端进入所述键盘指 点输入模式。  a receiving unit, configured to receive a control signal for instructing to enter the keyboard pointing input mode; and a first control unit, configured to control the terminal to enter the keyboard pointing input mode according to the control signal.
优选地, 所述输入命令为光标控制命令, 所述终端还包括:  Preferably, the input command is a cursor control command, and the terminal further includes:
第二控制单元, 用于在所述终端进入所述键盘指点输入模式后,接收所 述按键信号,根据所述按键信号,在光标当前位置处执行鼠标左键单击操作。  And a second control unit, configured to: after the terminal enters the keyboard pointing input mode, receive the button signal, and perform a left mouse click operation at a current position of the cursor according to the button signal.
优选地, 本实施例所述终端中, 所述图像釆集单元, 还用于釆集包括所 述输入体的第一图像。 此时, 所述终端还包括:  Preferably, in the terminal in this embodiment, the image collection unit is further configured to collect the first image including the input body. At this time, the terminal further includes:
显示单元;  Display unit;
添加单元, 用于将所述第一图像添加到所述显示单元的原始显示图像 中。  And an adding unit, configured to add the first image to an original display image of the display unit.
综上所述, 本发明实施例提供了一种终端的输入方法及终端, 可以输入 对光标的控制命令以及输入相应的鼠标操作。  In summary, the embodiments of the present invention provide a terminal input method and a terminal, which can input a control command for a cursor and input a corresponding mouse operation.
以上所述仅是本发明的实施方式,应当指出,对于本技术领域的普通技 术人员来说, 在不脱离本发明原理的前提下, 还可以作出若干改进和润饰, 这些改进和润饰也应视为在本发明的保护范围之内。  The above description is only an embodiment of the present invention, and it should be noted that those skilled in the art can also make some improvements and retouching without departing from the principles of the present invention. These improvements and retouchings should also be considered. It is within the scope of protection of the present invention.

Claims

权利要求书 Claim
1. 一种输入方法, 应用于具有键盘和图像釆集单元的终端, 所述键盘 的上表面位于所述图像釆集单元的釆集区域内, 所述键盘包括至少一个按 键, 其特征在于, 所述输入方法包括: An input method, applied to a terminal having a keyboard and an image collection unit, wherein an upper surface of the keyboard is located in a collection area of the image collection unit, and the keyboard includes at least one button, wherein The input method includes:
判断输入体与所述键盘的上表面之间的距离是否小于预定值; 判断所述至少一个按键是否产生按键信号;  Determining whether a distance between the input body and the upper surface of the keyboard is less than a predetermined value; determining whether the at least one button generates a button signal;
在所述距离小于所述预定值, 并且未产生所述按键信号时, 釆集所述输 入体在所述键盘的上表面的移动轨迹;  And when the distance is less than the predetermined value, and the button signal is not generated, collecting a movement trajectory of the input body on an upper surface of the keyboard;
根据所述移动轨迹, 生成输入命令。  An input command is generated based on the movement trajectory.
2. 如权利要求 1所述的输入方法, 其中, 所述判断输入体与所述键盘 的上表面之间的距离是否小于预定值的步骤包括:  2. The input method according to claim 1, wherein the step of determining whether the distance between the input body and the upper surface of the keyboard is less than a predetermined value comprises:
检测所述键盘上设置的导电层的电量变化;  Detecting a change in the amount of electricity of the conductive layer disposed on the keyboard;
在检测到所述电量变化满足预定条件时,判断所述输入体与所述键盘的 上表面之间的距离小于所述预定值。  When it is detected that the change in the electric quantity satisfies a predetermined condition, it is judged that the distance between the input body and the upper surface of the keyboard is smaller than the predetermined value.
3. 如权利要求 1所述的输入方法, 其中, 所述判断输入体与所述键盘 的上表面之间的距离是否小于预定值的步骤包括:  3. The input method according to claim 1, wherein the step of determining whether the distance between the input body and the upper surface of the keyboard is less than a predetermined value comprises:
检测所述键盘的上表面上方与所述上表面距离小于所述预定值的光信 号是否被遮挡;  Detecting whether an optical signal having a distance from the upper surface above the upper surface of the keyboard that is less than the predetermined value is blocked;
在检测到所述光信号被遮挡时,判断所述输入体与所述键盘的上表面之 间的距离小于所述预定值。  Upon detecting that the optical signal is occluded, it is determined that the distance between the input body and the upper surface of the keyboard is less than the predetermined value.
4. 如权利要求 1所述的输入方法, 其中, 所述终端具有键盘指点输入 模式和键盘按键输入模式,在所述判断输入体与所述键盘的上表面之间的距 离是否小于预定值的步骤之前, 还包括:  The input method according to claim 1, wherein the terminal has a keyboard pointing input mode and a keyboard key input mode, and whether the distance between the determining input body and the upper surface of the keyboard is less than a predetermined value Before the step, it also includes:
接收用于指示进入所述键盘指点输入模式的控制信号;  Receiving a control signal for instructing entry into the keyboard pointing input mode;
根据所述控制信号, 控制所述终端进入所述键盘指点输入模式。  And controlling the terminal to enter the keyboard pointing input mode according to the control signal.
5. 如权利要求 1所述的输入方法, 其中, 所述输入命令为光标控制命 令。  The input method according to claim 1, wherein the input command is a cursor control command.
6. 如权利要求 4所述的输入方法, 其中,  6. The input method according to claim 4, wherein
所述输入命令为光标控制命令;  The input command is a cursor control command;
在控制所述终端进入所述键盘指点输入模式后, 所述输入方法还包括: 接收所述按键信号,根据所述按键信号, 在光标当前位置处执行鼠标左 键操作。 After the terminal is controlled to enter the keyboard pointing input mode, the input method further includes: Receiving the button signal, and performing a left mouse button operation at a current position of the cursor according to the button signal.
7. 如权利要求 1至 6任一项所述的输入方法, 其中, 所述终端包括显 示单元, 在釆集所述输入体在所述键盘的上表面的移动轨迹时, 所述输入方 法还包括:  The input method according to any one of claims 1 to 6, wherein the terminal includes a display unit, and the input method is further performed when collecting a movement trajectory of the input body on an upper surface of the keyboard Includes:
釆集包括所述输入体的第一图像;  The set includes a first image of the input body;
将所述第一图像添加到所述显示单元的原始显示图像中。  The first image is added to an original display image of the display unit.
8. 一种终端, 其特征在于, 包括:  8. A terminal, comprising:
键盘, 所述键盘包括至少一个按键;  a keyboard, the keyboard comprising at least one button;
第一判断单元,用于判断输入体与所述键盘的上表面之间的距离是否小 于预定值;  a first determining unit, configured to determine whether a distance between the input body and an upper surface of the keyboard is smaller than a predetermined value;
第二判断单元, 用于判断所述至少一个按键是否产生按键信号; 图像釆集单元, 所述键盘的上表面位于所述图像釆集单元的釆集区域 内, 用于在所述距离小于所述预定值, 并且未产生所述按键信号时, 釆集所 述输入体在所述键盘的上表面的移动轨迹;  a second determining unit, configured to determine whether the at least one button generates a button signal, and an image collecting unit, wherein an upper surface of the keyboard is located in a collection area of the image collecting unit, and the distance is smaller than the Determining a predetermined value, and when the button signal is not generated, collecting a movement trajectory of the input body on an upper surface of the keyboard;
命令生成单元, 用于根据所述移动轨迹, 生成输入命令。  And a command generating unit, configured to generate an input command according to the moving track.
9. 如权利要求 8所述的终端, 其中, 所述第一判断单元包括: 第一检测单元, 用于检测所述键盘上设置的导电层的电量变化; 第三判断单元, 用于在检测到所述电量变化满足预定条件时, 判断所述 输入体与所述键盘的上表面之间的距离小于所述预定值。  The terminal according to claim 8, wherein the first determining unit comprises: a first detecting unit, configured to detect a change in a quantity of a conductive layer disposed on the keyboard; and a third determining unit, configured to detect When the change in the electric quantity satisfies the predetermined condition, it is judged that the distance between the input body and the upper surface of the keyboard is smaller than the predetermined value.
10. 如权利要求 8所述的终端, 其中, 所述第一判断单元包括: 第二检测单元,用于检测所述键盘的上表面上方与所述上表面距离小于 所述预定值的光信号是否被遮挡;  The terminal according to claim 8, wherein the first determining unit comprises: a second detecting unit, configured to detect an optical signal whose distance from the upper surface of the keyboard is less than the predetermined value Whether it is occluded;
第四判断单元, 用于在检测到所述光信号被遮挡时, 判断所述输入体与 所述键盘的上表面之间的距离小于所述预定值。  And a fourth determining unit, configured to determine that a distance between the input body and an upper surface of the keyboard is less than the predetermined value when detecting that the optical signal is occluded.
11. 如权利要求 8所述的终端, 其中, 所述终端具有键盘指点输入模式 和键盘按键输入模式, 所述终端还包括:  The terminal according to claim 8, wherein the terminal has a keyboard pointing input mode and a keyboard key input mode, and the terminal further includes:
接收单元, 用于接收用于指示进入所述键盘指点输入模式的控制信号; 第一控制单元, 用于根据所述控制信号,控制所述终端进入所述键盘指 点输入模式。  a receiving unit, configured to receive a control signal for instructing to enter the keyboard pointing input mode; and a first control unit, configured to control the terminal to enter the keyboard pointing input mode according to the control signal.
12. 如权利要求 11所述的终端, 其中, 所述输入命令为光标控制命令; 12. The terminal of claim 11, wherein The input command is a cursor control command;
所述终端还包括:  The terminal further includes:
第二控制单元, 用于在所述终端进入所述键盘指点输入模式后,接收所 述按键信号, 根据所述按键信号, 在光标当前位置处执行鼠标左键操作。  And a second control unit, configured to: after the terminal enters the keyboard pointing input mode, receive the button signal, and perform a left mouse button operation at a current position of the cursor according to the button signal.
1 3. 如权利要求 8至 12任一项所述的终端, 其中,  The terminal according to any one of claims 8 to 12, wherein
所述图像釆集单元还用于釆集包括所述输入体的第一图像;  The image collection unit is further configured to collect a first image including the input body;
所述终端还包括:  The terminal further includes:
显示单元;  Display unit;
添加单元, 用于将所述第一图像添加到所述显示单元的原始显示图像 中。  And an adding unit, configured to add the first image to an original display image of the display unit.
PCT/CN2011/070422 2010-01-22 2011-01-20 Terminal and input method thereof WO2011088793A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010100574.8 2010-01-22
CN201010100574.8A CN102135839B (en) 2010-01-22 2010-01-22 Terminal and input method thereof

Publications (1)

Publication Number Publication Date
WO2011088793A1 true WO2011088793A1 (en) 2011-07-28

Family

ID=44295642

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/070422 WO2011088793A1 (en) 2010-01-22 2011-01-20 Terminal and input method thereof

Country Status (2)

Country Link
CN (1) CN102135839B (en)
WO (1) WO2011088793A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102955564B (en) * 2011-08-25 2016-06-22 中国移动通信集团公司 The operational approach of a kind of terminal and terminal
CN102360263A (en) * 2011-09-26 2012-02-22 中兴通讯股份有限公司 Method implemented by taking three-dimensional moving track as input and mobile terminal
EP2701033B1 (en) * 2012-08-24 2018-11-28 BlackBerry Limited Temporary keyboard having some individual keys that provide varying levels of capacitive coupling to a touch-sensitive display
CN105607802B (en) * 2015-12-17 2020-04-24 联想(北京)有限公司 Input device and input method
WO2017115692A1 (en) * 2015-12-28 2017-07-06 アルプス電気株式会社 Handwriting input device, information input method, and program
CN106980461A (en) * 2017-02-23 2017-07-25 北京小牛互联科技有限公司 The method and apparatus for quickly positioning input text point in the word TIP of keyboard
CN108093145A (en) * 2018-01-04 2018-05-29 董平 A kind of function selection method and device and electronic equipment
CN110414225B (en) * 2019-07-24 2023-05-26 广东魅视科技股份有限公司 System and method for preventing HID keyboard attack
CN111634772B (en) * 2020-06-15 2022-10-14 上海三菱电梯有限公司 Non-contact elevator button system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1378171A (en) * 2002-05-20 2002-11-06 许旻 Computer input system
US20070125633A1 (en) * 2005-12-01 2007-06-07 Navisense, Llc Method and system for activating a touchless control
CN100437451C (en) * 2004-06-29 2008-11-26 皇家飞利浦电子股份有限公司 Method and device for preventing staining of a display device
WO2009067224A1 (en) * 2007-11-19 2009-05-28 Cirque Corporation Touchpad combined with a display and having proximity and touch sensing capabilities

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100432901C (en) * 2005-12-28 2008-11-12 中兴通讯股份有限公司 Mobile terminal having keyboard and hand-write synergic input function

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1378171A (en) * 2002-05-20 2002-11-06 许旻 Computer input system
CN100437451C (en) * 2004-06-29 2008-11-26 皇家飞利浦电子股份有限公司 Method and device for preventing staining of a display device
US20070125633A1 (en) * 2005-12-01 2007-06-07 Navisense, Llc Method and system for activating a touchless control
WO2009067224A1 (en) * 2007-11-19 2009-05-28 Cirque Corporation Touchpad combined with a display and having proximity and touch sensing capabilities

Also Published As

Publication number Publication date
CN102135839A (en) 2011-07-27
CN102135839B (en) 2014-07-30

Similar Documents

Publication Publication Date Title
WO2011088793A1 (en) Terminal and input method thereof
KR101844366B1 (en) Apparatus and method for recognizing touch gesture
US20180188922A1 (en) System and Method for Gesture Control
CN101963848B (en) Method for determining if target point belong to plane, mouse and touch screen
TWI450159B (en) Optical touch device, passive touch system and its input detection method
CN102023735B (en) A kind of touch input device, electronic equipment and mobile phone
EP2778849A1 (en) Method and apparatus for operating sensors of user device
US8164575B2 (en) Method for identifying a single tap, double taps and a drag and a controller for a touch device employing the method
KR20130099717A (en) Apparatus and method for providing user interface based on touch screen
WO2006084416A1 (en) An information-inputting device and its controlling method of the portable electronic apparatus
WO2011032521A1 (en) Electronic device and method, cell phone, program to achieve preset operation command thereof
CN104423831A (en) Electronic device with side touch combined shortcut function
US20140267025A1 (en) Method and apparatus for operating sensors of user device
US20100001955A1 (en) Input device, particularly computer mouse
CN106991394A (en) A kind of electronic equipment with fingerprint identification function
WO2015168977A1 (en) Screen control method and device
TW201421322A (en) Hybrid pointing device
WO2014146516A1 (en) Interactive device and method for left and right hands
TW200844808A (en) Electronic device
US20130328833A1 (en) Dual-mode input apparatus
WO2012111227A1 (en) Touch input device, electronic apparatus, and input method
CN100555196C (en) Be applied to the double function operation touch screen component and the method thereof of palm-type device
CN101598982B (en) Electronic device and method for executing mouse function of same
KR101348696B1 (en) Touch Screen Apparatus based Touch Pattern and Control Method thereof
KR20120051274A (en) Areas in the touch input device shaped image sensing area chiyong

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11734375

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11734375

Country of ref document: EP

Kind code of ref document: A1