WO2016183932A1 - Input method and apparatus for mobile terminal, and computer storage medium - Google Patents

Input method and apparatus for mobile terminal, and computer storage medium Download PDF

Info

Publication number
WO2016183932A1
WO2016183932A1 PCT/CN2015/085150 CN2015085150W WO2016183932A1 WO 2016183932 A1 WO2016183932 A1 WO 2016183932A1 CN 2015085150 W CN2015085150 W CN 2015085150W WO 2016183932 A1 WO2016183932 A1 WO 2016183932A1
Authority
WO
WIPO (PCT)
Prior art keywords
wristwatch
arm
mobile terminal
projection plane
plane
Prior art date
Application number
PCT/CN2015/085150
Other languages
French (fr)
Chinese (zh)
Inventor
高宇
袁宁
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2016183932A1 publication Critical patent/WO2016183932A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to the field of wireless communication technologies, and in particular, to an input method, device, and computer storage medium for a mobile terminal.
  • embodiments of the present invention provide a method, an apparatus, and a computer storage medium for inputting a mobile terminal.
  • a method for inputting a mobile terminal including:
  • the mobile terminal sends a text input request to the wristwatch through a communication link established with the wristwatch, instructing the wristwatch to start text input;
  • the wristwatch is a wristwatch worn on the wrist;
  • the mobile terminal receives the text information generated by the wristwatch through the arm movement through the communication link, and displays the text information on the mobile terminal to be input interface.
  • the method further includes:
  • the mobile terminal performs pairing processing with the wristwatch to establish a communication link with the wristwatch.
  • a method for inputting a mobile terminal including:
  • the wristwatch After receiving the text input request sent by the mobile terminal through the communication link established with the mobile terminal, the wristwatch detects the motion test track of the arm bending and the arm straightening, and determines the projection plane of the wristwatch for text input.
  • the watch is a wristwatch worn on the wrist;
  • the wristwatch transmits the generated text information to the mobile terminal through the communication link through the communication link, so that the mobile terminal performs display.
  • the projection plane includes an X-Z projection plane and a Y-Z projection; and the motion test track for bending the arm and extending the arm is detected, and determining a projection plane of the wristwatch for text input includes:
  • the motion test trajectory of the arm movement is generated by detecting the motion test trajectory of the arm bending and the arm extension;
  • the projection plane of the wristwatch for text input is a Y-Z projection plane
  • the projection plane for the text input of the wristwatch is the X-Z projection plane.
  • generating the text information by the arm movement includes:
  • the watch determines the projection plane of the watch, it is monitored in real time whether the arm of the wristwatch enters the determined projection plane;
  • the text information is generated by recording the motion trajectory of the arm.
  • generating the text information by recording the motion track of the arm includes:
  • the timer When it is detected that the arm wearing the watch enters the determined projection plane, the timer is started and turned on. Recording the movement trajectory of the arm;
  • Text information is generated when the recorded arm motion trajectory matches a text in the text database.
  • the method further includes:
  • the wristwatch performs pairing processing with the mobile terminal to establish a communication link with the mobile terminal.
  • an input device of a mobile terminal including:
  • Sending a text input requesting module configured to send a text input request to the wristwatch through a communication link established with the wristwatch, instructing the wristwatch to start text input;
  • the wristwatch is a wristwatch worn on the wrist ;
  • Receiving and displaying a text information module configured to receive, by the mobile terminal, text information generated by the arm movement by the arm movement through the communication link, and display the text information on the mobile terminal to be input interface.
  • the device further includes:
  • Establishing a communication link module configured to establish a communication link with the wristwatch by performing pairing processing with the wristwatch.
  • an input device of a mobile terminal including:
  • Determining a projection plane sub-module configured to, after receiving a text input request sent by the mobile terminal by using a communication link established with the mobile terminal, detecting the motion test track of the arm bending and the arm extension, and determining the wristwatch a projection plane for text input; the watch is worn a wrist watch on the wrist;
  • Generating a text information sub-module and when detecting that the arm wearing the wristwatch enters the determined projection plane, generating text information by arm movement; and transmitting the generated text information to the mobile terminal through the communication link So that the mobile terminal performs display.
  • the projection plane includes an X-Z projection plane and a Y-Z projection; and the determining the projection plane sub-module comprises:
  • Generating a motion test trajectory plane unit configured to detect a motion test trajectory of the arm motion by detecting a motion test trajectory of the arm bending and the arm extension;
  • Determining a projection plane unit configured to determine that a projection plane for text input is a YZ projection plane when the generated motion test trajectory plane is parallel to the XZ plane and perpendicular to the YZ plane, and when the generated motion test trajectory plane is parallel to YZ Plane and perpendicular to the XZ plane, the projection plane that determines the wristwatch for text input is the XZ projection plane.
  • the generating the text information submodule includes:
  • the detecting unit is configured to monitor, in real time, whether the arm of the wristwatch enters the determined projection plane after determining the projection plane of the wristwatch;
  • Generating a text information unit configured to generate text information by recording a motion trajectory of the arm when detecting that the arm wearing the wristwatch enters the determined projection plane.
  • the apparatus further includes: establishing a communication link module, configured to perform pairing processing with the mobile terminal, and establish a communication link with the mobile terminal.
  • a computer storage medium comprising a set of instructions that, when executed, cause at least one processor to perform an input method of the mobile terminal described above.
  • the embodiment of the invention realizes the input of the mobile terminal by the trajectory detection of the smart watch and the real-time communication with the mobile terminal, and solves the problem that the screen of the mobile terminal is small and inconvenient to pass directly in the prior art.
  • the problem of touching the input for input improves the user experience.
  • FIG. 1 is a schematic flowchart of an input method of a mobile terminal according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of an input device of a mobile terminal according to an embodiment of the present invention.
  • FIG. 3 is a schematic flowchart of a method for implementing input on a mobile phone side according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of a motion track input by a wristwatch in a projection plane according to an embodiment of the present invention
  • FIG. 5 is a schematic flowchart of a method for implementing input on a wristwatch side according to an embodiment of the present invention.
  • FIG. 1 is a flowchart of a method for inputting a mobile terminal according to an embodiment of the present invention. As shown in FIG. 1, the method includes the following steps:
  • Step S101 The mobile terminal establishes a communication link with the wristwatch by performing pairing processing with a wristwatch worn on the wrist;
  • Step S102 After establishing a communication link with the wristwatch, the mobile terminal sends a text input request to the wristwatch, instructing the wristwatch to start text input.
  • Step S103 The mobile terminal receives the text information generated by the wristwatch by the arm movement through the established communication link, and displays the text information on the mobile terminal to be input interface.
  • the method on the wrist side may include: after receiving the text input request sent by the mobile terminal, the wristwatch detects the wrist by bending the arm and bending the arm to test the trajectory.
  • the table is used for the projection plane of the text input.
  • the projection plane includes an X-Z projection plane and a Y-Z projection.
  • the motion test trajectory for bending the arm and extending the arm is detected, and determining the projection plane of the wristwatch for text input includes: checking the motion test trajectory of the arm bending and the arm straightening Measure, generate a motion test trajectory plane of the arm motion; when the generated motion test trajectory plane is parallel to the XZ plane and perpendicular to the YZ plane, determine that the projection plane of the wristwatch for text input is a YZ projection plane; when the generated motion test trajectory The plane is parallel to the YZ plane and perpendicular to the XZ plane, then the projection plane for the text input of the wristwatch is determined to be the XZ projection plane.
  • the method may further include:
  • the watch generates text information by arm movement.
  • the wristwatch determines the projection plane of the wristwatch for text input, it monitors in real time whether the arm of the wristwatch enters the determined projection plane; when detecting that the arm of the wristwatch enters the determined projection In the plane, text information is generated by recording the motion trajectory of the arm.
  • generating the text information by recording the motion track of the arm includes: when detecting that the arm wearing the wristwatch enters the determined projection plane , starting a timer and starting to record the movement track of the arm; when the timer counts to the set time, ending recording the movement track of the arm; by performing the recorded arm movement track and the preset text database Matching, determining whether to generate text information; when the recorded arm movement trajectory matches one of the characters in the text database, generating text information.
  • the method of the embodiment of the present invention may further include: sending, by the wristwatch, the generated text information to the mobile terminal by using the communication link, so that the mobile terminal performs display.
  • the method of the embodiment of the present invention includes an input method of the mobile terminal on the mobile terminal side and an input method of the mobile terminal on the wristwatch side.
  • the method includes the following steps:
  • the mobile terminal sends a text input request to the wristwatch through a communication link established with the wristwatch, instructing the wristwatch to start text input;
  • the wristwatch is a wristwatch worn on the wrist;
  • the mobile terminal receives the text information generated by the wristwatch through the arm movement through the communication link, and displays the text information on the mobile terminal to be input interface.
  • the method may further include:
  • the mobile terminal performs pairing processing with the wristwatch to establish a communication link with the wristwatch.
  • the method includes the following steps:
  • the wristwatch After receiving the text input request sent by the mobile terminal through the communication link established with the mobile terminal, the wristwatch detects the motion test track of the arm bending and the arm straightening, and determines the projection plane of the wristwatch for text input.
  • the watch is a wristwatch worn on the wrist;
  • the wristwatch transmits the generated text information to the mobile terminal through the communication link through the communication link, so that the mobile terminal performs display.
  • the projection plane includes an X-Z projection plane and a Y-Z projection; and the motion test track for bending the arm and extending the arm is detected to determine a projection plane of the wristwatch for text input, specifically including:
  • the motion test trajectory of the arm movement is generated by detecting the motion test trajectory of the arm bending and the arm extension;
  • the projection plane of the wristwatch for text input is a Y-Z projection plane
  • the projection plane for the text input of the wristwatch is the X-Z projection plane.
  • the text information is generated by the arm movement, and specifically includes:
  • the watch determines the projection plane of the watch, it is monitored in real time whether the arm of the wristwatch enters the determined projection plane;
  • the text information is generated by recording the motion trajectory of the arm.
  • generating the text information by recording the motion track of the arm specifically includes:
  • the timer is started and the movement track of the arm is started to be recorded;
  • Text information is generated when the recorded arm motion trajectory matches a text in the text database.
  • the method may further include:
  • the wristwatch performs pairing processing with the mobile terminal to establish a communication link with the mobile terminal.
  • FIG. 2 is a schematic diagram of an input device of a mobile terminal according to an embodiment of the present invention. As shown in FIG. 2, the method includes: establishing a communication link module 201, transmitting a text input request module 202, and receiving and displaying a text information module 203.
  • the communication link module 201 is configured to perform a pairing process with a wrist watch worn on the wrist to establish a communication link between the mobile terminal and the wristwatch; and the sending text input request module 202 is configured to After establishing a communication link with the wristwatch, the mobile terminal sends a text input request to the wristwatch, instructing the wristwatch to start text input; and the receiving and displaying text information module 203 is configured to pass the established The communication link receives the text information generated by the wristwatch by the arm movement and displays it on the mobile terminal to be input interface.
  • the device of the embodiment of the present invention may include: a determining a projection plane sub-module configured to: after receiving the text input request sent by the mobile terminal, detecting the motion test track by bending the arm and extending the arm to determine the wrist
  • the table is for a projection plane of text input; wherein the projection plane comprises an XZ projection plane and a YZ projection.
  • the determined projection The plane sub-module includes: a motion test trajectory plane unit configured to detect a motion test trajectory of the arm bending and the arm extension to generate a motion test trajectory plane of the arm motion; determine a projection plane unit, configured to generate the motion test The trajectory plane is parallel to the XZ plane and perpendicular to the YZ plane, then the projection plane for the text input of the wristwatch is determined to be the YZ projection plane, and the watch is determined when the generated motion test trajectory plane is parallel to the YZ plane and perpendicular to the XZ plane.
  • the projection plane for text input is the XZ projection plane.
  • the apparatus for the wristwatch of the embodiment of the present invention may further include: a text information sub-module configured to generate the text information by recording the motion track of the arm; wherein the generating the text information sub-module comprises: a detecting unit configured to be After the watch determines the projection plane of the watch, it monitors in real time whether the arm of the wristwatch enters the determined projection plane; generates a text information unit configured to detect when the arm wearing the watch enters the determined projection plane Text information is generated by recording the motion trajectory of the arm.
  • the generated text information sub-module is further configured to send the generated text information to the mobile terminal through the communication link, so that the mobile terminal performs display.
  • each module of the input device of the mobile terminal in the embodiment of the present invention has a module located on the mobile terminal side and a module located on the wristwatch side.
  • the input device of the mobile terminal in the embodiment of the present invention may include: a text input request module 202 and a text information module 203;
  • Sending a text input requesting module 202 configured to send a text input request to the wristwatch through a communication link established with the wristwatch, instructing the wristwatch to start text input;
  • the wristwatch is a wrist worn on the wrist table;
  • Receiving and displaying a text information module 203 configured to receive text information generated by the wristwatch by arm movement through the communication link, and display the text information on the mobile terminal to be input interface
  • the input device of the mobile terminal of the embodiment of the present invention may further include: establishing a communication link module, configured to perform pairing processing with the wristwatch, and the wrist The table establishes a communication link.
  • the input device of the mobile terminal of the embodiment of the present invention includes: a determining a projection plane sub-module configured to receive a text input request sent by the mobile terminal through a communication link established with the mobile terminal, and then The motion test track of the arm bending and the arm straightening is detected to determine the projection plane of the wristwatch for text input; the wristwatch is a wristwatch worn on the wrist;
  • Generating a text information sub-module and when detecting that the arm wearing the wristwatch enters the determined projection plane, generating text information by arm movement; and transmitting the generated text information to the mobile terminal through the communication link So that the mobile terminal performs display.
  • the projection plane includes an X-Z projection plane and a Y-Z projection; and the determining the projection plane sub-module comprises:
  • Generating a motion test trajectory plane unit configured to detect a motion test trajectory of the arm motion by detecting a motion test trajectory of the arm bending and the arm extension;
  • Determining a projection plane unit configured to determine that a projection plane for text input is a YZ projection plane when the generated motion test trajectory plane is parallel to the XZ plane and perpendicular to the YZ plane, and when the generated motion test trajectory plane is parallel to YZ Plane and perpendicular to the XZ plane, the projection plane that determines the wristwatch for text input is the XZ projection plane.
  • the generating the text information sub-module includes:
  • the detecting unit is configured to monitor, in real time, whether the arm of the wristwatch enters the determined projection plane after determining the projection plane of the wristwatch;
  • Generating a text information unit configured to generate text information by recording a motion trajectory of the arm when detecting that the arm wearing the wristwatch enters the determined projection plane.
  • the text information unit is generated, specifically for: when detecting that the arm wearing the wristwatch enters the determined projection plane, starting a timer and starting to record the motion track of the arm;
  • Text information is generated when the recorded arm motion trajectory matches a text in the text database.
  • the apparatus may further include: establishing a communication link module, configured to perform pairing processing with the mobile terminal, and establish a communication link with the mobile terminal.
  • establishing the communication link module 201 can be implemented by a communication chip in the input device of the mobile terminal; sending a text input request module 202, receiving and displaying the text information module 203, and determining that the projection plane sub-module can be input by the input device of the mobile terminal Central Processing Unit (CPU), Micro Control Unit (MCU), Digital Signal Processor (DSP), or Field-Programmable Gate Array (FPGA) combined with communication chip
  • CPU Central Processing Unit
  • MCU Micro Control Unit
  • DSP Digital Signal Processor
  • FPGA Field-Programmable Gate Array
  • the method of generating a motion test trajectory plane unit, determining a projection plane unit, generating a text information sub-module, detecting a unit, and generating a text information unit may be implemented by a CPU, an MCU, a DSP, or an FPGA in an input device of the mobile terminal.
  • FIG. 3 is a flowchart of a method for implementing input on a mobile phone side according to an embodiment of the present invention. As shown in FIG. 3, the method includes the following steps:
  • Step S301 starting a Bluetooth matching module
  • the purpose of starting the Bluetooth matching module for the mobile phone is to match the wristwatch, and after the matching is successful, form a one-to-one correspondence with the wristwatch, and prepare for the establishment of the subsequent input.
  • Step S302 is the matching watch successful?
  • this step mainly determines whether the Bluetooth pairing of the mobile phone and the watch is successful. If it is determined that the matching watch is successful, the process proceeds to step S303. If it is determined that the matching watch fails, the system prompts the user to re-test to proceed to step S302.
  • Step S303 entering an interface to be input
  • the mobile phone can enter an interface that needs to input text to prepare for input.
  • Step S304 sending an input request to the wristwatch
  • the mobile phone is ready to receive input, and the mobile phone sends an input request signal to the wristwatch via Bluetooth, and commands the wristwatch to start inputting.
  • Step S305 receiving a watch input and displaying
  • the wristwatch receives the request of step S304, it performs motion and generates text, which is transmitted to the mobile phone through Bluetooth, and the mobile phone receives the text and displays to the interface to be input described in step S303.
  • step S307 if the mobile terminal user has confirmed that the input is completed, the process proceeds to step S307, and if the mobile terminal user confirms that the input has not been completed, step S305 is repeated.
  • step S307 an end signal is sent to the wristwatch.
  • FIG. 5 is a flowchart of a method for implementing input on a wristwatch side according to an embodiment of the present invention. As shown in FIG. 5, the method includes the following steps:
  • Step S501 starting a Bluetooth matching module
  • the user mainly activates the Bluetooth matching module of the watch to pair with the user's smartphone.
  • Step S502 is the matching mobile phone successful?
  • step S503 it is judged whether the pairing is successful, and if the pairing successfully proceeds to step S503, if the pairing fails, the system prompts the user to re-test to proceed to step S502.
  • Step S503 receiving a start input signal?
  • the step is mainly that the watch end waits for the start input signal of the mobile phone side, and determines whether the start input signal is received. If the watch receives the input request signal of the mobile phone, the process proceeds to step S504, if the watch is not received. Upon receiving the input request signal of the mobile phone, the system prompts the user to re-test to proceed to step S503.
  • Step S504 starting a projection plane detecting module
  • this step mainly starts the projection plane detecting module, and the module mainly determines the projection surface to be input by the user through the user projection plane detecting action.
  • the embodiment of the present invention requires the user to determine a projection plane as a sampling standard plane for subsequent input before inputting.
  • the specific determination method includes, but is not limited to, the following method. First, the user's arm with the wristwatch is bent. At this time, a position is recorded by the gravity sensor, and then the user's arm is straightened, and then a position is recorded, and this is repeated three times. At this time, the projection detection module determines a projection plane according to the user action.
  • the projection plane is the XZ plane; similarly, if the user's motion is parallel to the XZ plane, and YZ The plane is vertical and the projection plane is the YZ plane.
  • the relationship between the user's motion trajectory and the X-Z and Y-Z planes can be obtained by the X ⁇ Y ⁇ Z component value of the motion process recorded by the gravity acceleration sensor.
  • the motion process determines that the user motion is perpendicular to the X-Z plane, parallel to the Y-Z axis plane, and the projection plane is the X-Z plane.
  • Step S505 the projection plane is determined?
  • the step determines whether the projection plane is determined. If the projection plane test is successful, the projection plane is determined, the system records the projection plane and proceeds to step S506. If the projection plane is not determined to be successful, the system prompts the user to re-test to proceed to step S505.
  • Step S506 starting a motion track detection module
  • this step mainly detects the arm movement of the user with the wristwatch.
  • the track starting point is recorded.
  • Timeout (such as more than 3 seconds) when the user's watch movement exits the projection plane area, or the total recording time expires from the starting point (for example, the maximum time for each word input is 10) Seconds, it is counted as ending one input.
  • Step S507 the motion track detecting module records the motion track
  • this step mainly records the movement track of the watch through the gravity acceleration sensor of the watch itself.
  • the gravity acceleration sensor itself can output acceleration values in three directions of X, Y, and Z when the device to which it belongs is moving. If the return value of the X direction is 1, it indicates that the device is moving in the positive direction of the X axis with an acceleration of 1 m per square second. According to the relationship of acceleration, time, speed and displacement, the motion direction and the motion displacement, that is, the motion trajectory can be calculated. Similarly, the Y-axis motion is similar to X. In the Z direction, when the device Z is stationary, the Z-direction return value is 9.8 meters per square second, which is a gravitational acceleration.
  • the return value is greater than 9.8 meters per square second. If the Z-axis moves in the negative direction, the return value is less than 9.8 meters per square second. According to this principle, the motion trajectory of the device in the X, Y, Z three-dimensional space can be drawn.
  • the rule for recording the motion trajectory in the embodiment of the present invention is that the wristwatch enters the projection area for the first time to record the starting point, and then the motion track of the wristwatch in the projection area is sampled by the gravity acceleration sensor in unit time (for example, Sampling every 500 milliseconds and drawing the trajectory) and recording the trajectory, the trajectory only draws the parallel part of the projection plane, the vertical part is not recorded, and the vertical part movement only calculates whether the motion is in the projection area (the projection plane position determined by S505 is positive or negative) 5 cm is used for recording track area).
  • the projection plane is an XZ plane
  • the Y-direction motion is used to determine whether the motion enters the projection area.
  • the projection trajectory of the XZ plane is recorded.
  • Figure 4 assumes that the user wants to input the number 0, then every 500 milliseconds. A period of sampling gravity acceleration value draws a trajectory, and the entire 0 trajectory is completed by 10 sampling periods, as shown in Fig. 4, the trajectory is 10 segments. Then, the input motion track of the final recorded 0 is as shown in FIG.
  • This cycle sampling method can record any track content projected on the X-Z plane.
  • step S508 is the motion input ended?
  • step S506 it is determined whether the motion input ends according to the determination condition described in step S506, and if it is determined that the motion input ends, the motion track recorded by the recording module is transmitted to the text recognition of step S509.
  • the module processing if it is determined that the motion input is not finished, the system prompts the user to re-test into step S508.
  • Step S509 the text recognition module determines the input text
  • the character recognition module receives the motion track transmitted in step S508, inputs the motion track into the character database for comparison query, and if the track matches a certain character, outputs the text to step S5010.
  • Step S5010 transmitting the text to the mobile phone
  • step S509 the text outputted in step S509 is directly transmitted to the user's mobile phone through the Bluetooth matched in step S501, and the text is displayed on the output interface through the mobile phone.
  • step S5011 it is determined whether the input is ended.
  • step S5012 it is detected whether the mobile phone sends a termination input signal to the wristwatch. If there is a termination signal, the process goes to step S5012, otherwise steps S506 to S5011 are repeated, and the input of the text to the mobile phone is continued.
  • step S5012 the input is ended, the Bluetooth is turned off, and the system is turned off.
  • the wristwatch includes: a Bluetooth matching module, an input projection plane detecting module, a wristwatch motion track detecting module, and a text recognition module
  • the mobile phone includes: a Bluetooth matching module and a mobile phone text input module.
  • the Bluetooth matching module in the wristwatch and the Bluetooth matching module in the mobile phone are configured to be paired with the user's smart wristwatch and the mobile phone;
  • the input projection plane detecting module is configured to detect the motion of the user's arm and the projection of the user input
  • the plane motion determination module is configured to detect an arm motion track of the wrist watch after determining the input projection plane;
  • the text recognition module is configured to identify the motion track and determine what is input Text;
  • the mobile phone text input module is configured to input and display text by receiving text information sent by the wristwatch side.
  • the specific implementation includes the following steps:
  • Step 1 Start the pairing of the user's smart watch and the Bluetooth matching module of the mobile phone;
  • Step 2 After the pairing is successful, the smart phone enters the interface to be input, and the mobile phone sends a start input signal to the watch and prepares to receive the input;
  • Step 3 After receiving the signal input at the beginning, the watch first inputs the projection detection module to determine the projection plane input by the user;
  • Step 4 After determining the input projection plane, start moving the arm with the wristwatch to complete the text track input;
  • Step 5 The character recognition module of the watch recognizes the motion track and determines what text is input
  • Step 6 Transfer the input text to the mobile phone through Bluetooth, and implement text input on the mobile phone.
  • the interaction function between the smart watch and the mobile terminal in the embodiment of the invention is that the watch and the mobile terminal are combined to achieve a better user experience.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • an embodiment of the present invention further provides that the computer storage medium includes a set of instructions that, when executed, cause at least one processor to execute the input method of the mobile terminal.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Function (AREA)

Abstract

Disclosed are an input method and apparatus for a mobile terminal, and a computer storage medium. The method comprises: a mobile terminal sends, by means of a communication link established with a watch, a text input request to the watch, and instructs the watch to start text input, the watch being a watch worn on a wrist; and the mobile terminal receives, by means of the communication link, text information generated by the watch due to arm movement, and displays same on an input interface of the mobile terminal.

Description

一种移动终端的输入方法、装置及计算机存储介质Input method, device and computer storage medium for mobile terminal 技术领域Technical field
本发明涉及无线通信技术领域,特别涉及一种移动终端的输入方法、装置及计算机存储介质。The present invention relates to the field of wireless communication technologies, and in particular, to an input method, device, and computer storage medium for a mobile terminal.
背景技术Background technique
目前已有手机输入方法,包括手写输入、拼音输入、语音输入、笔画输入等,这些输入方法多是直接操作智能手机进行输入。但现有输入方法,多是在屏幕上直接通过触摸操作来实现的,当移动终端屏幕很小时(如智能腕表),触摸屏操作输入很不方便。At present, there are mobile phone input methods, including handwriting input, pinyin input, voice input, stroke input, etc. These input methods are mostly direct operation of the smart phone for input. However, the existing input method is mostly realized by a touch operation on the screen. When the screen of the mobile terminal is very small (such as a smart watch), the touch screen operation input is inconvenient.
发明内容Summary of the invention
为解决现有存在的技术问题,本发明实施例提供一种移动终端的输入方法、装置及计算机存储介质。In order to solve the existing technical problems, embodiments of the present invention provide a method, an apparatus, and a computer storage medium for inputting a mobile terminal.
根据本发明实施例的一个方面,提供了一种移动终端的输入方法,包括:According to an aspect of an embodiment of the present invention, a method for inputting a mobile terminal is provided, including:
移动终端通过与腕表建立的通信链路,向所述腕表发送文字输入请求,指令所述腕表开始进行文字输入;所述腕表为戴在手腕上的腕表;The mobile terminal sends a text input request to the wristwatch through a communication link established with the wristwatch, instructing the wristwatch to start text input; the wristwatch is a wristwatch worn on the wrist;
移动终端通过所述通信链路,接收所述腕表通过手臂运动生成的文字信息,并将其显示在移动终端待输入界面上。The mobile terminal receives the text information generated by the wristwatch through the arm movement through the communication link, and displays the text information on the mobile terminal to be input interface.
上述方案中,所述方法还包括:In the above solution, the method further includes:
所述移动终端与所述腕表进行配对处理,与所述腕表建立通信链路。The mobile terminal performs pairing processing with the wristwatch to establish a communication link with the wristwatch.
根据本发明实施例的另一个方面,提供了一种移动终端的输入方法,包括: According to another aspect of the embodiments of the present invention, a method for inputting a mobile terminal is provided, including:
腕表通过与移动终端建立的通信链路,接收到所述移动终端发送的文字输入请求后,通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面;所述腕表为戴在手腕上的腕表;After receiving the text input request sent by the mobile terminal through the communication link established with the mobile terminal, the wristwatch detects the motion test track of the arm bending and the arm straightening, and determines the projection plane of the wristwatch for text input. The watch is a wristwatch worn on the wrist;
当所述腕表检测到戴腕表的手臂进入到所确定的投影平面时,通过手臂运动生成文字信息;When the wristwatch detects that the arm of the wristwatch enters the determined projection plane, generating text information by arm movement;
所述腕表通过所述通信链路,将所生成的文字信息通过所述通信链路,发送到所述移动终端,以使所述移动终端进行显示。The wristwatch transmits the generated text information to the mobile terminal through the communication link through the communication link, so that the mobile terminal performs display.
上述方案中,所述投影平面包括X-Z投影平面和Y-Z投影;所述通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面包括:In the above solution, the projection plane includes an X-Z projection plane and a Y-Z projection; and the motion test track for bending the arm and extending the arm is detected, and determining a projection plane of the wristwatch for text input includes:
通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,生成手臂运动的运动测试轨迹平面;The motion test trajectory of the arm movement is generated by detecting the motion test trajectory of the arm bending and the arm extension;
当所生成的运动测试轨迹平面平行于X-Z平面且垂直于Y-Z平面,确定腕表用于文字输入的投影平面是Y-Z投影平面;When the generated motion test trajectory plane is parallel to the X-Z plane and perpendicular to the Y-Z plane, it is determined that the projection plane of the wristwatch for text input is a Y-Z projection plane;
当所生成的运动测试轨迹平面平行于Y-Z平面且垂直于X-Z平面,确定腕表用于文字输入的投影平面是X-Z投影平面。When the generated motion test trajectory plane is parallel to the Y-Z plane and perpendicular to the X-Z plane, it is determined that the projection plane for the text input of the wristwatch is the X-Z projection plane.
上述方案中,所述当所述腕表检测到戴腕表的手臂进入到所确定的投影平面时,通过手臂运动生成文字信息包括:In the above solution, when the wristwatch detects that the arm of the wristwatch enters the determined projection plane, generating the text information by the arm movement includes:
当所述腕表确定腕表的投影平面后,实时监测戴腕表的手臂是否进入到所确定的投影平面;After the watch determines the projection plane of the watch, it is monitored in real time whether the arm of the wristwatch enters the determined projection plane;
当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息。When it is detected that the arm wearing the wristwatch enters the determined projection plane, the text information is generated by recording the motion trajectory of the arm.
上述方案中,所述当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息包括:In the above solution, when detecting that the arm wearing the wristwatch enters the determined projection plane, generating the text information by recording the motion track of the arm includes:
当检测到戴腕表的手臂进入到所确定的投影平面时,启动计时器并开 始记录所述手臂的运动轨迹;When it is detected that the arm wearing the watch enters the determined projection plane, the timer is started and turned on. Recording the movement trajectory of the arm;
当所述计时器计时到设定时间时,结束记录所述手臂的运动轨迹;When the timer counts to the set time, the recording of the movement trajectory of the arm is ended;
通过将所记录的手臂运动轨迹与预置的文字数据库进行匹配,判断是否生成文字信息;Whether to generate text information by matching the recorded arm movement trajectory with a preset text database;
当所记录的手臂运动轨迹与所述文字数据库中的一个文字匹配时,则生成文字信息。Text information is generated when the recorded arm motion trajectory matches a text in the text database.
上述方案中,所述方法还包括:In the above solution, the method further includes:
所述腕表与所述移动终端进行配对处理,与所述移动终端建立通信链路。The wristwatch performs pairing processing with the mobile terminal to establish a communication link with the mobile terminal.
根据本发明实施例的另一方面,提供了一种移动终端的输入装置,包括:According to another aspect of the embodiments of the present invention, an input device of a mobile terminal is provided, including:
发送文字输入请求模块,配置为通过与腕表建立的通信链路,向所述腕表发送文字输入请求,指令所述腕表开始进行文字输入;所述腕表为戴在手腕上的腕表;Sending a text input requesting module, configured to send a text input request to the wristwatch through a communication link established with the wristwatch, instructing the wristwatch to start text input; the wristwatch is a wristwatch worn on the wrist ;
接收及显示文字信息模块,配置为移动终端通过所述通信链路,接收所述腕表通过手臂运动生成的文字信息,并将其显示在移动终端待输入界面上。Receiving and displaying a text information module, configured to receive, by the mobile terminal, text information generated by the arm movement by the arm movement through the communication link, and display the text information on the mobile terminal to be input interface.
上述方案中,所述装置还包括:In the above solution, the device further includes:
建立通信链路模块,配置为通过与所述腕表进行配对处理,与所述腕表建立通信链路。Establishing a communication link module configured to establish a communication link with the wristwatch by performing pairing processing with the wristwatch.
根据本发明实施例的又一个方面,提供了一种移动终端的输入装置,包括:According to still another aspect of the embodiments of the present invention, an input device of a mobile terminal is provided, including:
确定投影平面子模块,配置为通过与移动终端建立的通信链路,接收到所述移动终端发送的文字输入请求后,通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面;所述腕表为戴 在手腕上的腕表;Determining a projection plane sub-module, configured to, after receiving a text input request sent by the mobile terminal by using a communication link established with the mobile terminal, detecting the motion test track of the arm bending and the arm extension, and determining the wristwatch a projection plane for text input; the watch is worn a wrist watch on the wrist;
生成文字信息子模块,当检测到戴腕表的手臂进入到所确定的投影平面时,通过手臂运动生成文字信息;并将所生成的文字信息通过所述通信链路,发送到所述移动终端,以使所述移动终端进行显示。Generating a text information sub-module, and when detecting that the arm wearing the wristwatch enters the determined projection plane, generating text information by arm movement; and transmitting the generated text information to the mobile terminal through the communication link So that the mobile terminal performs display.
上述方案中,所述投影平面包括X-Z投影平面和Y-Z投影;所述确定投影平面子模块包括:In the above solution, the projection plane includes an X-Z projection plane and a Y-Z projection; and the determining the projection plane sub-module comprises:
生成运动测试轨迹平面单元,配置为通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,生成手臂运动的运动测试轨迹平面;Generating a motion test trajectory plane unit configured to detect a motion test trajectory of the arm motion by detecting a motion test trajectory of the arm bending and the arm extension;
确定投影平面单元,配置为当所生成的运动测试轨迹平面平行于X-Z平面且垂直于Y-Z平面,确定腕表用于文字输入的投影平面是Y-Z投影平面,以及当所生成的运动测试轨迹平面平行于Y-Z平面且垂直于X-Z平面,确定腕表用于文字输入的投影平面是X-Z投影平面。Determining a projection plane unit, configured to determine that a projection plane for text input is a YZ projection plane when the generated motion test trajectory plane is parallel to the XZ plane and perpendicular to the YZ plane, and when the generated motion test trajectory plane is parallel to YZ Plane and perpendicular to the XZ plane, the projection plane that determines the wristwatch for text input is the XZ projection plane.
上述方案中,所述生成文字信息子模块包括:In the above solution, the generating the text information submodule includes:
检测单元,配置为当确定腕表的投影平面后,实时监测戴腕表的手臂是否进入到所确定的投影平面;The detecting unit is configured to monitor, in real time, whether the arm of the wristwatch enters the determined projection plane after determining the projection plane of the wristwatch;
生成文字信息单元,配置为当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息。Generating a text information unit configured to generate text information by recording a motion trajectory of the arm when detecting that the arm wearing the wristwatch enters the determined projection plane.
上述方案中,所述装置还包括:建立通信链路模块,配置为与所述移动终端进行配对处理,与所述移动终端建立通信链路。In the above solution, the apparatus further includes: establishing a communication link module, configured to perform pairing processing with the mobile terminal, and establish a communication link with the mobile terminal.
根据本发明实施例的另一方面,提供了一种计算机存储介质,所述计算机存储介质包括一组指令,当执行所述指令时,引起至少一个处理器执行上述的移动终端的输入方法。According to another aspect of an embodiment of the present invention, a computer storage medium is provided, the computer storage medium comprising a set of instructions that, when executed, cause at least one processor to perform an input method of the mobile terminal described above.
与现有技术相比较,本发明实施例的有益效果在于:Compared with the prior art, the beneficial effects of the embodiments of the present invention are:
本发明实施例通过智能腕表运行轨迹侦测及与移动终端实时通讯实现移动终端的输入,解决了现有技术中因移动终端屏幕小,不方便直接通过 触摸操作进行输入的问题,提高了用户体验。The embodiment of the invention realizes the input of the mobile terminal by the trajectory detection of the smart watch and the real-time communication with the mobile terminal, and solves the problem that the screen of the mobile terminal is small and inconvenient to pass directly in the prior art. The problem of touching the input for input improves the user experience.
附图说明DRAWINGS
图1是本发明实施例提供的一种移动终端的输入方法流程示意图;1 is a schematic flowchart of an input method of a mobile terminal according to an embodiment of the present invention;
图2是本发明实施例提供的一种移动终端的输入装置结构示意图;2 is a schematic structural diagram of an input device of a mobile terminal according to an embodiment of the present invention;
图3是本发明实施例提供的手机侧实现输入的方法流程示意图;3 is a schematic flowchart of a method for implementing input on a mobile phone side according to an embodiment of the present invention;
图4是本发明实施例提供的腕表在投影平面输入运动轨迹的示意图;4 is a schematic diagram of a motion track input by a wristwatch in a projection plane according to an embodiment of the present invention;
图5是本发明实施例提供的腕表侧实现输入的方法流程示意图。FIG. 5 is a schematic flowchart of a method for implementing input on a wristwatch side according to an embodiment of the present invention.
具体实施方式detailed description
以下结合附图对本发明的优选实施例进行详细说明,应当理解,以下所说明的优选实施例仅用于说明和解释本发明,并不用于限定本发明。The preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings.
图1显示了本发明实施例提供的一种移动终端的输入方法的流程图,如图1所示,包括以下步骤:FIG. 1 is a flowchart of a method for inputting a mobile terminal according to an embodiment of the present invention. As shown in FIG. 1, the method includes the following steps:
步骤S101:移动终端通过与戴在手腕上的腕表进行配对处理,与所述腕表建立通信链路;Step S101: The mobile terminal establishes a communication link with the wristwatch by performing pairing processing with a wristwatch worn on the wrist;
步骤S102:移动终端与所述腕表建立通信链路后,向所述腕表发送文字输入请求,指令所述腕表开始进行文字输入;Step S102: After establishing a communication link with the wristwatch, the mobile terminal sends a text input request to the wristwatch, instructing the wristwatch to start text input.
步骤S103:移动终端通过建立的通信链路,接收所述腕表通过手臂运动生成的文字信息,并将其显示在移动终端待输入界面上。Step S103: The mobile terminal receives the text information generated by the wristwatch by the arm movement through the established communication link, and displays the text information on the mobile terminal to be input interface.
其中,在一实施例中,腕表侧的方法可以包括:所述腕表接收到所述移动终端发送的文字输入请求后,通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面。In an embodiment, the method on the wrist side may include: after receiving the text input request sent by the mobile terminal, the wristwatch detects the wrist by bending the arm and bending the arm to test the trajectory. The table is used for the projection plane of the text input.
这里,所述投影平面包括X-Z投影平面和Y-Z投影。具体地说,所述通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面包括:通过对手臂弯曲和手臂伸直的运动测试轨迹进行检 测,生成手臂运动的运动测试轨迹平面;当生成的运动测试轨迹平面平行于X-Z平面且垂直于Y-Z平面,则确定腕表用于文字输入的投影平面是Y-Z投影平面;当所生成的运动测试轨迹平面平行于Y-Z平面且垂直于X-Z平面,则确定腕表用于文字输入的投影平面是X-Z投影平面。Here, the projection plane includes an X-Z projection plane and a Y-Z projection. Specifically, the motion test trajectory for bending the arm and extending the arm is detected, and determining the projection plane of the wristwatch for text input includes: checking the motion test trajectory of the arm bending and the arm straightening Measure, generate a motion test trajectory plane of the arm motion; when the generated motion test trajectory plane is parallel to the XZ plane and perpendicular to the YZ plane, determine that the projection plane of the wristwatch for text input is a YZ projection plane; when the generated motion test trajectory The plane is parallel to the YZ plane and perpendicular to the XZ plane, then the projection plane for the text input of the wristwatch is determined to be the XZ projection plane.
在一实施例中,该方法还可以包括:In an embodiment, the method may further include:
所述腕表通过手臂运动生成文字信息。The watch generates text information by arm movement.
具体地,当所述腕表确定腕表用于文字输入的投影平面后,实时监测戴腕表的手臂是否进入到所确定的投影平面;当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息。其中,所述当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息包括:当检测到戴腕表的手臂进入到所确定的投影平面时,启动计时器并开始记录所述手臂的运动轨迹;当所述计时器计时到设定时间时,结束记录所述手臂的运动轨迹;通过将所记录的手臂运动轨迹与预置的文字数据库进行匹配,判断是否生成文字信息;当所记录的手臂运动轨迹与所述文字数据库中的一个文字匹配时,则生成文字信息。Specifically, when the wristwatch determines the projection plane of the wristwatch for text input, it monitors in real time whether the arm of the wristwatch enters the determined projection plane; when detecting that the arm of the wristwatch enters the determined projection In the plane, text information is generated by recording the motion trajectory of the arm. Wherein, when detecting that the arm wearing the wristwatch enters the determined projection plane, generating the text information by recording the motion track of the arm includes: when detecting that the arm wearing the wristwatch enters the determined projection plane , starting a timer and starting to record the movement track of the arm; when the timer counts to the set time, ending recording the movement track of the arm; by performing the recorded arm movement track and the preset text database Matching, determining whether to generate text information; when the recorded arm movement trajectory matches one of the characters in the text database, generating text information.
本发明实施例的方法还可以包括:所述腕表通过所述通信链路,将所生成的文字信息发送到所述移动终端,以使所述移动终端进行显示。The method of the embodiment of the present invention may further include: sending, by the wristwatch, the generated text information to the mobile terminal by using the communication link, so that the mobile terminal performs display.
从上面的描述中可以看出,本发明实施例的方法包括移动终端侧的移动终端的输入方法以及腕表侧的移动终端的输入方法。As can be seen from the above description, the method of the embodiment of the present invention includes an input method of the mobile terminal on the mobile terminal side and an input method of the mobile terminal on the wristwatch side.
具体地,对于移动终端侧,其方法包括以下步骤:Specifically, for the mobile terminal side, the method includes the following steps:
移动终端通过与腕表建立的通信链路,向所述腕表发送文字输入请求,指令所述腕表开始进行文字输入;所述腕表为戴在手腕上的腕表;The mobile terminal sends a text input request to the wristwatch through a communication link established with the wristwatch, instructing the wristwatch to start text input; the wristwatch is a wristwatch worn on the wrist;
移动终端通过所述通信链路,接收所述腕表通过手臂运动生成的文字信息,并将其显示在移动终端待输入界面上。 The mobile terminal receives the text information generated by the wristwatch through the arm movement through the communication link, and displays the text information on the mobile terminal to be input interface.
其中,在一实施例中,该方法还可以包括:In an embodiment, the method may further include:
所述移动终端与所述腕表进行配对处理,与所述腕表建立通信链路。The mobile terminal performs pairing processing with the wristwatch to establish a communication link with the wristwatch.
对于腕表侧,其方法包括以下步骤:For the wrist side, the method includes the following steps:
腕表通过与移动终端建立的通信链路,接收到所述移动终端发送的文字输入请求后,通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面;所述腕表为戴在手腕上的腕表;After receiving the text input request sent by the mobile terminal through the communication link established with the mobile terminal, the wristwatch detects the motion test track of the arm bending and the arm straightening, and determines the projection plane of the wristwatch for text input. The watch is a wristwatch worn on the wrist;
当所述腕表检测到戴腕表的手臂进入到所确定的投影平面时,通过手臂运动生成文字信息;When the wristwatch detects that the arm of the wristwatch enters the determined projection plane, generating text information by arm movement;
所述腕表通过所述通信链路,将所生成的文字信息通过所述通信链路,发送到所述移动终端,以使所述移动终端进行显示。The wristwatch transmits the generated text information to the mobile terminal through the communication link through the communication link, so that the mobile terminal performs display.
其中,所述投影平面包括X-Z投影平面和Y-Z投影;所述通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面,具体包括:The projection plane includes an X-Z projection plane and a Y-Z projection; and the motion test track for bending the arm and extending the arm is detected to determine a projection plane of the wristwatch for text input, specifically including:
通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,生成手臂运动的运动测试轨迹平面;The motion test trajectory of the arm movement is generated by detecting the motion test trajectory of the arm bending and the arm extension;
当所生成的运动测试轨迹平面平行于X-Z平面且垂直于Y-Z平面,确定腕表用于文字输入的投影平面是Y-Z投影平面;When the generated motion test trajectory plane is parallel to the X-Z plane and perpendicular to the Y-Z plane, it is determined that the projection plane of the wristwatch for text input is a Y-Z projection plane;
当所生成的运动测试轨迹平面平行于Y-Z平面且垂直于X-Z平面,确定腕表用于文字输入的投影平面是X-Z投影平面。When the generated motion test trajectory plane is parallel to the Y-Z plane and perpendicular to the X-Z plane, it is determined that the projection plane for the text input of the wristwatch is the X-Z projection plane.
所述当所述腕表检测到戴腕表的手臂进入到所确定的投影平面时,通过手臂运动生成文字信息,具体包括:When the wristwatch detects that the arm of the wristwatch enters the determined projection plane, the text information is generated by the arm movement, and specifically includes:
当所述腕表确定腕表的投影平面后,实时监测戴腕表的手臂是否进入到所确定的投影平面;After the watch determines the projection plane of the watch, it is monitored in real time whether the arm of the wristwatch enters the determined projection plane;
当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息。 When it is detected that the arm wearing the wristwatch enters the determined projection plane, the text information is generated by recording the motion trajectory of the arm.
这里,所述当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息具体包括:Here, when it is detected that the arm wearing the wristwatch enters the determined projection plane, generating the text information by recording the motion track of the arm specifically includes:
当检测到戴腕表的手臂进入到所确定的投影平面时,启动计时器并开始记录所述手臂的运动轨迹;When it is detected that the arm wearing the watch enters the determined projection plane, the timer is started and the movement track of the arm is started to be recorded;
当所述计时器计时到设定时间时,结束记录所述手臂的运动轨迹;When the timer counts to the set time, the recording of the movement trajectory of the arm is ended;
通过将所记录的手臂运动轨迹与预置的文字数据库进行匹配,判断是否生成文字信息;Whether to generate text information by matching the recorded arm movement trajectory with a preset text database;
当所记录的手臂运动轨迹与所述文字数据库中的一个文字匹配时,则生成文字信息。Text information is generated when the recorded arm motion trajectory matches a text in the text database.
实际应用时,该方法还可以包括:In practical applications, the method may further include:
所述腕表与所述移动终端进行配对处理,与所述移动终端建立通信链路。The wristwatch performs pairing processing with the mobile terminal to establish a communication link with the mobile terminal.
图2显示了本发明实施例提供的一种移动终端的输入装置的示意图,如图2所示,包括:建立通信链路模块201、发送文字输入请求模块202以及接收及显示文字信息模块203。所述建立通信链路模块201,配置为通过与戴在手腕上的腕表进行配对处理,使所述移动终端与所述腕表建立通信链路;所述发送文字输入请求模块202,配置为所述移动终端与所述腕表建立通信链路后,向所述腕表发送文字输入请求,指令所述腕表开始进行文字输入;所述接收及显示文字信息模块203,配置为通过建立的通信链路,接收所述腕表通过手臂运动生成的文字信息,并将其显示在移动终端待输入界面上。FIG. 2 is a schematic diagram of an input device of a mobile terminal according to an embodiment of the present invention. As shown in FIG. 2, the method includes: establishing a communication link module 201, transmitting a text input request module 202, and receiving and displaying a text information module 203. The communication link module 201 is configured to perform a pairing process with a wrist watch worn on the wrist to establish a communication link between the mobile terminal and the wristwatch; and the sending text input request module 202 is configured to After establishing a communication link with the wristwatch, the mobile terminal sends a text input request to the wristwatch, instructing the wristwatch to start text input; and the receiving and displaying text information module 203 is configured to pass the established The communication link receives the text information generated by the wristwatch by the arm movement and displays it on the mobile terminal to be input interface.
本发明实施例位于腕表的装置可以包括:确定投影平面子模块,配置为接收到所述移动终端发送的文字输入请求后,通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面;其中,所述投影平面包括X-Z投影平面和Y-Z投影。具体地说,所述的确定投影 平面子模块包括:生成运动测试轨迹平面单元,配置为通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,生成手臂运动的运动测试轨迹平面;确定投影平面单元,配置为当所生成的运动测试轨迹平面平行于X-Z平面且垂直于Y-Z平面,则确定腕表用于文字输入的投影平面是Y-Z投影平面,以及当所生成的运动测试轨迹平面平行于Y-Z平面且垂直于X-Z平面,则确定腕表用于文字输入的投影平面是X-Z投影平面。The device of the embodiment of the present invention may include: a determining a projection plane sub-module configured to: after receiving the text input request sent by the mobile terminal, detecting the motion test track by bending the arm and extending the arm to determine the wrist The table is for a projection plane of text input; wherein the projection plane comprises an XZ projection plane and a YZ projection. Specifically, the determined projection The plane sub-module includes: a motion test trajectory plane unit configured to detect a motion test trajectory of the arm bending and the arm extension to generate a motion test trajectory plane of the arm motion; determine a projection plane unit, configured to generate the motion test The trajectory plane is parallel to the XZ plane and perpendicular to the YZ plane, then the projection plane for the text input of the wristwatch is determined to be the YZ projection plane, and the watch is determined when the generated motion test trajectory plane is parallel to the YZ plane and perpendicular to the XZ plane. The projection plane for text input is the XZ projection plane.
本发明实施例位于腕表的装置还可以包括生成文字信息子模块,配置为通过记录所述手臂的运动轨迹生成文字信息;其中,所述生成文字信息子模块包括:检测单元,配置为当所述腕表确定腕表的投影平面后,实时监测戴腕表的手臂是否进入到所确定的投影平面;生成文字信息单元,配置为当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息。The apparatus for the wristwatch of the embodiment of the present invention may further include: a text information sub-module configured to generate the text information by recording the motion track of the arm; wherein the generating the text information sub-module comprises: a detecting unit configured to be After the watch determines the projection plane of the watch, it monitors in real time whether the arm of the wristwatch enters the determined projection plane; generates a text information unit configured to detect when the arm wearing the watch enters the determined projection plane Text information is generated by recording the motion trajectory of the arm.
所述生成文字信息子模块,还用于通过所述通信链路,将所生成的文字信息发送到所述移动终端,以使所述移动终端进行显示。The generated text information sub-module is further configured to send the generated text information to the mobile terminal through the communication link, so that the mobile terminal performs display.
相应地,基于上述方法的描述,本发明实施例的移动终端的输入装置的各模块中,有位于移动终端侧的模块,也有位于腕表侧的模块。Correspondingly, based on the description of the above method, each module of the input device of the mobile terminal in the embodiment of the present invention has a module located on the mobile terminal side and a module located on the wristwatch side.
具体地,在移动终端侧,本发明实施例的移动终端的输入装置可以包括:发送文字输入请求模块202以及接收及显示文字信息模块203;其中,Specifically, on the mobile terminal side, the input device of the mobile terminal in the embodiment of the present invention may include: a text input request module 202 and a text information module 203;
发送文字输入请求模块202,配置为通过与腕表建立的通信链路,向所述腕表发送文字输入请求,指令所述腕表开始进行文字输入;所述腕表为戴在手腕上的腕表;Sending a text input requesting module 202, configured to send a text input request to the wristwatch through a communication link established with the wristwatch, instructing the wristwatch to start text input; the wristwatch is a wrist worn on the wrist table;
接收及显示文字信息模块203,配置通过所述通信链路,接收所述腕表通过手臂运动生成的文字信息,并将其显示在移动终端待输入界面上Receiving and displaying a text information module 203, configured to receive text information generated by the wristwatch by arm movement through the communication link, and display the text information on the mobile terminal to be input interface
其中,在一实施例中,本发明实施例的移动终端的输入装置还可以包括:建立通信链路模块,配置为通过与所述腕表进行配对处理,与所述腕 表建立通信链路。In an embodiment, the input device of the mobile terminal of the embodiment of the present invention may further include: establishing a communication link module, configured to perform pairing processing with the wristwatch, and the wrist The table establishes a communication link.
在腕表侧,本发明实施例的移动终端的输入装置包括:确定投影平面子模块,配置为通过与移动终端建立的通信链路,接收到所述移动终端发送的文字输入请求后,通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面;所述腕表为戴在手腕上的腕表;On the wristwatch side, the input device of the mobile terminal of the embodiment of the present invention includes: a determining a projection plane sub-module configured to receive a text input request sent by the mobile terminal through a communication link established with the mobile terminal, and then The motion test track of the arm bending and the arm straightening is detected to determine the projection plane of the wristwatch for text input; the wristwatch is a wristwatch worn on the wrist;
生成文字信息子模块,当检测到戴腕表的手臂进入到所确定的投影平面时,通过手臂运动生成文字信息;并将所生成的文字信息通过所述通信链路,发送到所述移动终端,以使所述移动终端进行显示。Generating a text information sub-module, and when detecting that the arm wearing the wristwatch enters the determined projection plane, generating text information by arm movement; and transmitting the generated text information to the mobile terminal through the communication link So that the mobile terminal performs display.
其中,在一实施例中,所述投影平面包括X-Z投影平面和Y-Z投影;所述确定投影平面子模块包括:In an embodiment, the projection plane includes an X-Z projection plane and a Y-Z projection; and the determining the projection plane sub-module comprises:
生成运动测试轨迹平面单元,配置为通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,生成手臂运动的运动测试轨迹平面;Generating a motion test trajectory plane unit configured to detect a motion test trajectory of the arm motion by detecting a motion test trajectory of the arm bending and the arm extension;
确定投影平面单元,配置为当所生成的运动测试轨迹平面平行于X-Z平面且垂直于Y-Z平面,确定腕表用于文字输入的投影平面是Y-Z投影平面,以及当所生成的运动测试轨迹平面平行于Y-Z平面且垂直于X-Z平面,确定腕表用于文字输入的投影平面是X-Z投影平面。Determining a projection plane unit, configured to determine that a projection plane for text input is a YZ projection plane when the generated motion test trajectory plane is parallel to the XZ plane and perpendicular to the YZ plane, and when the generated motion test trajectory plane is parallel to YZ Plane and perpendicular to the XZ plane, the projection plane that determines the wristwatch for text input is the XZ projection plane.
所述生成文字信息子模块包括:The generating the text information sub-module includes:
检测单元,配置为当确定腕表的投影平面后,实时监测戴腕表的手臂是否进入到所确定的投影平面;The detecting unit is configured to monitor, in real time, whether the arm of the wristwatch enters the determined projection plane after determining the projection plane of the wristwatch;
生成文字信息单元,配置为当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息。Generating a text information unit configured to generate text information by recording a motion trajectory of the arm when detecting that the arm wearing the wristwatch enters the determined projection plane.
这里,生成文字信息单元,具体用于:当检测到戴腕表的手臂进入到所确定的投影平面时,启动计时器并开始记录所述手臂的运动轨迹;Here, the text information unit is generated, specifically for: when detecting that the arm wearing the wristwatch enters the determined projection plane, starting a timer and starting to record the motion track of the arm;
当所述计时器计时到设定时间时,结束记录所述手臂的运动轨迹;When the timer counts to the set time, the recording of the movement trajectory of the arm is ended;
通过将所记录的手臂运动轨迹与预置的文字数据库进行匹配,判断是 否生成文字信息;By matching the recorded arm movement trajectory with the preset text database, it is judged to be Whether to generate text information;
当所记录的手臂运动轨迹与所述文字数据库中的一个文字匹配时,则生成文字信息。Text information is generated when the recorded arm motion trajectory matches a text in the text database.
实际应用时,该装置还可以包括:建立通信链路模块,配置为与所述移动终端进行配对处理,与所述移动终端建立通信链路。In practical applications, the apparatus may further include: establishing a communication link module, configured to perform pairing processing with the mobile terminal, and establish a communication link with the mobile terminal.
实际应用时,建立通信链路模块201可由移动终端的输入装置中的通信芯片实现;发送文字输入请求模块202、接收及显示文字信息模块203、确定投影平面子模块可由移动终端的输入装置中的中央处理器(CPU,Central Processing Unit)、微处理器(MCU,Micro Control Unit)、数字信号处理器(DSP,Digital Signal Processor)或可编程逻辑阵列(FPGA,Field-Programmable Gate Array)结合通信芯片实现;生成运动测试轨迹平面单元、确定投影平面单元、生成文字信息子模块、检测单元、以及生成文字信息单元可由移动终端的输入装置中的CPU、MCU、DSP或FPGA实现。In practical application, establishing the communication link module 201 can be implemented by a communication chip in the input device of the mobile terminal; sending a text input request module 202, receiving and displaying the text information module 203, and determining that the projection plane sub-module can be input by the input device of the mobile terminal Central Processing Unit (CPU), Micro Control Unit (MCU), Digital Signal Processor (DSP), or Field-Programmable Gate Array (FPGA) combined with communication chip The method of generating a motion test trajectory plane unit, determining a projection plane unit, generating a text information sub-module, detecting a unit, and generating a text information unit may be implemented by a CPU, an MCU, a DSP, or an FPGA in an input device of the mobile terminal.
图3显示了本发明实施例提供的手机侧实现输入的方法流程图,如图3所示,包括以下步骤:FIG. 3 is a flowchart of a method for implementing input on a mobile phone side according to an embodiment of the present invention. As shown in FIG. 3, the method includes the following steps:
步骤S301,启动蓝牙匹配模块;Step S301, starting a Bluetooth matching module;
这里,为手机启动蓝牙匹配模块的目的是,与腕表匹配,匹配成功后与腕表形成一一对应关系,为后续输入的建立做好准备。Here, the purpose of starting the Bluetooth matching module for the mobile phone is to match the wristwatch, and after the matching is successful, form a one-to-one correspondence with the wristwatch, and prepare for the establishment of the subsequent input.
步骤S302,匹配腕表成功?Step S302, is the matching watch successful?
这里,本步骤主要判断手机与腕表蓝牙配对是否成功,如果判断匹配腕表成功,则进入步骤S303,若判断匹配腕表失败,则系统提示用户重新测试进入步骤S302。Here, this step mainly determines whether the Bluetooth pairing of the mobile phone and the watch is successful. If it is determined that the matching watch is successful, the process proceeds to step S303. If it is determined that the matching watch fails, the system prompts the user to re-test to proceed to step S302.
步骤S303,进入待输入界面;Step S303, entering an interface to be input;
这里,待步骤S302匹配成功后,手机可以进入需要输入文字的界面进行输入准备。 Here, after the step S302 is successfully matched, the mobile phone can enter an interface that needs to input text to prepare for input.
步骤S304,发送输入请求给腕表;Step S304, sending an input request to the wristwatch;
这里,待步骤S303后手机已经准备好接收输入,此时手机通过蓝牙发送输入请求信号给腕表,命令腕表开始输入。Here, after the step S303, the mobile phone is ready to receive input, and the mobile phone sends an input request signal to the wristwatch via Bluetooth, and commands the wristwatch to start inputting.
步骤S305,接收腕表输入并显示;Step S305, receiving a watch input and displaying;
这里,当腕表接收到步骤S304的请求后,进行运动并产生文字,通过蓝牙传送给手机,手机接收到文字,显示到步骤S303所描述的待输入界面。Here, when the wristwatch receives the request of step S304, it performs motion and generates text, which is transmitted to the mobile phone through Bluetooth, and the mobile phone receives the text and displays to the interface to be input described in step S303.
步骤S306,结束输入?Step S306, end the input?
这里,如果手机端用户已经确认输入完毕,则进入步骤S307,如果手机端用户确认未输入完毕,则重复步骤S305。Here, if the mobile terminal user has confirmed that the input is completed, the process proceeds to step S307, and if the mobile terminal user confirms that the input has not been completed, step S305 is repeated.
步骤S307,发送结束信号给腕表。In step S307, an end signal is sent to the wristwatch.
这里,通过发送停止输入的信号命令给腕表,结束腕表的输入,最终,完成整个输入过程,并解除蓝牙匹配,关闭输入系统。Here, by inputting a signal command to stop input to the watch, the input of the watch is ended, and finally, the entire input process is completed, the Bluetooth matching is released, and the input system is turned off.
图5显示了本发明实施例提供的腕表侧实现输入的方法流程图,如图5所示,包括以下步骤:FIG. 5 is a flowchart of a method for implementing input on a wristwatch side according to an embodiment of the present invention. As shown in FIG. 5, the method includes the following steps:
步骤S501,启动蓝牙匹配模块;Step S501, starting a Bluetooth matching module;
这里,主要是用户启动腕表的蓝牙匹配模块,与用户的智能手机进行配对。Here, the user mainly activates the Bluetooth matching module of the watch to pair with the user's smartphone.
步骤S502,匹配手机成功?Step S502, is the matching mobile phone successful?
这里,判断是否配对成功,如果配对成功进入步骤S503,如果配对失败则系统提示用户重新测试进入步骤S502。Here, it is judged whether the pairing is successful, and if the pairing successfully proceeds to step S503, if the pairing fails, the system prompts the user to re-test to proceed to step S502.
步骤S503,收到开始输入信号?Step S503, receiving a start input signal?
这里,本步骤主要是腕表端等待手机侧的开始输入信号,并判断是否收到开始输入信号,如果收到腕表接收到手机的输入请求信号,则进入步骤S504,如果未收到腕表接收到手机的输入请求信号,则系统提示用户重新测试进入步骤S503。 Here, the step is mainly that the watch end waits for the start input signal of the mobile phone side, and determines whether the start input signal is received. If the watch receives the input request signal of the mobile phone, the process proceeds to step S504, if the watch is not received. Upon receiving the input request signal of the mobile phone, the system prompts the user to re-test to proceed to step S503.
步骤S504,启动投影平面检测模块;Step S504, starting a projection plane detecting module;
这里,本步骤主要是启动投影平面检测模块,此模块主要通过用户投影平面检测动作,来确定用户要输入的投影面。因为腕表处于一个三维空间中,如果不确定投影平面我们很难记录用户有效的输入运动轨迹。所以本发明实施例要求用户在输入前先确定一个投影平面作为后续输入的采样标准平面。具体确定方法包括但不限于如下方法,首先用户带腕表的手臂弯曲,此时通过重力传感器记录一个位置,然后用户手臂伸直,再记录一个位置,如此反复三次。此时投影检测模块根据用户动作,确定一个投影平面,如果用户的动作轨迹与Y-Z平面平行,与X-Z平面垂直,则投影平面为X-Z平面;同理,如果用户的动作与X-Z平面平行,与Y-Z平面垂直,则投影平面为Y-Z平面。用户运动轨迹与X-Z、Y-Z平面的关系,可以通过重力加速度传感器记录的运动过程的X\Y\Z分量值,并通过计算获得。如运动过程X分量接近为0(不超过0.5米每平方秒),Y分量在测量时间内有稳定的正反向输出(如先正向3米每平方秒再负向3米每平方秒),而Z分量接近9.8每平方秒(如9.5-10.1米每平方秒之间)。则此运动过程判定为用户运动与X-Z面垂直,与Y-Z轴面平行,投影平面为X-Z平面。Here, this step mainly starts the projection plane detecting module, and the module mainly determines the projection surface to be input by the user through the user projection plane detecting action. Because the watch is in a three-dimensional space, it is difficult to record the user's effective input motion trajectory if the projection plane is uncertain. Therefore, the embodiment of the present invention requires the user to determine a projection plane as a sampling standard plane for subsequent input before inputting. The specific determination method includes, but is not limited to, the following method. First, the user's arm with the wristwatch is bent. At this time, a position is recorded by the gravity sensor, and then the user's arm is straightened, and then a position is recorded, and this is repeated three times. At this time, the projection detection module determines a projection plane according to the user action. If the motion trajectory of the user is parallel to the YZ plane and is perpendicular to the XZ plane, the projection plane is the XZ plane; similarly, if the user's motion is parallel to the XZ plane, and YZ The plane is vertical and the projection plane is the YZ plane. The relationship between the user's motion trajectory and the X-Z and Y-Z planes can be obtained by the X\Y\Z component value of the motion process recorded by the gravity acceleration sensor. If the X component of the motion process is close to 0 (not more than 0.5 meters per square second), the Y component has a stable forward and reverse output during the measurement time (such as 3 meters per square second and 3 meters per square second) And the Z component is close to 9.8 per square second (such as between 9.5-10.1 meters per square second). Then, the motion process determines that the user motion is perpendicular to the X-Z plane, parallel to the Y-Z axis plane, and the projection plane is the X-Z plane.
步骤S505,投影平面确定?Step S505, the projection plane is determined?
这里,本步骤判断投影平面是否确定,如果投影平面测试成功,则说明投影平面确定,系统记录投影平面并进入步骤S506,如果投影平面没有确定成功,则系统提示用户重新测试进入步骤S505。Here, the step determines whether the projection plane is determined. If the projection plane test is successful, the projection plane is determined, the system records the projection plane and proceeds to step S506. If the projection plane is not determined to be successful, the system prompts the user to re-test to proceed to step S505.
步骤S506,启动运动轨迹检测模块;Step S506, starting a motion track detection module;
这里,本步骤主要检测用户带腕表的手臂动作,当用户腕表第一次进入投影平面区域(以S505确定的投影平面位置正负5厘米为记录轨迹区域),记录轨迹起始点。当用户腕表运动退出投影平面区域超时(如超过3秒),或从起始点开始计时总记录时间超时(如每个字输入最长时间为10 秒),则计为结束一次输入。Here, this step mainly detects the arm movement of the user with the wristwatch. When the user's wristwatch enters the projection plane area for the first time (the projection plane position determined by S505 is plus or minus 5 cm as the recording track area), the track starting point is recorded. Timeout (such as more than 3 seconds) when the user's watch movement exits the projection plane area, or the total recording time expires from the starting point (for example, the maximum time for each word input is 10) Seconds, it is counted as ending one input.
步骤S507,运动轨迹检测模块记录运动轨迹;Step S507, the motion track detecting module records the motion track;
这里,本步骤主要是通过腕表自身的重力加速度传感器,对腕表的运动轨迹进行记录。重力加速度传感器本身可以在自身所属设备运动时,输出X、Y、Z三个方向的加速度值。如X方向返回值为1,说明设备正以1米每平方秒的加速度在X轴正方向运动,根据加速度、时间、速度、位移的关系,可以计算出运动方向和运动位移,即运动轨迹。同理Y轴运动同X类似。另外Z方向,当设备Z方向静止时,Z向返回值为9.8米每平方秒,即一个重力加速度,如果Z正方向运动,则返回值大于9.8米每平方秒,如果Z轴负方向运动则,返回值小于9.8米每平方秒。据此原理,可以绘制出设备在X、Y、Z三维空间中的运动轨迹。根据以上重力加速度原理,本发明实施例记录运动轨迹的规则为,腕表第一次进入投影区域记录起始点,之后腕表在投影区域中的运动轨迹通过重力加速度传感器,以单位时间采样(如每500毫秒采样一次并绘制轨迹)并记录轨迹,轨迹只绘制与投影平面平行部分,垂直部分不记录,垂直部分运动仅为计算其运动是否在投影区域内(以S505确定的投影平面位置正负5厘米为记录轨迹区域)使用。具体如下图4所示,投影平面为X-Z平面,Y方面运动用于确定运动是否进入投影区域,如果进入则开始记录X-Z平面的投影轨迹,图4假设用户想输入数字0,则每500毫秒为一个周期采样重力加速度值绘制一段轨迹,整个0的轨迹由10个采样周期完成,如图4所示轨迹为10段。则最终记录的0的输入运动轨迹即如图4所示样子。以此周期采样记录方法可以记录任何投影在X-Z平面的轨迹内容。Here, this step mainly records the movement track of the watch through the gravity acceleration sensor of the watch itself. The gravity acceleration sensor itself can output acceleration values in three directions of X, Y, and Z when the device to which it belongs is moving. If the return value of the X direction is 1, it indicates that the device is moving in the positive direction of the X axis with an acceleration of 1 m per square second. According to the relationship of acceleration, time, speed and displacement, the motion direction and the motion displacement, that is, the motion trajectory can be calculated. Similarly, the Y-axis motion is similar to X. In the Z direction, when the device Z is stationary, the Z-direction return value is 9.8 meters per square second, which is a gravitational acceleration. If Z moves in the positive direction, the return value is greater than 9.8 meters per square second. If the Z-axis moves in the negative direction, , the return value is less than 9.8 meters per square second. According to this principle, the motion trajectory of the device in the X, Y, Z three-dimensional space can be drawn. According to the above principle of gravity acceleration, the rule for recording the motion trajectory in the embodiment of the present invention is that the wristwatch enters the projection area for the first time to record the starting point, and then the motion track of the wristwatch in the projection area is sampled by the gravity acceleration sensor in unit time (for example, Sampling every 500 milliseconds and drawing the trajectory) and recording the trajectory, the trajectory only draws the parallel part of the projection plane, the vertical part is not recorded, and the vertical part movement only calculates whether the motion is in the projection area (the projection plane position determined by S505 is positive or negative) 5 cm is used for recording track area). Specifically, as shown in FIG. 4, the projection plane is an XZ plane, and the Y-direction motion is used to determine whether the motion enters the projection area. If it enters, the projection trajectory of the XZ plane is recorded. Figure 4 assumes that the user wants to input the number 0, then every 500 milliseconds. A period of sampling gravity acceleration value draws a trajectory, and the entire 0 trajectory is completed by 10 sampling periods, as shown in Fig. 4, the trajectory is 10 segments. Then, the input motion track of the final recorded 0 is as shown in FIG. This cycle sampling method can record any track content projected on the X-Z plane.
步骤S508,运动输入是否结束?In step S508, is the motion input ended?
这里,根据步骤S506描述的判断条件确定运动输入是否结束,如果确定运动输入结束,则将记录模块记录的运动轨迹传送给步骤S509的文字识 别模块处理,如果确定运动输入未结束,则系统提示用户重新测试进入步骤S508。Here, it is determined whether the motion input ends according to the determination condition described in step S506, and if it is determined that the motion input ends, the motion track recorded by the recording module is transmitted to the text recognition of step S509. The module processing, if it is determined that the motion input is not finished, the system prompts the user to re-test into step S508.
步骤S509,文字识别模块判定输入的文字;Step S509, the text recognition module determines the input text;
这里,文字识别模块接收步骤S508传来的运动轨迹,将运动轨迹输入文字数据库进行对比查询,如果轨迹与某一个文字匹配则输出此文字进入到步骤S5010。Here, the character recognition module receives the motion track transmitted in step S508, inputs the motion track into the character database for comparison query, and if the track matches a certain character, outputs the text to step S5010.
步骤S5010,将文字传输到手机;Step S5010, transmitting the text to the mobile phone;
这里,将步骤S509输出的文字直接通过步骤S501匹配的蓝牙传输给用户的手机,并通过手机把文字显示在输出界面。Here, the text outputted in step S509 is directly transmitted to the user's mobile phone through the Bluetooth matched in step S501, and the text is displayed on the output interface through the mobile phone.
步骤S5011,判定是否结束输入?In step S5011, it is determined whether the input is ended.
具体地,检测手机是否发送了终止输入信号给腕表,如果有终止信号,则进入步骤S5012,否则重复步骤S506到步骤S5011步骤,继续输入文字给手机。Specifically, it is detected whether the mobile phone sends a termination input signal to the wristwatch. If there is a termination signal, the process goes to step S5012, otherwise steps S506 to S5011 are repeated, and the input of the text to the mobile phone is continued.
步骤S5012,结束输入,断开蓝牙,关闭系统。In step S5012, the input is ended, the Bluetooth is turned off, and the system is turned off.
下面以腕表和手机举例,说明本发明实施例的发明内容:The following describes the invention of the embodiment of the present invention by way of a wristwatch and a mobile phone:
所述腕表包括:蓝牙匹配模块、输入投影平面检测模块、腕表运动轨迹检测模块、以及文字识别模块,所述手机包括:蓝牙匹配模块、手机端文字输入模块。腕表中的蓝牙匹配模块以及手机中的蓝牙匹配模块,配置为用户的智能腕表及手机进行配对;所述输入投影平面检测模块配置为通过检测用户手臂的运动测试轨迹,对用户输入的投影平面进行确定;所述腕表运动轨迹检测模块配置为当确定输入投影平面后,对戴腕表的手臂运动轨迹进行检测;所述文字识别模块配置为对运动轨迹进行识别,判断输入的是什么文字;所述手机端文字输入模块配置为通过接收腕表侧发送的文字信息进行文字输入并显示。The wristwatch includes: a Bluetooth matching module, an input projection plane detecting module, a wristwatch motion track detecting module, and a text recognition module, and the mobile phone includes: a Bluetooth matching module and a mobile phone text input module. The Bluetooth matching module in the wristwatch and the Bluetooth matching module in the mobile phone are configured to be paired with the user's smart wristwatch and the mobile phone; the input projection plane detecting module is configured to detect the motion of the user's arm and the projection of the user input The plane motion determination module is configured to detect an arm motion track of the wrist watch after determining the input projection plane; the text recognition module is configured to identify the motion track and determine what is input Text; the mobile phone text input module is configured to input and display text by receiving text information sent by the wristwatch side.
具体实施包括以下步骤: The specific implementation includes the following steps:
步骤1、启动用户的智能腕表及手机的蓝牙匹配模块进行配对;Step 1. Start the pairing of the user's smart watch and the Bluetooth matching module of the mobile phone;
步骤2、配对成功后智能手机进入待输入界面,手机发送开始输入信号给腕表,并准备接收输入;Step 2: After the pairing is successful, the smart phone enters the interface to be input, and the mobile phone sends a start input signal to the watch and prepares to receive the input;
步骤3、腕表接收到开始输入的信号后,先由输入投影检测模块,对用户输入的投影平面进行确定;Step 3: After receiving the signal input at the beginning, the watch first inputs the projection detection module to determine the projection plane input by the user;
步骤4、确定输入投影平面以后,开始运动带腕表的手臂,完成文字轨迹输入;Step 4: After determining the input projection plane, start moving the arm with the wristwatch to complete the text track input;
步骤5、腕表的文字识别模块对运动轨迹进行识别,判断输入的是什么文字;Step 5: The character recognition module of the watch recognizes the motion track and determines what text is input;
步骤6、将输入的文字通过蓝牙传送给手机端,并实现手机上文字输入。Step 6. Transfer the input text to the mobile phone through Bluetooth, and implement text input on the mobile phone.
综上所述,本发明实施例具有以下技术效果:In summary, the embodiments of the present invention have the following technical effects:
本发明实施例通过智能腕表与移动终端的交互功能,是腕表和移动终端搭配实现了更好的用户体验。The interaction function between the smart watch and the mobile terminal in the embodiment of the invention is that the watch and the mobile terminal are combined to achieve a better user experience.
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功 能的装置。The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. The work specified in one or more blocks of a flow or a flow and/or a block diagram of a flowchart Able device.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
基于此,本发明实施例还提供了一种所述计算机存储介质包括一组指令,当执行所述指令时,引起至少一个处理器执行上述的移动终端的输入方法。Based on this, an embodiment of the present invention further provides that the computer storage medium includes a set of instructions that, when executed, cause at least one processor to execute the input method of the mobile terminal.
尽管上文对本发明进行了详细说明,但是本发明不限于此,本技术领域技术人员可以根据本发明的原理进行各种修改。因此,凡按照本发明原理所作的修改,都应当理解为落入本发明的保护范围。 Although the invention has been described in detail above, the invention is not limited thereto, and various modifications may be made by those skilled in the art in accordance with the principles of the invention. Therefore, modifications made in accordance with the principles of the invention are to be understood as falling within the scope of the invention.

Claims (14)

  1. 一种移动终端的输入方法,所述方法包括:A method for inputting a mobile terminal, the method comprising:
    移动终端通过与腕表建立的通信链路,向所述腕表发送文字输入请求,指令所述腕表开始进行文字输入;所述腕表为戴在手腕上的腕表;The mobile terminal sends a text input request to the wristwatch through a communication link established with the wristwatch, instructing the wristwatch to start text input; the wristwatch is a wristwatch worn on the wrist;
    移动终端通过所述通信链路,接收所述腕表通过手臂运动生成的文字信息,并将其显示在移动终端待输入界面上。The mobile terminal receives the text information generated by the wristwatch through the arm movement through the communication link, and displays the text information on the mobile terminal to be input interface.
  2. 根据权利要求1所述的方法,其中,所述方法还包括:The method of claim 1 wherein the method further comprises:
    所述移动终端与所述腕表进行配对处理,与所述腕表建立通信链路。The mobile terminal performs pairing processing with the wristwatch to establish a communication link with the wristwatch.
  3. 一种移动终端的输入方法,所述方法包括:A method for inputting a mobile terminal, the method comprising:
    腕表通过与移动终端建立的通信链路,接收到所述移动终端发送的文字输入请求后,通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面;所述腕表为戴在手腕上的腕表;After receiving the text input request sent by the mobile terminal through the communication link established with the mobile terminal, the wristwatch detects the motion test track of the arm bending and the arm straightening, and determines the projection plane of the wristwatch for text input. The watch is a wristwatch worn on the wrist;
    当所述腕表检测到戴腕表的手臂进入到所确定的投影平面时,通过手臂运动生成文字信息;When the wristwatch detects that the arm of the wristwatch enters the determined projection plane, generating text information by arm movement;
    所述腕表通过所述通信链路,将所生成的文字信息通过所述通信链路,发送到所述移动终端,以使所述移动终端进行显示。The wristwatch transmits the generated text information to the mobile terminal through the communication link through the communication link, so that the mobile terminal performs display.
  4. 根据权利要求3所述的方法,其中,所述投影平面包括X-Z投影平面和Y-Z投影;所述通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面包括:The method of claim 3, wherein the projection plane comprises an XZ projection plane and a YZ projection; and the motion test trajectory for arm bending and arm extension is detected to determine a projection plane of the wristwatch for text input include:
    通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,生成手臂运动的运动测试轨迹平面;The motion test trajectory of the arm movement is generated by detecting the motion test trajectory of the arm bending and the arm extension;
    当所生成的运动测试轨迹平面平行于X-Z平面且垂直于Y-Z平面,确定腕表用于文字输入的投影平面是Y-Z投影平面;When the generated motion test trajectory plane is parallel to the X-Z plane and perpendicular to the Y-Z plane, it is determined that the projection plane of the wristwatch for text input is a Y-Z projection plane;
    当所生成的运动测试轨迹平面平行于Y-Z平面且垂直于X-Z平面,确定腕表用于文字输入的投影平面是X-Z投影平面。 When the generated motion test trajectory plane is parallel to the Y-Z plane and perpendicular to the X-Z plane, it is determined that the projection plane for the text input of the wristwatch is the X-Z projection plane.
  5. 根据权利要求3所述的方法,其中,所述当所述腕表检测到戴腕表的手臂进入到所确定的投影平面时,通过手臂运动生成文字信息包括:The method according to claim 3, wherein said generating said text information by arm movement when said wristwatch detects that an arm of a wristwatch enters said determined projection plane comprises:
    当所述腕表确定腕表的投影平面后,实时监测戴腕表的手臂是否进入到所确定的投影平面;After the watch determines the projection plane of the watch, it is monitored in real time whether the arm of the wristwatch enters the determined projection plane;
    当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息。When it is detected that the arm wearing the wristwatch enters the determined projection plane, the text information is generated by recording the motion trajectory of the arm.
  6. 根据权利要求5所述的方法,其中,所述当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息包括:The method according to claim 5, wherein when the arm of the wristwatch is detected to enter the determined projection plane, generating the text information by recording the motion trajectory of the arm comprises:
    当检测到戴腕表的手臂进入到所确定的投影平面时,启动计时器并开始记录所述手臂的运动轨迹;When it is detected that the arm wearing the watch enters the determined projection plane, the timer is started and the movement track of the arm is started to be recorded;
    当所述计时器计时到设定时间时,结束记录所述手臂的运动轨迹;When the timer counts to the set time, the recording of the movement trajectory of the arm is ended;
    通过将所记录的手臂运动轨迹与预置的文字数据库进行匹配,判断是否生成文字信息;Whether to generate text information by matching the recorded arm movement trajectory with a preset text database;
    当所记录的手臂运动轨迹与所述文字数据库中的一个文字匹配时,则生成文字信息。Text information is generated when the recorded arm motion trajectory matches a text in the text database.
  7. 根据权利要求3所述的方法,其中,所述方法还包括:The method of claim 3, wherein the method further comprises:
    所述腕表与所述移动终端进行配对处理,与所述移动终端建立通信链路。The wristwatch performs pairing processing with the mobile terminal to establish a communication link with the mobile terminal.
  8. 一种移动终端的输入装置,所述装置包括:An input device for a mobile terminal, the device comprising:
    发送文字输入请求模块,配置为通过与腕表建立的通信链路,向所述腕表发送文字输入请求,指令所述腕表开始进行文字输入;所述腕表为戴在手腕上的腕表;Sending a text input requesting module, configured to send a text input request to the wristwatch through a communication link established with the wristwatch, instructing the wristwatch to start text input; the wristwatch is a wristwatch worn on the wrist ;
    接收及显示文字信息模块,配置通过所述通信链路,接收所述腕表通过手臂运动生成的文字信息,并将其显示在移动终端待输入界面上。 Receiving and displaying a text information module, configured to receive text information generated by the wristwatch by arm movement through the communication link, and display the text information on the mobile terminal to be input interface.
  9. 根据权利要求8所述的装置,其中,所述装置还包括:The apparatus of claim 8 wherein said apparatus further comprises:
    建立通信链路模块,配置为通过与所述腕表进行配对处理,与所述腕表建立通信链路。Establishing a communication link module configured to establish a communication link with the wristwatch by performing pairing processing with the wristwatch.
  10. 一种移动终端的输入装置,所述装置包括:An input device for a mobile terminal, the device comprising:
    确定投影平面子模块,配置为通过与移动终端建立的通信链路,接收到所述移动终端发送的文字输入请求后,通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,确定腕表用于文字输入的投影平面;所述腕表为戴在手腕上的腕表;Determining a projection plane sub-module, configured to, after receiving a text input request sent by the mobile terminal by using a communication link established with the mobile terminal, detecting the motion test track of the arm bending and the arm extension, and determining the wristwatch a projection plane for text input; the watch is a wristwatch worn on the wrist;
    生成文字信息子模块,当检测到戴腕表的手臂进入到所确定的投影平面时,通过手臂运动生成文字信息;并将所生成的文字信息通过所述通信链路,发送到所述移动终端,以使所述移动终端进行显示。Generating a text information sub-module, and when detecting that the arm wearing the wristwatch enters the determined projection plane, generating text information by arm movement; and transmitting the generated text information to the mobile terminal through the communication link So that the mobile terminal performs display.
  11. 根据权利要求10所述的装置,其中,所述投影平面包括X-Z投影平面和Y-Z投影;所述确定投影平面子模块包括:The apparatus of claim 10 wherein said projection plane comprises an X-Z projection plane and a Y-Z projection; said determining projection plane sub-module comprising:
    生成运动测试轨迹平面单元,配置为通过对手臂弯曲和手臂伸直的运动测试轨迹进行检测,生成手臂运动的运动测试轨迹平面;Generating a motion test trajectory plane unit configured to detect a motion test trajectory of the arm motion by detecting a motion test trajectory of the arm bending and the arm extension;
    确定投影平面单元,配置为当所生成的运动测试轨迹平面平行于X-Z平面且垂直于Y-Z平面,确定腕表用于文字输入的投影平面是Y-Z投影平面,以及当所生成的运动测试轨迹平面平行于Y-Z平面且垂直于X-Z平面,确定腕表用于文字输入的投影平面是X-Z投影平面。Determining a projection plane unit, configured to determine that a projection plane for text input is a YZ projection plane when the generated motion test trajectory plane is parallel to the XZ plane and perpendicular to the YZ plane, and when the generated motion test trajectory plane is parallel to YZ Plane and perpendicular to the XZ plane, the projection plane that determines the wristwatch for text input is the XZ projection plane.
  12. 根据权利要求10所述的装置,其中,所述生成文字信息子模块包括:The apparatus of claim 10, wherein the generating the text information sub-module comprises:
    检测单元,配置为当确定腕表的投影平面后,实时监测戴腕表的手臂是否进入到所确定的投影平面;The detecting unit is configured to monitor, in real time, whether the arm of the wristwatch enters the determined projection plane after determining the projection plane of the wristwatch;
    生成文字信息单元,配置为当检测到戴腕表的手臂进入到所确定的投影平面时,通过记录所述手臂的运动轨迹生成文字信息。 Generating a text information unit configured to generate text information by recording a motion trajectory of the arm when detecting that the arm wearing the wristwatch enters the determined projection plane.
  13. 根据权利要求10所述的装置,其中,所述装置还包括:建立通信链路模块,配置为与所述移动终端进行配对处理,与所述移动终端建立通信链路。The apparatus of claim 10, wherein the apparatus further comprises: establishing a communication link module configured to perform pairing processing with the mobile terminal to establish a communication link with the mobile terminal.
  14. 一种计算机存储介质,所述计算机存储介质包括一组指令,当执行所述指令时,引起至少一个处理器执行如权利要求1或2所述的移动终端的输入方法,或者执行如权利要求3至7任一项所述的移动终端的输入方法。 A computer storage medium comprising a set of instructions that, when executed, cause at least one processor to perform an input method of the mobile terminal of claim 1 or 2, or perform claim 3 The input method of the mobile terminal according to any one of the preceding claims.
PCT/CN2015/085150 2015-05-21 2015-07-27 Input method and apparatus for mobile terminal, and computer storage medium WO2016183932A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510261279.3 2015-05-21
CN201510261279.3A CN106293022A (en) 2015-05-21 2015-05-21 The input method of a kind of mobile terminal and device

Publications (1)

Publication Number Publication Date
WO2016183932A1 true WO2016183932A1 (en) 2016-11-24

Family

ID=57319228

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/085150 WO2016183932A1 (en) 2015-05-21 2015-07-27 Input method and apparatus for mobile terminal, and computer storage medium

Country Status (2)

Country Link
CN (1) CN106293022A (en)
WO (1) WO2016183932A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106648076A (en) * 2016-12-01 2017-05-10 杭州联络互动信息科技股份有限公司 Character input method and device for smart watches
CN111176423A (en) * 2018-11-09 2020-05-19 奇酷互联网络科技(深圳)有限公司 Intelligent wearable device combination, input method thereof and computer-readable storage medium
CN111679745A (en) * 2019-03-11 2020-09-18 深圳市冠旭电子股份有限公司 Sound box control method, device, equipment, wearable equipment and readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100023314A1 (en) * 2006-08-13 2010-01-28 Jose Hernandez-Rebollar ASL Glove with 3-Axis Accelerometers
US20110310013A1 (en) * 2010-06-17 2011-12-22 Electronics And Telecommunications Research Institute Interface apparatus and method for contact-free space input/output
CN104462162A (en) * 2013-11-25 2015-03-25 安徽寰智信息科技股份有限公司 Novel sign language recognition and collection method and device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202584010U (en) * 2012-04-06 2012-12-05 寇传阳 Wrist-mounting gesture control system
CN102915111B (en) * 2012-04-06 2017-05-31 寇传阳 A kind of wrist gesture control system and method
KR102034587B1 (en) * 2013-08-29 2019-10-21 엘지전자 주식회사 Mobile terminal and controlling method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100023314A1 (en) * 2006-08-13 2010-01-28 Jose Hernandez-Rebollar ASL Glove with 3-Axis Accelerometers
US20110310013A1 (en) * 2010-06-17 2011-12-22 Electronics And Telecommunications Research Institute Interface apparatus and method for contact-free space input/output
CN104462162A (en) * 2013-11-25 2015-03-25 安徽寰智信息科技股份有限公司 Novel sign language recognition and collection method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106648076A (en) * 2016-12-01 2017-05-10 杭州联络互动信息科技股份有限公司 Character input method and device for smart watches
CN111176423A (en) * 2018-11-09 2020-05-19 奇酷互联网络科技(深圳)有限公司 Intelligent wearable device combination, input method thereof and computer-readable storage medium
CN111679745A (en) * 2019-03-11 2020-09-18 深圳市冠旭电子股份有限公司 Sound box control method, device, equipment, wearable equipment and readable storage medium

Also Published As

Publication number Publication date
CN106293022A (en) 2017-01-04

Similar Documents

Publication Publication Date Title
RU2491610C1 (en) Method and device for inertial movement of window object
US10222868B2 (en) Wearable device and control method using gestures
US9377859B2 (en) Enhanced detection of circular engagement gesture
CN106055088B (en) The air of interactive wearable device writes and gesture system
CN107430450B (en) Apparatus and method for generating input
CN102937832B (en) A kind of gesture method for catching of mobile terminal and device
KR102347067B1 (en) Portable device for controlling external apparatus via gesture and operating method for same
EP3408831A1 (en) Local augmented reality persistent sticker objects
CN107656620B (en) Virtual object control method and device, electronic equipment and storage medium
US11058948B1 (en) Predictive modeling for multiplayer gaming
WO2016183932A1 (en) Input method and apparatus for mobile terminal, and computer storage medium
TW201327204A (en) Electronic device and Bluetooth-based data sharing method thereof
WO2019144760A1 (en) Data processing method, terminal device, and data processing system
WO2018094919A1 (en) Method and device for remotely and synchronously displaying writing
JP7267314B2 (en) Separable head-mounted display system and interaction method
WO2015131590A1 (en) Method for controlling blank screen gesture processing and terminal
WO2018219279A1 (en) Virtual touch system, method and device
CN113498502A (en) Gesture detection using external sensors
TWI724384B (en) Information processing method and device for wearable equipment
TWI717772B (en) Method, device, mobile terminal and storage medium for calling target function
US20180126561A1 (en) Generation device, control method, robot device, call system, and computer-readable recording medium
US9727778B2 (en) System and method for guided continuous body tracking for complex interaction
TW201725069A (en) Electronic device and method for controlling toy
CN103425433A (en) Intelligent human-computer interface system and control method thereof
TWI466014B (en) Method and control device for establishing connection and status relationship between at least two devices

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15892310

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15892310

Country of ref document: EP

Kind code of ref document: A1