WO2020088244A1 - 移动终端的交互控制方法和移动终端 - Google Patents

移动终端的交互控制方法和移动终端 Download PDF

Info

Publication number
WO2020088244A1
WO2020088244A1 PCT/CN2019/111275 CN2019111275W WO2020088244A1 WO 2020088244 A1 WO2020088244 A1 WO 2020088244A1 CN 2019111275 W CN2019111275 W CN 2019111275W WO 2020088244 A1 WO2020088244 A1 WO 2020088244A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile terminal
display
sensor
detected
movement distance
Prior art date
Application number
PCT/CN2019/111275
Other languages
English (en)
French (fr)
Inventor
詹云桥
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2020088244A1 publication Critical patent/WO2020088244A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03543—Mice or pucks

Definitions

  • the present invention requires the priority of a Chinese patent application filed on November 01, 2018 in the Chinese Patent Office with the application number 201811295547.3 and the invention titled "Mobile Terminal Interaction Control Method and Mobile Terminal". In the present invention.
  • the embodiments of the present invention relate to the technical field of intelligent terminals, and in particular, to an interactive control method of a mobile terminal and a mobile terminal.
  • the realization of using the touchpad to control the computer screen is mostly based on the mobile phone screen, and the entire screen of the mobile phone is used as the touchpad.
  • the touch events generated on the touch panel are converted into mouse events and forwarded and mapped to the PC screen, so that the user can operate the content in the PC screen through the mobile phone screen.
  • the key event is mapped to the PC screen through forwarding, so that the application on the PC screen responds to the key event accordingly.
  • the purpose of the embodiments of the present invention is to provide an interactive control method for a mobile terminal, a mobile sensor and a mobile terminal, so that it can conform to the user's existing usage habits, and is easier for the user to accept, breaking through the size limitation of the touch screen of the mobile terminal and making the user's The operation process is smoother and the user experience is improved.
  • an embodiment of the present invention provides a method for interactively controlling a mobile terminal, which includes the following steps: establishing a communication connection between the mobile terminal and a display; acquiring movement data of the mobile terminal; and confirming with the acquired movement data Coordinate data corresponding to motion data; forward coordinate data to the display to control the mouse pointer of the display to move accordingly according to the coordinate data.
  • Embodiments of the present invention also provide a mobile terminal, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are at least one The processor executes, so that at least one processor can execute the foregoing interactive control method of the mobile terminal.
  • FIG. 1 is a schematic diagram of an application scenario according to the first embodiment of the present invention
  • FIG. 2 is a schematic diagram of a virtual keyboard displayed on the touch screen according to the first embodiment of the present invention
  • FIG. 3 is a flowchart of a method for interactively controlling a mobile terminal according to a first embodiment of the present invention
  • FIG. 4 is a schematic diagram of modules in the mobile terminal according to the first embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a mobile terminal with a built-in mobile sensor according to a second embodiment of the present invention.
  • FIG. 6 is a flowchart of a method for interactively controlling a mobile terminal according to a second embodiment of the present invention.
  • FIG. 7 is a flowchart of a method for interactive control of a mobile terminal according to a third embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of a mobile terminal according to a fourth embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of a mobile terminal according to a fifth embodiment of the present invention.
  • FIG. 10 is a top view of a mobile sensor in a mobile terminal according to a fifth embodiment of the present invention.
  • the first embodiment of the present invention relates to a method for interactive control of a mobile terminal, which is applied to a mobile terminal, and includes: establishing a communication connection between the mobile terminal and a display; acquiring movement data of the mobile terminal; Coordinate data corresponding to the data; forward the coordinate data to the display to control the mouse pointer of the display to move accordingly according to the coordinate data, so that it can conform to the user's existing usage habits and be more easily accepted by the user, breaking the size of the touch screen of the mobile terminal.
  • the restrictions make the user's operation process smoother and improve the user's experience.
  • the implementation details of the interactive control method of the mobile terminal according to this embodiment will be specifically described below. The following content is only for implementation details provided for easy understanding, and is not necessary for implementing this solution.
  • the mobile terminal may be a smart terminal such as a smart phone or a smart bracelet
  • the display may be a display device such as a computer display or a TV display.
  • the mobile terminal in this embodiment uses a mobile phone as an example, and a display as a computer display as an example, however, it is not limited to this in practical applications.
  • the application scenario of this embodiment may be as shown in FIG. 1, by controlling the movement of the mobile phone, the user may move the mobile phone or tilt the mobile phone, thereby controlling the movement of the mouse pointer on the display.
  • the screen interface of the mobile phone can automatically display a virtual keyboard as shown in FIG. 2 to realize input of data that the user wants to input into the display through the mobile phone.
  • the specific flowchart of this embodiment may include the following steps as shown in FIG. 3.
  • Step 101 Establish a communication connection between the mobile terminal and the display.
  • the mobile terminal and the display can be connected via a USB cable, so that the communication state between the mobile terminal and the display is more stable, which is conducive to stable and efficient data transmission between the two parties.
  • the mobile terminal and the display can also be connected via WIFI, making the connection method more convenient and fast. It should be noted that this embodiment only uses the above two connection methods as examples, but in practical applications, any wired or wireless connection may be used for communication connection. There is no limit here.
  • various modules as shown in FIG. 4 can be set in the mobile terminal: the sensor data management module 201, used to initialize the sensor, monitor the real-time data of the sensor and transmit the data to the mouse event management module; the mouse event management module 202, Used to initialize the module, receive sensor data, analyze and calculate the position coordinates of the mouse pointer, and send mouse movement events to the main module; the keyboard event management module 203 is used to initialize the module, monitor keyboard events, and send keyboard events to the main module 202;
  • the main module 204 is used to initialize the touch screen interface, monitor mouse click events, receive mouse movements and keyboard events, and send corresponding events to the event forwarding management module; the event forwarding module 205 is used to initialize the module, receive events to be forwarded, and send The virtual device sends events for the virtual device to forward to the display, for example to the PC screen.
  • each module can be initialized first.
  • the main module 204 can be initialized as follows: layout input method interface, startup mouse event management module 202 initialization, and keyboard event management module 203 initialization And initialize the communication interface with them.
  • Initializing the mouse event management module 202 may be: initializing the sensor, initializing the communication interface with the main module, and initializing the sensor data listener.
  • Initializing the keyboard event management module 203 may be: drawing an input method interface, initializing a key value listener, and initializing a communication interface with the main module.
  • Initializing the event forwarding module 205 may be: creating a new virtual device for receiving and forwarding events, initializing a communication interface with the main module, and initializing a communication interface with the virtual device. Initializing each module makes the mobile terminal more suitable as a tool to control the PC screen.
  • Step 102 Obtain the movement data of the mobile terminal.
  • the user can hold the mobile terminal to control the mobile terminal to be in a moving state, for example, to move the mobile terminal or rotate the mobile terminal.
  • a sensor may be built in the mobile terminal, and the built-in sensor may be used to detect the current motion state, so as to obtain corresponding motion data.
  • Step 103 According to the acquired motion data, confirm the coordinate data corresponding to the motion data.
  • different motion data may correspond to different position coordinates of the mouse pointer in the display.
  • the correspondence relationship between the movement data and the position coordinates may be pre-stored in the mobile terminal. After the movement data is acquired, the position coordinates of the mouse pointer corresponding to the current movement data may be confirmed according to the stored correspondence relationship. Through the movement data, the mouse movement event is generated by simulation, which improves the input efficiency of the mouse event, and is helpful for quickly confirming the current position coordinates of the mouse pointer.
  • Step 104 Forward the coordinate data to the display to control the mouse pointer of the display to move accordingly according to the coordinate data.
  • the mobile terminal can send the position coordinates to the display through a USB cable or WIFI connection.
  • the display controls the mouse pointer to move to the position coordinates so that the mouse pointer can follow the movement of the mobile terminal mobile.
  • the interactive control method of the mobile terminal may further include: Step 105: Control the touch screen of the mobile terminal to display a virtual keyboard.
  • the mobile terminal can directly display the virtual keyboard on the touch screen after establishing a communication connection with the display. It is also possible to control the touch screen of the mobile terminal to display a virtual keyboard when it is detected that the display requires input method intervention.
  • an application that requires input method intervention can be pre-stored in the mobile terminal, and when it is detected that an application that requires input method intervention is opened in the display, the virtual keyboard as shown in FIG. 2 is controlled on the touch screen of the mobile terminal, without requiring The input method is involved, the touch screen can be in the off state, which is more conducive to energy saving.
  • the area occupied by the virtual keyboard on the touch screen is greater than or equal to a preset threshold.
  • the preset threshold can be set by the user according to actual needs. For example, the user wants to implement both keyboard events and mouse click events on the touch screen.
  • the size of the virtual keyboard on the touch screen directly affects the user's use effect.
  • the area occupied by the virtual keyboard on the touch screen can be set as large as possible, for example, the preset threshold is set to 2/3 or more of the area of the touch screen, so that The user can operate on the larger virtual keyboard, which is beneficial to the accuracy of user input and improves the user experience.
  • Virtual buttons can be set on the remaining small positions on the touch screen to achieve mouse click events.
  • the size of the preset threshold may be equal to the display area of the touch screen, that is to say, the virtual keyboard is displayed on the touch screen in full screen, as shown in FIG. 2.
  • the mouse click event can be realized by physical buttons on the mobile terminal.
  • the virtual keyboard can be placed on the entire touch screen interface in a large area, or even on the full screen, which expands the display range of the keyboard and avoids the possibility of erroneous input , While improving the input efficiency of keyboard events.
  • step 105 may be performed after step 101, that is, as long as the mobile terminal establishes a communication connection with the display, indicating that the mobile terminal starts to be used to control the display, step 105 may be started at this time.
  • Step 106 Detect the key value that the user clicks on the virtual keyboard, and send the detected key value to the display.
  • the display when the display receives the key value sent by the mobile terminal, the received key value is used as the input value, so that the function of keyboard input can also be realized by using the mobile terminal.
  • Step 107 When it is detected that the preset button is pressed, a mouse click instruction is sent to the display.
  • the preset key may be a virtual key.
  • the area occupied by the virtual key on the touch screen is smaller than the area occupied by the virtual keyboard on the touch screen, that is, most areas of the touch screen display the virtual keyboard, which is virtual
  • the buttons are reserved at a smaller position.
  • the area occupied by the virtual buttons on the entire touch screen is only the area of the finger. Using most of the area to display the virtual keyboard, users can choose the position of the virtual button according to their actual usage habits, such as Said set in the four corners of the touch screen.
  • the preset key is a physical key
  • the virtual keyboard is displayed on the touch screen in full screen.
  • Different physical buttons on the mobile terminal can correspond to the left and right buttons of the mouse.
  • the physical buttons make the user's experience more similar to clicking the actual mouse button, and improve the user's experience.
  • step 107 may be performed after step 101, that is, as long as the mobile terminal establishes a communication connection with the display, indicating that the mobile terminal starts to be used to control the display, then step 107 may be started.
  • the mobile terminal itself can be used as a mouse or a keyboard
  • the motion data can be obtained by controlling the movement of the mobile terminal, and then the position coordinates of the mouse pointer can be analyzed and used as the current mouse position coordinates and forwarded to the display
  • the display controls the movement of the mouse pointer according to the position coordinates, breaking through the size limitation of the touch screen of the mobile terminal, making the user's operation process smoother.
  • the physical buttons replace the left and right buttons of the mouse, which is conducive to the user's true feeling of clicking the mouse and improves the user's experience.
  • Mouse events and keyboard events are separated on the display interface of the mobile terminal, and there is no need to switch up and down between mouse events and keyboard events. The entire interaction process between the touch screen and the display conforms to the user's existing usage habits, and the improvement is conducive to improving input efficiency and office efficiency.
  • the second embodiment of the present invention relates to an interactive control method of a mobile terminal.
  • the second embodiment is a further improvement of the first embodiment.
  • the main improvement is that: in the second embodiment of the present invention, the motion data is specifically: the horizontal movement distance acquired by the movement sensor, which is beneficial to more accurately simulate the user The feeling of using the mouse in actual life improves the user experience.
  • the mobile terminal has a built-in mobile sensor.
  • the mobile sensor includes: a sensor body and a sphere.
  • the sensor body has a hollow structure.
  • the sphere is provided in the sensor body and can move on the bottom surface of the sensor body; the sphere moves to the sensor body.
  • the contact point with the bottom surface of the sensor body is the contact point to be detected.
  • FIG. 5 the top view of a mobile phone with a built-in mobile sensor is shown in Figure 5.
  • the mobile sensor is built into the mobile phone.
  • the mobile sensor can be a hollow cylindrical structure, so that it can seamlessly contact the movable ball placed inside, according to The contact point can get the direction of x movement more accurately.
  • the height of the cylinder can be the height that can hold a ball, and the bottom can be a smooth surface for the mobile ball to slide without resistance.
  • the movement sensor can obtain the contact angle of the current contact point and the pressure on the edge, that is, the pressure on the side of the cylinder, such as the side of the phone when the user moves the phone quickly or slowly to the left The pressure is different.
  • the contact angle may be: as shown in FIG. 5, in a rectangular coordinate system established using the center point of the bottom surface as the origin, the angle between the line connecting the contact point and the center point and the straight line where the horizontal axis is located.
  • the mobile phone can notify the sensor data management module of the corresponding value obtained through the Android API to calculate the position coordinates of the mouse pointer.
  • the specific flowchart of the interactive control method of the mobile terminal in this embodiment may be as shown in FIG. 6 and includes the following steps.
  • Step 301 Establish a communication connection between the mobile terminal and the display.
  • Step 301 is substantially the same as step 101 in the first embodiment, and will not be repeated here to avoid repetition.
  • Step 302 Detect the contact angle and the pressure on the side of the movement sensor through the movement sensor.
  • the mobile terminal is a mobile phone.
  • a rectangular coordinate system is established on the entire plane where the mobile phone screen is located.
  • the left and right directions are used as the X axis, and the up and down are used as the Y axis. , Otherwise it is positive.
  • X is a negative value, otherwise it is a positive value.
  • the contact point between the moving ball and the mobile sensor is at 45 degrees on the plane coordinate system, that is, the detected contact angle is 45 °.
  • a pressure sensor may be provided on the side of the movement sensor. When the moving ball moves into contact with the side, the pressure on the side may be detected by the pressure sensor on the side.
  • the mobile sensor in the mobile phone can be started after the communication connection between the mobile phone and the display is established, and start working. If the mobile phone is disconnected from the display, the detection data in the mobile sensor can be destroyed to avoid possible residual data.
  • the use of mobile phones in the back will have an impact, which is conducive to the effective switching between the two functions of normal communication use and control of the display of the mobile phone, and improves the user experience.
  • Step 303 Obtain the horizontal movement distance of the mobile terminal according to the contact angle.
  • the horizontal movement distance corresponding to the contact angle can be obtained according to the functional relationship. For example, when the detected contact angle is 45 °, the horizontal and vertical movement distances of the mobile phone on the horizontal plane are both 1.
  • Step 304 Calculate the coordinate data corresponding to the horizontal movement distance according to the acquired horizontal movement distance and the detected pressure.
  • the amount of pressure can be used to characterize the movement speed. When the movement speed is fast, the pressure is greater.
  • the movement coordinates can be used to obtain the position coordinates of the mouse at different movement speeds to adapt to the needs of different users.
  • a reference value can also be preset.
  • the reference value can be a reference value for starting coordinate adjustment and / or pressure adjustment; the reference value can be set by the user according to his own usage habits. If the user wants to increase sensitivity, a larger value can be set The starting coordinate reference value and the pressure adjustment reference value, and vice versa.
  • the starting coordinate reference value is (X, Y)
  • the horizontal movement distance is both horizontal and vertical 1
  • the detected pressure value is 1
  • the pressure adjustment reference value is 10%
  • the position coordinates of the mouse pointer in the acquired display are (X + 1 + 1 * 10%, Y + 1 + 1 * 10%).
  • Step 305 Forward the coordinate data to the display to control the mouse pointer of the display to move accordingly according to the coordinate data.
  • Step 306 Control the touch screen of the mobile terminal to display a virtual keyboard.
  • Step 307 Detect the key value that the user clicks on the virtual keyboard, and send the detected key value to the display.
  • Step 308 When detecting that the preset button is pressed, send a mouse click instruction to the display.
  • Steps 305 to 308 are substantially the same as steps 104 to 107 in the first embodiment, and will not be repeated here to avoid repetition.
  • this embodiment has a built-in mobile sensor in the mobile terminal.
  • the mobile sensor detects the movement of the mobile terminal in the horizontal plane to simulate the effect of the physical mouse device movement, which is more in line with the user's usage habits. Due to the portability and wide use of mobile terminals, using the mobile terminal to control the display further facilitates the user's use. Moreover, when the user moves the mobile terminal horizontally, the user gets a closer feeling to move the physical mouse device, which is beneficial to further improve the user's experience.
  • the third embodiment of the present invention relates to an interactive control method of a mobile terminal.
  • This embodiment is substantially the same as the second embodiment, except that the detected motion data is different.
  • the motion data is: by moving The horizontal movement distance acquired by the sensor.
  • the movement data is: the tilt movement distance acquired by the orientation sensor.
  • This embodiment provides another way of acquiring movement data, which makes the implementation of acquiring movement data flexible and diverse.
  • the specific flowchart of the interactive control method of the mobile terminal in this embodiment may be as shown in FIG. 7 and includes the following steps.
  • Step 401 Establish a communication connection between the mobile terminal and the display.
  • Step 401 is substantially the same as step 301, and will not be repeated here to avoid repetition.
  • Step 402 Detect the three-dimensional coordinates of the mobile terminal through the direction sensor.
  • the direction sensor in this embodiment may be a direction sensor built into most existing mobile phones.
  • the implementation of the existing direction sensor relies on the accelerometer built into the mobile phone.
  • It is generally a three-axis accelerometer, which is divided into X-axis, Y-axis and Z-axis.
  • the three-axis accelerometer means that it can detect motion in three-dimensional space.
  • the three-dimensional space formed by the three axes can be used to detect the three-dimensional coordinates of the location of the mobile phone, that is, the 3D coordinates of the X, Y, and Z axes.
  • the user can place the mobile phone parallel to the horizontal plane and tilt the phone horizontally with the screen facing upwards.
  • the Y-axis coordinate value of the direction sensor generally does not change, only the X- and Z-axis coordinate values change. It should be noted that this embodiment only takes the mobile phone tilted horizontally as an example, and is not limited to this in practical applications.
  • Step 403 Obtain the tilt movement distance of the mobile terminal according to the three-dimensional coordinates.
  • the value of a certain coordinate axis in the obtained three-dimensional coordinate is 0, it means that there is no tilt in this coordinate axis direction.
  • the coordinate values of X and Z axes are obtained, X
  • the coordinate values of and Z axis can be regarded as the tilt movement distance on the X and Z axis, respectively.
  • Step 404 According to the acquired tilt movement distance, confirm the coordinate data corresponding to the tilt movement distance.
  • the obtained tilt movement distances on the X and Z axes can be mapped to X and Y axis coordinate values according to a preset mapping relationship.
  • X is a positive value.
  • X is a negative value.
  • Y is positive, and conversely, when the user tilts the phone downward toward the upper edge of the screen, Y is negative.
  • the obtained X and Y axis coordinate values are the obtained position coordinates of the mouse pointer in the display.
  • Step 405 Forward the coordinate data to the display to control the mouse pointer of the display to move accordingly according to the coordinate data.
  • Step 406 Control the touch screen of the mobile terminal to display a virtual keyboard.
  • Step 407 Detect the key value that the user clicks on the virtual keyboard, and send the detected key value to the display.
  • Step 408 When detecting that the preset button is pressed, send a mouse click instruction to the display.
  • Steps 405 to 408 are substantially the same as steps 305 to 308 in the second embodiment, and will not be repeated here to avoid repetition.
  • the mobile terminal can only be equipped with a motion sensor or only a direction sensor, when both a motion sensor and a direction sensor are provided, you can choose to control whether the mobile sensor works or controls according to the user's usage habits
  • the direction sensor works. If the user does not choose between the two sensors, the two sensors can work at the same time. When moving horizontally, the movement data is detected by the movement sensor, and when tilting, the movement data is detected by the direction sensor. No specific restrictions.
  • this embodiment provides a solution for detecting tilt data of a mobile terminal through a built-in direction sensor in the mobile terminal, thereby generating a mouse event, which can conform to the user's usage habits and improve user operations
  • the fluency in the process provides convenience for the user to control the display with the mobile terminal.
  • the fourth embodiment of the present invention relates to a mobile terminal, which may include, as shown in FIG. 8, at least one processor 501; and a memory 502 communicatively connected to the at least one processor 501; wherein the memory 502 stores Instructions executed by at least one processor 501, the instructions are executed by at least one processor 501, so that at least one processor 501 can execute the above method embodiment.
  • the bus may include any number of interconnected buses and bridges.
  • the bus connects one or more processors and various circuits of the memory 502 together.
  • the bus can also connect various other circuits such as peripheral devices, voltage regulators, and power management circuits, etc., which are well known in the art, and therefore, they will not be described further herein.
  • the bus interface provides an interface between the bus and the transceiver.
  • the transceiver can be a single element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on the transmission medium.
  • the data processed by the processor 501 is transmitted on the wireless medium through the antenna. Further, the antenna also receives the data and transmits the data to the processor 501.
  • the processor 501 is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions.
  • the memory 502 may be used to store data used by the processor when performing operations.
  • the fifth embodiment of the present invention relates to a mobile terminal.
  • this embodiment is a further improvement of the fourth embodiment.
  • the main improvement lies in that the mobile terminal further includes a mobile sensor 603.
  • the processor 501 is connected to obtain the horizontal movement distance of the mobile terminal;
  • the mobile sensor 603 in the mobile terminal can be as shown in FIG. 10, including: a sensor body 701 and a sphere 702; specifically, the sensor body 701 is a hollow structure and a sphere 702 is provided in the sensor body 701 and can move on the bottom surface of the sensor body 701.
  • the contact point with the bottom surface of the sensor body 701 is the contact point to be detected;
  • the sensor body 701 Used to detect the contact angle; where the contact angle is: the angle between the line connecting the contact point and the center point to be detected and the line where the horizontal axis is located in the rectangular coordinate system established with the center point of the bottom surface as the origin;
  • the sensor body 701 is also used to detect the pressure on the side when the ball 702 is in contact with the side of the sensor body 701. Since the motion sensor in this embodiment has been described in detail in the second embodiment, to avoid repetition, it will not be repeated here.
  • the embodiments of the present invention establish a communication connection between the mobile terminal and the display, so that the mobile terminal and the display can perform data transmission, so that the mobile terminal controls the display.
  • Obtain the movement data of the mobile terminal confirm the coordinate data corresponding to the movement data based on the obtained movement data, and forward the coordinate data to the display to control the display's mouse pointer to move accordingly according to the coordinate data, so that the movement of the mobile terminal can be controlled
  • the embodiment of the invention breaks the size limitation of the touch screen of the mobile terminal, which is beneficial to make the user's operation process smoother and improve the user's experience.
  • a program which is stored in a storage medium and includes several instructions to make a device A single chip microcomputer, a chip, etc.) or a processor (processor) to perform all or part of the steps of the methods described in the embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code .

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

一种移动终端的交互控制方法、移动传感器和移动终端。其中的一种移动终端的交互控制方法，包括以下步骤：将移动终端与显示器建立通信连接（101）；获取移动终端的运动数据（102）；根据所获取的运动数据，确认与运动数据对应的坐标数据（103）；转发坐标数据至显示器，以控制显示器的鼠标指针根据坐标数据进行相应的移动（104）。

Description

移动终端的交互控制方法和移动终端
交叉引用
本发明要求在2018年11月01日提交中国专利局、申请号为201811295547.3、发明名称为“移动终端的交互控制方法和移动终端”的中国专利申请的优先权，该申请的全部内容通过引用结合在本发明中。
技术领域
本发明实施例涉及智能终端技术领域，特别涉及一种移动终端的交互控制方法和移动终端。
背景技术
目前，利用触摸板控制电脑屏幕的实现多基于手机屏幕，将手机整个屏幕作为触摸板。触摸板上产生的触摸事件转换为鼠标事件并转发映射到PC屏幕中，从而实现用户通过手机屏幕操作PC屏幕中的内容。按键事件经过转发映射到PC屏幕中，使得PC屏幕中的应用对按键事件作出相应响应。
然而，发明人发现在一些情形下至少存在如下问题：通过触摸事件转换成鼠标事件，违背于用户操作习惯；由于手机屏幕尺寸的限制，手机屏幕与PC屏幕大小不匹配，造成大量用户不连贯操作产生，影响用户的使用体验。
发明内容
本发明实施方式的目的在于提供一种移动终端的交互控制方法、移动传感器和移动终端，使得可以符合用户现有使用习惯，更容易让用户接受，突破了移动终端的触摸屏的尺寸限制使得用户的操作过程更加流畅，提升了用户的使用体验。
为解决上述技术问题，本发明实施方式提供了一种移动终端的交互控制方法，包括以下步骤：将移动终端与显示器建立通信连接；获取移动终端的 运动数据；根据所获取的运动数据，确认与运动数据对应的坐标数据；转发坐标数据至显示器，以控制显示器的鼠标指针根据坐标数据进行相应的移动。
本发明实施方式还提供了一种移动终端，包括：至少一个处理器；以及，与至少一个处理器通信连接的存储器；其中，存储器存储有可被至少一个处理器执行的指令，指令被至少一个处理器执行，以使至少一个处理器能够执行上述的移动终端的交互控制方法。
附图说明
一个或多个实施例通过与之对应的附图中的图片进行示例性说明，这些示例性说明并不构成对实施例的限定。
图1是根据本发明第一实施方式中的应用场景的示意图；
图2是根据本发明第一实施方式中的触摸屏显示的虚拟键盘的示意图；
图3是根据本发明第一实施方式移动终端的交互控制方法的流程图；
图4是根据本发明第一实施方式中的移动终端内的模块示意图；
图5是根据本发明第二实施方式中的内置移动传感器的移动终端的示意图；
图6是根据本发明第二实施方式的移动终端的交互控制方法的流程图；
图7是根据本发明第三实施方式的移动终端的交互控制方法的流程图；
图8是根据本发明第四实施方式的移动终端的结构示意图；
图9是根据本发明第五实施方式的移动终端的结构示意图；
图10是根据本发明第五实施方式的移动终端中的移动传感器的俯视图。
具体实施方式
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合附图对本发明的各实施方式进行详细的阐述。然而，本领域的普通技术人员可以理解，在本发明各实施方式中，为了使读者更好地理解本申请而提出了许多 技术细节。但是，即使没有这些技术细节和基于以下各实施方式的种种变化和修改，也可以实现本申请所要求保护的技术方案。
本发明的第一实施方式涉及一种移动终端的交互控制方法，应用于移动终端，包括：将移动终端与显示器建立通信连接；获取移动终端的运动数据；根据所获取的运动数据，得到与运动数据对应的坐标数据；将坐标数据转发至显示器，以控制显示器的鼠标指针根据坐标数据进行相应的移动，使得可以符合用户现有使用习惯，更容易让用户接受，突破了移动终端的触摸屏的尺寸限制使得用户的操作过程更加流畅，提升了用户的使用体验。下面对本实施方式的移动终端的交互控制方法的实现细节进行具体的说明，以下内容仅为方便理解提供的实现细节，并非实施本方案的必须。
本实施方式中，移动终端可以为智能手机、智能手环等智能终端，显示器可以为电脑的显示器、电视的显示器等显示设备。为方便说明，本实施方式中的移动终端以手机为例，显示器以电脑的显示器为例，然而在实际应用中并不以此为限。本实施方式的应用场景可以如图1所示，用户通过控制手机运动，即可以移动手机或是倾斜手机，从而控制显示器上的鼠标指针移动。当需要输入数据时，手机的屏幕界面可自动显示如图2所示的虚拟键盘，以实现将用户想要输入的数据通过手机输入到显示器中。本实施方式的具体流程图，可以如图3所示包括如下步骤。
步骤101：将移动终端与显示器建立通信连接。
具体的说，移动终端与显示器可以通过USB线连接，使得移动终端与显示器之间的通信状态更加稳定，有利于双方之间进行稳定高效的数据传输。在实际应用中，移动终端与显示器还可以通过WIFI连接，使得连接方式更加方便快捷。需要说明的是，本实施方式只是以上述两种连接方式为例，但在实际应用中可以为任意的有线、无线连接的方式进行通信连接。这里不做限定。
在实际应用中，移动终端中可以设置如图4所示的各个模块：传感器数 据管理模块201，用于初始化传感器、监听传感器实时数据并将数据传输给鼠标事件管理模块；鼠标事件管理模块202，用于初始化该模块、接收传感器数据、分析计算鼠标指针的位置坐标、向主模块发送鼠标移动事件；键盘事件管理模块203，用于初始化该模块、监听键盘事件、向主模块202发送键盘事件；主模块204，用于初始化触摸屏界面、监听鼠标点击事件、接收鼠标移动以及键盘事件、将相应事件发送给事件转发管理模块；事件转发模块205，用于初始化该模块、接收待转发的事件、向虚拟设备发送事件以供虚拟设备转发到显示器，比如说发送给PC屏幕。
当检测到移动终端与显示器建立通信连接后，可以首先对各个模块进行初始化，具体的，对主模块204初始化可以为：布局输入法界面、启动鼠标事件管理模块202初始化以及键盘事件管理模块203初始化并初始化与它们的通信接口。对鼠标事件管理模块202初始化可以为：初始化传感器、初始化与主模块的通信接口、初始化传感器数据监听器。对键盘事件管理模块203进行初始化可以为：绘制输入法界面、初始化键值监听器、初始化与主模块的通信接口。对事件转发模块205初始化可以为：新建虚拟设备用于接收转发事件、初始化与主模块的通信接口、初始化与虚拟设备的通信接口。对各个模块进行初始化使得移动终端更加适合作为一个控制PC屏幕的工具。
步骤102：获取移动终端的运动数据。
具体的说，用户可以手持移动终端，从而控制移动终端处于运动状态，比如说移动移动终端或是转动移动终端。移动终端内可以内置传感器，通过内置的传感器检测当前所处的运动状态，从而获取相应的运动数据。
步骤103：根据所获取的运动数据，确认与运动数据对应的坐标数据。
具体的说，不同的运动数据可以对应显示器中鼠标指针的不同位置坐标。比如说，移动终端中可以预存运动数据和位置坐标的对应关系，在获取到运动数据，可以根据存储的对应关系确认与当前的运动数据对应的鼠标指针的位置坐标。通过运动数据，模拟生成鼠标移动事件，提高了鼠标事件的输入 效率，有利于快速确认鼠标指针当前应处于的位置坐标。
步骤104：转发坐标数据至显示器，以控制显示器的鼠标指针根据坐标数据进行相应的移动。
具体的说，移动终端可以将位置坐标通过USB连接线或是WIFI连接发送至显示器，显示器在接收到位置坐标后，控制鼠标指针移动到位置坐标处，使得鼠标指针可以随着移动终端的运动而移动。
在一实施方式中，所述移动终端的交互控制方法，进一步还可以包括：步骤105：控制移动终端的触摸屏显示虚拟键盘。
具体的说，移动终端可以在与显示器建立通信连接后就直接在触摸屏上显示虚拟键盘。还可以在检测到显示器需要输入法介入时，再控制移动终端的触摸屏显示虚拟键盘。比如说，移动终端中可以预存需要输入法介入的应用，当检测到显示器中需要输入法介入的应用被打开时，控制移动终端的触摸屏上显示如图2所示的虚拟键盘，而在不需要输入法介入是，触摸屏可以处于灭屏状态，从而更有利于节能。
在一个例子中，虚拟键盘在触摸屏上占据的面积大于或等于预设阈值，预设阈值可以由用户根据实际需要进行设置，比如说，用户想要在触摸屏上同时实现键盘事件和鼠标点击事件，而触摸屏上虚拟键盘的大小直接影响用户的使用效果，可以通过设置使得触摸屏上虚拟键盘占据的面积尽可能较大，比如说，将预设阈值设置为触摸屏面积的2/3或者更大，使得用户可以在较大的虚拟键盘上操作，有利于用户输入的准确度，提高用户的使用体验。触摸屏上剩余较小的位置可以设置虚拟按键以实现鼠标点击事件。
较佳的，预设阈值的大小可以等于触摸屏的显示面积，也就是说，虚拟键盘在触摸屏上全屏显示，如图2所示。此时，由于触摸屏上已经没有区域设置虚拟按键，鼠标点击事件可以通过移动终端上的物理按键实现。
值得一提的是，现有技术中，为了扩大用户触摸操作区域，相关竞品将触摸屏界面充满整个手机屏幕。当显示器中的相关应用需要输入法介入时， 输入法从触摸屏底部滑出，并最终覆盖在触摸屏界面的下半部分区域，以供生成键盘事件。然而，输入法界面挡住触摸屏部分区域，进一步限制用户可触摸区域且容易造成触摸事件与按键事件上下文频繁切换，从而降低输入效率。而本实施方式中，由于产生鼠标移动事件的过程无需移动终端触摸屏参与，所以，整个触摸屏界面可以大面积的放置虚拟键盘，甚至可以全屏放置虚拟键盘，扩大了键盘显示范围，避免误输入的概率，同时提高了键盘事件的输入效率。
需要说明的是，在实际应用中步骤105可以在步骤101之后执行，即只要移动终端与显示器建立了通信连接，表明移动终端开始用于控制显示器，此时就可以开始执行步骤105。
步骤106：检测用户在虚拟键盘上点击的键值，将检测到的键值发送至显示器。
也就是说，显示器在接收到移动终端发送的键值时，将接收的键值作为输入值，从而使得利用移动终端还可以实现键盘输入的功能。
步骤107：在检测到预设按键被按压时，将鼠标点击指令发送至所述显示器。
具体的说，在一个例子中，预设按键可以为虚拟按键，此时虚拟按键在触摸屏上所占的面积小于虚拟键盘在触摸屏上占据的面积，即触摸屏上大部分区域显示虚拟键盘，为虚拟按键预留较小的位置，比如说整个触摸屏上虚拟按键所占的区域仅为手指的面积大小，利用大部分区域显示虚拟键盘，用户可以根据自己的实际使用习惯选择虚拟按键设置的位置，比如说设置在触摸屏的四角。
在另一个例子中，预设按键为物理按键，则虚拟键盘在触摸屏上全屏显示。移动终端上不同的物理按键可以对应鼠标的左右键，比如说，移动终端为手机时，可以利用手机的音量键来模拟鼠标点击事件，当检测到音量加键被按压时，将点击鼠标左键的指令发送至显示器，当检测到音量减键被按压 时，将点击鼠标右键的指令发送至显示器，以供显示器执行相应的点击鼠标左或右键应有的功能。实体按键使用户的使用感觉与点击实际鼠标按键更相似，提高用户的使用体验。
需要说明的是，在实际应用中步骤107可以在步骤101之后执行，即只要移动终端与显示器建立了通信连接，表明移动终端开始用于控制显示器，此时就可以开始执行步骤107。
与现有技术相比，本实施方式将移动终端本身既可以作为鼠标也可以作为键盘，通过控制移动终端运动获得运动数据，进而分析得到鼠标指针的位置坐标，作为当前鼠标位置坐标并转发到显示器中，显示器根据位置坐标控制鼠标指针移动，突破了移动终端的触摸屏的尺寸限制，使得用户的操作过程更加流畅。同时，实体按键代替鼠标的左右键，有利于用户真实的感受到点击鼠标的触感，提高用户的使用体验。鼠标事件与键盘事件在移动终端显示界面上实现了分离，不再需要鼠标事件与键盘事件上下切换，整个触摸屏与显示器的交互过程符合用户现有使用习惯，提高有利于提高输入效率和办公效率。
本发明的第二实施方式涉及一种移动终端的交互控制方法。第二实施方式是第一实施方式的进一步改进，主要改进之处在于：在本发明第二实施方式中，运动数据具体为：通过移动传感器获取的水平移动距离，有利于更准确的模拟用户在实际生活中使用鼠标的感觉，提高用户的使用体验。
本实施方式中，移动终端内置移动传感器，移动传感器包括：传感器本体和球体，传感器本体为中空结构，球体设置在传感器本体内，且可在传感器本体的底面上移动；球体移动到与传感器本体的侧面接触时，与传感器本体的底面的接触点为待检测接触点。比如说，内置移动传感器的手机的俯视图如图5所示，手机中置入移动传感器，移动传感器可以为中空的圆柱体结构，使得可以无缝接触其内部放置的可移动的小球，从而根据接触点更准确的得出x y的移动方向。圆柱体的高度可以为能容纳一个小球的高度，底部 可以为光滑平面供移动小球无阻力滑动。当移动小球滑动到移动传感器边缘时，移动传感器可以得到当前接触点的接触角度以及边缘所受压力即圆柱体侧面所受的压力，例如用户快速或缓缓向左移动手机时侧面受到的接触压力是不一样的。接触角度可以为：如图5所示在以底面的中心点为原点建立的直角坐标系中，待检测接触点与中心点的连线，和横轴所在直线的夹角的角度。手机可以将得到的相应值通过android API通知给传感器数据管理模块以计算鼠标指针的位置坐标。
本实施方式的移动终端的交互控制方法的具体流程图可以如图6所示，包括如下步骤。
步骤301：将移动终端与显示器建立通信连接。
步骤301与第一实施方式中步骤101大致相同，为避免重复此处不再赘述。
步骤302：通过移动传感器检测接触角度和移动传感器的侧面受到的压力。
比如说，移动终端为手机，手机水平放置时在，手机屏幕所在的整个平面上建立直角坐标系，左右方向作为X轴，上下作为Y轴，当用户控制手机向上移动时，则Y为负值，否则为正值。当用户将手机向左移动时，则X为负值，否则为正值。例如，如图5所示，用户向正东北方向移动手机时，此时移动小球与移动传感器的接触点为平面坐标系45度处，即检测到的接触角度为45°。移动传感器的侧面可以设置有压力感应器，当移动小球移动到与侧面接触时可以利用侧面的压力感应器检测到侧面所受的压力。
在实际应用中，手机中的移动传感器可以在手机与显示器建立通信连接后再启动，开始工作，如果手机与显示器断开连接，可以销毁移动传感器中的检测数据，以避免其中残存的数据可能对后面使用手机时会有影响，有利于手机在正常通讯使用与控制显示器两种功能之间进行有效的切换，提高用户的使用体验。
步骤303：根据接触角度获取移动终端的水平移动距离。
具体的说，可以根据函数关系得到与接触角度对应的水平移动距离，比如说，检测到的接触角度为45°时，则手机在水平面上横向和纵向移动的距离都为1。
步骤304：根据获取的水平移动距离和检测到的压力，计算与水平移动距离对应的坐标数据。
具体的说，压力大小可用于表征移动速度，移动速度快时压力较大，结合移动速度可以得到不同移动速度下的鼠标的位置坐标，以适应不同用户的使用需求。较佳的，还可以预设参考值，参考值可以为起始坐标参考值和/或压力调整参考值；参考值可以由用户根据自身使用习惯进行设置，如果用户想提高灵敏度可以设置较大的起始坐标参考值以及压力调整参考值，反之亦然。在一个例子中，起始坐标参考值为(X，Y)、水平移动距离横向纵向均为1、检测到的压力值为1、压力调整参考值为10％，则根据参考值、水平移动距离和检测到的压力，获取的显示器中的鼠标指针的位置坐标为(X+1+1*10％，Y+1+1*10％)。
步骤305：转发坐标数据至显示器，以控制显示器的鼠标指针根据坐标数据进行相应的移动。
步骤306：控制移动终端的触摸屏显示虚拟键盘。
步骤307：检测用户在虚拟键盘上点击的键值，将检测到的键值发送至显示器。
步骤308：在检测到预设按键被按压时，将鼠标点击指令发送至所述显示器。
步骤305至步骤308与第一实施方式中步骤104至步骤107大致相同，为避免重复此处不再一一赘述。
与现有技术相比，本实施方式在移动终端中内置移动传感器，通过移动传感器检测移动终端在水平面的移动来模拟实体鼠标设备移动的效果，更加 符合用户的使用习惯。由于移动终端的便携性和使用的广泛性，利用移动终端控制显示器进一步方便了用户的使用。而且，用户在水平移动移动终端时，获得和移动实体鼠标设备更加贴近的感觉，有利于进一步提升用户的使用体验。
本发明的第三实施方式涉及一种移动终端的交互控制方法，本实施方式与第二实施方式大致相同，不同之处在于，检测的运动数据不同，第二实施方式中运动数据为：通过移动传感器获取的水平移动距离，本实施方式中运动数据为：通过方位传感器获取的倾斜移动距离，本实施方式提供了另一种获取运动数据的方式，使得获取运动数据的实现方式灵活多样。
本实施方式的移动终端的交互控制方法的具体流程图可以如图7所示，包括如下步骤。
步骤401：将移动终端与显示器建立通信连接。
步骤401与步骤301大致相同，为避免重复在此不再赘述。
步骤402：通过方向传感器检测移动终端的三维坐标。
具体的说，以移动终端为手机为例，本实施方式中的方向传感器可以为现有的大部分手机中内置的方向传感器，现有的方向感应器的实现靠的是手机内置的加速计，一般为三轴加速计，分为X轴、Y轴和Z轴，三轴加速计意味着它能够检测到三维空间中的运动。也就是说可以利用这三个轴所构成的立体空间检测手机所处位置的三维坐标即X、Y、Z轴的3D坐标。用户可以将手机平行于水平面放置，屏幕朝上水平倾斜手机，当水平倾斜手机方向传感器的Y轴坐标值一般不会发生变化，只有X和Z轴坐标值会发生变化。需要说明的是，本实施方式只是以水平倾斜手机为例，在实际应用中并不以此为限。
步骤403：根据三维坐标获取移动终端的倾斜移动距离。
具体的说，如果获取的三维坐标中某一坐标轴的数值为0，说明在这一坐标轴方向上没有倾斜，比如说，在水平倾斜手机时，获取的为X和Z轴坐 标值，X和Z轴坐标值可以分别视为在X和Z轴上的倾斜移动距离。
步骤404：根据获取的倾斜移动距离，确认与倾斜移动距离对应的坐标数据。
具体的说，以水平倾斜手机为例，获取的为X和Z轴上的倾斜移动距离，可以将X和Z轴上的倾斜移动距离根据预设的映射关系映射为X和Y轴坐标值。当用户朝屏幕右边缘向下倾斜手机时，则X为正值，反之，当用户朝屏幕左边缘向下倾斜手机时，则X为负值。当用户朝屏幕下边缘向下倾斜手机时，则Y为正值，反之，当用户朝屏幕上边缘向下倾斜手机时，则Y为负值。此时，得到的X和Y轴坐标值为获取的显示器中的鼠标指针的位置坐标。
步骤405：转发坐标数据至显示器，以控制显示器的鼠标指针根据坐标数据进行相应的移动。
步骤406：控制移动终端的触摸屏显示虚拟键盘。
步骤407：检测用户在虚拟键盘上点击的键值，将检测到的键值发送至显示器。
步骤408：在检测到预设按键被按压时，将鼠标点击指令发送至所述显示器。
步骤405至步骤408与第二实施方式中步骤305至步骤308大致相同，为避免重复此处不再一一赘述。
在实际应用中，如果移动终端中可以仅设置有移动传感器也就可以仅设置有方向传感器，当同时设置有移动传感器和方向传感器时，可以根据用户的使用习惯，选择控制移动传感器工作，还是控制方向传感器工作。如果用户没有在两个传感器之间做出选择，那么两个传感器可以同时工作，当水平移动时，由移动传感器检测运动数据，当倾斜移动时，由方向传感器检测运动数据，对此本实施方式不做具体限定。
与现有技术相比，本实施方式，提供了一种通过移动终端中内置的方向传感器检测移动终端的倾斜数据，进而来产生鼠标事件的方案，使得可以符 合用户的使用习惯，提高了用户操作过程中的流畅度，为用户利用移动终端控制显示器提供了方便。
上面各种方法的步骤划分，只是为了描述清楚，实现时可以合并为一个步骤或者对某些步骤进行拆分，分解为多个步骤，只要包括相同的逻辑关系，都在本专利的保护范围内；对算法中或者流程中添加无关紧要的修改或者引入无关紧要的设计，但不改变其算法和流程的核心设计都在该专利的保护范围内。
本发明第四实施方式涉及一种移动终端，可以如图8所示，包括：至少一个处理器501；以及，与至少一个处理器501通信连接的存储器502；其中，所述存储器502存储有可被至少一个处理器501执行的指令，指令被至少一个处理器501执行，以使至少一个处理器501能够执行上述方法实施例。
其中，存储器502和处理器501采用总线方式连接，总线可以包括任意数量的互联的总线和桥，总线将一个或多个处理器和存储器502的各种电路连接在一起。总线还可以将诸如外围设备、稳压器和功率管理电路等之类的各种其他电路连接在一起，这些都是本领域所公知的，因此，本文不再对其进行进一步描述。总线接口在总线和收发机之间提供接口。收发机可以是一个元件，也可以是多个元件，比如多个接收器和发送器，提供用于在传输介质上与各种其他装置通信的单元。经处理器501处理的数据通过天线在无线介质上进行传输，进一步，天线还接收数据并将数据传送给处理器501。
处理器501负责管理总线和通常的处理，还可以提供各种功能，包括定时，外围接口，电压调节、电源管理以及其他控制功能。而存储器502可以被用于存储处理器在执行操作时所使用的数据。
本发明第五实施方式涉及一种移动终端，可以如图9所示，本实施方式是第四实施方式的进一步改进，主要改进之处在于，移动终端中还包括移动传感器603，移动传感器603与处理器501连接，用于获取移动终端的水平移动距离；移动终端内的移动传感器603可以如图10所示，包括：传感器本 体701和球体702；具体的说，传感器本体701为中空结构，球体702设置在传感器本体701内，且可在传感器本体701的底面上移动，球体702移动到与传感器本体701的侧面接触时，与传感器本体701的底面的接触点为待检测接触点；传感器本体701，用于检测接触角度；其中，接触角度为：在以底面的中心点为原点建立的直角坐标系中，待检测接触点与中心点的连线，和横轴所在直线的夹角的角度；传感器本体701，还用于在球体702与传感器本体701的侧面接触时，检测侧面受到的压力。由于本实施方式中的移动传感器在第二实施方式中已进行详细描述，为避免重复，此处不再赘述。
本发明实施方式相对于现有技术而言，将移动终端与显示器建立通信连接，使得移动终端和显示器能够进行数据传输，以实现移动终端对于显示器的控制。获取移动终端的运动数据，根据所获取的运动数据，确认与运动数据对应的坐标数据，转发坐标数据至显示器，以控制显示器的鼠标指针根据坐标数据进行相应的移动，使得可以通过控制移动终端运动来模拟鼠标指针的移动，更符合用户在实际使用鼠标过程中的使用习惯。而且，由于控制移动终端运动与移动终端的屏幕尺寸并无关联，因此避免了现有技术中，由于移动终端的屏幕尺寸与显示器的屏幕尺寸不匹配而造成的用户不连贯操作的产生，即本发明实施方式突破了移动终端的触摸屏的尺寸限制，有利于使用户的操作过程更加流畅，提升了用户的使用体验。
本领域技术人员可以理解，实现上述实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序存储在一个存储介质中，包括若干指令用以使得一个设备(可以是单片机，芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
本领域的普通技术人员可以理解，上述各实施方式是实现本发明的具体 实施例，而在实际应用中，可以在形式上和细节上对其作各种改变，而不偏离本发明的精神和范围。

Claims (12)

  1. 一种移动终端的交互控制方法，其中，包括：
    将所述移动终端与显示器建立通信连接；
    获取所述移动终端的运动数据；
    根据所获取的运动数据，确认与所述运动数据对应的坐标数据；
    转发所述坐标数据至所述显示器，以控制所述显示器的鼠标指针根据所述坐标数据进行相应的移动。
  2. 根据权利要求1所述的移动终端的交互控制方法，其中，所述获取所述移动终端的运动数据，包括：
    通过移动传感器获取所述移动终端的水平移动距离或通过方向传感器获取所述移动终端的倾斜移动距离。
  3. 根据权利要求2所述的移动终端的交互控制方法，其中，当通过所述移动传感器获取所述移动终端的水平移动距离时，包括：
    通过移动传感器检测接触角度；其中，所述移动传感器包括：传感器本体和球体，所述传感器本体为中空结构，所述球体设置在所述传感器本体内，且可在所述传感器本体的底面上移动；所述球体移动到与所述传感器本体的侧面接触时，与所述传感器本体的底面的接触点为待检测接触点；所述接触角度为：在以所述底面的中心点为原点建立的直角坐标系中，所述待检测接触点与所述中心点的连线，和横轴所在直线的夹角的角度；
    根据所述接触角度获取所述移动终端的水平移动距离。
  4. 根据权利要求3所述的移动终端的交互控制方法，其中，还包括：
    在所述通过移动传感器检测接触角度时，通过所述移动传感器检测所述侧面受到的压力；
    所述根据所获取的运动数据，确认与所述运动数据对应的坐标数据，包括：
    根据获取的所述水平移动距离和检测到的压力，计算与所述水平移动距离对应的坐标数据。
  5. 根据权利要求4所述的移动终端的交互控制方法，其中，还包括：
    预设参考值；其中，所述参考值为起始坐标参考值和/或压力调整参考值；
    所述根据获取的所述水平移动距离和检测到的压力，计算与所述水平移动距离对应的坐标数据，包括：
    根据所述参考值、获取的所述水平移动距离和所述检测到的压力，计算与所述水平移动距离对应的坐标数据。
  6. 根据权利要求2所述的移动终端的交互控制方法，其中，当通过所述方向传感器获取所述移动终端的倾斜移动距离时，包括：
    通过所述方向传感器检测所述移动终端的三维坐标；
    根据所述三维坐标获取所述移动终端的倾斜移动距离。
  7. 根据权利要求1所述的移动终端的交互控制方法，其中，在所述将所述移动终端与所述显示器建立通信连之后，还包括：
    控制所述移动终端的触摸屏显示虚拟键盘，所述虚拟键盘在所述触摸屏上占据的显示面积大于或等于预设阈值；
    检测用户在所述虚拟键盘上点击的键值；
    将检测到的键值发送至所述显示器，以供所述显示器将接收的键值作为输入值。
  8. 根据权利要求7所述的移动终端的交互控制方法，其中，所述虚拟键盘在所述触摸屏上占据的显示面积等于预设阈值，所述预设阈值为所述触摸 屏的显示面积。
  9. 根据权利要求1所述的移动终端的交互控制方法，其中，在所述将所述移动终端与所述显示器建立通信连之后，还包括：
    在检测到预设按键被按压时，将鼠标点击指令发送至所述显示器，以供所述显示器执行所述鼠标点击指令；其中，若所述预设按键为虚拟按键，则所述虚拟按键在所述触摸屏上所占的显示面积小于所述虚拟键盘在所述触摸屏上占据的显示面积；若所述预设按键为物理按键，则所述虚拟键盘在所述触摸屏上全屏显示。
  10. 根据权利要求1至9中任一项所述的移动终端的交互控制方法，其中，还包括：
    在检测到所述移动终端与所述显示器断开连接后，销毁获取的所述运动数据。
  11. 一种移动终端，其中，包括：
    至少一个处理器；以及，
    与所述至少一个处理器通信连接的存储器；其中，
    所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行如权利要求1至10中任一所述的移动终端的交互控制方法。
  12. 根据权利要求11所述的移动终端，其中，还包括：移动传感器，所述移动传感器与所述处理器连接，用于获取所述移动终端的水平移动距离；
    所述移动传感器包括：传感器本体和球体；
    所述传感器本体为中空结构，所述球体设置在所述传感器本体内，且可在所述传感器本体的底面上移动，所述球体移动到与所述传感器本体的侧面 接触时，与所述传感器本体的底面的接触点为待检测接触点；
    所述传感器本体，用于检测接触角度；其中，所述接触角度为：在以所述底面的中心点为原点建立的直角坐标系中，所述待检测接触点与所述中心点的连线，和横轴所在直线的夹角的角度；
    所述传感器本体，还用于在所述球体与所述传感器本体的侧面接触时，检测所述侧面受到的压力。
PCT/CN2019/111275 2018-11-01 2019-10-15 移动终端的交互控制方法和移动终端 WO2020088244A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811295547.3A CN111124156B (zh) 2018-11-01 2018-11-01 移动终端的交互控制方法和移动终端
CN201811295547.3 2018-11-01

Publications (1)

Publication Number Publication Date
WO2020088244A1 true WO2020088244A1 (zh) 2020-05-07

Family

ID=70462928

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/111275 WO2020088244A1 (zh) 2018-11-01 2019-10-15 移动终端的交互控制方法和移动终端

Country Status (2)

Country Link
CN (1) CN111124156B (zh)
WO (1) WO2020088244A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113010130B (zh) * 2021-03-11 2023-03-24 中国科学院软件研究所 一种基于图像流的远距离大屏交互控制方法
CN113282222B (zh) * 2021-04-23 2024-03-29 海南视联通信技术有限公司 一种光标控制方法和装置
CN115061651A (zh) * 2022-06-17 2022-09-16 镁佳(北京)科技有限公司 一种基于操作系统的点击数据传输方法、装置及设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101727209A (zh) * 2008-10-21 2010-06-09 上海吉芯电子有限公司 一种无线三维鼠标的设计方法
US20100174421A1 (en) * 2009-01-06 2010-07-08 Qualcomm Incorporated User interface for mobile devices
CN101930283A (zh) * 2009-06-23 2010-12-29 巍世科技有限公司 整合式有线/无线鼠标
CN101943957A (zh) * 2010-07-23 2011-01-12 康佳集团股份有限公司 一种带加速度传感器的触摸屏手机和鼠标输入的方法
CN103167338A (zh) * 2012-10-09 2013-06-19 深圳市金立通信设备有限公司 一种基于移动终端的智能电视输入控制系统及方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06149472A (ja) * 1992-11-09 1994-05-27 Fuji Electric Co Ltd 座標入力装置
CN2752853Y (zh) * 2004-12-18 2006-01-18 段西京 滚球式光机鼠标
JP2012088244A (ja) * 2010-10-21 2012-05-10 Toshiba Corp ３次元表面形状算出装置およびそれを用いた自動施工装置ならびにその方法
CN102486686A (zh) * 2010-12-06 2012-06-06 富泰华工业（深圳）有限公司 鼠标
CN103345312B (zh) * 2013-07-03 2016-01-13 张帆 以智能终端同时作为主机、鼠标和触摸板的系统及方法
CN106155529A (zh) * 2015-04-10 2016-11-23 中兴通讯股份有限公司 移动终端控制方法及移动终端
US20170277340A1 (en) * 2016-03-25 2017-09-28 Le Holdings (Beijing) Co., Ltd. Terminal control method and terminal
CN107707955A (zh) * 2017-08-30 2018-02-16 上海与德科技有限公司 一种显示器上的光标控制方法及智能设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101727209A (zh) * 2008-10-21 2010-06-09 上海吉芯电子有限公司 一种无线三维鼠标的设计方法
US20100174421A1 (en) * 2009-01-06 2010-07-08 Qualcomm Incorporated User interface for mobile devices
CN101930283A (zh) * 2009-06-23 2010-12-29 巍世科技有限公司 整合式有线/无线鼠标
CN101943957A (zh) * 2010-07-23 2011-01-12 康佳集团股份有限公司 一种带加速度传感器的触摸屏手机和鼠标输入的方法
CN103167338A (zh) * 2012-10-09 2013-06-19 深圳市金立通信设备有限公司 一种基于移动终端的智能电视输入控制系统及方法

Also Published As

Publication number Publication date
CN111124156B (zh) 2023-07-18
CN111124156A (zh) 2020-05-08

Similar Documents

Publication Publication Date Title
WO2020088244A1 (zh) 移动终端的交互控制方法和移动终端
US10055064B2 (en) Controlling multiple devices with a wearable input device
CN103345312B (zh) 以智能终端同时作为主机、鼠标和触摸板的系统及方法
EP2708983A2 (en) Method for auto-switching user interface of handheld terminal device and handheld terminal device thereof
US20110205169A1 (en) Multi-touch input apparatus and its interface method using hybrid resolution based touch data
EP2824551A1 (en) Method, device, and system for controlling computer terminal
CN102902476B (zh) 一种触摸式终端控制电子设备的方法及其系统
US10890982B2 (en) System and method for multipurpose input device for two-dimensional and three-dimensional environments
WO2013155735A1 (zh) 具备近接感测投影点坐标指示的离屏触控交互系统
CN109558061A (zh) 一种操作控制方法及终端
US9823773B2 (en) Handheld device and method for implementing input area position adjustment on handheld device
CN105183236A (zh) 一种触屏输入装置与方法
CN110851061A (zh) 一种指环式鼠标控制终端的方法
CN105204764B (zh) 具有悬浮屏的手持终端、显示设备及遥控方法
WO2018058673A1 (zh) 一种3d显示方法及用户终端
WO2011140752A1 (zh) 电子装置及获取用户操作的方法
CN111078032A (zh) 一种可预判两指合并趋势的指环式鼠标及预判方法
KR102145824B1 (ko) 스마트 터치패드 인터페이스 방법 및 그 장치
JP3211484U (ja) 触感型コントローラー
CN104834410A (zh) 输入装置以及输入方法
CN113760085A (zh) 虚拟环境构建和应用方法、vr设备及虚拟现实交互系统
CN110888529B (zh) 虚拟现实场景控制方法、虚拟现实设备及其控制装置
CN112068699A (zh) 一种交互方法、装置、电子设备和存储介质
KR20170124593A (ko) 지능형 상호작용 방법, 장비 및 시스템
CN112579015B (zh) 一种课件的显示方法、系统、设备和存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19879303

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 09/09/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19879303

Country of ref document: EP

Kind code of ref document: A1