WO2020048282A1 - 一种利用智能终端实现鼠标和键盘功能的方法 - Google Patents

一种利用智能终端实现鼠标和键盘功能的方法 Download PDF

Info

Publication number
WO2020048282A1
WO2020048282A1 PCT/CN2019/099562 CN2019099562W WO2020048282A1 WO 2020048282 A1 WO2020048282 A1 WO 2020048282A1 CN 2019099562 W CN2019099562 W CN 2019099562W WO 2020048282 A1 WO2020048282 A1 WO 2020048282A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
mouse
smart terminal
keyboard
virtual
Prior art date
Application number
PCT/CN2019/099562
Other languages
English (en)
French (fr)
Inventor
李冰
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2020048282A1 publication Critical patent/WO2020048282A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725—Cordless telephones

Definitions

  • the invention relates to the technical field of intelligent terminals, and in particular, to a method for implementing functions of a mouse and a keyboard by using an intelligent terminal.
  • the technical problem solved according to the solution provided by the embodiment of the present invention is that after the smart terminal is connected to the display and enters the computer mode, the user cannot directly use the keyboard and mouse to operate directly without an external device.
  • the smart terminal establishes a communication link with the external display by connecting with the external display;
  • the smart terminal After establishing a communication link with the external display, the smart terminal switches from the current terminal mode to a computer mode, and uses the communication link to transmit the display content of the computer mode to the external display, and at the same time
  • the display content on the screen is switched to an input interface composed of a virtual mouse and a virtual keyboard.
  • a device for implementing functions of a mouse and a keyboard by using a smart terminal includes: a processor, and a memory coupled to the processor; A program for implementing mouse and keyboard functions using a smart terminal running on a device, and when the program for implementing mouse and keyboard functions using the smart terminal is executed by the processor, the program for implementing the mouse using the smart terminal according to the embodiment of the present invention is implemented. And keyboard function method steps.
  • a computer storage medium provided according to an embodiment of the present invention stores a program for implementing mouse and keyboard functions using an intelligent terminal, and the program for implementing mouse and keyboard functions using an intelligent terminal is implemented according to an embodiment of the present invention when executed by a processor.
  • the steps of the method for implementing mouse and keyboard functions using a smart terminal are stored in a computer storage medium provided according to an embodiment of the present invention.
  • the dual-screen smart terminal when the user connects the dual-screen smart terminal to the display and enters the PC (computer) mode.
  • the two screens of the terminal function as a mouse screen and a keyboard screen, respectively. So that users can carry only a mobile phone to the display for convenient office purposes.
  • FIG. 1 is a flowchart of a method for implementing mouse and keyboard functions by using an intelligent terminal according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a device for implementing functions of a mouse and a keyboard by using an intelligent terminal according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a system for implementing functions of a mouse and a keyboard by using an intelligent terminal according to an embodiment of the present invention
  • FIG. 4 is a flowchart of a method for implementing a mouse and a keyboard function by using a dual-screen intelligent terminal according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram of a connection between a smart terminal and an external display according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a dual-screen state connection display provided in an embodiment of the present invention entering a PC mode, and two screens of a smart terminal are respectively controlled as functions of a mouse and a keyboard, and a display is used as a visual representation;
  • FIG. 7 is a schematic diagram of a single-screen state connection display provided in an embodiment of the present invention to enter a PC mode, a single screen of a smart terminal acting as a mouse and keyboard function, and a display as a visual representation.
  • the embodiment of the present invention is applicable to a mobile phone (smart terminal) having one or two screens and an external display device.
  • FIG. 1 is a flowchart of a method for implementing mouse and keyboard functions by using an intelligent terminal according to an embodiment of the present invention. As shown in FIG. 1, the method may include:
  • Step S1 the smart terminal establishes a communication link with the external display by connecting with the external display;
  • connection mode between the smart terminal and the external display includes a wired connection mode and a wireless connection mode.
  • Step S2 After establishing a communication link with the external display, the smart terminal is converted from the current terminal mode to a computer mode, and the display content of the computer mode is transmitted to the external display using the communication link. At the same time, the display content on the screen is switched to an input interface composed of a virtual mouse and a virtual keyboard.
  • the smart terminal may be a single-screen smart terminal.
  • the upper half of the screen of the single-screen smart terminal is a virtual mouse with an input interface; the lower half is a virtual keyboard with an input interface; or on the single-screen smart terminal screen
  • the upper part is the virtual keyboard of the input interface; the lower part is the virtual mouse of the input interface.
  • the smart terminal may also be a dual-screen smart terminal.
  • switching the display content on the screen to an input interface composed of a virtual mouse and a virtual keyboard includes: the dual-screen smart terminal monitors in real time whether two screens are in a horizontal state; If the two screens are monitored in a horizontal state, the dual-screen smart terminal displays the input interface consisting of a virtual mouse and a virtual keyboard on the two screens; if the two screens are monitored in a non-horizontal state, the dual screens The screen smart terminal displays the input interface composed of a virtual mouse and a virtual keyboard on a screen.
  • displaying the input interface consisting of a virtual mouse and a virtual keyboard on two screens by the dual-screen intelligent terminal includes: displaying the virtual mouse of the input interface in a horizontal manner by the dual-screen intelligent terminal. On one screen, a virtual keyboard of the input interface is displayed on another screen in a horizontal manner.
  • FIG. 2 is a schematic diagram of a device for implementing functions of a mouse and a keyboard by using a smart terminal according to an embodiment of the present invention.
  • the device includes a establishing module 201 for establishing a connection with the external display by connecting with the external display.
  • the external display simultaneously switches the display content on the screen to an input interface composed of a virtual mouse and a virtual keyboard.
  • the smart terminal may be a single-screen smart terminal.
  • the upper half of the screen of the single-screen smart terminal is a virtual mouse with an input interface; the lower half is a virtual keyboard with an input interface; or on the single-screen smart terminal screen
  • the upper part is the virtual keyboard of the input interface; the lower part is the virtual mouse of the input interface.
  • the processing module 202 includes: a monitoring unit for monitoring whether the two screens are in a horizontal state when the smart terminal is a dual-screen smart terminal; and a processing unit for monitoring the two screens.
  • a horizontal state the input interface consisting of a virtual mouse and a virtual keyboard is displayed on two screens, and when the two screens are monitored in a non-horizontal state, the input interface consisting of a virtual mouse and a virtual keyboard is displayed Show on one screen.
  • the processing unit is specifically configured to display a virtual mouse of the input interface on one screen in a landscape manner, and display a virtual keyboard of the input interface on another screen in a landscape manner.
  • An embodiment of the present invention provides a device for implementing functions of a mouse and a keyboard by using an intelligent terminal.
  • the device includes: a processor and a memory coupled to the processor; and the memory stores a memory that can be stored in the processor.
  • a program running on a smart terminal to implement mouse and keyboard functions, and the program using the smart terminal to implement mouse and keyboard functions is executed by the processor to implement the implementation of the mouse and keyboard using the smart terminal according to an embodiment of the present invention. Steps of the keyboard function method.
  • a computer storage medium provided by an embodiment of the present invention stores a program for implementing functions of a mouse and a keyboard using a smart terminal, and the program for implementing functions of a mouse and keyboard using a smart terminal is implemented by a processor to implement the functions provided by the embodiment of the present invention.
  • the steps of the method for implementing the functions of a mouse and a keyboard by using an intelligent terminal are implemented by a processor to implement the functions provided by the embodiment of the present invention.
  • the hardware based on the embodiment of the present invention is a foldable dual-screen mobile terminal, which can be used as a normal terminal. When one screen is turned over, the two screens can be combined into a large screen.
  • the large screen can display more information content, which can be a whole content, or independent information display of two screens, but the user can read the content on both sides at the same time in one field of view.
  • FIG. 3 is a schematic diagram of a system for implementing mouse and keyboard functions by using a smart terminal according to an embodiment of the present invention. As shown in FIG. 3, the system includes:
  • 1.CPU processor real-time detection of whether there is currently data transmission with the external display; and judge the terminal interface presentation status according to the current connection status.
  • Storage module This module stores the current connection status and the mobile phone screen status. Solutions include solution A: no external display is connected; solution B: connect an external display.
  • the screen state of the mobile phone includes a: the two screens are flipped and folded, and the two screens are between 0 and 179 degrees. b: Both screens are on a 180-degree horizontal plane.
  • the acquisition module refers to detecting the running status of the program on the display screen of the dual-screen smart terminal, and acquiring the user's gesture operation instruction and screen relationship status when the user performs an interactive operation. Feedback the operating status and user parameters to the judgment module for analysis.
  • Judgment module By judging the user operating parameters obtained by the acquisition module and the current dual-screen operating conditions, first determine the current dual-screen status.
  • the dual-screen is between 0 ° to 179 ° or 180 ° Which of the two states?
  • the solutions in the storage module are compared according to the combination of the screen status and the external connection status, and the conclusions obtained from the judgment are sent to the control module.
  • Control module controls the display module to perform specific interface display by obtaining the conclusion of the judgment module. Controls which screen the content is displayed on.
  • Display module The display module is the output part of the dual-screen smart terminal. It displays the calculation data of the entire acquisition, judgment, and control module on the screen, so that users can experience visually.
  • FIG. 4 is a flowchart of a method for implementing a mouse and a keyboard function by using a dual-screen intelligent terminal according to an embodiment of the present invention. The specific steps are as follows:
  • Step S101 the smart terminal is connected to a display, as shown in FIG. 5;
  • Judgment C101 Whether the smart terminal has received the information of the external display
  • Step S102.1 If the smart terminal receives the information of the external display, the smart terminal enters the PC mode and inputs the PC mode interface to the display;
  • the PC mode is a mode in which the contents of the terminal are presented on the display in a manner similar to that of a computer after the smart terminal is connected to the display.
  • Judgment C102 Whether the user flips the screen of the mobile phone to 180 °;
  • Step S103.1 If the user flips the screen of the mobile phone to 180 °, as shown in FIG. 6, the first screen of the smart terminal is used as the mouse functional area, and the second screen is used as the keyboard functional area, so that the user can perform operations through the terminal screen.
  • Step S103.2 If the user does not flip the screen of the mobile phone to 180 °, as shown in FIG. 7, the upper half screen of the smart terminal is used as the mouse functional area, and the lower half screen is used as the keyboard functional area, so that the user can operate through the terminal screen;
  • Step S104 The user unfolds the mobile phone to a horizontal 180 °.
  • the mouse displacement description in the embodiment of the present invention the coordinates of the mouse on the PC screen are moved according to the relative displacement corresponding to the touch point of the mobile phone screen.
  • the keyboard description of the embodiment of the present invention according to the click of the virtual keyboard of the mobile phone screen, the corresponding coding of the physical keyboard is sent to the processor, and the display on the display is finally completed.
  • the terminal generates a corresponding operation instruction according to the click and touch operation of the virtual mouse area on the screen, acquires the content to be displayed according to the operation instruction, and transmits the content to be displayed to an external display for display;
  • corresponding input instructions are generated according to the click operation of the virtual keyboard area on the screen, and synchronized to an external display for input display.
  • a use scenario of the embodiment of the present invention includes: a single-screen state is connected to a display to enter a PC mode, a single-screen of a smart terminal is operated as a mouse and a keyboard function, and a display is used as a visual presentation.
  • the first-level dual-screen status is connected to the monitor and enters the PC mode.
  • the two screens of the smart terminal are controlled as mouse and keyboard functions, respectively, and the monitor is visually presented.
  • the display and functions when a foldable dual-screen smart terminal device is connected to a display according to the different states of the dual-screen, the user's needs for mouse and keyboard functions can be solved, allowing the user to bring a Mobile phones can easily work and have a more convenient experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明公开了一种利用智能终端实现鼠标和键盘功能的方法，涉及智能终端技术领域，其方法包括：智能终端通过与外接显示器进行连接，建立与所述外接显示器的通信链路；在建立与所述外接显示器的通信链路后，所述智能终端从当前终端模式转换为电脑模式，并利用所述通信链路将所述电脑模式的显示界面传输给所述外接显示器，同时将屏幕上的显示界面切换成由虚拟鼠标和虚拟键盘组成的输入界面。

Description

一种利用智能终端实现鼠标和键盘功能的方法
本申请要求享有2018年09月03日提交的名称为“一种利用智能终端实现鼠标和键盘功能的方法及装置”的中国专利申请CN201811023042.1的优先权，其全部内容通过引用并入本文中。
技术领域
本发明涉及智能终端技术领域，特别涉及一种利用智能终端实现鼠标和键盘功能的方法。
背景技术
华为和三星都发布了PC模式的手机功能，这一功能给手机的使用带来了一种新的可能，手机直接连接显示器就可以像电脑一样使用。这是一种全新的便携式的使用体验。但是，智能终端连接显示器进入PC模式的使用场景，在普通单屏移动终端中，常规的做法是将手机屏幕替代为鼠标或键盘功能区；另外一种做法是需要外接鼠标和键盘。这两种实现方式都无法解决没有鼠标和键盘硬件设备的问题。现有方法都不能让用户在没有外接设备的情况下同时使用键盘和鼠标。
发明内容
根据本发明实施例提供的方案解决的技术问题是智能终端连接显示器进入电脑模式后，用户在没有外接设备的情况下无法同时使用键盘和鼠标直接操作。
根据本发明实施例提供的一种利用智能终端实现鼠标和键盘功能的方法，包括：
智能终端通过与外接显示器进行连接，建立与所述外接显示器的通信链路；
在建立与所述外接显示器的通信链路后，所述智能终端从当前终端模式转换为电脑模式，并利用所述通信链路将所述电脑模式的显示内容传输给所述外接显示器，同时将屏幕上的显示内容切换成由虚拟鼠标和虚拟键盘组成的输入界面。
根据本发明实施例提供的一种利用智能终端实现鼠标和键盘功能的设备，所述设备包括：处理器，以及与所述处理器耦接的存储器；所述存储器上存储有可在所述处理器 上运行的利用智能终端实现鼠标和键盘功能的程序，所述利用智能终端实现鼠标和键盘功能的程序被所述处理器执行时实现根据本发明实施例提供的所述的利用智能终端实现鼠标和键盘功能的方法的步骤。
根据本发明实施例提供的一种计算机存储介质，存储有利用智能终端实现鼠标和键盘功能的程序，所述利用智能终端实现鼠标和键盘功能的程序被处理器执行时实现根据本发明实施例提供的所述的利用智能终端实现鼠标和键盘功能的方法的步骤。
根据本发明实施例提供的方案，在双屏智能终端硬件的基础上，当用户将双屏智能终端连接显示器，进入PC(电脑)模式后。终端的两个屏幕分别作为鼠标屏和键盘屏起到鼠标和键盘操作的功能。以便用户可以只携带一部手机连接显示器就可以进行便捷办公的目的。
附图说明
图1是本发明实施例提供的一种利用智能终端实现鼠标和键盘功能的方法流程图；
图2是本发明实施例提供的一种利用智能终端实现鼠标和键盘功能的装置示意图；
图3是本发明实施例提供的利用智能终端实现鼠标和键盘功能的系统示意图；
图4是本发明实施例提供的利用双屏智能终端实现鼠标和键盘功能的方法流程图；
图5是本发明实施例提供的智能终端与外接显示器的连接示意图；
图6是本发明实施例提供的双屏状态连接显示器进入PC模式，智能终端两个屏幕分别作为鼠标和键盘功能操控，显示器作为视觉呈现的示意图；
图7是本发明实施例提供的单屏状态连接显示器进入PC模式，智能终端单屏作为鼠标和键盘功能操控，显示器作为视觉呈现的示意图。
具体实施方式
以下结合附图对本发明的优选实施例进行详细说明，应当理解，以下所说明的优选实施例仅用于说明和解释本发明，并不用于限定本发明。
本发明实施例适用在拥有一块或两块屏幕的手机(智能终端)和一台外接显示设备。
图1是本发明实施例提供的一种利用智能终端实现鼠标和键盘功能的方法流程图，如图1所示，该方法可以包括：
步骤S1：智能终端通过与外接显示器进行连接，建立与所述外接显示器的通信链 路；
其中，所述智能终端与所述外接显示器的连接方式包括有线连接方式和无线连接方式。
步骤S2：在建立与所述外接显示器的通信链路后，所述智能终端从当前终端模式转换为电脑模式，并利用所述通信链路将所述电脑模式的显示内容传输给所述外接显示器，同时将屏幕上的显示内容切换成由虚拟鼠标和虚拟键盘组成的输入界面。
在一实施方式中，所述智能终端可以是单屏智能终端。当所述智能终端为单屏智能终端时，在所述单屏智能终端屏幕的上半部分为输入界面的虚拟鼠标；下半部分为输入界面的虚拟键盘；或者在所述单屏智能终端屏幕的上半部分为输入界面的虚拟键盘；下半部分为输入界面的虚拟鼠标。
在另一实施方式中，所述智能终端也可以是双屏智能终端。当所述智能终端为双屏智能终端时，所述将屏幕上的显示内容切换成由虚拟鼠标和虚拟键盘组成的输入界面包括：所述双屏智能终端实时监测两个屏幕是否处于水平状态；若监测两个屏幕处于水平状态，则所述双屏智能终端将所述由虚拟鼠标和虚拟键盘组成的输入界面显示在两个屏幕上；若监测两个屏幕处于非水平状态，则所述双屏智能终端将所述由虚拟鼠标和虚拟键盘组成的输入界面显示在一个屏幕上。具体地说，所述双屏智能终端将所述由虚拟鼠标和虚拟键盘组成的输入界面显示在两个屏幕上包括：所述双屏智能终端将所述输入界面的虚拟鼠标以横向方式显示在一个屏幕上，将所述输入界面的虚拟键盘以横向方式显示在另一个屏幕上。
图2是本发明实施例提供的一种利用智能终端实现鼠标和键盘功能的装置示意图，如图2所示，包括：建立模块201，用于通过与外接显示器进行连接，建立与所述外接显示器的通信链路；处理模块202，用于在建立与所述外接显示器的通信链路后，从当前终端模式转换为电脑模式，并利用所述通信链路将所述电脑模式的显示内容传输给所述外接显示器，同时将屏幕上的显示内容切换成由虚拟鼠标和虚拟键盘组成的输入界面。
在一实施方式中，所述智能终端可以是单屏智能终端。当所述智能终端为单屏智能终端时，在所述单屏智能终端屏幕的上半部分为输入界面的虚拟鼠标；下半部分为输入界面的虚拟键盘；或者在所述单屏智能终端屏幕的上半部分为输入界面的虚拟键盘；下半部分为输入界面的虚拟鼠标。
在一实施方式中，所述处理模块202包括：监测单元，用于当所述智能终端为双屏智能终端时，实时监测两个屏幕是否处于水平状态；处理单元，用于当监测两个屏幕处 于水平状态，则将所述由虚拟鼠标和虚拟键盘组成的输入界面显示在两个屏幕上，以及当监测两个屏幕处于非水平状态，则将所述由虚拟鼠标和虚拟键盘组成的输入界面显示在一个屏幕上。具体地说，所述处理单元具体用于将所述输入界面的虚拟鼠标以横向方式显示在一个屏幕上，将所述输入界面的虚拟键盘以横向方式显示在另一个屏幕上。
本发明实施例提供的一种利用智能终端实现鼠标和键盘功能的设备，所述设备包括：处理器，以及与所述处理器耦接的存储器；所述存储器上存储有可在所述处理器上运行的利用智能终端实现鼠标和键盘功能的程序，所述利用智能终端实现鼠标和键盘功能的程序被所述处理器执行时实现根据本发明实施例提供的所述的利用智能终端实现鼠标和键盘功能的方法的步骤。
本发明实施例提供的一种计算机存储介质，存储有利用智能终端实现鼠标和键盘功能的程序，所述利用智能终端实现鼠标和键盘功能的程序被处理器执行时实现根据本发明实施例提供的所述的利用智能终端实现鼠标和键盘功能的方法的步骤。
本发明实施例基于的硬件是可折叠双屏移动终端，可做正常终端使用，当把一个屏幕翻转时，可将两个屏幕合成一个大屏幕。该大屏幕可以显示更多的信息内容，可以是一个整体内容，也可以是两个屏幕独立的信息显示，但用户可在一个视野中同时阅读两边的内容。
图3是本发明实施例提供的利用智能终端实现鼠标和键盘功能的系统示意图，如图3所示，包括：
1.CPU处理器：实时检测当前是否与外接显示器有数据传输；并根据当前连接状况判断终端界面呈现状态。
2.存储模块：该模块针对当前连接状态以及手机屏幕状态的存储。解决方案包括方案A：未连接外接显示器；方案B：连接外接显示器。手机屏幕状态包括a：两屏幕翻转折叠，两屏幕处于0到179度之间。b：两屏幕处在180度水平面上。
3.获取模块：获取模块是指在双屏智能终端的显示屏侦测程序运行情况、并且当用户进行交互操作时，获取用户手势操作指令，屏幕关系状态。将运行状况及用户参数反馈至判断模块进行分析。
4.判断模块：通过对获取模块所获得的用户操作参数及目前双屏的运行状况，做出判断，首先需判断目前双屏的状态，双屏是处于0°到到179°之间或180°两种状态的哪一种状态。根据屏幕状态、外备连接状况的组合进行存储模块中的解决方案进行比较，将判断得到的结论发送至控制模块。
5.控制模块：控制模块通过获取判断模块的结论，控制显示模块执行具体的界面显示。控制相应内容在哪个屏幕中显示。
6.显示模块：显示模块是双屏智能终端的输出部分，是将整个获取、判断及控制模块的计算数据结果显示到屏幕上，使用户能够在视觉感知体验。
图4是本发明实施例提供的利用双屏智能终端实现鼠标和键盘功能的方法流程图，具体步骤如下：
步骤S101：智能终端连接显示器，如图5所示；
用户进行PC模式操作前提条件需要其启动具体的智能终端，使其在开启的状态下，并且连接显示器进行之后的步骤及判断。
判断C101：智能终端是否接收到外接显示器的信息；
也就是说，智能终端是否识别外接显示器，并且向显示器输出信息。
步骤S102.1：若智能终端接收到外接显示器的信息，则智能终端进入PC模式，向显示器输入PC模式界面；
PC模式是一种智能终端连接显示器后，终端的内容以类似于电脑端的方式呈现在显示器上的模式。
判断C102：用户是否翻转手机的屏幕到180°；
步骤S103.1：若用户翻转手机的屏幕到180°，如图6所示，智能终端第一屏作为鼠标功能区，第二屏横屏作为键盘功能区，以便用户通过终端屏幕可以进行操作。
步骤S103.2：若用户未翻转手机的屏幕到180°，如图7所示，智能终端上半屏作为鼠标功能区，下半屏作为键盘功能区，以便用户通过终端屏幕可以进行操作；
步骤S104:用户展开手机到水平180°.
本发明实施例的鼠标位移说明：根据手机屏幕触摸点的相对位移对应来移动PC屏幕上鼠标的坐标。用户在鼠标功能区域滑动的距离对应显示器鼠标图形移动位置的距离公式为：手机触摸点位移距离*显示器水平像素数/手机横向DP数＝显示器鼠标移动距离。
本发明实施例的键盘说明：根据手机屏幕虚拟的键盘的点击，发送物理键盘的对应编码到处理器，最终完成显示器端的显示。
本发明实施例的终端根据屏幕上虚拟鼠标区域的点击触摸操作，生成对应的操作指令，并根据所述操作指令获取待显示的内容，并将所述待显示的内容传输给外接显示器 进行显示；同时根据屏幕上虚拟键盘区域的点击操作，生成对应的输入指令，并同步到外接显示器上进行输入显示。
本发明实施例的使用场景包括：单屏状态连接显示器进入PC模式，智能终端单屏作为鼠标和键盘功能操控，显示器作为视觉呈现。一级双屏状态连接显示器进入PC模式，智能终端两个屏幕分别作为鼠标和键盘功能操控，显示器作为视觉呈现。
根据本发明实施例提供的方案，在可折叠的双屏智能终端设备连接显示器情况下的显示和功能，根据双屏的不同状态可以解决用户对于鼠标和键盘功能的需求，让用户可以携带一部手机就可以轻松办公，拥有更加便捷的体验。
尽管上文对本发明进行了详细说明，但是本发明不限于此，本技术领域技术人员可以根据本发明的原理进行各种修改。因此，凡按照本发明原理所作的修改，都应当理解为落入本发明的保护范围。

Claims (6)

  1. 一种利用智能终端实现鼠标和键盘功能的方法，其中，包括：
    智能终端通过与外接显示器进行连接，建立与所述外接显示器的通信链路；
    在建立与所述外接显示器的通信链路后，所述智能终端从当前终端模式转换为电脑模式，并利用所述通信链路将所述电脑模式的显示内容传输给所述外接显示器，同时将屏幕上的显示内容切换成由虚拟鼠标和虚拟键盘组成的输入界面。
  2. 根据权利要求1所述的方法，其中，当所述智能终端为单屏智能终端时，在所述单屏智能终端屏幕的上半部分为输入界面的虚拟鼠标；下半部分为输入界面的虚拟键盘；或者在所述单屏智能终端屏幕的上半部分为输入界面的虚拟键盘；下半部分为输入界面的虚拟鼠标。
  3. 根据权利要求1所述的方法，其中，当所述智能终端为双屏智能终端时，所述将屏幕上的显示内容切换成由虚拟鼠标和虚拟键盘组成的输入界面包括：
    所述双屏智能终端实时监测两个屏幕是否处于水平状态；
    若监测两个屏幕处于水平状态，则所述双屏智能终端将所述由虚拟鼠标和虚拟键盘组成的输入界面显示在两个屏幕上；
    若监测两个屏幕处于非水平状态，则所述双屏智能终端将所述由虚拟鼠标和虚拟键盘组成的输入界面显示在一个屏幕上。
  4. 根据权利要求3所述的方法，其中，所述双屏智能终端将所述由虚拟鼠标和虚拟键盘组成的输入界面显示在两个屏幕上包括：
    所述双屏智能终端将所述输入界面的虚拟鼠标以横向方式显示在一个屏幕上，将所述输入界面的虚拟键盘以横向方式显示在另一个屏幕上。
  5. 一种利用智能终端实现鼠标和键盘功能的设备，其中，所述设备包括：处理器，以及与所述处理器耦接的存储器；所述存储器上存储有可在所述处理器上运行的利用智能终端实现鼠标和键盘功能的程序，所述利用智能终端实现鼠标和键盘功能的程序被所述处理器执行时实现如权利要求1至4中任一项所述的利用智能终端实现鼠标和键盘功能的方法的步骤。
  6. 一种计算机存储介质，其中，所述计算机存储介质存储有利用智能终端实现鼠标和键盘功能的程序，所述利用智能终端实现鼠标和键盘功能的程序被处理器执行时实现如权利要求1至4中任一项所述的利用智能终端实现鼠标和键盘功能的方法的步骤。
PCT/CN2019/099562 2018-09-03 2019-08-07 一种利用智能终端实现鼠标和键盘功能的方法 WO2020048282A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811023042.1 2018-09-03
CN201811023042.1A CN110874180A (zh) 2018-09-03 2018-09-03 一种利用智能终端实现鼠标和键盘功能的方法及装置

Publications (1)

Publication Number Publication Date
WO2020048282A1 true WO2020048282A1 (zh) 2020-03-12

Family

ID=69716908

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/099562 WO2020048282A1 (zh) 2018-09-03 2019-08-07 一种利用智能终端实现鼠标和键盘功能的方法

Country Status (2)

Country Link
CN (1) CN110874180A (zh)
WO (1) WO2020048282A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20230008954A (ko) 2021-07-07 2023-01-17 삼성디스플레이 주식회사 표시 장치 및 복수의 표시 장치들의 제어 방법
CN114115552A (zh) * 2021-10-29 2022-03-01 珠海读书郎软件科技有限公司 一种适用于双屏电话手表的虚拟键盘输入方法
CN117590996A (zh) * 2023-12-08 2024-02-23 广州文石信息科技有限公司 计算机和触摸屏设备的交互方法、电子设备以及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103345312A (zh) * 2013-07-03 2013-10-09 张帆 以智能终端同时作为主机、鼠标和触摸板的系统及方法
CN105812565A (zh) * 2016-03-15 2016-07-27 杜采桑 一种智能手机外接显示器的自适应桌面管理系统及方法
KR20170045528A (ko) * 2015-10-19 2017-04-27 (주)멀티미디어링크 멀티미디어 미러링 기능을 갖는 모니터 시스템

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8648825B2 (en) * 2010-10-01 2014-02-11 Z124 Off-screen gesture dismissable keyboard
CN101877178A (zh) * 2009-04-30 2010-11-03 上海易狄欧电子科技有限公司 电子书阅读系统及电子书阅读器互联和输入方法
CN203241885U (zh) * 2013-05-20 2013-10-16 汤中亮 一种双屏笔记本电脑
CN107704186B (zh) * 2017-09-01 2022-01-18 联想(北京)有限公司 一种控制方法及电子设备
CN107741760A (zh) * 2017-10-18 2018-02-27 上海龙旗科技股份有限公司 双屏笔记本及双屏显示方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103345312A (zh) * 2013-07-03 2013-10-09 张帆 以智能终端同时作为主机、鼠标和触摸板的系统及方法
KR20170045528A (ko) * 2015-10-19 2017-04-27 (주)멀티미디어링크 멀티미디어 미러링 기능을 갖는 모니터 시스템
CN105812565A (zh) * 2016-03-15 2016-07-27 杜采桑 一种智能手机外接显示器的自适应桌面管理系统及方法

Also Published As

Publication number Publication date
CN110874180A (zh) 2020-03-10

Similar Documents

Publication Publication Date Title
US11513618B2 (en) All-in-one machine and method and computer memory medium for realizing quick touch in all channels thereof
WO2020048282A1 (zh) 一种利用智能终端实现鼠标和键盘功能的方法
CN104166531B (zh) 电子装置及屏幕内容分享方法
KR101493603B1 (ko) 외부 표시 장치와 접속가능한 표시 단말 장치 및 방법
WO2021012931A1 (zh) 图标管理方法及终端
US8687019B2 (en) Composite multi-image display device, composite multi-image information processing device, composite multi-image display system, composite multi-image display method, and composite multi-image formation processing method
TWI398775B (zh) 具雙螢幕之多電腦管理設備及其操作方法
WO2016023455A1 (zh) 双面双屏智能移动终端
KR20130111600A (ko) 모바일 디바이스와 함께 외부 디스플레이의 사용을 구성하기 위한 방법 및 시스템
WO2015074619A1 (zh) 一种结合使用终端的方法、终端及通讯系统
WO2021213379A1 (zh) 投屏显示方法、系统、终端设备和存储介质
WO2019218862A1 (zh) 屏幕操作方法及移动终端
US10402148B2 (en) Multi-display control apparatus, systems, and methods
CN103345312A (zh) 以智能终端同时作为主机、鼠标和触摸板的系统及方法
WO2020001604A1 (zh) 显示方法及终端设备
WO2019228296A1 (zh) 显示处理方法及终端设备
JP2013145557A (ja) 携帯式電子装置に用いられるインスタントメッセージング方法及びそのシステム
WO2020078234A1 (zh) 显示控制方法及终端
WO2014036974A1 (zh) 一种终端设备、同屏显示方法和系统
CN109451141A (zh) 一种操作控制方法及相关终端
WO2020042921A1 (zh) 屏幕控制方法及电子设备
US11112880B1 (en) Selectively controlling a monitor's on-screen display with a keyboard or mouse
WO2016019695A1 (zh) 语音互动的方法及终端
TWI575382B (zh) 子母畫面演示方法及系統
WO2016131181A1 (zh) 一种指纹事件的处理方法、装置及终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19858530

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 080721)

122 Ep: pct application non-entry in european phase

Ref document number: 19858530

Country of ref document: EP

Kind code of ref document: A1