CN112231017A - Virtual keyboard and mouse method and device for compatible operation of Android operating system on Linux - Google Patents

Virtual keyboard and mouse method and device for compatible operation of Android operating system on Linux Download PDF

Info

Publication number
CN112231017A
CN112231017A CN202011167162.6A CN202011167162A CN112231017A CN 112231017 A CN112231017 A CN 112231017A CN 202011167162 A CN202011167162 A CN 202011167162A CN 112231017 A CN112231017 A CN 112231017A
Authority
CN
China
Prior art keywords
mouse
keyboard
android
linux
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011167162.6A
Other languages
Chinese (zh)
Other versions
CN112231017B (en
Inventor
姚宏亮
周剑
张耀斌
邱旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jide System Technology Co ltd
Original Assignee
Beijing Jide System Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jide System Technology Co ltd filed Critical Beijing Jide System Technology Co ltd
Priority to CN202011167162.6A priority Critical patent/CN112231017B/en
Publication of CN112231017A publication Critical patent/CN112231017A/en
Application granted granted Critical
Publication of CN112231017B publication Critical patent/CN112231017B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44505Configuring for program initiating, e.g. using registry, configuration files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a virtual keyboard and mouse method and device for compatibly running an Android operating system on Linux, and belongs to the technical field of computers. The method comprises the following steps: defining a corresponding mode of user keyboard and mouse operation and Android application touch screen operation, and formulating a coding protocol according to the corresponding mode; establishing a communication interface between Linux and an Android HAL; the method comprises the steps of obtaining data of user keyboard and mouse operation on a Linux side, coding the data according to a coding protocol, sending the coded data to an Android side for decoding, sending the decoded data to an Android HAL, and enabling the Android HAL to call a Framework Event to enable an Android application to make a corresponding response. According to the invention, the Android application which is compatible to run on the Linux operating system can support the mouse operation and the mouse and keyboard combined operation, so that the touch operation can be completely replaced by the mouse operation and the mouse and keyboard combined operation, the replacement mode is flexible, and a user can obtain good operation experience.

Description

Virtual keyboard and mouse method and device for compatible operation of Android operating system on Linux
Technical Field
The invention relates to the technical field of computers, in particular to a virtual keyboard and mouse method and device for compatibly running an Android operating system on Linux.
Background
With the termination of the service of Windows7, the Linux desktop system is more popular, and how to make the Android application run on the Linux operating system in a compatible manner, so that many applications only with a mobile phone version can run in the Linux desktop system, is a problem to be solved urgently.
However, as is well known, Android is a mobile operating system and is created for mobile touch screen devices, and therefore, the Android system has limited support for a mouse. When the Android application is compatibly operated on Linux, the Android application cannot normally operate because a hardware carrier (a desktop computer or a notebook computer) of a Linux system cannot support a touch mode and an operation mode is a mouse and a keyboard. The method needs to be provided, so that the Android application on the Linux can support corresponding operations of matching a mouse and a mouse keyboard, and the mouse and keyboard operations supported by a hardware carrier of the Linux system can completely realize the operation interaction of the Android application running on the Linux operating system.
Disclosure of Invention
In view of this, the invention provides a virtual keyboard and mouse method and device for compatibly running an Android operating system on Linux, and mainly aims to solve the problem that in the prior art, for an Android running environment compatibly running on the Linux system, Android applications cannot run normally because a hardware carrier of the Linux system cannot support a touch mode, so that the mouse operation and the mouse and keyboard cooperation operation supported by the hardware carrier of the Linux system can completely realize the operation interaction of the Android applications running on the Linux operating system.
According to one aspect of the invention, a virtual keyboard and mouse method for compatibly running an Android operating system on Linux is provided, and the method comprises the following steps:
s1, a coding protocol making step, which is to define a corresponding mode of user mouse and keyboard operations and Android application touch screen operations, wherein the user mouse and keyboard operations comprise mouse operations and mouse and keyboard combined operations, and a coding protocol is made according to the corresponding mode;
s2, establishing a communication step, namely establishing a Socket communication interface between the Linux side and the Android side;
s3 key and mouse event coding and transmitting step, acquiring the data of the key and mouse operation of the user from the display _ window at the Linux side, coding the data of the key and mouse operation of the user according to the coding protocol to generate first key and mouse data, and sending the first key and mouse data to the Android side;
s4, performing keyboard and mouse Event decoding transmission, namely decoding the first keyboard and mouse data on the Android side according to the coding protocol to generate second keyboard and mouse data, and sending the second keyboard and mouse data to a hardware abstraction layer of the Android operating system, wherein the hardware abstraction layer calls a Framework Event of the Android operating system to enable the Android application to make a response corresponding to the second keyboard and mouse data.
As a further improvement of the present invention, the corresponding manner of the user keyboard and mouse operation and the Android application touch screen operation includes: and the mouse and keyboard combined operation of the keyboard and mouse operation corresponds to the multi-point touch operation of the Android application touch screen.
As a further improvement of the present invention, the corresponding manner of the user keyboard and mouse operation and the Android application touch screen operation includes: the left click of the mouse of the user corresponds to the click of the touch screen of the Android application, the right click of the mouse of the user corresponds to the long-press popup menu of the Android application, and the sliding of the roller of the mouse of the user corresponds to the finger sliding of the touch screen of the Android application.
According to another aspect of the invention, a virtual keyboard and mouse device compatible with an Android operating system running on Linux is provided, and the device comprises:
the system comprises a coding protocol module, a keyboard and mouse module and a keyboard module, wherein the coding protocol module defines a corresponding mode of user keyboard and mouse operation and Android application touch screen operation, the user keyboard and mouse operation comprises mouse operation and mouse and keyboard combined operation, and a coding protocol is formulated according to the corresponding mode;
the keyboard and mouse event management module is used for establishing a Socket communication interface between a Linux side and an Android side; the keyboard and mouse event management module comprises: the Linux side keyboard and mouse event management module is used for acquiring the data of the keyboard and mouse operation of the user from the Linux side display _ window, coding the data of the keyboard and mouse operation of the user according to the coding protocol to generate first keyboard and mouse data, and sending the first keyboard and mouse data to the Android side keyboard and mouse event management module; and the Android side keyboard and mouse Event management module is used for decoding the first keyboard and mouse data to generate second keyboard and mouse data, and sending the second keyboard and mouse data to a hardware abstraction layer of an Android operating system, wherein the hardware abstraction layer calls a Framework Event of the Android operating system to enable the Android application to make a response corresponding to the second keyboard and mouse data.
As a further improvement of the present invention, the corresponding manner of the user keyboard and mouse operation and the Android application touch screen operation includes: and the mouse and keyboard combined operation of the keyboard and mouse operation corresponds to the multi-point touch operation of the Android application touch screen.
As a further improvement of the present invention, the corresponding manner of the user keyboard and mouse operation and the Android application touch screen operation includes: the left click of the mouse of the user corresponds to the click of the touch screen of the Android application, the right click of the mouse of the user corresponds to the long-press popup menu of the Android application, and the sliding of the roller of the mouse of the user corresponds to the finger sliding of the touch screen of the Android application.
The invention has the beneficial effects that:
(1) the Android application which is compatible to run on the Linux operating system can support mouse operation and mouse and keyboard cooperation operation, and complete replacement of touch operation by mouse operation and mouse and keyboard combination operation is realized.
(2) The substitution mode of the mouse operation and the combined operation of the mouse and the keyboard on the touch operation is flexible, and a user can set according to the operation habit of the user, so that the user can obtain good operation experience.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 shows an implementation schematic diagram of a virtual keyboard and mouse method for compatibly running an Android operating system on Linux according to an embodiment of the present invention;
fig. 2 shows a flowchart of implementing a virtual mouse operation in a virtual mouse method for compatibly running an Android operating system on Linux according to an embodiment of the present invention;
fig. 3 shows a flowchart for implementing the virtual mouse and keyboard combined operation in the virtual mouse and keyboard method for compatibly running the Android operating system on Linux according to the embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
First, partial terms or terms appearing in the description of the embodiments of the present invention are applied to the following explanations:
HAL: HAL is an abbreviation of Hardware Abstraction Layer Hardware Abstraction Layer, is a set of dynamic libraries built on Linux driver and has a standard calling interface. The set of dynamic libraries does not belong to the Linux kernel, but belongs to a system operation library layer above the Linux kernel layer. As the HAL has a standard hardware calling interface, the complicated and non-uniform interface of the Linux drive can be shielded.
The container technology comprises the following steps: the container effectively partitions resources managed by a single operating system into isolated groups to better balance conflicting resource usage requirements among the isolated groups.
JStack: the Android operating environment comprises a container.
Socket: the network programming interface is a protocol-independent network programming interface, shields the difference between the bottom layer communication software and a specific operating system, and realizes the communication between the computer which installs the TCP protocol software and realizes the socket specification.
Android Framework Event: an android event processing framework.
The core technical problem to be solved by the invention is that when the Android runs on the Linux operating system in a compatible layer manner, the Android application cannot run normally because a hardware carrier of the Linux system cannot support a touch manner. In order to solve the technical problems, the invention provides a virtual mouse method and a virtual mouse device for compatibly operating an Android operating system on Linux.
Example 1
Fig. 1 is a schematic diagram of an implementation of a virtual keyboard and mouse method for compatibly running an Android operating system on Linux according to an embodiment of the present invention, and it can be seen from the diagram that the method according to the embodiment includes the following steps:
s1: and a coding protocol establishing step, defining a corresponding mode of user mouse and key operation and Android application touch screen operation, wherein the user mouse and key operation comprises mouse operation and mouse and keyboard combined operation, and establishing a coding protocol according to the corresponding mode.
For example, the left mouse button is defined to correspond to a finger click, the right mouse button is defined to correspond to a long press, the left mouse button + the keyboard corresponds to a multi-finger touch operation, the left mouse button + the key value + the mouse wheel operation/the mouse movement operation corresponds to an enlargement and reduction effect, and the like, and the method can be flexibly defined according to the operation habits of users.
S2: establishing a communication step, namely establishing a Socket communication interface between a Linux side and an Android side;
for compatibly running the Android running environment on the Linux operating system, the Android running environment is run in a container. Starting an Android running environment through a container technology on the existing Linux operating system, marking the Android running environment as JStack, and running the Android application frame and the Android running environment as a system process of Linux in the JStack.
A virtual keyboard and mouse Event management module is realized in JStack and the Android side, the part of the module realized in JStack is called a Linux side keyboard and mouse Event management module Event Manager, and the part of the module realized on the Android side is called an Android side keyboard and mouse Event management module Android Event Manager. The virtual keyboard and mouse event management module establishes a socket process for communication management of Linux and Android HAL.
S3: a keyboard and mouse event code transmission step, namely acquiring data of keyboard and mouse operation of a user from a display _ window at a Linux side, coding the data of the keyboard and mouse operation of the user according to a coding protocol to generate first keyboard and mouse data, and sending the first keyboard and mouse data to an Android side;
the display _ window of the Linux end is a program for displaying application pages, and each application corresponds to one display _ window program. The program can also capture mouse events and keyboard key information, the mouse operation events comprise mouse coordinate information, mouse pressing, mouse releasing, mouse up roller, mouse down roller and the like, and the mouse and keyboard combined operation events comprise mouse coordinate information, events that a keyboard and a mouse key are pressed down simultaneously and the like. The Linux side keyboard and mouse Event management module Event Manager encodes the captured Linux mouse operation and mouse and keyboard combined operation Event information by using a coding protocol to generate first keyboard and mouse data, and transmits the first keyboard and mouse data to the Android side keyboard and mouse Event management module Android Event Manager through the Socket communication connection established in the step S2.
S4: and a keyboard and mouse Event decoding transmission step, namely decoding the first keyboard and mouse data at the Android side according to the coding protocol to generate second keyboard and mouse data, sending the second keyboard and mouse data to a hardware abstraction layer of the Android operating system, and calling a Framework Event of the Android operating system by the hardware abstraction layer to enable the Android application to make a response corresponding to the second keyboard and mouse data.
The virtual keyboard and mouse method for compatibly running the Android operating system on Linux provided by the embodiment of the invention is described below by combining two application scenes.
The application scene one: mouse base events.
FIG. 2 shows a flow diagram of a virtual mouse implementation;
(1) the virtual keyboard and mouse event management module establishes a socket process for communication management of Linux and Android HAL;
(2) the Linux side keyboard and mouse Event management module Event Manager acquires the captured mouse Event containing the coordinate information from the display _ window of the Linux;
(3) the Linux-side keyboard and mouse Event management module Event Manager encodes the obtained Linux mouse Event information by using a coding protocol, and then transmits the Linux mouse Event information to the Android-side keyboard and mouse Event management module Android Event Manager through a socket;
(4) the Android side key mouse Event management module Android Event Manager acquires the transmitted mouse coding Event, decodes the mouse coding Event and transmits the decoded mouse coding Event to an EventHub corresponding to a HAL (half-shell) for processing the mouse input Event at an Android end;
(5) continuously circulating the processes from (2) to (4) so as to obtain continuous mouse events;
(6) the Android HAL transfers the relevant events to the Framework, realizes the corresponding response to the mouse Event in the Framework Event of the Framework, and finally makes the Android application program make corresponding reactions, for example: the left button of the mouse is clicked to realize the click response effect of touch, the right button of the mouse is clicked to realize the menu response effect of long press, and the roller of the mouse slides to realize the response effect of finger sliding.
Application scenario two: mouse plus keyboard mix events.
FIG. 3 shows a flow diagram of a virtual mouse keyboard hybrid implementation.
(1) The virtual keyboard and mouse event management module establishes a socket process for communication management of Linux and Android HAL;
(2) the method comprises the steps that a Linux side keyboard Event management module Event Manager acquires a mouse Event which is captured by the Linux side keyboard Event management module and contains coordinate information and key information of a keyboard from display _ window of Linux; while by predefining one or more key values, for example: a left Ctrl, filtering the captured key values;
(3) when the keyboard and the left mouse key are simultaneously pressed, the Linux side keyboard and mouse Event management module Event Manager encodes an input mouse and keyboard combined Event by using a coding protocol, and then transmits the encoded input mouse and keyboard combined Event to the Android side keyboard and mouse Event management module Android Event Manager through a socket;
(4) the Android side keyboard and mouse Event management module Android Event Manager acquires the transmitted mouse and keyboard joint coding Event, decodes the mouse and keyboard joint coding Event and transmits the decoded mouse and keyboard joint coding Event to an HAL corresponding interface Event Hub of the Android terminal for processing the keyboard and mouse input Event;
(5) response to a mouse and keyboard combined Event is realized in an Event Hub, for example, after the Event transmitted simultaneously is found to be an Event that a keyboard and a left mouse button are pressed simultaneously, the Event is converted into a corresponding double-finger or multi-finger operation Event in the Event of Framework, and Android application starts to respond;
(6) and continuously polling to obtain the moving position of a mouse pointer or the upward and downward rolling position of a roller, continuously transmitting the position to a corresponding interface of the Android Framework, and respectively carrying out response operation. For example: judging whether the right movement of the mouse or the upward roller is the double-finger separation into the amplification effect and the left movement is the double-finger closing or the downward roller is the reduction effect in the Framework, thereby realizing the response of the application to the double-finger operation; the multi-finger operation effect of various touch screens can be realized.
(7) And when a mouse left button release event is captured, terminating the response of the double-finger zooming event.
Example two
Further, as an implementation of the method shown in the above embodiment, another embodiment of the present invention further provides a virtual keyboard and mouse device compatible with the Android operating system running on Linux. The embodiment of the apparatus corresponds to the embodiment of the method, and for convenience of reading, details in the embodiment of the apparatus are not repeated one by one, but it should be clear that the apparatus in the embodiment can correspondingly implement all the contents in the embodiment of the method. In the apparatus of this embodiment, there are the following modules:
firstly, the method comprises the following steps: and the coding protocol module defines a corresponding mode of the user keyboard and mouse operation and the Android application touch screen operation, the user keyboard and mouse operation comprises mouse operation and mouse and keyboard combined operation, and a coding protocol is formulated according to the corresponding mode. This module corresponds to the step of S1 in the first embodiment for formulating the encoding protocol.
II, secondly: the keyboard and mouse event management module establishes a Socket communication interface between the Linux side and the Android side, and establishes a communication step corresponding to S2 in the first embodiment. The keyboard and mouse event management module comprises:
the Linux side keyboard and mouse event management module is used for acquiring data of the keyboard and mouse operation of the user from the Linux side display _ window, coding the data of the keyboard and mouse operation of the user according to a coding protocol to generate first keyboard and mouse data, and sending the first keyboard and mouse data to the Android side keyboard and mouse event management module. This module corresponds to the step of transmitting the S3 keystroke event code in the first embodiment.
And the Android side keyboard and mouse Event management module decodes the first keyboard and mouse data to generate second keyboard and mouse data, and sends the second keyboard and mouse data to a hardware abstraction layer of the Android operating system, and the hardware abstraction layer calls a Framework Event of the Android operating system to enable the Android application to make a response corresponding to the second keyboard and mouse data. This module corresponds to the step of decoding and transmitting the S4 keystroke event in the first embodiment.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments of the apparatus.
It will be appreciated that the relevant features of the above methods and systems may be referred to one another. In addition, "first", "second", and the like in the above embodiments are for distinguishing the embodiments, and do not represent merits of the embodiments.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the invention and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Claims (6)

1. A virtual keyboard and mouse method compatible with an Android operating system on Linux is characterized by comprising the following steps:
s1, a coding protocol making step, which is to define a corresponding mode of user mouse and keyboard operations and Android application touch screen operations, wherein the user mouse and keyboard operations comprise mouse operations and mouse and keyboard combined operations, and a coding protocol is made according to the corresponding mode;
s2, establishing a communication step, namely establishing a Socket communication interface between the Linux side and the Android side;
s3 key and mouse event coding and transmitting step, acquiring the data of the key and mouse operation of the user from the display _ window at the Linux side, coding the data of the key and mouse operation of the user according to the coding protocol to generate first key and mouse data, and sending the first key and mouse data to the Android side;
s4, performing keyboard and mouse event decoding transmission, namely decoding the first keyboard and mouse data on the Android side according to the coding protocol to generate second keyboard and mouse data, and sending the second keyboard and mouse data to a hardware abstraction layer of the Android operating system, wherein the hardware abstraction layer calls FrameworkEvent of the Android operating system to enable the Android application to make a response corresponding to the second keyboard and mouse data.
2. The method for compatibly operating the virtual keyboard and mouse of the Android operating system on Linux according to claim 1, wherein the corresponding manner of the user keyboard and mouse operation and the Android application touch screen operation comprises: and the mouse and keyboard combined operation of the keyboard and mouse operation corresponds to the multi-point touch operation of the Android application touch screen.
3. The method for compatibly operating the virtual keyboard and mouse of the Android operating system on Linux according to claim 1 or 2, wherein the corresponding manner of the user keyboard and mouse operation and the Android application touch screen operation comprises: the left click of the mouse of the user corresponds to the click of the touch screen of the Android application, the right click of the mouse of the user corresponds to the long-press popup menu of the Android application, and the sliding of the roller of the mouse of the user corresponds to the finger sliding of the touch screen of the Android application.
4. A virtual keyboard and mouse device compatible with an Android operating system running on Linux comprises:
the system comprises a coding protocol module, a keyboard and mouse module and a keyboard module, wherein the coding protocol module defines a corresponding mode of user keyboard and mouse operation and Android application touch screen operation, the user keyboard and mouse operation comprises mouse operation and mouse and keyboard combined operation, and a coding protocol is formulated according to the corresponding mode;
the keyboard and mouse event management module is used for establishing a Socket communication interface between a Linux side and an Android side; the keyboard and mouse event management module comprises:
the Linux side keyboard and mouse event management module is used for acquiring the data of the keyboard and mouse operation of the user from the Linux side display _ window, coding the data of the keyboard and mouse operation of the user according to the coding protocol to generate first keyboard and mouse data, and sending the first keyboard and mouse data to the Android side keyboard and mouse event management module;
the Android side keyboard and mouse Event management module decodes the first keyboard and mouse data to generate second keyboard and mouse data, the second keyboard and mouse data are sent to a hardware abstraction layer of an Android operating system, and the hardware abstraction layer calls a Framework Event of the Android operating system to enable the Android application to make a response corresponding to the second keyboard and mouse data.
5. The Linux virtual keyboard and mouse device for compatibly running the Android operating system on Linux according to claim 4, wherein the user keyboard and mouse operation corresponds to an Android application touch screen operation mode and comprises: and the mouse and keyboard combined operation of the keyboard and mouse operation corresponds to the multi-point touch operation of the Android application touch screen.
6. The Linux virtual keyboard and mouse device compatible with running an Android operating system according to claim 4 or 5, wherein the user keyboard and mouse operation corresponds to an Android application touch screen operation mode and comprises the following steps: the left click of the mouse of the user corresponds to the click of the touch screen of the Android application, the right click of the mouse of the user corresponds to the long-press popup menu of the Android application, and the sliding of the roller of the mouse of the user corresponds to the finger sliding of the touch screen of the Android application.
CN202011167162.6A 2020-10-27 2020-10-27 Virtual keyboard and mouse method and device compatible with Android running environment running on Linux Active CN112231017B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011167162.6A CN112231017B (en) 2020-10-27 2020-10-27 Virtual keyboard and mouse method and device compatible with Android running environment running on Linux

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011167162.6A CN112231017B (en) 2020-10-27 2020-10-27 Virtual keyboard and mouse method and device compatible with Android running environment running on Linux

Publications (2)

Publication Number Publication Date
CN112231017A true CN112231017A (en) 2021-01-15
CN112231017B CN112231017B (en) 2021-06-22

Family

ID=74110451

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011167162.6A Active CN112231017B (en) 2020-10-27 2020-10-27 Virtual keyboard and mouse method and device compatible with Android running environment running on Linux

Country Status (1)

Country Link
CN (1) CN112231017B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113157464A (en) * 2021-04-27 2021-07-23 麒麟软件有限公司 Method for sharing Linux end input event to Android
CN113655940A (en) * 2021-08-24 2021-11-16 深圳技德应用技术有限公司 Linux-compatible Android-compatible simulated double-finger scaling method and device
CN113672407A (en) * 2021-08-24 2021-11-19 深圳技德终端技术有限公司 Linux-compatible Android keyboard input control method and device
CN113992730A (en) * 2021-10-27 2022-01-28 哈尔滨工业大学 Knowledge-based user behavior simulation method, simulation system, customization system, computer and storage medium
CN114077462A (en) * 2021-04-07 2022-02-22 北京鲸鲮信息系统技术有限公司 Method, device, equipment and medium for calling Android HIDL interface by software operating system

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102364434A (en) * 2011-06-24 2012-02-29 浙大网新科技股份有限公司 Method for integrating Wine and Android mouse input
CN103324348A (en) * 2013-06-28 2013-09-25 华南理工大学 Windows desktop control method based on intelligent mobile terminals
CN103440131A (en) * 2013-08-30 2013-12-11 四川九洲电器集团有限责任公司 Mobile terminal touch screen view layout adjustment method based on Android system
CN105430468A (en) * 2015-11-30 2016-03-23 北京奇艺世纪科技有限公司 Remote control method and device for television set-top box
CN107297073A (en) * 2017-06-15 2017-10-27 广州华多网络科技有限公司 Analogy method, device and the electronic equipment of peripheral hardware input signal
CN107463402A (en) * 2017-07-31 2017-12-12 腾讯科技(深圳)有限公司 The operation method and device of virtual opetrating system
CN108021425A (en) * 2017-12-28 2018-05-11 南开大学 A kind of virtual desktop system and operation method for integrating multiple Graphics Application windows
CN108762815A (en) * 2018-05-16 2018-11-06 北京麟卓信息科技有限公司 A kind of Android running environment implementation methods based on non-virtualized architectural framework
CN109117351A (en) * 2018-09-27 2019-01-01 四川长虹电器股份有限公司 A kind of front end displaying implementation method of Docker container cloud host and Dashboard
CN109669782A (en) * 2017-10-13 2019-04-23 阿里巴巴集团控股有限公司 Hardware abstraction layer multiplexing method, device, operating system and equipment
US10671235B2 (en) * 2015-03-03 2020-06-02 Soroco Private Limited Software robots for programmatically controlling computer programs to perform tasks

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102364434A (en) * 2011-06-24 2012-02-29 浙大网新科技股份有限公司 Method for integrating Wine and Android mouse input
CN103324348A (en) * 2013-06-28 2013-09-25 华南理工大学 Windows desktop control method based on intelligent mobile terminals
CN103440131A (en) * 2013-08-30 2013-12-11 四川九洲电器集团有限责任公司 Mobile terminal touch screen view layout adjustment method based on Android system
US10671235B2 (en) * 2015-03-03 2020-06-02 Soroco Private Limited Software robots for programmatically controlling computer programs to perform tasks
CN105430468A (en) * 2015-11-30 2016-03-23 北京奇艺世纪科技有限公司 Remote control method and device for television set-top box
CN107297073A (en) * 2017-06-15 2017-10-27 广州华多网络科技有限公司 Analogy method, device and the electronic equipment of peripheral hardware input signal
CN107463402A (en) * 2017-07-31 2017-12-12 腾讯科技(深圳)有限公司 The operation method and device of virtual opetrating system
CN109669782A (en) * 2017-10-13 2019-04-23 阿里巴巴集团控股有限公司 Hardware abstraction layer multiplexing method, device, operating system and equipment
CN108021425A (en) * 2017-12-28 2018-05-11 南开大学 A kind of virtual desktop system and operation method for integrating multiple Graphics Application windows
CN108762815A (en) * 2018-05-16 2018-11-06 北京麟卓信息科技有限公司 A kind of Android running environment implementation methods based on non-virtualized architectural framework
CN109117351A (en) * 2018-09-27 2019-01-01 四川长虹电器股份有限公司 A kind of front end displaying implementation method of Docker container cloud host and Dashboard

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114077462A (en) * 2021-04-07 2022-02-22 北京鲸鲮信息系统技术有限公司 Method, device, equipment and medium for calling Android HIDL interface by software operating system
CN113157464A (en) * 2021-04-27 2021-07-23 麒麟软件有限公司 Method for sharing Linux end input event to Android
CN113655940A (en) * 2021-08-24 2021-11-16 深圳技德应用技术有限公司 Linux-compatible Android-compatible simulated double-finger scaling method and device
CN113672407A (en) * 2021-08-24 2021-11-19 深圳技德终端技术有限公司 Linux-compatible Android keyboard input control method and device
CN113992730A (en) * 2021-10-27 2022-01-28 哈尔滨工业大学 Knowledge-based user behavior simulation method, simulation system, customization system, computer and storage medium

Also Published As

Publication number Publication date
CN112231017B (en) 2021-06-22

Similar Documents

Publication Publication Date Title
CN112231017B (en) Virtual keyboard and mouse method and device compatible with Android running environment running on Linux
CN109618177B (en) Video processing method and device, electronic equipment and computer readable storage medium
CN110888615B (en) Multi-input equipment interaction method, device and medium for double-screen different display of Android system
EP2680123A2 (en) Method and Device of Task Processing of One Screen and Multi-Foreground
CN104618793A (en) Information processing method and electronic equipment
CN105409160A (en) System for remotely controlling electronic device and method of operating the same
EP3242197B1 (en) Desktop sharing method and mobile terminal
CN111078104B (en) Redirection method of multi-point touch equipment on cloud desktop and computer equipment
CN112988419A (en) Method for sharing Linux input method to Android
CN103514219A (en) Method and system for sharing Web content between multiple terminals
CN104980801A (en) Method and device for processing audio data/video data
CN112274910A (en) Virtual key configuration method, virtual key method and related device
CN102438029B (en) Control method and system for realizing remote interaction of Android cell phones
CN111324398B (en) Method, device, terminal and storage medium for processing latest content
CN105049900A (en) Method and system for controlling smart television terminal, and smart television terminal
CN102272719B (en) Comprise providing and carry out the terminal of the graphic interface communicated and the system of server via Image Sharing agreement
CN112584229A (en) Method for switching channels of display equipment and display equipment
CN110231922B (en) Mobile terminal display control method and mobile terminal
KR100784263B1 (en) Method and apparatus for message sending using clip-board
CN112926420B (en) Display device and menu character recognition method
CN104936009A (en) Information transmission method and wireless display system
CN112584197B (en) Method and device for drawing interactive drama story line, computer medium and electronic equipment
JP2001197461A (en) Sharing operation method for multimedia information operation window
CN113419650A (en) Data moving method and device, storage medium and electronic equipment
CN111859999A (en) Message translation method, device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant