WO2020000815A1

WO2020000815A1 - Touch screen drive-based input device, operation method and system, and storage medium

Info

Publication number: WO2020000815A1
Application number: PCT/CN2018/111882
Authority: WO
Inventors: 王荣峰; 马尧
Original assignee: 广州小鸡快跑网络科技有限公司
Priority date: 2018-06-26
Filing date: 2018-10-25
Publication date: 2020-01-02
Also published as: CN109189254B; CN109189254A

Abstract

A touch screen drive-based input device, an operation method, a system, and a storage medium. The input device comprises a central processing unit, a power supply unit, an input unit and an output unit. The central processing unit is connected to the power supply unit, the input unit and the output unit. According to an input signal of the input unit, the central processing unit can find, by matching, the X and Y coordinates and an action that correspond to the input signal, convert the X and Y coordinates and the action into touch screen instructions which can be identified by a touch screen drive, and then output the touch screen instructions to a host of a smart device by means of the output unit, so as to convert the touch screen instructions, by means of the host of the smart device and according to a system drive, into the corresponding system layer touch screen action, and embody same in an application layer. Said device can realize the control of the touch screen of the smart device by means of an external input device.

Description

Input device based on touch screen driver, operation method, system and storage medium

Technical field

The present invention relates to the field of smart device manipulation, and in particular, to an input device based on a touch screen drive, an operation method, a system, and a storage medium.

Background technique

Touch screen operation is a very common input method. Using touch screen can complete direct and flexible interaction between people and devices, especially in the field of mobile devices, such as mobile phones and tablet computers. The wide application of touch screen operation makes the adaptation of content operation mainly based on touch screen, so content developers ignore the access to external devices for manipulation, but in many cases, it is necessary to access external devices. .

At present, most of the content (APP or games) cannot be directly operated through external devices without targeted access to external devices (such as keyboards, mice, gamepads, etc.), that is, the exchange of these contents must be completed. To operate, you still need to touch the screen directly with your finger on the screen. If the content is to be operable with peripherals, it can be accessed through targeted access, such as the standard HID protocol of the access device, a dedicated SDK, and the SDK being cracked and repackaged. However, standard HID protocols and dedicated SDKs require active access by content developers, and the process is cumbersome; the way of cracking may affect the integrity of the application and there are uncertain risks (such as subsequent upgrades, legal risks, official support, etc.).

Summary of the invention

In order to overcome the shortcomings of the prior art, one of the objectives of the present invention is to provide an input device based on a touch screen drive, which can implement touch screen manipulation of a smart device through an external input device.

Another object of the present invention is to provide an operation method based on a touch screen drive, which can implement touch screen control of a smart device through an external input device.

A third object of the present invention is to provide an operating system based on a touch screen driver, which can implement touch screen manipulation of a smart device through an external input device.

A fourth object of the present invention is to provide a computer-readable storage medium. When a program in the storage medium is executed, touch control of a smart device through an external input device can be implemented.

One of the objectives of the present invention is achieved by the following technical solutions:

An input device based on a touch screen drive includes a central processing unit, a power supply unit, an input unit, and an output unit; the central processing unit is connected to the power supply unit, the input unit, and the output unit, respectively; the The central processing unit can match the corresponding XY coordinates and actions according to the input signal of the input unit, convert the XY coordinates and actions into touch screen instructions that can be recognized by the touch screen drive, and then output the touch screen instructions through the output unit To the host of the smart device so that the host of the smart device is converted into a corresponding system layer touch screen action according to the system driver and is reflected at the application layer.

Further, the input unit is a built-in key unit and / or an expansion port unit.

Further, the output unit includes a USB chip and an output port, and the USB chip is connected to the output port.

Further, the central processing unit has a USB processing module, and the output unit is an output port.

Further, the output port is a lighting interface, a USB interface, or an extension cable with an input interface.

Further, the output unit includes a wireless communication module.

The second object of the present invention is achieved by the following technical solutions:

An operation method based on a touch screen driver. The method is implemented on the basis of the input device as described above. The input device is connected to the host of a smart device. The system of the smart device has a touch screen driver. The method includes the following: step:

Sending a touch screen descriptor instruction to the host of the smart device to register the input device as a touch screen device;

One-to-one correspondence between each input signal and each touch screen action and stored in the template database;

Acquiring a current environment of a display screen of the smart device, where the environment includes a screen resolution and a screen scene;

Acquiring an input signal, and acquiring a touch screen action corresponding to the input signal from the template database, where the touch screen action includes XY coordinates and actions;

Convert the XY coordinates and motion corresponding to the input signal into corresponding touch screen instructions that can be recognized by a touch screen driver, and send the touch screen instructions to the host of the smart device so that the host of the smart device follows The system driver translates into the corresponding system layer touch screen action and is reflected in the application layer.

Further, the output unit of the input device is a USB chip and an output port, or a wireless communication module, the USB chip is connected to the output port, and the connection method between the input device and the host of the smart device may be USB Interface connection or wireless connection.

Further, the output port is a USB interface, and the way to obtain the current environment of the smart device host is to obtain through a program on the smart device host or through a USB interface.

Further, the template database is stored in the input device or an external associated device.

Further, the input unit of the input device is a built-in key unit and / or an expansion port unit, and the way to obtain the input signal is through an IO bus, through an expansion port unit, or through wireless communication.

Further, the manner of sending the touch screen instruction to the host of the smart device may be a wired transmission manner or a wireless transmission manner.

Further, the wired transmission mode is specifically a USB interface wired transmission, and the wireless transmission mode is specifically a USB wireless transmission, a Bluetooth wireless transmission, or a WIFI wireless transmission.

The third object of the present invention is achieved by using the following technical solutions:

An operating system based on a touch screen driver includes a smart device and an input device based on the touch screen driver as described above, and a host of the smart device is connected to the input device.

The fourth objective of the present invention is achieved by using the following technical solutions:

A computer-readable storage medium stores an executable computer program, and when the computer program runs, the operation method based on the touch screen driver described above is implemented.

Compared with the prior art, the beneficial effects of the present invention are:

The touch screen-driven input device controls the touch screen through the input unit, which allows traditional touch screen operations to bring a better physical feedback experience and avoid direct contact with the touch screen; strong compatibility, the input device is based on intelligence The built-in touch screen driver of the device system is used to control the touch screen without changing the device or physical touch screen. The screen resolution is flexible and controllable, small in size, and easy to store and carry; no content access support is required, eliminating the need for developers Problems such as inconvenience and time consuming, as long as the content is developed according to the touch screen operation, this input device can be applied to implement touch screen operation; the built-in touch screen driving method of the smart device is used to avoid unnecessary troubles caused by cracking and modifying the system .

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic structural diagram of an input device based on a touch screen drive provided by the present invention; FIG.

FIG. 2 is a schematic flowchart of a touch screen driving-based operation method provided by the present invention.

detailed description

In the following, the present invention is further described with reference to the drawings and specific embodiments. It should be noted that, under the premise of no conflict, the embodiments described below or technical features can be arbitrarily combined to form a new embodiment. .

Please refer to FIG. 1, which is a structural block diagram of an input device based on a touch screen drive. The input device includes: a central processing unit, a power supply unit, an input unit, and an output unit; the central processing unit and the power supply unit, the input unit, and the output are respectively Unit connection; the central processing unit can match the corresponding XY coordinates and actions according to the input signal of the input unit, convert the XY coordinates and actions into touch screen instructions that can be recognized by the touch screen drive, and then output the touch screen instructions to In the host of the smart device, the host of the smart device is converted into a corresponding system layer touch screen action according to the system driver and is reflected in the application layer.

At present, mainstream smart device platforms (Android, iOS) have supported device management (Device Drivers). The default support in the system kernel is the usbtouchscreen driver. The input device can be based on the smart device's system driver to implement touch screens from external devices. The touch screen operation effect is not restricted by the size of the host screen, and can be flexibly adjusted.

In this embodiment, the power supply unit can supply power to the built-in battery, or OTG supplies power from the data port.

As a preferred embodiment, the input unit is a built-in key unit and / or an expansion unit. The built-in key unit is the MCU and key unit. The built-in key unit is the built-in key unit; the expansion port unit can be a USB interface, which is used to connect external standard equipment such as keyboards and mice.

As a preferred embodiment, the output unit includes a USB chip and an output port, and the USB chip is connected to the output port. The USB wired communication function is realized through a USB chip, and data is transmitted through a USB interface.

In addition, many composite MCUs currently contain a USB chip. When the central processing unit has a USB processing module, the output unit is only an output port, and a USB chip is no longer needed.

As a preferred embodiment, the output port is a lighting interface, a USB interface, or an extension cable with an input interface.

As a preferred embodiment, the output unit includes a wireless communication module. In addition to using USB wired communication, wireless communication can also be achieved through a wireless communication module. The wireless communication module includes a wireless communication chip and a USB receiver. The wireless communication chip is built into the input device, and the USB receiver is inserted into the input port of the smart device. .

As a preferred embodiment, the input device further includes a storage unit, which is connected to the central processing unit; the storage unit is used to store logic programs, data, and the like.

Please refer to FIG. 2. The present invention also provides a touch screen-driven operation method. The method is implemented on the basis of the input device described above. The input device is connected to the host of the smart device. The system of the smart device has a touch screen. The driver includes the following steps:

S1. Send a touch screen descriptor instruction to the host of the smart device to register the input device as a touch screen device;

S2. One-to-one correspondence between each input signal and each touch screen action and stored in the template database;

S3. Obtain the current environment of the display of the smart device. The environment includes the screen resolution and screen scene. Since the screen parameters (size, resolution) of different devices may be different, and the corresponding templates for different scenes are different, Therefore, it is necessary to obtain the current environment of the smart device.

S4. Obtain an input signal, and obtain a touch screen action corresponding to the input signal from a template database. The touch screen action includes XY coordinates and actions;

S5. Convert the XY coordinates and actions corresponding to the input signal into corresponding touch screen instructions that can be recognized by the touch screen driver, and send the touch screen instructions to the host of the smart device so that the host of the smart device is converted into the corresponding one according to the system driver. The system layer touches the screen and is reflected in the application layer.

The method mainly matches input signals of external devices with touch screen actions one by one, matches input signals received from external devices to corresponding touch screen actions, and then converts the touch screen actions into the built-in touch screen driver of the smart device. Recognizable touch screen instructions to enable touch screen manipulation of smart devices. In this embodiment, the input signal is a key signal, such as a signal generated by a keyboard, a mouse, and a handle.

In this embodiment, the touch screen instruction is sent to the host of the smart device in a single point or multi-point manner, where single point means that only one position is operated on the touch screen at the same time, and multi-point means that it can operate in multiple positions at the same time . When there is only one input signal, for example, the user only presses a certain key, a single point method is used, so that the smart device triggers only one touch screen operation; when there are multiple input signals at the same time, for example, the user presses multiple keys at the same time , The multi-point method is adopted to enable the smart device to trigger multiple touch screen operations at the same time.

As a preferred embodiment, the output unit of the input device is a USB chip and an output port, or a wireless communication module, the USB chip is connected to the output port, and the connection method between the input device and the host of the smart device may be a USB interface connection or Wireless connections. The wireless communication module includes a wireless communication chip and a USB receiver. The wireless communication chip is set in the input device, and the USB receiver is inserted into the input port of the smart device.

As a preferred embodiment, the output port is a USB interface, and the way to obtain the current environment of the host of the smart device is to obtain it through a program on the host of the smart device or through a USB interface, such as an Android ADB command.

As a preferred embodiment, the template database is stored in an input device, such as a built-in FLASH, or in an external associated device, such as a mobile phone. After receiving the input signal, that is, the key signal, pair the corresponding XY coordinates or actions in the template data to mark the action or trajectory of the touch screen. Since the key data is not touch screen data, it needs to be converted into the corresponding Motion coordinates and trajectory data.

As a preferred embodiment, the input unit of the input device is a built-in key unit and / or an expansion port unit, and the input signal is obtained through an IO bus, through an expansion port unit, or through wireless communication. When the input unit is a built-in button unit, the input signal generated by the built-in button unit can be obtained through the IO bus; if the input unit is an expansion port unit, the input signal generated by the wired keyboard or mouse is obtained through the expansion port unit. Use a wireless receiver to get input signals from a wireless keyboard, mouse, or wireless terminal.

As a preferred implementation manner, a manner for sending the touch screen instruction to the host of the smart device may be a wired transmission manner or a wireless transmission manner.

As a preferred embodiment, the wired transmission method is specifically a USB interface wired transmission, and the wireless transmission method is specifically USB wireless transmission, Bluetooth wireless transmission, or WIFI wireless transmission.

The invention also provides an operating system based on a touch screen driver, which includes a smart device and an input device based on a touch screen driver as described above, and a host of the smart device is connected to the input device.

In addition, the present invention also provides a computer-readable storage medium. The computer-readable storage medium stores an executable computer program, and when the computer program runs, the operation method based on the touchscreen driver described above is implemented.

The foregoing embodiments are merely preferred embodiments of the present invention, and the scope of protection of the present invention cannot be limited by this. Any non-substantial changes and substitutions made by those skilled in the art on the basis of the present invention belong to the present invention. Claimed scope.

Claims

An input device based on a touch screen drive, comprising: a central processing unit, a power supply unit, an input unit, and an output unit; the central processing unit and the power supply unit, the input unit, and the output unit are respectively connection;

The central processing unit may match the XY coordinates and motion corresponding to the input signal according to the input signal of the input unit, convert the XY coordinates and motion into a touch screen instruction recognizable by a touch screen drive, and then pass the output unit And outputting the touch screen instruction to the host of the smart device, so that the host of the smart device is converted into a corresponding system layer touch screen action according to the system driver and is reflected at the application layer.
The touch screen-driven input device according to claim 1, wherein the input unit is a built-in button unit and / or an expansion port unit.
The touch screen-driven input device according to claim 1, wherein the output unit comprises a USB chip and an output port, and the USB chip is connected to the output port.
The touch screen-driven input device according to claim 1, wherein the central processing unit has a USB processing module, and the output unit is an output port.
The touch screen-driven input device according to claim 1, wherein the output unit comprises a wireless communication module.
An operation method based on a touch screen drive, characterized in that the method is implemented on the basis of the input device according to claim 1, wherein the input device is connected to a host of a smart device, and a system of the smart device With touch screen driver, including the following steps:

Sending a touch screen descriptor instruction to the host of the smart device to register the input device as a touch screen device;

One-to-one correspondence between each input signal and each touch screen action and stored in the template database;

Acquiring a current environment of a display screen of the smart device, where the environment includes a screen resolution and a screen scene;

Acquiring an input signal, and acquiring a touch screen action corresponding to the input signal from the template database, where the touch screen action includes XY coordinates and actions;

Convert the XY coordinates and motion corresponding to the input signal into corresponding touch screen instructions that can be recognized by a touch screen driver, and send the touch screen instructions to the host of the smart device so that the host of the smart device follows The system driver translates into the corresponding system layer touch screen action and is reflected in the application layer.
The touch screen-driven operation method according to claim 6, wherein the output unit of the input device is a USB chip and an output port, or a wireless communication module, the USB chip and the output port The connection mode of the input device and the host of the smart device may be a USB interface connection or a wireless connection.
The operation method based on the touch screen drive according to claim 7, wherein the output port is a USB interface, and the way to obtain the current environment of the smart device host is: Program acquisition or USB interface.
The operation method based on the touch screen drive according to claim 6, wherein the template database is stored in the input device or an external associated device.
The touch screen-driven operation method according to claim 6, wherein the input unit of the input device is a built-in key unit and / or an expansion port unit, and the method of obtaining an input signal is through an IO bus Acquired, acquired through an expansion port unit, or acquired through wireless communication.
The operation method based on the touch screen drive according to claim 7, wherein the method of sending the touch screen instruction to the host of the smart device can be a wired transmission method or a wireless transmission method.
The operation method based on the touch screen drive according to claim 11, wherein the wired transmission method is specifically USB cable transmission, and the wireless transmission method is USB wireless transmission, Bluetooth wireless transmission, or WIFI wireless transmission. transmission.
A system based on a touch screen drive, comprising: a smart device and the input device based on the touch screen drive according to any one of claims 1 to 5, and a host of the smart device is connected to the input device. .
A computer-readable storage medium, characterized in that the computer-readable storage medium stores an executable computer program, and when the computer program runs, the touch-screen driver-based device according to any one of claims 6 to 12 is implemented. Method of operation.