CN111511045B

CN111511045B - Interaction method and device for mobile terminal and computer, electronic equipment and storage medium

Info

Publication number: CN111511045B
Application number: CN202010281624.0A
Authority: CN
Inventors: 陈侣德; 项应华; 郭宏记; 吴勇明; 茅明杰; 茅小春
Original assignee: Dianeng Technology Hangzhou Co ltd
Current assignee: Dianeng Technology Hangzhou Co ltd
Priority date: 2020-04-10
Filing date: 2020-04-10
Publication date: 2023-06-02
Anticipated expiration: 2040-04-10
Also published as: CN111511045A

Abstract

The invention provides an interaction method of a mobile terminal and a computer, which comprises the following steps: establishing wireless communication connection between the mobile terminal and the computer, wherein the mobile terminal is provided with first application software, and the computer is provided with second application software; when the file of the mobile terminal is selected to be shared to the computer, the first application software is used for controlling the processor of the mobile terminal to transmit the file to the processor of the computer through a Socket protocol; when the file of the computer is selected to be shared to the mobile terminal, the second application software is used for controlling the processor of the computer to transmit the file to the processor of the mobile terminal through a Socket. The interaction method of the mobile terminal and the computer can realize the cross-system information interaction between the mobile terminal and the computer. The invention also provides an interaction device based on the mobile terminal and the computer, electronic equipment and a storage medium.

Description

Interaction method and device for mobile terminal and computer, electronic equipment and storage medium

Technical Field

The present invention relates to the field of wireless communications technologies, and in particular, to a method and apparatus for interaction between a mobile terminal and a computer, an electronic device, and a computer readable storage medium.

Background

With the rapid development of communication technology, computers and mobile terminals (such as mobile phones) are indispensable tools in people's life. However, the functions of the mobile terminal and the computer have advantages and disadvantages, and the information interaction between the mobile terminal and the computer is inconvenient because the system of the mobile terminal and the system of the computer are independent.

Disclosure of Invention

In view of the foregoing, it is desirable to provide an interaction method, apparatus, electronic device and computer readable storage medium that facilitate information interaction between a mobile terminal and a computer.

The embodiment of the invention provides an interaction method of a mobile terminal and a computer, which is applied to the mobile terminal, wherein the mobile terminal comprises a first processor, the computer comprises a second processor, and the interaction method comprises the following steps:

establishing wireless communication connection between the mobile terminal and the computer; and

When the file of the mobile terminal is selected to be shared to the computer, the first processor is controlled to transmit the file to the second processor through a Socket protocol.

As a preferred solution, the interaction method further includes:

when text input is selected to be carried out on the computer through the mobile terminal, the first processor is controlled to acquire the input content of the mobile terminal, and the input content is transmitted to the second processor through a Socket protocol.

As a preferred solution, the mobile terminal is configured with one or more control interfaces entered in response to a user operation, each control interface includes one or more control icons, each control icon corresponds to a virtual key value one by one, each virtual key value corresponds to a computer control instruction one by one, and the interaction method further includes:

when the control icon is touched, the first processor is controlled to transmit the virtual key value corresponding to the control icon to the second processor through a Socket protocol.

As a preferred solution, the interaction method further includes:

when the control icon is a mouse control area, controlling the first processor to acquire coordinate change data generated when a touch point on the mouse control area slides, and converting the coordinate change data into a step change data set which comprises up, down, left and right movements; and

And controlling the first processor to transmit the step change data set to the second processor through a Socket protocol.

As a preferred solution, the interaction method further includes:

configuring a file directory for the access of the computer on the mobile terminal, and controlling the first processor to transmit the directory structure of the file directory and the files under the file directory to the second processor through a Socket protocol; or (b)

When the directory structure transmitted by the computer is received, the first processor is controlled to analyze the directory structure.

As a preferred solution, the interaction method further includes:

when the clipboard of the mobile terminal is selected to be shared with the computer, the first processor is controlled to acquire the content of the clipboard of the mobile terminal, and the content of the clipboard is transmitted to the second processor through a Socket protocol.

The embodiment of the invention provides an interaction method of a computer and a mobile terminal, which is applied to the computer, wherein the mobile terminal comprises a first processor, the computer comprises a second processor, and the interaction method comprises the following steps:

establishing wireless communication connection between the computer and the mobile terminal; and

When the files in the computer are selected to be shared to the mobile terminal, the second processor is controlled to transmit the files to the first processor through a Socket protocol.

As a preferred solution, the interaction method further includes:

when the files in the computer are selected to be shared to the mobile terminal, the second processor is controlled to copy the files to the appointed directory of the website server.

As a preferred solution, the interaction method further includes:

controlling the second processor to output and display the file in a two-dimensional code form at the storage address of the website server; or (b)

And controlling the second processor to transmit the storage address of the file in the website server to the first processor through a Socket protocol.

As a preferred solution, the interaction method further includes:

configuring a file directory for the mobile terminal to access on the computer, and controlling the second processor to transmit the directory structure of the file directory and the files under the file directory to the first processor through a Socket protocol; or (b)

And when receiving the directory structure transmitted by the mobile terminal, analyzing the directory structure by using the second processor.

As a preferred solution, the interaction method further includes:

when receiving the input content of the mobile terminal transmitted by the first processor, controlling the second processor to call a system API of the computer to output the input content to a current focus window of the computer.

As a preferred solution, the interaction method further includes:

When receiving a virtual key value transmitted by the first processor, controlling the second processor to execute a control instruction corresponding to the virtual key value; or (b)

When the step change data set transmitted by the first processor is received, the second processor is controlled to output an analog mouse signal according to the step change data set so as to control the movement of a mouse pointer of the computer.

As a preferred solution, the interaction method further includes:

when the clipboard of the computer is selected to be shared to the mobile terminal, the second processor is controlled to acquire the content of the clipboard of the computer, and the content of the clipboard is transmitted to the first processor through a Socket protocol.

As a preferred solution, the interaction method further includes:

when the mobile terminal is controlled by an input device of a computer, controlling the second processor to acquire a trigger event of the input device, and converting the trigger event of the input device into a control instruction matched with a Bluetooth HID protocol; and

And controlling the second processor to transmit the control instruction to the first processor through a Bluetooth HID protocol.

The embodiment of the invention provides an interaction device of a mobile terminal and a computer, which is applied to the mobile terminal, wherein the mobile terminal comprises a first communication module and a first processor, the computer comprises a second communication module and a second processor, the mobile terminal and the computer are in wireless communication connection with the second communication module through the first communication module, first application software is installed on the mobile terminal, and when a file of the mobile terminal is selected to be shared to the computer, the first application software controls the first processor to transmit the file to the second processor through a Socket protocol.

As a preferred scheme, when the text input is selected to be performed on the computer through the mobile terminal, the first application software is further used for controlling the first processor to acquire the input content of the mobile terminal, and transmitting the input content to the second processor through a Socket protocol.

As a preferred solution, the first application software includes one or more control interfaces, each control interface includes one or more control icons, each control icon corresponds to a virtual key value one by one, each virtual key value corresponds to a computer control instruction one by one, and when the control icon is touched, the first application software is further configured to control the first processor to transmit the virtual key value corresponding to the control icon to the second processor through a Socket protocol.

As a preferred solution, when the control icon is a mouse control area, the first application software is further configured to control the first processor to obtain coordinate change data generated when a touch point on the mouse control area slides, convert the coordinate change data into a step change data set including up, down, left and right movements, and transmit the step change data set to the second processor through a Socket protocol.

As a preferred solution, when the mobile terminal is configured with a file directory for the computer to access, the first application software is further configured to control the first processor to transmit the directory structure of the file directory and the file under the file directory to the second processor through a Socket protocol.

As a preferred solution, when the clipboard of the mobile terminal is selected to be shared with the computer, the first application software is further configured to control the first processor to obtain the content of the clipboard of the mobile terminal, and transmit the content of the clipboard to the second processor through a Socket protocol.

The embodiment of the invention provides an interaction device for interaction between a computer and a mobile terminal, which is applied to the computer, wherein the mobile terminal comprises a first communication module and a first processor, the computer comprises a second communication module and a second processor, the mobile terminal and the computer are in wireless communication connection with the second communication module through the first communication module, first application software is installed on the computer, and when files in the computer are selected to be shared to the mobile terminal, the first application software controls the second processor to transmit the files to the first processor through a Socket protocol.

Preferably, when the file in the computer is selected to be shared to the mobile terminal, the first application software is further configured to control the second processor to copy the file to a specified directory of a website server.

As a preferable scheme, the first application software is further configured to control the second processor to output and display the file at the storage address of the website server in a two-dimensional code manner, or control the second processor to transmit the file at the storage address of the website server to the first processor through a Socket protocol.

As a preferred solution, when the computer is configured with a file directory for the mobile terminal to access, the first application software is further configured to control the second processor to transmit the directory structure of the file directory and the file under the file directory to the first processor through a Socket protocol.

Preferably, when receiving the input content of the mobile terminal transmitted by the first processor, the first application software is further used for controlling the second processor to call a system API of the computer to output the input content to a current focus window of the computer.

As a preferable scheme, when receiving the virtual key value transmitted by the first processor, the first application software is further used for controlling the second processor to execute a control instruction corresponding to the virtual key value; when the step change data set transmitted by the first processor is received, the first application software is further used for controlling the second processor to output an analog mouse signal according to the step change data set so as to control the movement of a mouse pointer of the computer.

As a preferred solution, when the clipboard of the computer is selected to be shared to the mobile terminal, the first application software is further configured to control the second processor to obtain the content of the clipboard of the computer, and transmit the content of the clipboard to the first processor through a Socket protocol.

Preferably, when the mobile terminal is selected to be controlled by the input device of the computer, the first application software is further used for controlling the second processor to acquire a trigger event of the input device, converting the trigger event of the input device into a control instruction matched with a bluetooth HID protocol, and transmitting the control instruction to the first processor through the bluetooth HID protocol.

An embodiment of the present invention provides an electronic device including:

a communication module;

a processor; and

and the memory is used for storing computer program instructions, and the computer program instructions are run and executed by the processor to perform the interaction method between the mobile terminal and the computer or the interaction method between the computer and the mobile terminal.

Embodiments of the present invention provide a computer readable storage medium having a computer program stored thereon, the computer readable storage medium implementing the above-described method of interaction between a mobile terminal and a computer or the above-described method of interaction between a computer and a mobile terminal when the computer program is executed by a processor.

The interaction method and device for the mobile terminal and the computer, the electronic equipment and the computer readable storage medium can overcome the system barrier between the mobile terminal and the computer, and facilitate information interaction between the mobile terminal and the computer, so that a user can better use the two equipment.

Drawings

FIG. 1 is a flowchart of a method for interacting between a mobile terminal and a computer according to a preferred embodiment of the present invention.

FIG. 2 is a flowchart of a method for interacting between a computer and a mobile terminal according to a preferred embodiment of the present invention.

FIG. 3 is a flowchart of a method for interacting between a computer and a mobile terminal according to another preferred embodiment of the present invention.

FIG. 4 is a flowchart of a method for interacting between a computer and a mobile terminal according to another preferred embodiment of the present invention.

FIG. 5 is a flowchart of a method for interacting between a mobile terminal and a computer according to another preferred embodiment of the present invention.

Fig. 6 is a flowchart of a method for interacting between a mobile terminal and a computer according to another preferred embodiment of the present invention.

Fig. 7 is a flowchart of a method for interacting between a mobile terminal and a computer according to another preferred embodiment of the present invention.

Fig. 8 is a flowchart of a method for interacting between a mobile terminal and a computer according to another preferred embodiment of the present invention.

Fig. 9A is an interface diagram of the PPT control interface of the first application software in the universal control mode according to a preferred embodiment of the present invention.

FIG. 9B is an interface diagram of the PPT control interface of the first application software in the gesture control mode according to the preferred embodiment of the present invention.

Fig. 9C is an interface diagram of the PPT control interface of the first application software in the sound control mode according to a preferred embodiment of the present invention.

Fig. 10 is an interface diagram of a multimedia playing control interface of a first application software according to a preferred embodiment of the present invention.

FIG. 11 is an interface diagram of a text input control interface of a first application software according to a preferred embodiment of the present invention.

Fig. 12 is a flowchart of a method for interacting between a mobile terminal and a computer according to another preferred embodiment of the present invention.

Fig. 13 is a flowchart of a method for interacting between a mobile terminal and a computer according to another preferred embodiment of the present invention.

FIG. 14 is a functional block diagram of a first interactive device and a second interactive device according to a preferred embodiment of the present invention.

FIG. 15 is a functional block diagram of a mobile terminal and a computer according to a preferred embodiment of the present invention.

Description of the main reference signs

First interaction device 100

First communication module 101

First processor 102

First memory 103

First computer program 104

Second interaction means 110

Second communication module 111

Second processor 112

Second memory 113

Second computer program 114

Mobile terminal 200

Computer 210

The invention will be further described in the following detailed description in conjunction with the above-described figures.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without any inventive effort, are within the scope of the present invention.

Referring to fig. 1, fig. 1 is a flowchart of a method for interaction between a mobile terminal and a computer according to a preferred embodiment of the invention. The method can enable the mobile terminal to share the file to the computer. It will be appreciated that the order of the steps in the flow diagrams may be changed, and certain steps may be omitted, according to different needs. It can be appreciated that in this embodiment, the mobile terminal may be a portable electronic terminal such as a mobile terminal, a tablet pc, or a smart watch, and the computer may be a desktop computer or a notebook computer. The mobile terminal is taken as a mobile terminal, and the computer is a notebook computer to specifically explain the method.

Step S1, establishing wireless communication connection between the mobile terminal and the computer.

It is appreciated that in this embodiment, the wireless communication connection includes, but is not limited to, a Bluetooth communication connection, a WI-FI communication connection. The mobile terminal is preferably in one-to-one wireless communication connection with the computer. For example, when the mobile terminal and the computer both have bluetooth functions, the mobile terminal and the computer can be paired through bluetooth, so as to establish wireless communication connection, and when the mobile terminal and the computer both have WI-FI functions, the mobile terminal and the computer can be connected through a router. The router is preferably a wireless router.

It may be appreciated that in this embodiment, the router preferably has a function of setting up a local area network, and the mobile terminal and the computer may establish a wireless communication connection in a local area network environment set up by the router. When the mobile terminal and the computer are connected to the local area network, an IP address can be respectively allocated to the mobile terminal and the computer, for example, the IP address of the mobile terminal is 192.168.1.23:XX, and the IP address of the computer is 192.168.1.77:XX.

It will be appreciated that in this embodiment, when the mobile terminal establishes a wireless communication connection with the computer via WI-FI, the mobile terminal and the computer are preferably in the same lan environment.

It can be appreciated that in this embodiment, the network bandwidth for implementing Socket communication by bluetooth is much smaller than the network bandwidth for implementing Socket communication by WI-FI. When both the mobile terminal and the computer have the Bluetooth function and the WI-FI function, the priority of the WI-FI connection can be set to be higher than that of the Bluetooth connection. When the WI-FI and Bluetooth connection environments are simultaneously provided, the mobile terminal and the computer preferably establish wireless communication connection through the WI-FI, and if the WI-FI function is unavailable at a certain moment, the mobile terminal and the computer automatically switch to Bluetooth to establish wireless communication connection.

It can be understood that in this embodiment, when both the mobile terminal and the computer have the bluetooth function and the WI-FI function, the mobile terminal and the computer may also be connected by manually setting or presetting a connection setting to establish a wireless communication connection through bluetooth (instead of WI-FI), so as to implement some specific functions in the subsequent embodiments (such as using the computer as an external speaker to perform an audio playing function of the mobile terminal, and using the computer to implement dialing and answering a phone call of the mobile terminal).

In this embodiment, the mobile terminal is provided with a first application software, the first application software may control a first processor of the mobile terminal, the computer is provided with a second application software, and the second application software may control a second processor of the computer. After the wireless communication connection is established between the mobile terminal and the computer, the first application software can communicate with the second application software. Socket connection can be established between the mobile terminal and the computer. When there is no data transmission in the Socket connection, in order to maintain the Socket connection, the first processor may send a heartbeat check message to the second processor every preset time, or the second processor may send a heartbeat check message to the first processor every preset time. The format of the heartbeat check message can be defined according to actual development requirements.

It can be understood that in this embodiment, when the mobile terminal and the computer are in the same lan environment, the user may further use the first application software installed on the mobile terminal to scan the paired two-dimensional code generated by the second application software, so that the mobile terminal initiates handshake communication with the computer, so as to establish wireless communication connection.

And step S2, when the file of the mobile terminal is selected to be shared to the computer, controlling the first processor to transmit the file to the second processor through a Socket protocol.

It will be appreciated that in this embodiment, the Socket protocol may be a bluetooth Socket protocol or a WI-FI Socket protocol. When a user selects a file on the mobile terminal and selects to share the file with the computer, the first application software can control the first processor to transmit the file to the second processor through a Socket protocol, so that the computer receives the file shared by the mobile terminal. The file may refer to an office file (WORD file, PDF file, etc.), a picture, a video, etc. stored on the mobile terminal.

It will be appreciated that when the second processor receives the file, the second application software may display current file receipt information.

It may be understood that the first processor transmitting the file to the second processor through the Socket protocol may mean that the first processor transmits content data of the file to the second processor through the Socket protocol.

For example, when a user selects a photo a and enters the sharing function interface by performing a touch operation on the mobile terminal, file sharing may be performed by the first application software in the sharing function interface, and then the first application software controls the first processor to transmit the photo a through a Socket protocol, the second processor may receive the photo a transmitted by the first processor through the Socket protocol, and the second application software may display the received information of the photo a.

It may be appreciated that, in this embodiment, after the second processor receives the file transmitted by the first processor, the second application software may automatically control the second processor to save the file to a preset folder. The preset folder is the folder of the computer end. In other embodiments, the user may manually set the saving path of the file received by the second processor.

It can be understood that, in order to improve the security of file and instruction transmission, the transmitting end (mobile terminal or computer) may utilize a preset encryption algorithm to encrypt the data stream (file, instruction, etc.) transmitted by the transmitting end, and the receiving end (computer or mobile terminal) may utilize a corresponding decryption algorithm to decrypt the received data stream. For example, an encryption and decryption scheme of (RSA+AES) is adopted to improve the security of file and instruction transmission between the computer and the mobile terminal.

Referring to fig. 2, fig. 2 is a flowchart of a method for interaction between a computer and a mobile terminal according to a preferred embodiment of the invention. The method is used for enabling the computer to share the file to the mobile terminal. It will be appreciated that the order of the steps in the flow diagrams may be changed, and certain steps may be omitted, according to different needs.

And step S3, when the file in the computer is selected to be shared to the mobile terminal, controlling the second processor to transmit the file to the first processor through a Socket protocol.

It will be appreciated that in this embodiment, the Socket protocol may also be a bluetooth Socket protocol or a WI-FI Socket protocol. When a user selects a file on the computer and selects to share the file with the mobile terminal, the second application software can control the second processor to transmit the file to the first processor through a Socket protocol, so that the mobile terminal receives the file shared by the computer. The file may refer to an office file (WORD file, PDF file, etc.), a picture, a video, etc. stored on the computer.

It will be appreciated that when the first processor receives the file, the first application software may display current file receipt information.

It may be understood that the second processor transmitting the file to the first processor through the Socket protocol may mean that the second processor transmits content data of the file to the first processor through the Socket protocol.

For example, when the user performs a mouse/touch pad operation on the computer to select a photo B and enters the right-key menu through the right-key, the user may select "send file to mobile terminal" in the right-key menu, and then the second application software may control the second processor to transmit the photo B through the Socket protocol, the first processor may receive the photo B transmitted by the second processor through the Socket protocol, and the first application software may display the received information of the photo B.

It can be appreciated that in this embodiment, when the first processor receives the file transmitted by the second processor, the first application software may automatically control the first processor to save the file to a preset folder. The preset folder is a folder on the mobile terminal. In other embodiments, the user may manually touch the file to set the storage path of the file received by the first processor.

Referring to fig. 3, a flowchart of a method for interacting between a computer and a mobile terminal according to another preferred embodiment of the present invention is shown. The method is similar to the file sharing function described in fig. 2, and can also realize the sharing of the files in the computer to the mobile terminal. It will be appreciated that the order of the steps in the flow diagrams may be changed, and certain steps may be omitted, according to different needs.

And S4, when the files in the computer are selected to be shared, controlling the second processor to copy the files to the appointed directory of the website server.

It may be appreciated that, in this embodiment, the website server may be disposed at the computer end, the web content on the website server may be published by the second application software, and the specified directory may be a folder set in advance under the website server, where the folder is used to store the file to be shared. When a user selects a file on the computer and shares the file, the second application software can control the second processor to copy the file to the appointed directory of the website server. The file may refer to an office file (WORD file, PDF file, etc.), a picture, a video, etc. stored on the computer. In other embodiments, the website server may be disposed on an external network server, such as a cloud server, instead of the computer terminal.

S5, controlling the second processor to display the file in a two-dimensional code form at the storage address of the website server, so that the mobile terminal can download the file by scanning the two-dimensional code.

It can be understood that in this embodiment, when the file is copied to the designated directory of the website server, the second application software may control the second processor to output and display the file at the storage address of the website server in the form of a two-dimensional code, so that a user may use the mobile terminal to scan the two-dimensional code, thereby implementing downloading of the file to the mobile terminal. In other embodiments, the second application software may further control the second processor to output and display the file in a form of a bar code, a graphic code, or the like at the storage address of the website server.

It can be appreciated that the user can scan the two-dimensional code by using application software (APP) having a sweep function on the mobile terminal, including but not limited to the first application software, a WeChat, a browser, etc. APP. That is, the mobile terminal may not install the first application software, and the file shared by the computer terminal may be obtained through the scheme of the embodiment, for example, the user scans the two-dimensional code by using a one-scan function of a browser on the mobile terminal, so as to download the file shared by the computer terminal.

It may be appreciated that in this embodiment, the mobile terminal may obtain the storage address of the file on the website server by scanning the two-dimensional code, and then download the file to a local location using HTTP (Hyper Text Transfer Protocol ) or HTTPs (Hyper Text Transfer Protocol over Secure Socket Layer, hypertext transfer security protocol) based on the storage address, where the local location may refer to a specified folder on the mobile terminal. In other embodiments, when the mobile terminal scans the two-dimensional code to download the file, the storage location of the file in the mobile terminal may also be set by a manual touch operation of a user.

For example, when a user performs a mouse/touch pad operation on a computer to select a photo B and enters a right-key menu through a right-key, a "scan code sharing" may be selected in the right-key menu, then the second application software may control the second processor to copy the photo B to a specified directory of a website server, after copying a file is completed, the second application software may display the file at a storage address of the website server in a two-dimensional code manner, and other users may scan the two-dimensional code by using an APP having a scan function on the mobile terminal to obtain the storage address of the file at the website server, and then invoke a browser to download the file to the mobile terminal based on an HTTP or HTTPs protocol. Or directly scanning the two-dimensional code by using the scanning function of the browser and downloading the file to the local of the mobile terminal.

Referring to fig. 4, a flowchart of a method for interacting between a computer and a mobile terminal according to another preferred embodiment of the present invention is shown. The method is basically the same as the file sharing function described in fig. 3, and can also realize the sharing of the files in the computer to the mobile terminal. It will be appreciated that the order of the steps in the flow diagrams may be changed, and certain steps may be omitted, according to different needs.

And S6, controlling the second processor to transmit the storage address of the file at the website server to the first processor through a Socket protocol, so that the mobile terminal downloads the file based on the storage address.

It may be appreciated that in this embodiment, after the second application software controls the second processor to copy the file to the specified directory of the website server, the second application software may further control the second processor to transmit the storage address of the file at the website server to the first processor of the mobile terminal through a Socket protocol, and the first application software may display the storage address received by the first processor. When the first processor receives the storage address of the file, the first application software may call a browser to download the file to a designated folder based on HTTP protocol or HTTPs protocol. For example, when the second processor transmits the storage address of the file at the website server to the first processor through a Socket protocol, the storage address may be copied to a browser by a user of the mobile terminal to download the file from the website server and save the file, or the user of the mobile terminal may directly click on the storage address to automatically invoke the browser to access the website server and download the file from the website server and save the file.

For example, when the user performs a mouse/touch pad operation on the computer to select a photo B and enters a right-key menu through a right-key, the user may select "file sharing" in the right-key menu, then the second application software may control the second processor to copy the photo B to a specified directory of the website server, after the copying of the file is completed, the second application software may also control the second processor to transmit the file to the first processor at a storage address of the website server through a Socket protocol, and the first application software may output the receiving information of the storage address of the photo B received by the first processor, and the user may use the mobile terminal to start a browser to download the file to the mobile terminal based on the storage address. In other embodiments, the first application software may also directly invoke the browser to download the file to the mobile terminal locally based on the storage address.

Referring to fig. 5, a flowchart of a method for interaction between a mobile terminal and a computer in a preferred embodiment of the invention is shown. The method is used for enabling the mobile terminal to browse the files of the computer terminal. It will be appreciated that the order of the steps in the flow diagrams may be changed, and certain steps may be omitted, according to different needs.

And S7, configuring a file directory for browsing by the mobile terminal on the computer.

It can be understood that in this embodiment, those file directories may be designated in advance on the computer to provide the mobile terminal with browsing, so that security and privacy of other files stored in the computer can be ensured.

For example, one or more folders for sharing browsing may be newly established on the computer, where the one or more folders are file directories for browsing by the mobile terminal. Multiple files and subfolders can be stored under each folder, and multiple files and subfolders can be stored under subfolders. One or more folders stored on the computer itself may also be configured as a directory of files for viewing by the mobile terminal.

And S8, controlling the second processor to acquire the directory structure of the file directory and the file under the file directory, and transmitting the file to the first processor through a Socket protocol.

It may be appreciated that in this embodiment, the second application software may control the second processor to obtain the directory structure of the file directory and the file under the file directory, and transmit the file to the first processor through a Socket protocol. The first processor can receive the directory structure of the file directory and the files under the file directory transmitted by the second processor through a Socket protocol, and can analyze the directory structure, so that browsing of the file directory and the files under the file directory is realized.

For example, a user configures a folder a on a computer as a file directory for browsing by the mobile terminal, and the second application software may control the second processor to obtain the directory structure of the folder a and the files under the folder a, and transmit the directory structure and the files under the folder a to the first processor through a Socket protocol. The first processor can receive the directory structure of the folder A and the files under the folder A transmitted by the second processor through a Socket protocol, analyze the directory structure, and the first application software can display the directory structure of the folder A and the files under the folder A analyzed by the first processor, so that a user can use the mobile terminal to view the folder A of the computer terminal and the files under the folder A.

It can be understood that, in this embodiment, after the file directory for browsing by the mobile terminal is configured, the mobile terminal may also be enabled to browse the files at the computer end by the following manner: and the second application software controls the second processor to copy the directory structure of the file directory and the files under the file directory to the appointed directory of the website server. The mobile terminal can access the website server by using a browser based on the HTTP protocol or the HTTPS protocol, so that online browsing of the file catalogue and files under the file catalogue is realized. For example, the second application software controls the second processor to copy the directory structure of the file directory and the file under the file directory to the designated directory of the website server, and transmits the storage address of the file directory to the first processor through a Socket protocol, and the first application software can output and display the storage address received by the first processor, so that a user can access the website server by using the mobile terminal based on the storage address of the file directory to view the file directory and the file under the file directory.

Referring to fig. 6, a flowchart of a method for interaction between a mobile terminal and a computer in a preferred embodiment of the invention is shown. The method is used for enabling the computer to browse the files of the mobile terminal. It will be appreciated that the order of the steps in the flow diagrams may be changed, and certain steps may be omitted, according to different needs.

Step S9, configuring a file catalog for browsing by the computer on the mobile terminal.

It can be understood that in this embodiment, those file directories may be designated in advance on the mobile terminal and may be provided for the computer to browse, so that security and privacy of other files stored in the mobile terminal may be ensured.

For example, one or more folders for sharing browsing may be newly established on the mobile terminal, where the one or more folders are file directories for browsing by the computer. Multiple files and subfolders can be stored under each folder, and multiple files and subfolders can be stored under subfolders. One or more folders stored on the mobile terminal itself may also be configured as a directory of files for viewing by the computer.

Step S10, controlling the first processor to obtain the directory structure of the file directory and the file under the file directory, and transmitting the file to the second processor through a Socket protocol.

It may be appreciated that in this embodiment, the first application software may control the first processor to obtain the directory structure of the file directory and the file under the file directory, and transmit the file to the second processor through a Socket protocol. The second processor can receive the directory structure of the file directory and the files under the file directory transmitted by the first processor through a Socket protocol, and analyze the directory structure, so that browsing of the file directory and the files under the file directory is realized.

For example, a user configures a folder B on the mobile terminal as a file directory for browsing by the computer, and the first application software may control the first processor to obtain the directory structure of the folder B and the files under the folder B, and transmit the directory structure and the files under the folder B to the second processor through a Socket protocol. The second processor can receive the directory structure of the folder B and the files under the folder B transmitted by the first processor through a Socket protocol, analyze the directory structure, and display the directory structure of the folder B and the files under the folder B analyzed by the second processor by the second application software, so that a user can use the computer to view the folder B of the mobile terminal and the files under the folder B.

Referring to fig. 7, a flowchart of a method for interaction between a mobile terminal and a computer in a preferred embodiment of the invention is shown. The method is used for enabling the computer and the mobile terminal to share the clipboard. It will be appreciated that the order of the steps in the flow diagrams may be changed, and certain steps may be omitted, according to different needs.

And S11, controlling the second processor to acquire the content of the clipboard of the computer and transmitting the content of the clipboard to the first processor through a Socket protocol, so that the first application software controls the first processor to synchronize the content of the clipboard of the computer to the clipboard of the mobile terminal.

It may be appreciated that in this embodiment, the second application software has a "clipboard synchronization to mobile terminal" function icon, and when the "clipboard synchronization to mobile terminal" function icon on the second application software is clicked, the second application software controls the second processor to acquire the content of the clipboard of the computer, and transmits the acquired content of the clipboard to the first processor through a Socket protocol. The first processor can receive the content of the clipboard of the computer through a Socket protocol, and the first application software can control the first processor to synchronize the content of the clipboard of the computer to the clipboard of the mobile terminal, so that the content of the clipboard of the computer can be synchronized to the clipboard of the mobile terminal. In other embodiments, when the first processor receives the contents of the clipboard of the computer, the first application software may output a clipboard-synchronized alert message to alert the user of the mobile terminal.

For example, if the user performs the copy or cut operation on a certain content C on the computer, clicks the function icon of "clipboard synchronization to mobile terminal" on the second application software, the second application software controls the second processor to obtain the content stored in the clipboard of the computer, and transmits the obtained content of the clipboard to the first processor through Socket protocol. The first application software can control the first processor to synchronize the received content of the clipboard of the computer to the clipboard of the mobile terminal, and at the moment, a user can directly paste the content on the mobile terminal, namely the content C.

It may be appreciated that in other embodiments, after the function icon of "clipboard synchronize to mobile terminal" is turned on, the second application software may control the second processor to acquire the content of the clipboard of the computer at intervals of a preset time, and transmit the acquired content of the clipboard to the first processor through a Socket protocol. If the function icon of the clipboard synchronous to the mobile terminal is not lightened, the second application software does not control the second processor to acquire the content of the clipboard of the computer.

And step S12, controlling the first processor to acquire the content of the clipboard of the mobile terminal and transmitting the content of the clipboard to the second processor through a Socket protocol, so that the second application software controls the second processor to synchronize the content of the clipboard of the mobile terminal to the clipboard of the computer.

It will be appreciated that in this embodiment, the first application software has a "clipboard synchronize to computer" function icon. When the function icon of 'clipboard synchronization to computer' on the first application software is clicked, the first application software controls the first processor to acquire the content of the clipboard of the mobile terminal, and transmits the acquired content of the clipboard to the second processor through a Socket protocol. The second processor may receive the content of the clipboard of the mobile terminal through a Socket protocol, and the second application software may control the second processor to synchronize the content of the clipboard of the mobile terminal to the clipboard of the computer, so that the content of the clipboard of the mobile terminal may be synchronized to the clipboard of the computer. In other embodiments, when the second processor receives the content of the clipboard of the mobile terminal, the second application software may also output a clipboard-synchronized alert message to alert the user of the computer.

For example, if the user performs a copy or cut operation on a certain content D on the mobile terminal, clicks a function icon of "clipboard is synchronized to a computer" on the first application software, the first application software controls the first processor to obtain the content stored in the clipboard of the mobile terminal, and transmits the obtained content of the clipboard to the second processor through a Socket protocol. The second application software controls the second processor to synchronize the received content of the clipboard of the mobile terminal to the clipboard of the computer, and at the moment, a user can directly paste the content on the computer, namely the content D.

It may be appreciated that in other embodiments, after the function icon of "clipboard synchronize to computer" is turned on, the first application software may control the first processor to acquire the content of the clipboard of the mobile terminal at intervals of a preset time, and transmit the acquired content of the clipboard to the second processor through a Socket protocol. If the function icon of the clipboard synchronous to the computer is not lightened, the first application software does not control the first processor to acquire the content of the clipboard of the mobile terminal.

Referring to fig. 8, a flowchart of a method for interaction between a mobile terminal and a computer in a preferred embodiment of the invention is shown. The method is used for enabling the mobile terminal to serve as a remote control device to control the computer. It will be appreciated that the order of the steps in the flow diagrams may be changed, and certain steps may be omitted, according to different needs.

Step S13, configuring one or more control interfaces entered in response to user operations on the first application software.

It may be appreciated that in this embodiment, one or more control interfaces that may be accessed in response to a user operation may be configured on the first application software in advance, where each control interface may include one or more control icons, and each control interface may be used to implement a control function, for example, the one or more control interfaces include a PPT control interface (as shown in fig. 9A-9C), a multimedia play control interface (as shown in fig. 10), and a text input control interface (as shown in fig. 11).

As shown in fig. 9A, the PPT control interface in the general control mode includes a "previous page" control icon, a "next page" control icon, a "full screen" control icon, a "return" control icon, a "mouse control area" control icon, a "left click" control icon, and a "right click" control icon. The control icons are in one-to-one correspondence with a virtual key value, each virtual key value corresponds to a computer control instruction, and the control modes of the control icons are click operation, so that the control instructions are triggered. The control icon of the 'mouse control area' is used for controlling the movement of the computer mouse pointer, the control mode of the 'mouse control area' control icon is sliding operation, when a user performs sliding operation on the 'mouse control area' control icon, a coordinate change process can be generated, and the coordinate change process can be converted into step change data comprising up-down and left-right movement. As shown in fig. 9B, the PPT control interface in the gesture control mode may control the page turning of the PPT by shaking the mobile terminal, for example, shaking the mobile terminal up once to control the PPT to turn up and shaking the mobile terminal down once to control the PPT to turn down. When the first application software responds to the user operation to enter the PPT control interface of the gesture control mode, the first application software can control the first processor to read the sensing data of the sensors (such as a gyroscope and an acceleration sensor) of the mobile terminal so as to obtain the shaking direction of the mobile terminal. The PPT control interface in the gesture control mode comprises an exit control icon, the control mode of the control icon is clicking operation, and when the exit control icon is clicked, the PPT control interface in the gesture control mode can be controlled to exit by the mobile terminal.

As shown in fig. 9C, the PPT control interface in the voice control mode is a PPT control interface in which the PPT can be controlled to turn pages by voice, for example, a voice command "Next page" or "please turn Next page" is used to control the PPT to turn pages down, and a voice command "Last page" or "please turn Last page" is used to control the PPT to turn pages up. When the first application software responds to the PPT control interface of the sound control mode which is operated by the user, the first application software can control the first processor to read the sound collected by the microphone of the mobile terminal and conduct voice recognition so as to receive the sound instruction of the user. The PPT control interface in the sound control mode comprises an exit control icon, the control mode of the control icon is clicking operation, and when the exit control icon is clicked, the PPT control interface in the sound control mode can be controlled to exit by the mobile terminal.

As shown in fig. 10, the multimedia playing control interface includes a "play/pause" control icon, a "last track" control icon, a "next track" control icon, a "volume+" control icon, a "volume-" control icon, a "full screen" control icon, a "return" control icon, a "mouse control area" control icon, a "left click" control icon, and a "right click" control icon. The control icons are respectively corresponding to a virtual key value, each virtual key value corresponds to a computer control instruction one by one, and the control modes of the control icons are click operation, so that the control instructions are triggered. The control icon of the mouse control area is used for controlling the movement of the computer mouse pointer, and the control mode of the control icon of the mouse control area is sliding operation.

As shown in fig. 11, a text input control interface is provided, which includes a text input area and a text display area. The text input area is used for inputting text, and can support a system input method of the mobile terminal or a third-party input method installed in the mobile terminal to input text in the text input area, including but not limited to a keyboard input mode, a voice input mode, a handwriting input mode and the like. It will be appreciated that text may be entered by voice or handwriting if the current input method for text entry in the text entry area supports both voice and handwriting. The text display area is used for displaying the text content transmitted by the text input area.

It will be appreciated that, in other embodiments, when the computer is provided with a voice control system (supporting voice control functions), the one or more control interfaces may further include a voice control interface, and when the first application software responds to a user operation to enter the voice control interface, the first application software may control the first processor to read a sound collected by a microphone of the mobile terminal and perform voice recognition to implement receiving a voice command of the user, where the voice command includes, but is not limited to, a command for opening or closing an application program on the computer, a command for zooming in/out a page or a picture on the computer, a command for searching a browser on the computer, and the like. The first application software can control the first processor to conduct voice recognition on the user voice command to obtain a voice recognition result, and the voice recognition result is transmitted to the second processor. The second application software can control the second processor to call a system API to enable the voice control system, and transmit the received voice recognition result to the voice control system for execution so as to realize corresponding voice control.

Step S14, controlling the first processor to collect control content on the control interface, and transmitting the control content to the second processor through a Socket protocol, so that the second application software controls the second processor to execute an operation corresponding to the control content.

It will be appreciated that in this embodiment, the control content may include virtual key values, text, voice content, and step change data. The first application software can control the first processor to collect control content on the control interface and transmit the control content to the second processor through a Socket protocol.

It will be appreciated that when the control content is a virtual key value or text, the first application software may control the first processor to directly transfer the virtual key value or text to the second processor. When the control content is voice content, the first application software can control the first processor to perform voice recognition on the voice content, and then transmit a voice recognition result to the second processor. When the control content is step length change data, the first application software can control the first processor to convert the step length change data into the step length of a computer display interface, and then transmit the converted step length change data to the second processor. In other embodiments, the first application software may also control the first processor to directly transmit the step change data to the second processor, where the second application software controls the second processor to perform step conversion operation, or directly transmit the voice content to the second processor, where the second application software controls the second processor to perform voice recognition.

It can be understood that, in this embodiment, when the second processor receives the control content transmitted by the first processor through the Socket protocol, the computer may be controlled to execute the operation corresponding to the control content according to the control content.

For example, the control content is text, and the first application software controls the first processor to transmit the text to the second processor through a Socket protocol. The second application software may control the second processor to call a system API (Application Programming Interface, application program interface) to output the text to a window currently in focus on the computer. The window with focus preferably refers to the window currently activated at the computer end and set on top, i.e. the window in use (the window in which text can be entered using the computer keyboard).

For example, the control content is a virtual key value. Since the computer system itself provides a series of shortcuts for controlling the PPT and multimedia, the virtual key value of each control icon shown in fig. 9A to 10 can be set according to the key value of the shortcuts for controlling the PPT and multimedia in the computer system. The second application software can control the second processor to simulate the pressing and releasing actions of the corresponding shortcut key according to the received virtual key value, so as to realize the control of the multimedia and the PPT. For example, in fig. 9A, the virtual key value of the "previous" control icon is 33, the virtual key value of the "next" control icon is 34, the virtual key value of the "play/pause" control icon is 179, the virtual key value of the "previous track" control icon is 177, the virtual key value of the "next track" control icon is 176, the virtual key value of the "volume+" control icon is 175, and the virtual key value of the "volume-" control icon is 174. The first application software may control the first processor to transmit the virtual key value to the second processor through a Socket protocol. The second application software can control the second processor to send out the simulated clicking operation of the corresponding shortcut key according to the received virtual key value, and further realize the corresponding control function.

For example, the control content is step change data. When a user's finger slides in a control icon of a mouse control area, a coordinate change process is generated, the coordinate change process can be converted into change data containing a step length moving up, down, left and right, the first application software can control the first processor to transmit the step length change data to the second processor through a socket protocol, and the second application software can control the second processor to conduct coordinate conversion on the step length change data, and a simulated mouse movement signal is transmitted according to the converted step length change data, so that movement of a mouse pointer is realized. The conversion rule for the second application software to control the second processor to perform coordinate conversion on the step change data may be set based on the coordinate system of the control icon of the "mouse control area" and the coordinate system of the mouse control area on the computer.

Referring to fig. 12, a flowchart of a method for interaction between a mobile terminal and a computer in a preferred embodiment of the invention is shown. The method is used for enabling the computer to serve as auxiliary equipment of the mobile terminal. It will be appreciated that the order of the steps in the flow chart may be changed and certain steps may be omitted, depending on the requirements

It will be appreciated that in this embodiment, the data interaction between the mobile terminal and the computer is implemented based on the bluetooth protocol, so the wireless communication connection in this embodiment is preferably referred to as a bluetooth connection.

And step S15, controlling the first processor to acquire a call book of the mobile terminal, and transmitting the call book to the second processor through a Bluetooth HTP (handles-free Profile) protocol.

It may be appreciated that in this embodiment, the first application software has a "call" icon, and when the "call" icon is turned on, the first application software controls the first processor to obtain a call book of the mobile terminal, and transmits the call book to the second processor through a bluetooth HTP protocol, and the second application software may output and display the call book received by the second processor, so as to realize synchronous display of the call book of the mobile terminal on the computer.

Step S16, the second processor is controlled to acquire a telephone operation instruction aiming at the call book on the computer, and the telephone operation instruction is transmitted to the first processor through a Bluetooth HTP protocol, so that the first application software controls the first processor to execute an operation corresponding to the telephone operation instruction.

It will be appreciated that in this embodiment, the second application software also has a "talk" icon thereon, and when the "talk" icon is illuminated, the user can operate the talk book displayed by the second application software on the computer. The second application software can control the second processor to acquire the operation of the user on the phonebook displayed on the computer and transmit the phone operation instruction to the first processor, and the first application software can control the first processor to execute corresponding phone functions, such as answering a phone and dialing a phone, according to the phone operation instruction.

For example, when the mobile terminal has an incoming call, the second application software synchronously displays current incoming call information of the mobile terminal, when a user clicks an answer icon on the second application software, an answer operation instruction can be generated, the second application software controls the second processor to transmit the answer operation instruction to the first processor through a bluetooth HTP protocol, and the first application software can control the first processor to execute phone answering according to the answer operation instruction.

It can be understood that in this embodiment, when the user dials or receives a call on the computer, the second application software may control the second processor to obtain the speaking voice of the user collected by the microphone of the computer, and transmit the speaking voice of the user to the first processor through the bluetooth HTP protocol, and the first application software may transmit the speaking voice of the user to the call system of the mobile terminal by the first processor, so as to further implement transmission to the far-end call user. Similarly, the first application software can control the first processor to communicate with the communication system of the mobile terminal, so as to obtain the voice of the far-end communication user, and transmit the voice of the far-end communication user to the second processor through the Bluetooth HTP protocol, and the second application software can control the second processor to play the voice of the far-end communication user through a loudspeaker of the computer.

And step S17, controlling the first processor to acquire the audio information currently played by the mobile terminal, and transmitting the audio information to the second processor through a Bluetooth A2DP (Advanced Audio Distribution Profile) protocol, so that the second application software controls the second processor to play the audio information through a loudspeaker of a computer.

It can be appreciated that in this embodiment, a sound playing icon is provided on both the first application software and the second application software. When the icon of sound playing on the first application software is lightened, the first application software can control the first processor to acquire the audio information currently played by the mobile terminal, and the audio information can be generated by playing music playing software or video playing software started on the mobile terminal. The first application software may control the first processor to transmit the audio information to the second processor through a bluetooth A2DP protocol. When the sound playing icon on the second application software is lightened, the second application software can control the second processor to play the received audio information through a loudspeaker of the computer.

For example, the user opens a music play APP on the mobile terminal and selects to play a song, and the first application software may control the first processor to obtain audio information of the song and transmit the audio information to the second processor through bluetooth A2DP protocol. The second application software controls the second processor to play the received audio information of the song through a loudspeaker of the computer.

Step S18, the second processor is controlled to acquire a trigger event of an input device of the computer, the trigger event of the input device is converted into a control instruction matched with a Bluetooth HID protocol, and the control instruction is transmitted to the first processor through the Bluetooth HID protocol, so that the first application software controls the first processor to execute an operation corresponding to the control instruction.

It is understood that in this embodiment, the input device may be a keyboard, a mouse, or a touch pad of a computer. The first application software and the second application software are respectively provided with a keyboard icon, when the keyboard icons on the second application software are lightened, the second application software can control the second processor to call Global Hook to monitor the triggering event of the input device and convert the triggering event of the input device into a control instruction based on the Bluetooth HID protocol, and the second application software can control the second processor to transmit the converted control instruction to the first processor through the Bluetooth HID protocol. The first application software can control the first processor to execute the operation corresponding to the control instruction according to the received control instruction, so as to realize the function of taking the input device of the computer as the Bluetooth external input device of the mobile terminal.

Referring to fig. 13, a flowchart of a method for interaction between a mobile terminal and a computer in a preferred embodiment of the invention is shown. The method is used for enabling the mobile terminal screen to be displayed in a mirror image mode to a computer, and controlling the mobile terminal through the computer. It will be appreciated that the order of the steps in the flow diagrams may be changed, and certain steps may be omitted, according to different needs.

Step S19, the first processor is controlled to monitor the current screen display content of the mobile terminal in real time, and the screen display content is transmitted to the second processor through a Socket protocol.

It may be appreciated that in this embodiment, the first application software has a "mirror image display" icon, and when the "mirror image display" icon is lightened, the first application software may control the first processor to record the screen of the mobile terminal, so as to monitor the current screen display content of the mobile terminal in real time. The first application software controls the first processor to transmit the screen recording content to the second processor through a WI-FI Socket protocol, and the second application software can output and display the screen recording content received by the second processor, so that the screen content of the mobile terminal can be displayed on the computer in real time.

It can be appreciated that, in this embodiment, since the bandwidth required for transmitting the video content is high, the bluetooth Socket bandwidth is not sufficient to support the video content transmission, so the video content transmission in this embodiment is preferably based on WI-FI Socket protocol.

It may be understood that in this embodiment, the first application software controls the first processor to record a screen of the mobile terminal and transmit the screen record to the second processor, and the second application software controls the second processor to acquire a trigger event of an input device of the computer while performing output display on the screen record received by the second processor, and converts the trigger event of the input device into a control instruction matched with a bluetooth HID protocol, and transmits the control instruction to the first processor through the bluetooth HID protocol, so that the first application software controls the first processor to perform an operation corresponding to the control instruction, so that the computer can synchronously display a desktop of the mobile terminal and simultaneously control the mobile terminal through an input device of the computer.

It can be appreciated that referring to fig. 14, an embodiment of the invention further provides a first interaction device 100 for enabling the mobile terminal to interact with the computer and a second interaction device 110 for enabling the computer to interact with the mobile terminal. The first interaction device 100 comprises a first communication module 101, a first processor 102. The second interaction device 110 comprises a second communication module 111, a second processor 112.

Wherein, the computer and the mobile terminal establish wireless communication connection with the second communication module 111 through the first communication module 101.

It will be appreciated that in this embodiment, the wireless communication connection includes, but is not limited to, a bluetooth communication connection, a WI-FI communication connection, i.e., the first communication module 101 includes, but is not limited to, a bluetooth module, a WI-FI module, etc., and the second communication module 111 includes, but is not limited to, a bluetooth module, a WI-FI module, etc. The mobile terminal is preferably in one-to-one wireless communication connection with the computer. When the mobile terminal and the computer have Bluetooth functions, the mobile terminal and the computer can be matched through Bluetooth, so that wireless communication connection is established, and when the mobile terminal and the computer have WI-FI functions, the mobile terminal and the computer can be established through a router. The router is preferably a wireless router.

In this embodiment, the mobile terminal is installed with a first application software, the first application software may control the first processor 102, the computer is installed with a second application software, and the second application software may control the second processor 112 of the computer. After the wireless communication connection is established between the mobile terminal and the computer, the first application software can communicate with the second application software, and Socket connection can be established between the mobile terminal and the computer. When there is no data transmission in the Socket connection, in order to maintain the Socket connection, the first processor 102 may transmit the heartbeat check message to the second processor 112 at intervals of a preset time, or the second processor 112 may transmit the heartbeat check message to the first processor 102 at intervals of a preset time. The format of the heartbeat check message can be defined according to actual development requirements.

When the file of the mobile terminal is selected to be shared to the computer, the first application software controls the first processor 102 to transmit the file to the second processor 112 through a Socket protocol.

It will be appreciated that in this embodiment, the Socket protocol may be a bluetooth Socket protocol or a WI-FI Socket protocol. When a user selects a file on the mobile terminal and selects to share the file with the computer, the first application software may control the first processor 102 to transmit the file to the second processor 112 through a Socket protocol, so that the computer receives the file shared by the mobile terminal. The file may refer to an office file (WORD file, PDF file, etc.), a picture, a video, etc. stored on the mobile terminal.

It will be appreciated that when the second processor 112 receives the file, the second application software may display current file receipt information.

It will be understood that the first application software controlling the first processor 102 to transfer the file to the second processor 112 through the Socket protocol may mean that the first application software controlling the first processor 102 to transfer the content data of the file to the second processor 112 through the Socket protocol. For example, when a user selects a photo a and accesses the sharing function interface by performing a touch operation on the mobile terminal, file sharing may be performed by the first application software in the sharing function interface, and then the first application software controls the first processor 102 to transmit the photo a through a Socket protocol, the second processor 112 may receive the photo a transmitted by the first processor through the Socket protocol, and the second application software may display the received information of the received photo a.

It will be appreciated that, in this embodiment, when the second processor 112 receives the file transmitted by the first processor, the second application software may automatically control the second processor 112 to save the file in a preset folder. The preset folder is the folder of the computer end. In other embodiments, the user may manually set the saving path of the file received by the second processor.

When the file in the computer is selected to be shared to the mobile terminal, the second application software controls the second processor 112 to transmit the file to the first processor 102 through a Socket protocol.

It will be appreciated that in this embodiment, the Socket protocol may also be a bluetooth Socket protocol or a WI-FI Socket protocol. When a user selects a file on the computer and selects to share the file with the mobile terminal, the second application software may control the second processor 112 to transmit the file to the first processor 102 through a Socket protocol, so that the mobile terminal receives the file shared by the computer. The file may refer to an office file (WORD file, PDF file, etc.), a picture, a video, etc. stored on the computer.

It will be appreciated that when the first processor 102 receives the file, the first application software may display current file receipt information.

It will be appreciated that the second application software controlling the second processor 112 to transfer the file to the first processor 102 through the Socket protocol may mean that the second application software controlling the second processor 112 to transfer the content data of the file to the first processor 102 through the Socket protocol.

For example, when the user performs a mouse/touch pad operation on the computer to select a photo B and enters the right-key menu through the right-key, the user may select "send file to mobile terminal" in the right-key menu, then the second application software may control the second processor 112 to transmit the photo B through the Socket protocol, the first processor 102 may receive the photo B transmitted by the second processor 112 through the Socket protocol, and the first application software may display the received information of the received photo B.

It will be appreciated that, in this embodiment, when the first processor 102 receives the file transmitted by the second processor 112, the first application software may automatically control the first processor 102 to save the file into a preset folder. The preset folder is a folder on the mobile terminal. In other embodiments, the user may manually touch the file to set the storage path of the file received by the first processor 102.

When the files in the computer are selected to be shared, the second application software controls the second processor 112 to copy the files to the designated directory of the website server.

It may be appreciated that, in this embodiment, the website server may be disposed at the computer end, the web content on the website server may be published by the second application software, and the specified directory may be a folder set in advance under the website server, where the folder is used to store the file to be shared. When a user selects a file on the computer and shares the file, the second application software may control the second processor 112 to copy the file to a specified directory of the website server. The file may refer to an office file (WORD file, PDF file, etc.), a picture, a video, etc. stored on the computer. In other embodiments, the website server may be disposed on an external network server, such as a cloud server, instead of the computer terminal.

The second application software controls the second processor 112 to display the file at the storage address of the website server in a two-dimensional code form, so that the mobile terminal can download the file by scanning the two-dimensional code.

It can be understood that in this embodiment, when the file is copied to the designated directory of the website server, the second application software may control the second processor 112 to output and display the file at the storage address of the website server in the form of a two-dimensional code, so that the user may use the mobile terminal to scan the two-dimensional code, thereby implementing downloading the file to the mobile terminal. In other embodiments, the second application software may further control the second processor 112 to output and display the file in the form of a bar code, a graphic code, or the like at the storage address of the website server.

It may be appreciated that in this embodiment, the mobile terminal may obtain the storage address of the file on the website server by scanning the two-dimensional code, and then download the file to a local location by using HTTP or HTTPs based on the storage address, where the local location may refer to a designated folder on the mobile terminal. In other embodiments, when the mobile terminal scans the two-dimensional code to download the file, the storage location of the file in the mobile terminal may also be set by a manual touch operation of a user.

For example, when the user performs a mouse/touch pad operation on the computer to select a photo B and enters a right-key menu through a right-key, the second application software may select "scan code sharing" in the right-key menu, then the second application software may control the second processor 112 to copy the photo B to a specified directory of the website server, after the copying of the file is completed, the second application software may display the file at a storage address of the website server in a two-dimensional code manner, and other users may scan the two-dimensional code by using an APP having a scan function on the mobile terminal to obtain the storage address of the file at the website server, and then invoke the browser to download the file to the mobile terminal locally based on HTTP or HTTPs protocol. Or directly scanning the two-dimensional code by using the scanning function of the browser and downloading the file to the local of the mobile terminal.

When the file is copied to the designated directory of the website server, the second application software controls the second processor 112 to directly transmit the storage address of the file at the website server to the first processor 102 through a Socket protocol, so that the mobile terminal downloads the file based on the storage address.

It may be appreciated that, in this embodiment, after the second application software controls the second processor 112 to copy the file to the designated directory of the website server, the second application software may further control the second processor 112 to transmit the storage address of the file at the website server to the first processor 102 of the mobile terminal through the Socket protocol, and the first application software may display the storage address received by the first processor 102. When the first processor 102 receives the storage address of the file, the first application software may invoke the browser to download the file to a specified folder based on the HTTP protocol or the HTTPs protocol. For example, when the second processor 112 transmits the storage address of the file at the website server to the first processor 102 through Socket protocol, the storage address may be copied to a browser by a user of the mobile terminal to download the file from the website server and save the file, or the user of the mobile terminal may directly click on the storage address to automatically invoke the browser to access the website server and download the file from the website server and save the file.

For example, when the user performs a mouse/touch pad operation on the computer to select a photo B and enters a right-key menu through a right-key, the user may select "file sharing" in the right-key menu, then the second application software may control the second processor 112 to copy the photo B to a specified directory of the website server, after the copying of the file is completed, the second application software may also control the second processor 112 to transmit the storage address of the file at the website server to the first processor 102 through a Socket protocol, and the first application software may output the received information of the storage address of the photo B received by the first processor 102, and the user may use the mobile terminal to open a browser to download the file to the mobile terminal based on the storage address. In other embodiments, the first application software may also directly invoke the browser to download the file to the mobile terminal locally based on the storage address.

It will be appreciated that the user may pre-configure a directory of files on the computer for viewing by the mobile terminal.

It can be understood that in this embodiment, the user may designate those file directories on the computer in advance, so as to provide the mobile terminal with browsing, and further ensure security and privacy of other files stored in the computer. For example, the user may configure a file directory on the computer for viewing by the mobile terminal with or without the second application software.

For example, the user may newly create one or more folders for sharing browsing on the computer, where the one or more folders are file directories for browsing by the mobile terminal. Multiple files and subfolders can be stored under each folder, and multiple files and subfolders can be stored under subfolders. The user may also configure one or more folders stored on the computer itself as a directory of files for viewing by the mobile terminal.

The second application software controls the second processor 112 to obtain the directory structure of the file directory and the files under the file directory, and transmits the file structure and the files to the first processor 102 through a Socket protocol.

It can be appreciated that in this embodiment, the second application software may control the second processor 112 to obtain the directory structure of the file directory and the files under the file directory, and transmit the obtained file directory and the files to the first processor 102 through a Socket protocol. The first processor 102 may receive the directory structure of the file directory and the files under the file directory transmitted by the second processor 112 through a Socket protocol, and may parse the directory structure, thereby implementing browsing of the file directory and the files under the file directory.

For example, the user configures a folder a on the computer as a file directory for browsing by the mobile terminal, and the second application software may control the second processor 112 to obtain the directory structure of the folder a and the files under the folder a, and transmit them to the first processor 102 through a Socket protocol. The first processor 102 may receive the directory structure of the folder a and the files under the folder a transmitted by the second processor 112 through a Socket protocol, and analyze the directory structure, and the first application software may display the directory structure of the folder a and the files under the folder a analyzed by the first processor 102, so that a user may use the mobile terminal to view the folder a and the files under the folder a at the computer end.

It can be understood that, in this embodiment, after the file directory for browsing by the mobile terminal is configured, the mobile terminal may also be enabled to browse the files at the computer end by the following manner: the second application software controls the second processor 112 to copy the directory structure of the file directory and the files under the file directory to the designated directory of the website server. The mobile terminal can access the website server by using a browser based on the HTTP protocol or the HTTPS protocol, so that online browsing of the file catalogue and files under the file catalogue is realized. For example, the second application software controls the second processor 112 to copy the directory structure of the file directory and the file under the file directory to the designated directory of the website server, and transmits the storage address of the file directory to the first processor 102 through a Socket protocol, and the first application software may output and display the storage address received by the first processor 102, so that the user may use the mobile terminal to access the website server based on the storage address of the file directory to view the file directory and the file under the file directory.

It is understood that the user may configure a file directory for browsing by the computer on the mobile terminal in advance.

It can be understood that in this embodiment, the user may designate those file directories on the mobile terminal in advance, so as to provide the computer with browsing, and further ensure security and privacy of other files stored in the mobile terminal. For example, a user may configure a file directory on the mobile terminal for viewing by the computer with or without the first application software. For example, the user may newly establish one or more folders for sharing browsing on the mobile terminal, where the one or more folders are file directories for browsing by the computer. Multiple files and subfolders can be stored under each folder, and multiple files and subfolders can be stored under subfolders. The user may also configure one or more folders stored on the mobile terminal itself as a directory of files for viewing by the computer.

The first application software controls the first processor 102 to obtain the directory structure of the file directory and the files under the file directory, and transmits the directory structure and the files to the second processor 112 through a Socket protocol.

It can be appreciated that, in this embodiment, the first application software controls the first processor 102 to obtain the directory structure of the file directory and the files under the file directory, and transmit the obtained file structure and files to the second processor 112 through a Socket protocol. The processor 112 may receive the directory structure of the file directory and the files under the file directory transmitted by the first processor 102 through a Socket protocol, and analyze the directory structure, so as to browse the file directory and the files under the file directory.

For example, the user configures a folder B on the mobile terminal as a file directory for browsing by the computer, and the first application software may control the first processor 102 to obtain the directory structure of the folder B and the files under the folder B, and transmit the directory structure and the files under the folder B to the second processor 112 through a Socket protocol. The second processor 112 may receive the directory structure of the folder B and the files under the folder B transmitted by the first processor 102 through a Socket protocol, and analyze the directory structure, and the second application software may display the directory structure of the folder B and the files under the folder B analyzed by the second processor 112, so that a user may use the computer to view the folder B of the mobile terminal and the files under the folder B.

The second application software controls the second processor 112 to obtain the content of the clipboard of the computer and transmit the content of the clipboard to the first processor 102 through a Socket protocol, so that the first application software controls the first processor 102 to synchronize the content of the clipboard of the computer to the clipboard of the mobile terminal.

It may be appreciated that, in this embodiment, the second application software has a "clipboard synchronization to mobile terminal" function icon, and when the "clipboard synchronization to mobile terminal" function icon on the second application software is clicked, the second application software controls the second processor 112 to acquire the content of the clipboard of the computer, and transmits the acquired content of the clipboard to the first processor 102 through a Socket protocol. The first processor 102 may receive the content of the clipboard of the computer through a Socket protocol, and the first application software may control the first processor 102 to synchronize the content of the clipboard of the computer to the clipboard of the mobile terminal, so that the content of the clipboard of the computer may be synchronized to the clipboard of the mobile terminal. In other embodiments, when the first processor 102 receives the contents of the clipboard of the computer, the first application software may output a clipboard-synchronized alert message to alert the user of the mobile terminal.

For example, if the user performs the copy or cut operation on a certain content C on the computer, clicks the function icon of "clipboard synchronization to mobile terminal" on the second application software, the second application software controls the second processor 112 to obtain the content stored in the clipboard of the computer, and transmits the obtained content of the clipboard to the first processor 102 through the Socket protocol. The first application software may control the first processor 102 to synchronize the received content of the clipboard of the computer to the clipboard of the mobile terminal, where the user may directly perform a paste operation on the mobile terminal, and the pasted content is content C.

It will be appreciated that, in other embodiments, after the function icon of "clipboard synchronize to mobile terminal" is turned on, the second application software may control the second processor 112 to acquire the content of the clipboard of the computer at intervals of a preset time, and transmit the acquired content of the clipboard to the first processor 102 through Socket protocol. If the "clipboard synchronize to mobile terminal" function icon is not illuminated, the second application software does not control the second processor 112 to obtain the content of the clipboard of the computer.

The first application software controls the first processor 102 to obtain the content of the clipboard of the mobile terminal and transmit the content of the clipboard to the second processor 112 through a Socket protocol, so that the second application software controls the second processor 112 to synchronize the content of the clipboard of the mobile terminal to the clipboard of the computer.

It will be appreciated that in this embodiment, the first application software has a "clipboard synchronize to computer" function icon. When the function icon of "clipboard synchronize to computer" on the first application software is clicked, the first application software controls the first processor 102 to obtain the content of the clipboard of the mobile terminal, and transmits the obtained content of the clipboard to the second processor 112 through a Socket protocol. The second processor 112 may receive the content of the clipboard of the mobile terminal through a Socket protocol, and the second application software may control the second processor 112 to synchronize the content of the clipboard of the mobile terminal to the clipboard of the computer, so that the content of the clipboard of the mobile terminal may be synchronized to the clipboard of the computer. In other embodiments, when the second processor 112 receives the contents of the clipboard of the mobile terminal, the second application software may also output a clipboard-synchronized alert message to alert the user of the computer.

For example, if the user performs the copy or cut operation on a certain content D on the mobile terminal, clicks the "clipboard synchronization to computer" function icon on the first application software, the first application software controls the first processor 102 to obtain the content stored in the clipboard of the mobile terminal, and transmits the obtained content of the clipboard to the second processor 112 through a Socket protocol. The second application software controls the second processor 112 to synchronize the received content of the clipboard of the mobile terminal to the clipboard of the computer, and at this time, the user can directly perform a pasting operation on the computer, where the pasted content is content D.

It will be appreciated that, in other embodiments, after the "clipboard to computer" function icon is turned on, the first application software may control the first processor 102 to acquire the content of the clipboard of the mobile terminal at intervals of a preset time, and transmit the acquired content of the clipboard to the second processor 112 through a Socket protocol. If the "clipboard synchronize to computer" function icon is not illuminated, the first application software does not control the first processor 102 to obtain the content of the clipboard of the mobile terminal.

Wherein one or more control interfaces entered in response to user operation are preconfigured on the first application software.

As shown in fig. 9A, the PPT control interface in the general control mode includes a "previous page" control icon, a "next page" control icon, a "full screen" control icon, a "return" control icon, a "mouse control area" control icon, a "left click" control icon, and a "right click" control icon. The control icons are in one-to-one correspondence with a virtual key value, each virtual key value corresponds to a computer control instruction, and the control modes of the control icons are click operation, so that the control instructions are triggered. The control icon of the 'mouse control area' is used for controlling the movement of the computer mouse pointer, the control mode of the 'mouse control area' control icon is sliding operation, when a user performs sliding operation on the 'mouse control area' control icon, a coordinate change process can be generated, and the coordinate change process can be converted into step change data comprising up-down and left-right movement. As shown in fig. 9B, the PPT control interface in the gesture control mode may control the page turning of the PPT by shaking the mobile terminal, for example, shaking the mobile terminal up once to control the PPT to turn up and shaking the mobile terminal down once to control the PPT to turn down. When the first application software responds to the user operation to enter the PPT control interface of the gesture control mode, the first application software can control the first processor 102 to read the sensing data of the sensors (such as a gyroscope and an acceleration sensor) of the mobile terminal so as to obtain the shaking direction of the mobile terminal. The PPT control interface in the gesture control mode comprises an exit control icon, the control mode of the control icon is clicking operation, and when the exit control icon is clicked, the PPT control interface in the gesture control mode can be controlled to exit by the mobile terminal.

As shown in fig. 9C, the PPT control interface in the voice control mode is a PPT control interface in which the PPT can be controlled to turn pages by voice, for example, a voice command "Next page" or "please turn Next page" is used to control the PPT to turn pages down, and a voice command "Last page" or "please turn Last page" is used to control the PPT to turn pages up. When the first application software responds to the user operation to enter the PPT control interface of the sound control mode, the first application software can control the first processor 102 to read the sound collected by the microphone of the mobile terminal and perform voice recognition to realize receiving the sound instruction of the user. The PPT control interface in the sound control mode comprises an exit control icon, the control mode of the control icon is clicking operation, and when the exit control icon is clicked, the PPT control interface in the sound control mode can be controlled to exit by the mobile terminal.

It will be appreciated that, in other embodiments, when the computer is provided with a voice control system (supporting voice control functions), the one or more control interfaces may further include a voice control interface, and when the first application software responds to a user operation to enter the voice control interface, the first application software may control the first processor 102 to read the sound collected by the microphone of the mobile terminal and perform voice recognition to implement receiving a voice command of the user, where the voice command includes, but is not limited to, a command for opening or closing an application program on the computer, a command for zooming in/out a page or a picture on the computer, a command for searching a browser on the computer, and the like. The first application software may control the first processor 102 to perform voice recognition on the user voice command to obtain a voice recognition result, and transmit the voice recognition result to the second processor 112. The second application software may control the second processor 112 to call a system API to enable the voice control system, and transmit the received voice recognition result to the voice control system for execution, so as to implement corresponding voice control.

The first application software controls the first processor 102 to collect control content on the control interface, and transmits the control content to the second processor 112 through a Socket protocol, so that the second application software controls the second processor 112 to execute an operation corresponding to the control content.

It will be appreciated that in this embodiment, the control content may include virtual key values, text, voice content, and step change data. The first application software may control the first processor 102 to collect control content on the control interface and transmit the control content to the second processor 112 through a Socket protocol.

It will be appreciated that when the control content is a virtual key or text, the first application software may control the first processor 102 to directly transfer the virtual key or text to the second processor 112. When the control content is voice content, the first application software may control the first processor 102 to perform voice recognition on the voice content, and then transmit the voice recognition result to the second processor 112. When the control content is step change data, the first application software may control the first processor 102 to convert the step change data into a step of a computer display interface, and then transmit the converted step change data to the second processor 112. In other embodiments, the first application software may also control the first processor 102 to directly transmit the step change data to the second processor 112, and the second application software controls the second processor 112 to perform step conversion operation, or directly transmit the voice content to the second processor 112, and the second application software controls the second processor 112 to perform voice recognition.

It will be appreciated that, in this embodiment, when the second processor 112 receives the control content transmitted by the first processor 102 through the Socket protocol, the computer may be controlled to execute the operation corresponding to the control content according to the control content.

For example, the control content is text, and the first application software controls the first processor 102 to transmit the text to the second processor 112 through a Socket protocol. The second application software may control the second processor 112 to call a system API to output the text to a window currently in focus on the computer. The window with focus preferably refers to the window currently activated at the computer end and set on top, i.e. the window in use (the window in which text can be entered using the computer keyboard).

For example, the control content is a virtual key value. Since the computer system itself provides a series of shortcuts for controlling the PPT and multimedia, the virtual key value of each control icon shown in fig. 9A to 10 can be set according to the key value of the shortcuts for controlling the PPT and multimedia in the computer system. The second application software may control the second processor 112 to simulate the pressing and releasing actions of the corresponding shortcut key according to the received virtual key value, so as to control the multimedia and the PPT. For example, in fig. 9A, the virtual key value of the "previous" control icon is 33, the virtual key value of the "next" control icon is 34, the virtual key value of the "play/pause" control icon is 179, the virtual key value of the "previous track" control icon is 177, the virtual key value of the "next track" control icon is 176, the virtual key value of the "volume+" control icon is 175, and the virtual key value of the "volume-" control icon is 174. The first application software may control the first processor 102 to transmit the virtual key value to the second processor 112 through a Socket protocol. The second application software may control the second processor 112 to send out a corresponding simulated clicking operation of the shortcut key according to the received virtual key value, so as to implement a corresponding control function.

For example, the control content is step change data. When a user's finger slides in the control icon of the mouse control area, a coordinate change process is generated, the coordinate change process can be converted into change data containing a step length moving up, down, left and right, the first application software can control the first processor 102 to transmit the step length change data to the second processor 112 through a socket protocol, and the second application software can control the second processor 112 to perform coordinate conversion on the step length change data, and transmit a simulated mouse movement signal according to the converted step length change data, so that movement of a mouse pointer is realized. The conversion rule for the second application software to control the second processor 112 to perform coordinate conversion on the step change data may be set based on the coordinate system of the control icon of the "mouse control area" and the coordinate system of the mouse control area on the computer.

The first application software controls the first processor 102 to obtain a phonebook of the mobile terminal, and transmits the phonebook to the second processor through a bluetooth HTP protocol.

It may be appreciated that in this embodiment, the first application software has a "call" icon, and when the "call" icon is turned on, the first application software controls the first processor 102 to obtain the call book of the mobile terminal, and transmits the call book to the second processor 112 through the bluetooth HTP protocol, and the second application software may output and display the call book received by the second processor 112, so as to realize synchronous display of the call book of the mobile terminal on the computer.

The second application software controls the second processor 112 to obtain a phone operation instruction for the phonebook on the computer, and transmits the phone operation instruction to the first processor 102 through a bluetooth HTP protocol, so that the first application software controls the first processor 102 to execute an operation corresponding to the phone operation instruction.

It will be appreciated that in this embodiment, the second application software also has a "talk" icon thereon, and when the "talk" icon is illuminated, the user can operate the talk book displayed by the second application software on the computer. The second application software may control the second processor 112 to obtain the operation of the user on the phonebook displayed on the computer and transmit the phone operation instruction to the first processor 102, and the first application software may control the first processor 102 to execute the corresponding phone function according to the phone operation instruction, such as answering a phone call and making a phone call.

For example, when the mobile terminal has an incoming call, the second application software may synchronously display current incoming call information of the mobile terminal, and when the user clicks the answer icon on the second application software, an answer operation instruction may be generated, the second application software controls the second processor 112 to transmit the answer operation instruction to the first processor 102 through the bluetooth HTP protocol, and the first application software may control the first processor 102 to execute answering according to the answer operation instruction.

It can be understood that, in this embodiment, when the user makes or receives a call on the computer, the second application software may control the second processor 112 to obtain the speaking voice of the user collected by the microphone of the computer and transmit the speaking voice of the user to the first processor 102 through the bluetooth HTP protocol, and the first application software may transmit the speaking voice of the user to the communication system of the mobile terminal by the first processor 102, so as to realize transmission to the far-end communication user. Similarly, the first application software may control the first processor 102 to communicate with the call system of the mobile terminal, so as to obtain the voice of the far-end call user, and transmit the voice of the far-end call user to the second processor 112 through the bluetooth HTP protocol, and the second application software may control the second processor 112 to play the voice of the far-end call user through the speaker of the computer.

The first application software controls the first processor 102 to obtain the audio information currently played by the mobile terminal, and transmits the audio information to the second processor 112 through a bluetooth A2DP (Advanced Audio Distribution Profile) protocol, so that the second application software controls the second processor 112 to play the audio information through a speaker of a computer.

It can be appreciated that in this embodiment, a sound playing icon is provided on both the first application software and the second application software. When the "sound playing" icon on the first application software is lightened, the first application software may control the first processor 102 to obtain the audio information currently played by the mobile terminal, where the audio information may be generated by playing music playing software or video playing software started on the mobile terminal. The first application software may control the first processor 102 to transmit the audio information to the second processor 112 via the bluetooth A2DP protocol. When the "sound playing" icon on the second application software is illuminated, the second application software may control the second processor 112 to play the audio information received by the second processor through the speaker of the computer.

For example, the user may start a music playing APP on the mobile terminal and select to play a song, and the first application software may control the first processor 102 to obtain audio information of the song and transmit the audio information to the second processor 112 through bluetooth A2DP protocol. The second application software controls the second processor 112 to play the received audio information of the song through the speaker of the computer.

The second processor 112 of the second application software controls the second processor 112 to acquire a trigger event of an input device of the computer, converts the trigger event of the input device into a control instruction matched with a bluetooth HID protocol, and transmits the control instruction to the first processor 102 through the bluetooth HID protocol, so that the first application software controls the first processor 102 to execute an operation corresponding to the control instruction.

It is understood that in this embodiment, the input device may be a keyboard, a mouse, or a touch pad of a computer. The first application software and the second application software are both provided with a keyboard icon, when the keyboard icon on the second application software is lightened, the second application software can control the second processor 112 to call Global Hook to monitor the triggering event of the input device and convert the triggering event of the input device into a control instruction based on a bluetooth HID protocol, and the second application software can control the second processor 112 to transmit the converted control instruction to the first processor 102 through the bluetooth HID protocol. The first application software may control the first processor 102 to execute an operation corresponding to the control instruction according to the received control instruction, so as to implement a function of using the input device of the computer as the bluetooth external input device of the mobile terminal.

The first application software controls the first processor 102 to monitor the current screen display content of the mobile terminal in real time, and transmits the screen display content to the second processor 112 through a Socket protocol.

It may be appreciated that in this embodiment, the first application software has a "mirror image display" icon, and when the "mirror image display" icon is lightened, the first application software may control the first processor 102 to record the screen of the mobile terminal, so as to monitor the current screen display content of the mobile terminal in real time. The first application software controls the first processor 102 to transmit the screen recording content to the second processor 112 through a WI-FI Socket protocol, and the second application software can output and display the screen recording content received by the second processor 112, so that real-time display of the screen content of the mobile terminal on the computer is realized.

It may be understood that in this embodiment, the first application software controls the first processor 102 to record a screen of the mobile terminal and transmit the screen record to the second processor 112, and when the second application software outputs and displays the screen record received by the second processor 112, the second processor 112 is controlled to obtain a trigger event of an input device of the computer, and convert the trigger event of the input device into a control instruction matched with a bluetooth HID protocol, and the control instruction is transmitted to the first processor 102 through the bluetooth HID protocol, so that the first application software controls the first processor 102 to execute an operation corresponding to the control instruction, so that the computer can synchronously display a desktop of the mobile terminal, and at the same time, the mobile terminal can also be controlled through an input device of the computer.

It should be understood that referring to fig. 15, another embodiment of the present invention further provides a mobile terminal 200 and a computer 210. The mobile terminal 200 comprises a first communication module 101, a first memory 103, a first processor 102, a first memory 103 and a first computer program 104 stored in the first memory 103 and executable on the first processor 102. The computer 210 includes a second communication module 111, a second processor 112, a second memory 113, and a second computer program 114 stored in the second memory 113 and executable on the second processor 112.

The mobile terminal 200 may be a mobile phone, tablet computer, smart watch, etc. It will be appreciated by those skilled in the art that the diagram is merely an example of the mobile terminal 200 and is not limiting of the mobile terminal 200, and may include more or fewer components than shown, or may combine certain components, or different components. The computer 210 may be a notebook computer, a desktop computer, or other computer device. It will be appreciated by those skilled in the art that the schematic diagram is merely an example of the computer 210 and is not limiting of the computer 210, and may include more or fewer components than shown, or may combine certain components, or different components.

Illustratively, the first computer program 104 may be program code of the first application software and the second computer program 114 may be program code of the second application software.

The first processor 102 and the second processor 112 may each be a central processing module (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. The general purpose processor may be a microprocessor, or the first processor 102, the second processor 112 may be any conventional processor, etc., where the first processor 102 is a control center of the mobile terminal 200 and connects various parts of the entire mobile terminal 200 using various interfaces and lines, and the second processor 112 is a control center of the computer 210 and connects various parts of the entire computer 210 using various interfaces and lines.

The first memory 103 may be used for storing the first computer program 104 and/or modules/units. The first processor 102 implements the various functions of the mobile terminal 200 by running or executing computer programs and/or modules/units stored in the first memory 103 and invoking data stored in the first memory 103. The first memory 103 may mainly include a stored program area and a stored data area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. The storage data area may store data (such as video data, audio data, etc.) created according to the use of the mobile terminal 200, and the like. In addition, the first memory 103 may include a high-speed random access memory, and may further include a nonvolatile memory such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other nonvolatile solid-state storage device.

The second memory 113 may be used for storing the second computer program 114 and/or modules/units. The second processor 112 performs various functions of the computer 210 by running or executing computer programs and/or modules/units stored in the second memory 113 and invoking data stored in the second memory 113. The second memory 113 may mainly include a storage program area and a storage data area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. The storage data area may store data (such as video data, audio data, etc.) created according to the use of the computer 210, etc. In addition, the second memory 113 may include a high-speed random access memory, and may further include a nonvolatile memory such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other nonvolatile solid-state storage device.

The modules/units integrated by the mobile terminal 200 and the computer 210 may be stored in a computer readable storage medium if implemented as software functional modules and sold or used as a separate product. Based on such understanding, the present invention may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, where the computer program, when executed by a processor, may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in the form of source code, executable files or in some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical signal, a software distribution medium, and so forth. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.

In the several embodiments provided in the present invention, it should be understood that the mobile terminal and the computer embodiments described above are merely illustrative, for example, the division of the modules is merely a logic function division, and other division manners may be implemented in practice.

In addition, each functional module in the embodiments of the present invention may be integrated in the same processing module, or each module may exist alone physically, or two or more modules may be integrated in the same module. The integrated modules may be implemented in hardware or in hardware plus software functional modules.

It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. Accordingly, the embodiments are to be considered in all respects as illustrative and not restrictive.

Finally, it should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications and equivalents may be made to the technical solution of the present invention without departing from the spirit and scope of the technical solution of the present invention.

Claims

1. An interaction method of a mobile terminal and a computer is applied to the mobile terminal, the mobile terminal comprises a first processor, and the computer comprises a second processor, and is characterized in that the interaction method comprises the following steps:

establishing wireless communication connection between the mobile terminal and the computer;

when the file stored by the mobile terminal is selected to be shared to the computer, controlling the first processor to transmit the file to the second processor through a Socket protocol so as to open the file on the computer; and

When the folder on the mobile terminal is set to be the computer with the access right, the first processor is controlled to transmit the directory structure of the folder and the files under the folder to the second processor through a Socket protocol.

2. The interaction method of claim 1, wherein: the interaction method further comprises the following steps:

3. The interaction method of claim 1, wherein: the mobile terminal is configured with one or more control interfaces which are accessed in response to user operation, each control interface comprises one or more control icons, each control icon corresponds to a virtual key value one by one, each virtual key value corresponds to a computer control instruction one by one, and the interaction method further comprises:

4. An interaction method as claimed in claim 3, characterized in that: the interaction method further comprises the following steps:

5. The interaction method of claim 1, wherein: the interaction method further comprises the following steps:

6. The interaction method of claim 1, wherein: the interaction method further comprises the following steps:

7. An interaction method of a computer and a mobile terminal is applied to the computer, the mobile terminal comprises a first processor, and the computer comprises a second processor, and is characterized in that the interaction method comprises the following steps:

establishing wireless communication connection between the computer and the mobile terminal, wherein the computer and the mobile terminal are in the same local area network;

when the file stored by the computer is selected to be shared to the mobile terminal, controlling the second processor to transmit the file to the first processor through a Socket protocol so as to open the file on the mobile terminal; and

When the folder on the computer is set to be the mobile terminal with the access right, the second processor is controlled to copy the directory structure of the folder and the files under the folder to a website server, so that the mobile terminal opens the folder according to the storage address of the folder on the website server, wherein the website server is deployed on the computer.

8. The interaction method of claim 7, wherein: the interaction method further comprises the following steps:

9. The interaction method of claim 7, wherein: the interaction method further comprises the following steps:

10. The interaction method of claim 7, wherein: the interaction method further comprises the following steps:

11. The interaction method of claim 7, wherein: the interaction method further comprises the following steps:

12. The interaction method of claim 7, wherein: the interaction method further comprises the following steps:

13. The interaction method of claim 7, wherein: the interaction method further comprises the following steps:

14. The interaction device of the mobile terminal and the computer is applied to the mobile terminal, the mobile terminal comprises a first communication module and a first processor, the computer comprises a second communication module and a second processor, and the interaction device is characterized in that the mobile terminal and the computer are in wireless communication connection with the second communication module through the first communication module, first application software is installed on the mobile terminal, when files stored in the mobile terminal are selected to be shared to the computer, the first application software controls the first processor to transmit the files to the second processor through a Socket protocol, so that the files are started on the computer, and when a folder on the mobile terminal is set to have access rights to the computer, the first application software is also used for controlling the first processor to transmit directory structures of the folders and files under the folders to the second processor through the Socket protocol.

15. The interactive apparatus of claim 14, wherein: when text input is selected to be performed on the computer through the mobile terminal, the first application software is further used for controlling the first processor to acquire input content of the mobile terminal, and transmitting the input content to the second processor through a Socket protocol.

16. The interactive apparatus of claim 14, wherein: the first application software comprises one or more control interfaces, each control interface comprises one or more control icons, each control icon corresponds to a virtual key value one by one, each virtual key value corresponds to a computer control instruction one by one, and when the control icons are touched, the first application software is further used for controlling the first processor to transmit the virtual key values corresponding to the control icons to the second processor through a Socket protocol.

17. The interactive apparatus of claim 16, wherein: when the control icon is a mouse control area, the first application software is further used for controlling the first processor to acquire coordinate change data generated when a touch point on the mouse control area slides, converting the coordinate change data into a step change data set containing up, down, left and right movements, and transmitting the step change data set to the second processor through a Socket protocol.

18. The interactive apparatus of claim 14, wherein: when the clipboard of the mobile terminal is selected to be shared with the computer, the first application software is further used for controlling the first processor to acquire the content of the clipboard of the mobile terminal and transmitting the content of the clipboard to the second processor through a Socket protocol.

19. The interaction device is used for interaction between a computer and a mobile terminal, the mobile terminal comprises a first communication module and a first processor, the computer comprises a second communication module and a second processor, the interaction device is characterized in that the mobile terminal and the computer are in wireless communication connection with the second communication module through the first communication module, the computer is provided with first application software, when files stored in the computer are selected to be shared to the mobile terminal, the first application software controls the second processor to transmit the files to the first processor through a Socket protocol, so that the files are started on the mobile terminal, when the folders on the computer are set to have access rights to the mobile terminal, the first application software is also used for controlling the second processor to copy directory structures of the folders and files under the folders to a website server, so that the mobile terminal starts the files on the website server according to storage addresses of the folders, and the mobile terminal and the computer are deployed on the same website server.

20. The interactive apparatus of claim 19, wherein: the first application software is further used for controlling the second processor to output and display the storage address of the file at the website server in a two-dimensional code mode, or controlling the second processor to transmit the storage address of the file at the website server to the first processor through a Socket protocol.

21. The interactive apparatus of claim 19, wherein: when receiving the input content of the mobile terminal transmitted by the first processor, the first application software is further used for controlling the second processor to call a system API of the computer to output the input content to a current focus window of the computer.

22. The interactive apparatus of claim 19, wherein: when receiving the virtual key value transmitted by the first processor, the first application software is further used for controlling the second processor to execute a control instruction corresponding to the virtual key value; when the step change data set transmitted by the first processor is received, the first application software is further used for controlling the second processor to output an analog mouse signal according to the step change data set so as to control the movement of a mouse pointer of the computer.

23. The interactive apparatus of claim 19, wherein: when the clipboard of the computer is selected to be shared with the mobile terminal, the first application software is further used for controlling the second processor to acquire the content of the clipboard of the computer, and transmitting the content of the clipboard to the first processor through a Socket protocol.

24. The interactive apparatus of claim 19, wherein: when the mobile terminal is controlled by the input device of the computer, the first application software is further used for controlling the second processor to acquire a trigger event of the input device, converting the trigger event of the input device into a control instruction matched with a Bluetooth HID protocol, and transmitting the control instruction to the first processor through the Bluetooth HID protocol.

25. An electronic device, the electronic device comprising:

a communication module;

a processor; and

a memory having stored therein computer program instructions that are executed by the processor and that perform the method of interaction of a mobile terminal with a computer as claimed in any one of claims 1 to 6 or that perform the method of interaction of a computer with a mobile terminal as claimed in any one of claims 7 to 13.

26. A computer-readable storage medium having stored thereon a computer program, characterized by: the computer readable storage medium computer program when executed by a processor implements the method of interaction of a mobile terminal with a computer as claimed in any one of claims 1 to 6 or implements the method of interaction of a computer with a mobile terminal as claimed in any one of claims 7 to 13.