WO2011140774A1

WO2011140774A1 - Method, apparatus and system for implementing interaction between mobile terminal and personal computer

Info

Publication number: WO2011140774A1
Application number: PCT/CN2010/077007
Authority: WO
Inventors: 周昊; 马震宇; 王冲; 李毅
Original assignee: 中兴通讯股份有限公司
Priority date: 2010-05-12
Filing date: 2010-09-16
Publication date: 2011-11-17
Also published as: CN101826897A; CN101826897B

Abstract

Disclosed are a method, an apparatus and a system for implementing interaction between a mobile terminal and a personal computer (PC), wherein a protocol stack and an application program are started respectively by the mobile terminal and the PC, and a wireless fidelity (Wi-Fi) connection is established between the mobile terminal and the PC, thereby an application connection is implemented (610); and the application process between the mobile terminal and the PC is implemented through high-layer protocol interaction and negotiation (620). The method, apparatus and system of the present invention implement the wireless application interaction between mobile terminals and the PCs.

Description

Method, device and system for realizing interaction between mobile terminal and PC

The present invention relates to the field of communications, and in particular, to a method, device and system for implementing interaction between a mobile terminal and a personal computer (PC) based on Wireless Fidelity (Wi-Fi). Background technique

The birth and popularity of Wi-Fi technology has played an invaluable role in short-range wireless transmission applications. More and more electronic devices have integrated Wi-Fi modules and antennas to take advantage of the 802.11x standard in a wide range. Mutual identification, networking and high bandwidth transmission. PCs and personal mobile devices (such as mobile phones) now have good support for this standard.

Most of the input and output devices of traditional PCs are also wired input and output. Some devices have realized wireless input and output, such as wireless mouse, wireless keyboard and even wireless camera, but these wireless devices mostly have the following limitations:

Function specific: For example, the keyboard can only support basic ASCII input, the mouse can only support sliding and left and right input;

Form separation: For example, the keyboard and mouse must be two devices, the scanner and camera are also two devices, and the display and speakers for output are also two devices;

There must be a specific transmission port: for example, the keyboard and mouse need USB, PS2 and other port plug-in, the display for output needs the video card VGA port, etc., the speaker needs the output port of the sound card, etc.; It is not convenient for emergency use: for example, after the user's keyboard is damaged It is not possible to implement the keystroke input for the PC in time (except for the soft keyboard provided by the operating system input method of the PC).

It can be seen that the mobile terminal is currently unable to implement effective wireless application interaction with the PC. Summary of the invention

In view of this, the main purpose of the present invention is to provide a mobile terminal based on Wi-Fi.

A method and apparatus for PC interaction to implement wireless application interaction between a mobile terminal and a PC.

Another object of the present invention is to provide a mobile terminal to interact with a PC based on Wi-Fi. To achieve the above object, the technical solution of the present invention is implemented as follows:

A method for realizing interaction between a mobile terminal and a PC based on Wi-Fi, the method comprising: establishing a Wi-Fi connection between the mobile terminal and the PC respectively starting the protocol stack and the application to implement an application connection; Negotiate to realize the application process between the mobile terminal and the PC.

The negotiation process includes at least one of the following negotiations:

The PC and the mobile terminal perform master/slave negotiation, output capability negotiation, input capability negotiation, output data format negotiation, and input data format negotiation.

The process of the output capability negotiation includes at least one of the following: the output capability negotiation is initiated by the PC, and the mobile terminal records the output capability of the PC; or, the output capability negotiation is initiated by the mobile terminal, and the output capability of the mobile terminal is recorded by the PC;

The process of the input capability negotiation includes at least one of the following: the input capability negotiation is initiated by the mobile terminal, and the PC records the input capability of the mobile terminal; or, the input capability negotiation is initiated by the PC, and the input capability of the PC is recorded by the mobile terminal;

The process of negotiating the output data format includes: initiating output data format negotiation by the PC, and recording the output data format of the PC by the mobile terminal;

The process of negotiating the input data format includes: initiating an input data format negotiation by the mobile terminal, and the PC records the input data format of the mobile terminal.

The application process includes at least one of the following:

Mobile terminal side input; PC side output; Or, PC side input; Mobile terminal side output.

The process of inputting on the mobile terminal side includes:

The protocol stack of the mobile terminal encodes the keystroke into a specific format data and sends it to the PC, and the PC receives the keystroke data and simulates the keystroke input; and/or,

The protocol stack of the mobile terminal performs multimedia coding compression on the collected data according to the input capability negotiation and the data format negotiation result in the negotiation process, and sends the completed processed data to the PC; the PC receives the data and is negotiated by the protocol stack according to the protocol stack. The data format is decoded, and the decoded data is sent to the corresponding virtual device driver.

The process of outputting the PC side includes:

The PC compresses and encodes the captured data according to the output data encoding format, and then transmits the processed data to the mobile terminal; the mobile terminal decodes the data from the PC according to the data format, and then performs corresponding processing on the processed data.

A device for implementing interaction between a mobile terminal and a PC based on Wi-Fi, the device comprising a Wi-Fi connection module, a high layer protocol stack, and an input/output data processor;

The Wi-Fi connection module is configured to establish a Wi-Fi connection with the connected peer device to support a Wi-Fi based application connection;

The high-level protocol stack is configured to perform high-level protocol interaction and negotiation with the connected peer device;

The input/output data processor is configured to implement an application process with a connected peer device.

When the high-level protocol stack performs the negotiation, it is used to perform at least one of the following:

Master/slave negotiation, output capability negotiation, input capability negotiation, output data format negotiation, and input data format negotiation with the connected peer device.

The device further includes a data compression processing module, a multimedia processing module, and a security processing module; The multimedia processing module is configured to perform multimedia processing including encoding, decoding, and format conversion on the related multimedia data according to the negotiated multimedia information;

The data compression processing module is configured to perform processing including compression and decompression on the data in a limited bandwidth;

The security processing module is configured to support transmission of confidential data.

The device is placed in the mobile phone.

The apparatus is disposed in a PC, the apparatus further comprising a virtual device driver for controlling the operating system to identify and manage the multimedia input device in the form of a virtual device.

A system for realizing interaction between a mobile terminal and a PC based on Wi-Fi, the system comprises a mobile phone and a PC each provided with a Wi-Fi connection module, a high-level protocol stack, an input/output data processor, and a virtual device driver is also set in the PC. ; among them,

The Wi-Fi connection module in the mobile phone and the PC is used to establish a Wi-Fi connection between the mobile phone and the PC to support Wi-Fi based application connection;

The high-level protocol stack in the mobile phone and the PC is used for high-level protocol interaction and negotiation between the mobile phone and the PC;

The input/output data processor in the mobile phone and the PC is used to implement an application process between the mobile phone and the PC.

The mobile phone and the PC further include a data compression processing module, a multimedia processing module, and a security processing module;

The multimedia processing module is configured to perform multimedia processing including encoding, decoding, and format conversion on the related multimedia data according to the negotiated multimedia information;

It can be seen that the present invention is based on Wi-Fi, a method, device and system for implementing interaction between a mobile terminal and a PC, Both can realize the wireless application interaction between the mobile terminal and the PC.

FIG. 1 is a system diagram of implementing a mobile terminal and interaction according to an embodiment of the present invention; FIG.

2 is a flowchart of Wi-Fi-1/O negotiation according to an embodiment of the present invention;

3 is a flow chart of inputting a mobile terminal side according to an embodiment of the present invention;

4 is a flow chart of a PC side output according to an embodiment of the present invention;

FIG. 5 is a flowchart of implementing interaction with a PC on a mobile terminal side according to an embodiment of the present invention;

FIG. 6 is a flowchart of implementing a mobile terminal and interaction according to an embodiment of the present invention. detailed description

In general, input/output (I/O) interaction between the mobile terminal and the PC can be implemented based on Wi-Fi. In addition, Wi-Fi evolution technology (such as 802.11a/b/g/n series advancement) can also be utilized to enhance wireless access range and traversal capability; and, if applicable, Wi-Fi I/ O high-level protocols are industrialized, then specific communication standards can be formed. The mobile terminals supported by the standard may include mobile phones and other mobile terminals with Wi-Fi and other systems, which can be used as input/output terminals of PCs. .

Moreover, it is possible to further consider Wi-Fi access security, encrypting data through Wi-Fi's own encryption technology and high-level protocols to achieve confidentiality, and prohibiting other illegal users from arbitrarily controlling the PC.

In the following, the interaction between the mobile phone and the PC based on Wi-Fi is taken as an example for description.

The present invention mainly relates to the following technologies:

Wi-Fi area network construction and identification technology;

A high-level protocol for I/O interaction between a mobile phone and a PC;

Personal computer operating system virtual event technology;

Audio, video collection and transmission technology; Information encryption/decryption technology.

In specific applications, you can use the Wi-Fi-enabled mobile phone as a PC's multi-function I/O device to provide users with the following services and functions:

The mobile phone provides a wireless keyboard input service for the PC;

The mobile phone provides a wireless mouse input service for the PC;

The mobile phone provides a wireless transmission picture scanning input service for the PC;

The mobile phone provides a wireless voice input service for the PC;

The mobile phone provides a wireless image capture input service for the PC;

The mobile phone provides a wireless display output service for the PC;

The phone provides a wireless sound output service for the PC.

And, the following functional entities can be set in the PC and the mobile phone respectively as shown in FIG. 1:

Wi-Fi connection module;

Input/output data processor;

Multimedia processing module;

High-level protocol stack;

Security processing module;

Data compression processing module.

In addition, a virtual device driver is also set in the PC.

The above functional entities work together to achieve the purpose of providing input and output services for the PC by using a mobile phone, for example: the user provides keyboard input and mouse input for the PC by using a mobile phone keyboard and mouse; meanwhile, the PC can also use the speaker and screen of the mobile phone. And so on to achieve their own sound and image output.

Hereinafter, each functional entity described above will be described in detail.

1. Wi-Fi connection module

The Wi-Fi connection module enables the connection between the mobile phone and the PC, where the Wi-Fi access point (Access) Point ) can be provided by a PC or by a mobile phone so that the Access Point can be searched and connected. You can choose the encryption method you use when you connect. An underlying point-to-point wireless link is implemented after the connection is completed. In the local area network, both PCs and mobile phones are assigned unique and different LAN Internet Protocol (IP) addresses.

After the connection is successful, the PC side runs the server-side service and waits for the mobile phone side to access the high-level protocol. The high-level protocol interface can be implemented based on the general Socket application interface of the Transmission Control Protocol (TCP)/IP protocol family. The main purpose of the high-level protocol access is to enable the negotiation and data transmission between the PC and the mobile phone.

2. High-level protocol stack

The high-level protocol involved in the present invention is only a preliminary concept, and the industry has not yet supported the relevant protocol standards. High-level protocols (hereinafter referred to as "protocols") are used to support Wi-Fi-based mobile phones to establish connection procedures for wireless I/O devices, identity authentication, master/slave negotiation, capability negotiation, data type negotiation for transmission, data format negotiation, Transmission control, undo connection process, etc. The details will be explained in the following aspects:

Establish a connection process: Above the TCP/IP connection built by the Wi-Fi wireless link, by input

(Input) The receiver (for example, for PC, the input is provided by the mobile phone, so the PC is the Input Recipient) to establish a Socket listening based on TCP or User Datagram Protocol (UDP) protocol, and the Socket is listening. Released on a specific port number, waiting for the Input sender (corresponding to the concept of the Input Receptor, such as a mobile phone) to access. The Input sender obtains the IP address of the listener in the LAN segment, the transport layer protocol and port number used, and connects. After the connection is completed, the handshake message is sent. After the other party responds to the handshake message, the connection process ends.

Identity authentication: After the connection is completed, the Input sender sends TCP or UDP raw data to the connected peer. The format of the original data will be constrained by the upper layer protocol. The data content is the destination message of the Wi-Fi access, such as Wi- Fi I/O. If the current connection of the Input Receptor is also for this purpose, the Input Receptor sends a confirmation message, after which the two parties will interact with the device type and design. Prepare parameters such as model.

Master/slave negotiation: It is possible to agree on the roles played by the two parties in the transmission, namely the Input Recipient and the Input Transmitter, as well as the Output Recipient and the Output Transmitter.

Capacity negotiation: Capacity negotiation can be carried out after the master-slave negotiation is completed. When using one-way transmission, the Input Receptor is the Output Transmitter (which can be exchanged, and the PC can also act as the Input Transmitter of the mobile phone). The Input Transmitter sends its own set of input capabilities to the Input Receptor, such as whether it supports keyboard input, whether it supports mouse input, whether it supports camera input, and so on. After that, the output capability negotiation is performed, that is, the output sender sends the output capability set supported by itself to the Output receiver, for example, whether the display output is supported, whether the sound output is supported, or the like. After the capability negotiation is completed, the list of capability sets of the own party and the other party is maintained in the protocol stacks of both parties, and the service capabilities provided subsequently are completely in accordance with this table.

Data Transfer Negotiation: Determines the detailed parameters of the format, data rate, type, etc. of various types of input/output data involved in the capability set. For example, keyboard events, the format of mouse events, the video format used for video input/output, and the audio format used for audio input/output. Data negotiation also contains detailed information of each type of data, such as video data, which also needs to include video size, video color type, encoding format, and so on.

Transmission Control: Responsible for controlling the transmission rate during transmission and for transmitting and receiving specific messages.

Undo the connection process: When the user needs to disconnect, first disconnect the high-level protocol and notify the communication parties, and then release the underlying link of Wi-Fi.

The above negotiation process may be varied, for example, including at least one of the following consultations:

And, in particular, the process of output capability negotiation may include at least one of the following: an output capability negotiation initiated by the PC, the mobile terminal recording the output capability of the PC; or, initiated by the mobile terminal The output capability is negotiated, and the output capability of the mobile terminal is recorded by the PC. The process of input capability negotiation may include at least one of the following: the input capability negotiation initiated by the mobile terminal, and the PC records the input capability of the mobile terminal; or, the input capability negotiation initiated by the PC, and the input capability of the PC is recorded by the mobile terminal.

3. Input/output data processor in the data processor

On the mobile phone side, when the mobile phone turns on the Wi-Fi I/O function, the program running on the mobile phone side starts to detect the user's input in the set input mode.

Keyboard mode: The phone will detect every normal keystroke of the user and convert it to the data information that the protocol can recognize and send it to the PC via Wi-Fi.

Mouse mode: The phone will detect each direction keystroke or pulley, optical mouse event of the user, and convert it into data information that can be recognized by the protocol and send it to the PC via Wi-Fi.

Camera mode: If the phone has a camera device, in this mode, the phone compresses and encodes the moving image information captured by the camera and converts it into a format supported by the protocol, and then sends it to the PC via Wi-Fi.

Scanner mode: If the phone has a camera device, in this mode, the phone compresses and encodes the still image information captured by the camera and converts it to a format supported by the protocol, and then sends it to the PC via Wi-Fi.

Microphone mode: In this mode, the mobile phone compresses and encodes the voice data collected by the microphone device into a format supported by the protocol, and then transmits it to the PC through Wi-Fi.

The role of the input data processor on the PC side is mainly: After the high-level protocol starts working, the data sent by the Input sender is processed, the input type is identified, and the Input receptor is controlled.

For keyboard input, a virtual keyboard (Virtual Key technology or Key HOOK technology) that can be controlled by a virtual device driver should be used on the PC to perform analog keyboard input to the PC.

For mouse input, a virtual mouse that can be controlled by the virtual device driver should be used on the PC (Virtual Mouse technology or Mouse HOOK technology) simulates mouse input to the computer. For other multimedia type inputs, it can be done on the PC via a virtual driver that contains virtual device drivers. The virtual driver can control the operating system to identify and manage standard multimedia input devices, but the data source of the virtual driver is the application layer and not the lower level of the operating system or even the operating system. Such a virtual driver can provide a read interface, so that other applications that call the interface are considered to be acquiring data from hardware, and in fact the data is from a TCP or UDP port established by the Input Receptor. Like a virtual camera, the captured image is actually obtained from the phone side via Wi-Fi.

4. Input/output data processor in the data processor

The regular output data of the PC can be collected and converted into a data stream that can be transmitted over Wi-Fi and that can be recognized by the mobile phone and can be actually output. For example, display interception, sound interception, etc., and the data is multimedia processed and sent to the mobile phone through the Wi-Fi communication module.

On the mobile phone side, the mobile phone parses the data type for the received data, and then calls the corresponding drive interface to achieve the output:

Display output: The received dynamic image is output through the screen of the mobile phone, and the image size can be zoomed, scrolled, and the like.

Sound output: The received sound information is output through the speaker or earphone of the mobile phone, and the volume can be adjusted.

Other outputs: As long as the human body can feel the events that can be generated by the mobile phone itself, it can be output by using the mobile phone. If the PC needs an alarm under certain conditions, the vibration output can be performed by the mobile phone vibrator.

5. Multimedia processing module

This sub-module is also deployed on the mobile phone side and the PC side, and is mainly used for encoding, decoding, and format conversion of related multimedia data according to the multimedia information obtained in the data negotiation phase. Considering the efficiency of transmission, multimedia processing modules often need to cooperate with data compression processing modules. Work to ensure the correctness, consistency and authenticity of the data transmitted by both parties in the multimedia data transmission process.

6. Data compression processing module and security processing module

The data compression processing module compresses and decompresses the data with limited bandwidth to ensure input data rates. The security processing module is mainly used for the transmission of confidential data and may not be enabled.

For the foregoing description, the operational flow of Wi-Fi-1/O negotiation can be represented as shown in FIG. 2. As can be seen from Figure 2, the PC side and the mobile phone side can first establish a Wi-Fi connection, and then the PC side establishes a Socket listening, and then the mobile phone side initiates a Socket connection and the PC side performs a Socket connection confirmation. After that, the PC side and the mobile phone side perform identity authentication and master/slave negotiation, and the PC side initiates output capability negotiation, and the mobile phone side records the output capability of the PC; the mobile phone side initiates input capability negotiation, and the PC side records the mobile phone input. ability. Moreover, the PC side can also initiate an output data format negotiation, and the mobile phone side records the output data format of the PC; the input data format negotiation is initiated by the mobile phone side, and the input data format of the mobile phone is recorded on the PC side.

Thereafter, the PC side and the handset side can enter the working state, and the input/output data and the control information can be exchanged. Moreover, either party can initiate a notification of the end of the work status, and the other party closes the corresponding high-level link.

In addition, for the foregoing description, the input flow on the mobile phone side can be represented as shown in FIG. As can be seen from FIG. 3, whether the user applies the mobile phone for ordinary keyboard keystrokes or direction keystrokes, the protocol stack on the mobile phone side can encode the keystrokes into specific format data and send them to the PC side, and the PC side receives the keystroke data and Simulate keystroke input. Similarly, whether the user applies the mobile phone to scan the picture or enter the voice, the protocol stack on the mobile phone side can perform multimedia coding compression on the collected data according to the input capability negotiation and the data format negotiation result, and send the completed processing data to the PC side. The PC side can receive the data and decode it according to the negotiated data format by the protocol stack, and then send the decoded data to the corresponding virtual device driver to ensure that the application can be obtained from the virtual device driver. Data.

Further, for the foregoing description, the output flow on the PC side can be expressed as shown in FIG. It can be seen from Fig. 4 that whether the PC side captures the screen image or the sound data, the encoding can be compressed according to the output data encoding format; of course, the frame rate and resolution can also be considered at the same time. After that, the PC side can send the completed data to the mobile phone.

The mobile phone can receive data from the PC side, decode it according to the data format, and then perform corresponding display image or play sound on the processed data.

Since the mobile phone side is usually the dominant in the process of implementing the interaction, the following describes the operation flow of the mobile phone side by taking the keyboard input and display output as an example.

Referring to FIG. 5, FIG. 5 is a flowchart of implementing interaction with a PC on a mobile terminal side according to an embodiment of the present invention, where the process includes the following steps:

Step 501: Turn on the phone Wi-Fi and connect to the PC Access Point Name (APN).

Specifically, the user activates the phone and initiates a Wi-Fi connection on the phone, and the Wi-Fi connection finds the APN of the PC and connects to the PC.

Step 502: The mobile phone starts the Wi-Fi I/O software and implements an I/O connection with the PC server. If both the mobile phone and the PC have their own input/output data processors enabled, the mobile phone and the PC can implement the above I/O connection; and the mobile phone can notify the user after completing the I/O connection.

Step 503: Input and output mode selection.

Specifically, the user can select the input/output mode provided by the mobile phone: keyboard input/display output, the mobile phone notifies the PC side of the mode selected by the user; when the PC side feedback indicates that the keyboard input and/or display is permitted through the mobile phone When outputting, the phone can notify the user of the situation.

Step 510: Select keyboard input.

Step 511: When the key is pressed on the mobile phone, the PC responds to the keystroke of the mobile phone.

Specifically, the signal on the phone will be transmitted to the PC via Wi-Fi, and the PC will respond to the learned keystroke #. Go to step 530. Step 520: Select display output.

Step 521: The PC transmits the image to be displayed to the mobile phone for display.

Specifically, the image to be displayed on the PC can be transferred to the mobile phone via Wi-Fi, and the image is displayed by the mobile phone.

Step 530: End the Wi-Fi I/O function and exit the application.

For example, after a period of time, the user terminates the input/output function of the mobile phone, and the mobile phone in turn notifies the PC of the situation, and the mobile phone and the PC end the interaction. After that, the Wi-Fi connection between the phone and the PC is disconnected and the process ends.

In general, in order to implement a technology in which a mobile terminal interacts with a PC based on Wi-Fi, it is necessary to install a corresponding application, a protocol stack, and a virtual device driver on the mobile phone side and the PC side, respectively. Moreover, after starting the protocol stack and application in the mobile phone and the PC, a Wi-Fi connection and an application connection can be established between the mobile phone and the PC; after the high-level protocol interaction and negotiation, the mobile phone and the PC can be implemented based on Wi-Fi. Application interactions including input and output.

When the user chooses to end the session, the phone disconnects the application layer from the PC and the Wi-Fi connection. It should be noted that, in the output capability negotiation process, the output capability negotiation may also be initiated by the mobile terminal, and the output capability of the mobile terminal may be recorded by the PC; during the input capability negotiation process, the input capability negotiation may also be initiated by the PC, by the mobile terminal. Record the input capabilities of the PC. Moreover, the specific application process may also include PC side input; mobile terminal side output.

As can be seen from the above process, the invention can realize the interaction between the mobile terminal and the PC based on Wi-Fi, and can be represented as shown in FIG. 6. Referring to FIG. 6, FIG. 6 is a flowchart of implementing a mobile terminal and interaction according to an embodiment of the present invention, where the process includes the following steps:

Step 610: The mobile terminal and the PC respectively start a protocol stack and an application, and establish a Wi-Fi connection between the mobile terminal and the PC to implement an application connection.

Step 620: Implement an application process between the mobile terminal and the PC through high-level protocol interaction and negotiation. In summary, the present invention is based on Wi-Fi technology for implementing mobile terminal interaction with a PC, and can implement wireless application interaction between the mobile terminal and the PC.

Specifically, the present invention can be used for the input/output mode of a PC and the human being by utilizing the multimedia and multi-input capabilities of the mobile phone and the portability, combined with the long-distance, large-bandwidth wireless performance unique to Wi-Fi technology. The machine interaction mode provides a new operational idea and has the following advantages:

Easy to deploy: Considering the popularity of mobile phones and PCs, mobile users can use wireless input without having to purchase a wireless input device.

Long communication distance: Wi-Fi's long effective transmission distance ensures that users can control without needing to be close to the PC; and unlike traditional wireless mice and keyboards, users are outdoors or even off-site (requires a wider range of wireless) Links, such as WiMAX support, can also control the PC.

Device Concentration: There is no need to purchase several different devices for different input requirements. All inputs and outputs require only one mobile phone.

Instant special device support: For PCs that don't have special devices such as scanners, cameras, microphones, etc., you only need to use a mobile phone (currently, the phone basically has a standard configuration such as a camera or a microphone) to provide temporary special device support for the PC. To enable users to instantly enjoy the services provided by these special devices.

In addition, you can use the powerful CPU of the PC to handle more complex operations. Relatively speaking, the mobile phone is only used as a client, only for inputting the required operation instructions. It simplifies the user operation and strengthens and expands the mobile phone. Features.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included. Within the scope of protection of the present invention.

Claims

Claim

A method for implementing interaction between a mobile terminal and a PC based on Wi-Fi, wherein the method comprises:

A Wi-Fi connection is established between the mobile terminal and the PC that respectively initiates the protocol stack and the application to implement the application connection; and the application process between the mobile terminal and the PC is implemented through high-level protocol interaction and negotiation.

2. The method according to claim 1, wherein the negotiation process comprises at least one of the following negotiation:

3. The method of claim 2, wherein

The method according to any one of claims 1 to 3, wherein the application process comprises at least one of the following:

Mobile terminal side input; PC side output;

Or, PC side input; Mobile terminal side output.

The method according to claim 4, wherein the process of inputting by the mobile terminal side comprises:

The method according to claim 4, wherein the process of outputting the PC side comprises:

7. A device for implementing interaction between a mobile terminal and a PC based on Wi-Fi, the device comprising: a Wi-Fi connection module, a high layer protocol stack, and an input/output data processor; wherein the Wi-Fi connection module , for establishing a Wi-Fi connection with the connected peer device to support Wi-Fi based application connection;

The device according to claim 7, wherein the high-level protocol stack performs at least one of the following when performing the negotiation:

The device according to claim 7, wherein the device further comprises a data compression processing module, a multimedia processing module, and a security processing module;

10. Apparatus according to any one of claims 7 to 9, wherein the apparatus is located in a handset.

The device according to any one of claims 7 to 9, wherein the device is disposed in a PC, the device further comprising a virtual device driver for controlling the operating system to identify and manage the multimedia input in the form of a virtual device. device.

12. A system for implementing interaction between a mobile terminal and a PC based on Wi-Fi, wherein the system comprises a mobile phone and a PC, each of which is provided with a Wi-Fi connection module, a high-level protocol stack, an input/output data processor, and a PC. Also provided with a virtual device driver;

The system according to claim 12, wherein the mobile phone and the PC further comprise a data compression processing module, a multimedia processing module, and a security processing module;

The multimedia processing module is configured to perform multimedia processing including encoding, decoding, and format conversion on the related multimedia data according to the negotiated multimedia information; The data compression processing module is configured to perform processing including compression and decompression on the data in a limited bandwidth;