CN101826897A

CN101826897A - Method, device and system for realizing communication between mobile terminal and PC

Info

Publication number: CN101826897A
Application number: CN201010172630A
Authority: CN
Inventors: 周昊; 马震宇; 王冲; 李毅
Original assignee: ZTE Corp
Current assignee: ZTE Corp
Priority date: 2010-05-12
Filing date: 2010-05-12
Publication date: 2010-09-08
Anticipated expiration: 2030-05-12
Also published as: WO2011140774A1; CN101826897B

Abstract

The invention discloses a method, a device and a system for realizing communication between a mobile terminal and a PC. A mobile terminal and a PC are utilized to respectively start a protocol stack and an application program, and a Wi-Fi connection is established between the mobile terminal and the PC, thereby realizing application connection; and the application process between the mobile terminal and the PC is realized through high-level protocol communication and negotiation. The method, the device and the system of the invention realize wireless application communication between the mobile terminal and the PC.

Description

Method, device and system for realizing interaction between mobile terminal and PC

Technical Field

The invention relates to the field of communication, in particular to a method, a device and a system for realizing interaction between a mobile terminal and a PC (personal computer) based on Wi-Fi (wireless fidelity).

Background

The emergence and popularization of Wi-Fi technology has produced immeasurable effects in the field of short-range wireless transmission applications, and more electronic devices have integrated Wi-Fi modules and antennas to perform mutual identification, networking and high-bandwidth transmission in a large range by using the 802.11x standard. Both PCs and personal mobile terminals (e.g., cell phones) currently have good support for this standard.

Most of the input and output devices of the conventional PC are wired input and output, and some devices have implemented wireless input and output, such as a wireless mouse, a wireless keyboard, and even a wireless camera, but most of the wireless devices have the following limitations:

function specific: for example, the keyboard can only support basic ASCII code input, the mouse can only support sliding, left and right key input and the like;

form separation: for example, the keyboard and mouse must be two devices, the scanner and camera also two devices, the display and the box for output also two devices;

there must be a specific transmission port: for example, a keyboard and a mouse need to be plugged with ports such as USB and PS2, a display for output needs a video card VGA port, and a sound box needs an output port of a sound card;

inconvenient emergency use: for example, the keystroke input to the PC (except for the soft keyboard provided by the operating system input method of the PC) cannot be realized in time after the user keyboard is damaged.

Therefore, the mobile terminal cannot realize effective wireless application interaction with the PC at present.

Disclosure of Invention

In view of the above, the main objective of the present invention is to provide a method and an apparatus for implementing interaction between a mobile terminal and a PC based on Wi-Fi, so as to implement wireless application interaction between the mobile terminal and the PC.

The invention also aims to provide a system for realizing the interaction between the mobile terminal and the PC based on the Wi-Fi, and also realizes the wireless application interaction between the mobile terminal and the PC.

In order to achieve the purpose, the technical scheme of the invention is realized as follows:

a method for realizing interaction between a mobile terminal and a PC based on Wi-Fi comprises the following steps:

the mobile terminal and the PC respectively start a protocol stack and an application program, and establish Wi-Fi connection between the mobile terminal and the PC to realize application connection; and realizing the application process between the mobile terminal and the PC through high-level protocol interaction and negotiation.

The negotiation process comprises:

the PC and the mobile terminal perform master/slave negotiation, output capability negotiation, input capability negotiation, output data format negotiation and input data format negotiation.

The process of the output capability negotiation comprises: initiating output capability negotiation by a PC, and recording the output capability of the PC by a mobile terminal; or, initiating output capability negotiation by the mobile terminal, and recording the output capability of the mobile terminal by the PC;

the process of the input capability negotiation comprises: initiating input capability negotiation by the mobile terminal, and recording the input capability of the mobile terminal by the PC; or, initiating input capability negotiation by the PC, and recording the input capability of the PC by the mobile terminal.

The process of output data format negotiation comprises: initiating output data format negotiation by the PC, and recording the output data format of the PC by the mobile terminal;

the process of the input data format negotiation comprises: the mobile terminal initiates input data format negotiation, and the PC records the input data format of the mobile terminal.

The application process comprises at least one of:

inputting at the mobile terminal side; PC side output;

or, PC side input; and outputting at the mobile terminal side.

The process of the mobile terminal side input comprises the following steps:

the protocol stack of the mobile terminal encodes the keystroke into data with a specific format and transmits the data to the PC, and the PC receives the keystroke data and simulates keystroke input; and/or the presence of a gas in the gas,

the protocol stack of the mobile terminal carries out multimedia coding compression on the collected data according to the input capability negotiation and data format negotiation results in the negotiation process, and sends the processed data to the PC; and the PC receives the data, decodes the data according to the negotiated data format by the protocol stack, and then sends the decoded data to the corresponding virtual equipment driver.

The process of PC side output comprises the following steps:

the PC compresses and codes the captured data according to the output data coding format and then sends the processed data to the mobile terminal; and the mobile terminal decodes the data from the PC according to the data format and then correspondingly processes the processed data.

A device for realizing interaction between a mobile terminal and a PC (personal computer) based on Wi-Fi (wireless fidelity), comprises a Wi-Fi connection module, a high-level protocol stack and an input/output data processor; wherein,

the Wi-Fi connection module is used for establishing Wi-Fi connection with a connected opposite terminal device so as to support Wi-Fi-based application connection;

the high-level protocol stack is used for carrying out high-level protocol interaction and negotiation with the connected opposite terminal device;

and the input/output data processor is used for realizing the application process between the input/output data processor and the connected opposite terminal device.

The negotiation comprises:

master/slave negotiation with a connected peer device, output capability negotiation, input capability negotiation, output data format negotiation, and input data format negotiation.

The system further comprises a data compression processing module, a multimedia processing module and a safety processing module; wherein,

the multimedia processing module is used for carrying out multimedia processing including coding, decoding and format conversion on related multimedia data according to the multimedia information obtained by negotiation;

the data compression processing module is used for processing the data under the condition of limited bandwidth, including compression and decompression;

and the security processing module is used for supporting the transmission of confidential data.

The device is arranged in a mobile phone.

The device is arranged in a PC, and further comprises a virtual device driver which is used for controlling an operating system to identify and manage the multimedia input device in the form of a virtual device.

A system for realizing interaction between a mobile terminal and a PC (personal computer) based on Wi-Fi (wireless fidelity) comprises a mobile phone and a PC, wherein the mobile phone and the PC are respectively provided with a Wi-Fi connection module, a high-level protocol stack and an input/output data processor, and the PC is also provided with a virtual equipment driver; wherein,

the Wi-Fi connection module in the mobile phone and the PC is used for establishing Wi-Fi connection between the mobile phone and the PC so as to support Wi-Fi-based application connection;

the high-level protocol stack in the mobile phone and the PC is used for carrying out high-level protocol interaction and negotiation between the mobile phone and the PC;

and the input/output data processor in the mobile phone and the PC is used for realizing the application process between the mobile phone and the PC.

The mobile phone and the PC further comprise a data compression processing module, a multimedia processing module and a safety processing module; wherein,

Therefore, the method, the device and the system for realizing the interaction between the mobile terminal and the PC based on the Wi-Fi can realize the wireless application interaction between the mobile terminal and the PC.

Drawings

FIG. 1 is a system diagram for implementing a mobile terminal and interaction according to an embodiment of the present invention;

FIG. 2 is a flow chart of a Wi-Fi-I/O negotiation according to an embodiment of the present invention;

FIG. 3 is a flowchart illustrating an input process at the mobile terminal according to an embodiment of the present invention;

FIG. 4 is a flow chart of PC side output according to an embodiment of the present invention;

FIG. 5 is a flowchart illustrating interaction with a PC implemented at a mobile terminal according to an embodiment of the present invention;

fig. 6 is a flowchart of implementing mobile terminal and interaction according to an embodiment of the present invention.

Detailed Description

In general, I/O interaction between a mobile terminal and a PC may be implemented based on Wi-Fi. In addition, the evolution technology of Wi-Fi (such as 802.11a/b/g/n series propulsion) can be utilized to enhance the wireless access range and the traversing capability; furthermore, if the Wi-Fi I/O upper layer protocol to which it is applied is industrialized, a specific communication standard may be formed, and mobile terminals supported by the standard may include mobile phones and other mobile terminals with Wi-Fi or even other standards, which may be used as input/output terminals of PCs.

Moreover, the access security of Wi-Fi can be further considered, the data is encrypted through the encryption technology of the Wi-Fi and a high-level protocol so as to achieve the purpose of confidentiality, and other illegal users are forbidden to randomly control the PC.

In the following, the description is given only by taking the example of realizing the interaction between the mobile phone and the PC based on Wi-Fi.

The invention mainly relates to the following technologies:

the Wi-Fi area network construction and identity recognition technology;

the mobile phone and the PC carry out I/O interaction;

virtual event technology of PC operating system;

audio, video acquisition and transmission techniques;

information encryption/decryption techniques.

In specific application, a mobile phone with Wi-Fi function can be used as a multifunctional I/O device of a PC to provide the following services and functions for a user:

the mobile phone provides wireless keyboard input service for the PC;

the mobile phone provides wireless mouse input service for the PC;

the mobile phone provides wireless transmission picture scanning input service for the PC;

the mobile phone provides wireless microphone sound input service for the PC;

the mobile phone provides wireless image capture input service for the PC;

the mobile phone provides wireless display output service for the PC;

the mobile phone provides wireless sound output service for the PC.

Also, the following functional entities may be provided in the PC and the mobile phone, respectively, as shown in fig. 1:

a Wi-Fi connection module;

an input/output data processor;

a multimedia processing module;

a higher layer protocol stack;

a security processing module;

and a data compression processing module.

In addition, a virtual device driver is also provided in the PC.

The above functional entities cooperate with each other to achieve the purpose of providing input and output services for a PC by using a mobile phone, for example: the user provides keyboard input and mouse input for the PC by using a keyboard, a mouse and the like of the mobile phone; meanwhile, the PC can also use the loudspeaker, the screen and the like of the mobile phone to realize the self sound and image output.

The above-described functional entities will be described in detail below.

Wi-Fi connection module

The Wi-Fi connection module realizes the connection between the mobile phone and the PC, wherein the Access Point (Access Point) of Wi-Fi can be provided by the PC or the mobile phone, so that the Access Point can be searched smoothly and connected. The encryption mode can be freely selected when the connection is carried out. After the connection is completed, a bottom layer point-to-point wireless link is implemented. In the composed local area network, the PC and the mobile phone are assigned unique and different local area network IP addresses.

After the connection is successful, the PC side runs the server side service and waits for the mobile phone side to access the high-layer protocol. The high-level protocol interface can be realized based on a general Socket application interface of a TCP/IP protocol family, and the high-level protocol access mainly aims to enable the negotiation of an input/output scheme and data transmission between the PC and the mobile phone.

2. High layer protocol stack

The high-level protocol involved in the present invention is only a preliminarily conceived concept, and the industry has no related protocol standard support yet. The high-level protocol (hereinafter referred to as "protocol") is used for supporting the Wi-Fi-based mobile phone to perform connection establishment procedures, identity authentication, master/slave negotiation, capability negotiation, data type negotiation of transmission, data format negotiation, transmission control, connection revocation procedures and the like of the wireless I/O device. The details will be explained in the following aspects:

establishing a connection flow: on a TCP/IP connection constructed by a Wi-Fi wireless link, an Input receiver (for example, for a PC, Input is provided by a mobile phone, so the PC is the Input receiver) establishes a Socket interception based on a TCP or UDP protocol, issues the Socket interception on a certain port number, and waits for an Input sender (corresponding to the concept of the Input receiver, such as the mobile phone) to access. And the Input sending body acquires the IP address of the interception party, the adopted transport layer protocol and the port number in the local area network segment, connects, sends the handshake messages after the connection is finished, and finishes the connection process after the other party responds to the handshake messages.

Identity authentication: after the connection is finished, the Input sender sends TCP or UDP original data to the opposite end of the connection, the format of the original data is restricted by a high-level protocol, and the data content is a target message of the Wi-Fi access, such as Wi-Fi I/O. If the connection of the Input receptor is also for the purpose, the Input receptor sends a confirmation message, and then the two parties will interact with parameters such as the type of the equipment, the model of the equipment and the like.

Master/slave negotiation: the roles that both parties play in transmission, i.e., Input acceptor and Input transmitter, and Output acceptor and Output transmitter, etc., can be agreed upon.

Capability negotiation: capability negotiation may occur after master-slave negotiation is complete. When unidirectional transmission is adopted, the Input receiver is the Output transmitter (in fact, the Input receiver can be exchanged, and the PC can also be used as the Input transmitter of the mobile phone). The Input transmitter transmits its own Input capability set to the Input receiver, for example, whether to support keyboard Input, whether to support mouse Input, whether to support camera Input, and the like. Then, Output capability negotiation is performed, that is, the Output transmitter transmits the Output capability set supported by itself to the Output recipient, for example, whether display Output is supported or not, whether sound Output is supported or not, and the like. After the capability negotiation is completed, the capability set lists of the own party and the opposite party are respectively maintained in the protocol stacks of the two parties, and the subsequent service capability provided is completely performed according to the tables.

And data transmission negotiation: the detailed parameters such as format, data rate, type, etc. of various types of data of input/output involved in the capability set are determined. Such as keyboard events, mouse events, video formats for video input/output, and audio formats for audio input/output, etc. The data negotiation also contains detailed information of each type of data, for example, the video data also needs to additionally contain video size, video color type, coding format and the like.

And (3) transmission control: and the system is responsible for controlling the transmission rate in the transmission process, realizing the sending and receiving of specific messages and the like.

And (3) connection revocation flow: when the user needs to release the connection, the high-level protocol connection is disconnected firstly, the two communication parties are informed, and then the bottom link of the Wi-Fi is released.

3. Input data processor in input/output data processor

On the mobile phone side, after the Wi-Fi I/O function is opened by the mobile phone, the program running on the mobile phone side starts to detect the input of the user in the set input mode.

Keyboard mode: the handset will detect each normal key stroke of the user and convert it into data information recognizable by the protocol, which is sent to the PC via Wi-Fi.

Mouse mode: the mobile phone detects each direction key stroke or pulley and optical mouse event of the user, converts the direction key stroke or pulley and optical mouse event into data information which can be identified by a protocol and sends the data information to the PC through Wi-Fi.

A camera mode: if the mobile phone has a camera device, in the mode, the mobile phone compresses and codes the dynamic image information captured by the camera, converts the dynamic image information into a format supported by a protocol, and then sends the dynamic image information to the PC through Wi-Fi.

Scanner mode: if the mobile phone has a camera device, in this mode, the mobile phone compression-encodes and converts the still image information captured by the camera into a format supported by the protocol, and then transmits the encoded still image information to the PC through Wi-Fi.

Microphone mode: in the mode, the mobile phone performs compression coding on voice data acquired by the microphone device, converts the voice data into a format supported by a protocol, and sends the voice data to the PC through Wi-Fi.

The input data processor on the PC side functions mainly as: after the high-level protocol starts to work, the data sent by the Input sender is processed, the Input type is identified, and the Input receiver is controlled.

For keyboard input, Virtual keys (Virtual Key technology or Key HOOK technology) which can be controlled by a Virtual device driver should be used on the PC to simulate keyboard input to the PC.

For Mouse input, a Virtual Mouse (Virtual Mouse technology or Mouse HOOK technology) capable of being controlled by a Virtual device driver should be used on the PC to simulate Mouse input to the computer.

For other multimedia types of input, this may be done on the PC through a virtual driver that includes a virtual device driver. The virtual driver may control the operating system to recognize and manage standard multimedia input devices, but the data source of the virtual driver is the application layer and not the operating system or even lower layers of the operating system. A virtual driver of the type described above may provide a read interface that allows other applications that call the interface to be thought of as fetching data from hardware, where in fact the data comes from a TCP or UDP port established by the Input recipient. Such as a virtual camera, whose captured images are actually obtained from the handset side via Wi-Fi.

4. Output data processor in input/output data processor

The regular output data of the PC can be collected and converted into a data stream that can be transmitted through Wi-Fi and recognized by the handset and can be actually output. For example, display interception, sound interception and the like are carried out, multimedia processing is carried out on the data, and then the data are sent to the mobile phone through the Wi-Fi communication module.

On the mobile phone side, the mobile phone analyzes the data type of the received data, and then calls a corresponding driving interface to realize output:

and (3) outputting by a display: and outputting the received dynamic image through a mobile phone screen, wherein the size of the image can be scaled and scrolled, and the like.

And (3) sound output: the received sound information is output through a loudspeaker or an earphone of the mobile phone, and the volume can be adjusted.

And other outputs are as follows: if the human body can feel the events which can be generated by the mobile phone, the mobile phone can be used for outputting, and if the PC needs to give an alarm under a certain state, the mobile phone can be used for outputting vibration through a mobile phone vibrator.

5. Multimedia processing module

The submodules are also deployed at the mobile phone side and the PC side and are mainly used for coding, decoding, format conversion and the like of related multimedia data according to the multimedia information obtained in the data negotiation stage. In consideration of the transmission efficiency, the multimedia processing module often needs to work in cooperation with the data compression processing module to ensure data correctness, continuity and authenticity of both transmission parties in the transmission process of the multimedia data.

6. Data compression processing module and safety processing module

The data compression processing module can compress and decompress data under the condition of limited bandwidth to ensure the input data rate. The security processing module is mainly used for transmitting secret data and can not be started.

With respect to the foregoing description, the operational flow of Wi-Fi-I/O negotiation may be represented as shown in FIG. 2. As shown in fig. 2, the PC side and the mobile phone side may first establish a Wi-Fi connection, and then the PC side establishes Socket listening, and then the mobile phone side initiates Socket connection and the PC side confirms Socket connection. Then, the PC side and the mobile phone side perform identity authentication and master/slave negotiation, the PC side initiates output capability negotiation, and the mobile phone side records the output capability of the PC; and initiating input capability negotiation by the mobile phone side, and recording the input capability of the mobile phone by the PC side. Moreover, the PC side can also initiate output data format negotiation, and the mobile phone side records the output data format of the PC; the mobile phone side initiates negotiation of input data format, and the PC side records the input data format of the mobile phone.

After that, the PC side and the mobile phone side can enter into the working state and can carry out the interaction of input/output data and control information. And any party can initiate the notice of finishing the working state, and the other party closes the corresponding high-level link.

In addition, with respect to the foregoing description, the input flow on the mobile phone side may be represented as shown in fig. 3. As can be seen from fig. 3, no matter the user uses the mobile phone to perform normal keyboard keystroke or direction key keystroke, the protocol stack on the mobile phone side can encode the keystroke into specific format data and send the data to the PC side, and the PC side receives the keystroke data and simulates keystroke input. In the same way, no matter the user uses the mobile phone to scan the picture or input the voice, the protocol stack at the mobile phone side can perform multimedia coding compression on the collected data according to the input capability negotiation and data format negotiation result, and send the processed data to the PC side; the PC side can receive the data, the protocol stack decodes the data according to the negotiated data format, and then the decoded data is sent to the corresponding virtual device driver, so that the application program can obtain the data from the virtual device driver.

Also, with respect to the foregoing description, the output flow on the PC side can be represented as shown in fig. 4. As can be seen from fig. 4, whether the PC side captures a screen image or sound data, it is possible to compress the code according to the output data coding format; of course, both frame rate and resolution may also be considered. After that, the PC side can transmit the data whose processing is completed to the handset.

The mobile phone can receive the data from the PC side, decode the data according to the data format, and then perform corresponding processing such as image display or sound playing on the processed data.

Since the mobile phone side is usually used as the leading factor in the process of implementing interaction, the following description will briefly describe the operation flow of the mobile phone side by taking the mobile phone as an example to provide keyboard input and display output.

Referring to fig. 5, fig. 5 is a flowchart of a mobile terminal side implementing interaction with a PC according to an embodiment of the present invention, where the flowchart includes the following steps:

step 501: turn on the handset Wi-Fi and connect to the PC Access Point Name (APN).

Specifically, the user starts the cell phone and starts a Wi-Fi connection on the cell phone, which finds the APN of the PC and connects to the PC accordingly.

Step 502: the mobile phone starts Wi-Fi I/O software and realizes I/O connection with the PC server.

If the mobile phone and the PC both start respective input/output data processors, the mobile phone and the PC can realize the I/O connection; also, the handset may notify the user after completing the I/O connection.

Step 503: and selecting an input and output mode.

Specifically, the user may select the input/output mode provided by the handset: keyboard input/display output, the mobile phone informs the PC side of the mode selected by the user; when the PC side feedback indicates that keyboard input and/or display output through the mobile phone is approved, the mobile phone can inform the user of the condition.

Step 510: and selecting keyboard input.

Step 511: and (4) clicking a key on the mobile phone, and responding to the key clicking by the PC.

Specifically, the signal on the handset will be passed to the PC via Wi-Fi, and the PC will respond to the learned keystroke. Step 530 is entered.

Step 520: and selecting display output.

Step 521: the PC passes the image to be displayed to the handset for display.

Specifically, images to be displayed on the PC can be transferred to the cell phone through Wi-Fi, and the images are displayed by the cell phone.

Step 530: and ending the Wi-Fi I/O function and exiting the application.

Such as: after a period of time, the user terminates the input/output function of the mobile phone, the mobile phone further notifies the PC of the situation, and the mobile phone and the PC end the interaction. And then, the Wi-Fi connection between the mobile phone and the PC is disconnected, and the process is ended.

Generally, in order to implement a technology for interaction between a mobile terminal and a PC based on Wi-Fi, corresponding application programs, protocol stacks, and virtual device drivers need to be installed on a mobile phone side and a PC side, respectively. Moreover, after protocol stacks and application programs in the mobile phone and the PC are started, Wi-Fi connection and application connection can be established between the mobile phone and the PC; after the interaction and negotiation of the high-level protocol, the interaction of the applications including input and output can be realized between the mobile phone and the PC based on Wi-Fi.

When the user selects to end the session, the mobile phone disconnects the application layer connection and the Wi-Fi connection with the PC.

It should be noted that, in the output capability negotiation process, the mobile terminal may also initiate the output capability negotiation, and the PC records the output capability of the mobile terminal; in the input capability negotiation process, the input capability negotiation can also be initiated by the PC, and the input capability of the PC is recorded by the mobile terminal. Moreover, the specific application process may also include PC-side input; and outputting at the mobile terminal side.

As can be seen from the above flow, the idea of the present invention for realizing the interaction between the mobile terminal and the PC based on Wi-Fi can be represented as shown in FIG. 6. Referring to fig. 6, fig. 6 is a flowchart of implementing interaction between a mobile terminal and a mobile terminal according to an embodiment of the present invention, where the flowchart includes the following steps:

step 610: the mobile terminal and the PC respectively start a protocol stack and an application program, and establish Wi-Fi connection between the mobile terminal and the PC to realize application connection.

Step 620: and realizing the application process between the mobile terminal and the PC through high-level protocol interaction and negotiation.

In summary, no matter the method, the device or the system, the technology for realizing the interaction between the mobile terminal and the PC based on the Wi-Fi can realize the wireless application interaction between the mobile terminal and the PC.

Specifically, the invention can provide a brand-new operation idea for the input/output mode and the man-machine interaction mode of the PC by utilizing the characteristics of multimedia, multi-element input capability and portability of the mobile phone and combining the wireless performance of long distance and large bandwidth peculiar to the Wi-Fi technology, and has the following advantages:

the deployment is convenient: in view of the popularity of cell phones and PCs, cell phone users can use wireless input without purchasing a wireless input device.

The communication distance is long: the ultra-long effective transmission distance of Wi-Fi ensures that a user can freely control the system without approaching a PC; and different from the traditional wireless mouse and keyboard, the user can operate the PC outdoors even in different places (needing to rely on a wider range wireless link, such as WiMAX support).

Equipment centralization: a plurality of different devices do not need to be purchased for different input requirements, and all input and output can be realized by only one mobile phone.

Real-time special equipment support capability: aiming at a PC without special equipment such as a scanner, a camera, a microphone and the like, temporary special equipment support can be provided for the PC only by using a mobile phone (the current mobile phone basically comprises standard equipment such as the camera, the microphone and the like), so that a user can enjoy services brought by the special equipment in real time.

In addition, a powerful CPU of the PC can be used for processing more complex operation, and the mobile phone is only used as a client and is only used for inputting required operation instructions, so that the user operation is simplified, and the functions which can be realized by the mobile phone are enhanced and expanded.

The above description is only exemplary of the present invention and should not be taken as limiting the scope of the present invention, and any modifications, equivalents, improvements, etc. that are within the spirit and principle of the present invention should be included in the present invention.

Claims

1. A method for realizing interaction between a mobile terminal and a PC (personal computer) based on Wi-Fi (wireless fidelity) is characterized by comprising the following steps:

2. The method of claim 1, wherein the negotiation process comprises:

3. The method of claim 2,

the process of the input capability negotiation comprises: initiating input capability negotiation by the mobile terminal, and recording the input capability of the mobile terminal by the PC; or, initiating input capability negotiation by the PC, and recording the input capability of the PC by the mobile terminal;

4. The method according to any of claims 1 to 3, wherein the application process comprises at least one of:

inputting at the mobile terminal side; PC side output;

or, PC side input; and outputting at the mobile terminal side.

5. The method according to claim 4, wherein the mobile terminal side input procedure comprises:

6. The method of claim 4, wherein the PC side outputting comprises:

7. A device for realizing interaction between a mobile terminal and a PC (personal computer) based on Wi-Fi (wireless fidelity) is characterized by comprising a Wi-Fi connection module, a high-level protocol stack and an input/output data processor; wherein,

8. The apparatus of claim 7, wherein the negotiating comprises:

9. The apparatus of claim 7, further comprising a data compression processing module, a multimedia processing module, a security processing module; wherein,

10. A device according to any one of claims 7 to 9, wherein the device is provided in a mobile telephone.

11. The apparatus according to any one of claims 7 to 9, wherein the apparatus is provided in a PC, and further comprises a virtual device driver for controlling the operating system to recognize and manage the multimedia input device in the form of a virtual device.

12. A system for realizing interaction between a mobile terminal and a PC (personal computer) based on Wi-Fi (wireless fidelity) is characterized by comprising a mobile phone and a PC, wherein the mobile phone and the PC are respectively provided with a Wi-Fi connection module, a high-level protocol stack and an input/output data processor, and a virtual equipment driver is also arranged in the PC; wherein,

13. The system of claim 12, wherein the mobile phone and the PC each further comprise a data compression processing module, a multimedia processing module, and a security processing module; wherein,