WO2011130962A1

WO2011130962A1 - Remote processing method, device and system

Info

Publication number: WO2011130962A1
Application number: PCT/CN2010/075319
Authority: WO
Inventors: 张本全; 黄勤波
Original assignee: 中兴通讯股份有限公司
Priority date: 2010-04-19
Filing date: 2010-07-20
Publication date: 2011-10-27
Also published as: CN101834894A

Abstract

The present invention discloses a remote processing method, device and system. The method includes: a mobile terminal sends the user operation information on its screen to a server; the server implements the processing corresponding to the information; the server sends the processed data to the mobile terminal; and the mobile terminal plays the data. With the present invention, the purpose can be achieved that the mobile terminal can complete the work with high hardware requirements.

Description

TECHNICAL FIELD The present invention relates to the field of communications, and in particular to a remote processing method, apparatus, and system. BACKGROUND With the increasing popularity of smart mobile terminals such as mobile phones, the application range of mobile terminals is more and more extensive. At present, mobile terminals have replaced personal computers (PCs) in some aspects, for example, surfing the Internet, sending and receiving emails, and the like. However, due to limitations of hardware conditions such as local memory, CPU, and memory, there are many things that can be done on a PC, which cannot be completed on a mobile terminal. For example, engineering, software design, etc., which require relatively high hardware requirements. . The current solution only improves the hardware configuration of the mobile terminal. The current mobile terminal hardware capability is far from the PC, and the cost is high. SUMMARY OF THE INVENTION A primary object of the present invention is to provide a remote processing solution to at least solve the above problems. According to an aspect of the present invention, a remote processing method is provided, including: a mobile terminal transmitting operation information of a user on its interface to a server; the server performing processing corresponding to the information; Transmitting the processed data to the mobile terminal; the mobile terminal playing the data. According to another aspect of the present invention, a mobile terminal is provided, including: a user operation capture module, configured to capture operation information of a user on a mobile terminal interface; and a first sending module, configured to send the operation information to a server a first receiving module, configured to receive data sent by the server, where the data is processed by the server to process the data corresponding to the information; and the playing module is configured to play the first Receiving the data received by the module. According to still another aspect of the present invention, a server is provided, including: a second receiving module, configured to receive information about an operation of a user on an interface of the mobile terminal sent by a mobile terminal; and a processing module, configured to execute The processing corresponding to the information; the second sending module, configured to send the processed data to the mobile terminal. According to still another aspect of the present invention, there is provided a remote processing system comprising the above mobile terminal and the above-described server. Through the present invention, the mobile terminal transmits information of the operation of the user on its interface to the server; the server performs processing corresponding to the information; the server transmits the processed data to the mobile terminal; and the mobile terminal plays the data. The invention solves the problem that the mobile terminal cannot complete the work requiring high hardware, and thus achieves the purpose of completing the work with high hardware requirements on the mobile terminal. BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are set to illustrate,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 1 is a structural block diagram of a mobile terminal according to an embodiment of the present invention; FIG. 2 is a block diagram showing a preferred structure of a mobile terminal according to an embodiment of the present invention; FIG. 3 is a structural block diagram of a server according to an embodiment of the present invention; 4 is a block diagram showing a preferred structure of a server according to an embodiment of the present invention; FIG. 5 is a flowchart of a remote processing method according to an embodiment of the present invention; and FIG. 6 is a streaming media mobile terminal platform and server according to an embodiment of the present invention. Flow chart of the processing method. BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. In the following embodiments, an application of a mobile terminal (for example, a mobile phone) is stored on the server (data can also be stored on the server), and the mobile terminal realizes interaction with the server. Handling of certain jobs. Embodiment 1 FIG. 1 is a structural block diagram of a mobile terminal according to an embodiment of the present invention, as shown in FIG. The terminal includes a user operation capturing module 12, a first transmitting module 14, a first receiving module 16, and a playing module 18. The structure will be described below. The user operation capture module 12 is configured to capture the operation of the user on the mobile terminal interface; the first sending module 14 is connected to the user operation capture module 12 for transmitting the information of the operation to the server; the first receiving module 16 is connected to the first The sending module 14 is configured to receive data sent by the server, where the data is processed by the server to process the data corresponding to the information; the playing module 18 is connected to the first receiving module 16 for playing the data received by the first receiving module 16 . Through the above various modules, the mobile terminal sends the user's operation to the server, and the server performs response processing, and the processed data is sent to the mobile terminal by streaming media. It realizes the processing of jobs with higher hardware requirements on the mobile terminal. Preferably, the first sending module 14 is further configured to send the parameters of the screen of the terminal to the server. The first receiving module 16 is further configured to receive, by the server, a customized interface for the terminal according to the parameter. Preferably, the first receiving module 14 is further configured to receive control information from the server, and after receiving the control information, the mobile terminal invokes a control instruction corresponding to the control information. 2 is a block diagram showing a preferred structure of a mobile terminal module according to an embodiment of the present invention. As shown in FIG. 2, the mobile terminal includes a user operation capture module 12, a first transmission module 14, a first receiving module 16, and a playback module 18. . The first receiving module 16 includes a downlink data parsing module 162. The first sending module 14 includes: an uplink data constructing module 142 and a transport control module 144. The terminal further includes a management control module 20. This will be explained below. The management control module 20 is configured to manage and schedule other modules. The downlink data parsing module 162 is configured to parse downlink data transmitted from the streaming server. The playing module 18 is configured to play the streaming media format data parsed from the downlink data. The user operation capture module 12 is configured to capture a touch screen click event, a keyboard event, location information, and the like when the user operates on the mobile terminal. The uplink data construction module 142 is configured to construct a touch screen click event, a keyboard event, a location information, and the like when the user operates on the mobile terminal as uplink data. The transmission control module 144 is configured to sequentially send the uplink data in the uplink configuration module 142 to the server. FIG. 3 is a structural block diagram of a server according to an embodiment of the present invention. As shown in FIG. 3, the server includes: a second receiving module 32, a processing module 34, and a second sending module 36, which will be described below. The second receiving module 32 is configured to receive information about an operation of the user on the interface of the mobile terminal that is sent by the mobile terminal; the processing module 34 is connected to the second receiving module 32, and is configured to perform processing corresponding to the information; Connected to the processing module 34 for transmitting the processed data to the mobile terminal. Preferably, the second sending module 36 encapsulates the data and control information processed by the processing module 34 and sends the data to the mobile terminal. 4 is a block diagram of a preferred structure of a server according to an embodiment of the present invention. As shown in FIG. 4, the server includes: a second receiving module 32, a processing module 34, and a second sending module 36. The second receiving module 32 includes: The data parsing module 322, the uplink data distributing module 324, and the second sending module 36 include: a compression adapting module 362, a downlink data constructing module 364, and a transmission control module 366. The server also includes: a management control module 40. This will be explained below. The management control module 40 is configured to manage and schedule other modules. The uplink data parsing module 322 is configured to parse the uplink data transmitted from the mobile terminal. The uplink data distribution module 324 is configured to send a click event, location information, and the like parsed from the uplink data to a corresponding program (ie, the processing module 34) on the server for processing. The compression adaptation module 362 is configured to compress and adapt the operation result, the corresponding user interface (User Interface, UI for short), and the sound effect. The downlink data construction module 364 constructs the compressed multimedia data and the control information data into downlink data. The transmission control module 366 is configured to sequentially send the downlink data generated in the downlink data constructing module 364 to the mobile terminal. 5 is a flowchart of a remote processing method according to an embodiment of the present invention. As shown in FIG. 5, the process includes the following steps: Step S502: The mobile terminal sends operation information of the user on the interface to the server; Step S504 The server performs processing corresponding to the information. Step S506: The server sends the processed data to the mobile terminal. Step S508: The mobile terminal plays the data sent by the server. Through the above steps, the interaction between the mobile terminal and the server enables the mobile terminal to process jobs with higher hardware requirements through the server. Preferably, in order to enable the mobile terminal to obtain an interface adapted to itself, the parameters of the screen may be sent to the server; the server customizes the interface according to the parameters, and sends the interface to the mobile terminal. Mobile terminal. Of course, here, the mobile terminal can also send its own model information to the server, and the server finds the corresponding screen parameter according to the model information, and then customizes the interface. Preferably, the server may further transmit the mobile terminal that controls the information (for example, the processed data and the control information may be encapsulated together and sent to the mobile terminal), the mobile terminal plays the data, and invokes control corresponding to the control information. instruction. In order to ensure the speed of transmission, the server can convert the data and control information into the streaming media format through the User Data Protocol (User Date Protocol, UDP for short) at the transport layer. Of course, it can also be transferred to the TCP protocol by the Transfer Control Protocol. However, UDP is the preferred protocol) sent to the mobile terminal. In order to ensure that the operation information of the mobile terminal can arrive at the server in sequence, the mobile terminal can operate the information through the Transmission Control Protocol (TCP) at the transport layer (of course, it can also use the UDP protocol, if applicable) The UDP protocol, preferably, may take certain safeguards to make the UDP protocol reliable, for example, verifying the order of UDP packets) to the server. Embodiment 2 This embodiment combines the preferred embodiments in the first embodiment, and provides a remote processing method, where the method includes the following steps: Step S1, a mobile terminal (for example, a mobile phone) installs a streaming media application platform. Storing a large amount of data, a large operating program, and the like on the server side; Step 4: S2, establishing a communication link of the mobile terminal to the server end; in this step, the mobile terminal can send the parameters of the screen to the server; Step S3: The server end transmits the customized initialization interface to the mobile terminal through the communication link, and displays the application through the streaming media application. In step S4, the user performs a click operation on the initialization interface through the streaming application of the mobile terminal. The streaming application captures user operations and constructs operational related events, data, and streaming transmission requests and control information into uplink data for transmission to the server. Step S5, the server side parses the user operation data from the uplink data, sends the corresponding operation program to the server, and then compresses the operation result and the corresponding UI and sound effects. And compressing the compressed multimedia data and the control information data into downlink data, and transmitting the data to the mobile terminal by means of streaming media transmission. Step S6: The mobile terminal decodes the received downlink data, and presents the operation result of the server end by using the streaming media application. In the above steps, there are two methods for streaming media: Realtime streaming and '1 progressive streaming. iH ^ , video for real-time broadcast, using streaming media server or application real-time protocol such as RTSP, can be called real-time streaming; and using Hypertext Transfer Protocol (HTTP) server, file That is, by sequential stream transmission, it can be called sequential streaming. In the above steps, different transmission protocols can be dynamically used according to the real-time requirements and data reliability requirements of the job. Embodiment 3 This embodiment describes a streaming media platform and a server in a mobile terminal in conjunction with FIG. 6. FIG. 6 is a flowchart of a processing method of a streaming media mobile terminal platform and a server according to an embodiment of the present invention. The process includes the following steps: Step S601: Establish a communication link of a mobile terminal to a server. The transport protocol of the streaming media may be real-time transmission or continuous transmission. If it is real-time transmission, the application layer uses the Real Time Streaming Protocol (RTSP)/Real Time Transport Protocol (RTP) protocol, and the transport layer uses the UDP protocol. For transmission, the application layer uses the HTTP protocol, and the transport layer uses the TCP protocol. Considering the importance of user operation data, the TCP protocol is preferred when uplink data is transmitted to the server. Considering the real-time nature of the server operation results, when the downlink data is transmitted to the mobile terminal, the RTP protocol is preferred. The continuous development of LTE technology and the increasing bandwidth of mobile networks will bring better real-time performance. Step S602, the mobile terminal logs in to the server through the streaming media platform, and enters the initial interaction interface. After having the link to the streaming server, the mobile terminal has a unique IP address, and the server can uniquely locate the mobile terminal through the IP address, because there may be many mobile terminals requesting one server at the same time, provided that The server is a multi-user operating system such as Windows and Linux. Then the terminal logs in to the server, and the server customizes an initial terminal interface to the mobile terminal according to the information of the screen of the mobile terminal (for example, LCD information), just like the standby interface of the mobile terminal, in which the user can access and complete The function that mobile terminals usually use. Step S603, after the user operates, the control information such as coordinates is sent to the streaming server through the TCP transmission protocol. The mobile terminal user directly operates on the interface presented by the streaming media platform, and the user operation information may include: touch screen events, such as clicking, double clicking, long pressing, dragging, etc., the main parameters of these events include event type and coordinate information; Events, such as text input, keyboard shortcuts, etc., the main parameters of these events include event type and button information. When constructing uplink data, the mobile terminal streaming media platform needs to encapsulate the operation information according to the requirements of the server, so that the server can correctly parse the data. Step S604, after receiving the request of the mobile terminal in step S603, the server parses the control data and the request, parses the corresponding operation information, and then sends the corresponding operation information to the corresponding operation program, the operation program completes the corresponding response, and compresses the response result data (streaming media format; And, the result data and the control information (for interacting with the mobile terminal or scheduling the mobile terminal resources) are encapsulated into downlink data, and finally transmitted back to the mobile terminal through a streaming media transmission protocol such as RTP. Step S605: The streaming media platform of the mobile terminal receives the downlink data, parses out the streaming media data for playing, and responds to the server control command by using the local system of the mobile terminal. Step 4 gathers S606, repeats step 4 to gather S603 ~ S605 to complete the user operation of the next step. Through the above embodiment, the application of the mobile terminal and its data are stored on the server side, and then the operation of the terminal user is fed back to the server through the streaming media platform, and the server responds to the operation and passes the result of the operation of the user through the streaming media data. The transmission is presented on the streaming interface of the terminal. By performing data interaction in this way, the limitation of the storage capacity of the mobile terminal and the lack of computing performance are overcome, and the large-scale operation that can be completed only by a large PC can be completed, and the application of the mobile terminal under the condition of the smart mobile terminal hardware and communication network such as the mobile phone is improved. Scope and scope. Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general-purpose computing device, which can be concentrated on a single computing device or distributed over a network composed of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device, such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software. The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention. Various modifications and variations of the present invention are possible in the art. Any modifications, equivalent substitutions, improvements, etc. made within the scope of the present invention are intended to be included within the scope of the present invention.

Claims

Claim

A remote processing method, comprising: a mobile terminal transmitting operation information of a user on an interface thereof to a server; the server performing processing corresponding to the information;

The server sends the processed data to the mobile terminal;

The mobile terminal plays the data.

The method according to claim 1, wherein before the mobile terminal sends the information of the operation to the server, the method further includes:

The mobile terminal sends parameters of its screen to the server;

The server customizes the interface for the terminal according to the parameter, and sends the interface to the mobile terminal.

3. The method of claim 1 or 2, wherein the server encapsulates the data and control information and sends the data to the mobile terminal, the mobile terminal playing the data, and A control instruction corresponding to the control information is called.

The method according to claim 3, wherein the server transmits the data and the control information to the mobile terminal through a user data protocol at a transport layer.

The method according to claim 3, wherein the server transmits the data and the control information to the mobile terminal by using a transmission control protocol at a transport layer.

The method according to claim 1 or 2, wherein the mobile terminal transmits the information of the operation to the server by using a transmission control protocol at a transport layer.

The method according to claim 1 or 2, wherein the mobile terminal transmits the information of the operation to the server by a user data protocol at a transport layer.

8. A mobile terminal, comprising:

a user operation capture module, configured to capture operation information of the user on the mobile terminal interface; a first sending module, configured to send the operation information to the server; a first receiving module, configured to receive data sent by the server, where the data is processed by the server to process the data corresponding to the information;

a playing module, configured to play the data received by the first receiving module.

The mobile terminal according to claim 8, wherein the first sending module is further configured to send a parameter of a screen of the terminal to the server; the first receiving module is further configured to receive the The server customizes the interface for the terminal according to the parameter.

The mobile terminal according to claim 8 or 9, wherein

The first receiving module is further configured to receive control information from the server; the mobile terminal invokes a control instruction corresponding to the control information.

A server, comprising:

a second receiving module, configured to receive information about an operation of a user sent by the mobile terminal on an interface of the mobile terminal;

a processing module, configured to perform processing corresponding to the information;

The second sending module is configured to send the processed data to the mobile terminal.

The server according to claim 11, wherein the second sending module encapsulates the data and control information and sends the data to the mobile terminal.

A remote processing system, comprising the mobile terminal according to any one of claims 8 or 9, and the server according to any one of claims 11 or 12.