CN107071035A - mobile terminal remote control method, device and corresponding mobile terminal - Google Patents
mobile terminal remote control method, device and corresponding mobile terminal Download PDFInfo
- Publication number
- CN107071035A CN107071035A CN201710261609.8A CN201710261609A CN107071035A CN 107071035 A CN107071035 A CN 107071035A CN 201710261609 A CN201710261609 A CN 201710261609A CN 107071035 A CN107071035 A CN 107071035A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- terminal
- relative movement
- interface image
- movement terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/08—Protocols specially adapted for terminal emulation, e.g. Telnet
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present invention relates to terminal communication control field, and in particular to a kind of mobile terminal remote control method, device and corresponding mobile terminal, and methods described includes step：This mobile terminal sets up long-range interface channel with relative movement terminal；This mobile terminal receives the local interface image stream for relatively moving terminal transmission by the interface channel, it is synchronous that the local interface image of this mobile terminal is streaming to relative movement terminal, so that the terminal that relatively moves is by output display on its its local interface image that is added to；The local interface image stream for the relative movement terminal that this mobile terminal is received it is added to output display on own local interface image.The bidirectional remote transmission of interface image of the invention based at least two mobile terminals, when carrying out remote control, terminal user can see the interface image of other side each other, improve the visual effect of remote control so that such as teaching purpose that remote control is reached is more efficient, convenient.
Description
【Technical field】
The present invention relates to terminal communication control field, and in particular to a kind of mobile terminal remote control method, device and phase
The mobile terminal answered.
【Background technology】
Remote control, or remote assistance, refer to that at least two mobile terminals trusted each other set up wireless communication connection,
And then the user interface of a side (side of receiving aid) is shown in the user interface of the opposing party (assistance side), assistance side is by obtaining
To the side of receiving aid user interface, exchanged using functions such as sound explanation, paintbrushes with the side of receiving aid, so as to realize remote control
Or remote assistance effect.
In current terminal remote control, the side of receiving aid, an assistance side need to be determined, in direction assistance side request of receiving aid
After remote assistance, manipulate the side of receiving aid to reach remote control effect by assistance side.Meanwhile, assistance side is receiving the side of receiving aid
After picture, picture takes the whole operation interface of assistance side, the thing that assistance side can not be produced during remote control for the machine
Part behavior is handled, so as to be made troubles to user.Meanwhile, the image content of whole terminal is often transferred to association by the side of receiving aid
The side of helping, so that can not in particular cases ensure the privacy concern of itself some.Also, in the prior art often by remote control
Function and mobile terminal binding, limitation same brand mobile terminal could carry out remote control function.
For some specific usage scenarios, the picture transmission of oneself to assistance side can not be met into user by the side of receiving aid
Demand, such as in some usage scenarios for needing two users to be operated, and current remote control simultaneously, picture is fixed
And can not adjust, bring inconvenience to user.
【The content of the invention】
The primary and foremost purpose of the present invention is to provide a kind of mobile terminal remote control method and device.
Another object of the present invention is to provide a kind of mobile terminal for realizing long-range control method.
To realize the purpose, the present invention is adopted the following technical scheme that：
In a first aspect, the present invention provides a kind of mobile terminal remote control method, comprise the following steps：
This mobile terminal sets up long-range interface channel with relative movement terminal；
This mobile terminal receives the local interface image stream for relatively moving terminal transmission by the interface channel, synchronously will
The local interface image of this mobile terminal is streaming to relative movement terminal, so that it is added to it by the relative movement terminal
Output display on local interface image；
The local interface image stream for the relative movement terminal that this mobile terminal is received it is added to own local
Output display on interface image.
It is preferred that, the local interface image of described mobile terminal and relative movement terminal transmission is that user is voluntarily selected
The image of specific region on user interface of mobile terminal.
Specifically, described mobile terminal confirms the configuration information of both sides simultaneously with relative movement terminal by remote server
The long-range interface channel is set up according to this.
Specifically, the configuration information includes the characteristic information of user account information and mobile terminal, the mobile terminal
The screen size of characteristic information including mobile terminal, screen resolution, unique identifier code.
Further, it is described when described mobile terminal receives the local interface image stream of relative movement terminal transmission
This mobile terminal performs streaming media server function, in described mobile terminal synchronization by the local interface image of this mobile terminal
When being streaming to relative movement terminal, described mobile terminal performs client functionality.
It is preferred that, described mobile terminal and the image stream of relative movement terminal are transmitted as point-to-point transmission.
Preferably, the local interface image stream for the relative movement terminal transmission that described mobile terminal is received is in this movement
Shown in terminal with suspended window.
Further, described mobile terminal receives the operational order for acting on the suspended window, performs operational order pair
The operation answered.
Specifically, the operational order includes scaling instruction, move, hides instruction and out code.
Further, methods described also includes step：
This mobile terminal receives the first control instruction on the interface image for acting on the relative movement terminal, based on building
The second control instruction that first control instruction is modeled as acting in relative movement terminal by vertical command mappings relation, with
The relative movement terminal is allowed according to the corresponding operation of execution after second control instruction.
Preferably, after its control authority is authorized this mobile terminal by the relative movement terminal, execute instruction simulation turns
Change step.
Further, the control authority mandate shape of relative movement terminal is characterized by relatively moving the labeled button in terminal
State.
Further, after the relative movement terminal performs corresponding operation according to the second control instruction, also wrap
Include：
The display content for the relative movement terminal interface image that this mobile terminal to update is received.
Accordingly, second aspect, the present invention provides a kind of mobile terminal remote control device, including：
Link block：For setting up long-range interface channel with relative movement terminal；
Transport module：The local interface image stream of terminal transmission is relatively moved for being received by the interface channel, together
The local interface image of this mobile terminal is streaming to relative movement terminal by step, so that it is superimposed by the relative movement terminal
Output display on to its local interface image；
Display module：The local interface image stream of the relative movement terminal for it to be received is added to itself originally
Output display on ground interface image.
It is preferred that, the local interface image of described mobile terminal and relative movement terminal transmission is that user is voluntarily selected
Specific region image on user interface of mobile terminal.
Specifically, described mobile terminal confirms the configuration information of both sides simultaneously with relative movement terminal by remote server
The long-range interface channel is set up according to this.
Specifically, the configuration information includes the characteristic information of user account information and mobile terminal, the mobile terminal
The screen size of characteristic information including mobile terminal, screen resolution, unique identifier code.
Further, it is described when described mobile terminal receives the local interface image stream of relative movement terminal transmission
This mobile terminal performs streaming media server function, in described mobile terminal synchronization by the local interface image of this mobile terminal
When being streaming to relative movement terminal, described mobile terminal performs client functionality.
It is preferred that, described mobile terminal and the image stream of relative movement terminal are transmitted as point-to-point transmission.
Preferably, the local interface image stream for the relative movement terminal transmission that described mobile terminal is received is in this movement
Shown in terminal with suspended window.
Further, described mobile terminal receives the operational order for acting on the suspended window, performs operational order pair
The operation answered.
Specifically, the operational order includes scaling instruction, move, hides instruction and out code.
Further, described device also includes：
Instruction simulation module：Refer to for receiving the first control on the interface image for acting on the relative movement terminal
First control instruction is modeled as acting on the second control in relative movement terminal by order, the command mappings relation based on foundation
System instruction, to allow the relative movement terminal according to the corresponding operation of execution after second control instruction.
Preferably, the instruction simulation module includes granted unit, in the relative movement terminal by its control
Limit is authorized after this mobile terminal, execute instruction simulated operation.
Further, the control authority mandate shape of relative movement terminal is characterized by relatively moving the labeled button in terminal
State.
Further, after the relative movement terminal performs corresponding operation according to the second control instruction, display
Module updates the display content of the relative movement terminal interface image received.
The third aspect, the present invention also provides a kind of mobile terminal, for realizing above-mentioned long-range control method, including：
Touch-sensitive display：For showing the average information produced in this method implementation process and object information；
Memory：The candidate's intermediate data and result data produced for storing in above method implementation process；
One or more processors：The processor is configurable for the step of above method is realized in execution.
Compared with prior art, the present invention possesses following advantage：
This mobile terminal and the interface image stream of both relative movement terminals are passed through transmitted in both directions by the present invention so that entered
Terminal user can see the interface image of other side each other during row remote control, improve the visual effect of remote control so that
Such as teaching purpose that remote control is reached is more efficient, convenient.Meanwhile, this mobile terminal and the interface of relative movement terminal
The transmitted in both directions of image stream, adds diversified remote control function, such as remote teaching, remotely share, telecommuting work(
Can, it is that user brings more facilities.
Meanwhile, this mobile terminal passes through the shape of suspended window after the interface image that relative movement terminal is transmitted is received
Formula is superimposed, is presented in local user interface, can not only observe the image content that relative movement terminal is transmitted,
Other operations on this mobile terminal can be carried out simultaneously, allow user more easily to be controlled in remote control state and not remote
Free switching under state.Also, the size of suspended window, which is shown, voluntarily to be controlled by user, reach the viewing most coordinated with operation simultaneously
The effect deposited, meanwhile, the control authority of relative movement terminal can be voluntarily turned on and off by user, protect user to maximum program
Privacy.
Further, long-range control method of the invention is broken using the Implement of Function Module that point-to-point transmission can be achieved
The limitation of existing remote control terminal, realizes the remote control between across brand mobile terminal, allow different brands terminal user
Terminal remote control can also freely be realized.Meanwhile, in this mobile terminal and the respective boundary of relative movement terminal transmitted in both directions
By point-to-point transmission during the image of face, the load of cloud server is reduced, the definition and fluency of picture image is improved.
Obviously, the above-mentioned description about advantage of the present invention is recapitulative, and more advantage descriptions will be embodied in follow-up
During embodiment is disclosed, and, the content that those skilled in the art can also be disclosed reasonably finds its of the present invention
His plurality of advantages.
The additional aspect of the present invention and advantage will be set forth in part in the description, and these will become from the following description
Obtain substantially, or recognized by the practice of the present invention.
【Brief description of the drawings】
Fig. 1 is an embodiment schematic flow sheet of mobile terminal remote control method of the present invention.
Fig. 2 intercepts an embodiment of the image frame in its user interface in specific region for present invention relative movement terminal
Schematic diagram.
Fig. 3, which is this of the invention mobile terminal, is added to the interface image stream of the relative movement terminal received local interface
An embodiment schematic diagram of output display on image.
Fig. 4 is the picture of the interface image of the relative movement terminal shown on this mobile terminal in command mappings relation of the present invention
Sketch map.
Fig. 5 is the pixel map of its local interface image of relative movement terminal interception in command mappings relation of the present invention.
Fig. 6 is an application scenarios schematic diagram of the invention.
Fig. 7 is an embodiment schematic diagram of mobile terminal remote control device of the present invention.
The structural representation that Fig. 8 can be applicable for this mobile terminal and relative movement mobile terminal of the present invention.
【Embodiment】
The present invention is further described with exemplary embodiment below in conjunction with the accompanying drawings, identical label wherein in accompanying drawing
All refer to identical part.In addition, if it is known that the detailed description of technology is for showing the invention is characterized in that unnecessary
, then omitted.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singulative " one " used herein, " one
It is individual ", " described " and "the" may also comprise plural form.It is to be further understood that what is used in the specification of the present invention arranges
Diction " comprising " refer to there is the feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition
Other one or more features, integer, step, operation, element, component and/or their group.It should be understood that when we claim member
Part is " connected " or during " coupled " to another element, and it can be directly connected or coupled to other elements, or can also exist
Intermediary element.In addition, " connection " used herein or " coupling " can include wireless connection or wireless coupling.It is used herein to arrange
Taking leave "and/or" includes one or more associated wholes or any cell for listing item and all combines.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art
Language and scientific terminology), with the general understanding identical meaning with the those of ordinary skill in art of the present invention.Should also
Understand, those terms defined in such as general dictionary, it should be understood that with the context with prior art
The consistent meaning of meaning, and unless by specific definitions as here, otherwise will not use idealization or excessively formal implication
To explain.
Those skilled in the art of the present technique are appreciated that " terminal " used herein above, " terminal device " both include wireless communication
The equipment of number receiver, it only possesses the equipment of the wireless signal receiver of non-emissive ability, includes receiving again and transmitting hardware
Equipment, its have can on bidirectional communication link, perform two-way communication reception and launch hardware equipment.This equipment
It can include：Honeycomb or other communication equipments, it has single line display or multi-line display or shown without multi-line
The honeycomb of device or other communication equipments；PCS (Personal Communications Service, PCS Personal Communications System), it can
With combine voice, data processing, fax and/or its communication ability；PDA (Personal Digital Assistant, it is personal
Digital assistants), it can include radio frequency receiver, pager, the Internet/intranet access, web browser, notepad, day
Go through and/or GPS (Global Positioning System, global positioning system) receiver；Conventional laptop and/or palm
Type computer or other equipment, its have and/or conventional laptop and/or palmtop computer including radio frequency receiver or its
His equipment." terminal " used herein above, " terminal device " they can be portable, can transport, installed in the vehicles (aviation,
Sea-freight and/or land) in, or be suitable for and/or be configured in local runtime, and/or with distribution form, operate in the earth
And/or any other position operation in space." terminal " used herein above, " terminal device " can also be communication terminal, on
Network termination, music/video playback terminal, for example, can be PDA, MID (Mobile Internet Device, mobile Internet
Equipment) and/or the equipment such as mobile phone or intelligent television with music/video playing function, set top box.
Those skilled in the art of the present technique are appreciated that remote network devices used herein above, and it includes but is not limited to meter
The cloud that calculation machine, network host, single network server, multiple webserver collection or multiple servers are constituted.Here, Yun Youji
Constituted in a large amount of computers or the webserver of cloud computing (Cloud Computing), wherein, cloud computing is Distributed Calculation
One kind, a super virtual computer being made up of the computer collection of a group loose couplings.In embodiments of the invention, distal end
It can be realized and communicated by any communication mode between the network equipment, terminal device and WNS servers, included but is not limited to, be based on
3GPP, LTE, WIMAX mobile communication, based on TCP/IP, the computer network communication of udp protocol and based on bluetooth, infrared
The low coverage wireless transmission method of transmission standard.
Those skilled in the art of the present technique are appreciated that user interface/operation interface of the present invention refers to and can be used in
The display interface of control instruction is sent to intelligent terminal, for example, can be an option in the setting page of android system
In (or button, by application program addition wherein, similarly hereinafter) or the informing or interaction page that are breathed out from desktop
An option, can also be an option in the page that a movable component of the application program is constructed.
It will be appreciated by those skilled in the art that " application ", " application program ", " application software ", " client alleged by the present invention
End ", the concept of " client software " and similar statement, are the same concepts well known to those skilled in the art, refer to be by one
The instruction of column count machine and the computer software for being suitable to electronics operation of the organic construction of related data resource.Unless specified, this
Do not rely not by programming language species, rank, also by it the operating system or platform of operation of kind of name in itself is limited.Reason is worked as
So, this genus is not also limited by any type of terminal.
In embodiments of the invention, it is necessary at least two be respectively provided with perform remote control function mobile terminal, it is following with
Illustrated exemplified by two mobile terminals, in order to better discriminate between both, both are respectively defined as this shifting by the embodiment of the present invention
Dynamic terminal and relative movement terminal (also can be regarded as the first mobile terminal and the second mobile terminal), in the long-range of the realization present invention
During control method, the effect of this mobile terminal and relative movement terminal institute role is identical in fact, i.e. this movement is whole
The remote control function that can be realized relative movement terminal is held also to realize, in embodiments of the present invention using this mobile terminal to hold
The main body of row long-range control method is illustrated.
In a first aspect, be an embodiment schematic flow sheet of mobile terminal remote control method of the present invention as shown in Figure 1, bag
Include step S100-S300.
Step S100：This mobile terminal sets up long-range interface channel with relative movement terminal.
, it is necessary to set up this mobile terminal and the long-range interface channel of relative movement terminal before remote control is realized.Tool
Body, this mobile terminal and the functional module for being each equipped with performing remote control function in relative movement terminal, the functional module
The client software that can be mounted on mobile terminal or the plug-in unit for being built in mobile terminal operating system, it is following to install
Illustrated exemplified by the client software on mobile terminal.User logs in client by unique account, and client is accordingly obtained
Characteristic information such as screen size, screen resolution, unique identifier code etc. of mobile terminal are taken, then user account is associated
Cloud server is uploaded in the characteristic information of mobile terminal, cloud server is that each user account distributes unique UID
Afterwards with the characteristic information associated storage of user account and mobile terminal, different user can be found pair by the other user's account
Side.
Further, this mobile terminal is relatively moved by searching after the user account of terminal, is sent to cloud server
The request being connected is set up with relative movement terminal, cloud server sends the connection request of this mobile terminal to relative movement eventually
End, after the long-range interface channel that this mobile terminal and relative movement terminal are set up after the relative movement terminal check.It is described remote
Journey interface channel is data-message transmission passage, and the both sides positioned at passage two ends play client computer with streaming media server respectively
Role, the data transfer of both sides is realized using the long-range interface channel.Specifically, setting up this mobile terminal and relative movement
Signaling is transmitted using which kind of mode, which kind of agreement, passage is set up, it is necessary to confirm both sides during the long-range interface channel of terminal, this
Embodiment transmits signaling, sets up passage using WebSocket and based on XMPP, and this mobile terminal is determined by the passage
The letters such as the codec classification and video resolution, code check supported with IP address, port and the both sides of relative movement terminal
Breath.
Step S200：This mobile terminal receives the local interface image for relatively moving terminal transmission by the interface channel
Stream, it is synchronous that the local interface image of this mobile terminal is streaming to relative movement terminal, so that the relative movement terminal will
Its local interface image that is added on output display.
By the long-range interface channel of foundation, this mobile terminal and the video signal sound of relative movement terminal are realized using WebRTC
News transmission, WebRTC is webpage real-time Communication for Power (Web Real-Time Communication) abbreviation, can be clear with supported web page
Device of looking at carries out real-time voice dialogue and/or video conversation, and WebRTC provides the core technology of video speech session, including sound is regarded
The functions such as collection, encoding and decoding, network transmission, the display of frequency, and support cross-platform such as Windows, Linux, Mac, Android
Deng the use of platform, WebRTC bottoms are based on SRTP and UDP, and providing simple JavaScript by browser can just reach
Real-time communication ability, and it is big for optimizing space in the case of weak net.In the present embodiment, by the screen map for obtaining mobile terminal
As and microphone collection obtain video, audio synchronous stream, accordingly, the client software for being installed on mobile terminal also base
Be designed in WebRTC, it can be understood as client software is designed based on browser/Web, this mobile terminal and
Relative movement terminal realizes that audio frequency and video is talked with by the client software.
Realize that this mobile terminal and relative movement terminal are passed by the flow data between long-range interface channel using WebRTC
Defeated, the flow data interface channel is point-to-point, it is not necessary to which, by the transfer of cloud server, cloud server is setting up this shifting
During the long-range interface channel of dynamic terminal and relative movement terminal, transmission image stream, transfer signaling only need to be completed to set up
Long-range interface channel is stated, this follow-up mobile terminal and the Stream Data Transmission of relative movement terminal need not pass through cloud service again
Device.
A kind of embodiment of the present invention, this mobile terminal/relative movement terminal is to serve as client computer to serve as Streaming Media clothes again
Business device, that is, relatively move terminal and its local interface image be streamed to this mobile terminal for serving as streaming media server, simultaneously
Its local interface image is also streamed to the relative movement terminal for serving as client computer by this mobile terminal, for relative movement terminal
The image stream is added to output display on local interface image.The present embodiment is by the way that the flow data for relatively moving terminal is passed through
Long-range interface channel is directly transferred to this mobile terminal, and data flow needs not move through cloud server and carries out transfer, it is to avoid client
Efficiency of transmission caused by software upload flow data to cloud server and cloud server forwarding flow data to client software
Low the problem of.
It is understood that present invention preferably employs the point-to-point transmission between this mobile terminal and relative movement terminal
Scheme, when point-to-point transmission fails, then by cloud server carry out data flow transfer, that is, relatively move terminal by its
Ground interface image stream uploads to cloud server, and this mobile terminal pulls the figure that relative movement terminal is uploaded from cloud server
As stream, and this mobile terminal synchronization the local interface image stream of itself is uploaded into cloud server, relatively move terminal
Also the image stream of this mobile terminal upload can be pulled from cloud server, and the image stream is added on local interface image
Output display.
It is preferred that, the local interface image that described mobile terminal or relative movement terminal are transmitted is on mobile terminal
The interface image of specific region, as shown in Fig. 2 relative movement terminal intercepts the figure in the wire of its user interface upward arrow sensing
As the local interface image stream, then by the local interface image stream by the long-range interface channel set up transmit to
This mobile terminal, while this mobile terminal receives the image stream, the synchronous local interface image streaming by this mobile terminal
To relative movement terminal.
Step S300：The local interface image stream for the relative movement terminal that this mobile terminal is received it is added to
Output display on own local interface image.
This mobile terminal is received after the interface image stream that relative movement terminal is transmitted, and be added to local surface chart
As upper carry out output display, it is preferred that the interface image of the relative movement terminal is on this mobile terminal with the shape of suspended window
Formula output display.And, it is preferred that when this mobile terminal synchronously will be certainly when output display relatively moves the interface image of terminal
When the local interface image of body is transmitted to relative movement terminal, the local interface image of this mobile terminal interception is not covered
The suspended window picture of terminal output display on this mobile terminal is relatively moved, i.e., the interface image that this mobile terminal is intercepted is
The original interface image of this mobile terminal of suspended window bottom is this mobile terminal as shown in Figure 3 by the relative movement received
What the interface image (part in wire that arrow is pointed in Fig. 3) of terminal was exported after being superimposed on the local interface image of itself
Display effect schematic diagram.
After the interface image of received relative movement terminal is shown with suspended window, the behaviour for acting on suspended window is received
Instruct, suspended window performs corresponding operation according to the operational order, the operational order includes such as giving an order：
An embodiment of the present invention, the suspended window receives the scaling instruction being applied to it, by length and width of suspended window etc.
Amplify to ratio/reduce.
Another embodiment of the present invention, the suspension wears the move for receiving and being applied to it, the suspended window is moved
Move specified location displaying.
Another embodiment of the present invention, the suspension wears the hiding instruction for receiving and being applied to it, suspended window is reduced into
With a mark icon shows in the user interface of this mobile terminal, correspondingly, the mark icon is acted on receiving
After displaying instruction, the suspended window before hiding is presented in the user interface of this mobile terminal again.
Another embodiment of the present invention, the suspended window receives the out code being applied to it, and this mobile terminal will connect
The suspended window of the local interface image stream of the displaying relative movement terminal received is closed, meanwhile, this mobile terminal is closed to relative
Mobile terminal sends the port of local interface image, connects it is furthermore preferred that disconnecting this mobile terminal with the long-range of relative movement terminal
Connect.
Further, after the interface image of the relative movement terminal received by this mobile terminal output display, response
First control instruction, is modeled as making by the first control instruction acted on the interface image according to default command mappings relation
With the second control instruction in relative movement terminal, to allow the relative movement terminal according to being held after second control instruction
The corresponding operation of row.Specifically, its length when the interface image intercepted in the relative movement terminal is shown on this mobile terminal
Wide equal proportion amplification/diminution, the touch-control that then be will act at according to command mappings relation on relative movement terminal interface image is grasped
Work, slide etc. are modeled as acting on touch control operation, the slide of correspondence position in relative movement terminal, such as this implementation
Realize that the embodiment that the first control instruction is modeled as into the second control instruction is as follows in example：It is this mobile terminal as shown in Figure 4
The pixel map (18px*12px) of the interface image of the relative movement terminal of upper display, shown in Fig. 5 be the interception of relative movement terminal,
The pixel map (9px*6px) of its local interface image of transmission, each of which grid represents a pixel, this mobile terminal
The interface image for being intercepted, being transmitted with 2 times of scaling display relative movement terminal, what is shown on this mobile terminal is relative
The picture area of mobile terminal transmission, the determination relation of each pixel in the region is set up with a two-dimensional coordinate system,
Any pixel i.e. on the region is true according to the coordinate of the pixel and scaling all to that should have a unique coordinate
The target pixel points that the fixed pixel corresponds in the specific region intercepted on relative termination, if user is clicked in Fig. 4
When coordinate is the gray pixels point of (8,8), according to mapping relations, the i.e. coordinate in the interface image that relative movement terminal is intercepted
For the target pixel points of (4,4), the also gray pixels point as in Fig. 5.If therefore being clicked on this mobile terminal in viewing area
The pixel of coordinate (8,8), is then modeled as clicking in relative movement terminal coordinate (4,4) in institute interception area after conversion
Pixel, just will act on this first control instruction on this mobile terminal be modeled as acting in relative movement terminal the
Two control instructions, then relatively move terminal and perform corresponding operation according to second control instruction.It is understood that institute
Stating the process that the first control instruction is modeled as into the second control instruction can be completed or complete by cloud server by this mobile terminal
Completed into or by relative movement terminal, its realization principle is same as described above.
Preferably, in the embodiment of the present invention, only after its control authority is authorized this mobile terminal by relative movement terminal,
The instruction simulation conversion operation could be completed.Specifically, can relative movement terminal client software on provide one it is all
Such as the button of " mandate ", user can be authorized the control authority for relatively moving terminal with relative movement eventually by clicking on
Current this mobile terminal for setting up communication connection in end, " authorizes " button to be changed into " mandate " state, if again tapping on simultaneously
The button of " mandate " state, can recall the control authority for authorizing this mobile terminal.Further, the embodiment of the present invention
In, image streaming is transmitted in both directions, therefore this mobile terminal can equally authorize its control authority relative movement terminal, with
Relative movement terminal is set to complete foregoing instruction simulation transformation function.
Further, after relative movement terminal performs corresponding operation according to the second control instruction, it is transmitted to this
The interface image stream of mobile terminal also real-time update, the boundary of the relative movement terminal of this mobile terminal also received by real-time update
The display content of face image stream.
A kind of application scenarios of the present invention are scene of game, as shown in fig. 6, user A is mutual after being connected with user B by foundation
The interface image content in local specific region is mutually transmitted, real-time monitored user B game picture when user A is played
Face, user A and user B preferably can make game according to the real-time status of other side in the stronger game of assisting, cooperative
Judge and respond.
Further application of the invention scene is teaching scene, and user A transmits mutually local after being connected with user B by foundation
Interface image content in specific region, user A is familiar with a certain operation such as software installation and to teach user B with teaching how to fish, this
When demonstrated a step by a step by real-time picture transmission, while user B can also be in the colleague of viewing user A operation
Operation locally is synchronized, more preferable teaching efficiency is reached.
Further application of the invention scene is shared for content, and user A transmits mutually local after being connected with user B by foundation
Interface image content in specific region, user A is carried out after shooting photo with user B with regard to common photographed subject, and user A is this moment
The photo for sharing shooting gives user B, while the photo that user B will also share shooting gives user A, while both photos are entered
Row contrast, now by the interface image of transmitted in both directions can preferably realize the photo between user A, user B mutually watch,
Contrast.
Second aspect, is an embodiment schematic diagram of mobile terminal remote control device of the present invention as shown in Figure 7, including：
Link block 100：For setting up long-range interface channel with relative movement terminal.
, it is necessary to which link block 100 sets up this mobile terminal with relatively moving the long-range of terminal before remote control is realized
Interface channel.Specifically, functional module of this mobile terminal with being each equipped with performing remote control function in relative movement terminal,
Client software that the functional module can be mounted on mobile terminal or the plug-in unit for being built in mobile terminal operating system,
It is following to be illustrated by taking the client software being installed on mobile terminal as an example.User logs in client, visitor by unique account
Family end accordingly obtains characteristic information such as screen size, screen resolution, unique identifier code etc. of mobile terminal, then will use
Family account relating uploads to cloud server in the characteristic information of mobile terminal, and cloud server distributes for each user account
Characteristic information associated storage after unique UID with user account and mobile terminal, different user is by the other user's account
Other side can be found.
Further, this mobile terminal is relatively moved by searching after the user account of terminal, and link block 100 is to high in the clouds
Server send with the request that is connected of relative movement terminal foundation, cloud server by the connection request of this mobile terminal send to
Terminal is relatively moved, is led to after setting up long-range connection of this mobile terminal with relatively moving terminal after the relative movement terminal check
Road.The long-range interface channel is data-message transmission passage, and the both sides positioned at passage two ends play client computer with stream respectively
The role of media server, the data transfer of both sides is realized using the long-range interface channel.Specifically, setting up this mobile terminal
, it is necessary to confirm both sides signaling is transmitted using which kind of mode, which kind of agreement, build during long-range interface channel with relatively moving terminal
Vertical passage, the present embodiment transmits signaling, sets up passage, determined by the passage using WebSocket and based on XMPP
The codec classification supported of IP address, port and both sides and video resolution of this mobile terminal and relative movement terminal,
The information such as code check.
Transport module 200：The local interface image stream of terminal transmission is relatively moved for being received by the interface channel,
It is synchronous that the local interface image of this mobile terminal is streaming to relative movement terminal, so that the relative movement terminal folds it
It is added to output display on its local interface image.
By the long-range interface channel of foundation, this mobile terminal and the video signal sound of relative movement terminal are realized using WebRTC
News transmission, WebRTC is webpage real-time Communication for Power (Web Real-Time Communication) abbreviation, can be clear with supported web page
Device of looking at carries out real-time voice dialogue and/or video conversation, and WebRTC provides the core technology of video speech session, including sound is regarded
The functions such as collection, encoding and decoding, network transmission, the display of frequency, and support cross-platform such as Windows, Linux, Mac, Android
Deng the use of platform, WebRTC bottoms are based on SRTP and UDP, and providing simple JavaScript by browser can just reach
Real-time communication ability, and it is big for optimizing space in the case of weak net.In the present embodiment, by the screen map for obtaining mobile terminal
As and microphone collection obtain video, audio synchronous stream, accordingly, the client software for being installed on mobile terminal also base
Be designed in WebRTC, it can be understood as client software is designed based on browser/Web, this mobile terminal and
Relative movement terminal realizes that audio frequency and video is talked with by the client software.
Realize that this mobile terminal and relative movement terminal are passed by the flow data between long-range interface channel using WebRTC
Defeated, the flow data interface channel is point-to-point, it is not necessary to which, by the transfer of cloud server, cloud server is setting up this shifting
During the long-range interface channel of dynamic terminal and relative movement terminal, transmission image stream, transfer signaling only need to be completed to set up
Long-range interface channel is stated, this follow-up mobile terminal and the Stream Data Transmission of relative movement terminal need not pass through cloud service again
Device.
A kind of embodiment of the present invention, this mobile terminal/relative movement terminal is to serve as client computer to serve as Streaming Media clothes again
Business device, that is, relatively move terminal and its local interface image be streamed to this mobile terminal for serving as streaming media server, simultaneously
Its local interface image is also streamed to the relative movement terminal for serving as client computer by this mobile terminal, for relative movement terminal
The image stream is added to output display on local interface image.The present embodiment is by the way that the flow data for relatively moving terminal is passed through
Long-range interface channel is directly transferred to this mobile terminal, and data flow needs not move through cloud server and carries out transfer, it is to avoid client
Efficiency of transmission caused by software upload flow data to cloud server and cloud server forwarding flow data to client software
Low the problem of.
It is understood that present invention preferably employs the point-to-point transmission between this mobile terminal and relative movement terminal
Scheme, when point-to-point transmission fails, then by cloud server carry out data flow transfer, that is, relatively move terminal by its
Ground interface image stream uploads to cloud server, and this mobile terminal pulls the figure that relative movement terminal is uploaded from cloud server
As stream, and this mobile terminal synchronization the local interface image stream of itself is uploaded into cloud server, relatively move terminal
Also the image stream of this mobile terminal upload can be pulled from cloud server, and the image stream is added on local interface image
Output display.
It is preferred that, the local interface image that described mobile terminal or relative movement terminal are transmitted is on mobile terminal
The interface image of specific region, as shown in Fig. 2 relative movement terminal intercepts the figure in the wire of its user interface upward arrow sensing
As the local interface image stream, then by the local interface image stream by the long-range interface channel set up transmit to
This mobile terminal, while this mobile terminal receives the image stream, the synchronous local interface image streaming by this mobile terminal
To relative movement terminal.
Display module 300：The local interface image stream of the relative movement terminal for it to be received is added to certainly
Output display on the local interface image of body.
This mobile terminal is received after the interface image stream that relative movement terminal is transmitted, and be added to local surface chart
As upper carry out output display, it is preferred that the interface image of the relative movement terminal is on this mobile terminal with the shape of suspended window
Formula output display.And, it is preferred that when this mobile terminal synchronously will be certainly when output display relatively moves the interface image of terminal
When the local interface image of body is transmitted to relative movement terminal, the local interface image of this mobile terminal interception is not covered
The suspended window picture of terminal output display on this mobile terminal is relatively moved, i.e., the interface image that this mobile terminal is intercepted is
The original interface image of this mobile terminal of suspended window bottom is this mobile terminal as shown in Figure 3 by the relative movement received
What the interface image (part in wire that arrow is pointed in Fig. 3) of terminal was exported after being superimposed on the local interface image of itself
Display effect schematic diagram.
After the interface image of received relative movement terminal is shown with suspended window, the behaviour for acting on suspended window is received
Instruct, suspended window performs corresponding operation according to the operational order, the operational order includes such as giving an order：
An embodiment of the present invention, the suspended window receives the scaling instruction being applied to it, by length and width of suspended window etc.
Amplify to ratio/reduce.
Another embodiment of the present invention, the suspension wears the move for receiving and being applied to it, the suspended window is moved
Move specified location displaying.
Another embodiment of the present invention, the suspension wears the hiding instruction for receiving and being applied to it, suspended window is reduced into
With a mark icon shows in the user interface of this mobile terminal, correspondingly, the mark icon is acted on receiving
After displaying instruction, the suspended window before hiding is presented in the user interface of this mobile terminal again.
Another embodiment of the present invention, the suspended window receives the out code being applied to it, and this mobile terminal will connect
The suspended window of the local interface image stream of the displaying relative movement terminal received is closed, meanwhile, this mobile terminal is closed to relative
Mobile terminal sends the port of local interface image, connects it is furthermore preferred that disconnecting this mobile terminal with the long-range of relative movement terminal
Connect.
Further, described device also includes instruction simulation module 400：For being received in this mobile terminal output display
After the interface image of the relative movement terminal arrived, the first control instruction acted on the interface image is responded, according to default
First control instruction is modeled as acting on the second control instruction in relative movement terminal by command mappings relation, to allow the phase
To mobile terminal according to the corresponding operation of execution after second control instruction.
Specifically, the ratio such as its length and width when the interface image intercepted in the relative movement terminal is shown on this mobile terminal
Example amplification/diminution, then instruction simulation module 400 according to command mappings relation will act at relative movement terminal interface image on
Touch control operation, slide etc. be modeled as acting on touch control operation, the slide of correspondence position in relative movement terminal, example
As realized that the embodiment that the first control instruction is modeled as into the second control instruction is as follows in the present embodiment：It is this as shown in Figure 4
The pixel map (18px*12px) of the interface image of the relative movement terminal shown on mobile terminal, shown in Fig. 5 be relative movement
Terminal interception, the pixel map (9px*6px) of its local interface image of transmission, each of which grid represent a pixel,
The interface image that this mobile terminal is intercepted, transmitted with 2 times of scaling display relative movement terminal, on this mobile terminal
The picture area of the relative movement terminal transmission of display, each pixel in the region is set up with a two-dimensional coordinate system
Any pixel on relation, the i.e. region is determined all to that should have a unique coordinate, according to the coordinate of the pixel with
Scaling determines the target pixel points that the pixel corresponds in the specific region intercepted on relative termination, if user
When coordinate is the gray pixels point of (8,8) in click Fig. 4, according to mapping relations, the surface chart intercepted in relative movement terminal
I.e. coordinate is the target pixel points of (4,4) as in, also the gray pixels point as in Fig. 5.If therefore being clicked on this mobile terminal
The pixel of coordinate (8,8) in viewing area, is then modeled as clicking in relative movement terminal in institute interception area after conversion
The pixel of coordinate (4,4), the first control instruction that just will act on this on this mobile terminal is modeled as acting on relative shifting
The second control instruction in dynamic terminal, then relatively moves terminal and performs corresponding operation according to second control instruction.Can
With understanding, it is described by the first control instruction be modeled as the second control instruction process can by this mobile terminal complete or
Completed by cloud server or completed by relative movement terminal, its realization principle is same as described above.
Preferably, instruction simulation module 400 includes granted unit 401, for being controlled in the relative movement terminal
Authority is authorized after this mobile terminal, execute instruction simulated operation.
, could be complete only after its control authority is authorized this mobile terminal by relative movement terminal in the embodiment of the present invention
Into the instruction simulation conversion operation.Such as " awarded specifically, one can be provided on the client software of relative movement terminal
The button of power ", user is worked as by clicking on that the control authority for relatively moving terminal can be authorized with relative movement terminal
Before set up this mobile terminal of communication connection, " authorize " button to be changed into " mandate " state simultaneously, if again tapping on described
The button of " mandate " state, can recall the control authority for authorizing this mobile terminal.Further, in the embodiment of the present invention,
Image streaming is transmitted in both directions, therefore this mobile terminal can equally authorize its control authority relative movement terminal, so that
Relatively move terminal and complete foregoing instruction simulation transformation function.
Further, after relative movement terminal performs corresponding operation according to the second control instruction, it is transmitted to this
The interface image stream of mobile terminal also real-time update, the relative movement terminal of display module 300 also received by real-time update
The display content of interface image stream.
In addition, the present invention also provides a kind of mobile terminal, for realizing mobile terminal remote control method, as shown in figure 8,
For convenience of description, the part related to the embodiment of the present invention is illustrate only, particular technique details is not disclosed, refer to this hair
Bright embodiment method part.The terminal can be to include mobile phone, tablet personal computer, PDA (Personal Digital
Assistant, personal digital assistant), POS (Point of Sales, point-of-sale terminal), any terminal device such as vehicle-mounted computer,
So that mobile terminal is mobile phone as an example：
Fig. 8 is illustrated that the block diagram of the part-structure of the mobile phone related to mobile terminal provided in an embodiment of the present invention.Ginseng
Fig. 8 is examined, mobile phone includes：Baseband processing module 810, memory 820, input block 830, display unit 840, sensor 850, sound
The portions such as frequency circuit 860, Wireless Fidelity (wireless fidelity, WiFi) module 870, processor 880 and power supply 890
Part.It will be understood by those skilled in the art that the handset structure shown in Fig. 8 does not constitute the restriction to mobile phone, can include than
More or less parts are illustrated, some parts or different parts arrangement is either combined.
Baseband processing module 810 can be used for the baseband signal that synthesis will launch, or the baseband signal received is carried out
Decoding.Specifically, audio signal is compiled into the base band code for launching when exactly launching；During reception, the base band received
Code is interpreted as audio signal.Meanwhile, it also is responsible for address information (cell-phone number, station address), text information (news in brief word, website
Word), the compiling of pictorial information (multimedia message).
Memory 820 can be used for storage software program and module, and processor 880 is stored in memory 820 by operation
Software program and module, so as to perform various function application and the data processing of mobile phone.Memory 820 can mainly include
Storing program area and storage data field, wherein, the application journey that storing program area can be needed for storage program area, at least one function
Sequence (such as sound-playing function, image player function etc.) etc.；Storage data field can be stored uses what is created according to mobile phone
Data (such as voice data, phone directory etc.) etc..In addition, memory 820 can include high-speed random access memory, can be with
Including nonvolatile memory, for example, at least one disk memory, flush memory device or other volatile solid-states
Part.
Input block 830 can be used for the numeral or character information for receiving input, and produce with the user of mobile phone set with
And the relevant key signals input of function control.Specifically, input block 830 may include that contact panel 831 and other inputs are set
Standby 832.Contact panel 831, also referred to as touch-screen, collecting touch operation of the user on or near it, (such as user uses
The operation of any suitable object such as finger, stylus or annex on contact panel 831 or near contact panel 831), and root
Corresponding attachment means are driven according to formula set in advance.Optionally, contact panel 831 may include touch detecting apparatus and touch
Two parts of controller.Wherein, touch detecting apparatus detects the touch orientation of user, and detects the signal that touch operation is brought,
Transmit a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and is converted into touching
Point coordinates, then give processor 880, and the order sent of reception processing device 880 and can be performed.Furthermore, it is possible to using electricity
The polytypes such as resistive, condenser type, infrared ray and surface acoustic wave realize contact panel 831.Except contact panel 831, input
Unit 830 can also include other input equipments 832.Specifically, other input equipments 832 can include but is not limited to secondary or physical bond
One or more in disk, function key (such as volume control button, switch key etc.), trace ball, mouse, action bars etc..
Display unit 840 can be used for the various of the information that is inputted by user of display or the information for being supplied to user and mobile phone
Menu.Display unit 840 may include display panel 841, optionally, can use liquid crystal display (Liquid Crystal
Display, LCD), the form such as Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) it is aobvious to configure
Show panel 841.Further, contact panel 831 can cover display panel 841, when contact panel 831 is detected thereon or attached
After near touch operation, processor 880 is sent to determine the type of touch event, with preprocessor 880 according to touch event
Type corresponding visual output is provided on display panel 841.Although in fig. 8, contact panel 831 and display panel 841
It is input and the input function that mobile phone is realized as two independent parts, but in some embodiments it is possible to by touch-control
Panel 831 and the input that is integrated and realizing mobile phone of display panel 841 and output function.
Mobile phone may also include at least one sensor 850, such as optical sensor, motion sensor and other sensors.
Specifically, optical sensor may include ambient light sensor and proximity transducer, wherein, ambient light sensor can be according to ambient light
Light and shade adjust the brightness of display panel 841, proximity transducer can close display panel 841 when mobile phone is moved in one's ear
And/or backlight.As one kind of motion sensor, accelerometer sensor can detect in all directions (generally three axles) acceleration
Size, size and the direction of gravity are can detect that when static, available for identification mobile phone posture application (such as horizontal/vertical screen is cut
Change, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.；May be used also as mobile phone
The other sensors such as gyroscope, barometer, hygrometer, thermometer, the infrared ray sensor of configuration, will not be repeated here.
Voicefrequency circuit 860, loudspeaker 861, microphone 862 can provide the COBBAIF between user and mobile phone.Audio-frequency electric
Electric signal after the voice data received conversion can be transferred to loudspeaker 861, sound is converted to by loudspeaker 861 by road 860
Signal output；On the other hand, the voice signal of collection is converted to electric signal by microphone 862, by voicefrequency circuit 860 receive after turn
It is changed to voice data, then after voice data output processor 880 is handled, through RF circuits 810 to be sent to such as another mobile phone,
Or export voice data to memory 820 so as to further processing.
WiFi belongs to short range wireless transmission technology, and mobile phone can help user's transceiver electronicses postal by WiFi module 870
Part, browse webpage and access streaming video etc., it has provided the user wireless broadband internet and accessed.Although Fig. 8 is shown
WiFi module 870, but it is understood that, it is simultaneously not belonging to must be configured into for mobile phone, can not change as needed completely
Become in the essential scope of invention and omit.
Processor 880 is the control centre of mobile phone, using various interfaces and the various pieces of connection whole mobile phone, is led to
Cross operation or perform and be stored in software program and/or module in memory 820, and call and be stored in memory 820
Data, perform the various functions and processing data of mobile phone, so as to carry out integral monitoring to mobile phone.Optionally, processor 880 can be wrapped
Include one or more processing units；It is preferred that, processor 880 can integrated application processor and modem processor, wherein, should
Operating system, user interface and application program etc. are mainly handled with processor, modem processor mainly handles radio communication.
It is understood that above-mentioned modem processor can not also be integrated into processor 880.
Mobile phone also includes the power supply 890 (such as battery) powered to all parts, it is preferred that power supply can pass through power supply pipe
Reason system and processor 880 are logically contiguous, so as to realize management charging, electric discharge and power managed by power-supply management system
Etc. function.
Although not shown, mobile phone can also include camera, bluetooth module etc., will not be repeated here.
In embodiments of the present invention, the processor 880 included by the terminal also has following functions：
Long-range interface channel is set up with relative movement terminal；
The local interface image stream of relative movement terminal transmission is received by the interface channel, it is synchronous by this mobile terminal
Local interface image be streaming to relative movement terminal, so that the relative movement terminal is by its its local surface chart that is added to
As upper output display；
The local interface image stream for the relative movement terminal that it is received is added on own local interface image
Output display.
In summary, this mobile terminal and the interface image stream of both relative movement terminals are passed through two-way biography by the present invention
It is defeated so that when carrying out remote control, terminal user can see the interface image of other side each other, improve the straight of remote control
See effect so that such as teaching purpose that remote control is reached is more efficient, convenient.Meanwhile, this mobile terminal and relative shifting
The transmitted in both directions of the interface image stream of dynamic terminal, adds diversified remote control function, such as remote teaching, remotely share,
The functions such as telecommuting, are that user brings more facilities.
Meanwhile, this mobile terminal passes through the shape of suspended window after the interface image that relative movement terminal is transmitted is received
Formula is superimposed, is presented in local user interface, can not only observe the image content that relative movement terminal is transmitted,
Other operations on this mobile terminal can be carried out simultaneously, allow user more easily to be controlled in remote control state and not remote
Free switching under state.Also, the size of suspended window, which is shown, voluntarily to be controlled by user, reach the viewing most coordinated with operation simultaneously
The effect deposited, meanwhile, the control authority of relative movement terminal can be voluntarily turned on and off by user, protect user to maximum program
Privacy.
Further, long-range control method of the invention is broken using the Implement of Function Module that point-to-point transmission can be achieved
The limitation of existing remote control terminal, realizes the remote control between across brand mobile terminal, allow different brands terminal user
Terminal remote control can also freely be realized.Meanwhile, in this mobile terminal and the respective boundary of relative movement terminal transmitted in both directions
By point-to-point transmission during the image of face, the load of cloud server is reduced, the definition and fluency of picture image is improved.
Although having been illustrated with some exemplary embodiments of the present invention above, those skilled in the art will manage
Solution, in the case where not departing from the principle or spirit of the present invention, can make a change to these exemplary embodiments, of the invention
Scope is limited by claim and its equivalent.
Claims (10)
1. a kind of mobile terminal remote control method, it is characterised in that comprise the following steps：
This mobile terminal sets up long-range interface channel with relative movement terminal；
This mobile terminal receives the local interface image stream for relatively moving terminal transmission by the interface channel, synchronous to move this
The local interface image of dynamic terminal is streaming to relative movement terminal, and so that it is added to by the relative movement terminal, its is local
Output display on interface image；
The local interface image stream for the relative movement terminal that this mobile terminal is received it is added to own local interface
Output display on image.
2. according to the method described in claim 1, it is characterised in that described mobile terminal and the sheet of relative movement terminal transmission
Ground interface image is the image of the specific region on the user interface of mobile terminal that user voluntarily selectes.
3. according to the method described in claim 1, it is characterised in that described mobile terminal passes through high in the clouds with relative movement terminal
Server confirms the configuration information of both sides and sets up the long-range interface channel according to this.
4. method according to claim 3, it is characterised in that the configuration information includes user account information and mobile whole
The characteristic information at end, the characteristic information of the mobile terminal includes screen size, screen resolution, the unique identification of mobile terminal
Identification code.
5. according to the method described in claim 1, it is characterised in that described mobile terminal and the image stream of relative movement terminal
It is transmitted as point-to-point transmission.
6. according to the method described in claim 1, it is characterised in that the relative movement terminal that described mobile terminal is received is passed
Defeated local interface image stream is shown on this mobile terminal with suspended window.
7. according to the method described in claim 1, it is characterised in that also including step：
This mobile terminal receives the first control instruction on the interface image for acting on the relative movement terminal, based on foundation
The second control instruction that first control instruction is modeled as acting in relative movement terminal by command mappings relation, to allow
Relative movement terminal is stated according to the corresponding operation of execution after second control instruction.
8. method according to claim 7, it is characterised in that authorize this by its control authority in the relative movement terminal
After mobile terminal, then execute instruction simulation step of converting.
9. a kind of mobile terminal remote control device, it is characterised in that including：
Link block：For setting up long-range interface channel with relative movement terminal；
Transport module：The local interface image stream of terminal transmission is relatively moved for being received by the interface channel, synchronously will
The local interface image of this mobile terminal is streaming to relative movement terminal, so that it is added to it by the relative movement terminal
Output display on local interface image；
Display module：The local interface image stream of the relative movement terminal for it to be received is added to own local circle
Output display on the image of face.
10. a kind of mobile terminal, it is characterised in that including：
Touch-sensitive display；
Memory；
One or more processors；
One or more of processors are configurable for performing any one methods described as described in claim 1~8
Step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710261609.8A CN107071035B (en) | 2017-04-20 | 2017-04-20 | Mobile terminal remote control method and device and corresponding mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710261609.8A CN107071035B (en) | 2017-04-20 | 2017-04-20 | Mobile terminal remote control method and device and corresponding mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107071035A true CN107071035A (en) | 2017-08-18 |
| CN107071035B CN107071035B (en) | 2021-03-19 |
Family
ID=59600589
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710261609.8A Active CN107071035B (en) | 2017-04-20 | 2017-04-20 | Mobile terminal remote control method and device and corresponding mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107071035B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108011951A (en) * | 2017-11-30 | 2018-05-08 | 北京奇艺世纪科技有限公司 | Remote assistance method, device, system and electronic equipment |
| CN108833963A (en) * | 2018-05-31 | 2018-11-16 | 腾讯科技（上海）有限公司 | Method, computer equipment, readable storage medium storing program for executing and the system of display interface picture |
| CN110049269A (en) * | 2018-01-16 | 2019-07-23 | 北京视联动力国际信息技术有限公司 | A kind of method, server and the client of view networking conference management |
| CN110891167A (en) * | 2019-11-30 | 2020-03-17 | 北京城市网邻信息技术有限公司 | Information interaction method, first terminal and computer readable storage medium |
| CN111031121A (en) * | 2019-12-04 | 2020-04-17 | 苏宁智能终端有限公司 | Method and device for remotely controlling POS machine equipment through voice |
| CN114647356A (en) * | 2020-12-17 | 2022-06-21 | 美的集团股份有限公司 | Control operation guidance method and device for household electrical appliance |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030078036A1 (en) * | 2001-10-19 | 2003-04-24 | Yuan-Jung Chang | Device and method for automatically installing software by wireless identification |
| CN1764103A (en) * | 2004-10-20 | 2006-04-26 | 国际商业机器公司 | Privacy protection method and apparatus for remote control |
| CN105739857A (en) * | 2016-01-25 | 2016-07-06 | 北京小米移动软件有限公司 | Mobile terminal control method and apparatus |
| CN106161619A (en) * | 2016-07-05 | 2016-11-23 | 上海斐讯数据通信技术有限公司 | A kind of long-range control method based on mobile terminal |
| CN106201491A (en) * | 2016-07-01 | 2016-12-07 | 北京奇虎科技有限公司 | Mobile terminal and mobile terminal remote assist course control method for use, device |
| CN106254462A (en) * | 2016-08-05 | 2016-12-21 | 北京奇虎科技有限公司 | Method, server and the system of a kind of remote assistance realizing mobile terminal |
-
2017
- 2017-04-20 CN CN201710261609.8A patent/CN107071035B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030078036A1 (en) * | 2001-10-19 | 2003-04-24 | Yuan-Jung Chang | Device and method for automatically installing software by wireless identification |
| CN1764103A (en) * | 2004-10-20 | 2006-04-26 | 国际商业机器公司 | Privacy protection method and apparatus for remote control |
| CN105739857A (en) * | 2016-01-25 | 2016-07-06 | 北京小米移动软件有限公司 | Mobile terminal control method and apparatus |
| CN106201491A (en) * | 2016-07-01 | 2016-12-07 | 北京奇虎科技有限公司 | Mobile terminal and mobile terminal remote assist course control method for use, device |
| CN106161619A (en) * | 2016-07-05 | 2016-11-23 | 上海斐讯数据通信技术有限公司 | A kind of long-range control method based on mobile terminal |
| CN106254462A (en) * | 2016-08-05 | 2016-12-21 | 北京奇虎科技有限公司 | Method, server and the system of a kind of remote assistance realizing mobile terminal |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108011951A (en) * | 2017-11-30 | 2018-05-08 | 北京奇艺世纪科技有限公司 | Remote assistance method, device, system and electronic equipment |
| CN110049269A (en) * | 2018-01-16 | 2019-07-23 | 北京视联动力国际信息技术有限公司 | A kind of method, server and the client of view networking conference management |
| CN110049269B (en) * | 2018-01-16 | 2021-04-06 | 视联动力信息技术股份有限公司 | Video networking conference management method, server and client |
| CN108833963A (en) * | 2018-05-31 | 2018-11-16 | 腾讯科技（上海）有限公司 | Method, computer equipment, readable storage medium storing program for executing and the system of display interface picture |
| CN110891167A (en) * | 2019-11-30 | 2020-03-17 | 北京城市网邻信息技术有限公司 | Information interaction method, first terminal and computer readable storage medium |
| CN111031121A (en) * | 2019-12-04 | 2020-04-17 | 苏宁智能终端有限公司 | Method and device for remotely controlling POS machine equipment through voice |
| CN114647356A (en) * | 2020-12-17 | 2022-06-21 | 美的集团股份有限公司 | Control operation guidance method and device for household electrical appliance |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107071035B (en) | 2021-03-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107071035A (en) | mobile terminal remote control method, device and corresponding mobile terminal | |
| CN107203630A (en) | Application program page collecting method, device and corresponding mobile terminal | |
| CN107786732A (en) | Terminal applies method for pushing, mobile terminal and computer-readable recording medium | |
| US10768881B2 (en) | Multi-screen interaction method and system in augmented reality scene | |
| CN107005721A (en) | Direct broadcasting room pushing video streaming control method and corresponding server and mobile terminal | |
| US10108981B2 (en) | Controlling content distribution using multiple devices | |
| CN109451141B (en) | Operation control method and related terminal | |
| JP2023503526A (en) | Application sharing method, electronic device and computer readable storage medium | |
| CN107085617A (en) | Application program page collecting method, device and corresponding mobile terminal | |
| CN107943489A (en) | Data sharing method and mobile terminal | |
| CN108513671B (en) | Display method and terminal for 2D application in VR equipment | |
| JP2018523176A (en) | Method, server, mobile terminal, and apparatus for exchanging data with in-vehicle infotainment | |
| CN109739402B (en) | Fast application processing method and terminal equipment | |
| CN109889348A (en) | A kind of images share method and device | |
| CN111079030B (en) | Group searching method and electronic equipment | |
| JP2023503691A (en) | Application sharing method, electronic device and computer readable storage medium | |
| WO2016188252A1 (en) | Method, device for displaying reference content and storage medium thereof | |
| WO2020125405A1 (en) | Control method for terminal apparatus, and terminal apparatus | |
| CN109460170A (en) | Screen extension and exchange method, terminal and computer readable storage medium | |
| CN109284144A (en) | A kind of fast application processing method and mobile terminal | |
| WO2020135092A1 (en) | Permission management method and terminal device | |
| CN107765954B (en) | Application icon updating method, mobile terminal and server | |
| CN107864086A (en) | The quick sharing method of information, mobile terminal and computer-readable recording medium | |
| CN111367444A (en) | Application function execution method and device, electronic equipment and storage medium | |
| US20160329029A1 (en) | Apparatus and method for integrating a smart mobile device and a touch device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |