CN108920225A

CN108920225A - Remote assistant control method and device, terminal, storage medium

Info

Publication number: CN108920225A
Application number: CN201810414144.XA
Authority: CN
Inventors: 黄小燕; 曹飞
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2018-05-03
Filing date: 2018-05-03
Publication date: 2018-11-30

Abstract

This application discloses a kind of remote assistant control method and device, terminal, storage medium, belong to Internet technical field.The method includes：The screen data of second terminal is obtained, the second terminal is that the terminal of remote assistant control connection is established with the first terminal；Based on the screen data, the operation interface of the second terminal is shown；After detecting the trigger action for the operation interface, obtain based on the collected location information of the trigger action institute, the location information is used to indicate the target position in the operation interface；The location information is sent to the second terminal, prompt information is presented in the operation interface so that the second terminal is based on the location information, the prompt information executes operation to the target position for prompting.Remote assistant control method provided in an embodiment of the present invention effectively improves the efficiency and accuracy of remote assistant control.

Description

Remote assistant control method and device, terminal, storage medium

Technical field

This application involves Internet technical field, in particular to a kind of remote assistant control method and device, terminal, storage Medium.

Background technique

With the development of science and technology, the function of mobile terminal tends to diversification and complicates development, correspondingly, the multiplicity Higher requirements are also raised to mobile terminal user for change and the function of complicating, by taking the mobile terminal is mobile phone as an example, when When some difficulty biggish cell-phone function is used alone in old man, there can be more difficulty.

In the related technology, children can instruct old man's operating handset by the modes such as make a phone call, to help old man preferably Use mobile phone.

But the guidance method usually can not accurately describe how to operate mobile phone, therefore, the guidance method Efficiency is lower.

Summary of the invention

The embodiment of the invention provides a kind of remote assistant control method and device, terminal, storage medium, can solve phase The efficiency of guidance method is lower in the technology of pass.The technical solution is as follows：

On the one hand, a kind of remote assistant control method is provided, first terminal is applied to, the method includes：

The screen data of second terminal is obtained, the second terminal is to establish remote assistant control with the first terminal to connect The terminal connect；

Based on the screen data, the operation interface of the second terminal is shown；

After detecting the trigger action for the operation interface, obtain based on the collected position of the trigger action institute Confidence breath, the location information are used to indicate the target position in the operation interface；

The location information is sent to the second terminal, so that the second terminal is based on the location information described Prompt information is presented in operation interface, the prompt information executes operation to the target position for prompting.

On the other hand, a kind of remote assistant control method is provided, second terminal is applied to, the method includes：

The screen data of the second terminal is acquired, the second terminal is to establish remote assistant control with first terminal to connect The terminal connect；

The screen data is sent to the first terminal, so that the first terminal shows the behaviour of the second terminal Make interface；

The location information that the first terminal is sent is received, the location information is based on by the first terminal for described The trigger action of operation interface acquires, and the location information is used to indicate the target position in the operation interface；

Based on the location information, prompt information is presented in the operation interface, the target position is held with prompt Row operation.

Another aspect provides a kind of remote assistant control method, is applied to first terminal, the method includes：

The video flowing of the image of the operation interface comprising second terminal is obtained, the second terminal is and the first terminal Establish the terminal of remote assistant control connection；

The video flowing is played, to show the image of the operation interface；

After detecting the trigger action for the image of the operation interface, obtains and acquired based on the trigger action The location information arrived, the location information are used to indicate the target position in the operation interface；

In another aspect, providing a kind of remote assistant control method, it is applied to second terminal, the method includes：

The video flowing of the image of operation interface of the acquisition comprising the second terminal, the second terminal are and first terminal Establish the terminal of remote assistant control connection；

By the video stream to the first terminal, so that the first terminal is shown by playing the video flowing The image of the operation interface；

The location information that the first terminal is sent is received, the location information is based on by the first terminal for described The trigger action of the image of operation interface acquires, and the location information is used to indicate the target position in the operation interface It sets；

In another aspect, providing a kind of remote operation control device, described device includes：

First obtains module, and for obtaining the screen data of second terminal, the second terminal is and the first terminal Establish the terminal of remote assistant control connection；

Display module shows the operation interface of the second terminal for being based on the screen data；

Second obtains module, for obtaining and being based on the touching after detecting the trigger action for the operation interface The collected location information of hair operation institute, the location information are used to indicate the target position in the operation interface；

Sending module, for sending the location information to the second terminal, so that the second terminal is based on described Prompt information is presented in location information in the operation interface, and the prompt information executes behaviour to the target position for prompting Make.

Acquisition module, for acquiring the screen data of the second terminal, the second terminal is to establish with first terminal The terminal of remote assistant control connection；

First sending module, for the screen data to be sent to the first terminal, so that the first terminal is aobvious Show the operation interface of the second terminal；

First receiving module, the location information sent for receiving the first terminal, the location information is by described the One terminal is acquired based on the trigger action for the operation interface, and the location information is used to indicate the operation interface In target position；

For being based on the location information prompt information is presented in the operation interface, to prompt to institute in processing module It states target position and executes operation.

In another aspect, providing a kind of terminal, the terminal includes processor and memory, is stored in the memory At least one instruction, at least one section of program, code set or instruction set, at least one instruction, at least one section of program, institute Code set or instruction set is stated to be loaded by the processor and executed to realize the remote assistant control method as provided in terms of above-mentioned.

In another aspect, providing a kind of computer readable storage medium, at least one finger is stored in the storage medium Enable, at least one section of program, code set or instruction set, at least one instruction, at least one section of program, the code set or Instruction set is loaded by processor and is executed to realize the remote assistant control method as provided in terms of above-mentioned.

Technical solution bring beneficial effect provided in an embodiment of the present invention is：

The operation interface of second terminal is shown by first terminal, realizes operation circle of the synchronous second terminal of first terminal Face, and get and be used to indicate in operation interface after the location information of target position in first terminal, in the operation of second terminal The information that prompt operates target position is presented in interface, so that accurately prompt needs the target position operated, effectively Ground improves the efficiency and accuracy of remote assistant control.

Also, since the realization of the technical solution is not limited by operating system, expand the applicable model of the technical solution It encloses.

In addition, can guarantee the safety of second terminal due to without controlling by first terminal second terminal With autonomous operation.

Detailed description of the invention

To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application, for For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.

Fig. 1 is a kind of schematic diagram of implementation environment provided in an embodiment of the present invention.

Fig. 2 is the schematic diagram of another implementation environment provided in an embodiment of the present invention.

Fig. 3 is the schematic diagram of another implementation environment provided in an embodiment of the present invention.

Fig. 4 is a kind of flow chart of remote assistant control method provided in an embodiment of the present invention.

Fig. 5 is the schematic diagram of certain the frame operation interface shown on a kind of first terminal provided in an embodiment of the present invention.

Fig. 6 is a kind of letter of the target location display reminding in the operation interface of second terminal provided in an embodiment of the present invention The method flow diagram of breath.

Fig. 7 is a kind of letter of the target location display reminding in the operation interface of second terminal provided in an embodiment of the present invention The schematic diagram of breath.

Fig. 8 is a kind of method flow diagram for establishing remote assistant control connection provided in an embodiment of the present invention.

Fig. 9 is that the live information of direct broadcasting room is sent to second terminal by a kind of first terminal provided in an embodiment of the present invention Method flow diagram.

Figure 10 is the schematic diagram of display in a kind of first terminal provided in an embodiment of the present invention " success of creation room " prompt.

Figure 11 is showing for live information shown on a kind of display interface of second terminal provided in an embodiment of the present invention It is intended to.

Figure 12 be on a kind of display interface of second terminal provided in an embodiment of the present invention display reminding by aid whether The schematic diagram of the dialog box of remote assistant control connection is established in confirmation.

Figure 13 is the flow chart of another remote assistant control method provided in an embodiment of the present invention.

Figure 14 is the flow chart of another remote assistant control method provided in an embodiment of the present invention.

Figure 15 is a kind of structural schematic diagram of remote operation control device provided in an embodiment of the present invention.

Figure 16 is the structural schematic diagram of another remote operation control device provided in an embodiment of the present invention.

Figure 17 is the structural schematic diagram of another remote operation control device provided in an embodiment of the present invention.

Figure 18 is the structural schematic diagram of another remote operation control device provided in an embodiment of the present invention.

Figure 19 is also a kind of structural schematic diagram of remote operation control device provided in an embodiment of the present invention.

Figure 20 is the structural schematic diagram of another remote operation control device provided in an embodiment of the present invention.

Figure 21 is a kind of structural schematic diagram of terminal provided in an embodiment of the present invention.

Specific embodiment

To keep the purposes, technical schemes and advantages of the application clearer, below in conjunction with attached drawing to the application embodiment party Formula is described in further detail.

During using mobile terminal, it will usually the situation that will not be operated is encountered, for using mobile phone：Old man is single Solely using during mobile phone, the situation that will not operate certain applications can be encountered.It is a kind of in the related technology, children can pass through The modes such as make a phone call instruct old man's operating handset, and still, which usually can not accurately describe how to operate to mobile phone, Therefore, the efficiency of the guidance method is lower.

It is another in the related technology, also have and the method for executing operation by aid, example assisted by application program remote Such as：The remote assistance function of application program, alternatively, the remote control software that certain mobile terminal manufacturers integrate in system level. By taking mobile terminal is computer as an example, in the remote assistance function of application program, assistance pass is established in aid and by aid After system, can be shown on the computer of aid by the computer display interface of aid, and aid can be aobvious by the computer Show interface manipulation by the computer of aid.

But in the method, since aid enjoys manipulation by the permission of the computer of aid, cause by aid's There are security risks for computer, and the remote assistance function is only capable of realizing in the computer for being equipped with WINDOWS operating system, causes The scope of application of the remote assistance function is restricted.In addition, mobile terminal manufacturer is soft in the remotely control that system level integrates Part requires aid and is used the operating system of the manufacturer by aid, equally limits the scope of application of the function.

For this purpose, being sent out by first terminal to second terminal the embodiment of the invention provides a kind of remote assistant control method The location information for being used to indicate and being operated to the target position of operation interface is sent, second terminal is mentioned according to location information presentation Show information, operation is executed to target position according to the prompt information with guidance and help person, the remote secondary to aid may be implemented Control is helped, and the realization of the remote assistant control method is not limited by operating system, can solve above-mentioned the relevant technologies and exist The problem of.Wherein, the terminal that the first terminal person of being to aid in uses, second terminal are the terminals used by aid.Such as：First Terminal can be the terminal that children use, and second terminal can be the terminal for needing the parent instructed to use.

Referring to FIG. 1, it illustrates a kind of implementations involved in remote assistant control method provided in an embodiment of the present invention The structural schematic diagram of environment, the implementation environment may include：First terminal 10 and second terminal 20.The first terminal 10 and this Two terminals 20 can be smart phone, computer, multimedia player, electronic reader or wearable device etc..This first Connection can be established by cable network or wireless network between terminal 10 and the second terminal 20, for example, in the present embodiment, Second terminal 20 and first terminal 10 are established remote assistant control and are connected.

Wherein, first terminal 10 is used to obtain the screen data of second terminal 20；Based on screen data, in first terminal 10 The operation interface of middle display second terminal 20；After detecting the trigger action for operation interface, obtains and be based on trigger action The collected location information of institute, location information are used to indicate the target position in operation interface；Position is sent to second terminal 20 Prompt information is presented so that second terminal 20 is based on location information in information in the operation interface, and prompt information is for prompting to mesh Cursor position executes operation.

Second terminal 20 is used to acquire the screen data of second terminal 20, and second terminal 20 is to establish far with first terminal 10 The terminal of journey auxiliary control connection；Screen data is sent to first terminal 10, so that display second is whole in first terminal 10 The operation interface at end 20；The location information that first terminal 10 is sent is received, location information is based on by first terminal 10 for operation The trigger action at interface acquires, and location information is used to indicate the target position in operation interface；Based on location information, grasping Make that prompt information is presented in interface, operation is executed to target position with prompt.

Further, in a kind of optional embodiment, referring to FIG. 2, the implementation environment can also include：First service Device 30, the first server 30 can be a server, or the server cluster consisted of several servers, either One cloud computing service center.Illustratively, which can be cloud backstage.First terminal 10 and the first server Between 30, connection can be established by cable network or wireless network between second terminal 20 and the first server 30.

In a kind of optional embodiment, the remote assistant control method provided in an embodiment of the present invention can pass through direct broadcasting room It realizes, then the first server 30 is for assisting to realize remote assistant by direct broadcasting room between first terminal 10 and second terminal 20 Control function.Such as：The first server 30 can be used for creating direct broadcasting room for first terminal 10, so that the first terminal 10 is based on The direct broadcasting room and second terminal 20 are established remote assistant control and are connected；Alternatively, the first server 30 is used to be second terminal 20 Direct broadcasting room is created, so that the second terminal 20 is based on the direct broadcasting room and first terminal 10 is established remote assistant control and connected.Such as： The first server 30 can receive the direct broadcasting room creation instruction of the transmission of first terminal 10, create instruction creation according to the direct broadcasting room Direct broadcasting room, and the live information of the direct broadcasting room of creation is sent to the first terminal 10, in order to which first terminal 10 is based on this directly It broadcasts information and second terminal 20 is established remote assistant control and connected.Alternatively, the first server 30 can be used in first terminal 10 After establishing remote assistant control connection by direct broadcasting room with second terminal 20, phase is sent to first terminal 10 or second terminal 20 Close data.Such as：First server 30 after the video flowing for getting second terminal 20, can to 10 plug-flow of first terminal, so as to The video flowing is played simultaneously in first terminal 10.

Also, in a kind of optional embodiment, referring to FIG. 3, the implementation environment can also include：Second server 40, which can be a server, or the server cluster consisted of several servers or one A cloud computing service center.Illustratively, which can be application server.First terminal 10 and the second service Between device 40, between second terminal 20 and the second server 40 and between first server 30 and the second server 40 Connection can be established by cable network or wireless network.

Wherein, which is used in remote assistant control connection procedure, whole in first terminal 10 and second The transmission of data is carried out between end 20, and, in first terminal 10 and between first server 30, in second terminal 20 and the Function scheduling is carried out between one server 30.Such as：First terminal 10 request creation direct broadcasting room when, first terminal 10 can first by Direct broadcasting room creation instruction is sent to second server 40, and second server 40 can be based on direct broadcasting room creation instruction the first clothes of scheduling The functional interface of business device 30, and direct broadcasting room creation instruction is forwarded to the first server 30, make first server 30 be based on being somebody's turn to do Direct broadcasting room creation instruction creation direct broadcasting room.Alternatively, the second server 40 can be with after second terminal 20 determines access direct broadcasting room Whether the live information for verifying direct broadcasting room is effective, and the function of scheduling first server 30 connects when determining that live information is effective Mouthful, make first server 30 that the second terminal 20 is accessed direct broadcasting room.

The embodiment of the invention provides a kind of remote assistant control method, which can be applied to figure 1 to Fig. 3 it is any shown in implementation environment, and the implementation of the remote assistant control method can there are many, such as：It can lead to Live streaming application etc. is crossed to realize.In order to make it easy to understand, the embodiment of the present invention is real by live streaming application with the remote assistant control method It is existing, and this method is applied to be described for implementation environment shown in Fig. 3.As shown in figure 4, the remote assistant controlling party Method may comprise steps of：

The screen data of step 401, second terminal acquisition second terminal, and screen data is sent to first terminal.

In live streaming application, which is carried in video flowing, therefore, should in a kind of optional implementation The implementation of step 401 may include：The video flowing that second terminal is sent is obtained, which includes that an at least frame second is whole The image of the operation interface at end.Wherein, the image of the operation interface of second terminal is the screen data of second terminal.

Optionally, after second terminal and first terminal establish remote assistant control connection, second terminal can be using record The mode of screen acquires the video flowing, so that include the image of at least operation interface of a frame second terminal in the video flowing of acquisition, Then by the video stream to first terminal, for showing operation circle of the second terminal in the display interface of first terminal Face, so that aid provides guidance to by aid based on the operation interface of the display.

Wherein, the implementation that screen data is sent to first terminal can be by second terminal：Second terminal is by the screen Curtain data are sent to first server, which is forwarded to second terminal for the screen data again.Such as：First clothes Being engaged in device can be for cloud from the background, which can be circulated the pushing video streaming of acquisition to cloud backstage, cloud backstage by second terminal again It is sent to second terminal.

It should be noted that the information security in order to guarantee second terminal, is established long-range in second terminal and first terminal After auxiliary control connection, dialog box can be shown in the display interface of second terminal, is confirmed whether out with prompt by aid The screen data for the acquisition second terminal that begins detects the confirmation instruction triggered by aid based on the dialog box in second terminal Afterwards, start the screen data of acquisition second terminal.Such as：Remote assistant control is established in second terminal and first terminal to connect Afterwards, pop-up can be shown in the display interface of second terminal, which is confirmed whether to start by aid record screen for prompting, the Two terminals start to record operation circle including second terminal after receiving the confirmation triggered by aid based on the pop-up instruction The image in face, to obtain video flowing.

Step 402, first terminal are based on screen data, and the behaviour of the second terminal is shown in the display interface of first terminal Make interface.

First terminal after receiving the screen data that second terminal is sent to it, can be shown in first terminal this The operation interface of two terminals by the operation interface simultaneous display of second terminal in first terminal, and then is convenient for aid's root The trigger action operated to the target position in the operation interface is executed instruction according to the operation interface.

Optionally, when the screen data that second terminal is sent to the first terminal carries in video streaming, the step 402 Realization process may include：Video flowing is played, in first terminal to show the operation of second terminal in the video of broadcasting Interface.

Wherein, it is more to show that the implementation of the operation interface of second terminal can have in the display interface of first terminal Kind, the embodiment of the present invention can be described by following two for realization mode：

The first can realize mode, and the operation interface of second terminal is displayed in full screen in the display interface of first terminal.

At this, the first can be in realization mode, and aid can check second terminal from the display interface of the first terminal Operation interface, and for the operation interface execute trigger action, with guidance the operation interface is operated by aid.

Second of achievable mode, while the display interface of the first terminal itself is shown in first terminal, The operation interface of second terminal is shown in the display interface of one terminal.

The display interface of the first terminal itself can be shown in this second achievable mode, in first terminal, meanwhile, The operation interface of second terminal, and the operation interface can be shown in this itself display interface using the forms such as suspended window Position in this itself display interface can be configured according to actual needs, such as：The operation interface may be displayed on The positions such as this itself the upper left corner, the upper right corner, centre, the lower left corner or the lower right corner of display interface.Also, being directed in aid should Under the action of the moving operation of operation interface, the integral position of the operation interface can also change according to the moving operation.

In this second achievable mode, due to that can show two interfaces in first terminal simultaneously, aid can be with It is operated for two interfaces, when aid operates for the display interface of first terminal itself, first terminal The original function of the first terminal can be realized according to the operation, such as：When aid clicks display circle of first terminal itself When contact icon in face, first terminal can show contacts list according to the clicking operation in display interface.Work as help It is available after first terminal detects the trigger action when person executes trigger action for the operation interface of second terminal Based on the collected location information of trigger action institute, to realize to by the guidance of aid, i.e. execution step 403.Such one Come, the original function of first terminal had not only may be implemented in first terminal, but also may be implemented to improve first to by the guidance of aid Terminal can realize the compatibility of function.

Step 403, after first terminal detects the trigger action for the operation interface of the second terminal, first terminal It obtains based on the collected location information of trigger action institute.

Wherein, which is used to indicate the target position in the operation interface of the second terminal.

Optionally, which can be the touch control operation of the operation interface for second terminal, the location information packet Include the coordinate information of the position of touch control operation.Such as：The touch control operation can be the clicking operation inputted by input equipment, The location information is the coordinate information of the click location of the clicking operation on a display screen；Alternatively, the touch control operation may be For the touch operation of touching display screen, which is the coordinate information of the touch point of the touch operation.And/or the touching Hair operation can operate for voice collecting, which is included in voice collecting and operates in collected voice messaging.Such as： The voice operating can be the operation of recorded speech, carry the location information in the content of the voice of recording.

Illustratively, it is assumed that the display screen of first terminal is touching display screen, and Fig. 5, which is shown, to be shown on the first terminal The schematic diagram of certain frame operation interface needs to indicate to be clicked the figure in the operation interface at the A of position by aid when aid determines When mark, aid can touch position A, correspondingly, first terminal can be detected by touching the trigger action generated, and be based on The trigger action gets the coordinate information of position A.

Step 404, first terminal send location information to second terminal.

Second server between first terminal and second terminal for carrying out the transmission of data, therefore, the step 404 Implementation may include：First terminal sends the location information to second server, and second server is sent out to second terminal again The location information is given, so that prompt information is presented in the operation interface of second terminal according to the location information.

Step 405, second terminal are based on location information, and prompt information is presented in the operation interface, to prompt to target position It sets and executes operation.

Wherein, which executes operation to target position for prompting.

Optionally, when trigger action is touch control operation, it can be based on the corresponding coordinate information of the touch control operation, second Target location display reminding information in the operation interface of terminal, the prompt information of the display may include suspension pattern or text Information etc..And in order to improve attention rate, the display mode of the prompt information of the display can be configured according to actual needs, example Such as：The prompt information can be flashed according to predeterminated frequency.Also, the shape and color of the suspension pattern, the text information Font and color can be configured according to actual needs, such as：The suspension pattern can be cursor pattern, aperture pattern Or scribble pattern etc..

It, can be by playing collected voice messaging, to realize to prompt when trigger action is that voice collecting operates The presentation of information.Further, when trigger action is that voice collecting operates, the implementation of the presentation prompt information can be with Including：While playing collected voice messaging, the voice content in voice messaging is identified, and according in the voice content Included location information, the corresponding position in the operation interface of second terminal show suspension pattern or text information.

In a kind of achievable mode, in order to guarantee prompt information display position accuracy, referring to FIG. 6, should be The realization process of target location display reminding information may include in the operation interface of second terminal：

Step 4051, second terminal obtain the resolution ratio of first terminal and second terminal respectively.

Wherein, display resolution (abbreviation resolution ratio) is the number of pixels that can be shown on display screen, and the resolution ratio is usual It is indicated with the total columns of pixel in display screen horizontal direction with the multiplying for the total line number of pixel in vertical direction, such as：Display screen water Square total columns of upward pixel is 160, when the total line number of pixel in vertical direction is 128, the resolution ratio of the display screen It is 160 × 128.

Generally, the configuration information of itself is stored in each terminal, record has terminal display screen in the configuration information Resolution ratio, therefore, second terminal can obtain the resolution ratio of itself by inquiring the configuration information.Second terminal obtains the The implementation of the resolution ratio of one terminal may include：Second terminal sends resolution ratio acquisition instruction to first terminal, and first eventually The resolution ratio of itself can be sent to the second terminal after receiving the resolution ratio acquisition instruction by end；Alternatively, long-range establishing During auxiliary control connection, the resolution ratio of itself can be sent to first server by first terminal, first server to When second terminal sends location information, which sends the resolution ratio of the first terminal to the second terminal simultaneously.

Step 4052, second terminal determine location information based on first terminal, the resolution ratio of second terminal and location information The indicated target position in the operation interface of second terminal.

In order to guarantee prompt information display position accuracy, according to location information in the operation interface display reminding believe Before breath, the effect of touch control operation can be clicked through according to the resolution ratio of first terminal, the resolution ratio of second terminal and location information Row coordinate transform, so that the content that second terminal is shown according to the target location after coordinate transform, with first terminal in touch-control The content shown at the position of operation is consistent, so that can accurately be grasped according to the guidance of aid by aid Make.

Optionally, the implementation of the step 4052 may include：Determine that the position of touch control operation is whole first respectively Hold the position of pixel column and touch control operation locating in horizontal direction in display screen vertical direction in first terminal display screen Upper locating pixel column；According to the ratio of the total columns of pixel in the pixel column and first terminal resolution ratio and object pixel column with The equal corresponding relationship of the ratio of the total columns of pixel in second terminal resolution ratio, determines the corresponding object pixel in the target position Column；It is differentiated according to the ratio of the total line number of pixel in the pixel column and first terminal resolution ratio and object pixel row and second terminal The equal corresponding relationship of the ratio of the total line number of pixel in rate, determines the corresponding object pixel row in the target position, to be somebody's turn to do Target position.

It that is to say, it is assumed that the resolution ratio of first terminal is H1 × W1, and the resolution ratio of second terminal is H2 × W2, touch control operation The coordinate of position be (x1, y1), the coordinate of target position is (x2, y2), then the position of touch control operation and target position Following relationship should be met：X1/W1=x2/W2 and y1/H1=y2/H2 can determine the seat of the target position according to the corresponding relationship Mark.

Illustratively, it is assumed that the resolution ratio of first terminal is 800 × 480, and the resolution ratio of second terminal is 1280 × 720, touching The coordinate for controlling the position of operation is (120,200), the coordinate of target position be (x2, y2) according to the position of touch control operation with The relationship that target position should meet can obtain：X2=180, y2=320, the i.e. coordinate of target position are (180,320).

Step 4053, the target location display reminding information in the operation interface of second terminal.

Since the content that the target location is shown is consistent with the content shown at the position of the touch control operation, The target position can be operated by aid with prompt, and then complete guidance in the target location display reminding information Process.

Step 406, second terminal receive the operational order triggered based on prompt information.

Illustratively, Fig. 7 is the schematic diagram of the display reminding information at the B of target position in the operation interface of second terminal, quilt Aid can be with the operational order of triggering selection, by carrying out pair Fig. 7 and Fig. 5 by clicking the icon at the place target position B Than can be seen that：The content that second terminal is shown according to the target location after coordinate transform, with first terminal in touch control operation Position at show content it is consistent.

It should be noted that the remote assistant control method can also include establishing before step 401 to step 406 The process of remote assistant control connection, and the process for establishing remote assistant control connection can be initiated by first terminal, it can also To be initiated by second terminal, and this establish remote assistant control connection implementation can there are many, the embodiment of the present invention with Remote assistant control connection is established by direct broadcasting room, and the process for establishing remote assistant control connection is initiated as by first terminal Example is described, referring to FIG. 8, the process for establishing remote assistant control connection may include：

Step 501, first terminal send direct broadcasting room creation instruction to first server.

For first terminal after opening remote assistant control function, which can send direct broadcasting room wound to first server Instruction is built, to request creation direct broadcasting room.Wherein, the terminal iidentification of the first terminal can be carried in direct broadcasting room creation instruction, The terminal iidentification is for identifying terminal.Illustratively, which may include：International mobile equipment identification number (International Mobile Equipment Identity, IMEI), media access control (Media Access Control, MAC) address, alternatively, carrying out the character string etc. after operation according to IMEI and MAC Address.

Optionally, remote assistant control method provided in an embodiment of the present invention can be realized by application program, such as：It can The remote assistant control method is realized to control client by the remote assistant of installation in the terminal.Visitor is controlled in remote assistant Multiple keys can be set in the main interface at family end, each key corresponds to different functions, and multiple key includes that creation is straight A key is broadcast, can realize that sending direct broadcasting room to server creates the operation instructed by clicking the creation direct broadcasting room key.

It should be noted that after first terminal opens remote assistant control function, the background program meeting of the first terminal Some initialization operations are executed, which may include：Detect network connection state, the initial configuration of direct broadcast function (such as cloud interaction live streaming initialization), and load bottom code library etc..

Also, after executing initialization operation, first terminal can send logging request instruction, the login to second server Request instruction be used for request call second server remote assistant control interface, the logging request instruction in carry this first The terminal iidentification of terminal.Second server, can be according to the terminal iidentification of the first terminal after receiving logging request instruction Whether the relevant information of the first terminal is recorded in inquiry second server.When recording the first terminal in second server Relevant information when, second server execute remote assistant control interface call operation, and to first terminal transmission carry The login response of key information carries out authorization login to the second terminal；When the first terminal is not recorded in second server Relevant information when, second server according to the terminal iidentification of the first terminal execute registration operation, which is added To user list, and the operation for calling remote assistant control interface is executed, while carrying key information to first terminal transmission Login response, authorization login is carried out to the second terminal.First terminal can believe the key after receiving the key information It ceases and saves to predeterminated position, to carry out safe test in the process with remote assistant control connection etc. is established in subsequent creation direct broadcasting room Card.

Step 502, first server are based on direct broadcasting room creation instruction, create direct broadcasting room, and direct broadcasting room is created response hair It send to first terminal.

Wherein, the live information of the direct broadcasting room of creation is carried in direct broadcasting room creation response, recording in the live information has The information such as the room number of direct broadcasting room, the room number are used to identify the direct broadcasting room of the creation.The process of the creation direct broadcasting room can be considered Caller interface, and the process that the routine interface of first terminal and calling is attached.Such as：First server is receiving To after direct broadcasting room creation instruction, can call start broadcasting, watch, upper wheat, the routine interfaces such as plug-flow and recording, and establish first terminal With the connection between called routine interface.

In a kind of achievable mode, the implementation of the step 502 may include：First server creates direct broadcasting room Instruction is sent to second server, second server after receiving direct broadcasting room creation instruction, schedulable first server Functional interface forwards direct broadcasting room creation instruction to the first server, and records the creation task.First server is receiving To after direct broadcasting room creation instruction, direct broadcasting room can be created based on predetermined manner, and send direct broadcasting room creation response to first terminal.

The live information of direct broadcasting room is sent to second terminal by step 503, first terminal.

Optionally, referring to FIG. 9, the realization process of the step 503 may include：

Step 5031, first terminal generate uniform resource locator according to live information.

First terminal can be reserved for direct broadcasting room creation response after receiving the direct broadcasting room creation response of first server transmission The live information of middle carrying, and the corresponding uniform resource locator of direct broadcasting room is generated according to preset rules according to the live information (Uniform Resource Locator, URL), the URL are the one of the access path of direct broadcasting room indicated by the live information The succinct expression of kind, can realize the access to the direct broadcasting room by the URL.

URL is sent to second terminal by step 5032, first terminal.

In general, be logged in account in terminal, pass through the account logged in the account and second terminal that log on first terminal Number it can will realize the information exchange between first terminal and second terminal.Therefore, the implementation of the step 5032 can wrap It includes：By logging in the first account of first terminal and logging in the second account of second terminal, URL is sent to the by first terminal Two terminals.

Optionally, the account logged in terminal can by the account for the client that registration terminal is installed, such as：The terminal The account of upper login can be by the wechat account for the wechat client that registration terminal is installed；Alternatively, the account logged in terminal The account logged in platform can be obtained for terminal applies, alternatively, the account logged in the terminal can be to be integrated in client In the corresponding account of application program, such as：The account logged in the terminal can be by wechat client that terminal is installed Small routine (liteapp) corresponding to account etc..

Further, the first account and the second account can be the account there are incidence relation.Illustratively, first account With the account that the second account can be there are friend relation.Such as：In social networks chain, the first account and the second account can be with For there are the accounts of the friend relations such as wechat good friend, telephone directory good friend and QQ friends.Also, the first terminal can be by becoming better Friend sends the mode for sharing link, sends the URL to second terminal.By the way that there are the accounts of friend relation to send live information, It can guarantee the instant transmitting-receiving of live information, additionally it is possible to guarantee the peace of the remote assistant established according to live information control connection Quan Xing.

Illustratively, referring to FIG. 10, that installs on first terminal is remote after first terminal receives direct broadcasting room creation response " success of creation room " and " please invite and room is added by aid " can be shown on the display interface of journey auxiliary control client Successful information is created Deng prompt direct broadcasting room, and is additionally provided with the virtual key of " invite and be added " on the display interface.It is helping After person clicks the key that " should be invited and be added ", contact person's selective listing will pop up in the display interface, so that aid selects to need Invite being sent to by aid, and by the URL by aid for addition.Such as：Children can be in contact person's selective listing Middle selection parent to invite parent to enter direct broadcasting room, and carries out remote assistant control, and the interface to parent by the direct broadcasting room On also show " after inviting successfully, turning back to remote assistant control client, wait elder be added room " prompt information.

Step 504, second terminal show live information, and receive the confirmation access instruction triggered based on live information.

It, can be in display circle of the second terminal after second terminal receives the live information for the direct broadcasting room that first terminal is sent The live information is shown on face, is established remote assistant control connection for choosing whether confirmation by aid, is selected when by aid When selecting confirmation and establishing remote assistant control connection, confirmation access instruction can be triggered by predetermined registration operation, it is straight with instruction confirmation access Between broadcasting.

Illustratively, second terminal is mounted on when live information is sent to by first terminal by the first social application client In the second social application client after, the schematic diagram of shown live information please refers on the display interface of the second terminal Figure 11, as shown in figure 11, the live information are shown in the display interface of second terminal in the form of instant message, second terminal After detecting the operation for being clicked the instant message by aid, dialogue shown in Figure 12 can be shown on the display interface of second terminal Frame K is built with prompting the remote assistant control for whether being confirmed foundation and aid by aid to connect when being selected to confirm by aid When founding the option of remote assistant control connection, the confirmation access instruction triggered based on the selection is can be detected in second terminal.

It should be noted that second terminal can also after being selected confirmation to establish remote assistant control connection by aid The operation for opening remote assistant control function is executed, and the operation of the unlatching remote assistant control function can be for by second terminal The operation of automatic trigger when detecting confirmation access instruction is also possible to after second terminal detects confirmation access instruction, the Dialog box is shown in the display interface of two terminals, and the behaviour triggered after opening is selected by aid in the dialog box Make.

Also, after opening remote assistant control function, second terminal also can send logging request to second server and refer to It enables, with the remote assistant control interface of request call second server, and obtains the login response for carrying key information.Its In, the implementation of the process please accordingly sends the implementation that logging request instructs to second server with reference to first terminal, Details are not described herein again.

Step 505, second terminal are after getting the confirmation access instruction triggered based on live information, based on live streaming letter It ceases to second server and sends verifying instruction, to request second server verifying live information whether effective.

In order to guarantee effective foundation of remote assistant control connection, second terminal is triggered based on live information receiving Confirmation access instruction after, can based on live information to second server send verifying instruction, to request second server to be tested Whether effective demonstrate,prove the live information.When second server confirmation live information is effective, second server is determined to be based on being somebody's turn to do Live information establishes remote assistant control connection, and sends confirmation access instruction to first terminal.When second server confirmation is straight Broadcast information it is invalid when, second server determination can not based on the live information establish remote assistant control connection, at this time without to First terminal sends confirmation access instruction.

Whether step 506, second server verify the live information effective, and send verification result to second terminal.

Optionally, the live information of direct broadcasting room, the terminal iidentification of first terminal and first can be carried in verifying instruction The information such as account, second server can verify the live information according to the information carried in verifying instruction, with judgement Whether live information is effective, and sends corresponding verification result to second terminal.

Wherein, the second server verifying whether effective implementation of live information may include：Detecting the first account is It is no to be online, when first account is online, confirm that the live information is effective；Alternatively, detect this first Whether the remote assistant control function of terminal remains open state, when the remote assistant control function of first terminal remains on When opening state, confirm that the live information is effective.

Step 507, when verification result instruction live information it is effective when, second terminal to first terminal send confirmation access refers to It enables.

When verification result instruction live information is effective, show that first terminal and second terminal can be based on the live information It completes remote assistant and controls establishment of connection, second terminal can send confirmation access instruction to first terminal at this time, which visits Ask that instruction is used to indicate second terminal and determines access direct broadcasting room.First terminal, can be true after receiving the confirmation access instruction Determine second terminal confirmation and access the direct broadcasting room, that is to say, can be confirmed and remote assistant control establishment of connection process is completed.

In a kind of achievable mode, the implementation of the step 506 and step 507 may include：Second server is tested Whether effective demonstrate,prove the live information, when second server confirmation live information is invalid, second server is sent to second terminal The invalid verification result of live information, and confirm that failure is established in remote assistant control connection；When second server confirms live streaming letter When ceasing effective, second server sends live information effectively to first server and second terminal confirmation accesses the anti-of direct broadcasting room Feedforward information, first server establish the connection relationship of the second terminal and direct broadcasting room after receiving the feedback information, to complete Remote assistant between first terminal and second terminal controls establishment of connection.Also, the remote secondary is completed in first server After helping control establishment of connection, first server sends the instruction information established and completed to second terminal, and second terminal is receiving After the instruction information completed to the foundation, confirmation access instruction is sent to first terminal, it is remote to prompt first terminal that this is completed Journey auxiliary control establishment of connection process.

In conclusion remote assistant control method provided in an embodiment of the present invention, shows second terminal by first terminal Operation interface, realize the operation interface of the synchronous second terminal of first terminal, and get in first terminal and be used to indicate operation In interface after the location information of target position, it is presented what prompt operated target position in the operation interface of second terminal Information effectively improves the efficiency and accuracy of remote assistant control so that accurately prompt needs the target position operated.

Also, the realization of the remote assistant control method is not limited by operating system, expands remote assistant control The scope of application of method.

In addition, in remote assistant control method provided in an embodiment of the present invention, without whole to second by first terminal End is controlled, and can guarantee the safety and autonomous operation of second terminal.

Figure 13 is the flow chart of another remote assistant control method provided in an embodiment of the present invention, and this method is applied to the One terminal, as shown in figure 13, this method may include：

The video flowing of the image of the operation interface of step 601, acquisition comprising second terminal.

Wherein, second terminal is that the terminal of remote assistant control connection is established with first terminal.

Step 602 plays video flowing, with the image of operation display interface.

Step 603, after detecting the trigger action for the image of operation interface, obtain and acquired based on trigger action The location information arrived.

Wherein, location information is used to indicate the target position in operation interface.

Step 604 sends location information to second terminal, is in the operation interface so that second terminal is based on location information Existing prompt information, the prompt information execute operation to target position for prompting.

For above-mentioned steps 601 into step 604, the specific implementation process of each step can be with reference in embodiment illustrated in fig. 4 Correspondence step, the embodiment of the present invention repeats no more this.

In conclusion remote assistant control method provided in an embodiment of the present invention, by first terminal play video flowing come It shows the image of second terminal operation interface, realizes the operation interface of the synchronous second terminal of first terminal, and obtained in first terminal After the location information for getting the target position being used to indicate in operation interface, prompt pair is presented in the operation interface of second terminal The information that target position is operated effectively improves remote assistant so that accurately prompt needs the target position operated The efficiency and accuracy of control.

Figure 14 is the flow chart of another remote assistant control method provided in an embodiment of the present invention, and this method is applied to the Two terminals, as shown in figure 14, this method may include：

The video flowing of the image of the operation interface of step 701, acquisition comprising second terminal.

Step 702, by video stream to first terminal, so that first terminal is by playing video flowing operation display interface Image.

Step 703 receives the location information that first terminal is sent.

Wherein, location information is acquired by first terminal based on the trigger action of the image for operation interface, the position Confidence ceases the target position being used to indicate in operation interface.

Step 704 is based on location information, and prompt information is presented in the operation interface, executes behaviour to target position with prompt Make.

For above-mentioned steps 701 into step 704, the specific implementation process of each step can be with reference in embodiment illustrated in fig. 4 Correspondence step, the embodiment of the present invention repeats no more this.

In conclusion remote assistant control method provided in an embodiment of the present invention, by acquiring the behaviour comprising second terminal Make the video flowing of the image at interface, and by the video stream to first terminal, for the figure of first terminal operation display interface Picture, realizes the operation interface of the synchronous second terminal of first terminal, and gets and be used to indicate in operation interface in second terminal After the location information of target position, the information that prompt operates target position is presented by the location information, so as to standard The target position for needing to operate really is prompted, the efficiency and accuracy of remote assistant control are effectively improved.

Figure 15 is a kind of structural schematic diagram of remote operation control device provided in an embodiment of the present invention, the remote operation control Device processed is configured in first terminal, and as shown in figure 15, which may include：

First obtains module 801, and for obtaining the screen data of second terminal, second terminal is to establish far with first terminal The terminal of journey auxiliary control connection.

Display module 802 shows the operation interface of second terminal for being based on screen data.

Second obtains module 803, for obtaining and being based on trigger action after detecting the trigger action for operation interface The collected location information of institute, location information are used to indicate the target position in operation interface.

Sending module 804 is being operated for sending location information to second terminal so that second terminal is based on location information Prompt information is presented in interface, prompt information executes operation to target position for prompting.

Optionally, Figure 16 is please referred to, which can also include：

Creation module 805, for creating direct broadcasting room.

Module 806 is established, for establishing remote assistant control connection relationship based on direct broadcasting room and second terminal.

Optionally, creation module 805 can be used for：

Direct broadcasting room creation instruction is sent to first server, direct broadcasting room creation instruction is for requesting creation direct broadcasting room.

It receives the direct broadcasting room that first server is sent and creates response, the direct broadcasting room of creation is carried in direct broadcasting room creation response Live information.

Optionally, establishing module 806 may include：

The live information of direct broadcasting room is sent to second terminal.

The confirmation access instruction that second terminal is sent is received, confirmation access instruction is used to indicate second terminal and determines that access is straight Between broadcasting.

Optionally, the process that the live information of direct broadcasting room is sent to second terminal by module 806 is established, may include：

Uniform resource position mark URL is generated according to live information.

URL is sent to second terminal.

Optionally, the process that URL is sent to second terminal by module 806 is established, may include：

By logging in the first account of first terminal and logging in the second account of second terminal, URL is sent out by first terminal It send to second terminal；Wherein, the first account and the second account are the account there are incidence relation.

Optionally, first module 801 is obtained, be used for：

The video flowing that second terminal is sent is obtained, video flowing may include the figure of at least operation interface of a frame second terminal Picture.

Display module 802, is used for：

Video flowing is played, in first terminal with the operation display interface in the video of broadcasting.

Optionally, trigger action is the touch control operation for operation interface, and location information may include the work of touch control operation With the coordinate information of point.

And/or trigger action is voice collecting operation, location information may include operating collected language in voice collecting In message breath.

In conclusion remote operation control device provided in an embodiment of the present invention, shows second terminal by display module Operation interface, realize the operation interface of the synchronous second terminal of first terminal, got in the second acquisition module and be used to indicate behaviour Make in interface after the location information of target position, prompt is presented in the operation interface of second terminal, target position is operated Information effectively improve the efficiency of remote assistant control and accurate so that accurately prompt needs the target position that operates Property.

Figure 17 is the structural schematic diagram of another remote operation control device provided in an embodiment of the present invention, the remote operation Control device is configured in second terminal, and as shown in figure 17, which may include：

Acquisition module 901, for acquiring the screen data of second terminal, second terminal is to establish remote secondary with first terminal The terminal for helping control to connect.

First sending module 902, for screen data to be sent to first terminal, so that first terminal shows second terminal Operation interface.

First receiving module 903, for receiving the location information of first terminal transmission, location information is based on by first terminal It is acquired for the trigger action of operation interface, location information is used to indicate the target position in operation interface.

For being based on location information prompt information is presented, in the operation interface to prompt to target position in processing module 904 It sets and executes operation.

Optionally, Figure 18 is please referred to, which can also include：

Second receiving module 905 receives the live information for the direct broadcasting room that first terminal is sent.

Second sending module 906, for after getting the confirmation access instruction triggered based on live information, to first Terminal sends confirmation access instruction, and confirmation access instruction is used to indicate second terminal and determines access direct broadcasting room.

Optionally, the second sending module 906, is specifically used for：

Verifying instruction is sent to second server based on live information, verifying instruction is straight for requesting second server verifying Whether effective broadcast information.

Receive the verification result that second server is sent.

When verification result instruction live information is effective, confirmation access instruction is sent to first terminal.

Optionally, processing module 904 are specifically used for：

The resolution ratio of first terminal and second terminal is obtained respectively.

Based on first terminal, the resolution ratio of second terminal and location information, determine that location information is signified in the operation interface The target position shown.

Target location display reminding information in the operation interface.

Optionally, the process of the target location display reminding information of processing module 904 in the operation interface, can wrap It includes：

Target location in the operation interface shows that suspension pattern or text information, suspension pattern or text information are used for Indicate prompt information.

In conclusion remote operation control device provided in an embodiment of the present invention, acquires second terminal by acquisition module Screen data, which is sent to first terminal by the first sending module, so that first terminal shows second terminal Operation interface, realizes the operation interface of the synchronous second terminal of first terminal, and gets in the first receiving module and be used to indicate behaviour After the location information for making the target position in interface, processing module is presented prompt by the location information and grasps to target position The information of work, so as to accurately prompt to need the target position that operates, effectively improve remote assistant control efficiency and Accuracy.

Figure 19 is the structural schematic diagram of another remote operation control device provided in an embodiment of the present invention, the remote operation Control device is configured in first terminal, and as shown in figure 19, which may include：

First obtains module 1101, the video flowing of the image for obtaining the operation interface comprising second terminal.

Display module 1102, for playing video flowing, with the image of operation display interface.

Second obtains module 1103, for after detecting the trigger action for the image of operation interface, acquisition to be based on The collected location information of trigger action institute.

Sending module 1104 is being grasped for sending location information to second terminal so that second terminal is based on location information Make that prompt information is presented in interface, which executes operation to target position for prompting.

In conclusion remote operation control device provided in an embodiment of the present invention, display module by play video flowing come It shows the image of second terminal operation interface, realizes the operation interface of the synchronous second terminal of first terminal, and obtain mould second After block gets the location information for the target position being used to indicate in operation interface, presents and mention in the operation interface of second terminal Show the information operated to target position, so that accurately prompt needs the target position operated, effectively improves long-range Assist the efficiency and accuracy of control.

Figure 20 is the structural schematic diagram of another remote operation control device provided in an embodiment of the present invention, which can match It is placed in second terminal, as shown in figure 20, which may include：

Acquisition module 1201, the video flowing of the image for acquiring the operation interface comprising second terminal.

Sending module 1202, for being shown so that first terminal passes through broadcasting video flowing by video stream to first terminal Show the image of operation interface.

Receiving module 1203, for receiving the location information of first terminal transmission.

For being based on location information prompt information is presented, in the operation interface to prompt to target position in processing module 1204 It sets and executes operation.

In conclusion remote operation control device provided in an embodiment of the present invention, includes second by acquisition module acquisition The video flowing of the image of the operation interface of terminal, sending module is by the video stream to first terminal, so that first terminal is aobvious Show the image of operation interface, realize the operation interface of the synchronous second terminal of first terminal, and gets in receiving module for referring to After the location information for showing the target position in operation interface, processing module by the location information present prompt to target position into The information of row operation effectively improves the effect of remote assistant control so as to accurately prompt the target position for needing to operate Rate and accuracy.

About the device in above-described embodiment, wherein modules execute the concrete mode of operation in related this method Embodiment in be described in detail, no detailed explanation will be given here.

Figure 21 shows the structural schematic diagram of the terminal 1300 of an illustrative embodiment of the invention offer.The terminal 1300 It can be portable mobile termianl, such as：Smart phone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III, dynamic image expert's compression standard audio level 3), MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image expert's compression standard audio level 4) player, laptop Or desktop computer.Terminal 1300 be also possible to referred to as user equipment, portable terminal, laptop terminal, terminal console etc. other Title.

In general, terminal 1300 includes：Processor 1301 and memory 1302.

Processor 1301 may include one or more processing cores, such as 4 core processors, 8 core processors etc..Place Reason device 1301 can use DSP (Digital Signal Processing, Digital Signal Processing), FPGA (Field- Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, may be programmed Logic array) at least one of example, in hardware realize.Processor 1301 also may include primary processor and coprocessor, master Processor is the processor for being handled data in the awake state, also referred to as CPU (Central Processing Unit, central processing unit)；Coprocessor is the low power processor for being handled data in the standby state.? In some embodiments, processor 1301 can be integrated with GPU (Graphics Processing Unit, image processor), GPU is used to be responsible for the rendering and drafting of content to be shown needed for display screen.In some embodiments, processor 1301 can also be wrapped AI (Artificial Intelligence, artificial intelligence) processor is included, the AI processor is for handling related machine learning Calculating operation.

Memory 1302 may include one or more computer readable storage mediums, which can To be non-transient.Memory 1302 may also include high-speed random access memory and nonvolatile memory, such as one Or multiple disk storage equipments, flash memory device.In some embodiments, the non-transient computer in memory 1302 can Storage medium is read for storing at least one instruction, at least one instruction performed by processor 1301 for realizing this Shen Please in embodiment of the method provide remote assistant control method.

In some embodiments, terminal 1300 is also optional includes：Peripheral device interface 1303 and at least one periphery are set It is standby.It can be connected by bus or signal wire between processor 1301, memory 1302 and peripheral device interface 1303.It is each outer Peripheral equipment can be connected by bus, signal wire or circuit board with peripheral device interface 1303.Specifically, peripheral equipment includes： In radio circuit 1304, display screen 1305, CCD camera assembly 1306, voicefrequency circuit 1307, positioning component 1308 and power supply 1309 At least one.

Peripheral device interface 1303 can be used for I/O (Input/Output, input/output) is relevant outside at least one Peripheral equipment is connected to processor 1301 and memory 1302.In some embodiments, processor 1301, memory 1302 and periphery Equipment interface 1303 is integrated on same chip or circuit board；In some other embodiments, processor 1301, memory 1302 and peripheral device interface 1303 in any one or two can be realized on individual chip or circuit board, this implementation Example is not limited this.

Radio circuit 1304 is for receiving and emitting RF (Radio Frequency, radio frequency) signal, also referred to as electromagnetic signal. Radio circuit 1304 is communicated by electromagnetic signal with communication network and other communication equipments.Radio circuit 1304 is by telecommunications Number being converted to electromagnetic signal is sent, alternatively, the electromagnetic signal received is converted to electric signal.Optionally, radio circuit 1304 include：Antenna system, one or more amplifiers, tuner, oscillator, digital signal processor, compiles solution at RF transceiver Code chipset, user identity module card etc..Radio circuit 1304 can by least one wireless communication protocol come with it is other Terminal is communicated.The wireless communication protocol includes but is not limited to：WWW, Metropolitan Area Network (MAN), Intranet, each third generation mobile communication network (2G, 3G, 4G and 5G), WLAN and/or WiFi (Wireless Fidelity, Wireless Fidelity) network.In some implementations In example, radio circuit 1304 can also include that NFC (Near Field Communication, wireless near field communication) is related Circuit, the application are not limited this.

Display screen 1305 is for showing UI (User Interface, user interface).The UI may include figure, text, Icon, video and its their any combination.When display screen 1305 is touch display screen, display screen 1305 also there is acquisition to exist The ability of the touch signal on the surface or surface of display screen 1305.The touch signal can be used as control signal and be input to place Reason device 1301 is handled.At this point, display screen 1305 can be also used for providing virtual push button and/or dummy keyboard, it is also referred to as soft to press Button and/or soft keyboard.In some embodiments, display screen 1305 can be one, and the front panel of terminal 1300 is arranged；Another In a little embodiments, display screen 1305 can be at least two, be separately positioned on the different surfaces of terminal 1300 or in foldover design； In still other embodiments, display screen 1305 can be flexible display screen, is arranged on the curved surface of terminal 1300 or folds On face.Even, display screen 1305 can also be arranged to non-rectangle irregular figure, namely abnormity screen.Display screen 1305 can be with Using LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) etc. materials preparation.

CCD camera assembly 1306 is for acquiring image or video.Optionally, CCD camera assembly 1306 includes front camera And rear camera.In general, the front panel of terminal is arranged in front camera, the back side of terminal is arranged in rear camera.? In some embodiments, rear camera at least two is that main camera, depth of field camera, wide-angle camera, focal length are taken the photograph respectively As any one in head, to realize that main camera and the fusion of depth of field camera realize background blurring function, main camera and wide Pan-shot and VR (Virtual Reality, virtual reality) shooting function or other fusions are realized in camera fusion in angle Shooting function.In some embodiments, CCD camera assembly 1306 can also include flash lamp.Flash lamp can be monochromatic temperature flash of light Lamp is also possible to double-colored temperature flash lamp.Double-colored temperature flash lamp refers to the combination of warm light flash lamp and cold light flash lamp, can be used for Light compensation under different-colour.

Voicefrequency circuit 1307 may include microphone and loudspeaker.Microphone is used to acquire the sound wave of user and environment, and It converts sound waves into electric signal and is input to processor 1301 and handled, or be input to radio circuit 1304 to realize that voice is logical Letter.For stereo acquisition or the purpose of noise reduction, microphone can be separately positioned on the different parts of terminal 1300 to be multiple. Microphone can also be array microphone or omnidirectional's acquisition type microphone.Loudspeaker is then used to that processor 1301 or radio frequency will to be come from The electric signal of circuit 1304 is converted to sound wave.Loudspeaker can be traditional wafer speaker, be also possible to piezoelectric ceramics loudspeaking Device.When loudspeaker is piezoelectric ceramic loudspeaker, the audible sound wave of the mankind can be not only converted electrical signals to, can also be incited somebody to action Electric signal is converted to the sound wave that the mankind do not hear to carry out the purposes such as ranging.In some embodiments, voicefrequency circuit 1307 may be used also To include earphone jack.

Positioning component 1308 is used for the current geographic position of positioning terminal 1300, to realize navigation or LBS (Location Based Service, location based service).Positioning component 1308 can be the GPS (Global based on the U.S. Positioning System, global positioning system), China dipper system or Russia Galileo system positioning group Part.

Power supply 1309 is used to be powered for the various components in terminal 1300.Power supply 1309 can be alternating current, direct current Electricity, disposable battery or rechargeable battery.When power supply 1309 includes rechargeable battery, which can be line charge Battery or wireless charging battery.Wired charging battery is the battery to be charged by Wireline, and wireless charging battery is to pass through The battery of wireless coil charging.The rechargeable battery can be also used for supporting fast charge technology.

In some embodiments, terminal 1300 further includes having one or more sensors 1310.One or more sensing Device 1310 includes but is not limited to：Acceleration transducer 1311, gyro sensor 1312, pressure sensor 1313, fingerprint sensing Device 1314, optical sensor 1315 and proximity sensor 1316.

Acceleration transducer 1311 can detecte the acceleration in three reference axis of the coordinate system established with terminal 1300 Size.For example, acceleration transducer 1311 can be used for detecting component of the acceleration of gravity in three reference axis.Processor The 1301 acceleration of gravity signals that can be acquired according to acceleration transducer 1311, control display screen 1305 with transverse views or indulge The display of direction view progress user interface.Acceleration transducer 1311 can be also used for adopting for game or the exercise data of user Collection.

Gyro sensor 1312 can detecte body direction and the rotational angle of terminal 1300, gyro sensor 1312 Acquisition user can be cooperateed with to act the 3D of terminal 1300 with acceleration transducer 1311.Processor 1301 is according to gyro sensors The data that device 1312 acquires, may be implemented following function：Action induction (for example changing UI according to the tilt operation of user) is clapped Image stabilization, game control and inertial navigation when taking the photograph.

The lower layer of side frame and/or display screen 1305 in terminal 1300 can be set in pressure sensor 1313.Work as pressure When the side frame of terminal 1300 is arranged in sensor 1313, user can detecte to the gripping signal of terminal 1300, by processor 1301 carry out right-hand man's identification or prompt operation according to the gripping signal that pressure sensor 1313 acquires.When pressure sensor 1313 When the lower layer of display screen 1305 is set, the pressure operation of display screen 1305 is realized to UI according to user by processor 1301 Operability control on interface is controlled.Operability control includes button control, scroll bar control, icon control, dish At least one of single control part.

Fingerprint sensor 1314 is used to acquire the fingerprint of user, is collected by processor 1301 according to fingerprint sensor 1314 Fingerprint recognition user identity, alternatively, by fingerprint sensor 1314 according to the identity of collected fingerprint recognition user.Knowing Not Chu the identity of user when being trusted identity, authorize the user to execute relevant sensitive operation by processor 1301, which grasps Make to include solving lock screen, checking encryption information, downloading software, payment and change setting etc..Fingerprint sensor 1314 can be set Set the front, the back side or side of terminal 1300.When being provided with physical button or manufacturer Logo in terminal 1300, fingerprint sensor 1314 can integrate with physical button or manufacturer Logo.

Optical sensor 1315 is for acquiring ambient light intensity.In one embodiment, processor 1301 can be according to light The ambient light intensity that sensor 1315 acquires is learned, the display brightness of display screen 1305 is controlled.Specifically, when ambient light intensity is higher When, the display brightness of display screen 1305 is turned up；When ambient light intensity is lower, the display brightness of display screen 1305 is turned down.Another In one embodiment, the ambient light intensity that processor 1301 can also be acquired according to optical sensor 1315, dynamic adjustment camera shooting The acquisition parameters of head assembly 1306.

Proximity sensor 1316, also referred to as range sensor are generally arranged at the front panel of terminal 1300.Proximity sensor 1316 for acquiring the distance between the front of user Yu terminal 1300.In one embodiment, when proximity sensor 1316 is examined When measuring the distance between the front of user and terminal 1300 and gradually becoming smaller, display screen 1305 is controlled from bright screen by processor 1301 State is switched to breath screen state；When proximity sensor 1316 detects that the distance between user and the front of terminal 1300 gradually become When big, display screen 1305 is controlled by processor 1301 and is switched to bright screen state from breath screen state.

It, can be with it will be understood by those skilled in the art that the restriction of the not structure paired terminal 1300 of structure shown in Figure 21 Including than illustrating more or fewer components, perhaps combining certain components or being arranged using different components.

The embodiment of the invention also provides a kind of computer readable storage medium, which is non-volatile memories Jie Matter is stored at least one instruction, at least one section of program, code set or instruction set in the storage medium, at least one instruction, At least one section of program, the code set or the instruction set is loaded by processor and is executed to realize that the above embodiments of the present application such as provide Remote assistant control method.

The embodiment of the invention also provides a kind of computer program product, it is stored with instruction in the computer program product, When run on a computer, it enables a computer to execute remote assistant control method provided in an embodiment of the present invention.

The embodiment of the invention also provides a kind of chip, which includes programmable logic circuit and/or program instruction, when The chip is able to carry out remote assistant control method provided in an embodiment of the present invention when running.

In embodiments of the present invention, relative determinative "and/or" indicates three kinds of logical relations, and A and/or B expression are individually deposited In A, individualism B and exist simultaneously tri- kinds of logical relations of A and B.

Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..

The foregoing is merely the preferred embodiments of the application, not to limit the application, it is all in spirit herein and Within principle, any modification, equivalent replacement, improvement and so on be should be included within the scope of protection of this application.

Claims

1. a kind of remote assistant control method, which is characterized in that it is applied to first terminal, the method includes：

The screen data of second terminal is obtained, the second terminal is that remote assistant control connection is established with the first terminal Terminal；

After detecting the trigger action for the operation interface, obtain based on the collected position letter of trigger action institute Breath, the location information are used to indicate the target position in the operation interface；

The location information is sent to the second terminal, so that the second terminal is based on the location information in the operation Prompt information is presented in interface, the prompt information executes operation to the target position for prompting.

2. the method according to claim 1, wherein it is described obtain second terminal screen data before, it is described Method further includes：

Create direct broadcasting room；

Remote assistant control connection relationship is established based on the direct broadcasting room and the second terminal.

3. according to the method described in claim 2, it is characterized in that, the creation direct broadcasting room, including：

Direct broadcasting room creation instruction is sent to first server, the direct broadcasting room creation instruction is for requesting creation direct broadcasting room；

The direct broadcasting room creation response that the first server is sent is received, the live streaming of creation is carried in the direct broadcasting room creation response Between live information.

4. according to the method described in claim 2, it is characterized in that, described established based on the direct broadcasting room and the second terminal Remote assistant controls connection relationship, including：

The live information of the direct broadcasting room is sent to the second terminal；

The confirmation access instruction that the second terminal is sent is received, it is true that the confirmation access instruction is used to indicate the second terminal Surely the direct broadcasting room is accessed.

5. according to the method described in claim 4, it is characterized in that, the live information by the direct broadcasting room be sent to it is described Second terminal, including：

Uniform resource position mark URL is generated according to the live information；

The URL is sent to the second terminal.

6. according to the method described in claim 5, it is characterized in that, described be sent to the second terminal for the URL, packet It includes：

By logging in the first account of the first terminal and logging in the second account of the second terminal, by the URL by institute It states first terminal and is sent to the second terminal；Wherein, first account and second account are that there are incidence relations Account.

7. method according to any one of claims 1 to 6, which is characterized in that the screen data for obtaining second terminal, packet It includes：

The video flowing that the second terminal is sent is obtained, the video flowing includes the operation interface of second terminal described in an at least frame Image；

It is described to be based on the screen data, show the operation interface of the second terminal, including：

The video flowing is played, in the first terminal to show the operation interface in the video of broadcasting.

8. method according to any one of claims 1 to 6, which is characterized in that

The trigger action is the touch control operation for the operation interface, and the location information includes the work of the touch control operation With the coordinate information of point；

And/or the trigger action is voice collecting operation, the location information is included in voice collecting and operates collected language In message breath.

9. a kind of remote assistant control method, which is characterized in that it is applied to second terminal, the method includes：

The screen data of the second terminal is acquired, the second terminal is that remote assistant control connection is established with first terminal Terminal；

The screen data is sent to the first terminal, so that the first terminal shows operation circle of the second terminal Face；

The location information that the first terminal is sent is received, the location information is based on being directed to the operation by the first terminal The trigger action at interface acquires, and the location information is used to indicate the target position in the operation interface；

Based on the location information, prompt information is presented in the operation interface, behaviour is executed to the target position with prompt Make.

10. according to the method described in claim 9, it is characterized in that, the acquisition second terminal screen data it Before, the method also includes：

Receive the live information for the direct broadcasting room that the first terminal is sent；

After getting the confirmation access instruction triggered based on the live information, the confirmation is sent to the first terminal Access instruction, the confirmation access instruction are used to indicate the second terminal and determine the access direct broadcasting room.

11. according to the method described in claim 10, it is characterized in that, described send the confirmation access to the first terminal Instruction, including：

Verifying instruction is sent to second server based on the live information, the verifying instruction is for requesting the second service Whether device verifies the live information effective；

Receive the verification result that the second server is sent；

When the verification result indicates that the live information is effective, the confirmation access instruction is sent to the first terminal.

12. according to any method of claim 9 to 11, which is characterized in that it is described to be based on the location information, described Prompt information is presented in operation interface, including：

The resolution ratio of the first terminal and the second terminal is obtained respectively；

Based on the first terminal, the resolution ratio of the second terminal and the location information, determine the location information in institute State target position indicated in operation interface；

Target location in the operation interface shows the prompt information.

13. according to any method of claim 9 to 11, which is characterized in that described present in the operation interface mentions Show information, including：

Target location in the operation interface shows suspension pattern or text information, the suspension pattern or text information It is used to indicate prompt information.

14. a kind of remote assistant control method, which is characterized in that it is applied to first terminal, the method includes：

The video flowing of the image of the operation interface comprising second terminal is obtained, the second terminal is to establish with the first terminal The terminal of remote assistant control connection；

The video flowing is played, to show the image of the operation interface；

After detecting the trigger action for the image of the operation interface, obtain collected based on the trigger action institute Location information, the location information are used to indicate the target position in the operation interface；

15. a kind of remote assistant control method, which is characterized in that it is applied to second terminal, the method includes：

The video flowing of the image of operation interface of the acquisition comprising the second terminal, the second terminal are to establish with first terminal The terminal of remote assistant control connection；

By the video stream to the first terminal, so that the first terminal is by playing described in the video flowing shows The image of operation interface；

The location information that the first terminal is sent is received, the location information is based on being directed to the operation by the first terminal The trigger action of the image at interface acquires, and the location information is used to indicate the target position in the operation interface；

16. a kind of remote operation control device, which is characterized in that described device includes：

First obtains module, and for obtaining the screen data of second terminal, the second terminal is to establish with the first terminal The terminal of remote assistant control connection；

Second obtains module, for obtaining and being grasped based on the triggering after detecting the trigger action for the operation interface Make the collected location information of institute, the location information is used to indicate the target position in the operation interface；

Sending module, for sending the location information to the second terminal, so that the second terminal is based on the position Prompt information is presented in information in the operation interface, and the prompt information executes operation to the target position for prompting.

17. a kind of remote operation control device, which is characterized in that described device includes：

Acquisition module, for acquiring the screen data of the second terminal, the second terminal is to establish remotely with first terminal The terminal of auxiliary control connection；

First sending module, for the screen data to be sent to the first terminal, so that the first terminal shows institute State the operation interface of second terminal；

First receiving module, the location information sent for receiving the first terminal, the location information are whole by described first End group is acquired in the trigger action for the operation interface, and the location information is used to indicate in the operation interface Target position；

For being based on the location information prompt information is presented in the operation interface, to prompt to the mesh in processing module Cursor position executes operation.

18. a kind of terminal, which is characterized in that the terminal includes processor and memory, is stored at least in the memory One instruction, at least one section of program, code set or instruction set, at least one instruction, at least one section of program, the generation Code collection or instruction set are loaded by the processor and are executed to realize remote assistant control as described in any of the claims 1 to 8 Method, the remote assistant control method as described in claim 9 to 13 is any, remote assistant control as claimed in claim 14 Method, alternatively, remote assistant control method as claimed in claim 15.

19. a kind of computer readable storage medium, which is characterized in that be stored at least one instruction, extremely in the storage medium Few one section of program, code set or instruction set, at least one instruction, at least one section of program, the code set or the instruction Collection is loaded by processor and is executed to realize remote assistant control method as described in any of the claims 1 to 8, such as claim 9 to 13 any remote assistant control methods, remote assistant control method as claimed in claim 14, alternatively, as weighed Benefit require 15 described in remote assistant control method.