CN108462729A

CN108462729A - Realize method and apparatus, terminal device and the server of terminal device interaction

Info

Publication number: CN108462729A
Application number: CN201710087563.2A
Authority: CN
Inventors: 刘聪; 陈首名; 罗恒亮; 杜小毅; 廖凡; 徐永士
Original assignee: Beijing Samsung Telecommunications Technology Research Co Ltd; Samsung Electronics Co Ltd
Current assignee: Beijing Samsung Telecommunications Technology Research Co Ltd; Samsung Electronics Co Ltd
Priority date: 2017-02-17
Filing date: 2017-02-17
Publication date: 2018-08-28
Anticipated expiration: 2037-02-17
Also published as: CN108462729B

Abstract

A kind of method and apparatus, terminal device and server for realizing terminal device interaction is provided.The method includes：(A) the shared content to be shared to second terminal equipment is determined in the content that first terminal equipment currently provides to the user；(B) the shared content determined second terminal equipment is sent to share.According to the method, the transmission quantity of shared data can be effectively reduced.

Description

Realize method and apparatus, terminal device and the server of terminal device interaction

Technical field

All things considered of the present invention is related to terminal device interaction technique field, more particularly, is related to a kind of realization terminal and sets Method and apparatus, terminal device and the server of standby interaction.

Background technology

In the prior art, can the content that terminal device is currently shown other-end connected to it be shared in real time to set It is shown on standby, so that the user of other-end equipment can also watch the content that the terminal device is shown.But it usually needs Will the terminal device and other-end equipment by wired connection or in the same local area network, ensure that network environment is good It is good and controllable, it could realize and a large amount of content is shared into other-end equipment in real time.And in some cases, for example, eventually When end equipment needs to carry out teleengineering support with the other-end equipment of distal end and carry out remote content transmission, it is difficult to realize real-time A large amount of image data is transmitted, can not ensure real-time, interactive.

Invention content

Exemplary embodiment of the present invention is to provide a kind of method and apparatus that realizing terminal device interaction, terminal device And server, the transmission quantity of shared data can be effectively reduced.

Exemplary embodiment according to the present invention provides a kind of method for realizing terminal device interaction, including：(A) The shared content to be shared to second terminal equipment is determined in the content that one terminal device currently provides to the user；(B) it will determine The shared content gone out is sent to second terminal equipment and is shared.

Optionally, the first terminal equipment and/or second terminal equipment are virtual reality device.

Optionally, according in following at least one of determine shared content to be shared to second terminal equipment：First eventually The corresponding user's object of interest of end equipment, the corresponding content of shared region, the corresponding content of specified event, second terminal equipment Corresponding user's object of interest, the changing content comprising effective content, the user of second terminal equipment are shared to what is received The operation of content.

Optionally, determine that the corresponding user of first terminal equipment is interested right according at least one among following item As：Incidence relation in the corresponding user behavior of first terminal equipment, the content currently provided to the user between each object, Scene, the corresponding user property of first terminal equipment corresponding to the content currently provided to the user；And/or according to Among lower item at least one of determine the corresponding user's object of interest of second terminal equipment：The corresponding use of second terminal equipment Family behavior, the corresponding user property of second terminal equipment；And/or the shared region include among following region at least one ：For the shared region, the shared region for the setting of second terminal equipment, first terminal equipment of the setting of first terminal equipment The region where the corresponding user's object of interest in region, second terminal equipment where corresponding user's object of interest；With/ Or, the specified event includes at least one in system dependent event, content dependent event；And/or the changing content is The changed partial content of shared content that the content currently provided to the user is sent relative to the last time, wherein following Among condition at least one of when being satisfied, determine in the changing content to include effective content：The changing content accounts for currently The ratio of the content provided to the user is not less than the first predetermined threshold；The changing content includes the corresponding content of shared region； The changing content includes the corresponding content of specified event；The changing content includes first terminal equipment and/or second terminal The corresponding user's object of interest of equipment；The changing content includes operable object.

Optionally, when meeting at least one of following, step (A) is executed：The movement velocity of first terminal equipment is not more than Second predetermined threshold；In the content currently provided to the user comprising the corresponding content of shared region, the specified corresponding content of event, The corresponding user's object of interest of first terminal equipment, the corresponding user's object of interest of second terminal equipment, operable object, At least one of including in the changing content of effective content.

Optionally, step (B) includes：The shared content is reconstructed according to predetermined manner, and will be in after reconstruct Appearance is sent to second terminal equipment and is shared.

Optionally, the predetermined manner includes at least one among following item：Acquisition include the shared content most Content in zonule；The shared content is adjusted according to the device attribute of second terminal equipment；According to redundant area to described Shared content is reconstructed；The shared content is adjusted according to current Network status；Based on the corresponding use of first terminal equipment Family attribute and/or the corresponding user property of second terminal equipment are corrected the shared content；Based on filter condition to institute Shared content is stated to be filtered；The operation of shared content is directed to according to the user of first terminal equipment and/or second terminal equipment Shared content is optimized.

Optionally, the method further includes：It is received from second terminal equipment：User selects from the shared content received Target object location information, and/or from the currently viewing visual angle of first terminal equipment to target object it is corresponding viewing regard The motion path at angle；According to the location information and/or the motion path received, the user of first terminal equipment is instructed Mobile viewing visual angle and/or the viewing visual angle for the user for automatically switching first terminal equipment.

Optionally, the method further includes：User, which is received, from second terminal equipment is directed to the shared content progress received The operation information of operation；To the content currently provided to the user, function corresponding with the operation information received is executed.

Optionally, the method further includes：Operation in response to user to the external operation equipment of first terminal equipment, is obtained Take the operation focus position of external operation equipment described in the content currently provided to the user；It is described outer when detecting When connecing operation equipment and occurring invalid mobile, the operation focus position before current operation focus is adjusted to mobile.

Optionally, the method further includes：Before step (A), obtain what first terminal equipment currently provided to the user Content.

Optionally, the content that first terminal equipment currently provides to the user is that first terminal equipment is shown when preceding to user Content, wherein obtain first terminal equipment currently provide to the user content the step of include：It is current to obtain first terminal equipment Panoramic view；Receive the corresponding currently viewing Viewing-angle information of first terminal equipment；According to the currently viewing Viewing-angle information and Current panoramic view determines the first terminal equipment when the preceding content that shown to user.

Optionally, the method further includes：It is currently user to first terminal equipment to receive user from first terminal equipment The operation information that the content of offer is operated；Function corresponding with the operation information received is executed, to obtain first terminal The content that equipment currently provides to the user.

In accordance with an alternative illustrative embodiment of the present invention, a kind of device for realizing terminal device interaction is provided, including：It is shared Content determining unit determines being total to second terminal equipment to be shared in the content that first terminal equipment currently provides to the user Enjoy content；The shared content determined is sent to second terminal equipment and shared by shared cell.

Optionally, share content determining unit according in following at least one of determine it is to be shared to second terminal equipment Shared content：In the corresponding user's object of interest of first terminal equipment, the corresponding content of shared region, specified event are corresponding Hold, the user of the corresponding user's object of interest of second terminal equipment, the changing content comprising effective content, second terminal equipment Operation to the shared content received.

Optionally, content determining unit is shared according at least one among following item to determine that first terminal equipment corresponds to User's object of interest：Each object in the corresponding user behavior of first terminal equipment, the content currently provided to the user Between incidence relation, the corresponding user of the scene corresponding to the content currently provided to the user, first terminal equipment belongs to Property；And/or shared content determining unit determines the corresponding user of second terminal equipment according at least one among following item Object of interest：The corresponding user behavior of second terminal equipment, the corresponding user property of second terminal equipment；And/or it is described total It includes at least one among following region to enjoy region：For the shared region of first terminal equipment setting, for second terminal The shared region of equipment setting, the region where the corresponding user's object of interest of first terminal equipment, second terminal equipment pair Region where the user's object of interest answered；And/or the specified event includes system dependent event, content dependent event At least one of in；And/or the changing content be the content that currently provides to the user relative to the last time send it is shared in Hold changed partial content, wherein shared content determining unit is when at least one among the following conditions is satisfied, really Include effective content in the fixed changing content：The changing content accounts for the ratio of the content currently provided to the user not less than the One predetermined threshold；The changing content includes the corresponding content of shared region；The changing content includes that specified event is corresponding Content；The changing content includes first terminal equipment and/or the corresponding user's object of interest of second terminal equipment；The change It includes operable object to change content.

Optionally, content determining unit is shared when determination meets at least one of following, is currently in first terminal equipment The shared content to be shared to second terminal equipment is determined in the content that user provides：The movement velocity of first terminal equipment is little In the second predetermined threshold；It is corresponding interior comprising the corresponding content of shared region, specified event in the content currently provided to the user It is appearance, the corresponding user's object of interest of first terminal equipment, the corresponding user's object of interest of second terminal equipment, operable right As in, the changing content comprising effective content at least one of.

Optionally, shared cell is reconstructed the shared content according to predetermined manner, and the content after reconstruct is sent out Second terminal equipment is sent to be shared.

Optionally, described device further includes：Receiving unit is received from second terminal equipment：User is shared from what is received The location information of the target object selected in content, and/or from the currently viewing visual angle of first terminal equipment to target object pair The motion path for the viewing visual angle answered；Visual angle effect unit, according to the location information and/or the movement road received Diameter instructs the viewing that the user of first terminal equipment moves the user of viewing visual angle and/or automatic switchover first terminal equipment to regard Angle.

Optionally, described device further includes：Operation information receiving unit receives user for reception from second terminal equipment To the operation information that is operated of shared content；Execution unit is executed and is received to the content currently provided to the user The corresponding function of operation information of arriving.

Optionally, described device further includes：Focus acquiring unit, the external operation in response to user to first terminal equipment The operation of equipment obtains the operation focus position of external operation equipment described in the content currently provided to the user； Current operation focus is adjusted to move by focus adjustment unit when detecting that the external operation equipment occurs invalid mobile Operation focus position before dynamic.

Optionally, described device further includes：Acquiring unit is currently in first terminal equipment in shared content determining unit Before determining the shared content to be shared to second terminal equipment in the content that user provides, obtaining first terminal equipment is currently The content that user provides.

Optionally, the content that first terminal equipment currently provides to the user is that first terminal equipment is shown when preceding to user Content, wherein acquiring unit includes：Panoramic view acquiring unit obtains the current panoramic view of first terminal equipment；Believe at visual angle Receiving unit is ceased, the corresponding currently viewing Viewing-angle information of first terminal equipment is received；Determination unit currently viewing is regarded according to described Angle information and current panoramic view determine the first terminal equipment when the preceding content that shown to user.

Optionally, described device further includes：Operation information receiving unit receives user couple first eventually from first terminal equipment The operation information that the content that end equipment currently provides to the user is operated；Execution unit, the operation information for executing and receiving Corresponding function, to obtain the content that first terminal equipment currently provides to the user.

In accordance with an alternative illustrative embodiment of the present invention, a kind of terminal device is provided, including：Shared content determining unit, The shared content to be shared to another terminal device is determined in the content that the terminal device currently provides to the user；It is shared single The shared content determined is sent to another terminal device and shared by member.

Optionally, the terminal device and/or another terminal device are virtual reality device.

Optionally, share content determining unit according in following at least one of determine and to be shared set to another terminal Standby shared content：The corresponding user's object of interest of the terminal device, the corresponding content of shared region, specified event correspond to Content, the corresponding user's object of interest of another terminal device, the changing content comprising effective content, another end Operation of the user of end equipment to the shared content received.

Optionally, it shares content determining unit and determines that the terminal device is corresponded to according at least one among following item User's object of interest：Each object in the corresponding user behavior of the terminal device, the content currently provided to the user Between incidence relation, the corresponding user of the scene corresponding to the content currently provided to the user, the terminal device belongs to Property；And/or shared content determining unit determines that another terminal device is corresponding according at least one among following item User's object of interest：The corresponding user behavior of another terminal device, the corresponding user property of another terminal device； And/or the shared region includes at least one among following region：For the terminal device setting shared region, For the area where the shared region of another terminal device setting, the corresponding user's object of interest of the terminal device Region where domain, the corresponding user's object of interest of another terminal device；And/or the specified event includes system At least one of in dependent event, content dependent event；And/or the changing content is the content phase currently provided to the user The changed partial content of shared content sent for the last time, wherein shared content determining unit the following conditions it In at least one of when being satisfied, determine in the changing content to include effective content：It is currently user that the changing content, which accounts for, The ratio of the content of offer is not less than the first predetermined threshold；The changing content includes the corresponding content of shared region；The change It includes the corresponding content of specified event to change content；The changing content includes that first terminal equipment and/or another terminal are set Standby corresponding user's object of interest；The changing content includes operable object.

Optionally, content determining unit is shared when determination meets at least one of following, is currently in the terminal device The shared content to be shared to another terminal device is determined in the content that user provides：The movement velocity of the terminal device No more than the second predetermined threshold；It is corresponded to comprising the corresponding content of shared region, specified event in the content currently provided to the user Content, the corresponding user's object of interest of the terminal device, the corresponding user's object of interest of another terminal device, At least one of in operable object, the changing content comprising effective content.

Optionally, shared cell is reconstructed the shared content according to predetermined manner, and the content after reconstruct is sent out Another terminal device is sent to be shared.

Optionally, the predetermined manner includes at least one among following item：Acquisition include the shared content most Content in zonule；The shared content is adjusted according to the device attribute of another terminal device；According to redundant area pair The shared content is reconstructed；The shared content is adjusted according to current Network status；It is corresponded to based on the terminal device User property and/or the corresponding user property of another terminal device the shared content is corrected；Based on filtering Condition is filtered the shared content；According to the user of the terminal device and/or another terminal device for altogether The operation for enjoying content optimizes shared content.

Optionally, the terminal device further includes：Receiving unit is received from another terminal device：User is from reception To shared content in the location information of target object that selects, and/or from the currently viewing visual angle of the terminal device to mesh Mark the motion path of the corresponding viewing visual angle of object；Visual angle effect unit, according to the location information that receives and/or described Motion path instructs the user of the terminal device to move viewing visual angle and/or automatically switches the user's of the terminal device Viewing visual angle.

Optionally, the terminal device further includes：Operation information receiving unit receives user from another terminal device The operation information operated for the shared content received；Execution unit holds the content currently provided to the user Row function corresponding with the operation information received.

Optionally, the terminal device further includes：Focus acquiring unit, in response to user to the external of the terminal device The operation of equipment is operated, the operation focus institute for obtaining external operation equipment described in the content currently provided to the user is in place It sets；Current operation focus is adjusted to by focus adjustment unit when detecting that the external operation equipment occurs invalid mobile Operation focus position before movement.

In accordance with an alternative illustrative embodiment of the present invention, a kind of terminal device is provided, including：Shared content receipt unit, Receive the shared content that another terminal device is sent, wherein it is currently use that the shared content, which is in another terminal device, It is determined in the content that family provides；Display unit shows the shared content received.

Optionally, the terminal device further includes：Transmission unit, for being sent to another terminal device：User from The location information of the target object selected in the shared content received, and/or from the currently viewing of another terminal device Motion path of the visual angle to the corresponding viewing visual angle of target object.

Optionally, the terminal device further includes：Receiving unit is operated, it is shared interior for what is received for receiving user Hold the operation information operated；Transmission unit, for the operation information to be sent to another terminal device.

In accordance with an alternative illustrative embodiment of the present invention, a kind of server is provided, including：Acquiring unit obtains first eventually The content that end equipment currently provides to the user；Shared content determining unit, in first terminal equipment currently provides to the user The shared content to be shared to second terminal equipment is determined in appearance；The shared content determined is sent to second by shared cell Terminal device is shared.

Optionally, the server further includes：Receiving unit is received from second terminal equipment：User is total to from what is received Enjoy the location information of the target object selected in content；Path determining unit determines according to the location information received And the motion path is sent out to the motion path of the corresponding viewing visual angle of target object at the currently viewing visual angle of one terminal device It is sent to first terminal equipment.

Optionally, the server further includes：Operation information receiving unit is directed to from second terminal equipment reception user and connects The operation information that the shared content received is operated；Execution unit is executed and is connect to the content currently provided to the user The corresponding function of operation information of receiving, and the operation information is sent to first terminal equipment.

Optionally, the server further includes：Operation information receiving unit receives user couple first from first terminal equipment The operation information that the content that terminal device currently provides to the user is operated；Execution unit, the operation letter for executing and receiving Corresponding function is ceased, to obtain the content that first terminal equipment currently provides to the user.

In method and apparatus, terminal device and the service of realization terminal device interaction according to an exemplary embodiment of the present invention In device, it will only need partial content to be sharing to be sent to other-end equipment among content that terminal device provides to the user and carry out It is shared, to reduce the transmission of redundant data, the volume of transmitted data of equipment room is reduced, transfer resource is saved, improves and sets The real-time linked up between standby.In addition, the operation between can also be achieved terminal device is shared.

It will illustrate the other aspect and/or advantage of present general inventive concept in part in following description, also one Divide and will be apparent by description, or can be learnt by the implementation of present general inventive concept.

Description of the drawings

By with reference to be exemplarily illustrated embodiment attached drawing carry out description, exemplary embodiment of the present it is upper It states and will become apparent with other purposes and feature, wherein：

Fig. 1 shows the flow chart of the method for realization terminal device interaction according to an exemplary embodiment of the present invention；

Fig. 2 shows the corresponding user's object of interest of determining first terminal equipment according to an exemplary embodiment of the present invention Example；

Fig. 3 shows the corresponding user's object of interest of determining first terminal equipment according to an exemplary embodiment of the present invention Another example；

Fig. 4 shows that according to an exemplary embodiment of the present invention determined according to the corresponding content of shared region shares showing for content Example；

Fig. 5 shows that changing content of the basis according to an exemplary embodiment of the present invention comprising effective content determines and shares content Example；

Fig. 6 shows the example according to an exemplary embodiment of the present invention that shared content is determined whether according to movement velocity；

Fig. 7 shows the example according to an exemplary embodiment of the present invention being reconstructed to sharing content；

Fig. 8 shows another example according to an exemplary embodiment of the present invention being reconstructed to sharing content；

Fig. 9 shows another example according to an exemplary embodiment of the present invention being reconstructed to sharing content；

Figure 10 shows another example according to an exemplary embodiment of the present invention being reconstructed to sharing content；

Figure 11 shows the example according to an exemplary embodiment of the present invention being reconstructed to sharing content；

Figure 12 shows the flow chart of the method for realizing terminal device interaction in accordance with an alternative illustrative embodiment of the present invention；

Figure 13-Figure 15 shows that the user's movement viewing according to an exemplary embodiment of the present invention for instructing first terminal equipment regards The example at angle；

Figure 16 shows the user's movement viewing for instructing first terminal equipment in accordance with an alternative illustrative embodiment of the present invention The example at visual angle；

Figure 17 shows the flow chart of the method for realizing terminal device interaction in accordance with an alternative illustrative embodiment of the present invention；

Figure 18-Figure 19 shows showing for the correspondence of different operation equipment room according to an exemplary embodiment of the present invention Example；

Figure 20 shows the matched example of operating parameter of different operation equipment room according to an exemplary embodiment of the present invention；

Figure 21 shows the example of shared gesture operation according to an exemplary embodiment of the present invention；

Figure 22 shows the example of adaptive adjustment operation focus according to an exemplary embodiment of the present invention；

Figure 23 shows the flow chart of the method for realizing terminal device interaction in accordance with an alternative illustrative embodiment of the present invention；

Figure 24 shows the block diagram of the device of realization terminal device interaction according to an exemplary embodiment of the present invention；

Figure 25 shows the block diagram of terminal device in accordance with an alternative illustrative embodiment of the present invention；

Figure 26 shows the block diagram of server in accordance with an alternative illustrative embodiment of the present invention；

Figure 27 shows the block diagram of terminal device in accordance with an alternative illustrative embodiment of the present invention.

Specific implementation mode

The embodiment of the present invention is reference will now be made in detail, examples of the embodiments are shown in the accompanying drawings, wherein identical mark Number identical component is referred to always.It will illustrate the embodiment by referring to accompanying drawing below, to explain the present invention.

Fig. 1 shows the flow chart of the method for realization terminal device interaction according to an exemplary embodiment of the present invention.The side Method can be executed by terminal device, can also be executed by server.The method can be realized by computer program.For example, The method can be executed by the application for interaction in terminal device or server, or pass through terminal device Or the function program realized in the operating system of server executes.

In step S10, determination is to be shared in the content that first terminal equipment currently provides to the user sets to second terminal Standby shared content.

As an example, first terminal equipment and/or second terminal equipment can be virtual reality device.

In step S20, the shared content determined is sent to second terminal equipment and is shared.

As an example, the method according to an exemplary embodiment of the present invention for realizing terminal device interaction may also include：In step Before rapid S10, the connection established between first terminal equipment and second terminal equipment is to interact.Initiate the connection request can Can also be second terminal equipment to be first terminal equipment.The initiator of connection request can be depending on specific situation：For example, The user of first terminal equipment wants and the user of second terminal equipment watch together first terminal equipment provide to the user it is interior Hold, then can be established and be connected by first terminal device request and second terminal equipment, when the user of second terminal equipment passes through the After two terminal devices receive connection request, that is, complete the process that connection is established；For example, the user of second terminal equipment wants to lead to The content that second terminal equipment viewing first terminal equipment provides to the user is crossed, then can pass through second terminal device request and first Terminal device establishes connection, after first terminal equipment receives connection request, that is, completes the process that connection is established.

As an example, when first terminal equipment is connection request initiator, second terminal equipment receives first terminal and sets Standby request and after establishing connection, can return among following information at least one of arrive first terminal equipment：Second terminal equipment Device attribute, the Network status of second terminal equipment, the corresponding user property of second terminal equipment, second terminal equipment correspond to User demand (for example, the corresponding user's object of interest of second terminal equipment, for second terminal equipment setting shared region Domain etc.), preferably to be interacted with first terminal equipment.If connection request initiator is second terminal equipment, the At least one among above- mentioned information can be sent to first terminal equipment by two terminal devices in a connection request, also can be when first After terminal device receives connection request, at least one among above- mentioned information is sent to first terminal equipment.

It, can be by various suitable modes come in the content that first terminal equipment currently provides to the user in step S10 Determine the shared content to be shared to second terminal equipment.

It should be understood that the content that first terminal equipment currently provides to the user can be when the preceding content shown to user, Can also be including when the preceding content that shown to user and due to the viewing visual angle of user currently fail to show to user be with The content that family provides.For example, by taking first terminal equipment is virtual reality device as an example, first terminal equipment currently provides to the user Content can be the content being currently presented in the virtual visual field of user, can also be the content of current entire virtual scene, The content of i.e. current panoramic view.

As preferable example, can according in following at least one of determine it is to be shared to second terminal equipment it is shared in Hold：The corresponding user's object of interest of first terminal equipment, the corresponding content of shared region, the specified corresponding content of event, the User's docking of the corresponding user's object of interest of two terminal devices, the changing content comprising effective content, second terminal equipment The operation of the shared content received.

It is described in detail below with reference to specific exemplary embodiment：

(A) it is determined according to the corresponding user's object of interest of first terminal equipment and shares content

As an example, can determine that the corresponding user of first terminal equipment is interested according at least one among following item Object：Association in the corresponding user behavior of first terminal equipment, the content currently provided to the user between each object is closed Scene corresponding to system, the corresponding user property of first terminal equipment, the content currently provided to the user.

(a1) determine that the corresponding user of first terminal equipment is interested right according to the corresponding user behavior of first terminal equipment As

As an example, can be according to the user of first terminal equipment in the content that first terminal equipment currently provides to the user Operated object determines the corresponding user's object of interest of first terminal equipment.For example, directly user currently can be grasped The object of work is determined as user's object of interest, will also can be determined as using together with the current operated associated object of object Family object of interest.Fig. 2 shows determining first terminal equipment according to an exemplary embodiment of the present invention, corresponding user is interested The example of object.As shown in Fig. 2, the content presentation currently provided to the user is billiard game scene, first terminal equipment The current operated object of user is grey ball, therefore, can current operated ball be determined as user's object of interest, together When, also the ball of other on desktop (ball of number 1,5,6,8) can be also determined as user's object of interest.

As an example, the content that first terminal equipment can be currently provided to the user according to the user of first terminal equipment It operates to determine the corresponding user's object of interest of first terminal equipment.Fig. 3 shows according to an exemplary embodiment of the present invention true Determine another example of the corresponding user's object of interest of first terminal equipment.As shown in figure 3, in shooting game, it is most of to use When family is shot at operation, interested object is the object of some type as goal.It therefore, can be according to user's Firing operation determines that user's object of interest is the class object as goal.As an example, can be by about different behaviour The prediction model of work and its corresponding user's object of interest, according to the current operation of the user of first terminal equipment come pre- Survey user's object of interest.Here, can be corresponding to the various historical operations based on active user or other users it is interested right As training to obtain prediction model or the existing prediction model of optimization.

As an example, the corresponding use of first terminal equipment can be determined according to the user of first terminal equipment current action Family object of interest.As an example, can the object corresponding to the current action of the user of first terminal equipment be determined as user Object of interest.For example, if most of user's eye gaze an object is more than 3 seconds or more, interested object is usual It is the object.Therefore, action can be watched attentively according to user, determines that user's object of interest is the object currently watched attentively.As Another example, action (for example, gesture etc.) that can be current to the user of first terminal equipment carry out semantic analysis, obtain dynamic with this The object for making to match is as user's object of interest.For example, if the user of first terminal equipment makes action of writing, it can The objects such as pen, paper, book in the content currently provided to the user are determined as user's object of interest；It drinks water if user makes The objects such as cup, beverage bottle in the content currently provided to the user can be then determined as user's object of interest by action.

In addition, as an example, can also be set in first terminal according to the current action of the user of first terminal equipment and user Both operated objects determines more accurate user's object of interest in the standby content currently provided to the user.For example, with Family object operated in the content that first terminal equipment currently provides to the user is writing pencil, by being moved to user is current Make carry out semantic analysis, if it is determined that the current action of user is the action that ink is dipped in simulation, it is determined that user's object of interest is Writing pencil and ink bottle；If it is determined that the current action of user is the action that simulation is write, it is determined that user's object of interest is Writing pencil and writing paper.

As an example, the corresponding use of first terminal equipment can be determined according to the user of first terminal equipment current voice Family object of interest.Particularly, the user of first terminal equipment is during using first terminal equipment, it will usually adjoint Communication, and in language often includes the information about the interested object of user.Therefore, language identification skill can be passed through Art identifies the object being mentioned in the voice of the user of first terminal equipment, and it is interested right that the object is determined as user As.Such as：In billiard game, Archon has been mentioned in the voice of the user of first terminal equipment, then it can be true by the ball of white It is set to user's object of interest.For example, the content that currently provides to the user present be scene of game when, if first terminal is set Standby user sends voice " looking at these pipelines " by remotely connecting to the user of second terminal equipment, then can be according in voice Appearance determines that " pipeline " is the corresponding user's object of interest of first terminal equipment.

As an example, can determine that the corresponding user's sense of first terminal equipment is emerging according to the user setting of first terminal equipment Interesting object.For example, the user of first terminal equipment can pre-set object of interest, currently provided to the user if detected Include pre-set object of interest in content, then the object detected can be determined as user's object of interest.In addition, with Family can also specify the object among the content currently provided to the user as user's object of interest in real time.

As an example, the corresponding use of first terminal equipment can be determined according to the historical behavior of the user of first terminal equipment Family object of interest.Particularly, the historical behavior of user reflects the demand of user at a certain time in the past in a sense, It is also potential demand sometime in the future simultaneously, therefore, can be detected from the content currently provided to the user and meet user and go through The object of history behavior is as user's object of interest.As an example, historical behavior can be eye gaze behavior, search behavior, The historical behaviors such as splitting glass opaque, navigation patterns, edit action, click behavior.

(a2) first terminal equipment pair is determined according to the incidence relation between each object in the content currently provided to the user The user's object of interest answered

Since the object in scene is frequently not independent, there are certain relationship that is mutually related between other objects, Therefore, it can obtain object associated with user's object of interest according to the incidence relation between object and feel together as user Object of interest.For example, user's object of interest can will be determined as together with the current operated associated object of object of user.

As an example, associated object can be belonged to same type of object with user's object of interest, match Object etc..It should be understood that associated object can be determined according to various suitable modes, for example, can be according to pre- in scene The incidence relation being first arranged determines associated object；Or it can determine whether to belong to according to attributes such as classification, color, shapes In same type of object；Or it can determine whether the object to match according to the attributes such as classification, matching relationship etc..Example Such as, the object being user-operably in the content currently provided to the user is pen, then can be by pen and object (example associated there Such as, book, book, blank etc.) it is determined as user's object of interest.

(a3) scene corresponding to the content currently provided to the user determines the corresponding user's sense of first terminal equipment Object of interest

For example, in billiard game scene, most of interested object of user is all billiards.It therefore, can be according to current Billiard game scene corresponding to the content provided to the user determines that user's object of interest is billiards.

As an example, the prediction model about different scenes and its corresponding user's object of interest, root can be passed through User's object of interest is predicted according to the scene corresponding to the content currently provided to the user.Here, can be based on active user or Other users object of interest corresponding under various scenes trains to obtain prediction model or the existing prediction model of optimization.

(a4) determine that the corresponding user of first terminal equipment is interested right according to the corresponding user property of first terminal equipment As

As an example, user property may include at least one among following item：The educational background of user, is used the identity of user The Income situation at family, the interest of user, the custom of user.

(B) it is determined according to the corresponding content of shared region and shares content

As an example, the shared region may include at least one among following region：It is set for first terminal equipment The shared region set, the shared region, the corresponding user's object of interest of first terminal equipment that are arranged for second terminal equipment Region where the region at place, the corresponding user's object of interest of second terminal equipment.It should be understood that the shared region can Including one or more regions.

(b1) about the shared region being arranged for first terminal equipment

The user of first terminal equipment can pre-set the shared region of fixed position and fixed size, also with user Specified and position and the size of real-time update shared region.User can specify shared region by various suitable operations, For example, the modes such as eye gaze, gesture, click, circle choosing can be used in user.For example, can counting user eye within some period The location point that eyeball is watched attentively obtains location point distribution map, then determines user's area of interest according to the distribution map, thus will The region is set as shared region.

Fig. 4 shows that according to an exemplary embodiment of the present invention determined according to the corresponding content of shared region shares showing for content Example.As shown in figure 4, the content currently provided to the user includes personal bank card and football match, user merely desires to will be about football The content of match shares to the user of second terminal equipment, and therefore, the user of first terminal equipment can be specified by gesture operation Shared region (region corresponding to dashed rectangle in Fig. 4), to which the corresponding content of shared region is only shared to second eventually The user of end equipment.

(b2) about the region where the corresponding user's object of interest of first terminal equipment

Here, shared region can be adjusted adaptively, can with the variation of the size and location of user's object of interest reality The position of Shi Gengxin shared regions and size.For example, user can first be arranged user's object of interest (for example, can specify in real time, Can preset), then the Minimum Area comprising user's object of interest is determined as to current shared region.

In addition, user can also be first by dynamic user's object of interest in first terminal equipment currently provides to the user The region being likely to occur in appearance is appointed as shared region, and the content in the shared region is shared to by first terminal equipment in real time Two terminal devices.It, can be according to first terminal equipment and/or second terminal after detecting that dynamic user's object of interest occurs The shared region that the demand of the user of equipment keeps current is constant, or selection will be where dynamic user's object of interest Region is as shared region, that is, the adaptive adjustment shared region with the variation of user's object of interest.

(b3) interested about the shared region and the corresponding user of second terminal equipment being arranged for second terminal equipment Region where object

When shared region is arranged, the demand for meeting the user of first terminal equipment is not only needed, it also can be according to second eventually The demand of the user of end equipment, eventually using the shared region needed for the user of second terminal equipment as shared region and/or second Region where the corresponding user's object of interest of end equipment is as shared region.

(C) it is determined according to the corresponding content of the event of specifying and shares content

During first terminal equipment is to second terminal equipment sharing contents, in first terminal equipment often along with The generation of event is specified some in the generation of some events, needs the user for reminding second terminal equipment.Therefore, can will refer to The corresponding content of event is determined as shared content.

As an example, specified event may include system dependent event and/or content dependent event.

(c1) about system dependent event

As an example, system dependent event may include at least one among following item：Notifications, are determined error prompting When remind, the systems pop-up event such as low battery, network speed are abnormal, device temperature is abnormal.For example, when first terminal equipment sends out low electricity When measuring alarm, it may be selected the event prompt window being sent to second terminal equipment, to inform second terminal equipment at the first time User's first terminal equipment be in low battery, the resolution ratio for sharing the content that may be interrupted or share of content may It can reduce.

(c2) about content dependent event

As an example, content dependent event may include occurring in the content currently provided to the user first terminal equipment and/ Or the corresponding user's object of interest of second terminal equipment.For example, occurring first in the content that ought currently provide to the user eventually When end equipment and/or the corresponding user's object of interest of second terminal equipment, user's object of interest or the user can be felt The content share in the region where object of interest gives second terminal equipment.

It should be understood that specified event can be by the user setting of first terminal equipment, it also can be by the user of second terminal equipment Setting.For example, the user of second terminal equipment can ask when there is a certain user's object of interest, the user is interested right It is shared as the content in the region at place is sent to second terminal equipment.

In addition, when second terminal equipment receives the corresponding content of specified event, in the same of the content that display receives When, the user of second terminal equipment can be prompted in a manner of voice, vibrations etc..

(D) it is determined according to the corresponding user's object of interest of second terminal equipment and shares content

As an example, can determine that the corresponding user of second terminal equipment is interested according at least one among following item Object：The corresponding user behavior of second terminal equipment, the corresponding user property of second terminal equipment.

(d1) determine that the corresponding user of second terminal equipment is interested right according to the corresponding user behavior of second terminal equipment As

As an example, the operation for the content that second terminal equipment can be shown according to the user of second terminal equipment, aobvious At least one of in object, current action, voice, the object of interest of setting, historical behavior operated by the content shown To determine the corresponding user's object of interest of second terminal equipment.

(d2) determine that the corresponding user of second terminal equipment is interested right according to the corresponding user property of second terminal equipment As

(E) it is determined according to the changing content comprising effective content and shares content

As an example, the changing content can be content the sharing relative to last time transmission currently provided to the user The changed partial content of content.As an example, the change can be determined when at least one among the following conditions is satisfied Change in content includes effective content：The ratio that the changing content accounts for the content currently provided to the user is not less than the first predetermined threshold Value；The changing content includes the corresponding content of shared region；The changing content includes the corresponding content of specified event；It is described Changing content includes first terminal equipment and/or the corresponding user's object of interest of second terminal equipment；The changing content packet Containing operable object.

As an example, the first predetermined threshold can be the fixed value (for example, 30%) of acquiescence, can also be whole according to first Value set by the user demand of end equipment and/or second terminal equipment.

Fig. 5 shows that changing content of the basis according to an exemplary embodiment of the present invention comprising effective content determines and shares content Example.As shown in figure 5, (a) in Fig. 5 shows the last shared content for being sent to second terminal equipment, hereinafter referred to as draw Face one, the content currently provided to the user (hereinafter referred to as picture two) change relative to picture one, such as (b) institute in Fig. 5 Show.If picture two does not include effective content relative to one changed part of picture, it can not share and currently be carried for user The content of confession, as shown in (c) in Fig. 5, second terminal equipment continues to show that the last time receives shared content；If picture Two include effective content relative to one changed part of picture, then can be by picture two relative to one changed portion of picture The content divided is determined as shared content, and second terminal equipment can be according to picture one and this changed part received The content (that is, picture two) of image after content synthesis variation is shown, as shown in (d) in Fig. 5.

(F) operation of the shared content received is determined according to the user of second terminal equipment and shares content

As an example, second can be determined eventually to the operation of the shared content received according to the user of second terminal equipment The corresponding user's object of interest of end equipment and/or the shared region being arranged for second terminal equipment, to according to determining The corresponding user's object of interest of second terminal equipment and/or for second terminal equipment setting shared region it is shared to determine Content.

In addition, as an example, the method according to an exemplary embodiment of the present invention for realizing terminal device interaction may also include： When meeting at least one of following, step S10 is executed：The movement velocity of first terminal equipment is not more than the second predetermined threshold；When Before include the corresponding content of shared region, the corresponding content of specified event, first terminal equipment pair in the content that provides to the user User's object of interest for answering, the corresponding user's object of interest of second terminal equipment, operable object, comprising effective content At least one of in changing content.

As an example, can be when at least one among the following conditions is satisfied, determination does not execute step S10：First eventually The movement velocity of end equipment is more than the second predetermined threshold；The movement velocity of first terminal equipment is more than third predetermined threshold and current Not including in the content provided to the user needs content to be sharing.As an example, need content to be sharing may include following item it At least one of in：Including the corresponding content of shared region, the corresponding content of specified event, the corresponding user of first terminal equipment The corresponding user's object of interest of object of interest, second terminal equipment, operable object, in the variation comprising effective content Hold.

It should be understood that the movement velocity of first terminal equipment can be obtained by various suitable modes.For example, when first When terminal device is virtual reality device, use can be detected by gyroscope built in first terminal equipment and acceleration transducer The head movement at family, and then control the content that variation is presented to user for first terminal equipment.And it is passed by gyroscope and acceleration The data that sensor detects also reflect the motion state of first terminal equipment, i.e., the size and velocity of rotation of rotational angle is fast Slowly.Therefore, first terminal equipment can be transported according to the data of gyroscope and acceleration transducer in first terminal equipment Dynamic analysis, obtains the motion state (for example, movement velocity etc.) of first terminal equipment, if according to the movement of first terminal equipment State (for example, movement velocity is more than the second predetermined threshold) knows that the head rotation of the user of first terminal equipment is very fast, then may be used Think that user loses interest in the content presented in rotation process, therefore can determine and do not execute step S10.

Fig. 6 shows the example according to an exemplary embodiment of the present invention that shared content is determined whether according to movement velocity.Such as Shown in Fig. 6, when the user of first terminal equipment rotates head, the gyroscope and acceleration built in first terminal equipment can be passed through Sensor can detect the motion state of first terminal equipment, when detecting that current movement velocity is more than the second predetermined threshold, It can determine that user loses interest in the content currently provided to the user, the not shared content currently provided to the user, in Fig. 6 (a) shown in, second terminal equipment still shows the last shared content received from first terminal equipment, if detecting movement Speed is no more than the second predetermined threshold, illustrates that user may be interested in the content currently provided to the user, then can perform step The shared content determined is sent to second terminal equipment and shared, as shown in (b) in Fig. 6 by S10 and step S20.

As another example, in addition to the motion state according to first terminal equipment, it may also be combined with and currently provide to the user Content determines whether to execute step S10.It particularly, can be according to the gyroscope and acceleration sensing built in first terminal equipment The data of device carry out motion analysis to first terminal equipment, obtain the motion state of first terminal equipment (for example, movement velocity Deng), if the motion state (for example, movement velocity is more than third predetermined threshold) according to first terminal equipment knows first terminal The head rotation of the user of equipment is very fast, then can further analyze the content of current virtual field-of-view image, if analysis The user of first terminal equipment is obtained during rotating head quickly, the content that first terminal equipment provides to the user is not Including needing content to be sharing, then it is believed that user does not feel emerging to the content that first terminal equipment provides to the user in rotation process Interest, therefore step S10 can not be executed.

It should be understood that the second predetermined threshold and third predetermined threshold may be the same or different.As preferable example, Second predetermined threshold can be more than third predetermined threshold, and the second predetermined threshold can be higher value, and third predetermined threshold can be smaller value, That is, only when the user of first terminal equipment quickly rotates head, just determination does not execute step S10；And if The user of one terminal device relatively quickly rotates head, then further can judge to be according to the content currently provided to the user No execution step S10.

Shared content can be reconstructed according to predetermined manner, and will be after reconstruct in step S20 as preferable example Content is sent to second terminal equipment and is shared.

As an example, the predetermined manner includes at least one among following item：Acquisition includes the shared content Content in Minimum Area；The shared content is adjusted according to the device attribute of second terminal equipment；According to redundant area to institute Shared content is stated to be reconstructed；The shared content is adjusted according to current Network status；It is corresponding based on first terminal equipment User property and/or the corresponding user property of second terminal equipment are corrected the shared content；Based on filter condition pair The shared content is filtered；The behaviour of shared content is directed to according to the user of first terminal equipment and/or second terminal equipment Shared content of opposing optimizes.

(A) content in the Minimum Area for including the shared content is obtained

When shared content is object, in order to enable the user of second terminal equipment to pass through in background other than objects etc. Hold enhancing viewing impression, it can be from the content obtained in the content currently provided to the user in the Minimum Area for including shared content. Fig. 7 shows the example according to an exemplary embodiment of the present invention being reconstructed to sharing content.As shown in fig. 7, if it is determined that Shared content is the corresponding user's object of interest " pipeline " of first terminal equipment, then can will include in the Minimum Area of " pipeline " Content be sent to second terminal equipment and shared.

(B) the shared content is adjusted according to the device attribute of second terminal equipment

As an example, device attribute may include at least one among following item：Screen size, the image that can show Type (for example, 2D, 3D etc.), the resolution ratio of screen, memory, processor.

As an example, the size for sharing content can be adjusted according to the screen size of second terminal equipment, for example, can be according to the Shared content is amplified by the screen size of two terminal devices, to enable to shared content in the limited of second terminal equipment Screen in as much as possible amplification display；Shared content can be reduced according to the screen size of second terminal equipment, so that Shared content can be all shown in the limited screen of second terminal equipment, to promote impact-share.

As an example, if second terminal equipment is merely able to display 2D images, it can be by shared content by 3D content-forms Be converted to 2D content-forms.

As an example, if the resolution ratio of the screen of second terminal equipment is relatively low, the resolution ratio of shared content can be dropped It is low.

(C) the shared content is reconstructed according to redundant area

It should be understood that the shared content determined may include multiple shared contents, it is therefore, according to the present invention exemplary Shared content is arranged compactly in one by embodiment, position relationship that can be according to shared content in the content provided to the user It rises, the white space of redundancy is reduced as far as possible.In addition, also can be according to first terminal equipment and/or second terminal equipment User demand determines the arrangement position of shared content.

Fig. 8 shows another example according to an exemplary embodiment of the present invention being reconstructed to sharing content.Such as Fig. 8 institutes Show, if it is determined that the shared content gone out is the corresponding user's object of interest " application icon " of first terminal equipment, then can be according to Position relationship between " application icon " is in the content currently provided to the user, after " application icon " is amplified compactly It is arranged together, redundant area as less as possible.

(D) the shared content is adjusted according to current Network status

As an example, if current Network status is preferable, the resolution ratio of shared content can be improved；If current Network status is poor, then can reduce the resolution ratio of shared content.

(E) the corresponding user property of first terminal equipment and/or the corresponding user property of second terminal equipment are based on to institute Shared content is stated to be corrected

The user of user and second terminal equipment for first terminal equipment, its own has certain specific attributes, this A little attributes reflect the particular demands of user, and shared content is reconstructed according to user property, reflects the individual demand of user, Increase user experience.As an example, user property may include at least one among following item：The educational background of user, user Identity, the Income situation of user, the interest of user, the custom of user, the physical condition of user.

As an example, if the analysis of the eyes attribute by the user to first terminal equipment, determines that user belongs to color Blind group automatically can then be corrected shared content according to the colour blindness attribute of user, as shown in figure 9, being set according to first terminal The voice of standby user can determine that the corresponding user's object of interest of first terminal equipment is " red ball ", but according to first terminal The corresponding user property of equipment finds that the user belongs to protanopia anerythrochloropsia group, thus by after correction by " green ball " location The content in domain is sent to second terminal equipment and is shared.

As an example, if passing through the strong hand attribute of the user to first terminal equipment and/or second terminal equipment Analysis, determines that user gets used to left hand, then can be corrected automatically to shared content according to the lefthanded attribute of user.

As an example, can also be according to educational background/identity/income of the user of first terminal equipment and/or second terminal equipment Etc. situations personage carried out to user draw a portrait analysis, know the preference of user, for being corrected to shared content, reach personalized Purpose.

(F) the shared content is filtered based on filter condition

As an example, filter condition can be the filter condition and/or second terminal of the user preset of first terminal equipment The filter condition of the user preset of equipment, for example, the user preset of second terminal equipment filters out the event window of system pop-up Deng, in order to avoid experience lf being influenced.

As an example, filter condition can be the history according to the user of first terminal equipment and/or second terminal equipment Filter condition determined by behavior.The historical behavior of user reflects the point of interest of user in a sense, therefore can pass through Corresponding filter condition is determined to the analysis of the historical behavior of user.For example, in virtual scene of painting, user uses always Writing brush creates ink and wash, and therefore pencil progress sketch, which is rarely employed, can fall the pencil automatic fitration in shared content.

As an example, filter condition can be according to filter condition determined by user property.Here, user property can wrap Include at least one among following item：The corresponding user property of first terminal equipment, the corresponding user property of second terminal equipment, The attribute of role in the content provided to the user.For example, may filter that with the unmatched object of user property, for example, if The user of first terminal equipment is student, then will can be filtered out with the content except the relevant content of student.

As an example, filter condition can be the user right according to the shared equipment of the user setting of first terminal equipment Identified filter condition.

Different user rights can be arranged to protect first terminal in user for different shared equipment or shared equipment The privacy content of the user of equipment is not leaked, or the user of shared equipment is avoided to carry out maloperation to shared content and cause not Necessary loss.For example, the user of first terminal equipment is currently playing, at this time if the user of second terminal equipment Accidentally game is closed, then the user of the first terminal equipment made can not return in normal game.

As an example, user right may include at least one among following item：Permission, user privacy right is arranged in system Limit, range of applications permission.

Permission is set about system, is related to which system setting can be shared, which system setting cannot be shared.For example, The setting of the systematic parameters such as sound, brightness, vibrational feedback will can be set as to share, to avoid due to second terminal equipment User faulty operation and cause the user of first terminal equipment by unnecessary influence.

About privacy of user permission, the content which is related to about privacy of user cannot be shared.For example, can will include first The curriculum offering of bank card, personal account, the friend information of the user of terminal device etc. is that cannot share, to protect first terminal The individual privacy of the user of equipment is not checked arbitrarily by the user of second terminal equipment.

About range of applications permission, being related to being arranged the content of which application program can share, which application program Content cannot share, for the application program that can be shared, which of Application Program Interface content can further be arranged can With shared, which content cannot be shared.For example, the user of first terminal equipment is chatting and seeing video simultaneously, chat is answered With the dialog box in program, seen by the user of second terminal equipment due to comprising the chat record with other people, being not desired to, because This, can be that cannot share by the curriculum offering of chat application.

It is also possible to provide specific Permission Levels, for example, may be configured as invisible (that is, cannot share), it is read-only, can The user of the different Permission Levels such as operation, first terminal equipment can flexibly set permission to be protected to shared content. As shown in Figure 10, it includes Private Banking's card information and section of football match video interface to need content to be sharing, and second terminal is set Standby user A, Permission Levels are sightless to bank card, therefore the bank card information in content to be sharing will be needed to filter Fall, the shared content comprising section of football match video interface is only sent to user A.And for the user B of second terminal equipment, Permission Levels are visible bank card, so the shared content that will include Private Banking's card information and section of football match video interface It is transmitted directly to user B.

Need content to be sharing is filtered by being based on filter condition, can both reduce the range of shared content, compared with The transmission quantity of few shared data, can also protect the privacy of the user of first terminal equipment.

(G) operation of shared content is directed to according to the user of first terminal equipment and/or second terminal equipment to shared interior Appearance optimizes

First terminal equipment and second terminal equipment may carry out shared content certain during shared content Operation, for example, amplifieroperation etc., these operations of user, reflect the shared demand of user, for example, putting to a certain extent Big operation reflects the quality requirement to sharing content.

These operations of user based on first terminal equipment and/or second terminal equipment can carry out weight to shared content It is shared again after structure, for example, improving the quality (for example, improving the resolution ratio for sharing content) for sharing content.

For example, the user of first terminal equipment performs amplifieroperation to shared content, then it can be by the thinner of shared content The image of granularity (high-resolution) is sent to second terminal equipment and is shared.

As an example, step S20 may include：By shared content in the form of high-resolution and by it is described be currently user Content in the content of offer in addition to the shared content is sent to second terminal equipment in the form of low resolution.

In addition, as an example, step S10 may also include：Based on second terminal equipment screen size determine it is described current The part that cannot be shown in the screen of second terminal equipment among the content provided to the user；It cannot be shown described Content to be sharing and/or operable object is needed to be added to energy among the content currently provided to the user among the part shown Enough parts shown in the screen of second terminal equipment, and set to second terminal using the content after superposition as to be shared Standby shared content.

As shown in figure 11, the screen of second terminal equipment is smaller, and the content of display is limited, in order in limited display area It inside shows as much as possible and shares content, can determine shared content according to the screen size of second terminal equipment.For example, Figure 11 In (a) show that the content currently provided to the user, (b) in Figure 11 are shown if the content that directly will currently provide to the user It is sent directly to second terminal equipment to be shared, the content that second terminal equipment can be shown is according to the present invention exemplary Embodiment, the corresponding user's object of interest extraction of first terminal equipment in the part that can cannot show second terminal equipment Out, such as the content in the box in (a) in Figure 11, and the object of interest extracted is added to second terminal equipment It the part that can be shown in screen can be in limited display to the user of second terminal equipment as shown in (c) in Figure 11 More information are obtained in region, in addition, the reality for the object being superimposed after user's precise knowledge of second terminal equipment for convenience Border position can will indicate that the thumbnail for the content of the physical location of the object of superposition currently provided to the user is also sent to Second terminal equipment is shown together.

In addition, as an example, the method according to an exemplary embodiment of the present invention for realizing terminal device interaction may also include： The operation of the shared content received optimizes the shared content according to the user of second terminal equipment, and will be excellent Content after change is sent to second terminal equipment.

During content is shared, the user of second terminal equipment may for first terminal equipment and second terminal equipment Certain operations, such as amplifieroperation, these operations of the user of second terminal equipment, one are carried out to the shared content received Determine to reflect the shared demand of the user of second terminal equipment in degree, for example, amplifieroperation reflects the matter to sharing content Amount demand.These operations of user based on second terminal equipment, first terminal equipment can optimize the shared content, And the content after optimization is sent to second terminal equipment.

For example, after shared content is sent to second terminal equipment by first terminal equipment, the user couple of second terminal equipment Shared content performs amplifieroperation, and second terminal equipment will indicate that the information of the amplifieroperation of user is sent to first terminal and sets Standby, first terminal equipment will be by the figure of the more fine granularity (high-resolution) in the region checked after the shared interior perhaps user amplification As the user for being sent to second terminal equipment shows, to meet second terminal equipment user demand.

Figure 12 shows the flow chart of the method for realizing terminal device interaction in accordance with an alternative illustrative embodiment of the present invention. Wherein, step S10 and step S20 can refer to the specific implementation mode that is described according to Fig. 1 to realize, details are not described herein.

In step S30, received from second terminal equipment：The target object that user selects from the shared content received Location information, and/or from the currently viewing visual angle of first terminal equipment to the motion path of the corresponding viewing visual angle of target object.

Particularly, the shared content that viewing has received before may be selected in the user of second terminal equipment, it is not necessary to watch The content of current Real-Time Sharing, that is, the user of second terminal equipment and the currently watched content of the user of first terminal equipment Can be different, in other words, the visual angle for watching panoramic view can be different.As an example, can be shared to panoramic view in advance Two terminal devices, the shared reconstruction of content that second terminal equipment may be based on receiving before go out panoramic view, eventually to second The content that the user of end equipment has shared before being watched by panoramic view.

First terminal equipment is instructed according to the location information and/or the motion path received in step S40 User move viewing visual angle and/or automatically switch first terminal equipment user viewing visual angle.

As an example, when what is received is the location information of target object, it can be according to the position of the target object received Confidence ceases and the current viewing visual angle of user, calculates from current viewing visual angle to the corresponding viewing visual angle of target object (that is, making Viewing visual angle when target object appears in the visual field of the user of first terminal equipment) motion path, then can be according to meter The motion path of calculating instructs user to move viewing visual angle and/or automatically switches the viewing visual angle of the user of first terminal equipment.

As an example, user can be instructed to move viewing visual angle by modes such as voice, display mobile route, prompt tones. By taking prompt tone as an example, if the user of first terminal equipment by prompt tone slowly close to target object, prompt tone is increasingly Greatly, it is spaced shorter；If user is far from target object, sound is smaller and smaller, and interval is longer.

As shown in figure 13, the shared content that viewing has received before may be selected in the user of second terminal equipment, that is, second The user of terminal device is different with the currently watched content of the user of first terminal equipment；As shown in figure 14, user can be from it Before selection target object " computer " in the shared content that has received, and the location information of the target object of selection is sent to One terminal device, first terminal equipment according to the location information of " computer " that receives, instruct user to move viewing visual angle so that " computer " appears in the visual field of the user of first terminal equipment, as shown in figure 15, and it should be understood that since first terminal is set The viewing visual angle of standby user changes, and the content that first terminal equipment currently provides to the user may also be changed, Therefore, it can return to and execute step S10 and S20, to which the user of second terminal equipment can determine the user of first terminal equipment Whether position selected target object where is moved into.

As another example, it can directly be received from second terminal equipment：From the currently viewing visual angle of first terminal equipment to The motion path of the corresponding viewing visual angle of target object.

Particularly, the user of second terminal equipment can from the shared content having received before selection target object, And it can be based on the current viewing visual angle of the user of first terminal equipment (for example, being determined according to current shared content) and selection Target object positional information calculation go out first terminal equipment user it is corresponding from current viewing visual angle to target object The motion path of viewing visual angle, and calculated motion path can be sent to first terminal equipment, to first terminal equipment Its user can be instructed to move viewing visual angle according to the motion path received and/or automatically switch the viewing visual angle of its user.

(a) in Figure 16 shows that current shared content, (b) in Figure 16 show that second terminal equipment currently shows panorama View, and can on the panoramic view of display the current viewing visual angle of the user of simultaneous display first terminal equipment, second terminal The location information for the target object that equipment is selected according to its user in panoramic view and the user of first terminal equipment are current Viewing visual angle calculates the user of first terminal equipment from current viewing visual angle to the fortune of the corresponding viewing visual angle of target object Dynamic path, and calculated motion path is sent to first terminal equipment, first terminal equipment is according to the movement road received Diameter instructs its user to move viewing visual angle or automatically switches the viewing visual angle of its user, and it should be understood that due to first terminal The viewing visual angle of the user of equipment changes, and the content that first terminal equipment currently provides to the user may also be changed Become, therefore, first terminal equipment, which can return to, executes step S10 and S20, can determine first to the user of second terminal equipment Whether the user of terminal device is moved into the position where target object, as shown in (c) in Figure 16.

Figure 17 shows the flow chart of the method for realizing terminal device interaction in accordance with an alternative illustrative embodiment of the present invention. Wherein, step S10 and step S20 can refer to the specific implementation mode that is described according to Fig. 1 to realize, details are not described herein.

The user of first terminal equipment may be unfamiliar with certain manipulations, it is desirable to pass through when using first terminal equipment It is shared with the content of second terminal equipment, obtain the Operating Guideline of the user of second terminal equipment.Second terminal equipment receives After shared content, the user of second terminal equipment may carry out a series of guidance operation.Selectively, according to the present invention The method of the realization terminal device interaction of another exemplary embodiment may include step S30 and step S40, and first terminal is prompted to set Standby user makes how from the position for the object that current viewing visual angle is moved to operated by the user of second terminal equipment The user of one terminal device finds the object operated by the user of second terminal equipment.In addition, can not also execute step S30 and step Rapid S40, for example, object operated by the user of the second terminal equipment just viewing visual angle current in the user of first terminal equipment It is interior.

In step S50, receives user from second terminal equipment and be directed to the operation letter that the shared content received is operated Breath.

It can be wrapped as an example, the user of second terminal equipment is directed to the operation information that the shared content received is operated Include at least one among following item：Operate the attribute information and operating parameter of equipment；Operation information about gesture operation；It closes In the operation information of voice operating.For example, operation equipment can be the operation equipment such as handle, keyboard, mouse of outer company, it can also It is the touch screen, button etc. of second terminal equipment itself.For example, operating parameter can be that click, sliding, long-press etc. are specific Operating parameter.

Work(corresponding with the operation information received is executed to the content currently provided to the user in step S60 Energy.

As an example, can be determined first according to the operation information received for being carried out to the content currently provided to the user Then the corresponding operation information of identical operation executes function corresponding with the operation information determined.To realize first eventually Operation between end equipment and second terminal equipment is shared, and the user of second terminal equipment can reflect the operation for sharing content In the content provided to the user to first terminal equipment.

First terminal equipment is directed to same target with second terminal equipment, realizes that the operation corresponding to same treatment may not Together.For example, the user of first terminal equipment is operated by handle, the handling result that viewing visual angle moves right can be reached, And the user of second terminal equipment then needs to slide the handling result that could realize the viewing visual angle that moves right to the right on the screen. Therefore, the user of second terminal equipment needs when the user's operation for instructing first terminal equipment shares content to the in practice The current operation of the user of two terminal devices matches, and is matched in the operation equipment of first terminal equipment, and can be first Operation on terminal device after real-time display matching, to instruct the user of first terminal equipment that can reach above-mentioned according to the operation Operating effect.

As an example, when operation information includes the attribute information and operating parameter of the operation equipment of second terminal equipment, First the operation equipment of second terminal equipment can be determined whether with first according to the attribute information of the operation equipment of second terminal equipment The operation equipment of terminal device is consistent or matches, if consistent or matching, can act directly on first terminal by operating parameter In equipment, otherwise, the content for being converted to operating parameter for currently being provided to the user to first terminal equipment is needed to carry out phase The corresponding operating parameter of same operation, and transformed operating parameter is acted in first terminal equipment, it should be appreciated that by Function corresponding with transformed operation information is executed in first terminal equipment, the content currently provided to the user is also changed Become, therefore, can return to and execute step S10 and S20, user of the effect Real-time Feedback to second terminal equipment of generation will be operated, To reach the Real-Time Sharing of operation.In addition, operating parameter that can also be in first terminal equipment after real-time display matching.

As shown in figure 18, first terminal equipment can prestore the correspondence of the operating parameter between different handles, such as scheme Shown in 19, the handle that the handle of second terminal equipment connection is connect with first terminal equipment is different, and passes through the attribute of equipment The matching of information, handle " A " key that the "○" key for the handle that second terminal equipment is connected is connect with first terminal equipment have There is identical function.Therefore when the "○" key for the handle that the user's operation of second terminal equipment is connected, first terminal equipment is certainly Dynamic " A " key being matched in connected handle, and first terminal equipment is currently provided to the user according to the function of " A " key Content is handled accordingly.In addition, the handle operation after matching can be also shown in first terminal equipment, such as Figure 20 institutes Show.

When the user of the user guided first terminal equipment of second terminal equipment operates, if the operation is grasped for gesture Make, as shown in figure 21, the user of second terminal equipment can first select operation object, then the image collector of second terminal equipment The gesture of the user of (for example, front camera etc.) acquisition second terminal equipment is set, second terminal equipment is by the letter of operation object Breath and collected gesture operation are sent to first terminal equipment, and first terminal equipment is right according to the operation information received The operation object carries out respective handling, it should be appreciated that since first terminal equipment has carried out respective handling to the operation object, the The content that one terminal device currently provides to the user is also changed, and therefore, be can return to and is executed step S10 and S20, will operate The effect Real-time Feedback of generation to second terminal equipment user, in addition, can also show second to the user of first terminal equipment The gesture operation of the user of terminal device can understand specific mode of operation so as to the user of first terminal equipment.

As an example, in actual scene, when the user of second terminal equipment operates selected operation object, the Two terminal devices can be filtered redundant operation according to operation object acceptable action type.In second terminal equipment During user does gesture, due to the continuity of gesture, the gesture operation of some redundancies is often carried in operating process, May be that some other actions and behavior are operated by action and Activity recognition.For example, in billiard game, a batting is completed When action, the action that can be captured by camera has shot, action, aiming action etc. of bending of bending over, but for behaviour Make for object " billiards ", according to its operational attribute it is found that it only receives shot, therefore can aim at etc. bending over to bend Redundant operation filters out.

In addition, the side according to an exemplary embodiment of the present invention for realizing terminal device interaction shown in Fig. 1, Figure 12 and Figure 17 Method may also include：Operation in response to user to the external operation equipment of first terminal equipment, acquisition is described currently to be carried for user The operation focus position of external operation equipment described in the content of confession；When detecting that it is invalid that the external operation equipment occurs When mobile, the operation focus position before current operation focus is adjusted to mobile.

It is transmitted as an example, the invalid movement can be the user of first terminal equipment and the user of second terminal equipment The movement of external operation equipment caused by external operation equipment.

For example, when the user of first terminal equipment and the user of second terminal equipment are closely shared, in order to know the How the user of two terminal devices operates first terminal equipment by external operation equipment (for example, handle etc.) currently carries for user External operation equipment may be passed to second terminal equipment by the user of the content of confession, first terminal equipment in instruction course User, which is operated by the user of second terminal equipment, first terminal equipment real-time display operating result, And it can show concrete operations information of the user to external operation equipment of second terminal equipment.

However during the transmission of external operation equipment (that is, invalid mobile), the operation focus of external operation equipment can It can move, it therefore, can be when detecting that the external operation equipment occurs invalid mobile, by current operation focus tune The whole operation focus position to before movement.

For example, the user of first terminal equipment and the user of second terminal equipment be when transmitting external operation equipment, first The user of terminal device can first press some setting button in external operation equipment before transmission, and first terminal equipment receives When the push button signalling, the position where current operation focus is can record, after completing to transmit, the user of second terminal equipment can To press above-mentioned setting button again, first terminal equipment knows that transmission terminates (that is, invalid movement occurs for external operation equipment), Then the current operation focus of external operation equipment is adjusted at recorded position (that is, where operation focus before transmitting At position).

As shown in figure 22, in billiard game, the operation focus of external operation equipment has been directed toward " white ball ", but due to The sensing datas such as gyroscope and accelerometer in external operation equipment are changed in the transmittance process of external operation equipment, are made outer Connecing operation equipment, operation focus has been directed toward " No. 1 ball " after the transfer.At this point, if it is external operation equipment operation focus without Adjustment, the user of second terminal equipment directly operate, then will will produce maloperation.Therefore, it can be set according to external operation It is standby transmit before the position of operation focus the position of the operation focus after transmission is adaptively adjusted, make its with before transmission Position is consistent.

Figure 23 shows the flow chart of the method for realizing terminal device interaction in accordance with an alternative illustrative embodiment of the present invention. The method can be executed by server, can also be realized by computer program.For example, the method can be by being mounted on clothes The application for interaction in business device executes, or the function program realized in the operating system for passing through server executes. Wherein, step S10 and step S20 can refer to the specific implementation mode that is described according to Fig. 1 to realize, details are not described herein.

In step S70, before step S10, the content that first terminal equipment currently provides to the user is obtained.

Here, before content is shared, first terminal equipment and needing carry out shared second terminal equipment need respectively with At least one of server establishes connection, among needing second terminal equipment to be sharing that can send following information to server：The The identification informations (for example, ID etc.) of two terminal devices, the device attribute of second terminal equipment, second terminal equipment it is network-like Condition, the corresponding user property of second terminal equipment, the corresponding user demand of second terminal equipment are (for example, second terminal equipment pair The user's object of interest answered, the shared region etc. being arranged for second terminal equipment), to be carried out more with first terminal equipment Good interaction.

It is shown to user when preceding as an example, the content that first terminal equipment currently provides to the user is first terminal equipment Content, wherein step S70 may include：Obtain the current panoramic view of first terminal equipment；First terminal equipment is received to correspond to Currently viewing Viewing-angle information；First terminal equipment is determined according to the currently viewing Viewing-angle information and current panoramic view When the preceding content shown to user.

As an example, can the current panoramic view of first terminal equipment directly be obtained from first terminal equipment.As another Example can not have to obtain its current panoramic view from first terminal equipment, can be run by server and be worked as with first terminal equipment The identical application program of application program of preceding operation, and it is current to first terminal equipment from first terminal equipment reception user in real time The operation information that the content provided to the user is operated；Function corresponding with the operation information received is executed, to ensure Always the image consistent with the panoramic view that first terminal equipment is current can be obtained, is to use to obtain first terminal equipment currently The content that family provides.

Also, the sharing mode of first terminal equipment and second terminal equipment can be divided into following several：

(a) one-to-one interactive mode：One first terminal equipment is interacted with a second terminal equipment.

(b) one-to-many interactive mode：One first terminal equipment is interacted with multiple second terminal equipment, that is, multiple second Terminal device obtains the content in the same first terminal equipment by server.

(c) many-one interactive mode：Multiple first terminal equipment are interacted with a second terminal equipment, a second terminal Equipment can obtain the content in multiple first terminal equipment simultaneously, and second terminal equipment can pass through the side of any switching laws at this time Formula selection shows the shared content of a first terminal equipment, can also show multiple first simultaneously on the same screen simultaneously The shared content of terminal device, and operate on it.

(d) multi-to-multi interactive mode：Multiple first terminal equipment are interacted with multiple second terminal equipment.

Embodiment one, first terminal equipment share first terminal equipment with second terminal device A and second terminal equipment B The picture of the currently watched a certain video of user.

The user of second terminal device A can pre-set a specified event：When occurring target 1 in video pictures, then The picture in the region where target 1 is sent to second terminal device A.It is to use when target 1 appears in first terminal equipment currently When the content that family provides, first terminal equipment (or server) identifies the region where target 1, and certainly the content in the region It is dynamic to be sent to second terminal device A.Also, if the user of second terminal device A amplifies in second terminal device A in shared To hold, second terminal device A will then indicate that the information of the amplifieroperation of its user is sent to first terminal equipment (or server), the The image of more fine granularity (high-resolution) in the region can be sent to second terminal device A by one terminal device (or server), To meet second terminal device A user demand.

In addition, current panoramic view can be shared to second terminal equipment B by first terminal equipment (or server) in real time, The user of second terminal equipment B can see current panoramic view, since the target in video pictures is excessive, when first terminal is set Standby user can not find target 2 where, then can seek the help of the user of second terminal equipment B.Second terminal is set The user of standby B has selected the position of target 2, second terminal equipment is just by the position of target 2 by watching current panoramic view Information is sent to first terminal equipment, or is sent to server, and first terminal equipment is transmitted to by server.First terminal equipment After receiving the location information, it can instruct how its user moves viewing visual angle, to reach the orientation where target 2, for example, can The distant relationships that its user and target 2 are notified by the size of prompt tone, by prompt, the user of first terminal equipment finally may be used To find target 2.

Embodiment two, the content that first terminal equipment currently provides to the user are the scene in shooting game, first terminal Equipment and second terminal equipment are separately connected the handle of different model.When in the content that first terminal equipment currently provides to the user When there is shooting object, the user of second terminal equipment using handle and clicks the shooting pair in the shared content of "○" key shooting As.Operation information is sent in first terminal equipment (or server) by second terminal equipment, by first terminal equipment (or service Device) it is parsed, by comparing the model parameter of different handles, the operation for the handle that the user of second terminal equipment is used, It is mapped on handle " A " key of the user of first terminal equipment, and executes function corresponding with " A " key, and then complete to shooting The shooting of object, therefore it is currently to use that the user of second terminal equipment, which will present in first terminal equipment the shooting for shooting object, In the content that family provides, in addition, also can the corresponding key position of the handle of first terminal equipment be prompted to its user, to help How the user of first terminal equipment uses the handle of oneself if understanding.

Figure 24 shows the block diagram of the device of realization terminal device interaction according to an exemplary embodiment of the present invention.Such as Figure 24 institutes Show, the device according to an exemplary embodiment of the present invention for realizing terminal device interaction is including shared content determining unit 101 and altogether Enjoy unit 102.

Particularly, content determining unit 101 is shared to be used in the content that first terminal equipment currently provides to the user Determine the shared content to be shared to second terminal equipment.

Shared cell 102 is shared for the shared content determined to be sent to second terminal equipment.

As an example, the first terminal equipment and/or second terminal equipment are virtual reality device.

As an example, shared content determining unit 101 can according in following at least one of determine to be shared give second eventually The shared content of end equipment：The corresponding user's object of interest of first terminal equipment, the corresponding content of shared region, specified event The corresponding user's object of interest of corresponding content, second terminal equipment, the changing content comprising effective content, second terminal are set Operation of the standby user to the shared content received.

As an example, shared content determining unit 101 can determine first terminal according at least one among following item The corresponding user's object of interest of equipment：The corresponding user behavior of first terminal equipment, the content currently provided to the user In the incidence relation between each object, the scene corresponding to the content currently provided to the user, first terminal equipment correspond to User property.

As an example, shared content determining unit 101 can determine second terminal according at least one among following item The corresponding user's object of interest of equipment：The corresponding user of the corresponding user behavior of second terminal equipment, second terminal equipment belongs to Property.

As an example, the shared region may include at least one among following region：It is set for first terminal equipment The shared region set, the shared region, the corresponding user's object of interest of first terminal equipment that are arranged for second terminal equipment Region where the region at place, the corresponding user's object of interest of second terminal equipment.

As an example, the specified event may include at least one in system dependent event, content dependent event.

As an example, the changing content can be content the sharing relative to last time transmission currently provided to the user The changed partial content of content, wherein at least one that shared content determining unit 101 can be among the following conditions is expired When sufficient, determine in the changing content to include effective content：The changing content accounts for the ratio of the content currently provided to the user Not less than the first predetermined threshold；The changing content includes the corresponding content of shared region；The changing content includes specified thing The corresponding content of part；The changing content includes that first terminal equipment and/or the corresponding user of second terminal equipment are interested right As；The changing content includes operable object.

As an example, shared content determining unit 101 can be when determination meets at least one of following, in first terminal equipment The shared content to be shared to second terminal equipment is determined in the content currently provided to the user：The movement speed of first terminal equipment Degree is not more than the second predetermined threshold；Include the corresponding content of shared region, specified event pair in the content currently provided to the user The corresponding user's object of interest of content, first terminal equipment answered, the corresponding user's object of interest of second terminal equipment, can At least one of in operation object, the changing content comprising effective content.

As an example, shared cell 102 can be reconstructed the shared content according to predetermined manner, and will be after reconstruct Content is sent to second terminal equipment and is shared.

As an example, the predetermined manner may include at least one among following item：Acquisition includes the shared content Minimum Area in content；The shared content is adjusted according to the device attribute of second terminal equipment；According to redundant area pair The shared content is reconstructed；The shared content is adjusted according to current Network status；It is corresponded to based on first terminal equipment User property and/or the corresponding user property of second terminal equipment the shared content is corrected；Based on filter condition The shared content is filtered；It is directed to shared content according to the user of first terminal equipment and/or second terminal equipment Operation optimizes shared content.

As an example, according to an exemplary embodiment of the present invention realize that the device of terminal device interaction may also include：It receives Unit (not shown) and visual angle effect unit (not shown).

Receiving unit is used to receive from second terminal equipment：The target object that user selects from the shared content received Location information, and/or from the currently viewing visual angle of first terminal equipment to the movement road of the corresponding viewing visual angle of target object Diameter.

Visual angle effect unit is used for according to the location information and/or the motion path received, and guidance first is eventually The user of end equipment moves viewing visual angle and/or automatically switches the viewing visual angle of the user of first terminal equipment.

As an example, according to an exemplary embodiment of the present invention realize that the device of terminal device interaction may also include：Operation Information receiving unit (not shown) and execution unit (not shown).

Operation information receiving unit is used to receive user from second terminal equipment and be grasped for the shared content received The operation information of work.

Execution unit is used to, to the content currently provided to the user, execute work(corresponding with the operation information received Energy.

As an example, according to an exemplary embodiment of the present invention realize that the device of terminal device interaction may also include：Focus Acquiring unit (not shown) and focus adjustment unit (not shown).

Focus acquiring unit is for operation in response to user to the external operation equipment of first terminal equipment, described in acquisition The operation focus position of external operation equipment described in the content currently provided to the user.Focus adjustment unit is used for when inspection When measuring the external operation equipment and occurring invalid mobile, where the operation focus before current operation focus is adjusted to mobile At position.

As an example, according to an exemplary embodiment of the present invention realize that the device of terminal device interaction may also include：It obtains Unit (not shown).

Acquiring unit is used for true in the content that first terminal equipment currently provides to the user in shared content determining unit Before the fixed shared content to be shared to second terminal equipment, the content that first terminal equipment currently provides to the user is obtained.

It is shown to user when preceding as an example, the content that first terminal equipment currently provides to the user is first terminal equipment Content, wherein acquiring unit may include：Panoramic view acquiring unit (not shown), Viewing-angle information receiving unit (not shown) With determination unit (not shown).

Panoramic view acquiring unit is for obtaining the current panoramic view of first terminal equipment.Viewing-angle information receiving unit is used In the corresponding currently viewing Viewing-angle information of reception first terminal equipment.Determination unit is used for according to the currently viewing Viewing-angle information Determine first terminal equipment when the preceding content shown to user with current panoramic view.

Operation information receiving unit is used to receive user from first terminal equipment and currently be carried for user to first terminal equipment The operation information that the content of confession is operated.Execution unit is for executing function corresponding with the operation information received, to obtain The content for taking first terminal equipment currently to provide to the user.

It should be understood that the specific implementation of the device according to an exemplary embodiment of the present invention for realizing terminal device interaction The related specific implementation of Fig. 1-Figure 23 descriptions be may be incorporated by reference to realize, details are not described herein.

Figure 25 shows the block diagram of terminal device according to an exemplary embodiment of the present invention.As shown in figure 25, according to the present invention The terminal device of exemplary embodiment includes shared content determining unit 201 and shared cell 202.

Hereinafter, the terminal device is known as first terminal equipment.Have in shared it should be understood that first terminal equipment is removed Hold except determination unit 201 and shared cell 202, can also have it to execute other devices of its own function as terminal device Part, for example, display device etc..

Particularly, content determining unit 201 is shared to be used in the content that first terminal equipment currently provides to the user Determine the shared content to be shared to second terminal equipment.

Shared cell 202 is shared for the shared content determined to be sent to second terminal equipment.

As an example, shared content determining unit 201 can according in following at least one of determine to be shared give second eventually The shared content of end equipment：The corresponding user's object of interest of first terminal equipment, the corresponding content of shared region, specified event The corresponding user's object of interest of corresponding content, second terminal equipment, the changing content comprising effective content, second terminal are set Operation of the standby user to the shared content received.

As an example, shared content determining unit 201 can determine first terminal according at least one among following item The corresponding user's object of interest of equipment：The corresponding user behavior of first terminal equipment, the content currently provided to the user In the incidence relation between each object, the scene corresponding to the content currently provided to the user, first terminal equipment correspond to User property.

As an example, shared content determining unit 201 can determine second terminal according at least one among following item The corresponding user's object of interest of equipment：The corresponding user of the corresponding user behavior of second terminal equipment, second terminal equipment belongs to Property.

As an example, the changing content can be content the sharing relative to last time transmission currently provided to the user The changed partial content of content, wherein at least one that shared content determining unit 201 can be among the following conditions is expired When sufficient, determine in the changing content to include effective content：The changing content accounts for the ratio of the content currently provided to the user Not less than the first predetermined threshold；The changing content includes the corresponding content of shared region；The changing content includes specified thing The corresponding content of part；The changing content includes that first terminal equipment and/or the corresponding user of second terminal equipment are interested right As；The changing content includes operable object.

As an example, shared content determining unit 201 can be when determination meets at least one of following, in first terminal equipment The shared content to be shared to second terminal equipment is determined in the content currently provided to the user：The movement speed of first terminal equipment Degree is not more than the second predetermined threshold；Include the corresponding content of shared region, specified event pair in the content currently provided to the user The corresponding user's object of interest of content, first terminal equipment answered, the corresponding user's object of interest of second terminal equipment, can At least one of in operation object, the changing content comprising effective content.

As an example, shared cell 202 can be reconstructed the shared content according to predetermined manner, and will be after reconstruct Content is sent to second terminal equipment and is shared.

As an example, terminal device according to an exemplary embodiment of the present invention may also include：Receiving unit (not shown) and Visual angle effect unit (not shown).

As an example, terminal device according to an exemplary embodiment of the present invention may also include：Operation information receiving unit is (not Show) and execution unit (not shown).

As an example, terminal device according to an exemplary embodiment of the present invention may also include：Focus acquiring unit (is not shown Go out) and focus adjustment unit (not shown).

It should be understood that the specific implementation of terminal device according to an exemplary embodiment of the present invention may be incorporated by reference Fig. 1- The related specific implementation of Figure 22 descriptions realizes that details are not described herein.

Figure 26 shows the block diagram of server according to an exemplary embodiment of the present invention.As shown in figure 26, shown according to the present invention Example property embodiment server include：Acquiring unit 301, shared content determining unit 302 and shared cell 303.

Particularly, acquiring unit 301 is for obtaining the content that first terminal equipment currently provides to the user.

It is to be shared that shared content determining unit 302 is used for the determination in the content that first terminal equipment currently provides to the user To the shared content of second terminal equipment.

Shared cell 303 is shared for the shared content determined to be sent to second terminal equipment.

As an example, shared content determining unit 302 can according in following at least one of determine to be shared give second eventually The shared content of end equipment：The corresponding user's object of interest of first terminal equipment, the corresponding content of shared region, specified event The corresponding user's object of interest of corresponding content, second terminal equipment, the changing content comprising effective content, second terminal are set Operation of the standby user to the shared content received.

As an example, shared content determining unit 302 can determine first terminal according at least one among following item The corresponding user's object of interest of equipment：The corresponding user behavior of first terminal equipment, the content currently provided to the user In the incidence relation between each object, the scene corresponding to the content currently provided to the user, first terminal equipment correspond to User property.

As an example, shared content determining unit 302 can determine second terminal according at least one among following item The corresponding user's object of interest of equipment：The corresponding user of the corresponding user behavior of second terminal equipment, second terminal equipment belongs to Property.

As an example, the changing content can be content the sharing relative to last time transmission currently provided to the user The changed partial content of content, wherein at least one that shared content determining unit 302 can be among the following conditions is expired When sufficient, determine in the changing content to include effective content：The changing content accounts for the ratio of the content currently provided to the user Not less than the first predetermined threshold；The changing content includes the corresponding content of shared region；The changing content includes specified thing The corresponding content of part；The changing content includes that first terminal equipment and/or the corresponding user of second terminal equipment are interested right As；The changing content includes operable object.

As an example, shared content determining unit 302 can be when determination meets at least one of following, in first terminal equipment The shared content to be shared to second terminal equipment is determined in the content currently provided to the user：The movement speed of first terminal equipment Degree is not more than the second predetermined threshold；Include the corresponding content of shared region, specified event pair in the content currently provided to the user The corresponding user's object of interest of content, first terminal equipment answered, the corresponding user's object of interest of second terminal equipment, can At least one of in operation object, the changing content comprising effective content.

As an example, shared cell 303 can be reconstructed the shared content according to predetermined manner, and will be after reconstruct Content is sent to second terminal equipment and is shared.

As an example, server according to an exemplary embodiment of the present invention may also include：Receiving unit (not shown) and road Diameter determination unit (not shown).

Receiving unit is used to receive from second terminal equipment：The target object that user selects from the shared content received Location information.

Path determining unit is used to determine that the currently viewing of first terminal equipment regards according to the location information received The motion path and is sent to first terminal equipment by angle to the motion path of the corresponding viewing visual angle of target object.

As an example, server according to an exemplary embodiment of the present invention may also include：Operation information receiving unit (does not show Go out) and execution unit (not shown).

Execution unit is used to, to the content currently provided to the user, execute work(corresponding with the operation information received Can, and the operation information is sent to first terminal equipment.

It is shown to user when preceding as an example, the content that first terminal equipment currently provides to the user is first terminal equipment Content, wherein acquiring unit 301 may include：Panoramic view acquiring unit (not shown), Viewing-angle information receiving unit (do not show Go out) and determination unit (not shown).

It should be understood that the specific implementation of server according to an exemplary embodiment of the present invention may be incorporated by reference Fig. 1-figure The related specific implementations of 23 descriptions realize that details are not described herein.

Figure 27 shows the block diagram of terminal device in accordance with an alternative illustrative embodiment of the present invention.As shown in figure 27, according to The terminal device of exemplary embodiment of the present includes：Shared content receipt unit 401 and display unit 402.Here, the end End equipment can be the second terminal equipment in the above exemplary embodiments.

Particularly, the shared content that content receipt unit 401 is used to receive the transmission of first terminal equipment is shared, wherein The shared content is to be determined in the content that first terminal equipment currently provides to the user.

Display unit 402 is for showing the shared content received.

As an example, terminal device in accordance with an alternative illustrative embodiment of the present invention may also include：Transmission unit (does not show Go out).

Transmission unit is used to send to first terminal equipment：The target object that user selects from the shared content received Location information, and/or from the currently viewing visual angle of first terminal equipment to the movement road of the corresponding viewing visual angle of target object Diameter.

As an example, terminal device in accordance with an alternative illustrative embodiment of the present invention may also include：Operate receiving unit (not shown).

Operation receiving unit is used to receive user and is directed to the operation information that the shared content received is operated, wherein The operation information is sent to first terminal equipment by transmission unit.

It should be understood that the specific implementation of terminal device according to an exemplary embodiment of the present invention may be incorporated by reference Fig. 1- The related specific implementation of Figure 23 descriptions realizes that details are not described herein.

Method and apparatus, terminal device and the service according to an exemplary embodiment of the present invention for realizing terminal device interaction Device only will need partial content to be sharing to be sent to other-end equipment and is total among content that terminal device provides to the user It enjoys, to reduce the transmission of redundant data, reduces the volume of transmitted data of equipment room, save transfer resource, improve equipment Between the real-time linked up.In addition, the operation between can also be achieved terminal device is shared.

Moreover, it should be understood that the device according to an exemplary embodiment of the present invention for realizing terminal device interaction, terminal device And each unit in server can be implemented hardware component and/or component software.Those skilled in the art are according to each of restriction Processing performed by a unit, can such as use site programmable gate array (FPGA) or application-specific integrated circuit (ASIC) reality Existing each unit.

In addition, the method according to an exemplary embodiment of the present invention for realizing terminal device interaction may be implemented as computer Computer code in readable medium recording program performing.Those skilled in the art can realize the meter according to the description to the above method Calculation machine code.The above method of the invention is realized when the computer code is performed in a computer.

Although having show and described some exemplary embodiments of the present invention, it will be understood by those skilled in the art that It, can be to these in the case where not departing from the principle and spirit of the invention defined by the claims and their equivalents Embodiment is modified.

Claims

1. a kind of method for realizing terminal device interaction, including：

(A) it is determined in the content that first terminal equipment currently provides to the user to be shared to the shared interior of second terminal equipment Hold；

(B) the shared content determined second terminal equipment is sent to share.

2. according to the method described in claim 1, wherein, the first terminal equipment and/or second terminal equipment are virtual existing Real equipment.

3. according to the method described in claim 1, wherein, according in following at least one of determine and to be shared set to second terminal Standby shared content：The corresponding user's object of interest of first terminal equipment, the corresponding content of shared region, specified event correspond to Content, second terminal equipment corresponding user's object of interest, the changing content comprising effective content, second terminal equipment Operation of the user to the shared content received.

4. according to the method described in claim 3, wherein, first terminal equipment is determined according at least one among following item Corresponding user's object of interest：It is each in the corresponding user behavior of first terminal equipment, the content currently provided to the user The scene corresponding to incidence relation, the content currently provided to the user, the corresponding use of first terminal equipment between object Family attribute；

And/or the corresponding user's object of interest of second terminal equipment is determined according at least one among following item：Second The corresponding user behavior of terminal device, the corresponding user property of second terminal equipment；

And/or the shared region includes at least one among following region：For the shared region of first terminal equipment setting Domain, for the shared region of second terminal equipment setting, the region where the corresponding user's object of interest of first terminal equipment, Region where the corresponding user's object of interest of second terminal equipment；

And/or the specified event includes at least one in system dependent event, content dependent event；

And/or the changing content is that the shared content that the content currently provided to the user is sent relative to the last time becomes The partial content of change, wherein when at least one among the following conditions is satisfied, determine in the changing content comprising effective Content：The ratio that the changing content accounts for the content currently provided to the user is not less than the first predetermined threshold；The changing content Including the corresponding content of shared region；The changing content includes the corresponding content of specified event；The changing content includes the One terminal device and/or the corresponding user's object of interest of second terminal equipment；The changing content includes operable object.

5. method according to any one of claims 1 to 4, wherein

When meeting at least one of following, step (A) is executed：

The movement velocity of first terminal equipment is not more than the second predetermined threshold；

Include the corresponding content of shared region, the corresponding content of specified event, first terminal in the content currently provided to the user Equipment corresponding user's object of interest, operable object, includes effective at the corresponding user's object of interest of second terminal equipment At least one of in the changing content of content.

6. method according to any one of claims 1 to 4, wherein step (B) includes：

The shared content is reconstructed according to predetermined manner, and the content after reconstruct is sent to second terminal equipment and is carried out It is shared.

7. according to the method described in claim 6, wherein, the predetermined manner includes at least one among following item：

Obtain the content in the Minimum Area for including the shared content；

The shared content is adjusted according to the device attribute of second terminal equipment；

The shared content is reconstructed according to redundant area；

The shared content is adjusted according to current Network status；

Based on the corresponding user property of first terminal equipment and/or the corresponding user property of second terminal equipment to described shared interior Appearance is corrected；

The shared content is filtered based on filter condition；

The operation that shared content is directed to according to the user of first terminal equipment and/or second terminal equipment is excellent to shared content progress Change.

8. method according to any one of claims 1 to 4, further includes：

It is received from second terminal equipment：The location information for the target object that user selects from the shared content received, and/or From the currently viewing visual angle of first terminal equipment to the motion path of the corresponding viewing visual angle of target object；

According to the location information and/or the motion path received, the user of first terminal equipment is instructed to move viewing The viewing visual angle of the user of visual angle and/or automatic switchover first terminal equipment.

9. method according to any one of claims 1 to 4, further includes：

User, which is received, from second terminal equipment is directed to the operation information that the shared content received is operated；

To the content currently provided to the user, function corresponding with the operation information received is executed.

10. method according to any one of claims 1 to 4, further includes：

Operation in response to user to the external operation equipment of first terminal equipment obtains the content currently provided to the user Described in it is external operation equipment operation focus position；

When detecting that the external operation equipment occurs invalid mobile, the operation before current operation focus is adjusted to mobile Focus position.

11. method according to any one of claims 1 to 4, further includes：

Before step (A), the content that first terminal equipment currently provides to the user is obtained.

12. according to the method for claim 11, wherein the content that first terminal equipment currently provides to the user is first whole End equipment is when the preceding content shown to user, wherein the step of obtaining the content that first terminal equipment currently provides to the user is wrapped It includes：

Obtain the current panoramic view of first terminal equipment；

Receive the corresponding currently viewing Viewing-angle information of first terminal equipment；

Determine that first terminal equipment is shown when preceding to user according to the currently viewing Viewing-angle information and current panoramic view Content.

13. according to the method for claim 11, further including：

The operation letter that the content that user currently provides first terminal equipment to the user is operated is received from first terminal equipment Breath；

Function corresponding with the operation information received is executed, to obtain the content that first terminal equipment currently provides to the user.

14. a kind of device for realizing terminal device interaction, including：

Shared content determining unit determines to be shared to second terminal in the content that first terminal equipment currently provides to the user The shared content of equipment；

The shared content determined is sent to second terminal equipment and shared by shared cell.

15. a kind of terminal device, including：

Shared content determining unit determines to be shared to another terminal in the content that the terminal device currently provides to the user The shared content of equipment；

The shared content determined is sent to another terminal device and shared by shared cell.

16. a kind of terminal device, including：

Shared content receipt unit receives the shared content that another terminal device is sent, wherein the shared content is described It is determined in the content that another terminal device currently provides to the user；

Display unit shows the shared content received.

17. terminal device according to claim 16, further includes：

Transmission unit, for being sent to another terminal device：The target pair that user selects from the shared content received The location information of elephant, and/or from the currently viewing visual angle of another terminal device to the corresponding viewing visual angle of target object Motion path.

18. terminal device according to claim 16, further includes：

Receiving unit is operated, the operation information that the shared content received is operated is directed to for receiving user；

Transmission unit, for the operation information to be sent to another terminal device.

19. a kind of server, including：

Acquiring unit obtains the content that first terminal equipment currently provides to the user；

20. server according to claim 19, further includes：

Receiving unit is received from second terminal equipment：The position for the target object that user selects from the shared content received Information；

Path determining unit determines the currently viewing visual angle of first terminal equipment to target according to the location information received The motion path of the corresponding viewing visual angle of object, and the motion path is sent to first terminal equipment.

21. server according to claim 19, further includes：

Operation information receiving unit receives user from second terminal equipment and is directed to the operation that the shared content received is operated Information；

Execution unit executes function corresponding with the operation information received, and will to the content currently provided to the user The operation information is sent to first terminal equipment.

22. server according to claim 19, wherein the content that first terminal equipment currently provides to the user is first Terminal device is when the preceding content that shown to user, wherein acquiring unit includes：

Panoramic view acquiring unit obtains the current panoramic view of first terminal equipment；

Viewing-angle information receiving unit receives the corresponding currently viewing Viewing-angle information of first terminal equipment；

Determination unit, according to the currently viewing Viewing-angle information and current panoramic view come determine first terminal equipment when it is preceding to The content that user shows.