TW201917556A - Multi-screen interaction method and apparatus, and electronic device - Google Patents

Abstract

Disclosed in embodiments of the present application are a multi-screen interaction method and apparatus, and an electronic device. The method comprises: a first terminal loads an interactive material, the interactive material comprising a specified object material created according to a specified object; acquire a real image; when a target event related to the specified object is played back in a video in a second terminal, add the specified object material to the real image. By means of the embodiments of the present application, the interactive participation of users can be improved.

Description

Multi-screen interactive method, device and electronic device

The present application relates to the field of multi-screen interaction technology, and in particular, to a multi-screen interaction method, device, and electronic device.

Multi-screen interaction refers to the transmission, analysis, display and control of multimedia (audio, video, picture) content on different multimedia terminal devices (such as between common mobile phones and TVs) through wireless network connection. After a series of operations, the same content can be displayed on different terminal devices, and content intercommunication between the terminals can be realized. In the prior art, the interaction from the television end to the mobile terminal is usually implemented by means of a graphic code. For example, a two-dimensional code related to a program currently being played can be displayed on a television screen, and the user can install it in a mobile phone. The application's "sweep" and other functions scan the QR code, then parse it on the mobile phone and display the specific interactive page. Then, the user can answer questions, draws and other interactions on the page. Although this prior art method can realize the interaction between the mobile phone and the television, the specific implementation form is relatively rigid, and the actual participation of the user is not high. Therefore, how to provide a richer multi-screen interaction and increase user participation has become a technical problem that needs to be solved by those skilled in the art.

The application provides a multi-screen interaction method, device and electronic device, which can improve the user's participation in interaction. The present application provides the following solution: A multi-screen interaction method, comprising: a first terminal loading an interactive material, the interactive material comprising a specified object material created according to a specified object; acquiring a real-life image; when the video in the second terminal is played The specified object material is added to the live image when the target event is associated with the specified object. A multi-screen interaction method, comprising: a first server saves an interactive material, the interactive material includes a specified object material created according to the specified object; and the interactive material is provided to the first terminal, and the real image is collected by the first terminal For example, when the video in the second terminal is played to a target event corresponding to the specified object, the specified object material is added to the live image. A multi-screen interaction method, comprising: playing a video by a second terminal; playing a sound wave signal of a preset frequency when the video is played to a target event related to the specified object, so that the first terminal knows by detecting the sound wave signal The target event occurs and the specified object material is added to the captured live image. A multi-screen interaction method includes: receiving, by a second server, sound wave signal information of a preset frequency provided by a first server; inserting a sound wave signal of the preset frequency at a position where a target event related to a specified object occurs in the video, In order to play the video through the second terminal, the first terminal learns the occurrence of the target event by detecting the sound wave signal, and adds the specified object material to the collected real-life image. A video interaction method, comprising: loading, by a first terminal, an interactive material, the interactive material comprising a specified object material created according to a specified object; when a video in the first terminal is played to a target event related to the specified object, Jumping to the interactive interface; displaying the live image acquisition result in the interactive interface, and adding the specified object material to the live image. A video interaction method includes: a first server saves an interactive material, the interactive material includes a specified object material created according to the specified object; and the interactive material is provided to the first terminal, so that the video in the first terminal is played When the target event related to the specified object is reached, the interactive interface is jumped, and the live image acquisition result is displayed in the interactive interface, and the specified object material is added to the real image. An interactive method, comprising: loading an interactive material, the specified material comprising a specified object created according to the specified object; acquiring a real image; adding the specified object material when a target event related to the specified object is detected Go to the live image. A multi-screen interactive device is applied to the first terminal, and includes: a first material loading unit, configured to load an interactive material, the interactive material includes a specified object material created according to the specified object; and a first real image capturing unit, configured to: Collecting a live view image; a first material adding unit, configured to add the specified object material to the real-life image when a video in the second terminal is played to a target event related to the specified object. A multi-screen interactive device is applied to the first server, and includes: a first interactive material saving unit, configured to save the interactive material, the interactive material includes a specified object material created according to the specified object; the first interactive material providing unit, Providing the interactive material to the first terminal, the real image is collected by the first terminal, and when the video in the second terminal is played to a target event corresponding to the specified object, the specified object material is added Go to the live image. A multi-screen interactive device is applied to a second terminal, comprising: a video playing unit for playing a video; and a sound wave signal playing unit, configured to play a preset frequency when the video is played to a target event related to the specified object The sound wave signal is such that the first terminal learns the occurrence of the target event by detecting the sound wave signal, and adds the specified object material to the collected real-life image. A multi-screen interactive device is applied to the second server, and includes: an acoustic signal information receiving unit, configured to receive sound wave signal information of a preset frequency provided by the first server; and an acoustic wave signal information inserting unit, configured to Inserting a sound wave signal of the preset frequency at a position where the target event related to the object is specified, so that the first terminal can detect the occurrence of the target event by detecting the sound wave signal during the process of playing the video through the second terminal. And add the specified object material to the captured live image. A video interaction device, applied to the first terminal, includes: a loading unit, configured to load an interactive material, the interactive material includes a specified object material created according to the specified object; and an interface jump unit, configured to be in the first terminal Jumping to the interactive interface when the video is played to the target event related to the specified object; a material adding unit, configured to display the live image capturing result in the interactive interface, and adding the specified object material to the real scene In the image. A video interaction device is applied to the first server, and includes: a second material saving unit, configured to save the interactive material, the interactive material includes a specified object material created according to the specified object; and a second material providing unit, configured to The interactive material is provided to the first terminal, so that when the video in the first terminal is played to the target event related to the specified object, the interactive interface is jumped to, and the live image collection result is displayed in the interactive interface. And adding the specified object material to the live image. An interactive device includes: a second material loading unit, configured to load an interactive material, the interactive material includes a specified object material created according to the specified object; a second real image capturing unit configured to collect the real image; Adding a unit for adding the specified object material to the live image when a target event related to the specified object is detected. An electronic device comprising: one or more processors; and a memory associated with the one or more processors, the memory for storing program instructions, the program instructions being processed by the one or more When the reading is performed, the following operations are performed: loading the interactive material, the specified material including the specified object material created according to the specified object; acquiring the real image; when the video in the second terminal is played to the target related to the specified object When the event, the specified object material is added to the live image. According to the specific embodiment provided by the present application, the present application discloses the following technical effects: Through the embodiment of the present application, an interactive material can be created according to a video/animation related to a specified object, and in a specific interaction process, the user may be located. When the actual environment collects the real-life image and broadcasts the target event corresponding to the specified object in the second terminal, the specified object material is added to the real-life image for display. In this way, the user can obtain the experience that the relevant specified object comes to the space environment (for example, his own home), and therefore, the user's participation in the interaction can be improved. Of course, implementing any of the products of the present application does not necessarily require all of the advantages described above to be achieved at the same time.

The following will be combined with the drawings in the embodiments of the present application. The technical solutions in the embodiments of the present application are clear, Completely described, Obviously, The described embodiments are only a part of the embodiments of the present application. Rather than all embodiments. Based on the embodiments in the present application, All other embodiments obtained by those of ordinary skill in the art, All are within the scope of this application.  In the embodiment of the present application, Provides a new multi-screen interactive solution. In this scenario, It is mainly an interaction between a mobile terminal device (referred to as a first terminal in the embodiment of the present application) such as a user's mobile phone and a terminal device (referred to as a second terminal in the present application embodiment) having a large screen such as a television. specific, Some programs such as large-scale live-party evenings can be used through the second terminal (of course, Can also be other types of programs) during playback, Conduct the above interaction process. E.g, In the live show, The program organizers will invite some entertainment stars and other performances. but, In the prior art, The user can only watch the performance of the star on the stage from the second terminal. In the embodiment of the present application, You can use some technical means, Enable users to get the "star to my home" experience. When it is implemented, Materials related to performances such as specific entertainment stars can be provided in advance. In the performance link of the character in the second terminal, Passing augmented reality in the first terminal, a pre-recorded performance video of the character, Materials such as animations are projected into the real environment where the user is located. E.g, The user usually watches the program in the second terminal such as TV at home. therefore, It is possible to project specific character performance videos/animations and the like into the user's home. such, Although the user still needs to see the specific projection result through the screen of the second terminal, but, Since the background of the performance is a real-life image captured in the user's environment, therefore, Relative to the performance on the stage viewed from the first terminal, It is possible to make the user get the experience that the "star" is really in his home. of course, In the specific implementation, In addition to the designated person, It can also be an animal, It can even be a commodity, and many more, In the embodiment of the present application, Unified is called "specified object."  When it is implemented, From a system architecture perspective, See Figure 1, The hardware device involved in the embodiment of the present application may include the foregoing first terminal and the second terminal. The software involved may be an associated application client installed in the first terminal (or, It can also be a program that is solidified in the first terminal, etc.) And the first server in the cloud. E.g, Assume that the above interaction is provided during the "Double 11" party. Because the organizer of the "Double 11" party is usually an online sales platform (for example, "Mobile Taobao", "Tmall", etc., the company, therefore, The application client and server provided by the online sales platform can be accessed. Provide technical support for the above multi-screen interaction. That is, Users can use "Mobile Taobao", Clients of applications such as "Tmall" come to the specific interaction process, And the materials used in the interaction process, etc. It can be provided by the server. It should be noted, The second terminal mainly exists as a playback terminal. The content such as the video played therein may be controlled by the second server of the back end (the server of the television station, etc.). That is, Regarding signals such as live video streams, A unified video signal transmission operation, etc., can be performed by the second server. after that, The video signal is transmitted to each of the second terminals for playback. That is, In the multi-screen interactive scenario provided by the embodiment of the present application, The first terminal corresponds to the second terminal and is a different server.  The specific implementation scheme is described in detail below.  Embodiment 1 First, In the first embodiment, from the perspective of the client, Provides a multi-screen interaction method, See Figure 2, The method may specifically include:  S201: The first terminal loads the interactive material, The interactive material includes a specified object material created according to the specified object;   among them, About interactive materials, that is, in the process of interacting with augmented reality, The material needed to generate information content such as virtual images. When it is implemented, The specified object may specifically be information related to the specified person. Or specify information about the product, Or, It can also be information related to items related to offline games. and many more. among them, Different specified objects can correspond to different interactive scenarios. E.g, When the specified object is the specified person, The specific scene can be a "star to your home" event. That is, E.g, During the process of watching TV programs on TV, etc. Through the program, The "stars" that participate in the performance in the program can be "traversed" to the user's home. And when the specified object is the specified item, The product may generally be a product related to a physical product sold in an online sales system, or the like. usually, Users need to pay more resources to purchase the item. but, During the event, Can be given by gift or ultra-low-cost sales, etc. Give it as a gift to the user. In the process of giving gifts, The "cross-screen gift" can be implemented in the manner of the embodiment of the present application. specific, By playing content related to a specified item in a second terminal such as a television, And "traversing" to the first terminal such as the user's mobile phone, In addition, an operation option for snapping up the data object associated with the specified item may also be provided. When receiving a snap-in operation through this operation option, Submit to the server, The panning result is determined by the server. therefore, Allow users to get the opportunity to snap up or draw, And then get the corresponding goods, or, Get the opportunity to buy the corresponding item at an ultra-low price, and many more.  In addition, When the specified object is an item related to the offline game, Another form of "cross-screen gift" can be used. That is, During the event, If the system wants to provide some coupons for users, Non-physical gifts such as "cash red envelopes", You can then send the gift, Associated with games such as offline magic. E.g, In the process of playing a program such as magic on a second terminal such as a TV, Some props may be used during the period. The solution of the embodiment of the present application is The item can be "traversed" to be displayed in the first terminal device such as the user's mobile phone. and then, The user can click on the item, etc. Carry out the collection of non-physical gifts. That is, Receiving information on the operation of the target item, Submit the operation information to the server, Determining, by the server, the reward information obtained by the operation and returning the information. then, The first terminal can provide the reward information obtained. and many more.  The specified object material may specifically include a video material obtained by shooting the specified object, E.g, If the specified object specifically refers to the specified person, You can sing in advance to the designated person’s performance, Video recording, such as dancing, Get the video clip. or, In another way, The specified object material may also include: a cartoon image made with the image of the specified object as a prototype, And animation material based on the cartoon image and so on. E.g, In the case where the specified object is the specified person, You can create a cartoon character based on the image of the designated person. And based on the cartoon character image to create animation material, Including dancing animations with cartoon characters, Singing animation, etc. among them, If you need to "sing", etc. The character can be dubbed by the designated character. or, Play the pre-recorded song of the specified character, and many more.   among them, For the same specified object, Can correspond to multiple sets of different specified object materials, E.g, For the same designated person, Different shows of the show, You can generate different character materials separately. and many more. That is, The material corresponding to the same specified object can be multiple sets. Specifically, when the specified object enters a user's "home", The specific material can be selected by the user. then, Provide specific augmented reality images with selected footage.  In addition, The interactive material provided by the first server may also include: Material used to represent the transfer channel. E.g, Specifically through the door, tunnel, Wormhole, Mascots such as "Tmall", The material is generated by transmitting a light array or the like. This material used to represent the transfer channel can be used to: Before specifically adding the specified object material to the live image, Since the designated object was originally performed on the stage of the party scene, But then it will come to the user’s home, therefore, To enhance the fun, It also makes the position change of the specified object more reasonable. You can also first pass the material used to represent the transfer channel. Play preset animations, Create an atmosphere where a designated object will “traverse” into its home through this transmission channel. Make users get a better experience. In addition, After the interaction is over, When the specified object needs to leave home, It is also possible to provide an animation of the opposite process to the home when the material used to represent the transmission channel is provided. Causing the user to get the specified object to leave the house, The experience of gradually closing the transfer channel.  Furthermore, The interactive material provided by the first server may further include a voice sample material recorded by the specified object. This voice sample material can be used to greet the user to indicate a greeting when the specified object "enters" into the user's home. and, You can also get the user's user name (including the name, before the specific greeting). Real name, etc.), etc. Achieve the greetings of “Thousands of People” E.g, "XXX, I am coming to your house," among them, For different users, The specific content of "XXX" is different. The above greeting will be greeted by the specified object by voice. In order to achieve the above-mentioned purpose of "thousands of thousands of people", It cannot be achieved directly by pre-recording a greeting voice. to this end, In the embodiment of the present application, A specific text can be read in advance by a specified object (specifically, corresponding to a designated person). And recording the voice of each text read aloud, Most of the initials will be included in this text. The pronunciation of the finals and tones. When it is implemented, The above specific text can usually be about a thousand or so. It can basically cover 90% of Chinese pronunciation. such, When the specified object just "enters" the user's home, After generating a specific greeting based on the user’s distinguished name, It is possible to transmit the pronunciation information of each Chinese character saved in the voice sample material. Send the corresponding voice, In order to achieve the effect of shouting the user name and greetings by the specified object.   of course, In practical applications, Can also include other materials, It is not listed here one by one. When it is implemented, The amount of information on the above interactive material may be large. The process of loading the interactive material by the first terminal may take a long time. therefore, It can be downloaded to the first terminal locally in advance. E.g, After the party played in the second terminal starts, The user can access the main venue interface of the party through the first terminal. While watching the program in the second terminal, Be prepared to interact through the main venue interface. The specific "star to your home" link may be at some point during the evening. Synchronized with the state of the second terminal, therefore, As long as after the party starts, The user enters the main conference site interface of the first terminal. Even if the specific "star to your home" event has not been officially launched, It is also possible to perform related interactive material downloading operations in advance. such, After the specific event begins, You can quickly move to the interactive process. Avoid situations where the active material has not been downloaded successfully and cannot participate in the event in time. of course, For users who do not enter the main site interface provided by the first terminal in advance, If you need to participate in the above "Star to your home" event, You can also temporarily download related interactive material. among them, For the case of temporary downloads, To avoid taking too long to download, A downgrade scheme can be provided. E.g, You can download only the specific object material mentioned above. The material used to express the transmission channel and the voice sample material can be downloaded no longer. at this time, Users don’t realize the feeling of “crossing”. The greeting of the specified object is also not received.  S202: Collecting real-life images;  When it is implemented, The first terminal can provide a corresponding activity page for activities such as "star to your home". An action option for making an interactive request can be provided on this page. E.g, As shown in Figure 3-1, It is a schematic diagram showing the activity page in an example. It can provide information such as related specified objects. You can also provide buttons such as "Start Now". The button can be an operation option for the user to make an interactive request. Users can make specific interaction requests by clicking on the "Start Now" button. of course, In practical applications, There are other ways to receive user interaction requests. E.g, A QR code can be displayed on the second terminal screen. The user sends a request by scanning the two-dimensional code through the first terminal, and many more.  When it is implemented, Operation options such as the "start now" button can be inoperable until the formal interaction process begins. Avoid user premature clicks. In addition, The copying aspect displayed on the operation options can also be different. E.g, In an inoperable state, Can be displayed as "exciting to open immediately", and many more. Before the interaction is about to begin, Then change the copy displayed on the button to the state of "start now". and, In order to create a nervous, Anxiously waiting for the atmosphere, At the same time, it is more attractive to users to perform click operations. You can also display the "breathing" effect on the display. E.g, The button can shrink at a rate of 70%. After 3S, it will return to its original size. After 3S, it shrinks again. And repeat this rhythm, and many more.   among them, The point in time at which the user interaction request is received may be earlier than the point in time when the specified object officially disappears from the second terminal and "enters the user's home". Really because After the user makes an interaction request, The client can also perform some preparatory work in advance. specific, After receiving the user’s interaction request, The live image acquisition in the first terminal can be first turned on, That is, The camera component on the first terminal can be activated. Then enter the state of live shooting, Prepare for subsequent augmented reality-based interactions.  When it is implemented, Before specifically launching the collection of real-life images, It is also possible to first determine whether the interactive material is already loaded locally in the first terminal. If not already loaded, Then you can first load the interactive material.   It should be noted, In the embodiment of the present application, The virtual image presented to the user through the augmented reality is related to the specified object material, In order to make the process of interaction more authentic, It is possible to make the specified object material appear on a plane in the real image. E.g, Can be the ground, The plane of the table, and many more, such, If the specified object is a specified person, Then, the performance process of the designated character can be performed on a plane. And if no special treatment is done, After the specified object material is added to the live image, It may happen that the specified object material is "floating" in midair. If the corresponding specified object material is the dance of the specified character, Singing and other performances, Will make the designated character "floating" in midair, This will reduce the user experience, Can't give users a more realistic immersive immersion.   to this end, In a preferred embodiment of the present application, It is also possible to display the specified object material to a plane included in the live image. When it is implemented, The plane recognition can be performed from the real image by the first terminal. then, Adding the specified object material to the plane in the real image, Avoid the phenomenon of “floating” in the air. at this time, Regarding where the specified object material appears, Can be arbitrarily determined by the first terminal, Just sit on a flat surface. or, In another implementation, Can go one step further, The user selects the location of the specific specified object material. specific, After launching the live image detection, The client can first perform plane detection from it. After detecting a plane, As shown in Figure 3-2, Can draw a range, And provide a movable cursor. You can also prompt the user to place the cursor in the drawn dropable range in the interface. After the user moves the cursor to the droppable range, The color of the cursor can change. To indicate that the user's placement location is available. at this time, The client can record where the cursor is actually placed. When it is implemented, In order to record the location information where the cursor is placed, There are many ways, E.g, In one way, The position where the first terminal is located at a certain moment can be used as the initial position (for example, It is possible to set the position of the first terminal as the initial position when the cursor is placed. and many more), And creating a coordinate system with the initial position (which may be the geometric center point of the first terminal, etc.) as a coordinate origin. then, After the cursor is placed in a specific dropable range, You can record the position of the cursor relative to the coordinate system. such, Subsequent when the specified object material is added to the live image, It can be added based on this position.  In addition, as described above, In an alternative embodiment, Before the specified object material is officially "entered" into the live image, You can also add the material used to represent the transfer channel to the live image. In the above manner, After the user completes the cursor placement, It is also possible to present a specific material for expressing the transmission channel at the position where the cursor is located. E.g, Assume that the "portal" material is used as the transmission channel. When it is implemented, As shown in Figure 3-3, After the user completes the placement of the cursor, You can prompt the user to "confirm the plane, Click to place the portal" and many more, After the user clicks on the cursor, It is possible to present a "portal" material at the corresponding location.  Subsequent specifics at the beginning to add the specified object material to the live image, The cursor can disappear, and, It can also animate based on the channel material. An animation process for displaying that a specified object enters the captured live image through the transmission channel. E.g, As shown in Figures 3-4 and 3-5, It shows the two states in the above animation process, As can be seen, It presents the effect that someone will "enter" the user's home through the portal. After the specified object material enters the live image, The material for indicating the transfer channel disappears. At the end of the interaction, Then the material used to represent the transmission channel can be re-displayed. And providing an animation process for displaying a specified object to leave through the transmission channel, After leaving completely, The material for indicating the transfer channel disappears.  S203: When the video in the second terminal plays to a target event related to the specified object, Adding the specified object material to the live image.  When it is implemented, The point in time at which the interaction begins may be related to the target event corresponding to the specified object broadcasted in the second terminal. among them, The so-called target event may specifically refer to an event such as the start of an interactive activity related to a specified object. E.g, In the program played by the second terminal, When it comes to the "star to your home" link, You can place a "portal" on the stage (can be physical, Or it can be virtual by projection, etc. An event in which a specified object is passed out from a "portal" on the stage can be used as the target event. at this time, This point in time also becomes the starting point of the interaction. corresponding, The first terminal can perform specific processing of adding specific object material to the live image for display.   among them, Since the programs in the second terminal are usually live broadcast, therefore, Unable to follow the method of setting the time in the first terminal in advance, To maintain synchronization with the point in time at which the second terminal has a target event. And because the second terminal plays usually a TV signal, Although the time point of the TV signal transmission is the same, but, For users in different geographic locations, The point in time at which the signal arrives at the user may vary. That is, The same is the event that the specified object is worn out from the "gateway" on the stage. Users in Beijing may be at 21: 00: 00 sees the occurrence of the event from the second terminal, The users in Guangzhou may be at 21: 00: I saw it at 02 o’clock. and many more. therefore, Even if the staff at the first server saw the event at the party’s scene, Sending a notification message about the target event to each first terminal uniformly, There may also be situations in which users in different regions actually experience different results. Some users may feel that the traversing process of the specified object and the event on the second terminal can be seamlessly connected. And some users may not feel it. It may happen that the specified object in the TV program has not been worn out from the portal. However, it has entered the medium-sized situation in the mobile phone.   to this end, In the embodiment of the present application, Since the user is usually watching TV, While interacting with mobile terminals such as mobile phones, therefore, The first terminal and the second terminal are usually located in the same space environment. And the distance between the two is not too far. In this case, The sensing of the target event in the second terminal by the first terminal may also be implemented in the following manner: The television program producer may at the time of occurrence of the target event, A sound wave signal of a preset frequency is added to the video signal to be transmitted. such, As the specific video signal is sent to the user's second terminal, The sound wave signal will also be delivered. and, The frequency of the acoustic signal can be outside the human hearing range. That is, The user does not perceive the presence of the acoustic signal. but, The first terminal can sense the sound wave signal, and then, The first terminal can use the sound wave signal as a sign of occurrence of the target event. Then perform the subsequent interaction process. In this way, The occurrence flag of the target event can be carried in a specific video signal. And communicating to the first terminal through the second terminal, therefore, The event that the user sees on the second terminal can be guaranteed. Better able to seamlessly interface with images seen in the first terminal, To get a better experience.   among them, Regarding the acoustic signal, The specific frequency information may be determined by the first server. And provided by the first server to the second server. In the process of transmitting the video signal by the second server, If it is found that the target event related to the specified object is occurring, The sound wave signal can be inserted at a position corresponding to the video signal. on the other hand, The first server can also inform the first terminal of the frequency information of the sound wave signal in some manner. such, The sound signal can be established between the first terminal and the second terminal. It should be noted, In the specific implementation, In the same party, There may be multiple "stars to your home" links. Corresponding to different specified objects, therefore, It is also possible to provide acoustic signals of different frequencies for different designated objects, respectively. The first server may provide a correspondence between the specified object and the sound wave frequency to the second server. When the second server adds an acoustic signal, It can be added according to the corresponding relationship provided by the first server; and, The correspondence is also provided to the first terminal. The first terminal may be different according to the frequency of the detected sound wave signal. Determine which specific object corresponds to the current event.  After the specific interaction, as described above, It is possible to use the animation based on the transmission channel as a sign of the beginning of the interaction. after that, You can add the specified object material to the live image. If the user has specified a location, It can be added to the corresponding position in the live image. If the specified object material is added, The user has moved the location of the first terminal device, That is, it has changed relative to the initial position, So that after the material is added, It did not appear in the display of the first terminal. For this situation, Since the coordinate system was previously created based on the initial position of the mobile terminal device (the position does not change once determined), therefore, It can also be based on SLAM (Concurrent Mapping and Localization, Technology such as instant positioning and map construction), Determining the coordinates of the position of the first terminal after moving in the coordinate system, That is, determine where the first terminal has moved, And determining, in what direction the first terminal is moved relative to the initial position, In turn, the user can be guided to move the first terminal in the opposite direction. So that the added material can appear in the picture of the first terminal. As shown in Figure 3-6, The user can be guided to move the first terminal through an "arrow".   as described above, There may be multiple sets of material corresponding to the same specified object. E.g, Including dancing material, Singing materials, etc. Specifically before adding the specified object material to the live image. It also gives users the option to select specific materials. The user can make a selection. In the process of user selection, You can also play a fixed video, etc. E.g, The content of this fixed video can be a box. And keep beating, Used to express the preparation work of the designated object being changed. and many more. After the user selects a specific material, You can add the selected material to the live image for display. E.g, As shown in Figure 3-7, It is a specific example, Showing one of the images in the specified material presentation process, among them, Part of the image about the character is a virtual image, The background behind the character is the real-life image captured by the user through the first terminal.   among them, Since the interactive material may also include a voice sample material recorded by the specified object, therefore, After adding the specified object material, A user name information of the associated user of the first terminal may also be obtained. And generating the user-specific greeting corpus for the associated user, This includes the user name. and then, The greeting is expected to be converted into speech and played according to the voice sample material. corresponding, In the specified object material, There may also be an action when the specified object greets the user, Expressions, etc. Make the user feel that the designated person is actually greeting himself. among them, Regarding the user name, Can be based on the account that the current user is logged into, Determine the corresponding user's name, Or you can also use the real-name authentication information provided by the user in advance. Get the user’s real name, and many more, Through the above methods, "Thousands of People" can be realized for different users. of course, If you can’t get the secret of some users, Real name, etc. Can also be based on the gender of the user, Age, etc. Generate a relatively generic name for the user, and many more.  In addition, Specifically after adding the specified object material to the live image, Shooting options are also available. When an operation request is received through the operation option, A corresponding image (photo or video, etc.) can be generated by performing screen capture or screen recording on each image layer. In this way, Can take a photo with the specified object, and many more. That is, When shooting images such as photos or videos, The live view image may further include a live view image of the person who needs to take a photo with the specified object. E.g, In the process of a user’s specific interaction, Because it is usually interactive at home, There may be other people around, If someone else wants to take a photo with the specified object, Then, it can enter the real image capturing area of the first terminal, Enabling the first terminal to capture his/her real-life image, after that, The user operates the operation option, A specific photographing operation can be realized. When it is implemented, You can also use depth of field information. Distinguishing the positional relationship between the person in the real image and the specified object in the virtual image, To further enhance the realism.   among them, Since the interface also includes some buttons and other operation options, therefore, When taking a screen shot or recording screen, You can also remove the image layer that is used to display the action options. Screen capture or screen recording operation only for the real image layer and the image layer where the video/animation is located. To improve the realism of the generated photo or video.  When it is implemented, The ability to take photos and videos can be provided through the same operating option. And through different ways of operation to distinguish the user's specific intentions. E.g, Corresponding to taking a photo function when clicking on the operation option, The corresponding shooting video function is performed when the operation option is long pressed. and many more. That is, If the user just clicks on the above action option, You can trigger a screen capture operation. Generate a photo. If the user presses and holds the action option, Then trigger the recording operation, Until the user let go. In addition, When it is implemented, You can also limit the length of each recorded video. E.g, Each video does not exceed 10S. Then the user presses and holds the operation option for more than 10 seconds. Even if you still hold it down, Will also end the screen recording operation, Generate a video of up to 10S, and many more.  Furthermore, In the process of interaction, You can also provide options for sharing photos or videos you take. E.g, This action option can be located on the side of the above operating options for taking photos or videos. And can display tips, E.g: "Click to share a great moment," and many more. After the user clicks, Can provide a shared portal for multiple social networking platforms. Users can choose which social network platform to share.  In addition, In the process of interaction, In addition to playing the video/animation corresponding to the specified object, Or take a photo with the specified object, Sharing and other operations, Other interactive options are also available for users. E.g, You can also provide options for participating in a charity event. If the user is willing to participate, You can click directly through this action option. or, It is also possible to participate in the corresponding public welfare activities through such channels. Associated with the completion of the charity event, The server collects such information on the number of people. And in real time, the director and other staff at the show site are available. Make the scenery of the program site, etc., change correspondingly with the completion progress of the public welfare activities. E.g, The scenery of the show scene gradually changed from desert to oasis. and many more.  After the interaction is over, The specified object material will not be displayed again. of course, The specified object may also appear in the screen of the second terminal again. therefore, In order to better show the user's "crossing" process, At this point, the material of the transfer channel can still be displayed. As shown in Figure 3-8, An animation process for displaying a person leaving through the transfer channel may also be provided. The transfer channel material itself can also appear to be gradually smaller. After leaving completely, The material for indicating the transfer channel also disappears from the screen.  After the interaction is over, Can exit the interface for real-time image acquisition, at this time, In an alternative implementation, A docking page for browsing and sharing each of the captured photos or videos can also be provided. That is, After the interaction is over, Can provide a receiving page, Used to guide the user to share the captured photos or videos. among them, Individual photos or videos can be sorted in this order in the order in which they were taken. E.g, As shown in Figure 3-9, Specifically, it can be displayed from left to right in order of time from near to far. and many more. In the process of presentation, The user clicks on any of the photos or videos. Can evoke the sharing component interface, As shown in Figure 3-10, Users can complete specific sharing operations through this component.  In short, Through the embodiment of the present application, Can load the specified object material, In the process of specific interaction, It is possible to collect real-life images of the actual environment in which the user is located. And when the target event corresponding to the specified object is broadcast in the second terminal, Add the specified object material to the live image for display. such, Enable users to get specific objects to their own space environment (for example, The experience of my own home, therefore, Can increase user engagement with interaction.  Embodiment 2 This embodiment 2 corresponds to the first embodiment, From the server's perspective, Provides a multi-screen interaction method, among them, See Figure 4, The method may specifically include:  S401: The first server saves the interactive material. The interactive material includes a specified object material created according to the specified object;  S402: Providing the interactive material to the first terminal, Collecting a real scene image by the first terminal, When the video in the second terminal plays to a target event corresponding to the specified object, Adding the specified object material to the live image.  When it is implemented, The specified object includes a designated person. of course, When it is implemented, Can also include animals, commodity, Props and more.  Specifically when providing interactive footage, A video material obtained by photographing the specified object may be provided. or, Providing a cartoon image based on the image of the specified object, And animated material based on the cartoon image.   specific, When the specified object is a designated person, It is also possible to provide a voice sample material recorded by the designated person.  When it is implemented, In order to make the first terminal more convenient to perceive the occurrence of the target event in the second terminal, The first server may further provide an acoustic signal of a preset frequency to the second server corresponding to the second terminal. When the video used in the second terminal is played to a target event corresponding to the specified object, Add to the video, So that the first terminal learns the occurrence of the target event by detecting an acoustic wave signal of the preset frequency.  When it is implemented, The server can also perform statistics on the interaction of each client. among them, The statistical information may also be provided to the second server corresponding to the second terminal. Adding, by the second server, the statistical information to the video played by the second terminal, For publishing the statistical results through the second terminal, or, Statistics can also be used to influence the setting of the party at the party. and many more.   among them, Since the second embodiment corresponds to the first embodiment, therefore, For a specific implementation, refer to the description in the foregoing Embodiment 1. I won't go into details here.  Embodiment 3 The third embodiment is from the perspective of the second terminal, Provides a multi-screen interaction method, See Figure 5, The method may specifically include:  S501: The second terminal plays the video;  S502: When the video plays to a target event related to the specified object, Playing the sound wave signal of the preset frequency, So that the first terminal knows the occurrence of the target event by detecting the sound wave signal. And add the specified object material to the captured real-life image.  When it is implemented, Different specified objects can correspond to sound waves of different frequencies.  Embodiment 4 The fourth embodiment is from the perspective of the second server corresponding to the second terminal, Provides a multi-screen interaction method, See Figure 6, The method may specifically include:  S601: The second server receives the sound wave signal information of the preset frequency provided by the first server;  S602: Inserting a sound wave signal of the preset frequency at a position where a target event related to a specified object occurs in the video, In order to play the video through the second terminal, Obtaining, by the first terminal, the occurrence of the target event by detecting the sound wave signal, And add the specified object material to the captured real-life image.  When it is implemented, The second server may further receive statistics about the interaction of the first terminal provided by the first server, Adding the statistical information to the video for transmission, For playing through the second terminal.  Embodiment 5 In the foregoing Embodiments 1 to 4, Realizing multi-screen interaction between the first terminal and the second terminal, In practical applications, Users can also watch videos such as live shows of the evening through the first terminal. under these circumstances, During the process of watching the video through the first terminal, You can also get the experience of "stars to my home." That is, Watch videos and interact with the same terminal.   specific, See Figure 7, The fifth embodiment provides a video interaction method. The method may specifically include:  S701: The first terminal loads the interactive material, The interactive material includes a specified object material created according to the specified object;  S702: When the video in the first terminal plays to a target event related to the specified object, Jump to the interactive interface;  S703: Displaying the live image acquisition result in the interactive interface, And adding the specified object material to the live image.  That is, During the process of watching the video through the first terminal, The video plays to the target event associated with the specified object. You can jump to the interactive interface. In the interactive interface, You can first collect real-life images. then, Adds the specified object material to the live image. such, The user also obtains the experience that the specified object "traverses" from the "evening scene" to the space environment in which it is located.  Regarding other specific implementations in the fifth embodiment, See the description in the foregoing embodiments, I won't go into details here.  Embodiment 6 This embodiment 6 corresponds to the fifth embodiment, Providing a video interaction method from the perspective of the first server, See Figure 8, The method may specifically include:  S801: The first server saves the interactive material. The interactive material includes a specified object material created according to the specified object;  S802: Providing the interactive material to the first terminal, When the video in the first terminal is played to a target event related to the specified object, Jump to the interactive interface, And displaying the real image acquisition result in the interactive interface, And adding the specified object material to the live image.  Embodiment 7 In the foregoing embodiments, The first terminal, such as a mobile phone, is used as an execution subject to provide specific interaction results. In practical applications, The program can also be extended to other scenarios. E.g, In addition to mobile phones, A wearable device such as smart glasses can also be used as the first terminal. In addition to interacting with the video played in the second terminal or the first terminal, It can also be a video played with a movie screen. Or live performances, show, Merchant promotions, In the process of sports events and other related events, Conduct a specific interactive process. to this end, This seventh embodiment provides another interactive method. See Figure 9, The method may specifically include:  S901: The first terminal loads the interactive material, The interactive material includes a specified object material created according to the specified object;  In the specific implementation, The application scenario in this embodiment may not be limited. therefore, Before providing a specific interactive interface, An interface for loading interactive footage is also available. In this interface, A variety of optional interactive materials are available. E.g, Materials related to the current movie being released by major theaters, With offline performances, Promotions, Events related to events such as competitions, and many more, Users can choose the material they need to download. In addition, In the specific implementation, Since some applications provide users with the ability to book online, Users can book tickets online. Not only can it include movie tickets, It can also include a variety of shows, Tickets related to the competition and so on. therefore, When providing interactive material, It can also be provided based on the user's specific booking information. E.g, When a user subscribes to a movie ticket through an online booking system, If there is just an interactive material related to the movie, You can prompt the user to download. and many more. It should be noted, In the embodiment of the present application, The downloaded interactive material can be saved locally on the terminal such as a mobile phone. or, It can also be downloaded to terminals such as wearable devices. To watch movies more conveniently, Interact in the process of performances.  In this embodiment, The specific specified object can also refer to the designated person, commodity, Props and more.  S902: Collecting real-life images;   usually, Wearable devices have devices such as cameras. therefore, Real-time image collection can be performed through wearable devices, etc. The user is watching the movie, During the performance, etc. Images actually seen through wearable devices such as glasses, It can be a real-life image captured by such glasses.  S903: When a target event related to the specified object is detected, Adding the specified object material to the live image.  The specific target event can be that the specified object appears in a specific movie, show, game, During promotions, etc. and many more. Specifically when detecting target events, There are many ways, E.g, One way, Can be made by movies, show, game, The exhibitor or organizer of the promotion, Insert some sonic information, etc. on specific event nodes. A wearable device or the like knows the occurrence of a specific event by detecting such a signal. or, In other implementations, It is also possible to directly know the occurrence of the target event by analyzing the collected real-life image. E.g, Specifically in the process of interacting with wearable devices, The real-life image captured by the wearable camera is usually the same as the real-life image actually viewed by the user. Or have overlapping parts, Then if the user sees a target event, Then the camera can actually collect information about the corresponding event. In addition, Wearable devices can also have sound collectors, etc. therefore, Through image analysis, Voice analysis and other methods to know the occurrence of specific target events, and many more.  Corresponding to the first embodiment, The embodiment of the present application further provides a multi-screen interactive device. specific, See Figure 10, The device is applied to the first terminal, include:  First material loading unit 1001, Used to load interactive footage, The interactive material includes a specified object material created according to the specified object;  First live image acquisition unit 1002, For collecting real-life images;  The first material adding unit 1003, For when a video in the second terminal is played to a target event related to the specified object, Adding the specified object material to the live image.   among them, The video played in the second terminal is a live video stream.  Receiving, by the first terminal, a sound wave signal of a preset frequency sent when the video is played, Determining the occurrence of the target event. among them, The sound wave signal may be emitted when a video in the second terminal is played to a target event corresponding to the specified object.   among them, The first material adding unit may specifically be used to:  The specified object material is added to a plane included in the live image for display.  When it is implemented, The device can also include:  Place the location determination unit, Before the adding the specified object material, Determining the placement position in the captured real-life image;  The first material adding unit may specifically be used to: Adding the specified object material to the placement location.   among them, The placement location determining unit may be specifically configured to:  Determining a plane position in the collected real-life image, The placement position is in the planar position.   specific, The placement location determining unit may specifically include:  Planar detection subunit, For performing plane detection in the collected real-life image;  The cursor provides a subunit, Used to provide a cursor, According to the detected plane, Determine the allowable range of the cursor;  Place the location determination subunit, A position for placing the cursor is placed as the placement position.   among them, The placement location determining subunit may specifically include:  The coordinate system establishes a subunit, Used to establish a coordinate system with the initial position where the first terminal is located;  Coordinate determination subunit, a cursor coordinate for determining a position at which the cursor is placed in the coordinate system;  Position determination subunit, Used to use the cursor coordinates as the placement position.   specific, The device may further include:  Change direction determining unit, For adding the specified object material to the placement location, When the material does not appear on the interface of the first terminal, Determining a direction of change of the first terminal relative to the initial position;  Prompt unit, Used to change direction according to the A prompt identifier in the opposite direction is provided in the interface of the first terminal.  When it is implemented, The interactive material may also include material for representing a transmission channel. The device can also include:  Channel material addition unit, For the step of collecting the live image, The material for representing the transfer channel is added to the live image.   among them, The first material adding unit may specifically be used to:  Based on the transfer channel material, A process of entering the specified object through the transfer channel into the captured live image.  In addition, The interactive material may further include a voice sample material recorded by the specified object;  The device may further include:  User name acquisition unit, User name information for obtaining the associated user of the first terminal;  Greeting corpus generation unit, Generating a greeting corpus including the user name for the associated user;  Play unit, For use according to the speech sample material, The greeting is expected to be converted to speech and played.   among them, The specified object material is a plurality of sets of materials corresponding to the same specified object, The device also includes:  The material selection option provides the unit, 哟 providing an operation option for selecting the specified object material;  The first material adding unit may be used to:  The selected specified object material to be selected is added to the live image.  In addition, The device can also include:  Shooting option providing unit, For displaying the specified object material in the live image for display, Provide shooting operation options;  Image generation unit, For receiving an operation request through the shooting operation option, According to each image layer, Generate the corresponding image, The image layer includes a real image, Specifies an image for the pixel material.   among them, The image generating unit may be specifically configured to:  Screen capture or screen recording for each image layer, And remove the image layer that is used to demonstrate the operation options. Generate a captured image.  When it is implemented, The live view image further includes a person image that is combined with the specified object.  In addition, It can also include:  Sharing options provide unit, Used to provide an operation option for sharing captured images.  Furthermore, Also includes:  Undertake page providing unit, Used to provide a docking page for browsing and sharing captured images.  When it is implemented, The specified object includes information specifying a person.  Or, The specified object includes information specifying the item.   specific, Also includes:  Snatch option offering unit, After the adding the specified object material to the live image, Providing an operation option for snapping up a data object associated with the specified item;  Submit unit, Used to receive a panic operation through this action option, Submit to the server, The panning result is determined by the server.  In addition, The specified object includes item information related to the offline game.   at this time, The device can also include:  Operation information submission unit, After the adding the specified object material to the live image, Receiving information on the operation of the target item, Submit the operation information to the server, Determining, by the server, the reward information obtained by the operation and returning the reward information;  Reward information providing unit, Used to provide the reward information obtained.   among them, The specified object material includes a video material obtained by photographing the specified object.  Or, The specified object material includes: a cartoon image made with the image of the specified object as a prototype, And animated material based on the cartoon image.  Corresponding to the second embodiment, The embodiment of the present application further provides a multi-screen interactive device. See Figure 11, The device is applied to the first server, include:  The first interactive material saving unit 1101, Used to save interactive footage, The interactive material includes a specified object material created according to the specified object;  a first interactive material providing unit 1102, Providing the interactive material to the first terminal, Collecting a real scene image by the first terminal, When the video in the second terminal plays to a target event corresponding to the specified object, Adding the specified object material to the live image.   among them, The specified object includes a designated person.   specific, The first interactive material storage unit may be specifically configured to: The video material obtained by shooting the specified object is saved.  Or, Preserving a cartoon image based on the image of the specified object, And animated material based on the cartoon image.   among them, The specified object includes a designated person, The first interactive material saving unit can also be used to:  The voice sample material recorded by the specified person is saved.  In addition, The device can also include:  Acoustic signal information providing unit, Providing, to the second server corresponding to the second terminal, a sound wave signal of a preset frequency, When the video used in the second terminal is played to a target event corresponding to the specified object, Add to the video, So that the first terminal learns the occurrence of the target event by detecting an acoustic wave signal of the preset frequency.  In addition, It can also include:  Statistical unit, Used to perform statistics on the interaction of each first terminal;  Statistical information providing unit, Providing the statistical information to the second server corresponding to the second terminal, The statistical information is added by the second server to the video played by the second terminal.  Corresponding to the three phases of the embodiment, The embodiment of the present application further provides a multi-screen interactive device. See Figure 12, The device is applied to the second terminal, include:  Video playback unit 1201, Used to play video;  Acoustic signal playing unit 1202, For playing the video to a target event related to the specified object, Playing the sound wave signal of the preset frequency, So that the first terminal knows the occurrence of the target event by detecting the sound wave signal. And add the specified object material to the captured real-life image.   among them, Different specified objects correspond to acoustic signals of different frequencies.  Corresponding to the fourth embodiment, The embodiment of the present application further provides a multi-screen interactive device. See Figure 13, The device is applied to the second server, include:  Acoustic signal information receiving unit 1301, Acoustic signal information for receiving a preset frequency provided by the first server;  Acoustic signal information insertion unit 1302, Inserting a sound wave signal of the preset frequency at a position where a target event related to a specified object occurs in the video, In order to play the video through the second terminal, Obtaining, by the first terminal, the occurrence of the target event by detecting the sound wave signal, And add the specified object material to the captured real-life image.   among them, The device can also include:  Statistical information receiving unit, And receiving statistical information about the interaction of the first terminal provided by the first server;  Statistical information playback unit, Used to add the statistical information to the video for transmission, For playing through the second terminal.  Corresponding to the fifth embodiment, The embodiment of the present application further provides a video interaction device. See Figure 14, The device is applied to the first terminal, include:  Loading unit 1401, Used to load interactive footage, The interactive material includes a specified object material created according to the specified object;  Interface jump unit 1402, For when a video in the first terminal is played to a target event related to the specified object, Jump to the interactive interface;  Material adding unit 1403, For displaying real-time image acquisition results in the interactive interface, And adding the specified object material to the live image.  Corresponding to the sixth embodiment, The embodiment of the present application further provides a video interaction device. See Figure 15, The device is applied to the first server, include:  Second material saving unit 1501, Used to save interactive footage, The interactive material includes a specified object material created according to the specified object;  a second material providing unit 1502, Providing the interactive material to the first terminal, When the video in the first terminal is played to a target event related to the specified object, Jump to the interactive interface, And displaying the real image acquisition result in the interactive interface, And adding the specified object material to the live image.  Corresponding to the seventh embodiment, An embodiment of the present application further provides an interactive device. See Figure 16, The device can include:  a second material loading unit 1601, Used to load interactive footage, The interactive material includes a specified object material created according to the specified object;  a second real image acquisition unit 1602, For collecting real-life images;  a second material adding unit 1603, For detecting a target event related to the specified object, Adding the specified object material to the live image.  In addition, An embodiment of the present application further provides an electronic device. include:  One or more processors; And a storage associated with the one or more processors, The storage is for storing program instructions, The program instructions, when being read and executed by the one or more processors, Do the following:  Load interactive footage, The interactive material includes a specified object material created according to the specified object;  Collecting real-life images;  When the video in the second terminal plays to a target event related to the specified object, Adding the specified object material to the live image.   among them, Figure 17 exemplarily shows the architecture of an electronic device, E.g, Device 1700 can be a mobile phone, computer, Digital broadcast terminal, Messaging device, Game console, Tablet device, Medical equipment, Fitness equipment, Personal digital assistant, Aircraft, etc.  Referring to Figure 17, Device 1700 can include one or more of the following components: Processing component 1702, Storage 1704, Power component 1706, Multimedia component 1708, Audio component 1710, Input/Output (I/O) interface 1712, Sensor assembly 1714, And a communication component 1716.  Processing component 1702 typically controls the overall operation of device 1700, Such as with display, Telephone call, Data communication, The operations associated with camera operations and recording operations. Processing component 1702 can include one or more processors 1720 to execute instructions, In the video playing method provided by the technical solution provided by the disclosure, when the preset condition is met, Generate a traffic compression request, And send it to the server, The traffic compression request records information for triggering the server to acquire the target attention area, The traffic compression request is used to request the server to preferentially guarantee the code rate of the video content in the target attention area; Playing the video content corresponding to the code stream file according to the code stream file returned by the server, The code stream file is a step of all or part of a video file obtained by the server performing rate conversion processing on the video content outside the target attention area according to the traffic compression request. In addition, Processing component 1702 can include one or more modules. It is convenient to handle the interaction between component 1702 and other components. E.g, Processing component 1702 can include a multimedia module, To facilitate interaction between the multimedia component 1708 and the processing component 1702.  The storage 1704 is configured to store various types of material to support operation at the device 1700. Examples of such materials include instructions for any application or method operating on device 1700, Contact information, Phone book information, News, image, Video, etc. The storage 1704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof. Such as static random access memory (SRAM), Electrically erasable programmable read-only memory (EEPROM), Erasable programmable read-only memory (EPROM), Programmable Read Only Memory (PROM), Read only memory (ROM), Magnetic storage, Flash memory, Disk or disc.  Power component 1706 provides power to various components of device 1700. The power component 1706 can include a power management system, One or more power supplies, And others are generated for device 1700, Manage and distribute the components associated with power.  The multimedia component 1708 includes a screen between the device 1700 and the user that provides an output interface. In some embodiments, The screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, The screen can be implemented as a touch screen. To receive input signals from the user. The touch panel includes one or more touch sensors to sense the touch, Sliding and gestures on the touch panel. The touch sensor can sense not only the boundary of a touch or a sliding motion, It also detects the duration and pressure associated with the touch or slide operation. In some embodiments, The multimedia component 1708 includes a front camera and/or a rear camera. When the device 1700 is in the operating mode, When in shooting mode or video mode, The front camera and/or rear camera can receive external multimedia material. Each front and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.  The audio component 1710 is configured to output and/or input acoustic signals. E.g, The audio component 1710 includes a microphone (MIC), When the device 1700 is in the operating mode, Such as call mode, When recording mode and voice recognition mode, The microphone is configured to receive an external acoustic signal. The received acoustic signals may be further stored in the storage 1704 or transmitted via the communication component 1716. In some embodiments, The audio component 1710 also includes a speaker. Used to output sound wave signals.  The I/O interface 1712 provides an interface between the processing component 1702 and the peripheral interface module. The peripheral interface module may be a keyboard. Click on the wheel, Buttons, etc. These buttons can include but are not limited to: Home button, Volume button, Start button and lock button.  Sensor assembly 1714 includes one or more sensors, Used to provide device 1700 with a status assessment of various aspects. E.g, The sensor component 1714 can detect an open/closed state of the device 1700. Relative positioning of components, For example, the component is a display and a keypad of device 1700. Sensor component 1714 can also detect a change in position of one component of device 1700 or device 1700, The presence or absence of contact of the user with the device 1700, Device 1700 orientation or acceleration/deceleration and temperature change of device 1700. Sensor assembly 1714 can include a proximity sensor, It is configured to detect the presence of nearby merchandise without any physical contact. The sensor assembly 1714 can also include a light sensor, Such as CMOS or CCD image sensors, Used in imaging applications. In some embodiments, The sensor component 1714 can also include an acceleration sensor, Gyro sensor, Magnetic sensor, Pressure sensor or temperature sensor.  Communication component 1716 is configured to facilitate wired or wireless communication between device 1700 and other devices. The device 1700 can access a wireless network based on a communication standard. Like WiFi, 2G or 3G, Or a combination of them. In an exemplary embodiment, The communication section 1716 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, The communication component 1716 also includes a near field communication (NFC) module. To promote short-range communication. E.g, The NFC module can be based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies to achieve.  In an exemplary embodiment, Device 1700 can be implemented by one or more application specific integrated circuits (ASICs), Digital signal processor (DSP), Digital signal processing equipment (DSPD), Programmable logic device (PLD), Field Programmable Gate Array (FPGA), Controller, Microcontroller, Implemented by a microprocessor or other electronic component, Used to perform the above method.  In an exemplary embodiment, There is also provided a non-transitory computer readable storage medium comprising instructions, For example, a storage 1704 including instructions, The above instructions may be executed by the processor 1720 of the device 1700 to complete the preset conditions in the video playing method provided by the technical solution of the present disclosure. Generate a traffic compression request, And send it to the server, The traffic compression request records information for triggering the server to acquire the target attention area, The traffic compression request is used to request the server to preferentially guarantee the code rate of the video content in the target attention area; Playing the video content corresponding to the code stream file according to the code stream file returned by the server, The code stream file is a video file obtained by the server performing rate conversion processing on the video content outside the target attention area according to the traffic compression request. E.g, The non-transitory computer readable storage medium may be a ROM, Random access memory (RAM), CD-ROM, magnetic tape, Soft disk and optical data storage devices, etc.  As can be seen from the description of the above embodiments, It will be apparent to those skilled in the art that the present application can be implemented by means of a software plus a necessary universal hardware platform. Based on this understanding, The technical solution of the present application, which is essential or contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a storage medium. Such as ROM/RAM, Disk, CD, etc. Including a number of instructions to make a computer device (which may be a personal computer, server, Or a network device or the like) performs the methods described in various embodiments or portions of the embodiments of the present application.  Each embodiment in this specification is described in a progressive manner. The same similar parts between the various embodiments can be referred to each other. Each embodiment focuses on differences from other embodiments. especially, For a system or system embodiment, Since it is basically similar to the method embodiment, So the description is relatively simple, For related points, refer to the partial description of the method embodiment. The system and system embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated. The component displayed as a unit may or may not be a physical unit. That can be located in one place, Or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art, without creative efforts, That is, it can be understood and implemented.  The multi-screen interaction method provided by the above application, Devices and electronic equipment, Introduced in detail, The principle and implementation of the present application are described in the following by using specific examples. The description of the above embodiments is only for helping to understand the method of the present application and its core ideas; Simultaneously, For those of ordinary skill in the art, According to the idea of the application, There will be changes in the specific implementation and application scope. In summary, The contents of this specification are not to be construed as limiting the application.

1001‧‧‧First material loading unit

1002‧‧‧First live image acquisition unit

1003‧‧‧First material addition unit

1101‧‧‧First interactive material storage unit

1102‧‧‧First interactive material supply unit

1201‧‧‧Video playback unit

1202‧‧‧Sonic signal playback unit

1301‧‧‧Sonic signal receiving unit

1302‧‧‧Sonic signal information insertion slip

1401‧‧‧Loading unit

1402‧‧‧Interface jump unit

1403‧‧‧Material Addition Unit

1501‧‧‧Second material storage unit

1502‧‧‧Second material supply unit

1601‧‧‧Second material loading unit

1602‧‧‧Second real image acquisition unit

1603‧‧‧Second material addition unit

1700‧‧‧ Equipment

1702‧‧‧Processing components

1704‧‧‧Storage

1706‧‧‧Power components

1708‧‧‧Multimedia components

1710‧‧‧Audio components

1712‧‧‧Input/Output (I/O) interface

1714‧‧‧ Sensor components

1716‧‧‧Communication components

1720‧‧‧ processor

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments will be briefly described below. Obviously, the drawings in the following description are only some implementations of the present application. For example, other drawings may be obtained from those of ordinary skill in the art in light of the inventive work. 1 is a schematic diagram of a system provided by an embodiment of the present application; FIG. 2 is a flowchart of a first method provided by an embodiment of the present application; and FIGS. 3-1 to 3-10 are schematic diagrams of a user interface provided by an embodiment of the present application; 4 is a flowchart of a second method provided by an embodiment of the present application; FIG. 5 is a flowchart of a third method provided by an embodiment of the present application; FIG. 6 is a flowchart of a fourth method provided by an embodiment of the present application; The flowchart of the fifth method provided by the embodiment of the present application; FIG. 8 is a flowchart of the sixth method provided by the embodiment of the present application; FIG. 9 is a flowchart of the seventh method provided by the embodiment of the present application; FIG. 11 is a schematic diagram of a second device according to an embodiment of the present application; FIG. 12 is a schematic diagram of a third device provided by an embodiment of the present application; FIG. 14 is a schematic diagram of a fifth device provided by an embodiment of the present application; FIG. 15 is a schematic diagram of an embodiment of the present application; A schematic view of a sixth apparatus; FIG. 16 is a schematic view of a seventh embodiment of the device provided in this embodiment of the application; FIG. 17 is a schematic view of an electronic device provided by the embodiment of the present application.

Claims (48)

A multi-screen interaction method, comprising: loading, by a first terminal, an interactive material, the interactive material comprising a specified object material created according to the specified object; acquiring a real-life image; and playing the video in the second terminal to the specified object The specified object material is added to the live image when the related target event is associated. The method of claim 1, wherein the video played in the second terminal is a live video stream. The method of claim 1, wherein the first terminal receives a sound wave signal of a preset frequency emitted during the video playback to determine the occurrence of the target event. The method of claim 1, wherein the sound wave signal is emitted when a video in the second terminal is played to a target event corresponding to the specified object. The method of claim 1, wherein the adding the specified object material to the live image comprises: adding the specified object material to a plane included in the live image for display. The method of claim 5, wherein the adding the specified object material further comprises: determining a placement position in the collected real-life image; adding the specified object material to the real image The image includes: adding the specified object material to the placement location. The method of claim 5, wherein the determining the placement position in the collected real-life image comprises: determining a plane position in the collected real-life image, the plane position at which the placement position is located in. The method of claim 7, wherein the determining a plane position in the collected real-life image, the plane position in which the placement position is located, comprises: performing in the collected real-life image Plane detection; providing a cursor to determine the position of the cursor according to the detected plane; the position where the cursor is placed is taken as the placement position. The method of claim 8, wherein the position at which the cursor is placed is the placement position, comprising: establishing a coordinate system with an initial position where the first terminal is located; determining that the cursor is placed The cursor coordinates in the coordinate system; the cursor coordinates are taken as the placement position. The method of claim 6, wherein the method further comprises: determining the first terminal after the specified object material is added to the placement location, when the material does not appear on the interface of the first terminal a direction of change with respect to the initial position; according to the direction of change, a prompt indication of the opposite direction is provided in the interface of the first terminal. The method of claim 1, wherein the interactive material further comprises material for indicating a transfer channel, and after the step of acquiring the live image, the method further comprises: adding the material for indicating the transfer channel to In the real image. The method of claim 11, further comprising: adding the specified object material to the live image comprises: displaying the specified object through the transmission channel to enter the shooting based on the transmission channel material The process in the real image. The method of claim 1, wherein the interactive material further includes a voice sample material recorded by the specified object; the method further comprising: obtaining user name information of the associated user of the first terminal; The user generates a greeting corpus including the user name; according to the voice sample material, the greeting is expected to be converted into a voice and played. The method of claim 1, wherein the specified object material is a plurality of sets of materials corresponding to the same specified object, the method further comprising: providing an operation option for selecting the specified object material; The specified object material is added to the real image, including: adding the selected specified object material to the real image. The method of claim 1, further comprising: providing a shooting operation option during the displaying of the specified object material to the live image; receiving an operation request through the shooting operation option, A corresponding image is generated based on each image layer, the image layer including a live image and an image specifying the pixel material. The method of claim 15, wherein the generating the captured image according to each image layer comprises: taking a screen or a screen for each image layer, and removing the image for displaying the operation option Layer, generate a captured image. The method of claim 15, wherein the live image further includes a person image that is photographed with the designated object. The method of claim 15, wherein the method further comprises: providing an operation option for sharing the captured image. The method of claim 15, wherein the method further comprises: providing a receiving page for browsing and sharing the captured image. The method of any one of claims 1 to 19, wherein the specified object includes information specifying a person. The method of any one of claims 1 to 19, wherein the specified object includes information specifying the item. The method of claim 21, wherein after the adding the specified object material to the live image, further comprising: providing an operation option for snapping the data object associated with the specified item; When receiving the panning operation through the operation option, the server submits to the server, and the server determines the panning result. The method of any one of claims 1 to 19, wherein the specified object includes item information related to the offline game. The method of claim 23, wherein after the adding the specified object material to the live image, the method further comprises: submitting the operation information to the operation information when the target item is received The server determines the reward information obtained by the operation and returns the information; and provides the reward information obtained. The method of any one of claims 1 to 19, wherein the specified object material comprises a video material obtained by photographing the specified object. The method according to any one of claims 1 to 19, wherein the specified object material comprises: a cartoon image made with the image of the specified object as a prototype, and an animation material produced based on the cartoon image. A multi-screen interaction method, comprising: the first server saves an interactive material, the interactive material includes a specified object material created according to the specified object; the interactive material is provided to the first terminal, and the first terminal collects the real scene And an image, when the video in the second terminal is played to a target event corresponding to the specified object, the specified object material is added to the live image. The method of claim 27, wherein the specified object includes a designated person. The method of claim 27, wherein the saving the interactive material comprises: saving a video material obtained by capturing the specified object. The method of claim 27, wherein the saving the interactive material comprises: saving a cartoon image made with the image of the specified object as a prototype, and an animation material based on the cartoon image. The method of claim 27, wherein the specified object includes a designated person, the saving the interactive material, and further comprising: saving the voice sample material recorded by the designated person. The method of claim 27, wherein the method further comprises: providing, to the second server corresponding to the second terminal, an acoustic signal of a preset frequency for use in the video in the second terminal When the target event corresponding to the specified object is played, it is added to the video, so that the first terminal knows the occurrence of the target event by detecting the sound wave signal of the preset frequency. The method of claim 27, further comprising: performing statistics on interactions of the first terminals; providing statistical information to the second server corresponding to the second terminal, by the second server Add the statistics to the video played by the second terminal. A multi-screen interaction method, comprising: playing a video by a second terminal; playing a sound wave signal of a preset frequency when the video is played to a target event related to the specified object, so that the first terminal knows by detecting the sound wave signal The target event occurs and the specified object material is added to the captured live image. The method of claim 34, wherein the different designated objects correspond to acoustic signals of different frequencies. A multi-screen interaction method, comprising: receiving, by a second server, sound wave signal information of a preset frequency provided by a first server; and inserting a position of a target event related to a specified object in the video into the preset frequency The sound wave signal is used to detect the occurrence of the target event by detecting the sound wave signal by the first terminal during the playing of the video through the second terminal, and adding the specified object material to the collected real-life image. The method of claim 36, further comprising: receiving statistical information provided by the first server for interaction of the first terminal; adding the statistical information to the video for transmission, for Play through the second terminal. A video interaction method, comprising: loading, by a first terminal, an interactive material, the interactive material comprising a specified object material created according to the specified object; when the video in the first terminal is played to a target event related to the specified object , jumping to the interactive interface; displaying the real image acquisition result in the interactive interface, and adding the specified object material to the real image. A video interaction method, comprising: a first server saves an interactive material, the interactive material includes a specified object material created according to the specified object; and the interactive material is provided to the first terminal, so that the video in the first terminal When playing to the target event related to the specified object, jump to the interactive interface, and display the live image acquisition result in the interactive interface, and add the specified object material to the real image. An interactive method, comprising: loading an interactive material, the specified material comprising a specified object created according to the specified object; acquiring a real image; and when the target event related to the specified object is detected, the specified object material is Add to this live image. The multi-screen interactive device is characterized in that it is applied to the first terminal, and includes: a first material loading unit, configured to load an interactive material, the interactive material includes a specified object material created according to the specified object; and the first real image capturing unit And the first material adding unit is configured to add the specified object material to the real image when the video in the second terminal is played to a target event related to the specified object. A multi-screen interactive device, comprising: the first interactive material saving unit, configured to: save the interactive material, the interactive material includes a specified object material created according to the specified object; a unit, configured to provide the interactive material to the first terminal, where the first terminal collects a real-life image, and when the video in the second terminal plays a target event corresponding to the specified object, the specified object material is added to In the real image. A multi-screen interactive device, characterized in that, the second terminal comprises: a video playing unit for playing a video; and a sound wave signal playing unit, configured to play the pre-playing when the video is played to a target event related to the specified object The sound wave signal of the frequency is set, so that the first terminal knows the occurrence of the target event by detecting the sound wave signal, and adds the specified object material to the collected real-life image. A multi-screen interactive device, characterized in that it is applied to a second server, comprising: an acoustic signal information receiving unit, configured to receive sound wave signal information of a preset frequency provided by a first server; and an acoustic signal information inserting unit, configured to Inserting a sound wave signal of the preset frequency in a position where a target event related to the specified object occurs in the video, so that the first terminal detects the occurrence of the target event by detecting the sound wave signal during the process of playing the video through the second terminal. And add the specified object material to the captured live image. A video interaction device, which is applied to the first terminal, and includes: a loading unit, configured to load an interactive material, the interactive material includes a specified object material created according to the specified object; and an interface jump unit, configured to be the first terminal When the video in the play reaches the target event related to the specified object, jump to the interactive interface; the material adding unit is configured to display the real image acquisition result in the interactive interface, and add the specified object material to the live image in. A video interaction device, configured to be applied to the first server, comprising: a second material saving unit, configured to save an interactive material, the interactive material includes a specified object material created according to the specified object; Providing the interactive material to the first terminal, so that when the video in the first terminal plays the target event related to the specified object, jumping to the interactive interface, and displaying the real image acquisition result in the interactive interface, and Add the specified object material to the live image. An interactive device, comprising: a second material loading unit, configured to load an interactive material, the interactive material comprising a specified object material created according to the specified object; and a second real image capturing unit configured to collect the real image; a second material adding unit configured to add the specified object material to the real-life image when a target event related to the specified object is detected. An electronic device, comprising: one or more processors; and a memory associated with the one or more processors, the memory for storing program instructions, the program instructions being processed by the one or more When the device reads execution, the following operations are performed: loading the interactive material, including the specified object material created according to the specified object; collecting the real image; when the video in the second terminal is played to the target event related to the specified object , the specified object material is added to the live image.