CN114979756B

CN114979756B - Method, device and equipment for realizing one-to-many screen-throwing independent display and interaction

Info

Publication number: CN114979756B
Application number: CN202210521400.1A
Authority: CN
Inventors: 侯晓飞
Original assignee: Beijing Zitiao Network Technology Co Ltd
Current assignee: Beijing Zitiao Network Technology Co Ltd
Priority date: 2022-05-13
Filing date: 2022-05-13
Publication date: 2024-05-07
Anticipated expiration: 2042-05-13
Also published as: CN114979756A

Abstract

The application discloses a method, a device and equipment for realizing one-to-many screen projection independent display and interaction, wherein the method comprises the following steps: firstly, after N slave devices are connected through a screen-throwing software development kit SDK running on a master device in a preset connection mode, a subsystem can be divided for each slave device in a master system of the master device, and the binding relation between the N slave devices and the corresponding subsystems is stored; and then receiving selection operation of a screen-throwing mode of the slave equipment by a user, responding to the selection operation, and realizing data interaction between the master equipment and each slave equipment and independent display of screen-throwing contents of the master equipment on each slave equipment through the screen-throwing SDK operated on the master equipment and the slave equipment according to the binding relation between N slave equipment and the corresponding subsystem. Therefore, the master device can be independently displayed on different slave devices in a split screen mode, and each slave device can be respectively controlled to perform different operations, so that the screen throwing experience of a user is improved.

Description

Method, device and equipment for realizing one-to-many screen-throwing independent display and interaction

Technical Field

The present application relates to the field of computer technologies, and in particular, to a method, an apparatus, and a device for implementing one-to-many screen projection independent display and interaction.

Background

Along with the development of network technology, various intelligent devices such as mobile phones, tablet computers and intelligent televisions penetrate through the aspects of daily life of people, and the functions are more and more powerful. For example, the intelligent television is used as a display terminal, not only can access the internet to acquire various network resources, but also a user can install and uninstall various application programs by himself. And as mobile terminal equipment such as mobile phones and tablet computers are spread around everyone, the application of screen projection in families is more and more widespread.

At present, a television in a household is usually more than one, and a tablet personal computer, a notebook computer and other devices capable of being used for screen projection are also available, but the wireless screen projection of the existing mobile terminal is realized in a one-to-one screen projection mode or a multi-screen simultaneous display mode, the screen projection device can only be used as a display to display contents, and the screen projection device cannot be used as an independent system to carry out input and output operations, so that the screen projection experience of a user is poor.

Disclosure of Invention

The main purpose of the embodiment of the application is to provide a method, a device and equipment for realizing one-to-many screen-throwing independent display and interaction, which can be well applied to scenes such as families, offices, exhibition halls and the like, so that one mobile terminal can be used as a main equipment to be independently displayed on different other display equipment used as slave equipment in a split screen manner, and each slave equipment can be respectively controlled to perform different operations, thereby improving the screen-throwing experience of users.

The embodiment of the application provides a method for realizing one-to-many screen projection independent display and interaction, which comprises the following steps:

After N slave devices are connected through a preset connection mode by using a screen-throwing software development kit SDK running on a master device, dividing a subsystem for each slave device in a master system of the slave device, and storing the binding relation between the N slave devices and the corresponding subsystems; the N is a positive integer greater than 1;

And receiving selection operation of a screen throwing mode of the slave equipment by a user, responding to the selection operation, and realizing data interaction between the master equipment and each slave equipment and independent display of screen throwing contents of the master equipment on each slave equipment through the screen throwing SDK operated on the master equipment and the slave equipment according to the binding relation between the N slave equipment and the corresponding subsystem.

In one possible implementation, when the screen-casting mode selected by the user is a mirror-image screen-casting mode; the response to the selection operation, according to the binding relationship between the N slave devices and the corresponding subsystems, through the screen-throwing SDKs running on the master device and the slave devices, realizes data interaction between the master device and each slave device, and independent display of screen-throwing contents of the master device on each slave device, including:

And responding to the selection operation, and transmitting the application interface data currently displayed by the master device to the slave device corresponding to the mirror image screen-projection mode selected by the user for screen-projection display through the master device and the screen-projection SDK operated on the slave device according to the binding relation between the N slave devices and the corresponding subsystems.

In one possible implementation, when the screen-throwing mode selected by the user is a system screen-throwing mode; the response to the selection operation, according to the binding relationship between the N slave devices and the corresponding subsystems, through the screen-throwing SDKs running on the master device and the slave devices, realizes data interaction between the master device and each slave device, and independent display of screen-throwing contents of the master device on each slave device, including:

Responding to the selection operation, and transmitting main interface data of the main equipment to the slave equipment corresponding to a screen-throwing mode of a user selection system for screen-throwing display through the main equipment and the screen-throwing SDK operated on the slave equipment according to the binding relation between the N slave equipment and the corresponding subsystem;

And receiving triggering operation of a user on a display interface on the slave equipment, responding to the triggering operation, and correspondingly processing the application in the master equipment through the screen-throwing SDK running on the master equipment and the slave equipment to realize independent input and output of data between the master equipment and each slave equipment.

In a possible implementation manner, when the screen-throwing mode selected by the user comprises a mirror image screen-throwing mode and a system screen-throwing mode, wherein the mirror image screen-throwing mode corresponds to the first slave device, and the system screen-throwing mode corresponds to the second slave device; the response to the selection operation, according to the binding relationship between the N slave devices and the corresponding subsystems, through the screen-throwing SDKs running on the master device and the slave devices, realizes data interaction between the master device and each slave device, and independent display of screen-throwing contents of the master device on each slave device, including:

Responding to the selection operation, and transmitting the application interface data currently displayed by the master device to the first slave device for screen projection display through the screen projection SDK running on the master device and the first slave device according to the binding relation between the N slave devices and the corresponding subsystems;

Responding to the selection operation, and transmitting main interface data of the main equipment to the second slave equipment for screen projection display through the screen projection SDK running on the main equipment and the second slave equipment according to the binding relation between the N slave equipment and the corresponding subsystem; and receiving triggering operation of a user on a display interface on the second slave device, and responding to the triggering operation, and correspondingly processing the application in the master device through the screen-throwing SDK running on the master device and the second slave device to realize independent input and output of data between the master device and the second slave device.

In a possible implementation manner, the method further includes:

Creating corresponding Pulse Code Modulation (PCM) equipment according to the identification of the slave equipment through the screen-throwing SDK;

According to the binding relation between the N slave devices and the corresponding subsystems, through the screen-throwing SDKs operated on the master device and the slave devices, data interaction between the master device and each slave device is realized, and the independent display of screen-throwing contents of the master device on each slave device is realized, including:

and according to the binding relation between the N slave devices and the corresponding subsystem, transmitting the multimedia data generated by the slave devices corresponding to the subsystem by using the PCM device, so as to realize data interaction between the master device and each slave device and independent display of screen contents of the master device on each slave device.

In a possible implementation, the multimedia data includes audio data and/or video data; according to the binding relation between the N slave devices and the corresponding subsystems, the PCM device is utilized to transmit multimedia data generated by the slave devices corresponding to the subsystems, so as to realize data interaction between the master device and each slave device, and the independent display of screen contents of the master device on each slave device, including:

And according to the binding relation between the N slave devices and the corresponding subsystems and the identifiers of the slave devices, carrying out uplink and downlink transmission of audio data and/or video data between the slave devices corresponding to the subsystems and the master device by using the PCM device, so as to realize data interaction between the master device and each slave device and independent display of screen contents of the master device on each slave device.

In a possible implementation manner, the method further includes:

And receiving a modification operation of a screen throwing mode of a third slave device by a user, and responding to the modification operation, and updating data transmitted between the master device and the third slave device and screen throwing content displayed on the third slave device by the master device and the screen throwing SDK operated on the third slave device according to the binding relation between the N slave devices and the corresponding subsystems.

In a possible implementation manner, the preset connection manner includes a code scanning manner, an IP address searching manner or a broadcasting manner.

The embodiment of the application also provides a device for realizing the independent display and interaction of one-to-many projection screens, which comprises:

The storage unit is used for dividing a subsystem for each slave device in a main system of the slave device after N slave devices are connected through a preset connection mode by using a screen-throwing software development kit SDK running on the main device, and storing the binding relation between the N slave devices and the corresponding subsystems; the N is a positive integer greater than 1;

The screen throwing unit is used for receiving the selection operation of a screen throwing mode of the slave equipment by a user, responding to the selection operation, and realizing the data interaction between the master equipment and each slave equipment and the independent display of the screen throwing content of the master equipment on each slave equipment through the screen throwing SDK operated on the master equipment and the slave equipment according to the binding relation between the N slave equipment and the corresponding subsystem.

In one possible implementation, when the screen-casting mode selected by the user is a mirror-image screen-casting mode; the screen throwing unit is specifically used for:

In one possible implementation, when the screen-throwing mode selected by the user is a system screen-throwing mode; the screen throwing unit comprises:

The first transmission subunit is used for responding to the selection operation, and transmitting the main interface data of the main equipment to the slave equipment corresponding to the screen-throwing mode of the user selection system for screen-throwing display through the main equipment and the screen-throwing SDK operated on the slave equipment according to the binding relation between the N slave equipment and the corresponding subsystem;

The first processing subunit is used for receiving the triggering operation of the user on the display interface of the slave equipment, responding to the triggering operation, and correspondingly processing the application in the master equipment through the screen-throwing SDK running on the master equipment and the slave equipment so as to realize the independent input and output of the data between the master equipment and each slave equipment.

In a possible implementation manner, when the screen-throwing mode selected by the user comprises a mirror image screen-throwing mode and a system screen-throwing mode, wherein the mirror image screen-throwing mode corresponds to the first slave device, and the system screen-throwing mode corresponds to the second slave device; the screen throwing unit comprises:

the second transmission subunit is used for responding to the selection operation, and transmitting the application interface data currently displayed by the master device to the first slave device for screen projection display through the screen projection SDK operated on the master device and the first slave device according to the binding relation between the N slave devices and the corresponding subsystems;

The second processing subunit is used for responding to the selection operation, and transmitting the main interface data of the main equipment to the second slave equipment for screen projection display through the screen projection SDK running on the main equipment and the second slave equipment according to the binding relation between the N slave equipment and the corresponding subsystem; and receiving triggering operation of a user on a display interface on the second slave device, and responding to the triggering operation, and correspondingly processing the application in the master device through the screen-throwing SDK running on the master device and the second slave device to realize independent input and output of data between the master device and the second slave device.

In a possible implementation manner, the apparatus further includes:

The creation unit is used for creating corresponding Pulse Code Modulation (PCM) equipment according to the identification of the slave equipment through the screen-throwing SDK;

the screen throwing unit is specifically used for:

In a possible implementation, the multimedia data includes audio data and/or video data; the screen throwing unit is specifically used for:

In a possible implementation manner, the apparatus further includes:

and the updating unit is used for receiving the modification operation of the screen-casting mode of the third slave equipment by the user, responding to the modification operation, and updating data transmitted between the master equipment and the third slave equipment and screen-casting contents displayed on the third slave equipment by the master equipment and the screen-casting SDK operated on the third slave equipment according to the binding relation between the N slave equipment and the corresponding subsystem.

The embodiment of the application also provides a device for realizing the independent display and interaction of one-to-many projection screens, which comprises: a processor, memory, system bus;

The processor and the memory are connected through the system bus;

The memory is configured to store one or more programs, the one or more programs comprising instructions, which when executed by the processor, cause the processor to perform any of the implementations of the split, multi-drop, independent display and interaction methods described above.

The embodiment of the application also provides a computer readable storage medium, wherein the computer readable storage medium stores instructions, and when the instructions run on the terminal equipment, the terminal equipment is enabled to execute any implementation mode of the method for realizing one-to-many screen-projection independent display and interaction.

According to the method, the device and the equipment for realizing the one-to-many screen-projection independent display and interaction, firstly, N slave devices are connected through a preset connection mode in a screen-projection software development kit SDK running on a master device, one subsystem can be divided for each slave device in a master system of the master device, and the binding relation between the N slave devices and the corresponding subsystems is stored; n is a positive integer greater than 1, then receiving selection operation of a screen-throwing mode of the slave equipment by a user, responding to the selection operation, and realizing data interaction between the master equipment and each slave equipment and independent display of screen-throwing contents of the master equipment on each slave equipment through screen-throwing SDKs operated on the master equipment and the slave equipment according to binding relations between N slave equipment and corresponding subsystems. Therefore, according to the embodiment of the application, the data interaction between the master device and each slave device and the independent display of the screen projection content of the master device on each slave device are realized through the screen projection SDK operated on the master device and the slave devices according to the screen projection mode selected by the user by utilizing the stored binding relation between the N connected slave devices and the corresponding subsystems, so that the screen projection experience of the user is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic flow chart of a method for realizing one-to-many screen-projection independent display and interaction according to an embodiment of the present application;

FIG. 2 is a diagram of an exemplary scenario for implementing one-to-many screen-casting independent display and interaction according to an embodiment of the present application;

Fig. 3 is a schematic diagram of a device for realizing one-to-many screen independent display and interaction according to an embodiment of the present application.

Detailed Description

With the development of networks, the bandwidth of the networks is larger and the speed is faster and faster. The use scene of the wireless network is more convenient, and mobile terminal equipment such as mobile phones, tablet computers and the like are spread around everyone, so that the application of screen projection in families is wider and wider.

However, at present, a mobile terminal is used as a wireless screen of a main device, whether one-to-one screen is used for screen casting to a single screen casting device or screen casting is used for screen casting to a plurality of screen casting devices (i.e. slave devices) to realize multi-screen simultaneous display, the screen casting device can only be used as a display to display content, and the screen casting device cannot be used as an independent system to perform input and output operations, so that the screen casting experience of a user is poor.

In order to solve the above-mentioned defect, the application provides a method, apparatus and device for realizing one-to-many screen-projection independent display and interaction, firstly, through a screen-projection software development kit (Software Development Kit, abbreviated as SDK) running on a master device, after connecting N slave devices in a preset connection mode, a subsystem can be divided for each slave device from the master system of the master device, and the binding relation between the N slave devices and the corresponding subsystems is stored; n is a positive integer greater than 1, then receiving selection operation of a screen-throwing mode of the slave equipment by a user, responding to the selection operation, and realizing data interaction between the master equipment and each slave equipment and independent display of screen-throwing contents of the master equipment on each slave equipment through screen-throwing SDKs operated on the master equipment and the slave equipment according to binding relations between N slave equipment and corresponding subsystems. Therefore, according to the embodiment of the application, the data interaction between the master device and each slave device and the independent display of the screen projection content of the master device on each slave device are realized through the screen projection SDK operated on the master device and the slave devices according to the screen projection mode selected by the user by utilizing the stored binding relation between the N connected slave devices and the corresponding subsystems, so that the screen projection experience of the user is improved.

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

First embodiment

Referring to fig. 1, a flow chart of a method for implementing one-to-many screen-projection independent display and interaction according to the present embodiment is provided, where the method includes the following steps:

s101: after N slave devices are connected through a preset connection mode by using a screen-throwing software development kit SDK running on the master device, dividing a subsystem for each slave device in a master system of the slave device, and storing the binding relation between the N slave devices and the corresponding subsystems; wherein N is a positive integer greater than 1.

In this embodiment, in order to enable a mobile terminal device (such as a mobile phone, a tablet computer, etc.) serving as a master device to be displayed on different display devices (such as a television, a tablet computer, etc.) serving as slave devices independently in a split screen manner, and each slave device can be controlled to perform different operations respectively, so as to improve the screen-throwing experience of a user. After N (N is a positive integer greater than 1) slave devices are connected by a preset connection mode through a screen-throwing SDK running on the master device, a subsystem (such as a subsystem 1 corresponding to the slave device 1, a subsystem 2 corresponding to the slave device 2 and the like) can be respectively and correspondingly divided for each slave device in the N slave devices in the master system of the master device, and the binding relation between the N slave devices and the corresponding subsystems is saved.

It should be noted that, in the present application, the storage space of the main system of the main device is shared, that is, the main device has the capability of being divided into a plurality of subsystems, and each subsystem obtained after the division is accessible through a network, and meanwhile, memories between all the subsystems are independent (that is, equivalent to each independent process).

In addition, an optional implementation manner is that the preset connection manner may be set according to actual situations, which is not limited in the embodiment of the present application, and for example, the preset connection manner may be set as a code scanning manner, an IP address searching manner, a broadcasting manner, or the like.

In this way, the screen-throwing SDK running on the master device can be connected with each slave device through connection modes such as code scanning, IP address searching or broadcasting modes, and meanwhile, each time after connecting with one slave device, a subsystem can be registered and divided on the master device, the subsystem and the corresponding slave device are bound, and the obtained binding relation is saved. For example, after the slave device 1 is connected to the master device, the on-screen SDK server running on the master device may request the master device to partition a subsystem, and register the ID of the slave device into the partitioned subsystem to bind the two.

Specifically, when the slave device is connected for the first time by using the screen-dropping SDK running on the master device, the slave device can be connected in a code scanning mode or can be directly connected through an IP address searching mode. For the connected slave devices, the next time of reconnection, the connection can be directly selected by broadcasting after the master device directly discovers the available slave devices. Each time a slave device is connected, a subsystem is created in the master system of the slave device to perform binding interaction with the slave device. If multiple slave devices are connected, the multiple subsystems are divided from the master system of the master device to connect with the different slave devices, which is equivalent to that multiple subsystems respectively perform one-to-one binding interaction with the multiple different slave devices, so as to execute the subsequent step S102.

S102: and receiving selection operation of a screen throwing mode of the slave equipment by a user, responding to the selection operation, and realizing data interaction between the master equipment and each slave equipment and independent display of screen throwing contents of the master equipment on each slave equipment through the screen throwing SDK operated on the master equipment and the slave equipment according to the binding relation between N slave equipment and the corresponding subsystem.

In this embodiment, in order to improve the screen capturing experience of the user, after the master device connects N slave devices through step S101 and stores the binding relation between the N slave devices and the corresponding subsystems, the master device may further receive a selection operation that the user selects at least one slave device from the N slave devices to perform the screen capturing and the corresponding screen capturing mode, for example, the master device may pop up an interface capable of displaying the N slave devices that are currently connected on the display screen immediately after connecting the N slave devices, and prompt the user to select the slave device from which the user wants to capture the screen, and the user may select at least one slave device from the N slave devices to perform the screen capturing and the corresponding screen capturing mode through a selection operation such as clicking the screen or sending a voice command. Then, after receiving a selection operation of selecting at least one slave device from N slave devices by a user to perform screen projection and a corresponding transparent mode, the master device responds to the selection operation, and can realize data interaction between the master device and each slave device through the screen projection SDK operated on the master device and the slave device according to the stored binding relation between the N slave devices and the corresponding subsystems, and independent display of screen projection contents of the master device on each slave device.

Specifically, after the master device is connected to one slave device in step S101, a corresponding pulse code modulation (Pulse Code Modulation, abbreviated as PCM) device may be created in the subsystem according to the identifier (such as ID) of the slave device through the screen-throwing SDK, so that multimedia data generated by the slave device corresponding to the subsystem may be transmitted by using the PCM device according to the binding relationship between N slave devices and the corresponding subsystem, so that data interaction between the master device and each slave device may be realized, and independent display of screen-throwing content of the master device on each slave device may be realized.

When the multimedia data comprises audio data and/or video data, after the corresponding PCM equipment is created according to the identifiers of the slave equipment through the screen throwing SDK, the audio data and/or the video data between the corresponding slave equipment of the sub-system and the corresponding sub-system in the master equipment are/is transmitted up and down by utilizing the created PCM equipment according to the binding relation between the N slave equipment and the corresponding sub-system and the identifiers of the slave equipment, so that the data interaction between the corresponding sub-system in the master equipment and each slave equipment and the independent display of the screen throwing content of the master equipment on each slave equipment can be realized. For example, if a slave device has a speaker mounted thereon, then sound may be played through the slave device's speaker while audio and video is being played on the slave device. If a microphone is available on the slave device, the slave device can be used by recording a sound by a recorder, voice by WeChat, or the like. At this time, when the user on the slave device 1 watches the video, the user on the slave device 2 can also dial a voice call by using WeChat, the user on the slave device 3 can also play a network game and the like, and the three are independently displayed on the screen and are mutually independent in-and-out operation, so that the screen throwing experience of the user is improved.

In one possible implementation manner of the embodiment of the present application, when the screen-throwing mode selected by the user is the mirror image screen-throwing mode, in the step S102, the implementation process of "responding to the selection operation, according to the binding relationship between N slave devices and corresponding subsystems, through the screen-throwing SDKs running on the master device and the slave devices, to implement data interaction between the master device and each slave device, and the independent display of the screen-throwing content on each slave device by the master device" may include: and responding to the selection operation, and transmitting the application interface data currently displayed by the master device to the slave device corresponding to the mirror image screen-projection mode selected by the user for screen-projection display through the screen-projection SDK operated on the master device and the slave device according to the binding relation between the N slave devices and the corresponding subsystems.

In this implementation manner, the screen projection modes of the subsystems of the master device when the screen is projected to the corresponding slave device are different, and may include a mirror image screen projection mode and a system screen projection mode. When the screen-throwing mode selected by the user is the mirror image screen-throwing mode, after the slave device corresponding to the mirror image screen-throwing mode is determined, through the master device and the screen-throwing SDK operated on the slave device, the application interface data (namely the content being displayed on the master device) currently displayed by the master device is transmitted to the slave device to be directly displayed, and the slave device cannot be controlled and can only act as a display.

In another possible implementation manner of the embodiment of the present application, when the screen-throwing mode selected by the user is the system screen-throwing mode, in response to the selection operation in step S102, the implementation process of "responding to the selection operation, according to the binding relationship between N slave devices and corresponding subsystems, through the screen-throwing SDKs running on the master device and the slave devices, implementing data interaction between the master device and each slave device, and the independent display of the screen-throwing content of the master device on each slave device" may include the following steps A1-A2:

Step A1: and responding to the selection operation, and transmitting main interface data of the main equipment to the slave equipment corresponding to the screen-throwing mode of the user selection system for screen-throwing display through the screen-throwing SDK operated on the main equipment and the slave equipment according to the binding relation between the N slave equipment and the corresponding subsystem.

In this implementation manner, when the screen-throwing mode selected by the user is the system screen-throwing mode, after determining that the user selects the slave device corresponding to the system screen-throwing mode, the main interface data of the main device (i.e. the content of the Home interface of the main device) is transmitted to the slave device through the main device and the screen-throwing SDK running on the slave device to perform screen-throwing display, and the user can perform autonomous control on the slave device, i.e. the user can autonomously select and operate any system application through the slave device, for example, play a game by opening a game software application, or open a video software application to watch a video, etc.

Step A2: and receiving triggering operation of a user on a display interface on the slave equipment, responding to the triggering operation, and correspondingly processing the application in the master equipment through the screen-throwing SDK running on the master equipment and the slave equipment to realize independent input and output of data between the master equipment and each slave equipment.

After the main interface data of the main equipment is transmitted to the slave equipment corresponding to the screen-throwing mode of the user selection system for screen-throwing display through the step A1, the triggering operation of the user on the display interface of the slave equipment can be further received, and in response to the triggering operation, the application in the main equipment is correspondingly processed through the screen-throwing SDK operated on the main equipment and the slave equipment and the registered identification ID of the slave equipment, and the result data generated by the application is transmitted to the slave equipment, so that the pushing is performed, thereby realizing independent input and output of the data between the main equipment and each slave equipment, namely, different information can be displayed on each slave equipment without mutual interference, and further improving the user experience.

Illustrating: after two slave devices are connected and the user selects the screen projection mode of the two slave devices as the system screen projection mode, all system applications on the master device can be accessed through the two slave devices, and the two slave devices can also be directly installed on the subsystem corresponding to the master device. For example, the user on the slave device 1 plays the class a network game, the user on the slave device 2 wants to play the class B network game, but the system of the master device is not provided with the application of the class B network game, at this time, the user on the slave device 2 can open an application store on the slave device to download and install the application of the class B network game to a subsystem corresponding to the master device, the use of the user on the slave device 1 is not influenced, the independent input and output of data between the master device and the two slave devices are realized, mutual interference is avoided, and the screen throwing experience of the user is improved.

In still another possible implementation manner of the embodiment of the present application, when the screen-throwing mode selected by the user is a mirror screen-throwing mode and a system screen-throwing mode, and the mirror screen-throwing mode corresponds to the first slave device and the system screen-throwing mode corresponds to the second slave device, in the step S102, "in response to the selection operation, according to the binding relationship between N slave devices and the corresponding subsystems, through the screen-throwing SDKs running on the master device and the slave devices, the implementation process of implementing the data interaction between the master device and each slave device, and the independent display of the screen-throwing content on each slave device by the master device" may include the following steps B1-B2:

Step B1: and responding to the selection operation, and transmitting the application interface data currently displayed by the master device to the first slave device for screen projection display through the screen projection SDK running on the master device and the first slave device according to the binding relation between the N slave devices and the corresponding subsystems.

In this implementation manner, for the first slave device in the mirror image screen-throwing mode selected by the user, according to the binding relationship between the N slave devices and the corresponding subsystems, through the screen-throwing SDKs running on the master device and the first slave device, the application interface data (i.e., the content being displayed on the master device) currently displayed on the master device is transmitted to the first slave device to directly perform screen-throwing display, where the first slave device cannot be controlled and can only function as one display.

Step B2: responding to the selection operation, and transmitting main interface data of the main equipment to the second slave equipment for screen projection display through the screen projection SDK running on the main equipment and the second slave equipment according to the binding relation between the N slave equipment and the corresponding subsystem; and receiving triggering operation of a user on a display interface on the second slave device, and responding to the triggering operation, and correspondingly processing the application in the master device through the screen-throwing SDK running on the master device and the second slave device to realize independent input and output of data between the master device and the second slave device.

In this implementation manner, for the second slave device in which the user selects the system screen-throwing mode, according to the binding relationship between the N slave devices and the corresponding subsystems, through the screen-throwing SDKs running on the master device and the second slave device, the master interface data of the master device (i.e., the content of the Home interface of the master device) is transmitted to the second slave device to perform screen-throwing display, and the user can perform autonomous control on the second slave device, i.e., the user can autonomously select and operate any system application through the second slave device, for example, play a game by opening a game software application, or open a video software application to watch video, etc.

After the main interface data of the main equipment is transmitted to the second slave equipment for screen projection display, further triggering operation of a user on a display interface of the second slave equipment can be received, and in response to the triggering operation, the application in the main equipment is correspondingly processed through the screen projection SDK running on the main equipment and the second slave equipment and the identification ID registered by the second slave equipment, and the result data generated by the application is transmitted to the second slave equipment, so that independent input and output of the data between the main equipment and the second slave equipment are realized, and the data are not mutually interfered with the first slave equipment.

Thus, the above steps S101-S102 realize the one-to-many independent screen display of the system, and each slave device can be used as a device with an independent system, i.e. each slave device is equivalent to an independent input/output device, and does not interfere with each other. For example, in a home, office, exhibition hall, etc., one mobile terminal (such as a mobile phone or a tablet computer) can be used as a main device for multiple people to use at the same time, and does not affect each other. The method can realize that a plurality of independent screens are projected onto a plurality of devices for data interaction, such as projecting a mobile phone onto an independent display of an intelligent television, a tablet personal computer and the like, without the need of a plurality of people to squeeze together to watch videos or only enabling one person to play games, and enabling other people to not operate other applications and the like. Each person can select different applications such as watching video, playing games or listening to music according to own preference, and therefore screen experience of the user is improved.

In addition, in order to further improve the screen-throwing experience of the user, an optional implementation manner may further receive a modification operation of the screen-throwing mode performed by the user on the slave device (defined as the third slave device herein), and in response to the modification operation, update data transmitted between the master device and the third slave device through the screen-throwing SDKs running on the master device and the third slave device according to the binding relationship between the N slave devices and the corresponding subsystems, and screen-throwing content displayed on the third slave device by the master device.

In this implementation manner, for example, the screen-throwing mode of the third slave device is modified from the mirror screen-throwing mode to the system screen-throwing mode by the user selecting the third slave device with the screen-throwing mode modified, and according to the binding relationship between the N slave devices and the corresponding subsystems, the current interface data (i.e., the content being displayed on the master device) displayed on the third slave device is updated to the master interface data (i.e., the content of the Home interface of the master device) of the master device through the screen-throwing SDKs operated on the master device and the second slave device, so that the user can autonomously control the third slave device, i.e., the user can autonomously select and operate the system application of any master device through the third slave device, and can also install and apply the system application to the subsystem corresponding to the master device. And the screen-throwing mode of the third slave device is changed from the system screen-throwing mode to the mirror image screen-throwing mode, so that the third slave device can be used as a display again, and only the display interface is switched and updated to the application interface data currently displayed by the master device (namely, the content being displayed on the master device).

Illustrating: in a family, a child A wants to take a mobile phone to watch a cartoon, a child B wants to take the mobile phone to play a game, and a child C wants to brush a short video with the mobile phone. At this time, the mobile phone can be respectively put on the smart television, the tablet personal computer 1 and the tablet personal computer 2. And after the screen-throwing SDK is installed on the three slave devices of the intelligent television, the tablet personal computer 1 and the tablet personal computer 2, the screen-throwing two-dimensional codes on the three slave devices are scanned by a mobile phone respectively for connection screen throwing. After the mobile phone terminal is connected, the three slave devices are selected to be in a system screen throwing mode in the SDK of the mobile phone terminal, so that a child A can watch an animation through the intelligent television, a child B can play a game on the tablet computer 1, and a child C can brush short videos on the tablet computer 2.

Further, when the parent feels that the playing time of the child b is too long, the tablet computer 1 can be used as a display again by modifying the screen projection mode of the tablet computer 1 (i.e. modifying the screen projection mode of the system into the mirror image screen projection mode), so that the tablet computer 1 can only display the application interface currently displayed by the mobile phone and cannot perform operation processing on the application interface, i.e. the playing game of the child b is interrupted. Similarly, when the parent feels that the child c is brushing short for too long, and does not want to let the child c continue brushing short, the short video that the child c is brushing can be interrupted by switching the screen mode of the tablet computer 2.

In this way, the electronic device implements the data interaction between the master device and each slave device through the screen-throwing SDK running on the master device and the slave device according to the screen-throwing mode selected by the user by executing the steps S101-S102 and using the stored binding relationship between the connected N slave devices and the corresponding subsystems. Thus, independent input and output of each slave device can be supported, such as independent display of different content, independent input and output keys, a touch screen, audio and video, and the like. And each slave device acts as an independent "system" and can operate independently. Not only can a master device be independently displayed on different slave devices in a split screen mode, but also each slave device can be controlled by different users to perform different operations, for example, one user can watch a movie by using the slave device A, one user can play a game by using the slave device B, one user can play a video call by using the slave device C, and the like, so that the screen throwing experience of the user is improved.

Illustrating: fig. 2 is a diagram illustrating an example of a scene for realizing one-to-many screen-projection independent display and interaction according to an embodiment of the present application. Specifically, in this application scenario, assuming that the user a is watching a movie with the mobile phone M, at this time, the user b to the user N users want to operate other applications respectively, by using a screen-dropping SDK and a router, and using a preset connection mode, after connecting the N slave devices controlled by the user b to the user N (for example, the slave device 1 is a tablet computer in the figure, the slave device N is a smart tv, etc.), dividing a subsystem (i.e., the subsystems 1 to N in the figure) for each slave device in the main system of the main device, and saving a one-to-one binding relationship between the N slave devices and the N subsystems (for example, the subsystem 1 binds the slave device 1, the subsystem N binds the slave device N, etc.), then, selecting operation of the screen-dropping mode by the user N slave devices may be received, and in response to the selecting operation, according to the binding relationship between the N slave devices and the corresponding subsystems, through the screen-dropping SDK running on the main device and the slave device, and the screen-dropping between the main device and each slave device, and the independent display content of the main device on each slave device may be displayed. Therefore, the users B to N can independently control the slave devices 1 to N respectively, namely, the users B to N can independently select and operate any system application in the mobile phone through the slave devices 1 to N, and can also install the application in a subsystem with binding relation in the mobile phone, and the like, so that the screen throwing experience of the users B to N is improved. The specific implementation process can be referred to the detailed description of the steps S101-S102, and will not be repeated here.

In summary, in the method for implementing one-to-many screen-projection independent display and interaction provided in the present embodiment, firstly, N slave devices are connected through a preset connection manner by using a screen-projection software development kit SDK running on a master device, and then a subsystem can be divided for each slave device from a master system of the master device, and binding relations between the N slave devices and corresponding subsystems are stored; n is a positive integer greater than 1, then receiving selection operation of a screen-throwing mode of the slave equipment by a user, responding to the selection operation, and realizing data interaction between the master equipment and each slave equipment and independent display of screen-throwing contents of the master equipment on each slave equipment through screen-throwing SDKs operated on the master equipment and the slave equipment according to binding relations between N slave equipment and corresponding subsystems. Therefore, according to the embodiment of the application, the data interaction between the master device and each slave device and the independent display of the screen projection content of the master device on each slave device are realized through the screen projection SDK operated on the master device and the slave devices according to the screen projection mode selected by the user by utilizing the stored binding relation between the N connected slave devices and the corresponding subsystems, so that the screen projection experience of the user is improved.

Second embodiment

The embodiment will be described with respect to a device for realizing one-to-many screen independent display and interaction, and the related content refers to the above method embodiment.

Referring to fig. 3, a schematic composition diagram of an apparatus for implementing one-to-many screen-projection independent display and interaction according to the present embodiment is provided, where the apparatus 300 includes:

A storage unit 301, configured to divide a subsystem for each slave device in a master system of the slave device after connecting N slave devices by using a preset connection manner through a screen-throwing software development kit SDK running on the master device, and store binding relations between the N slave devices and corresponding subsystems; the N is a positive integer greater than 1;

The screen-throwing unit 302 is configured to receive a selection operation of a screen-throwing mode of a slave device by a user, and respond to the selection operation, and implement data interaction between the master device and each slave device and independent display of screen-throwing contents of the master device on each slave device through screen-throwing SDKs running on the master device and the slave devices according to binding relations between the N slave devices and corresponding subsystems.

In one implementation manner of this embodiment, when the screen-casting mode selected by the user is a mirror image screen-casting mode; the screen projection unit 302 is specifically configured to:

In one implementation manner of this embodiment, when the screen-throwing mode selected by the user is the system screen-throwing mode; the screen projection unit 302 includes:

In one implementation manner of this embodiment, when the screen-casting mode selected by the user includes a mirror image screen-casting mode and a system screen-casting mode, where the mirror image screen-casting mode corresponds to the first slave device and the system screen-casting mode corresponds to the second slave device; the screen projection unit 302 includes:

In one implementation of this embodiment, the apparatus further includes:

the screen projection unit 302 is specifically configured to:

In one implementation of this embodiment, the multimedia data includes audio data and/or video data; the screen projection unit 302 is specifically configured to:

In one implementation of this embodiment, the apparatus further includes:

In an implementation manner of this embodiment, the preset connection manner includes a code scanning manner, an IP address searching manner, or a broadcasting manner.

Further, the embodiment of the application also provides a device for realizing one-to-many screen projection independent display and interaction, which comprises: a processor, memory, system bus;

The processor and the memory are connected through the system bus;

The memory is configured to store one or more programs, the one or more programs comprising instructions, which when executed by the processor, cause the processor to perform any of the implementations of the split, multiple drop-on-screen independent display and interaction methods described above.

Further, the embodiment of the application also provides a computer readable storage medium, wherein the computer readable storage medium stores instructions, and when the instructions run on the terminal equipment, the terminal equipment is caused to execute any implementation method for realizing the one-to-many screen-projection independent display and interaction method.

From the above description of embodiments, it will be apparent to those skilled in the art that all or part of the steps of the above described example methods may be implemented in software plus necessary general purpose hardware platforms. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network communication device such as a media gateway, etc.) to execute the method described in the embodiments or some parts of the embodiments of the present application.

It should be noted that, in the present description, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different manner from other embodiments, and identical and similar parts between the embodiments are all enough to refer to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section.

It is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for implementing one-to-many screen-projection independent display and interaction, the method comprising:

After N slave devices are connected through a preset connection mode by using a screen-throwing software development kit SDK running on a master device, dividing a subsystem for each slave device in a master system of the slave device, and storing the binding relation between the N slave devices and the corresponding subsystems; the N is a positive integer greater than 1; the memory space of the main system of the main equipment is shared, and the memories among the subsystems are mutually independent;

2. The method of claim 1, wherein when the user-selected screen-casting mode is a mirror-image screen-casting mode; the response to the selection operation, according to the binding relationship between the N slave devices and the corresponding subsystems, through the screen-throwing SDKs running on the master device and the slave devices, realizes data interaction between the master device and each slave device, and independent display of screen-throwing contents of the master device on each slave device, including:

3. The method of claim 1, wherein when the user-selected screen mode is a system screen mode; the response to the selection operation, according to the binding relationship between the N slave devices and the corresponding subsystems, through the screen-throwing SDKs running on the master device and the slave devices, realizes data interaction between the master device and each slave device, and independent display of screen-throwing contents of the master device on each slave device, including:

4. The method of claim 1, wherein when the user-selected screen-projection mode comprises a mirrored screen-projection mode and a system screen-projection mode, and the mirrored screen-projection mode corresponds to a first slave device and the system screen-projection mode corresponds to a second slave device; the response to the selection operation, according to the binding relationship between the N slave devices and the corresponding subsystems, through the screen-throwing SDKs running on the master device and the slave devices, realizes data interaction between the master device and each slave device, and independent display of screen-throwing contents of the master device on each slave device, including:

5. The method according to claim 1, wherein the method further comprises:

6. The method according to claim 5, wherein the multimedia data comprises audio data and/or video data; according to the binding relation between the N slave devices and the corresponding subsystems, the PCM device is utilized to transmit multimedia data generated by the slave devices corresponding to the subsystems, so as to realize data interaction between the master device and each slave device, and the independent display of screen contents of the master device on each slave device, including:

7. The method according to claim 1, wherein the method further comprises:

8. The method according to any one of claims 1 to 7, wherein the preset connection mode includes a scan code, an IP address search or a broadcast mode.

9. An apparatus for realizing one-to-many screen projection independent display and interaction, the apparatus comprising:

The storage unit is used for dividing a subsystem for each slave device in a main system of the slave device after N slave devices are connected through a preset connection mode by using a screen-throwing software development kit SDK running on the main device, and storing the binding relation between the N slave devices and the corresponding subsystems; the N is a positive integer greater than 1; the memory space of the main system of the main equipment is shared, and the memories among the subsystems are mutually independent;

10. An apparatus for realizing one-to-many screen-projection independent display and interaction, comprising: a processor, memory, system bus;

The processor and the memory are connected through the system bus;

The memory is for storing one or more programs, the one or more programs comprising instructions, which when executed by the processor, cause the processor to perform the method of any of claims 1-8.

11. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein instructions, which when run on a terminal device, cause the terminal device to perform the method of any of claims 1-8.