WO2022247260A1

WO2022247260A1 - Screen casting method and screen casting device

Info

Publication number: WO2022247260A1
Application number: PCT/CN2021/141267
Authority: WO
Inventors: 周学艺
Original assignee: 华为云计算技术有限公司
Priority date: 2021-05-26
Filing date: 2021-12-24
Publication date: 2022-12-01
Also published as: CN115407951A

Abstract

A screen casting method and a screen casting device, which are used to solve the problem in the prior art that a user needs to manually perform a verification operation for each instance of screen casting, thus operation is tedious. In the present application, the screen casting method comprises: when receiving an associated device request from a proxy device, a service device sending to the proxy device an identifier of one or more associated devices associated with the proxy device; the service device receiving a proxy screen casting request from the proxy device, the proxy screen casting request comprising an identifier of a screen casting source device and screen casting authorization information of a screen casting target device, and the one or more associated devices comprising the screen casting source device; and the service device sending a screen casting event notification to the screen casting source device, the screen casting event notification being used to instruct the screen casting source device to, according to the screen casting authorization information comprised in the screen casting event notification, send screen casting data to the screen casting target device, and the screen casting data being displayed on the screen casting target device.

Description

Screen projection method and screen projection device

Cross References to Related Applications

This application claims the priority of the Chinese patent application with the application number 202110580259.8 and the application name "A Screen Projection Method and Screen Projection Device" submitted to the China Patent Office on May 26, 2021, the entire contents of which are incorporated herein by reference. Applying.

technical field

The present application relates to the field of computer technology, and in particular to a screen projection method and a screen projection device.

Background technique

Screen casting (screen casting) technology refers to first connecting the screen casting target device to the wireless network in the use environment (home, office, hotel, etc.), and the screen casting source device passes through the digital living network alliance (digital living network alliance). , DLNA) and other protocols send the screen projection data (for example, the screen image of the screen projection source device) to the screen projection target device, and the screen projection target device outputs and plays the screen projection data locally, so as to realize the screen content projection of the screen projection source device to the function displayed on the screen-casting target device.

In the existing screen projection method, when the user needs to play the screen projection data in the screen projection source device through the screen projection target device, the user needs to manually perform the verification operation. Specifically, the screen projection target device displays the screen projection authorization information, such as the screen projection QR code. The user scans the screen projection QR code with the screen projection source device, and the screen projection source device sends the screen projection to the screen projection target device based on the acquired screen projection QR code. Send a screen projection request. After the screen projection target device passes the verification of the screen projection QR code carried in the screen projection request, it sends channel authorization screen information to the screen projection source device, and then the screen projection source device can use the channel authorization screen information to update the projection screen. The screen data is encrypted and sent to the target device for screen projection. In this way, the user needs to manually perform the verification operation every time the screen is projected, and the operation is cumbersome.

Contents of the invention

In view of this, the present application provides a screen projection method and a screen projection device, which are used to solve the problem in the prior art that a user needs to manually perform a verification operation for each screen projection, and the operation is cumbersome.

In the first aspect, the present application provides a screen projection method, which can be executed by a service device. The service device can be a server, and the server can include physical devices such as hosts or processors, or virtual devices such as virtual machines or containers. devices, which may also include chips or integrated circuits. In addition, the screen projection method can also be executed by components of the server, for example, implemented by components such as a processing device, a circuit, and a chip in the server.

In a possible implementation manner, the screen projection method includes: when receiving a device association request from the proxy device, the service device sends an identifier of at least one associated device that has an association relationship with the proxy device to the proxy device; The proxy screen projection request of the device, the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device; at least one of the associated devices includes the screen projection source device; the service device sends the projection screen to the screen projection source device The screen event notification, the screen projection event notification is used to instruct the screen projection source device to send screen projection data to the screen projection target device according to the screen projection authorization information included in the screen projection event notification, and the screen projection data is displayed on the screen projection target device.

In the above technical solution, the proxy device assists the screen projection source device to obtain the screen projection authorization information of the screen projection target device, and sends the screen projection authorization information to the service device, and the service device sends a screen projection event notification to the screen projection source device, and the screen projection The event notification includes screen projection authorization information, so that the screen projection source device can transmit screen projection data with the screen projection target device according to the screen projection authorization information in the screen projection event notification. In this solution, the user does not need to scan the projection QR code on the projection target device through the projection source device, or enter the projection code on the projection target device in the projection source device, which reduces user operations and helps to improve user experience. Moreover, the proxy device can obtain the screen projection authorization information of the screen projection target device for each of the multiple screen projection source devices, so as to realize the unified proxy of the proxy device. In large-scale conference scenarios, the proxy device can be used for management personnel Unified scheduling of different screen projection source devices to switch the screen projection to the screen projection target device, without the need for each user to manually verify authorization, and also helps to avoid the situation of user operation preemption.

In a possible implementation manner, the association relationship includes at least one or more of the following relationships: corresponding to the same account, corresponding to the same group, and corresponding to the same department.

In a possible implementation manner, before the service device sends the screen projection event notification to the screen projection source device, the method further includes: the service device determines that the screen projection source device is one of the associated devices.

In the above technical solution, after receiving the proxy screen projection request from the proxy device, the service device can verify whether the proxy device has an association relationship with the screen projection source device, thereby helping to ensure that only the screen projection source device has an association relationship In order to improve the security of the screen projection source device, the proxy device can obtain the screen projection authorization information for the screen projection source device.

In a possible implementation, after the service device sends the screen projection event notification to the screen projection source device, it further includes: the service device receives a first screen projection request from the screen projection source device, and the first screen projection request includes the projection Screen authorization information and the identification of the screen projection source device; when the screen projection target device is not idle, the service device will add the screen projection source device identification to the queue of the service device to be screen projection.

In a possible implementation, it also includes: when the screen projection target device is in an idle state, the service device obtains the channel authorization information of the screen projection target device from the screen projection target device, and sends the channel authorization information to the screen projection target device. Screen source device, channel authorization information is used for screen projection source device to encrypt screen projection data.

In the above technical solution, when the screen projection source device requests screen projection from the screen projection target device, the service device can determine whether to request the screen projection target device immediately according to the screen projection status (including idle state and non-idle state) of the screen projection target device. Channel authorization information of the screencasting target device. In one case, if the screen-casting target device is not in an idle state, the service device may add the identity of the screen-casting source device to the waiting screen-casting queue of the service device, and when the screen-casting target device is in an idle state, indicate The screen projection source device requests the channel authorization information of the screen projection target device again. Therefore, the screen projection source device does not need to request the screen projection target device for multiple times, reducing the number of failed screen projection requests from the screen projection source device. When the screen-casting target device switches from the non-idle state to the idle state, the service device can instruct the screen-casting source device to request the channel authorization information of the screen-casting target device again, reducing the waiting time of the screen-casting source device. In a large-scale conference scenario, the service device can adjust the screen projection order of multiple screen projection source devices based on the priority of multiple screen projection source devices, which helps to avoid the situation of user operation preemption. This method does not require the user of the screen-casting source device to manually check the screen-casting status of the current screen-casting target device, which helps to improve user experience. In the case that multiple screen projection source devices need to cast screens sequentially, it is helpful to quickly switch and cast screens for screen projection target devices.

In a possible implementation, before the service device adds the identity of the screen-casting source device to the screen-to-be-cast queue of the service device, it further includes: the service device monitors the screen-casting status of the screen-casting target device, and determines the screen-casting target device In a non-idle state; or, the service device sends a first screen projection request to the screen projection target device, and receives a rejection response from the screen projection target device, where the rejection response is used to indicate that the screen projection target device is in a non-idle state.

In a possible implementation manner, the service device obtains channel authorization information from the screen projection target device, including: the service device sends a first screen projection request to the screen projection target device; the service device receives the channel authorization information of the screen projection target device.

In the second aspect, the present application provides a screen projection method, which can be executed by a service device, the service device can be a server, and the server can include physical devices such as hosts or processors, or virtual devices such as virtual machines or containers. devices, which may also include chips or integrated circuits. In addition, the screen projection method can also be executed by components of the server, for example, implemented by components such as a processing device, a circuit, and a chip in the server.

In a possible implementation manner, the screen projection method includes: when receiving a device association request from the proxy device, the service device sends an identifier of at least one associated device that has an association relationship with the proxy device to the proxy device; The proxy screen projection request of the device, the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device; at least one of the associated devices includes the screen projection source device; the service device according to the screen projection authorization information, from The channel authorization information of the screen projection target device is obtained from the screen projection target device, and the channel authorization information is sent to the screen projection source device; the channel authorization information is used by the screen projection source device to encrypt the projection data and send the encrypted projection data to the projection screen The target device, the projection data is displayed on the target device.

In a possible implementation, the service device obtains the channel authorization information of the screen projection target device from the screen projection target device according to the screen projection authorization information, including: the service device sends a channel authorization request to the screen projection target device, and the channel authorization request includes screen projection authorization information, and the channel authorization request is used to request channel authorization information of the screen projection target device from the screen projection target device; the service device receives the channel authorization information from the screen projection target device.

In the above technical solution, the proxy device assists the screen projection source device to obtain the screen projection authorization information of the screen projection target device, and sends the screen projection authorization information to the service device, and the service device obtains the screen projection authorization information from the screen projection target device according to the screen projection authorization information. The channel authorization information of the screen projection target device sends the channel authorization information to the screen projection source device, so that the screen projection source device can transmit screen projection data with the screen projection target device according to the screen projection authorization information. In this solution, the user does not need to scan the projection QR code on the projection target device through the projection source device, or enter the projection code on the projection target device in the projection source device, which reduces user operations and helps to improve user experience. Moreover, the proxy device can obtain the screen projection authorization information of the screen projection target device for each of the multiple screen projection source devices, so as to realize the unified proxy of the proxy device. In large-scale conference scenarios, the proxy device can be used for management personnel Unified scheduling of different screen projection source devices to switch the screen projection to the screen projection target device, without the need for each user to manually verify authorization, and also helps to avoid the situation of user operation preemption. Moreover, when the service device receives the proxy screen projection request sent by the proxy device, it does not need to send a screen projection event notification to the screen projection source device, but directly requests channel authorization information from the screen projection target device, which helps to reduce signaling interactions.

In a third aspect, the present application provides a screen projection method, which can be executed by a proxy device, and the proxy device can be a terminal device, such as a user terminal (such as a mobile phone, a computer, etc.).

In a possible implementation, the screen projection method includes: the proxy device obtains the screen projection authorization information of the screen projection target device; when the proxy device receives an indication of the proxy request for screen projection, it obtains from the service device the information associated with the proxy device. The identification of at least one associated device in the relationship; the proxy device receives the first user operation, and the first user operation is for the user to select one of at least one associated device as the screen projection source device, and sends a proxy screen projection request to the service device, and the proxy screen projection request Include the authorization information of the screen projection and the identification of the screen projection source device, and the proxy screen projection request is used to instruct the service device to send a screen projection event notification to the screen projection source device.

In a possible implementation manner, before the agent device receives the first user operation, the method further includes: the agent device displays an identifier of at least one associated device on a display interface of the agent device.

For the technical effects that can be achieved by any one of the possible implementation manners in the above third aspect, reference may be made to the description of the beneficial effects in the above first aspect or the second aspect, and details will not be repeated here.

In a fourth aspect, the present application provides a screen projection method, which can be executed by a screen projection source device, and the screen projection source device can be a terminal device, such as a user terminal (such as a mobile phone, a computer, etc.).

In a possible implementation, the screen projection method includes: the screen projection source device receives a screen projection event notification from the service device, the screen projection event notification includes the screen projection authorization information, and the screen projection event notification is a response from the service device to the proxy device. The screen projection source device and the proxy device have an association relationship; the screen projection source device sends the screen projection data of the screen projection source device to the screen projection target device according to the screen projection authorization information, and the screen projection data is in displayed on the target device.

In a possible implementation, before the screen projection source device sends the screen projection data of the screen projection source device to the screen projection target device according to the screen projection authorization information, the source device further includes: prompting the user according to the screen projection event notification Whether to agree to screen projection; the screen projection source device receives the instruction that the user agrees to screen projection.

In a possible implementation, the screen projection source device sends the screen projection data of the screen projection source device to the screen projection target device according to the screen projection authorization information, including: the screen projection source device sends the screen projection data to the screen projection target device according to the screen projection authorization information. The device sends the first screen projection request, which includes the screen projection authorization information and the identification of the screen projection source device; the screen projection source device receives the channel authorization information from the screen projection target device; the screen projection source device receives the channel authorization information according to the channel authorization information Encrypt the screen projection data, and send the encrypted screen projection data to the screen projection target device.

In a possible implementation manner, the screen projection source device sends a first screen projection request to the screen projection target device via the service device; the screen projection source device receives channel authorization information of the screen projection target device forwarded from the service device.

For the technical effects that can be achieved by any possible implementation manner in the above fourth aspect, reference may be made to the description of the beneficial effects in the above first aspect, and details will not be repeated here.

In the fifth aspect, the present application provides a screen projection method, which can be executed by a screen projection target device, and the screen projection target device can be a terminal device, such as a screen projection device, a large-screen device, or a large-screen device Wait.

In a possible implementation manner, the screen projection method includes: the screen projection target device receives a first screen projection request from the screen projection source device, and the first screen projection request includes the screen projection authorization information of the screen projection target device and the screen projection The identification of the source device, the screen projection authorization information is used by the screen projection source device to request the channel authorization information of the screen projection target device from the screen projection target device, and the channel authorization information is used by the screen projection source device to encrypt the screen projection data; In the case of being idle, the screen projection target device adds the identifier of the screen projection source device to the screen projection queue of the screen projection target device.

In a possible implementation manner, the method further includes: when the screen projection target device is in an idle state, the screen projection target device sends channel authorization information to the screen projection source device.

In a possible implementation manner, the screen projection target device receives the first screen projection request of the screen projection source device forwarded by the service device; the screen projection target device sends channel authorization information to the screen projection source device via the service device.

In the above technical solution, when the screen projection source device requests screen projection from the screen projection target device, the screen projection target device can determine whether to send the screen projection to the screen projection source device according to the screen projection state (including idle state and non-idle state) of the screen projection target device. Send the channel authorization information of the screencasting target device. In one case, if the screen-casting target device is not idle, the screen-casting target device can add the identity of the screen-casting source device to the screen-casting queue of the screen-casting target device, and when the screen-casting target device is idle state, instructs the screen-casting source device to request the channel authorization information of the screen-casting target device again. Therefore, the screen projection source device does not need to request the screen projection target device for multiple times, reducing the number of failed screen projection requests from the screen projection source device. When the screen-casting target device switches from the non-idle state to the idle state, the screen-casting target device can instruct the screen-casting source device to request channel authorization information from the screen-casting target device again, reducing the waiting time of the screen-casting source device. In a large-scale meeting scenario, the screen projection target device can adjust the screen projection order of multiple screen projection source devices based on the priority of multiple screen projection source devices, which helps to avoid the situation of user operation preemption. It is not necessary for the user of the screen-casting source device to manually check the screen-casting status of the current screen-casting target device, which helps to improve user experience. In the case that multiple screen projection source devices need to cast screens sequentially, it is helpful to quickly switch and cast screens for screen projection target devices.

In the sixth aspect, the present application provides a screen projection method, which can be executed by a service device, and the service device can be a server, and the server can include physical devices such as hosts or processors, or virtual devices such as virtual machines or containers. devices, which may also include chips or integrated circuits. In addition, the screen projection method can also be executed by components of the server, for example, implemented by components such as a processing device, a circuit, and a chip in the server.

In a possible implementation manner, the service device sends the information of the first screen-casting target device to the screen-casting source device, and the information of the first screen-casting target device includes the identifier of the first screen-casting target device; the first screen-casting target The device has an association relationship with the screen-casting source device; the service device receives the second screen-casting request from the screen-casting source device; the second screen-casting request contains the identity of the second screen-casting target device; the second screen-casting target device is idle The first receiving device in the state; the service device obtains the channel authorization information of the second screen projection target device from the second screen projection target device according to the identification of the second screen projection target device; the service device sends the channel authorization information to the screen projection source device , the channel authorization information is used by the screen projection source device to encrypt the screen projection data and send the encrypted screen projection data to the second screen projection target device.

In the above technical solution, by establishing the association between the screen projection source device and the screen projection target device, and maintaining the signaling channel between the screen projection target device and the service device, the user does not need to manually obtain the screen projection target through the screen projection source device The screen projection authorization information of the device reduces user operations and helps to realize automatic and fast screen projection.

In a possible implementation manner, before the service device sends the information of the first screen projection target device to the screen projection source device, it further includes: the service device determines a third screen projection target device that maintains a signaling channel connection with the service device; The device determines the first target device for screen projection from the third target device for screen projection.

In a possible implementation manner, the service device determines the first screen projection target device from the third screen projection target device, including: the service device sends an identifier of the third screen projection target device to the screen projection source device; the service device Receive an association request from the screen projection source device, where the association request includes the target ID determined by the screen projection source device from the ID of the third screen projection target device; the service device determines the third screen projection target device corresponding to the target ID as The target device for the first projection.

In a possible implementation manner, the service device determining the first screen projection target device from the third screen projection target device includes: the service device determining the third screen projection target device as the first screen projection target device.

In a possible implementation manner, the service device determines the first screen projection target device from the third screen projection target device, including: the service device determines that the third screen projection target device belongs to the same area as the screen projection source device The third target device for screen projection is determined as the first target device for screen projection.

In a possible implementation manner, the service device obtains the channel authorization information of the second screen projection target device from the second screen projection target device according to the identifier of the second screen projection target device, including: the service device obtains the channel authorization information of the second screen projection target device according to the second screen projection target device The identifier of the target device sends a third screen projection request to the second screen projection target device; the service device receives the channel authorization information of the second screen projection target device that the second screen projection target device responds to the third screen projection request.

In a possible implementation manner, before the service device sends the information of the first screen projection target device to the screen projection source device, it includes: the service device monitors the screen projection status of the first screen projection target device, and obtains the first screen projection target device The screen projection status information of the screen projection status information indicates whether the first screen projection target device is in an idle state. In a possible implementation manner, the information of the first screen-casting target device further includes screen-casting state information of the first screen-casting target device.

In the above technical solution, the service device can monitor the screen projection status of the first screen projection target device, obtain the screen projection status information of the first screen projection target device, and then send the information of the first screen projection target device to the screen projection source device It carries the screen projection status information of the first screen projection target device, so that the screen projection source device can determine the second screen projection target device from the first screen projection target device in the idle state, that is, the second screen projection target device is idle state. Correspondingly, when the screen projection source device requests the second screen projection target device for screen projection, the success rate of screen projection is increased.

In a possible implementation manner, the service device sends the information of the first screen projection target device to the screen projection source device, including: the service device obtains the first screen projection target device whose screen projection status information indicates an idle state; The ID of the screen target device and send it to the screen projection source device.

In the above technical solution, the service device may determine the first screen-casting target device that is in an idle state from the first screen-casting target devices according to the screen-casting status of the first screen-casting target device, and send the first screen-casting target device The ID of the screen projection is sent to the screen projection source device, so that the screen projection source device can determine the second screen projection target device from the first screen projection target device in an idle state, that is, the second screen projection target device is in an idle state. Correspondingly, when the screen projection source device requests the second screen projection target device for screen projection, the success rate of screen projection is increased.

In a seventh aspect, the present application provides a screen projection method, which can be executed by a screen projection source device, and the screen projection source device can be a terminal device, such as a user terminal (such as a mobile phone, a computer, etc.).

In a possible implementation manner, the screen projection method includes: the screen projection source device receives information of a first screen projection target device from the service device, the information of the first screen projection target device includes an identifier of the first screen projection target device, The first screen-casting target device has an association relationship with the screen-casting source device; the screen-casting source device sends a second screen-casting request to the service device, and the second screen-casting request contains the identity of the second screen-casting target device, and the second screen-casting target The device is the first screen projection target device in an idle state; the screen projection source device receives the channel authorization information of the second screen projection target device from the service device; the screen projection source device encrypts the screen projection data according to the channel authorization information and encrypts the encrypted The screen projection data is sent to the second screen projection target device.

In a possible implementation manner, before the screen projection source device sends the second screen projection request to the service device, it further includes: the screen projection source device displays the identifier of the first screen projection target device on a display interface of the screen projection source device; The screen projection source device receives a second user operation, and the second user operation is that the user selects one of the identifiers of the first screen projection target device in the display interface of the screen projection source device; the screen projection source device converts the first screen projection target selected by the user The identifier of the device is used as the identifier of the second target device for screen projection.

In a possible implementation manner, the information of the first screen projection target device further includes screen projection state information of the first screen projection target device, and the screen projection state information indicates whether the first screen projection target device is in an idle state.

For the technical effects that can be achieved by any possible implementation in the seventh aspect above, reference may be made to the description of beneficial effects in the sixth aspect above, and details will not be repeated here.

In an eighth aspect, the present application provides a screen projection method. The screen projection method can be executed by a second screen projection target device. The second screen projection target device can be a terminal device, such as a screen projection device, a large screen device, Large screen devices, etc.

In a possible implementation manner, the screen projection method includes: the second screen projection target device receives a third screen projection request from the service device, and the service device maintains a signaling channel connection with the second screen projection target device; In response to the third screen projection request, the screen projection target device sends channel authorization information of the second screen projection target device to the service device, and the channel authorization information is used by the screen projection source device to encrypt the screen projection data and send the encrypted screen projection data to The target device for the second projection.

In a possible implementation manner, the second screen projection target device receives the screen projection data encrypted from the screen projection source device according to channel authorization information, and displays the screen projection data.

For the technical effects that can be achieved by any one of the possible implementations in the above eighth aspect, reference may be made to the description of the beneficial effects in the above sixth aspect, which will not be repeated here.

In a ninth aspect, the present application provides a screen projection device, including:

transceiver unit and processing unit;

In a possible implementation manner, the processing unit is configured to control the transceiver unit to send to the proxy device an identifier of at least one associated device that has an association relationship with the proxy device when the transceiver unit receives a request for an associated device from the proxy device; the processing unit further uses Therefore, the control transceiving unit receives the proxy screen projection request from the proxy device, and the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device; wherein at least one associated device includes the screen projection source device; processing The unit is also used to control the sending and receiving unit to send a screen projection event notification to the screen projection source device, and the screen projection event notification is used to instruct the screen projection source device to send the screen projection to the screen projection target device according to the screen projection authorization information included in the screen projection event notification. Data, screen projection data is displayed on the screen projection target device.

In a possible implementation manner, before the processing unit controls the transceiving unit to send a screen projection event notification to the screen projection source device, it is further configured to: determine that the screen projection source device is one of at least one associated device.

In a possible implementation manner, after the processing unit controls the transceiver unit to send a screen projection event notification to the screen projection source device, it is further configured to: control the transceiver unit to receive the first screen projection request from the screen projection source device, and the first screen projection The screen request includes screen projection authorization information and the identification of the screen projection source device; if the screen projection target device is not in an idle state, add the screen projection source device identification to the screen projection queue of the screen projection device.

In a possible implementation manner, the processing unit is further configured to: obtain channel authorization information of the screen projection target device from the screen projection target device when the screen projection target device is in an idle state, and control the transceiver unit to authorize the channel The information is sent to the screen projection source device, and the channel authorization information is used by the screen projection source device to encrypt the screen projection data.

In a possible implementation manner, before the processing unit adds the identification of the screen projection source device to the screen projection queue of the screen projection device, it is also used to: monitor the screen projection status of the screen projection target device, and determine the screen projection target device In a non-idle state; or, the control transceiver unit sends a first screen projection request to the screen projection target device, and receives a rejection response from the screen projection target device, and the rejection response is used to indicate that the screen projection target device is in a non-idle state.

For the technical effects that can be achieved by any one of the possible implementations in the above ninth aspect, reference may be made to the description of the beneficial effects in the above first aspect, and details will not be repeated here.

In a tenth aspect, the present application provides a screen projection device, including:

transceiver unit and processing unit;

In a possible implementation manner, the processing unit is configured to control the transceiver unit to send to the proxy device an identifier of at least one associated device that has an association relationship with the proxy device when the transceiver unit receives a request for an associated device from the proxy device; the processing unit further uses Therefore, the control transceiving unit receives the proxy screen projection request from the proxy device, and the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device; wherein at least one associated device includes the screen projection source device; processing The unit is also used to obtain the channel authorization information of the screen projection target device from the screen projection target device according to the screen projection authorization information, and control the transceiver unit to send the channel authorization information to the screen projection source device; the channel authorization information is used by the screen projection source device Encrypt the screen projection data and send the encrypted screen projection data to the screen projection target device, and the screen projection data will be displayed on the screen projection target device.

In a possible implementation, the processing unit is specifically configured to: control the transceiver unit to send a channel authorization request to the screen projection target device, the channel authorization request includes screen projection authorization information, and the channel authorization request is used to request a channel from the screen projection target device Authorization information; controlling the transceiver unit to receive the channel authorization information from the screen projection target device.

For the technical effects that can be achieved by any possible implementation manner in the above tenth aspect, reference may be made to the description of beneficial effects in the above second aspect, and details are not repeated here.

In an eleventh aspect, the present application provides a screen projection device, including:

transceiver unit and processing unit;

In a possible implementation manner, the processing unit is configured to acquire the screen-casting authorization information of the screen-casting target device; The device has an identification of at least one associated device with an association relationship; the processing unit is also used to control the transceiver unit to receive a first user operation, the first user operation is for the user to select one of the at least one associated device as the screen projection source device, and control the transceiver unit Send a proxy screen projection request to the service device, the proxy screen projection request includes the screen projection authorization information and the identification of the screen projection source device, and the proxy screen projection request is used to instruct the service device to send a screen projection event notification to the screen projection source device.

In a possible implementation manner, before the processing unit controls the transceiver unit to receive the first user operation, it is further configured to: display an identifier of at least one associated device on a display interface of the screen projection device.

For the technical effects that can be achieved by any possible implementation manner in the above eleventh aspect, reference may be made to the description of beneficial effects in the above third aspect, and details are not repeated here.

In a twelfth aspect, the present application provides a screen projection device, including:

transceiver unit and processing unit;

In a possible implementation manner, the processing unit is configured to control the transceiving unit to receive a screen casting event notification from the service device, the screen casting event notification includes screen casting authorization information, and the screen casting event notification It is sent by the service device in response to the proxy device’s proxy screen projection request, and the screen projection device has an association relationship with the proxy device; the processing unit is also used to control the screen projection according to the screen projection authorization information The transceiving unit sends the screen projection data of the screen projection device to the screen projection target device, and the screen projection data is displayed on the screen projection target device.

In a possible implementation manner, before the processing unit controls the transceiving unit to send the screen projection data of the screen projection device to the screen projection target device according to the screen projection authorization information, it is further configured to: according to the A screen projection event notification, prompting the user whether to agree to screen projection; controlling the transceiver unit to receive an indication of the user's consent to screen projection.

In a possible implementation manner, the processing unit is specifically configured to: control the transceiver unit to send a first screen projection request to the screen projection target device according to the screen projection authorization information, the first screen projection request includes the screen projection authorization information and the identification of the screen projection source device; controlling the transceiver unit to receive the channel authorization information from the screen projection target device; encrypting the screen projection data according to the channel authorization information, and sending the encrypted screen projection data to the screen projection target device.

In a possible implementation manner, the processing unit is specifically configured to: control the transceiver unit to send a first screen projection request to the screen projection target device via the service device; control the transceiver unit to receive the screen projection forwarded by the service device Channel authorization information for the target device.

For the technical effects that can be achieved by any possible implementation in the above-mentioned twelfth aspect, reference may be made to the description of beneficial effects in the above-mentioned fourth aspect, and details are not repeated here.

In a thirteenth aspect, the present application provides a screen projection device, including:

transceiver unit and processing unit;

In a possible implementation manner, the processing unit controls the transceiving unit to receive a first screen projection request from the screen projection source device, and the first screen projection request includes the screen projection authorization information of the screen projection target device and the identification of the screen projection source device , the screen projection authorization information is used by the screen projection source device to request the channel authorization information of the screen projection target device from the screen projection target device, and the channel authorization information is used by the screen projection source device to encrypt the screen projection data; when the screen projection target device is not idle In this case, the processing unit adds the identifier of the screen-casting source device to the screen-casting queue of the screen-casting target device.

In a possible implementation manner, when the screen projection target device is in an idle state, the processing unit is further configured to control the transceiver unit to send channel authorization information to the screen projection source device.

In a possible implementation, the processing unit is specifically configured to control the transceiver unit to receive the first screen projection request of the screen projection source device forwarded by the service device; control the transceiver unit to send channel authorization information to the screen projection source device via the service device .

For the technical effects that can be achieved by any one of the possible implementations in the above-mentioned thirteenth aspect, reference may be made to the description of beneficial effects in the above-mentioned fifth aspect, and details are not repeated here.

In a fourteenth aspect, the present application provides a screen projection device, including:

transceiver unit and processing unit;

In a possible implementation manner, the processing unit controls the transceiver unit to send the information of the first screen projection target device to the screen projection source device, and the information of the first screen projection target device includes an identifier of the first screen projection target device; the first The screen projection target device has an association relationship with the screen projection source device; the control transceiver unit receives the second screen projection request from the screen projection source device; the second screen projection request contains the identity of the second screen projection target device; the second screen projection target The device is the first receiving device in an idle state; according to the identification of the second screen-casting target device, the channel authorization information of the second screen-casting target device is obtained from the second screen-casting target device; Channel authorization information. The channel authorization information is used by the screen projection source device to encrypt the screen projection data and send the encrypted screen projection data to the second screen projection target device.

In a possible implementation manner, before the processing unit controls the transceiver unit to send the information of the first screen projection target device to the screen projection source device, it is also used to: determine a third screen projection target device that maintains a signaling channel connection with the service device ; Determine the first screen projection target device from the third screen projection target device.

In a possible implementation manner, the processing unit is specifically configured to: control the transceiver unit to send an identifier of the third screen projection target device to the screen projection source device; control the transceiver unit to receive an association request from the screen projection source device, and the association request includes The screen projection source device determines the target identifier from the identifiers of the third screen projection target device; and determines the third screen projection target device corresponding to the target identifier as the first screen projection target device.

In a possible implementation manner, the processing unit is specifically configured to: determine the third screen projection target device as the first screen projection target device.

In a possible implementation manner, the processing unit is specifically configured to: determine, among the third screen projection target devices, a third screen projection target device that belongs to the same area as the screen projection source device as the first screen projection target device.

In a possible implementation manner, the processing unit is specifically configured to: control the transceiver unit to send a third screen projection request to the second screen projection target device according to the identifier of the second screen projection target device; control the transceiver unit to receive the second screen projection The target device responds to the channel authorization information of the second screen projection target device in response to the third screen projection request.

In a possible implementation manner, before the processing unit controls the transceiver unit to send the information of the first screen projection target device to the screen projection source device, it includes: monitoring the screen projection state of the first screen projection target device, and obtaining the first screen projection target Screen projection status information of the device, where the screen projection status information indicates whether the first screen projection target device is in an idle state.

In a possible implementation manner, the information of the first screen-casting target device further includes screen-casting state information of the first screen-casting target device.

In a possible implementation manner, the processing unit is specifically configured to: obtain the identifier of the first screen projection target device whose screen projection state information indicates an idle state among the first screen projection target devices, and control the sending and receiving unit to send to the projection Screen source device.

For the technical effects that can be achieved by any one of the possible implementation manners in the above fourteenth aspect, reference may be made to the description of the beneficial effects in the above sixth aspect, which will not be repeated here.

In a fifteenth aspect, the present application provides a screen projection device, including:

transceiver unit and processing unit;

In a possible implementation manner, the processing unit is configured to control the transceiver unit to receive information of a first screen projection target device from the service device, where the information of the first screen projection target device includes an identifier of the first screen projection target device, and the second A screen projection target device has an association relationship with the screen projection source device; the control transceiver unit sends a second screen projection request to the service device, the second screen projection request contains the identity of the second screen projection target device, and the second screen projection target device is The first screen projection target device in an idle state; control the transceiver unit to receive channel authorization information from the second screen projection target device of the service device; encrypt the screen projection data according to the channel authorization information and control the transceiver unit to convert the encrypted screen projection data Send to the second target device for screencasting.

In a possible implementation manner, before the processing unit controls the transceiver unit to send the second screen projection request to the service device, it is further configured to: display the identity of the first screen projection target device on the display interface of the screen projection device; control the transceiver unit Receive a second user operation, the second user operation is the user selects one of the identifiers of the first screen projection target device in the display interface of the screen projection source device; use the identifier of the first screen projection target device selected by the user as the second screen projection The identity of the target device.

For the technical effects that can be achieved by any one of the possible implementations in the fifteenth aspect above, reference may be made to the description of beneficial effects in the seventh aspect above, and details are not repeated here.

In a sixteenth aspect, the present application provides a screen projection device, including:

transceiver unit and processing unit;

In a possible implementation manner, the processing unit is configured to control the transceiver unit to receive the third screen projection request from the service device, and maintain a signaling channel connection between the service device and the second screen projection target device; Screen request, control the transceiver unit to send the channel authorization information of the second screen projection target device to the service device, the channel authorization information is used by the screen projection source device to encrypt the screen projection data and send the encrypted screen projection data to the second screen projection target device .

For the technical effects that can be achieved by any one of the possible implementations in the sixteenth aspect above, reference may be made to the description of the beneficial effects in the eighth aspect above, and details will not be repeated here.

In a seventeenth aspect, the present application provides a computing device, including a processor, the processor is connected to a memory, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory to The computing device is made to implement the method in any possible implementation manner of any one of the foregoing first aspect to the eighth aspect.

In an eighteenth aspect, the present application provides a computing device, including a processor and a memory, the processor is connected to the memory, the memory is used to store computer programs, and the processor is used to execute the program stored in the memory A computer program, so that the computing device implements the method in any possible implementation manner of any one of the first aspect to the eighth aspect above.

In a nineteenth aspect, the present application provides a computer-readable storage medium, where computer programs or instructions are stored in the computer-readable storage medium, and when the computer programs or instructions are executed by a computing device, the computing device implements the above-mentioned A method in any possible implementation manner of any one of the first aspect to the eighth aspect.

In a twentieth aspect, the present application provides a computer program product, the computer program product includes a computer program or an instruction, and when the computer program or instruction is executed by a computing device, any one of the above first to eighth aspects can be realized A method in any of the possible implementations.

In a twenty-first aspect, the present application provides a chip, including at least one processor and an interface; the interface is used to provide program instructions or data for the at least one processor; the at least one processor is used to execute the A program line of instructions to implement the method in any possible implementation manner of any one of the above-mentioned first aspect to the eighth aspect.

In a twenty-second aspect, the present application provides a screen projection system, including any possible implementation of the above-mentioned ninth aspect, any possible implementation of the above-mentioned eleventh aspect, and the above-mentioned twelfth aspect Any one of the possible implementations, and any one of the possible implementations of the above-mentioned thirteenth aspect.

In a twenty-third aspect, the present application provides a screen projection system, including any possible implementation of the above-mentioned fourteenth aspect, any possible implementation of the above-mentioned fifteenth aspect, and the above-mentioned sixteenth aspect Any possible implementation of the aspect.

For the technical effects that can be achieved by any one of the above seventeenth to twenty-third aspects, reference can be made to the description of beneficial effects in the above first to sixteenth aspects, which will not be repeated here.

Description of drawings

Fig. 1 is a schematic diagram of the architecture of a group of screen projection systems provided by the present application;

FIG. 2 is a schematic flowchart of local screen projection in an existing solution provided by the present application;

FIG. 3 is a schematic diagram of a possible screen projection scenario provided by the present application;

FIG. 4 is a system architecture diagram of a screen projection system applicable to the embodiment of the application provided by the application;

FIG. 5 is a schematic flow chart of a screen projection method exemplarily provided by the present application;

FIG. 6 is a schematic diagram of a display interface of the first group of screen projection source devices provided by the present application;

FIG. 7 is a schematic flowchart of another screen projection method exemplarily shown in the present application;

FIG. 8 is a schematic flowchart of a method for using a waiting queue for screen projection in local projection according to an example of the present application;

FIG. 9 is a schematic flowchart of a method for using a queue to be projected in a remote screen projected according to an example of the present application;

FIG. 10 is a schematic flowchart of another method for using a queue to be screened in remote screen projection shown in the present application;

FIG. 11 is a schematic diagram of a display interface of a second group of screen projection source devices provided by the present application;

FIG. 12 is a schematic flow chart of another screen projection method provided by the present application;

FIG. 13 is a schematic diagram of a display interface of a third group of screen projection source devices provided by the present application;

Fig. 14 is a schematic structural diagram of a screen projection device provided by the present application;

FIG. 15 is a schematic structural diagram of yet another screen projection device exemplarily provided in the present application.

Detailed ways

Screencasting can be to put the screencasting data on the screencasting source device (such as mobile phone, tablet (Pad), computer with wireless transceiver function, etc.) An efficient way to present and share data.

From the perspective of whether content is displayed on the screen-casting source device, in a possible screen-casting example, the screen-casting source device can generate a corresponding screen-casting based on the content (such as video, picture) displayed in the interface of the screen-casting source device The data is sent to the screen-casting target device, and the screen-casting source device and the screen-casting target device display the same content in their respective interfaces. In another example of possible screen projection, the screen projection source device can generate corresponding screen projection data according to the content to be displayed, and send it to the screen projection target device, and the screen projection target device will display the screen projection source in the interface of the screen projection target device The content to be displayed by the device.

The method of screen projection can be a point-to-point local screen projection method in a local area network (LAN), or a remote screen projection method realized through service equipment forwarding.

Fig. 1 (a) is a schematic structural diagram of a local screen projection system exemplarily provided by the present application. The local screen projection system includes a screen projection source device and a screen projection target device. The screen projection source device sends screen projection data to the screen projection target device through the LAN. Correspondingly, the screen projection target device receives and plays the screen projection data.

(b) in FIG. 1 is a schematic structural diagram of a remote screen projection system exemplarily provided by the present application. The remote screen projection system includes a screen projection source device, a screen projection target device and a service device, wherein the screen projection source device forwards the screen projection data to the screen projection target device through the service device, and the screen projection target device receives and plays the screen projection data.

In this application, the screen-casting source device can also be called a screen-casting mobile device, mobile device, sending device, etc., and the screen-casting target device can also be called a screen-casting device, a screen-casting device, a receiving device, a large-screen device, a large-screen device, etc. screen devices, etc. The service device can also be called a server, a server, or a projection service, etc.

Figure 2 is a schematic flow diagram of a local projection screen in an existing solution provided by this application, in this flow:

In step 201, the screen-casting target device displays screen-casting authorization information.

The screen-casting authorization information may be generated by the screen-casting target device. Exemplarily, after the device is started, or after receiving a user's screen projection instruction, the screen projection target device displays the screen projection authorization information on the display interface of the screen projection target device.

Exemplarily, the screen projection authorization information may be a screen projection two-dimensional code, wherein the screen projection two-dimensional code is a black and white graphic record data symbol distributed on a plane (two-dimensional direction) with a certain specific geometric figure according to a certain rule informational. The screen projection authorization information may also be a screen projection code, such as a string composed of numbers, uppercase and lowercase characters, special characters, etc., and the screen projection code is, for example, "Ba34dg#k6".

In step 202, the screen projection source device obtains screen projection authorization information.

Exemplarily, if the screen projection authorization information is a screen projection QR code, the user can use the screen projection source device to scan the screen projection QR code displayed on the screen projection target device, so that the screen projection source device can obtain the screen projection QR code. code. Alternatively, if the screen projection authorization information is a screen projection code, the user may input the screen projection code in the screen projection source device, so that the screen projection source device obtains the screen projection code.

Step 203, the screen projection source device generates a screen projection request according to the screen projection authorization information, and sends the screen projection request to the screen projection target device. The screen casting request includes screen casting authorization information.

In step 204, the screen projection target device determines that the screen projection source device passes the screen projection verification according to the screen projection authorization information in the screen projection request. Specifically, if the screen-casting target device determines that the screen-casting authorization information in the screen-casting request is the screen-casting authorization information displayed on the interface, it determines that the screen-casting source device passes the screen-casting verification.

Step 205, the screen projection target device sends channel authorization information to the screen projection source device.

In this application, the channel authorization information can be understood as an encryption key or an encryption certificate. The channel authorization information is used for encrypted communication between the screen projection source device and the screen projection target device.

Step 206, the screen projection source device sends screen projection data to the screen projection target device according to the channel authorization information.

In an optional implementation, the screen projection source device encrypts the screen projection data according to channel authorization information to obtain encrypted screen projection data (which may be called encrypted data), and then sends the encrypted data to the screen projection target device. Correspondingly, the screen projection target device can decrypt the encrypted data based on the channel authorization information to obtain the screen projection data. In this way, the security of data communication between the screen projection source device and the screen projection target device is guaranteed.

In the process of remote screen projection, the communication between the screen projection source device and the screen projection target device is forwarded by the service device from the middle: the screen projection source device sends a screen projection request to the screen projection target device through the service device, and correspondingly, The screen projection target device sends channel authorization information to the screen projection source device via the service device. Other steps are similar to the above steps 201 to 205 and will not be repeated here.

In order to better explain the embodiment of the present application, the above-mentioned screen casting process is explained in combination with a schematic diagram of a possible screen casting scenario provided as an example in FIG. 3 . The screencasting scene shown in Figure 3 can be a meeting scene. For example, there are three people participating in the meeting, user A, user B, and user C. Among them, user A and user B participate in the meeting in the meeting room, and user C participates in the meeting remotely outside the meeting room. . Each user needs to display the data in his screen-casting source device on the screen-casting target device in the meeting room. For example, user A holds two screen projection source devices, such as mobile phone a and computer d (where mobile phone a and computer d correspond to the same account, that is, the account of user A). User B holds a screen projection source device, such as mobile phone b. User C holds a screen projection source device, such as mobile phone c.

Since user A is in the conference room, user A can use mobile phone a to scan the screen projection QR code displayed on the screen projection target device in the conference room to perform screen projection. Specifically, when user A needs to display the screen projection data in mobile phone a, he can use mobile phone a to scan the screen projection QR code displayed on the screen projection target device, so that mobile phone a can obtain the screen projection QR code. code, and then based on the process in Figure 2, the screen projection data in mobile phone a is sent to the screen projection target device. Similarly, user B can also scan the screen projection QR code displayed on the screen projection target device through mobile phone b, so that mobile phone b can obtain the screen projection QR code, and then based on the process in Figure 2, the screen projection on mobile phone b The data is sent to the screen-casting target device.

Since user C participates in the conference remotely outside the meeting room, user C cannot directly use mobile phone c to scan the screen projection QR code displayed on the screen projection target device to perform screen projection. User A can send a screen projection QR code to mobile phone c through mobile phone a. Correspondingly, user C scans the screen projection QR code through mobile phone c, so that mobile phone c can obtain the screen projection QR code, and then based on Figure 2 In the middle process, the screen projection data in the mobile phone c is sent to the screen projection target device.

Similarly, user A, user B, and user C can also manually input the screen projection code displayed on the screen projection target device into their respective mobile phones, so as to realize sending the screen projection data in their respective mobile phones to the screen projection target device. User C can obtain the screen projection code displayed on the screen projection target device from user A.

For each screen projection, the user needs to scan the screen projection QR code displayed on the screen projection target device through the screen projection source device, or input the screen projection code displayed on the screen projection target device in the screen projection source device, so that The screen projection source device obtains the screen projection authorization information of the screen projection target device. This method requires manual verification by the user, and the operation is cumbersome.

In view of this, in order to reduce user operations and improve the flexibility of screen projection operations in the screen projection system, this application provides a screen projection method, which introduces a proxy device, and the proxy device can be used for one or more screen projection source devices Obtain the screen-casting authorization information of the screen-casting target device, so users corresponding to one or more screen-casting source devices do not need to perform manual verification.

FIG. 4 is an exemplary system architecture diagram of a screen projection system applicable to the embodiment of the present application provided by the present application. Exemplarily, the screen projection system may include a proxy device, a screen projection source device, a service device, and a screen projection target device. In local screen projection, both the screen projection source device and the screen projection target device in FIG. 4 can be connected. FIG. 4 is only exemplary, and the present application does not limit the number of devices.

In a possible implementation manner, the service device can be used to manage information of each terminal device in the screen projection system. Exemplarily, a screen-casting application may be installed in the terminal device, and the terminal device may log in to the service device through the screen-casting application before interacting with the service device. Information of the terminal device is recorded in the service device, such as an account Information, device identification, Internet protocol (internet protocol, IP) address, port number, etc. Exemplarily, the terminal device may be a proxy device, or a screen projection source device, or a screen projection target device.

In the screen projection system, the proxy device can request screen projection authorization information for the screen projection source device in the screen projection system. For example, the proxy device can be understood as a near-end device relative to the screen projection target device. The screen source device is understood as a remote device relative to the screen projection target device.

There is an association relationship between the proxy device and the screen projection source device. In a possible implementation manner, the association relationship between the two may at least include one or more of the following:

(1) The proxy device and the source device for screen projection correspond to the same account.

For example, in the conference scene shown in Figure 3, user A wants to display the screen projection data on computer d on the screen projection target device, and user A can obtain the projection data displayed on the screen projection target device for computer d through mobile phone a. screen authorization information. Here, the mobile phone a is the proxy device, and the computer d is the screen projection source device.

(2) The agent device and the screen projection source device correspond to the same group or the same department.

For example, in the meeting scenario shown in Figure 3, user A and user C participate in the same meeting, and user A's mobile phone a is associated with user C's mobile phone c (it can be understood that mobile phone a and mobile phone c correspond to the same group group), user A can obtain the screen-casting authorization information displayed on the screen-casting target device for mobile phone c through mobile phone a. Here, mobile phone a is the proxy device, and mobile phone c is the source device for screen projection.

Of course, other association methods are also possible, which are not limited in this application.

FIG. 5 is a schematic flowchart of a screen projection method exemplarily provided in the present application. In this process:

In step 501, the screen-casting target device displays screen-casting authorization information.

In the manner of local screen projection, the screen projection authorization information may be generated and displayed by the screen projection target device.

In the way of remote screen projection, the screen projection authorization information may be generated and displayed by the screen projection target device, or obtained and displayed by the screen projection target device from the service device.

In step 502, the proxy device acquires screen projection authorization information.

The screen projection authorization information can be a screen projection QR code, and the user can use the proxy device to scan the screen projection QR code displayed on the screen projection target device, so that the proxy device can obtain the screen projection QR code. Alternatively, the screen projection authorization information may also be a screen projection code, and the user may input the screen projection code in the proxy device, so that the proxy device obtains the screen projection code. For the convenience of description, the following uses the screen-casting authorization information as the screen-casting QR code as an example.

It should be noted that when the proxy device obtains the screen projection authorization information, it can also obtain the information of the screen projection target device, such as one or more of the device identification, IP address, and port number of the screen projection target device. The information of the target device can be used by the subsequent service device or the screen projection source device to request screen projection from the screen projection target device.

It should also be noted that the proxy device may also send screen projection data to the screen projection target device. In an example, after the proxy device obtains the screen-casting authorization information, it may display first prompt information on the interface of the proxy device, and the first prompt message is used to remind the user of the proxy device that the obtained screen-casting information Is it used for the proxy device itself to cast the screen, or for other devices to cast the screen. If the user of the proxy device indicates that the acquired screen projection information is for other devices (that is, the screen projection source device that needs proxy projection), the proxy device can further obtain the screen projection source device that needs proxy projection. identification, and execute the following step 503. If the user of the proxy device indicates that the acquired screen projection information is for the proxy device itself to project the screen, the proxy device can send the screen projection data to the screen projection target device. For details, refer to the process in FIG. 2 , and will not repeat it here.

In the above process, the proxy device can obtain the identification of the screen-casting source device that needs proxy screen-casting in the following ways:

In this application, an identifier of a device (which may be referred to as an associated device) that has an association relationship with the proxy device is pre-recorded in the service device. Correspondingly, the agent device may obtain identifiers of multiple associated devices from the service device, and then determine the identifier of the associated device that needs to be proxied (ie, the identifier of the screen-casting source device) from the identifiers of the multiple associated devices.

In a possible implementation manner, the proxy device may send an association device request to the service device, where the association device request carries an identifier of the proxy device, and the association device request is used to request an association device identifier from the service device. Correspondingly, the service device may determine the identifier of the associated device according to the identifier of the proxy device in the request for associating the device, and send the identifier of the associated device in the response message to the proxy device. The proxy device may display the identifier of the associated device in the response message on the display interface of the proxy device, and the user performs a first user operation, wherein the first user operation may be that the user selects the associated device ID displayed on the display interface of the proxy device. The proxy device needs the identification of the associated device for proxying (that is, the identification of the screen projection source device). According to the operation of the first user, the proxy device acquires the identifier of the screen projection source device that needs proxy screen projection.

For example, the service device records the identifiers of associated devices corresponding to the proxy device 1, such as identifier 11, identifier 12, and identifier 13. During the process that the proxy device acquires the ID of the screen projection source device that needs proxy projection, the associated device request sent by the proxy device 1 to the service device carries the ID of the proxy device 1. Correspondingly, the service device , and send a response message to the agent device 1, the response message includes the identifiers of the associated devices, that is, the identifier 11, the identifier 12 and the identifier 13. The proxy device 1 can display the identification 11, the identification 12 and the identification 13 in the display interface of the proxy device, and the user selects the identification of one of the associated devices in the display interface of the proxy device, such as the user selects the identification 11, and the proxy device receives After the instruction from the user to select the logo 11, the logo 11 is used as the logo of the screen-casting source device.

In step 503, the proxy device sends a proxy screen projection request to the service device, and the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device.

Step 504, the service device determines that the proxy device has an association relationship with the screen projection source device.

After receiving the proxy screen projection request from the proxy device, the service device can obtain the screen projection source device identification and screen projection authorization information of the screen projection target device from the proxy screen projection request. In response to the proxy screen projection request, the service device verifies whether the proxy device is qualified to act as a proxy for the screen projection source device.

In an optional implementation manner, if the service device determines that there is an association relationship between the proxy device and the screen projection source device (for example, the service device determines that the pre-recorded identifier of the associated device of the proxy device includes the ID of the screen-casting source device), then step 505 is performed. If the service device determines that there is no association between the proxy device and the screen projection source device, it rejects the proxy device's proxy screen projection request.

Wherein, step 504 is an optional step, which can be used to ensure that only the proxy device associated with the screen-casting source device can obtain screen-casting authorization information for the screen-casting source device, so as to improve the security of screen-casting by the screen-casting source device. Of course, the service device may also directly perform step 505 after receiving the proxy screen projection request from the proxy device.

Step 505, the service device sends a screen projection event notification to the screen projection source device, and the screen projection event notification includes screen projection authorization information of the screen projection target device.

The service device may send a screen projection event notification to the screen projection source device according to the identifier of the screen projection source device in the proxy screen projection request. Correspondingly, the screen-casting source device may obtain the screen-casting authorization information of the screen-casting target device based on the screen-casting event notification from the service device.

After obtaining the screen projection authorization information, the screen projection source device may determine whether to project the screen to the screen projection target device based on the screen projection authorization information. In an optional manner, the screen projection source device may display second prompt information on the display interface of the screen projection source device, and the second prompt information is used to prompt the user of the screen projection source device whether to agree to screen projection. If the user of the screen projection source device indicates to agree to screen projection, the screen projection source device performs the following step 506. If the user of the screen projection source device indicates to reject the screen projection, the screen projection source device may send a rejection message to the service device. Avoid the problem of leakage of sensitive data in the source device of screencasting.

In another optional way, if the proxy device and the screen projection source device correspond to the same account, if the proxy device obtains the screen projection authorization information for the screen projection source device, the screen projection source device can agree to the projection by default. Screen. Specifically, when the service device determines that the proxy device and the screen projection source device correspond to the same account, when the service device sends a screen projection event notification to the screen projection source device, it may instruct the screen projection source device not to display the second prompt information , and directly request channel authorization information from the screen-casting target device according to the screen-casting authorization information in the screen-casting event notification.

In this application, after the screen projection source device receives the screen projection event notification from the service device, the screen projection source device can request channel authorization information from the screen projection target device, and transmit the projection information with the screen projection target device based on the requested channel authorization information. screen data. Based on different projection methods, there are two cases as follows:

In the way of local projection:

Step 506A, the screen casting source device sends a first screen casting request to the screen casting target device, wherein the first screen casting request includes screen casting authorization information of the screen casting target device. The first screen projection request is used for the screen projection source device to request channel authorization information of the screen projection target device from the screen projection target device.

In step 507A, the screen projection target device sends channel authorization information of the screen projection target device to the screen projection source device after determining that the screen projection authorization information included in the first screen projection request has passed the verification. Specifically, if the screen projection target device determines that the screen projection authorization information in the first screen projection request is its own screen projection authorization information, it determines that the screen projection authorization information included in the first screen projection request has passed the verification, and reports to the screen projection source The device sends the channel authorization information of the screencasting target device.

Step 508A, the screen projection source device sends screen projection data to the screen projection target device according to the channel authorization information.

The screen projection source device can encrypt the screen projection data according to the channel authorization information to obtain encrypted data. The screen projection source device sends encrypted data to the screen projection target device. Correspondingly, the screen projection target device decrypts the encrypted data according to the channel authorization information to obtain the screen projection data. In an example, long connection data communication is used between the screen projection source device and the screen projection target device, for example, transmission control protocol (transmission control protocol, TCP) communication is used between the screen projection source device and the screen projection target device. In another example, there is no link data communication between the screen projection source device and the screen projection target device, for example, user data protocol (UDP) communication is used between the screen projection source device and the screen projection target device.

In the way of remote projection:

Step 506B, the screen projection source device sends a first screen projection request to the screen projection target device via the service device.

Among them, after the service device receives the first screen projection request from the screen projection source device, it can verify whether the screen projection source device is a trusted screen projection source device, that is, verify whether it is a screen projection source that has logged into the service device If yes, the device forwards the first screen-casting request to the screen-casting target device, thereby helping to improve the security of screen-casting.

Step 507B, after the screen projection target device determines that the screen projection authorization information included in the first screen projection request has passed the verification, it sends channel authorization information of the screen projection target device to the screen projection source device via the service device. Specifically, if the screen-casting target device determines that the screen-casting authorization information in the first screen-casting request is its own screen-casting authorization information, it determines that the screen-casting authorization information included in the first screen-casting request has passed the The screen source device sends the channel authorization information of the screen projection target device.

In step 508B, the screen projection source device sends screen projection data to the screen projection target device via the service device according to the channel authorization information.

Similar to the introduction in step 508A, details are not repeated here.

What needs to be added is that in the scenario where the service device generates the screen-casting authorization information of the screen-casting target device, the service device can maintain the correspondence between the screen-casting target device and the screen-casting authorization information, for example, the screen-casting target device 1 corresponds to the The screen-casting authorization information 1 and the screen-casting target device 2 correspond to the screen-casting authorization information 2 and so on. Correspondingly, after receiving the first screen projection request from the screen projection source device, the service device can not only verify whether the screen projection source device is a trusted screen projection source device, but also verify the screen projection authorization included in the first screen projection request. Whether the information is verified. Specifically, the service device may determine whether the screen projection authorization information included in the first screen projection request is the same as the screen projection authorization information of the screen projection target device maintained in the service device, and if so, determine that the screen projection authorization information has passed the verification . Subsequently, the service device can obtain the channel authorization information of the screen projection target device from the screen projection target device according to the screen projection authorization information, and send the channel authorization information to the screen projection source device; or, the service device generates the screen projection target device. Channel authorization information, and send the channel authorization information to the screen projection source device and the screen projection target device respectively.

Step 509, the screen projection target device displays the screen projection data.

Optionally, the screen projection target device may display the screen projection data on a display interface of the screen projection target device. In the meeting scene as shown in Figure 3, mobile phone c can display the screen projection data of mobile phone c on the screen projection target device under the operation of user C, so that user A and user B can share the screen projection data on the screen projection target device See the interface of mobile phone c.

In order to better explain the process shown in the above step 501 to step 509, the following still uses an example in conjunction with the conference scene shown in FIG. 3 . For example, the associated devices of mobile phone a include mobile phone b, mobile phone c, and computer d, and the identifications of mobile phone a, mobile phone b, mobile phone c, and computer d are respectively identification a, identification b, identification c, and identification d.

Example 1, user A casts the screen on behalf of mobile phone c through mobile phone a.

User A can scan the screen-casting QR code displayed by the screen-casting target device with mobile phone a, and obtain the screen-casting authorization information of the screen-casting target device. At this time, the display interface of the mobile phone a may be as shown in (a) in FIG. 6 , where a first prompt message is displayed, and the first prompt message is "whether to request screen projection for other devices". If mobile phone a detects that user A selects "Yes" in the display interface, it will send an associated device request to the service device in response to the selection operation. The associated device request carries the identification of mobile phone a, and the associated device request is used to send The service device requests the identification of the associated device of mobile phone a.

The service device sends a response message to the mobile phone a according to the identification of the mobile phone a in the associated device request, and the response message includes the identifications of the associated devices of the mobile phone a: identification b, identification c, identification d.

After mobile phone a receives the response message, it displays the logo b, logo c, and logo d on the display interface of mobile phone a, and prompts the user to choose which device to request screen projection for, see (b) in Figure 6 for details. If the user selects the identification c on the display interface of the mobile phone a, the mobile phone a sends a proxy screen projection request to the service device, and the proxy screen projection request includes the identification c and screen projection authorization information. In response to the proxy screen projection request, the service device determines that mobile phone c has an association relationship with mobile phone a, and sends the screen projection authorization information to mobile phone c in the screen projection event notification.

After mobile phone c receives the screen projection event notification, a second prompt message may pop up on the display interface of mobile phone c, and the second prompt message may be used to prompt user C corresponding to mobile phone c whether to agree to screen projection. Exemplarily, the display interface of mobile phone c can be referred to as shown in (c) in FIG. , in response to the operation, a first screen projection request is sent to the screen projection target device, and the first screen projection request includes screen projection authorization information. Further, after receiving the first screen projection request, the screen projection target device determines that the screen projection authorization information in the first screen projection request has passed the verification, and sends the channel authorization information to the mobile phone c. Mobile phone c performs encrypted transmission of screen projection data with the screen projection target device based on the channel authorization information.

Example 2: User A casts the screen on behalf of computer d through mobile phone a.

The mobile phone a and the computer d are both terminal devices of the user A, that is, they correspond to the same account. User A can use mobile phone a to scan the screen projection QR code displayed on the screen projection target device, and the display interface of mobile phone a can still be shown in (a) in FIG. 6 . The mobile phone a requests the identification of the associated device from the service device, and displays the identification of the associated device on the display interface, for example, refer to (b) in FIG. 6 . User A can select the logo d in the interface of mobile phone a, then mobile phone a sends a proxy screen projection request to the service device, and the service device sends a screen projection event notification to computer d in response to the proxy screen projection request. Wherein, the service device can determine that the mobile phone a and the computer d correspond to the same account, and when sending the screen projection event notification to the computer d, can instruct the computer d not to display the second prompt information, but directly follow the projection information in the screen projection event notification. screen authorization information, and send a first screen projection request to the screen projection target device. Further, after receiving the first screen projection request, the screen projection target device determines that the screen projection authorization information in the first screen projection request has passed the verification, and sends the channel authorization information to the computer d. The computer d encrypts and transmits screen projection data with the screen projection target device based on the channel authorization information. Since the mobile phone a and the computer d both correspond to the same account (that is, the account of user A), user A does not need to confirm on the computer d again, which helps to reduce user operations.

In the above technical solution, the proxy device assists the screen projection source device to obtain the screen projection authorization information of the screen projection target device, and sends the screen projection authorization information to the service device, and the service device sends a screen projection event notification to the screen projection source device, and the screen projection The event notification contains the screen projection authorization information, so that the screen projection source device can request the channel authorization information of the screen projection target device from the screen projection target device according to the screen projection authorization information in the screen projection event notification, and then according to the channel of the screen projection target device The authorization information and the screen projection target device transmit the screen projection data. In this solution, the user does not need to scan the projection QR code on the projection target device through the projection source device, or enter the projection code on the projection target device in the projection source device, which reduces user operations and helps to improve user experience. Moreover, the proxy device can obtain the screen projection authorization information of the screen projection target device for each of the multiple screen projection source devices, so as to realize the unified proxy of the proxy device. In large-scale conference scenarios, the proxy device can be used for management personnel Unified scheduling of different screen projection source devices to switch screen projection to screen projection target devices, without the need for each user to manually verify authorization, and also helps to avoid user operation preemption.

This application provides another implementation of the screen projection method. Compared with the implementation shown in FIG. 5, the service device does not need to send the projection screen request to the screen projection source device when receiving the proxy screen projection request sent by the proxy device. Screen event notification, and directly request channel authorization information from the screen projection target device, which helps to reduce signaling interaction.

For details, please refer to the schematic flowchart of another screen projection method shown in FIG. 7 exemplarily:

In step 701, the screen projection target device displays screen projection authorization information.

In step 702, the proxy device acquires screen projection authorization information.

In step 703, the proxy device sends a proxy screen projection request to the service device, and the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device.

Optionally, in step 704, the service device determines that the proxy device has an association relationship with the screen projection source device.

Step 705, the service device sends a channel authorization request to the screen projection target device, and the channel authorization request includes screen projection authorization information of the screen projection target device. In a possible manner, the channel authorization request sent by the service device to the screen projection target device may also include the identification of the screen projection source device, such as the port number of the screen projection source device, to inform the screen projection target device of the channel authorization request. Although the terminal is a service device, the channel authorization request is used to request channel authorization information for the screen projection source device. Thus, the screen projection target device can determine the screen projection source device that needs to obtain the channel authorization information.

Step 706: After the screen projection target device determines that the screen projection authorization information included in the channel authorization request has passed the verification, it sends the channel authorization information to the screen projection source device via the service device.

Step 707, the screen projection source device sends screen projection data to the screen projection target device according to the channel authorization information.

In this application, if it is a local projection method, the projection source device sends projection data to the projection target device according to the channel authorization information; if it is a remote projection method, the projection source device sends the projection data to the projection target device according to the channel authorization information The device sends screen projection data to the screen projection target device.

Step 708, the screen projection target device displays the screen projection data.

In this method, in order to ensure the security of the data in the screen projection source device, after the screen projection source device receives the channel authorization information from the service device, the screen projection source device can determine whether it needs to perform screen projection. Specifically, the screen projection source device may display third prompt information on the display interface. The third prompt information is used to prompt the user whether to project the data in the screen projection source device to the screen projection target device. If the user agrees, then The screen projection source device sends screen projection data to the screen projection target device according to the channel authorization information.

In addition, the service device may also determine whether the proxy device and the screen-casting source device correspond to the same account during the process of determining whether the agent device and the screen-casting source device have an association relationship. If the two correspond to the same account, the service device can directly send a channel authorization request to the screen projection target device. If the two do not correspond to the same account, the service device can determine whether screen projection is required from the screen projection source device. Correspondingly, the screen projection source device displays a third prompt message on the display interface, and the third prompt message prompts the user whether to It is necessary to project the data in the screen-casting source device to the screen-casting target device. If the user agrees, the screen-casting source device will send a confirmation message to the service device, and then the service device will request channel authorization information from the screen-casting target device.

In this application, the screen-casting state of the screen-casting target device may include an idle state and a non-idle state. If the target screen casting device is idle, it can be understood that the target screen casting device has not been used by the screen casting source device for screen casting (for example, it has not received the screen projection data from the screen casting source device); if the screen casting target device is not idle, it can be It is understood that the screen projection target device has been used by the screen projection source device for screen projection (for example, receiving screen projection data from the screen projection source device).

In the case that the screen projection target device can only receive the screen projection data of one screen projection source device, if the screen projection source device needs to request screen projection from a non-idle screen projection target device, the request will fail. Because the screen projection target device is currently receiving screen projection from other screen projection source devices. In this case, the screen projection source device needs to wait for the screen projection target device to change from the non-idle state to the idle state, and then request the screen projection target device again to request screen projection success. However, in this case, the screen projection source device cannot detect in time that the screen projection target device changes from a non-idle state to an idle state, that is, it cannot timely project a screen to the screen projection target device.

For this reason, this application provides a method of a waiting screen projection queue, which is used to cache and send the screen projection request in the waiting screen projection queue according to the screen projection request from the screen projection source device when the screen projection target device is in a non-idle state The identification of the screen-casting source device is used to notify the screen-casting source device in time to perform screen-casting after the screen-casting target device changes from a non-idle state to an idle state.

The manner of the waiting screen projection queue provided by the present application can be applied to the screen projection system shown in FIG. 1 , and can also be applied to the screen projection system shown in FIG. 4 .

This application is based on different projection methods, as follows:

Situation 1: For local screen projection, the queue to be screen projection can be set in the screen projection target device.

Refer to FIG. 8 for a schematic flowchart of a method for using a queue to be screened in local screen projection shown as an example:

In step 801, the screen projection source device sends a first screen projection request to the screen projection target device.

After the screen projection target device receives the first screen projection request, it can select the next steps to be performed according to the current screen projection state of the screen projection target device. Specifically, when the screen-casting state of the screen-casting target device is idle, the screen-casting target device performs step 802; when the screen-casting target device is not idle, the screen-casting target device performs step 803 and step 804 .

Step 802: After determining that the screen projection authorization information included in the first screen projection request has passed the verification, the screen projection target device sends channel authorization information of the screen projection source device to the screen projection source device.

In step 803, the screen projection target device caches the identifier of the screen projection source device in the screen projection queue of the screen projection target device. In this application, the screen-casting target device caches the identifier of the screen-casting source device in the screen-to-be-cast queue of the screen-casting target device. In the casting queue.

In a possible implementation, the target screen projection device may send a rejection response (also called a screen projection non-idle notification) to the screen projection source device, and accordingly, the screen projection source device displays a fourth prompt message on the display interface , the fourth prompt message is used to prompt the user whether to wait for the screen projection. If the user confirms that it needs to wait for the screen projection, the screen projection source device will send a confirmation waiting message to the screen projection target device, and the screen projection target device will use the identification of the screen projection source device Buffered to the screen-to-be-cast queue of the screen-casting target device.

Step 804, after the screen projection target device changes from the non-idle state to the idle state, it sends a screen projection idle notification to the screen projection source device, and the screen projection idle notification is used to instruct the screen projection source device to re-initiate a screen projection request.

In a possible implementation, the screen-casting authorization information of the screen-casting target device can be updated according to a preset cycle, so as to ensure the security of the screen-casting. In this case, the screen-casting target device can regenerate the screen-casting authorization information , and include the regenerated screen casting authorization information in the screen casting idle notification, and send it to the screen casting source device.

Correspondingly, after receiving the screen projection idle notification, the screen projection source device resends the first screen projection request to the screen projection target device. In a possible implementation, after receiving the screen projection idle notification, the screen projection source device may display fifth prompt information on the display interface. The fifth prompt information is used to prompt the user whether to continue screen projection. If the user confirms If it is necessary to continue screen projection, the screen projection source device may resend the first screen projection request to the screen projection target device. Afterwards, the screen projection target device sends channel authorization information of the screen projection target device to the screen projection source device according to the first screen projection request. That is, the above step 801 and step 802 can be returned.

What needs to be added is that one or more identifiers of the screen-casting source devices may be cached in the waiting screen-casting queue of the screen-casting target device. After the screen projection state of the screen projection target device changes from the non-idle state to the idle state, the screen projection target device can determine the screen projection source device that is still in the waiting state from the one or more screen projection source devices, and then according to the The priority of the screen projection source device that is still in the waiting state determines a screen projection source device, and sends a screen projection idle notification to the screen projection source device.

In addition, the screen projection target device can also broadcast a screen projection idle notification. Correspondingly, the screen projection source device that is still in the waiting state can send the first screen projection request to the screen projection target device through competition, and the screen projection target device determines a projection screen. The screen source device, and then send the channel authorization information of the screen projection target device to the screen projection source device.

Situation 2: In the way of remote projection, the queue to be projected can be set in the projected target device or service device.

Case 1: The queue to be casted is set in the target device for screencasting.

Refer to FIG. 9 for a schematic flow diagram of a method for using a queue to be screened in remote screen projection shown as an example:

In step 901, the screen projection source device sends a first screen projection request to the screen projection target device via the service device.

After the screen projection target device receives the first screen projection request, it can select the next steps to be performed according to the current screen projection state of the screen projection target device. Specifically, when the screen-casting state of the screen-casting target device is idle, the screen-casting target device performs step 902; when the screen-casting target device is in a non-idle state, the screen-casting target device performs step 903 and step 904 .

Step 902: After determining that the screen-casting authorization information included in the first screen-casting request has passed the verification, the screen-casting target device sends the channel authorization information of the screen-casting target device to the screen-casting source device via the service device.

In step 903, the screen projection target device caches the identifier of the screen projection source device in the screen projection queue of the screen projection target device. In a possible implementation manner, the screen projection target device may send a rejection response to the screen projection source device through the service device, and correspondingly, the screen projection source device displays fourth prompt information on the display interface, and the fourth prompt information is used to prompt Does the user need to wait for the screen projection? If the user confirms that they need to wait for the screen projection, the screen projection source device sends a confirmation waiting message to the screen projection target device through the service device, and the screen projection target device caches the identity of the screen projection source device to the screen projection target The device is in the screen waiting queue.

Step 904: After the screen projection target device changes from the non-idle state to the idle state, it sends a screen projection idle notification to the screen projection source device via the service device, and the screen projection idle notification is used to instruct the screen projection source device to re-initiate the screen projection request.

In a possible implementation manner, the screen projection authorization information of the screen projection target device may be updated according to a preset period, so as to ensure the security of the screen projection. In this case, the screen projection target device may regenerate the screen projection authorization information, include the regenerated screen projection authorization information in the screen projection idle notification, and send it to the screen projection source device through the service device.

Correspondingly, after receiving the screen projection idle notification, the screen projection source device re-sends the first screen projection request to the screen projection target device via the service device. In a possible implementation, after receiving the screen projection idle notification, the screen projection source device may display fifth prompt information on the display interface. The fifth prompt information is used to prompt the user whether to continue screen projection. If the user confirms If it is necessary to continue screen projection, the screen projection source device may resend the first screen projection request to the screen projection target device. Afterwards, according to the first screen projection request, the screen projection target device sends channel authorization information of the screen projection target device to the screen projection source device via the service device. That is, the above step 901 and step 902 can be returned.

What needs to be added is that one or more identifiers of the screen-casting source devices may be cached in the waiting screen-casting queue of the screen-casting target device. After the screen projection state of the screen projection target device changes from the non-idle state to the idle state, the screen projection target device can determine the screen projection source device that is still in the waiting state from the one or more screen projection source devices, and then according to the The priority of the screen projection source device in the waiting state determines a screen projection source device, and sends a screen projection idle notification to the screen projection source device through the service device.

In addition, the screen projection target device may also send a screen projection idle notification to the service device, and the service device broadcasts the screen projection idle notification. Correspondingly, the screen projection source device that is still in the waiting state can send the first screen projection request to the service device through competition, and the service device determines a screen projection source device, and then requests the channel of the screen projection target device for the screen projection source device authorization information. Or, the screen projection source device sends the first screen projection request to the screen projection target device through the service device through competition, and the screen projection target device determines a screen projection source device, and then sends the screen projection target to the screen projection source device through the service device The channel authorization information of the device.

Case 2: The queue to be projected is set in the service device.

Refer to FIG. 10 for a schematic flowchart of another method for using a queue to be screened in remote screen projection:

Step 1001, the screen projection source device sends a first screen projection request to the service device.

After receiving the first screen projection request, the service device may obtain the current screen projection status of the screen projection target device. In an optional example, the service device may monitor the screen projection state of the screen projection target device in real time, and then determine whether the current screen projection state of the screen projection target device is an idle state or a non-idle state.

The service device selects the next steps to be performed according to the current screen projection status of the screen projection target device. Specifically, when the server device determines that the screen-casting state of the screen-casting target device is idle, the service device executes step 1002; when the server device determines that the screen-casting state of the screen-casting target device is not idle, the service device executes step 1004.

Step 1002, the service device sends a first screen projection request to the screen projection target device, and the first screen projection request includes screen projection authorization information.

Step 1003, after the screen projection target device determines that the screen projection authorization information included in the first screen projection request passes the verification, it sends channel authorization information of the screen projection target device to the screen projection source device via the service device.

Step 1004, the service device caches the identifier of the screen projection source device in the queue of the service device to be screen projection. In this application, the service device caches the identity of the screen-casting source device in the screen-to-be-cast queue of the screen-casting target device, which can also be understood as the service device caches the first screen-casting request in the screen-to-be-cast queue of the screen-casting target device .

In a possible implementation manner, the service device may send a rejection response to the screen projection source device. Correspondingly, the screen projection source device displays fourth prompt information on the display interface, and the fourth prompt information is used to prompt the user whether to wait for the screen projection. screen, if the user confirms that it needs to wait for the screen projection, the screen projection source device sends a confirmation waiting message to the service device, and the service device caches the identity of the screen projection source device into the waiting screen projection queue of the service device.

Step 1005, after the screen projection target device changes from the non-idle state to the idle state, the service device sends a screen projection idle notification to the screen projection source device, and the screen projection idle notification is used to instruct the screen projection source device to re-initiate a screen projection request.

In a possible implementation manner, the screen-casting authorization information of the screen-casting target device may be updated by the service device according to a preset period, so as to ensure the security of screen-casting. In this case, the service device may regenerate the screen projection authorization information, include the regenerated screen projection authorization information in the screen projection idle notification, and send it to the screen projection source device. In addition, the service device may also send the regenerated screen projection authorization information to the screen projection target device.

Correspondingly, after receiving the screen projection idle notification, the screen projection source device re-sends the first screen projection request to the service device, and then the service device sends the first screen projection request to the screen projection target device. In a possible implementation, after receiving the screen projection idle notification, the screen projection source device may display fifth prompt information on the display interface. The fifth prompt information is used to prompt the user whether to continue screen projection. If the user confirms If it is necessary to continue screen projection, the screen projection source device may resend the first screen projection request to the screen projection target device. Afterwards, according to the first screen projection request, the screen projection target device sends channel authorization information of the screen projection target device to the screen projection source device via the service device. That is, it can return to the above step 1001 to step 1003 again.

What needs to be added is that in the embodiment of the present application, the method for the service device to determine whether the screen-casting target device is in an idle state may also be: after receiving the first screen-casting request, the service device sends the first screen-casting request to the screen-casting target device. Screencasting request, if the channel authorization information from the screencasting target device is received, it means that the current screencasting status of the screencasting target device is idle; if a rejection response from the screencasting target device is received (also called non-idle notification), which means that the current screen-casting state of the screen-casting target device is non-idle state. Further, after the screen projection target device changes from the non-idle state to the idle state, the screen projection target device may send a screen projection idle notification to the service device, and the service device sends the screen projection idle notification to the screen projection source device.

What needs to be added is that one or more identifiers of screen projection source devices may be cached in the waiting screen projection queue of the service device. After the screen projection status of the screen projection target device changes from the non-idle state to the idle state, the service device can determine the screen projection source device that is still in the waiting state from the one or more screen projection source devices, and then According to the priority of the screen projection source device in the state, a screen projection source device is determined, and a screen projection idle notification is sent to the screen projection source device.

In addition, the service device can also broadcast a screen projection idle notification. Correspondingly, the screen projection source device that is still in the waiting state sends the first screen projection request to the service device through competition. The service device determines a screen projection source device, and then provides the The screen projection source device requests the channel authorization information of the screen projection target device.

Through the above method, when the screen-casting state of the screen-casting target device changes from non-idle state to idle state, the screen-casting source device can receive a screen-casting idle notification from the screen-casting target device or from the service device, so that the screen-casting source The device can send the screen projection request to the screen projection target device again in time, so that the screen projection source device can cast the screen to the screen projection target device in time. It is not necessary for the user of the screen-casting source device to manually check the screen-casting status of the current screen-casting target device, which helps to improve user experience. In the case that multiple screen projection source devices need to cast screens sequentially, it is helpful to quickly switch and cast screens for screen projection target devices.

In order to better explain the flow of the waiting queue in this application, the conference scene shown in FIG. 3 is used as an example below. Assume that mobile phone a, mobile phone b, and mobile phone c all adopt the remote projection method. When user A is using mobile phone a to cast the screen, user B scans the QR code on the screen projection target device through mobile phone b, and requests screen projection. Since the screen projection target device is occupied by mobile phone a at this time, the display The interface can be as shown in (a) in FIG. 11 , the display interface of the mobile phone b displays fourth prompt information, for example, the fourth prompt information is "Prompt: The screen projection target device is currently occupied by other devices, do you want to wait?". If the mobile phone b detects that the user B selects an operation of "yes" in the display interface, in response to the operation, the mobile phone b enters a state of waiting for screen projection. At this time, the screen waiting queue in the service device may include the identifier of the mobile phone b. After the screen projection of mobile phone a is finished, the service device can send a screen projection idle notification to mobile phone b. Correspondingly, the display interface of mobile phone b can be as shown in (b) in Figure 11, and the display interface of mobile phone b displays the fifth prompt information , the fifth prompt message is, for example, "Prompt: The screen projection target device is currently idle, do you want to continue screen projection?" Sending the first screen projection request, so that the mobile phone b can project the screen to the screen projection target device. In addition, in the above example, user C can also request screen projection through mobile phone c, and the display interface of mobile phone c can also refer to those shown in (a) and (b) in FIG. 11 .

Further, the present application may provide user A to adjust the screen projection sequence of all screen projection source devices. For example, user A, as a manager, can adjust the screen projection sequence of the user's screen projection source device on mobile phone a. The display interface of the mobile phone a can refer to that shown in (c) in Figure 11. The screen projection sequence displayed on the display interface is the logo b and the logo c. Correspondingly, the queue to be projected in the service device includes the logos with the sequence b and identification c. After the screen projection of mobile phone a ends, the service device can send a screen projection idle notification to mobile phone b, so that mobile phone b can project the screen to the target device. After the screen projection of the mobile phone b is completed, the service device can send a screen projection idle notification to the mobile phone c, so that the mobile phone c can project the screen to the target device. Here, user A can notify the service device to adjust the order of the identifiers in the queue to be projected by changing the order of the identifiers on the display interface of the mobile phone a.

As in the above embodiment, the proxy device assists the screen projection source device to obtain the screen projection authorization information of the screen projection target device, and then the screen projection source device sends screen projection data to the screen projection target device based on the screen projection authorization information. In addition, the present application provides another screen projection method, which can be applied to the screen projection system shown in Fig. 1 exemplarily, and the method can be completed by a service device, a screen projection target device, and a screen projection source device.

In this embodiment of the application, the target screen-casting device associated with the screen-casting source device may be referred to as the first screen-casting target device; is the second target device for screen projection; the target device for screen projection that maintains a signaling channel connection with the service device may be referred to as the third target device for screen projection.

It can be understood that the service device may maintain a signaling channel connection with the M third screen projection target devices; the service device may determine N first screen projection target devices from the M third screen projection target devices, where Both M and N are positive integers, and N is less than or equal to M. The identifiers of the N first screen-casting target devices can be displayed on the display interface of the screen-casting source device, so that the user can select a screen from the N first screen-casting target devices for the screen-casting source device to perform screen-casting The target device (that is, the second target device for screen projection).

Referring to FIG. 12 exemplarily showing a schematic flow diagram of another method for screen projection:

Step 1201, the service device determines a first target device for screen projection.

The service device may determine N first screen projection target devices from the M third screen projection target devices based on a preset policy. The preset strategy may at least include a user-selected binding strategy, an automatic binding strategy, and an area matching binding strategy. Based on three different strategies, step 1201 can be described in three examples.

In example a, the user chooses a binding policy independently, see steps a1 to a4.

In step a1, the service device sends M identifiers respectively corresponding to the M third screen projection target devices to the screen projection source device.

In step a2, the screen projection source device determines N target identities from the M identities. Specifically, the screen projection source device displays M logos on the display interface of the screen projection source device, and the user can select N target logos on the display interface of the screen projection source device, and the third projection logo corresponding to the N target logos The screen target device is the first screen projection target device, and correspondingly, the screen projection source device determines the N target identifiers selected by the user.

In step a3, the screen projection source device sends an association request to the service device, and the association request includes N target identifiers.

In step a4, the service device determines the third screen projection target devices corresponding to the N target identifiers as the N first screen projection target devices.

Example b, automatic binding policy, refer to step b1 or step b2.

In step b1, the service device takes the M third screen projection target devices as associated devices of the screen projection source device, that is, determines the M third screen projection target devices as N first screen projection target devices, and M is equal to N.

Step b2, the service device selects N third target devices for screen projection from the M third target devices for screen projection according to the number of times the screen projection source device projects to M third target devices for screen projection, and sends the N The third screen projection target devices serve as the N first screen projection target devices.

For example c, region matching and binding policy, refer to step c1 and step c2.

In step c1, the service device determines the area to which the screen projection source device belongs.

Step c2, the service device determines N third screen projection target devices belonging to the same area as the screen projection source device from the M third screen projection target devices, and takes the N third screen projection target devices as N The target device for the first projection.

Step 1202, the service device sends the information of the first screen projection target device to the screen projection source device.

In this application, when the service device sends the information of the first screen-casting target device to the screen-casting source device, there are at least two implementation methods: first, when the screen-casting source device logs in to the service device through the screen-casting application, the service The device actively sends the information of the first screen-casting target device to the screen-casting source device. Second, the screen projection source device can send an association device request to the service device when projection is required, and the association device request is used to request the identity of the first screen projection target device from the service device, and the service device responds to the association device request, Send the information of the first target device for screen projection to the source device for screen projection.

Step 1203, the screen projection source device determines the second screen projection target device from the first screen projection target device according to the information of the first screen projection target device; sends a second screen projection request to the service device, wherein the second screen projection request contains the identifier of the second screencasting target device.

The screen projection source device may display the information of the first screen projection target device on the display interface of the screen projection source device. The user performs a second user operation, wherein the second user operation may be that the user selects one of the identifiers of the first screen-casting target device (ie, the identifier of the second screen-casting target device) in the display interface of the screen-casting source device. Correspondingly, the screen projection source device receives the second user operation, generates a second screen projection request including the identifier of the second screen projection target device according to the identifier of the second screen projection target device selected by the user, and sends the second screen projection The screen request is sent to the service device.

Based on the information of the first screen-casting target device sent by the service device to the screen-casting source device, there may be at least the following three examples:

Example 1, the service device sends information about N first screen projection target devices to the screen projection source device. Wherein, the information of each first screen-casting target device includes the identification of the corresponding first screen-casting target device and screen-casting status information, and the screen-casting status information may be real-time monitoring of the screen-casting of the first screen-casting target device by the service device state, or the screen projection state information may be reported by the first screen projection target device to the service device, and the screen projection state information may be used to indicate whether the first screen projection target device is in an idle state. For example, the identifiers corresponding to the N first screen projection target devices are identifier 1, identifier 2, ..., identifier N, and the screen projection status information corresponding to the N first screen projection target devices are status 1, status 2, ... ..., state N, the service device sends ID 1 and status 1, ID 2 and status 2, ..., ID N and status N to the screen projection source device.

Correspondingly, the screen projection source device can display the information (including identification and screen projection status information) of the N first screen projection target devices on the display interface of the screen projection source device, as shown in (a) in FIG. 13 , the user In the display interface, the first screen projection target device whose screen projection status information is idle may be selected as the second screen projection target device.

Example 2, the service device may also determine K first screen projection target devices in an idle state from the N first screen projection target devices according to the screen projection state information of each first screen projection target device, where K is positive Integer, and K is less than or equal to N. The service device sends the identifiers of the K first screen projection target devices in an idle state to the screen projection source device without indicating the screen projection status information of the first screen projection target devices to the screen projection source device. For example, the identifiers corresponding to the N first screen projection target devices are identifier 1, identifier 2, ..., identifier N, and the screen projection status information corresponding to the N first screen projection target devices are status 1, status 2, ... ..., state N, the service device determines 3 first screen projection target devices in the idle state from the N first screen projection target devices, that is, K is equal to 3, and the number of the 3 first screen projection target devices in the idle state The identifiers are respectively identifier 2, identifier 3, and identifier 4, and the service device sends the identifier 2, identifier 3, and identifier 4 to the screen projection source device.

Correspondingly, the screen projection source device can display the identities of the three first screen projection target devices on the display interface of the screen projection source device, as shown in (b) in Figure 13, and the user can select one of them in the display interface The first screen projection target device serves as the second screen projection target device.

Example 3, the service device sends information about N first screen projection target devices to the screen projection source device. Wherein, the information of each first screen projection target device includes an identifier corresponding to the first screen projection target device. For example, the IDs corresponding to the N first screen projection target devices are ID 1, ID 2, ..., ID N, and the service device sends ID 1, ID 2, ..., ID N to the screen projection source device.

Correspondingly, the screen projection source device can display the identifications of the N first screen projection target devices on the display interface of the screen projection source device, such as shown in (c) in FIG. 13 , and the user can select one of them in the display interface The first screen projection target device serves as the second screen projection target device. Here, if the second screen-casting target device indicated by the user is in a non-idle state, the service device may cache the identifier of the screen-casting source device in the queue of the service device to be screen-casted, and the second screen-casting target device is not idle. After the idle state changes to the idle state, step 1204 to step 1206 are executed again.

In this application, after receiving the second screen projection request from the screen projection source device, the service device can verify whether the screen projection source device is a trusted screen projection source device, that is, verify whether it is a projection screen that has logged into the service device. The screen source device, if yes, executes step 1204, and if not, sends a screen projection rejection message to the screen projection source device or does not respond. In this way, it helps to improve the security of screen projection.

Step 1204, the service device sends a third screen projection request to the second screen projection target device according to the identifier of the second screen projection target device. The third screen projection request is used to request channel authorization information of the second screen projection target device from the second screen projection target device.

Step 1205, the second screen projection target device sends channel authorization information of the second screen projection target device to the screen projection source device via the service device.

Step 1206, the screen projection source device sends screen projection data to the second screen projection target device according to the channel authorization information.

Similar to the introduction in step 508A, details are not repeated here.

Step 1207, the second screen projection target device displays the screen projection data.

Based on the above content and the same idea, FIG. 14 and FIG. 15 are schematic structural diagrams of possible screen projection devices provided by the present application. These screen projection devices can be used to implement the function of any one of the service device, proxy device, screen projection source device, and screen projection target device in the above method embodiments, and thus can also achieve the beneficial effects of the above method embodiments.

In this application, the screen projection device may be any one of the service device, the screen projection source device, and the screen projection target device as shown in FIG. 1 . The screen projection device may also be any one of the server device, the proxy device, the screen projection source device, and the screen projection target device as shown in FIG. 4 .

As shown in FIG. 14 , the screen projection device 1400 includes a processing unit 1401 and a transceiver unit 1402 .

When the screen projection device 1400 is a service device, the screen projection device 1400 can be used to implement the method of the service device in the related embodiment in FIG. 5 . In a possible implementation manner, the processing unit 1401 is configured to control the transceiving unit 1402 to send the identifier of at least one associated device that has an association relationship with the agent device to the agent device when the transceiver unit 1402 receives an association device request from the agent device; the processing unit 1401 is also used to control the transceiving unit 1402 to receive the proxy screen projection request from the proxy device, and the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device; wherein at least one associated device includes a screen projection The source device; the processing unit 1401 is also used to control the transceiver unit 1402 to send a screen projection event notification to the screen projection source device, and the screen projection event notification is used to instruct the screen projection source device to send the screen projection event notification to the screen projection source device according to the screen projection authorization information included in the screen projection event notification. The screen target device sends the screen projection data, and the screen projection data is displayed on the screen projection target device.

When the screen projection device 1400 is a service device, the screen projection device 1400 can be used to implement the method of the service device in the related embodiment in FIG. 7 . In a possible implementation manner, the processing unit 1401 is configured to control the transceiving unit 1402 to send the identifier of at least one associated device that has an association relationship with the agent device to the agent device when the transceiver unit 1402 receives an association device request from the agent device; the processing unit 1401 is also used to control the transceiving unit 1402 to receive the proxy screen projection request from the proxy device, and the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device; wherein at least one associated device includes a screen projection The source device; the processing unit 1401 is also used to obtain the channel authorization information of the screen projection target device from the screen projection target device according to the screen projection authorization information, and control the transceiver unit 1402 to send the channel authorization information to the screen projection source device; the channel authorization information It is used for the screen projection source device to encrypt the screen projection data and send the encrypted screen projection data to the screen projection target device, and the screen projection data is displayed on the screen projection target device.

When the screen projection device 1400 is a proxy device, the screen projection device 1400 may be used to implement the method of the proxy device in the related embodiment in FIG. 5 or FIG. 7 . In a possible implementation manner, the processing unit 1401 is configured to acquire the screen-casting authorization information of the screen-casting target device; The screen projection apparatus 1400 has an identification of at least one associated device with an association relationship; the processing unit 1401 is further configured to control the transceiver unit 1402 to receive a first user operation, and the first user operation is for the user to select one of the at least one associated device as a screen projection source device, control the transceiver unit 1402 to send a proxy screen projection request to the service device, the proxy screen projection request includes the screen projection authorization information and the identification of the screen projection source device, and the proxy screen projection request is used to instruct the service device to send the screen projection to the screen projection source device Event notification.

When the screen projection device 1400 is the screen projection source device, the screen projection device 1400 may be used to implement the method of the screen projection source device in the related embodiments in FIG. 5 or FIG. 8 or FIG. 9 or FIG. 10 . In a possible implementation manner, the processing unit 1401 is configured to control the transceiving unit 1402 to receive a screen casting event notification from the service device, the screen casting event notification includes screen casting authorization information, and the screen casting event The event notification is sent by the service device in response to the proxy device's proxy screen projection request, and the screen projection device 1400 has an association relationship with the proxy device; the processing unit 1401 is also configured to, according to the screen projection device The authorization information controls the transceiving unit 1402 to send the screen projection data of the screen projection device 1400 to the screen projection target device, and the screen projection data is displayed on the screen projection target device.

When the screen projection device 1400 is the screen projection source device, the screen projection device 1400 may be used to implement the method of the screen projection source device in the related embodiments in FIG. 7 or FIG. 8 or FIG. 9 or FIG. 10 . In a possible implementation manner, the processing unit 1401 is configured to control the transceiver unit 1402 to receive channel authorization information from the service device, encrypt the screen projection data of the screen projection device 1400 according to the channel authorization information, and send the The screen projection target device sends the screen projection data of the screen projection apparatus 1400, and the screen projection data is displayed on the screen projection target device.

When the screen projection device 1400 is a screen projection target device, the screen projection device 1400 may be used to implement the method of the screen projection target device in the related embodiments in FIG. 5 or FIG. 8 or FIG. 9 or FIG. 10 . In a possible implementation, the processing unit 1401 controls the transceiving unit 1402 to receive a first screen casting request from the screen casting source device, and the first screen casting request includes the screen casting authorization information of the screen casting target device and the screen casting source device The screen projection authorization information is used by the screen projection source device to request the channel authorization information of the screen projection target device from the screen projection target device, and the channel authorization information is used by the screen projection source device to encrypt the screen projection data; when the screen projection target device is not idle state, the processing unit 1401 adds the identifier of the screen-casting source device to the screen-to-be-cast queue of the screen-casting target device.

When the screen projection device 1400 is a screen projection target device, the screen projection device 1400 may be used to implement the method of the screen projection target device in the related embodiments in FIG. 7 or FIG. 8 or FIG. 9 or FIG. 10 . In a possible implementation manner, the processing unit 1401 controls the transceiving unit 1402 to receive a channel authorization request from the service device, and according to the channel authorization request, send channel authorization information to the screen projection source device via the service device. The processing unit 1401 controls the transceiving unit 1402 to receive the screen projection data encrypted from the screen projection source device according to the channel authorization information, and display the screen projection data.

When the screen projection device 1400 is a service device, the screen projection device 1400 can be used to implement the method of the service device in the related embodiment in FIG. 12 . In a possible implementation manner, the processing unit 1401 controls the transceiving unit 1402 to send the information of the first screen projection target device to the screen projection source device, and the information of the first screen projection target device includes an identifier of the first screen projection target device; The first screen projection target device has an association relationship with the screen projection source device; the control transceiver unit 1402 receives the second screen projection request from the screen projection source device; the second screen projection request contains the identity of the second screen projection target device; the second The screen projection target device is the first receiving device in an idle state; according to the identification of the second screen projection target device, obtain the channel authorization information of the second screen projection target device from the second screen projection target device; control the transceiver unit 1402 to The screen source device sends channel authorization information, and the channel authorization information is used by the screen projection source device to encrypt the screen projection data and send the encrypted screen projection data to the second screen projection target device.

When the screen projection device 1400 is the screen projection source device, the screen projection device 1400 may be used to implement the method of the screen projection source device in the related embodiment in FIG. 12 . In a possible implementation manner, the processing unit 1401 is configured to control the transceiving unit 1402 to receive the information of the first screen-casting target device from the service device, where the information of the first screen-casting target device includes an identifier of the first screen-casting target device , the first screen projection target device has an association relationship with the screen projection source device; the control transceiver unit 1402 sends a second screen projection request to the service device, the second screen projection request includes the identity of the second screen projection target device, and the second screen projection The target device is the first screen projection target device in an idle state; the control transceiver unit 1402 receives the channel authorization information of the second screen projection target device from the service device; according to the channel authorization information, encrypt the screen projection data and control the transceiver unit 1402 to encrypt The final screen projection data is sent to the second screen projection target device.

When the screen projection apparatus 1400 is the second screen projection target device, the screen projection apparatus 1400 may be used to implement the method for the second screen projection target device in the related embodiment in FIG. 12 . In a possible implementation manner, the processing unit 1401 is configured to control the transceiving unit 1402 to receive the third screen projection request from the service device, and the service device maintains a signaling channel connection with the second screen projection target device; Three screen projection requests, the control transceiver unit 1402 sends the channel authorization information of the second screen projection target device to the service device, and the channel authorization information is used by the screen projection source device to encrypt the screen projection data and send the encrypted screen projection data to the second projection screen screen the target device.

FIG. 15 shows an apparatus 1500 provided in the embodiment of the present application. The apparatus shown in FIG. 15 may be a hardware circuit implementation manner of the apparatus shown in FIG. 14 . The apparatus may be applicable to the flow chart shown above to execute the function of any one of the service device, the proxy device, the screen projection source device, and the screen projection target device in the above method embodiments.

For ease of illustration, only the main components of the device are shown in FIG. 15 .

The device 1500 shown in FIG. 15 includes a communication interface 1510, a processor 1520 and a memory 1530, wherein the memory 1530 is used for storing program instructions and/or data. Processor 1520 may cooperate with memory 1530 . Processor 1520 may execute program instructions stored in memory 1530 . When the instructions or programs stored in the memory 1530 are executed, the processor 1520 is used to perform the operations performed by the processing unit 1401 in the above embodiments, and the communication interface 1510 is used to perform the operations performed by the transceiver unit 1402 in the above embodiments.

The memory 1530 is coupled to the processor 1520 . The coupling in the embodiments of the present application is an indirect coupling or a communication connection between devices, units or modules, which may be in electrical, mechanical or other forms, and is used for information exchange between devices, units or modules. At least one of the memories 1530 may be included in the processor 1520 .

In this embodiment of the present application, the communication interface may be a transceiver, a circuit, a bus, a module, or other types of communication interfaces. In the embodiment of the present application, when the communication interface is a transceiver, the transceiver may include an independent receiver and an independent transmitter; it may also be a transceiver integrated with a transceiver function, or be a communication interface.

Apparatus 1500 may also include a communication link 1540 . Wherein, the communication interface 1510, the processor 1520 and the memory 1530 can be connected to each other through the communication line 1540; the communication line 1540 can be a peripheral component interconnect standard (peripheral component interconnect, referred to as PCI) bus or an extended industry standard architecture (extended industry standard architecture , referred to as EISA) bus and so on. The communication line 1540 can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 15 , but it does not mean that there is only one bus or one type of bus.

Based on the above content and the same idea, the present application provides a computing device, including a processor, the processor is connected to a memory, the memory is used to store computer programs, and the processor is used to execute the computer programs stored in the memory , so that the computing device implements the methods in the above-mentioned related embodiments in FIG. 5 to FIG. 12 .

Based on the above content and the same idea, the present application provides a computing device, including a processor and a memory, the processor is connected to the memory, the memory is used to store computer programs, and the processor is used to execute the A stored computer program to enable the computing device to implement the methods in the above-mentioned related embodiments in FIG. 5 to FIG. 12 .

Based on the above content and the same idea, the present application provides a computer-readable storage medium, in which a computer program or instruction is stored, and when the computer program or instruction is executed by a computing device, the computing device Implement the methods in the above-mentioned related embodiments in FIG. 5 to FIG. 12 .

Based on the above content and the same idea, the present application provides a computer program product, the computer program product includes a computer program or instruction, when the computer program or instruction is executed by a computing device, the above-mentioned related embodiments in Figure 5 to Figure 12 are implemented Methods.

Based on the above content and the same idea, the present application provides a chip, including at least one processor and an interface; the interface is used to provide program instructions or data for the at least one processor; the at least one processor is used to execute the The program line instructions described above are used to implement the methods in the above-mentioned related embodiments in FIG. 5 to FIG. 12 .

Based on the above content and the same idea, this application provides a screen projection system, including the service device, proxy device, screen projection source device, and screen projection target device involved in the above-mentioned related embodiments of Figure 5 or Figure 8 or Figure 9 or Figure 10 .

Based on the above content and the same idea, this application provides a screen projection system, including the service device, proxy device, screen projection source device, and screen projection target device involved in the above-mentioned related embodiments of Figure 7 or Figure 8 or Figure 9 or Figure 10 .

Based on the above content and the same idea, the present application provides a screen projection system, including the service device, the screen projection source device, and the second screen projection target device involved in the above-mentioned related embodiment in FIG. 12 .

In this application, "at least one" means one or more, and "multiple" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one item (piece) of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c ", where a, b, c can be single or multiple. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone, where A, B can be singular or plural. In the text description of this application, the character "/" generally indicates that the contextual objects are an "or" relationship; in the formulas of this application, the character "/" indicates that the contextual objects are a "division" Relationship.

It can be understood that the various numbers involved in the embodiments of the present application are only for convenience of description, and are not used to limit the scope of the embodiments of the present application. The size of the serial numbers of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its functions and internal logic.

Apparently, those skilled in the art can make various changes and modifications to this application without departing from the protection scope of this application. In this way, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.

Claims

A screen projection method, characterized in that, comprising:

When the service device receives the association device request from the proxy device, it sends to the proxy device an identifier of at least one associated device that has an association relationship with the proxy device;

The service device receives the proxy screen projection request from the proxy device, the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device; the at least one associated device includes the screen projection source device;

The service device sends a screen projection event notification to the screen projection source device, and the screen projection event notification is used to instruct the screen projection source device to send a notification to the screen projection authorization information included in the screen projection event notification. The screen projection target device sends screen projection data, and the screen projection data is displayed on the screen projection target device.
The method according to claim 1, wherein the association relationship includes at least one or more of the following relationships: corresponding to the same account, corresponding to the same group, and corresponding to the same department.
The method according to claim 1, wherein before the service device sends a screen projection event notification to the screen projection source device, the method further comprises:

The service device determines that the screen projection source device is one of the at least one associated device.
The method according to any one of claims 1 to 3, further comprising: after the service device sends a screen projection event notification to the screen projection source device:

The service device receives a first screen projection request from the screen projection source device, and the first screen projection request includes the screen projection authorization information and the identification of the screen projection source device;

If the screen projection target device is not in an idle state, the service device adds the identifier of the screen projection source device to a screen waiting queue of the service device.
The method of claim 4, further comprising:

When the screen projection target device is in an idle state, the service device acquires channel authorization information of the screen projection target device from the screen projection target device, and sends the channel authorization information to the projection screen For the screen source device, the channel authorization information is used by the screen projection source device to encrypt the screen projection data.
The method according to claim 4 or 5, wherein before the service device adds the identity of the screen projection source device to the queue of the service device to be screen projection, it further includes:

The service device monitors the screen projection status of the screen projection target device, and determines that the screen projection target device is in a non-idle state;

Alternatively, the service device sends the first screen projection request to the screen projection target device, and receives a rejection response from the screen projection target device, where the rejection response is used to indicate that the screen projection target device is not idle state.
A screen projection method, characterized in that, comprising:

When the service device receives the association device request from the proxy device, it sends to the proxy device an identifier of at least one associated device that has an association relationship with the proxy device;

The service device receives the proxy screen projection request from the proxy device, the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device; the at least one associated device includes the screen projection source device;

The service device obtains channel authorization information of the screen projection target device from the screen projection target device according to the screen projection authorization information, and sends the channel authorization information to the screen projection source device;

The channel authorization information is used by the screen projection source device to encrypt screen projection data and send the encrypted screen projection data to the screen projection target device, and the screen projection data is displayed on the screen projection target device.
The method according to claim 7, wherein the service device obtains channel authorization information of the screen projection target device from the screen projection target device according to the screen projection authorization information, including:

The service device sends a channel authorization request to the screen projection target device, the channel authorization request includes the screen projection authorization information, and the channel authorization request is used to request the channel authorization information from the screen projection target device ;

The service device receives the channel authorization information from the screen projection target device.
A screen projection method, characterized in that, comprising:

The proxy device obtains the screen-casting authorization information of the screen-casting target device;

When the proxy device receives an indication of a proxy request for screen projection, it acquires an identifier of at least one associated device that has an associated relationship with the proxy device from the service device;

The proxy device receives a first user operation, the first user operation is that the user selects one of the at least one associated device as a screen projection source device, and sends a proxy screen projection request to the service device, and the proxy screen projection The request includes the screen projection authorization information and the identifier of the screen projection source device, and the proxy screen projection request is used to instruct the service device to send a screen projection event notification to the screen projection source device.
The method according to claim 9, wherein before the agent device receives the first user operation, it further comprises:

The proxy device displays the identifier of the at least one associated device on a display interface of the proxy device.
The method according to claim 9 or 10, wherein the association relationship includes at least one or more of the following relationships: corresponding to the same account, corresponding to the same group, and corresponding to the same department.
A screen projection method, characterized in that, comprising:

The screen projection source device receives a screen projection event notification from the service device, the screen projection event notification includes screen projection authorization information, and the screen projection event notification is sent by the service device in response to the proxy device's proxy screen projection request, There is an association relationship between the screen projection source device and the proxy device;

The screen projection source device sends the screen projection data of the screen projection source device to the screen projection target device according to the screen projection authorization information, and the screen projection data is displayed on the screen projection target device.
The method according to claim 12, wherein, before the screen projection source device sends the screen projection data of the screen projection source device to the screen projection target device according to the screen projection authorization information, further comprising:

The screen projection source device prompts the user whether to agree to screen projection according to the screen projection event notification;

The screen projection source device receives an indication that the user agrees to screen projection.
The method according to claim 12 or 13, wherein the association relationship includes at least one or more of the following relationships: corresponding to the same account, corresponding to the same group, and corresponding to the same department.
A screen projection method, characterized in that, comprising:

The screen projection source device receives the information of the first screen projection target device from the service device, the information of the first screen projection target device includes the identifier of the first screen projection target device, and the first screen projection target device is related to the first screen projection target device The above screen projection source devices have an association relationship;

The screen projection source device sends a second screen projection request to the service device, the second screen projection request includes an identifier of a second screen projection target device, and the second screen projection target device is the first screen projection device in an idle state. A screen projection target device;

The screen projection source device receives the channel authorization information of the second screen projection target device from the service device;

The screen projection source device encrypts the screen projection data according to the channel authorization information and sends the encrypted screen projection data to the second screen projection target device, and the screen projection data is stored on the second screen projection target device on display.
The method according to claim 15, wherein, before the screen projection source device sends the second screen projection request to the service device, further comprising:

The screen projection source device displays the identifier of the first screen projection target device on the display interface of the screen projection source device;

The screen projection source device receives a second user operation, and the second user operation is a user selecting one of the identifiers of the first screen projection target device in the display interface of the screen projection source device;

The screen projection source device uses the identifier of the first screen projection target device selected by the user as the identifier of the second screen projection target device.
The method according to claim 15 or 16, wherein the information of the first screen-casting target device further includes screen-casting state information of the first screen-casting target device, and the screen-casting state information indicates the Whether the first screen projection target device is in an idle state.
A screen projection device, characterized in that it comprises:

transceiver unit and processing unit;

The processing unit is configured to control the transceiving unit to send to the proxy device an identifier of at least one associated device that has an association relationship with the proxy device when receiving an associated device request from the proxy device;

The processing unit is further configured to control the transceiving unit to receive a proxy screen projection request from the proxy device, and the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device; The at least one associated device includes the screen projection source device;

The processing unit is further configured to control the transceiving unit to send a screen projection event notification to the screen projection source device, where the screen projection event notification is used to instruct the screen projection source device to The screen-casting authorization information sends screen-casting data to the screen-casting target device, and the screen-casting data is displayed on the screen-casting target device.
The screen projection device according to claim 18, wherein the association relationship includes at least one or more of the following relationships: corresponding to the same account, corresponding to the same group, and corresponding to the same department.
The screen projection device according to claim 18, wherein the processing unit is further configured to: before controlling the transceiver unit to send a screen projection event notification to the screen projection source device:

Determine that the screen projection source device is one of the at least one associated device.
The screen projection device according to any one of claims 18 to 20, wherein, after the processing unit controls the transceiver unit to send a screen projection event notification to the screen projection source device, it is further configured to:

controlling the transceiving unit to receive a first screen projection request from the screen projection source device, where the first screen projection request includes the screen projection authorization information and the identification of the screen projection source device;

If the screen projection target device is not in an idle state, adding the identifier of the screen projection source device to the screen projection queue of the screen projection device.
The screen projection device according to claim 21, wherein the processing unit is further used for:

When the screen projection target device is in an idle state, obtain channel authorization information of the screen projection target device from the screen projection target device, and control the transceiver unit to send the channel authorization information to the The screen projection source device, where the channel authorization information is used by the screen projection source device to encrypt the screen projection data.
The screen projection device according to claim 21 or 22, wherein the processing unit is further configured to:

Monitor the screen projection status of the screen projection target device, and determine that the screen projection target device is in a non-idle state;

Alternatively, control the transceiving unit to send the first screen projection request to the screen projection target device, and receive a rejection response from the screen projection target device, where the rejection response is used to indicate that the screen projection target device is not in the idle state.
A screen projection device, characterized in that it comprises:

transceiver unit and processing unit;

The processing unit is configured to control the transceiving unit to send to the proxy device an identifier of at least one associated device that has an association relationship with the proxy device when receiving an associated device request from the proxy device;

The processing unit is further configured to control the transceiving unit to receive a proxy screen projection request from the proxy device, and the proxy screen projection request includes the identification of the screen projection source device and the screen projection authorization information of the screen projection target device; The at least one associated device includes the screen projection source device;

The processing unit is further configured to obtain channel authorization information of the screen projection target device from the screen projection target device according to the screen projection authorization information, and control the sending and receiving unit to send the screen projection source device to the screen projection source device. The channel authorization information;

Wherein, the channel authorization information is used for the screen projection source device to encrypt the screen projection data and send the encrypted screen projection data to the screen projection target device, and the screen projection data is displayed on the screen projection target device .
The screen projection device according to claim 24, wherein the processing unit is specifically used for:

controlling the transceiving unit to send a channel authorization request to the screen projection target device, the channel authorization request including the screen projection authorization information, and the channel authorization request is used to request the channel authorization from the screen projection target device information;

and controlling the transceiving unit to receive the channel authorization information from the screen projection target device.
A screen projection device, characterized in that it comprises:

transceiver unit and processing unit;

The processing unit is configured to obtain screen projection authorization information of the screen projection target device;

The processing unit is further configured to obtain, from the service device, an identifier of at least one associated device that has an associated relationship with the screen projection device when receiving an indication of a proxy request for screen projection;

The processing unit is further configured to control the transceiving unit to receive a first user operation, the first user operation is for the user to select one of the at least one associated device as the screen projection source device, and control the transceiving unit to send the The service device sends a proxy screen projection request, the proxy screen projection request includes the screen projection authorization information and the identification of the screen projection source device, and the proxy screen projection request is used to instruct the service device to send The screen source device sends a screen projection event notification.
The screen projection device according to claim 26, wherein before the processing unit controls the transceiver unit to receive the first user operation, it is further configured to:

Displaying the identifier of the at least one associated device on the display interface of the screen projection device.
The screen projection device according to claim 26 or 27, wherein the association relationship includes at least one or more of the following relationships: corresponding to the same account, corresponding to the same group, corresponding to the same department .
A screen projection device, characterized in that it comprises:

transceiver unit and processing unit;

The processing unit is configured to control the transceiving unit to receive a screen projection event notification from the service device, the screen projection event notification includes screen projection authorization information, and the screen projection event notification is a response from the service device to the proxy device The proxy screen projection request sent by the proxy device has an association relationship between the screen projection device and the proxy device;

The processing unit is further configured to, according to the screen projection authorization information, control the transceiver unit to send the screen projection data of the screen projection device to the screen projection target device, and the screen projection data is on the screen projection target device show.
The screen projection device according to claim 29, wherein the processing unit controls the sending and receiving unit to send the screen projection data of the screen projection device to the screen projection target device according to the screen projection authorization information, and further Used for:

According to the screen projection event notification, prompt the user whether to agree to screen projection;

and controlling the transceiver unit to receive an indication that the user agrees to screen projection.
The screen projection device according to claim 29 or 30, wherein the association relationship includes at least one or more of the following relationships: corresponding to the same account, corresponding to the same group, corresponding to the same department .
A screen projection device, characterized in that it comprises:

transceiver unit and processing unit;

The processing unit is configured to: control the transceiver unit to receive information of a first screen projection target device from the service device, the information of the first screen projection target device includes an identifier of the first screen projection target device, the The first screen projection target device has an association relationship with the screen projection device;

Controlling the transceiver unit to send a second screen projection request to the service device, the second screen projection request includes an identifier of a second screen projection target device, and the second screen projection target device is the first screen projection device in an idle state. The screen target device;

controlling the transceiver unit to receive channel authorization information of the second screen projection target device from the service device;

According to the channel authorization information, encrypt the screen projection data and control the transceiver unit to send the encrypted screen projection data to the second screen projection target device, and the screen projection data is on the second screen projection target device show.
The screen projection device according to claim 32, wherein before the processing unit controls the transceiver unit to send the second screen projection request to the service device, it is further used for:

Displaying the identifier of the first screen-casting target device on the display interface of the screen-casting source device;

controlling the transceiving unit to receive a second user operation, the second user operation being the user selecting one of the identifiers of the first screen-casting target device in the display interface of the screen-casting source device;

The identifier of the first screen-casting target device selected by the user is used as the identifier of the second screen-casting target device.
The screen projection device according to claim 32 or 33, wherein the information of the first screen projection target device further includes screen projection state information of the first screen projection target device, and the screen projection state information Indicates whether the first screen-casting target device is in an idle state.
A computing device, characterized in that it includes a processor, the processor is connected to a memory, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the calculation The device realizes the method according to any one of claims 1 to 6, or realizes the method according to claim 7 or 8, or realizes the method according to any one of claims 9 to 11, or realizes the method described in any one of claims 9 to 11, or realizes The method according to any one of claims 12 to 14, or implementing the method according to any one of claims 15 to 17.
A computer-readable storage medium, characterized in that, computer programs or instructions are stored in the computer-readable storage medium, and when the computer programs or instructions are executed by a computing device, the computing device implements claims 1 to 1. 6, or realize the method as described in claim 7 or 8, or realize the method as described in any one in claim 9 to 11, or realize the method as described in any one in claim 12 to 14 The method described in one, or realize the method described in any one in the claim 15 to 17.
A computer-readable storage medium, characterized in that, computer programs or instructions are stored in the computer-readable storage medium, and when the computer programs or instructions are executed by a computing device, any one of claims 1 to 6 can be realized. The method described in item, or realize the method as described in claim 7 or 8, or realize the method as described in any one in claim 9 to 11, perhaps realize as described in any one in claim 12 to 14 method, or implement a method as described in any one of claims 15 to 17.
A screen projection system, characterized by comprising the screen projection device according to any one of claims 18 to 23, the screen projection device according to any one of claims 26 to 28, and the screen projection device according to any one of claims 29 to 31 device.