WO2022252928A1 - Screen projection method and apparatus, wireless terminal, screen projection device and storage medium - Google Patents

Abstract

A screen projection method and apparatus, a wireless terminal, a screen projection device and a storage medium, which belong to the technical field of screen projection. The method comprises: establishing a data communication link with a screen projection device in response to a screen projection instruction; when a first Bluetooth link is established between a wireless terminal and an audio output device, sending a Bluetooth link establishment request to the screen projection device, so that the screen projection device establishes a second Bluetooth link with the audio output device on the basis of the Bluetooth link establishment request; and transmitting screen projection data to the screen projection device by means of the data communication link, so that the screen projection device outputs a picture on the basis of image data, and transmitting audio data to the audio output device by means of the second Bluetooth link. In the embodiments of the present application, during the screen projection process, audio output devices other than the screen projection device may continue to be used for audio playback so as to avoid the impact caused by the switching between audio playback sources during the screen projection process.

Description

Screen projection method, device, wireless terminal, screen projection equipment and storage medium

This application claims the priority of the Chinese patent application with the application number 202110620731.6 and the title of the invention "screen projection method, device, wireless terminal, screen projection equipment and storage medium" filed on June 3, 2021, the entire contents of which are incorporated by reference incorporated in this application.

technical field

The embodiments of the present application relate to the technical field of screen projection, and in particular, to a screen projection method, device, wireless terminal, screen projection device, and storage medium.

Background technique

Screen projection is a technology that transmits the audio and video data on the terminal side to the screen projection device, so as to display the terminal screen and play the terminal sound through the screen projection device.

For example, when the mobile phone and the TV are connected to the same wireless network, the user can turn on the screen projection function of the mobile phone, and the mobile phone transmits the audio and video data to the TV through the wireless network, so that the screen of the mobile phone is displayed on the TV side, and the sound of the mobile phone is played.

Contents of the invention

Embodiments of the present application provide a screen projection method and device, a wireless terminal, a screen projection device, and a storage medium. Described technical scheme is as follows:

On the one hand, an embodiment of the present application provides a screen projection method in a wireless terminal, the method comprising:

In response to the screen projection instruction, a data communication link is established with the screen projection device, the data communication link is used to transmit screen projection data, and the screen projection data includes image data and audio data;

When the wireless terminal establishes a first Bluetooth link with the audio output device, send a Bluetooth link establishment request to the screen projection device, so that the screen projection device can communicate with the audio output based on the Bluetooth link establishment request and the audio output device. the device establishes a second Bluetooth link; and,

Transmitting the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data, and transmits the screen projection data to the audio output device through the second Bluetooth link the audio data.

On the other hand, an embodiment of the present application provides a screen projection method in a screen projection device, the method comprising:

Establish a data communication link with the wireless terminal, the data communication link is used to transmit screen projection data, and the screen projection data includes image data and audio data;

In response to the Bluetooth link establishment request sent by the wireless terminal, establish a second Bluetooth link with an audio output device, and the audio output device has a first Bluetooth link established with the wireless terminal;

receiving the screen projection data transmitted by the wireless terminal through the data communication link; and,

outputting a picture based on the image data, and transmitting the audio data to the audio output device through the second Bluetooth link, so that the audio output device outputs sound based on the audio data.

On the other hand, an embodiment of the present application provides a screen projection device, and the device includes:

A data link establishment module, configured to establish a data communication link with the screen projection device in response to a screen projection instruction, the data communication link is used to transmit screen projection data, and the screen projection data includes image data and audio data;

A request sending module, configured to send a bluetooth link establishment request to the screen projection device when the first bluetooth link is established between the wireless terminal and the audio output device, so that the screen projection device establishes a bluetooth link based on the bluetooth link requesting to establish a second Bluetooth link with the audio output device;

A first transmission module, configured to transmit the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data; and,

A second transmission module, configured to transmit the audio data to the audio output device through the second Bluetooth link.

On the other hand, an embodiment of the present application provides a screen projection device, and the device includes:

A data link establishment module, configured to establish a data communication link with the wireless terminal, the data communication link is used to transmit screen projection data, and the screen projection data includes image data and audio data;

A Bluetooth link establishment module, configured to establish a second Bluetooth link with an audio output device in response to the Bluetooth link establishment request sent by the wireless terminal, and the audio output device establishes a first Bluetooth link with the wireless terminal ;

A data receiving module, configured to receive the screen projection data transmitted by the wireless terminal through the data communication link;

a display module for outputting a picture based on the image data; and,

A third transmission module, configured to transmit the audio data to the audio output device through the second Bluetooth link, so that the audio output device outputs sound based on the audio data.

On the other hand, an embodiment of the present application provides a wireless terminal, the wireless terminal includes a processor and a memory, at least one program is stored in the memory, and the at least one program is loaded and executed by the processor to implement The method for projecting a screen in a wireless terminal according to the above aspects.

On the other hand, an embodiment of the present application provides a screen projection device, the screen projection device includes a processor and a memory, at least one program is stored in the memory, and the at least one program is loaded and executed by the processor In order to realize the screen projection method in the screen projection device as described in the above aspects.

On the other hand, an embodiment of the present application provides a computer-readable storage medium, where at least one program is stored in the computer-readable storage medium, and the at least one program is loaded and executed by a processor to implement the above-mentioned screencasting method.

On the other hand, an embodiment of the present application provides a computer program product, the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium; the Bluetooth chip of the electronic device reads the computer-readable storage medium from the computer-readable storage medium. A computer instruction, the processor executes the computer instruction, so that the electronic device executes the screen projection method provided in various optional implementation manners of the foregoing aspects.

Description of drawings

FIG. 1 shows a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application;

FIG. 2 shows a flow chart of a screen projection method provided by an exemplary embodiment of the present application;

Fig. 3 is an implementation schematic diagram of a screen projection process shown in an exemplary embodiment of the present application;

FIG. 4 is a flowchart of a second Bluetooth link establishment process provided by an exemplary embodiment of the present application;

Fig. 5 is an implementation schematic diagram of a screen projection process shown in another exemplary embodiment of the present application;

FIG. 6 is a schematic diagram of an implementation of an audio path switching process shown in an exemplary embodiment of the present application;

Fig. 7 is a flow chart of the screen casting end process shown in an exemplary embodiment of the present application;

FIG. 8 shows a structural block diagram of a screen projection device provided by an embodiment of the present application;

FIG. 9 shows a structural block diagram of a screen projection device provided by another embodiment of the present application;

Fig. 10 shows a structural block diagram of an electronic device provided by an exemplary embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

Please refer to FIG. 1 , which shows a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application. The implementation environment includes a wireless terminal 110 , an audio output device 120 and a screen projection device 130 .

The wireless terminal 110 is an electronic device with bluetooth and screen projection functions. The electronic device may be a smart phone, a tablet computer, a personal computer, etc. In FIG. limited.

The audio output device 120 is an electronic device with Bluetooth and audio output functions. The electronic device can be a Bluetooth headset, a Bluetooth speaker, etc. In FIG. 1, the audio output device 120 is a Bluetooth headset as an example for illustration. .

After the wireless terminal 110 establishes the first Bluetooth link with the audio output device 120, the wireless terminal 110 transmits audio data to the audio output device 120 through the first Bluetooth link, and the audio output device 120 plays terminal sound based on the audio data.

The screen projection device 130 is an electronic device with bluetooth and display functions. The electronic device may be a smart TV, a monitor, a personal computer, or a projector, etc. In FIG. 1 , the screen projection device 130 is a smart TV as an example for illustration.

In a possible implementation manner, the wireless terminal 110 and the screen projection device 130 are located in the same wireless network. When receiving the screen projection instruction, the wireless terminal 110 and the screen projection device 130 establish a data communication link through the wireless network, and the screen projection During the process, the wireless terminal 110 transmits screen projection data (picture data and audio data) to the screen projection device 130 through the data communication link, and the screen projection device 130 displays the terminal screen and plays the terminal audio through its own speaker.

Of course, in other possible implementation manners, the wireless terminal 110 and the screen projection device 130 may also establish a data communication link based on a wired connection. For example, the wireless terminal 110 and the screen projection device 130 are connected through a data cable. When the screen command is issued, the wireless terminal 110 and the screen projection device 130 establish a data communication link through the data cable, which is not limited in this embodiment.

In the embodiment of the present application, during the screen projection process, if a first Bluetooth link is established between the wireless terminal 110 and the audio output device 120, the wireless terminal 110 actively triggers the screen projection device 130 to establish a second Bluetooth link with the audio output device 120 , in the follow-up process, after the screen projection device 130 receives the screen projection data through the data communication link, on the one hand, it displays the terminal screen based on the image data in the screen projection data; The audio data is transmitted to the audio output device 120, and the audio output device 120 plays terminal sound based on the audio data.

Optionally, during the screen projection process, the wireless terminal 110 also provides an audio channel switching function. Through this function, the user can switch the audio channel from the audio output device 120 to the screen projection device 130 as required, so that the terminal can be played through the screen projection device 130. sound, or switch the audio path from the screen projection device 130 to the audio output terminal 120 , and then output the sound through the audio output terminal 120 .

In the related technology, during the screen projection process, the wireless terminal sends the screen projection data (including image data and audio data) to the screen projection device, and the screen projection device performs screen display and sound playback, even if the wireless terminal and the audio output device at this time There is a Bluetooth connection between them, and the terminal sound will not be played through the audio output device.

However, in the solution provided by the embodiment of the present application, if there is a Bluetooth connection between the wireless terminal and the audio output device to perform screen projection, the wireless terminal instructs the screen projection device to establish a Bluetooth connection with the audio output device, so that during the screen projection process The screen device can play sound through the audio output device to avoid the impact caused by switching the audio playback source from the audio output device to the screen projection device.

In a possible application scenario, a Bluetooth connection is established between a smartphone and a Bluetooth headset. When a user uses the smartphone to watch a video, the smartphone transmits audio data to the Bluetooth headset, and the Bluetooth headset plays the audio to avoid causing interference to others. When the user wants to continue watching videos through the smart TV, the smart phone can establish a data communication link with the smart TV by triggering the screen projection function of the smart phone.

Using the solution provided by related technologies, during the screen projection process, the sound of the smart phone will be played through the smart TV, and the sound played by the smart TV will cause interference to others.

However, using the solution provided by the embodiment of the present application, when establishing a data communication link, the smart phone triggers the smart TV to establish a Bluetooth connection with the Bluetooth headset. During the screen projection process, the smart TV displays the screen of the mobile phone based on the received image data, and synchronously transmits the audio data to the Bluetooth headset through the Bluetooth connection, and the Bluetooth headset plays the sound of the mobile phone, so as to avoid the interference of the external sound of the smart TV when casting the screen. .

Please refer to FIG. 2 , which shows a flow chart of a screen projection method provided by an exemplary embodiment of the present application. This embodiment uses the implementation environment shown in FIG. 1 as an example for illustration. The method includes:

Step 201, in response to the screen projection instruction, the wireless terminal establishes a data communication link with the screen projection device, the data communication link is used to transmit screen projection data, and the screen projection data includes image data and audio data.

Optionally, in response to the screen projection instruction, the wireless terminal and the screen projection device establish a wireless data communication link through a wireless network, or, the wireless terminal and the screen projection device establish a wired data communication link through a wired connection. For the convenience of description, the following embodiments are described by taking a wireless data communication link as an example.

In some embodiments, when there are multiple candidate screen projection devices in the wireless network, when receiving a screen projection instruction, the wireless terminal displays the device identification of each candidate screen projection device, and when receiving a device selection operation, communicates with the selected The projection device establishes a data communication link.

During the screen projection process, the wireless terminal uses the image data of its own display screen and the audio data of its own voice as the screen projection data, and sends the screen projection data to the screen projection device through the data communication link.

In step 202, the screen projection device establishes a data communication link with the wireless terminal.

Step 203, in the case that the wireless terminal establishes a first Bluetooth link with the audio output device, the wireless terminal sends a Bluetooth link establishment request to the screen projection device.

When a data communication link is established between the wireless terminal and the screen projection device, and a first Bluetooth link is established between the wireless terminal and the audio output device, the wireless terminal sends a Bluetooth link establishment request to the screen projection device, Instruct the screen projection device to establish a second Bluetooth link with the audio output device.

Wherein, the first Bluetooth link between the wireless terminal and the audio output device can be established before the screen projection, or can be established during the screen projection process (if the first Bluetooth link is not established during the screen projection process, the screen projection device will display terminal screen and play terminal sound).

Optionally, the Bluetooth link establishment request is transmitted through a data communication link, or, the Bluetooth link establishment request is transmitted through a Bluetooth link with the screen projection device, which is not limited in this embodiment.

Step 204, in response to the Bluetooth link establishment request sent by the wireless terminal, the screen projection device establishes a second Bluetooth link with the audio output device.

After receiving the bluetooth link establishment request, the screen projection device establishes a second bluetooth link with the audio output device based on the information contained in the bluetooth link establishment request.

Schematically, as shown in Figure 3, a bluetooth link is established between the mobile phone 31 and the bluetooth headset 32 before screen projection, and the audio data is transmitted to the bluetooth headset 32 through the bluetooth link; 31 sends a Bluetooth link establishment request to the TV 33 , and the TV 33 establishes a Bluetooth link with the Bluetooth headset 32 after receiving the request.

Step 205, the wireless terminal transmits the screen projection data to the screen projection device through the data communication link.

After the establishment of the second Bluetooth link is completed, the wireless terminal transmits the image data and audio data to the screen projection device synchronously through the data communication link. As shown in FIG. 3 , the mobile phone 31 transmits screen projection data including image data and audio data to the TV 33 .

Step 206, the screen projection device receives the screen projection data transmitted by the wireless terminal through the data communication link.

In step 207, the screen projection device outputs a picture based on the image data.

Since a second Bluetooth link is established between the screen projection device and the audio output device, when the screen projection device implements the screen projection function, it only analyzes the image data and displays the terminal screen, but does not analyze the audio data.

Step 208, the screen projection device transmits audio data to the audio output device through the second Bluetooth link, so that the audio output device outputs sound based on the audio data.

While displaying the terminal screen, the screen projection device synchronously transmits the audio data to the audio output device through the second Bluetooth link. is displayed, and the terminal sound is played on the audio output device.

Schematically, as shown in Figure 3, TV 33 analyzes image data, and shows the picture identical with mobile phone 31; Make no sound during screencasting).

It can be seen that, using the solution provided by the embodiment of the present application, the terminal sound is played through the audio output device before and after screen projection (the audio path between the wireless terminal and the audio output device is switched to the audio path between the screen projection device and the audio output device), avoiding During the screen projection process, the terminal sound is directly released through the screen projection device, causing interference to others.

To sum up, in the embodiment of this application, during the process of projecting the screen from the wireless terminal to the screen projection device, if the wireless terminal establishes a Bluetooth link with the audio output device, the screen projection device will establish the Bluetooth link based on the request sent by the wireless terminal. , establish a Bluetooth link with the audio output device, and when the subsequent screen projection device receives the projection data transmitted by the wireless terminal, it can display the terminal screen based on the image data in the projection data and transmit the image data in the projection data to the audio output device. Audio data, so that the audio output device can play the terminal sound; using the solution provided by the embodiment of this application, the audio output device other than the screen projection device can continue to be used for audio playback during the screen projection process, for example, the screen projection process can continue to be played through the screen projection process. The Bluetooth headset connected to the wireless terminal can play audio, which improves the freedom of audio playback during the screen projection process and avoids the impact caused by switching audio playback sources during the screen projection process.

Optionally, before establishing a data communication link with the screen projection device in response to the screen projection instruction, the method includes:

Establish a first bluetooth link with the audio output device;

In the case that the wireless terminal establishes a first Bluetooth link with the audio output device, a Bluetooth link establishment request is sent to the screen projection device, including:

Obtain the audio device Bluetooth information of the audio output device, and send a Bluetooth link establishment request including the audio device Bluetooth information to the projection device.

Optionally, send a bluetooth link establishment request including the bluetooth information of the audio device to the screen projection device, including:

Get the device state of the audio output device; and,

When the audio output device is in use, send a Bluetooth link establishment request including the Bluetooth information of the audio device to the screen projection device.

Optionally, when the wireless terminal establishes a first Bluetooth link with the audio output device, sending a Bluetooth link establishment request to the screen projection device includes:

Establish a first bluetooth link with the audio output device;

displaying a link establishment prompt, the link establishment prompt is used to confirm whether to establish a second bluetooth link between the screen projection device and the audio output device; and,

In response to the confirmation instruction, acquire the Bluetooth information of the audio device of the audio output device, and send a Bluetooth link establishment request including the Bluetooth information of the audio device to the screen projection device.

Optionally, after transmitting the screen projection data to the screen projection device, the method further includes:

In response to the switching instruction, a switching request is sent to the screen projection device, so that the screen projection device stops transmitting audio data to the audio output device through the second Bluetooth link, and outputs sound based on the audio data.

Optionally, after sending the bluetooth link establishment request to the screen projection device, the method includes:

In the case that the audio output device supports multiple bluetooth links, maintain the first bluetooth link;

or,

If the audio output device supports a single Bluetooth link, disconnect the first Bluetooth link.

Optionally, after transmitting the screen projection data to the screen projection device, the method further includes:

In response to the screen projection end instruction, and the first Bluetooth link is disconnected, obtain the audio device Bluetooth information of the audio output device from the screen projection device; and,

Re-establish the first Bluetooth link with the audio output device based on the Bluetooth information of the audio device.

Optionally, after transmitting the screen projection data to the screen projection device, the method further includes:

In response to the screen projection end instruction, a screen projection end request is sent to the screen projection device, so that the screen projection device disconnects the data communication link and the second Bluetooth link based on the screen projection end request.

Optionally, after outputting the picture based on the image data and transmitting the audio data to the audio output device through the second Bluetooth link, the method further includes:

In response to the switching request sent by the wireless terminal, stop transmitting audio data to the audio output device through the second Bluetooth link; and,

Sound is output based on the audio data.

Optionally, after outputting the picture based on the image data and transmitting the audio data to the audio output device through the second Bluetooth link, the method further includes:

In response to the wireless terminal sending a screen projection end request, the data communication link and the second Bluetooth link are disconnected.

Optionally, the audio output device supports a single Bluetooth link;

After outputting the picture based on the image data and transmitting the audio data to the audio output device through the second Bluetooth link, the method further includes:

In response to the screen projection end request sent by the wireless terminal, the audio device Bluetooth information of the audio output device is sent to the wireless terminal, so that the wireless terminal re-establishes the first Bluetooth link with the audio output device based on the audio device Bluetooth information.

Optionally, before outputting the picture based on the image data and transmitting the audio data to the audio output device through the second Bluetooth link, the method further includes:

determining a transmission delay of the second bluetooth link; and,

The image data and the audio data are transmitted synchronously based on the transmission delay.

In a possible application scenario, before performing screen projection, the wireless terminal has established a first Bluetooth link with the audio output device, and transmits audio data to the audio output device through the first Bluetooth link. When the user triggers the wireless terminal to perform screen projection in this situation, in response to the screen projection command, the wireless terminal obtains the audio device Bluetooth information of the audio output device, and sends a Bluetooth link establishment message containing the audio device Bluetooth information to the screen projection device. ask. Wherein, the Bluetooth information of the audio device may be a Bluetooth address or a Bluetooth name of the audio output device.

Correspondingly, after receiving the Bluetooth link establishment request, the screen projection device initiates a Bluetooth connection request to the audio output device based on the Bluetooth information of the audio device, thereby establishing a second Bluetooth link with the audio output device. The embodiment of the present application does not limit the specific process of establishing the Bluetooth link.

In a possible implementation, although the wireless terminal establishes a Bluetooth connection with the audio output device, the user may not use the audio output device. In order to avoid continuing to play the terminal sound through the audio output device in this case, the wireless terminal acquires the Output the device status of the device, and when the audio output device is in use, send a Bluetooth link establishment request including the Bluetooth information of the audio device to the projection device.

Optionally, the device status is detected by the audio output device through its own sensor, and reported to the wireless terminal through the first Bluetooth link. For example, when the audio output device is a bluetooth earphone, the bluetooth earphone determines the attitude of the earphone through the built-in sensor, and determines that it is in the use state when the attitude of the earphone is in the ear state.

Optionally, if the audio output device is not in use, the wireless terminal will not send a Bluetooth link establishment request to the screen projection device; or, if the audio output device is in an unused state, the wireless terminal will still send a Bluetooth link to the screen projection device path establishment request, and instruct the screen projection device to play the terminal sound through its own speaker during the screen projection process (that is, not to transmit audio data to the audio output device through the second Bluetooth link).

In this embodiment, based on the device state of the audio output device, the wireless terminal determines whether to send a Bluetooth link establishment request to the screen projection device, so as to avoid playing the terminal sound through the audio output device when the audio output device is not in use, resulting in the need to manually The problem of switching the audio path (switching to the screen mirroring device for playback).

In another possible application scenario, before the screen projection, the wireless terminal has not established the first Bluetooth link with the audio output device. If the screen projection is performed at this time, the screen projection device will display the terminal screen and play the terminal sound. If the wireless terminal establishes a connection with the audio output device during the screen projection process, the wireless terminal can determine whether to switch the audio path (from the screen projection device to the audio output device) according to user needs. As shown in FIG. 4 , the above step 203 may include the following steps.

Step 203A, establishing a first Bluetooth link with the audio output device.

Optionally, during the screen projection process, when receiving a Bluetooth connection instruction, the wireless terminal establishes a first Bluetooth link with the audio output device. Wherein, the audio output device may be a Bluetooth device paired with the wireless terminal for the first time, or a Bluetooth device previously paired with the wireless terminal.

In step 203B, a link establishment prompt is displayed, and the link establishment prompt is used to confirm whether to establish a second Bluetooth link between the screen projection device and the audio output device.

When it is detected that a Bluetooth connection is established with the audio output device during screen projection, in order to determine whether the audio path needs to be switched from the screen projection device to the audio output device, the wireless terminal displays a link establishment prompt to prompt the user to confirm whether the audio output device is connected to the screen projection device. A second Bluetooth link is established with the audio output device, and the audio path is switched to the audio output device.

If a confirmation instruction is received, the wireless terminal determines that it needs to switch to the audio channel, and executes step 203C; if a cancel instruction is received, the wireless terminal determines to maintain the audio channel, and continues to play the terminal sound through the screen projection device.

Schematically, as shown in FIG. 5 , during the screen projection process, the mobile phone 31 transmits screen projection data to the TV 33 , and the TV displays the screen of the mobile phone according to the image data therein, and plays the sound of the mobile phone according to the audio data therein. When the mobile phone 31 establishes a Bluetooth connection with the Bluetooth headset 32, the mobile phone 31 displays a link establishment prompt 311, prompting whether to establish a Bluetooth link between the TV 33 and the Bluetooth headset 32, and plays the sound of the mobile phone through the Bluetooth headset 32.

Step 203C, in response to the confirmation instruction, acquire the Bluetooth information of the audio device of the audio output device, and send a Bluetooth link establishment request including the Bluetooth information of the audio device to the screen projection device.

In response to the confirmation instruction, the wireless terminal obtains the audio device Bluetooth information of the audio output device, and then sends a Bluetooth link establishment request including the audio device Bluetooth information to the screen projection device, and the screen projection device communicates with the audio output device based on the audio device Bluetooth information. A second Bluetooth link is established, and the audio data is sent to the audio output device through the second Bluetooth link for playback by the audio output device. Wherein, the confirmation instruction is triggered by a confirmation operation, and the confirmation operation is received through a wireless terminal (such as clicking on a confirmation option), or received through an audio output device (such as tapping a Bluetooth headset).

Schematically, as shown in Figure 5, after the user clicks the confirmation option, the TV 33 and the Bluetooth earphone 32 promptly establish a Bluetooth link, and send audio data to the Bluetooth earphone 32 through the Bluetooth link, thereby playing the mobile phone through the Bluetooth earphone 32. sound.

In order to further improve the freedom of audio playback during the screen projection process, the user can switch the audio playback source of the phone's voice as needed during the screen projection process. In a possible implementation manner, in response to the switching instruction, the wireless terminal sends a switching request to the screen projection device, so that the screen projection device stops transmitting audio data to the audio output device through the second Bluetooth link, and plays the terminal sound based on the audio data .

Optionally, a switching control is displayed on the interface of the wireless terminal during the screen projection process, and when a trigger operation on the switching control is received, the wireless terminal receives a switching instruction, thereby sending a switching request to the screen projection device. Wherein, the switching request may be sent through a data path link, or may be sent through a Bluetooth link between the wireless terminal and the screen projection device.

After receiving the switching request, the screen projection device stops sending audio data to the audio output device through the second Bluetooth link, that is, the audio path is switched from the audio output device to the screen projection device. Optionally, after receiving the switch request, the second Bluetooth link between the screen projection device and the audio output device is maintained, so that the audio channel can be switched again later.

Schematically, as shown in Figure 6, during the screen projection process, the TV 33 first displays the screen of the mobile phone, and plays the sound of the mobile phone through the Bluetooth headset 32; According to the switching request, the transmission of audio data to the Bluetooth earphone 32 is stopped, thereby playing the sound of the mobile phone through its own speaker.

Optionally, when receiving the switching instruction again, the wireless terminal sends a switching request to the screen projection device, so that the screen projection device transmits audio data to the audio output device again through the second Bluetooth link.

In this embodiment, during the screen projection process, when receiving the switching instruction, the wireless terminal instructs the screen projection device to switch the audio channel, thereby realizing the switching of sound playback between the screen projection device and the audio output device, which further improves the screen projection process. The freedom of sound playback.

In a possible implementation manner, when the wireless terminal instructs the projection device to establish a Bluetooth link with the audio output device, it needs to determine whether to maintain the first connection with the audio output device according to the Bluetooth link support status of the audio output device. A Bluetooth link. Wherein, when the audio output device supports multiple Bluetooth links, the wireless terminal maintains the first Bluetooth link with the audio output device; when the audio output device supports a single Bluetooth link, the wireless terminal needs to disconnect from the audio output device. The first Bluetooth link between the screen mirroring device and the audio output device to establish a second Bluetooth link.

Moreover, when the first bluetooth link is disconnected, in order for the wireless terminal to continue to play the terminal sound through the audio output device after the screen projection ends, in a possible implementation manner, as shown in FIG. 7 , the method The following steps may also be included.

Step 701, in response to the screen projection end instruction, the wireless terminal sends a screen projection end request to the screen projection device.

In a possible implementation manner, when the screen projection end operation is received and the first Bluetooth link with the audio output device is disconnected during the screen projection process, the wireless terminal obtains the audio output device from the screen projection device Bluetooth information of the audio device, so that the terminal sound can continue to be played through the audio output device after the screen casting ends. Optionally, the wireless terminal obtains the Bluetooth information of the audio device by sending a screen projection end request.

Wherein, the screen projection end request may be sent through a data communication link, or may be sent through a Bluetooth link between the wireless terminal and the screen projection device.

Step 702, in response to the screen projection end request sent by the wireless terminal, the screen projection device sends the audio device Bluetooth information of the audio output device to the wireless terminal.

Since a Bluetooth link is established between the screen projection device and the audio output device, after receiving the request, the screen projection device can obtain the Bluetooth information of the audio device of the audio output device, and then send the Bluetooth information to the wireless terminal for wireless The terminal re-establishes the first Bluetooth link. Wherein, the Bluetooth information of the audio device may be sent through a data communication link, or may be sent through a Bluetooth link between the wireless terminal and the screen projection device.

Step 703, in response to the screen projection end request sent by the wireless terminal, the screen projection device disconnects the data communication link and the second Bluetooth link.

Since the terminal sound does not need to be played through the screen projection device after the screen projection ends, the screen projection device disconnects the second Bluetooth link with the audio output device while disconnecting the data communication link based on the screen projection end request, so that the wireless terminal Re-establish the Bluetooth connection with the audio output device.

Step 704, the wireless terminal re-establishes the first Bluetooth link with the audio output device based on the Bluetooth information of the audio device.

After the wireless terminal acquires the Bluetooth information of the audio device, it re-establishes the first Bluetooth link with the audio output device, and then plays the terminal sound through the audio output device, without the need for the user to manually trigger the Bluetooth link reconstruction.

In this embodiment, when the audio output device only supports single link, when the screen projection ends, the wireless terminal obtains the Bluetooth information of the audio output device from the screen projection device, so as to re-establish a Bluetooth link with the audio output device based on the Bluetooth information , so that the audio output device can continue to play the terminal sound after the screen projection ends, and the user does not need to manually trigger link reconstruction, which ensures the continuity of audio playback before and after the screen projection ends.

When both the terminal screen and the terminal sound are displayed and played through the screen projection device, the terminal screen and the terminal sound are kept in sync; and when the terminal screen is displayed by the screen projection device and the terminal sound is played by the audio output device, the audio output from the screen projection device There is a transmission delay when the device transmits audio data, so there may be a problem of out-of-sync audio and picture (expressed as sound lag).

Therefore, in order to improve the synchronization of audio and video during the screen projection process, in a possible implementation manner, when the screen projection device receives the screen projection data and needs to play the terminal sound through the audio output device, the screen projection device first determines the second The transmission delay of the Bluetooth link.

Regarding the specific method of determining the transmission delay of the second Bluetooth link, in a possible implementation manner, the screen projection device sends a delay measurement instruction to the audio output device through the second Bluetooth link, and the audio output device receives the delay measurement After the command, send a response command through the second bluetooth link. The screen projection device determines the transmission delay of the second Bluetooth link based on the time interval between the delay measurement instruction and the response instruction.

Schematically, when the delay measurement command is sent at t1 and the response command is received at t2, the transmission delay of the second Bluetooth link is (t2-t1)/2.

Further, the screen projection device synchronizes the transmission of the image data and the audio data based on the determined transmission delay, so as to ensure that in the screen projection data under the same time stamp, the display time of the image data is synchronized with the playback time of the audio data.

In a possible implementation, the screen projection device can perform delayed transmission processing on the image data based on the transmission delay, so as to use the delay to offset the transmission delay of the audio data, and ensure that the image decoding in the screen projection device and the audio in the audio output device Synchronization of decoding. For example, when the transmission delay of the second Bluetooth link is 20ms, the screen projection device decodes and displays the received image data with a delay of 20ms.

Optionally, before synchronizing the transmission of image data and audio data, the wireless terminal needs to determine the current display content. If the current display content has high real-time requirements, no synchronization will be performed; if the current display content has low real-time requirements, then Synchronization is performed, wherein the real-time requirement can be determined based on the application type of the application currently running on the terminal.

For example, if the currently displayed content is an application screen of a game application, in order to reduce the screen display delay, the wireless terminal does not perform synchronization; if the currently displayed content is an application screen of a video screen application, the wireless terminal performs synchronization to ensure the synchronization of audio and video.

In this embodiment, when the terminal screen is displayed through the screen projection device and the terminal sound is played through the audio output device, the screen projection device synchronizes the transmission of image data and audio data based on the transmission delay of the second Bluetooth link, which improves the projection efficiency. The synchronization of audio and video during the screen process.

It should be noted that, in each of the above-mentioned embodiments, the steps with the wireless terminal as the execution subject can be independently implemented as a screen projection method on the wireless terminal side, and the steps with the screen projection device as the execution subject can be independently implemented as a projection method on the screen projection device side. screen method, this embodiment will not repeat it here.

The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

Please refer to FIG. 8 , which shows a structural block diagram of a screen projection device provided by an embodiment of the present application. The device can include:

The data link establishing module 801 is configured to establish a data communication link with the screen projection device in response to the screen projection instruction, the data communication link is used to transmit the screen projection data, and the screen projection data includes image data and audio data;

The request sending module 802 is configured to send a bluetooth link establishment request to the screen projection device when the wireless terminal has established a first bluetooth link with the audio output device, so that the screen projection device can Establishing a request to establish a second Bluetooth link with the audio output device;

The first transmission module 803 is configured to transmit the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data;

The second transmission module 804 is configured to transmit the audio data to the audio output device through the second Bluetooth link.

Optionally, the device also includes:

A first Bluetooth link establishing module, configured to establish the first Bluetooth link with the audio output device;

The request sending module 802 is configured to:

Acquire the audio device Bluetooth information of the audio output device, and send the Bluetooth link establishment request including the audio device Bluetooth information to the screen projection device.

Optionally, the request sending module 802 is specifically used for:

Obtain the device status of the audio output device;

When the audio output device is in use, send the bluetooth link establishment request including the bluetooth information of the audio device to the screen projection device.

Optionally, the request sending module 802 includes:

a link establishing unit, configured to establish the first Bluetooth link with the audio output device;

A display unit, configured to display a link establishment prompt, where the link establishment prompt is used to confirm whether the second Bluetooth link is established between the screen projection device and the audio output device;

The request sending unit is configured to, in response to the confirmation instruction, acquire the audio device Bluetooth information of the audio output device, and send the Bluetooth link establishment request including the audio device Bluetooth information to the screen projection device.

Optionally, the device also includes:

A switching module, configured to send a switching request to the screen projection device in response to a switching instruction, so that the screen projection device stops transmitting the audio data to the audio output device through the second Bluetooth link, and based on the The above audio data is output as sound.

Optionally, the device also includes:

A Bluetooth link maintaining module, configured to maintain the first Bluetooth link when the audio output device supports multiple Bluetooth links;

or,

The Bluetooth link disconnection module is configured to disconnect the first Bluetooth link when the audio output device supports a single Bluetooth link.

Optionally, the device also includes:

The Bluetooth information acquisition module is configured to send a screen projection end request to the screen projection device in response to the screen projection end instruction, and the first Bluetooth link is disconnected, and the screen projection end request is used to request from the screen projection device Obtain the Bluetooth information of the audio output device of the audio output device;

A link reestablishment module, configured to re-establish the first Bluetooth link with the audio output device based on the Bluetooth information of the audio output device.

Optionally, the device also includes:

The screen projection end module is configured to send a screen projection end request to the screen projection device in response to the screen projection end instruction, so that the screen projection device disconnects the data communication link and the screen projection end request based on the screen projection end request. Second Bluetooth link.

Please refer to FIG. 9 , which shows a structural block diagram of a screen projection device provided by another embodiment of the present application. The device can include:

A data link establishment module 901, configured to establish a data communication link with the wireless terminal, the data communication link is used to transmit screen projection data, and the screen projection data includes image data and audio data;

The Bluetooth link establishment module 902 is configured to establish a second Bluetooth link with the audio output device in response to the Bluetooth link establishment request sent by the wireless terminal, and the audio output device has established a first Bluetooth link with the wireless terminal road;

A data receiving module 903, configured to receive the screen projection data transmitted by the wireless terminal through the data communication link;

a display module 904, configured to output a picture based on the image data;

The third transmission module 905 is configured to transmit the audio data to the audio output device through the second Bluetooth link, so that the audio output device outputs sound based on the audio data.

Optionally, the device also includes:

A stop module, configured to stop transmitting the audio data to the audio output device through the second Bluetooth link in response to the switching request sent by the wireless terminal;

The playing module is used for outputting sound based on the audio data.

Optionally, the device also includes:

A disconnection module, configured to disconnect the data communication link and the second Bluetooth link in response to the wireless terminal sending a screen projection end request.

Optionally, the audio output device supports a single Bluetooth link;

The device also includes:

The bluetooth information sending module is configured to send the audio device bluetooth information of the audio output device to the wireless terminal in response to the screen projection end request sent by the wireless terminal, so that the wireless terminal can communicate with the audio device based on the bluetooth information of the audio device The audio output device re-establishes the first Bluetooth link.

Optionally, the device also includes:

A delay determination module, configured to determine the transmission delay of the second Bluetooth link;

A synchronization module, configured to synchronize the transmission of the image data and the audio data based on the transmission delay.

Please refer to FIG. 10 , which shows a structural block diagram of an electronic device provided by an exemplary embodiment of the present application. The electronic device 1000 can be realized as the wireless terminal or the screen projection device in the foregoing embodiments. The electronic device may be a smartphone, a tablet, a personal computer, a smart TV, a projector, and the like. The electronic device 1000 in this application may include one or more of the following components: a processor 1010 , a memory 1020 and a Bluetooth chip 1030 .

Processor 1010 may include one or more processing cores. The processor 1010 uses various interfaces and lines to connect various parts in the entire electronic device 1000, and executes by running or executing instructions, programs, code sets or instruction sets stored in the memory 1020, and calling data stored in the memory 1020. Various functions of the electronic device 1000 and processing data. Optionally, the processor 1010 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware. The processor 1010 may integrate one or more of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a neural network processor (Neural-network Processing Unit, NPU) and a modem, etc. The combination. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used to render and draw the content that needs to be displayed on the display screen; the NPU is used to realize artificial intelligence (Artificial Intelligence, AI) functions; the modem is used to process wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 1010, but may be realized by a single chip.

The memory 1020 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory, ROM). Optionally, the memory 1020 includes a non-transitory computer-readable storage medium. The memory 1020 may be used to store instructions, programs, codes, sets of codes or sets of instructions. The memory 1020 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like for implementing the following method embodiments; the storage data area can store data created according to the use of the electronic device 1000 (such as audio data, phonebook) and the like.

The Bluetooth chip 1030 is a component for realizing the Bluetooth function. Wherein, the Bluetooth chip 1030 includes two parts, Host and Controller (corresponding to different Bluetooth protocol stacks), and the Host and Controller can run on the same chip (single-chip architecture), or can run on different chips (dual-chip architecture). For example, the Host runs on the processor, and the Controller runs on the Bluetooth module; or, both the Host and the Controller run on the Bluetooth chip 1030 .

In addition, those skilled in the art can understand that the structure of the electronic device 1000 shown in the above drawings does not constitute a limitation on the electronic device, and the electronic device may include more or less components than those shown in the illustration, or combine certain components, or a different arrangement of components. For example, the electronic device 1000 also includes components such as a display screen, a sensor, a speaker, a microphone, a power supply, and a WiFi component, which will not be repeated here.

An embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores at least one program, and the at least one program is loaded and executed by a processor to implement the screen projection method described in each of the above embodiments .

The embodiment of the present application also provides a computer program product, where the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The Bluetooth chip of the electronic device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the electronic device executes the screen projection method provided in various optional implementation manners of the above aspects.

It should be understood that the "plurality" mentioned herein refers to two or more than two. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship. In addition, the numbering of the steps described herein only exemplarily shows a possible sequence of execution among the steps. In some other embodiments, the above-mentioned steps may not be executed according to the order of the numbers, such as two different numbers The steps are executed at the same time, or two steps with different numbers are executed in the reverse order as shown in the illustration, which is not limited in this embodiment of the present application.

The above are only optional embodiments of the application, and are not intended to limit the application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the application shall be included in the protection of the application. within range.

Claims (19)

1. A screen projection method in a wireless terminal, the method comprising:

   In response to the screen projection instruction, a data communication link is established with the screen projection device, the data communication link is used to transmit screen projection data, and the screen projection data includes image data and audio data;

   When the wireless terminal establishes a first Bluetooth link with the audio output device, send a Bluetooth link establishment request to the screen projection device, so that the screen projection device can communicate with the audio output based on the Bluetooth link establishment request and the audio output device. the device establishes a second Bluetooth link; and,

   Transmitting the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data, and transmits the screen projection data to the audio output device through the second Bluetooth link the audio data.
2. The method according to claim 1, wherein, before establishing a data communication link with the screen projection device in response to the screen projection instruction, the method comprises:

   establishing the first bluetooth link with the audio output device;

   In the case where the wireless terminal and the audio output device have established a first Bluetooth link, sending a Bluetooth link establishment request to the screen projection device includes:

   Acquire the audio device Bluetooth information of the audio output device, and send the Bluetooth link establishment request including the audio device Bluetooth information to the screen projection device.
3. The method according to claim 2, wherein the sending the bluetooth link establishment request including the bluetooth information of the audio device to the screen projection device comprises:

   obtaining a device state of the audio output device; and,

   When the audio output device is in use, send the Bluetooth link establishment request including the Bluetooth information of the audio device to the screen projection device.
4. The method according to claim 1, wherein when the wireless terminal and the audio output device have established a first Bluetooth link, sending a Bluetooth link establishment request to the screen projection device includes:

   establishing the first bluetooth link with the audio output device;

   displaying a link establishment prompt, where the link establishment prompt is used to confirm whether to establish the second Bluetooth link between the screen projection device and the audio output device; and,

   Responding to the confirmation instruction, acquire the audio device Bluetooth information of the audio output device, and send the Bluetooth link establishment request including the audio device Bluetooth information to the screen projection device.
5. The method according to any one of claims 1 to 4, wherein, after transmitting the screen projection data to the screen projection device, the method further comprises:

   In response to a switching instruction, sending a switching request to the screen projection device, so that the screen projection device stops transmitting the audio data to the audio output device through the second Bluetooth link, and outputs sound based on the audio data .
6. The method according to any one of claims 1 to 4, wherein, after sending the Bluetooth link establishment request to the screen projection device, the method includes:

   In the case that the audio output device supports multiple Bluetooth links, maintaining the first Bluetooth link;

   or,

   If the audio output device supports a single Bluetooth link, disconnect the first Bluetooth link.
7. The method according to claim 6, wherein, after transmitting the screen projection data to the screen projection device, the method further comprises:

   In response to the screen projection end instruction and the first Bluetooth link is disconnected, acquire the audio device Bluetooth information of the audio output device from the screen projection device; and,

   Re-establish the first Bluetooth link with the audio output device based on the Bluetooth information of the audio device.
8. The method according to any one of claims 1 to 4, wherein, after transmitting the screen projection data to the screen projection device, the method further comprises:

   In response to the screen projection end instruction, sending a screen projection end request to the screen projection device, so that the screen projection device disconnects the data communication link and the second Bluetooth link based on the screen projection end request.
9. A screen projection method in a screen projection device, the method comprising:

   Establish a data communication link with the wireless terminal, the data communication link is used to transmit screen projection data, and the screen projection data includes image data and audio data;

   In response to the Bluetooth link establishment request sent by the wireless terminal, establish a second Bluetooth link with an audio output device, and the audio output device has a first Bluetooth link established with the wireless terminal;

   receiving the screen projection data transmitted by the wireless terminal through the data communication link; and,

   outputting a picture based on the image data, and transmitting the audio data to the audio output device through the second Bluetooth link, so that the audio output device outputs sound based on the audio data.
10. The method according to claim 9, wherein, after outputting a picture based on the image data and transmitting the audio data to the audio output device through the second Bluetooth link, the method further comprises:

    Stop transmitting the audio data to the audio output device via the second Bluetooth link in response to a switching request sent by the wireless terminal; and,

    Sound is output based on the audio data.
11. The method according to claim 9, wherein, after outputting a picture based on the image data and transmitting the audio data to the audio output device through the second Bluetooth link, the method further comprises:

    Disconnecting the data communication link and the second Bluetooth link in response to the wireless terminal sending a screen projection end request.
12. The method according to claim 9, wherein the audio output device supports a single Bluetooth link;

    After outputting the picture based on the image data and transmitting the audio data to the audio output device through the second Bluetooth link, the method further includes:

    In response to the screen projection end request sent by the wireless terminal, sending the audio device Bluetooth information of the audio output device to the wireless terminal, so that the wireless terminal re-establishes with the audio output device based on the audio device Bluetooth information The first Bluetooth link.
13. The method according to any one of claims 9 to 12, wherein, before outputting a picture based on the image data and transmitting the audio data to the audio output device through the second Bluetooth link, the method Also includes:

    determining a transmission delay of the second Bluetooth link; and,

    The transmission synchronization of the image data and the audio data is performed based on the transmission delay.
14. A screen projection device, the device comprising:

    A data link establishment module, configured to establish a data communication link with the screen projection device in response to a screen projection instruction, the data communication link is used to transmit screen projection data, and the screen projection data includes image data and audio data;

    A request sending module, configured to send a bluetooth link establishment request to the screen projection device when the wireless terminal has established a first bluetooth link with the audio output device, so that the screen projection device establishes a bluetooth link based on the bluetooth link requesting to establish a second Bluetooth link with the audio output device;

    A first transmission module, configured to transmit the screen projection data to the screen projection device through the data communication link, so that the screen projection device outputs a picture based on the image data; and,

    A second transmission module, configured to transmit the audio data to the audio output device through the second Bluetooth link.
15. A screen projection device, the device comprising:

    A data link establishment module, configured to establish a data communication link with the wireless terminal, the data communication link is used to transmit screen projection data, and the screen projection data includes image data and audio data;

    A Bluetooth link establishment module, configured to establish a second Bluetooth link with an audio output device in response to the Bluetooth link establishment request sent by the wireless terminal, and the audio output device establishes a first Bluetooth link with the wireless terminal ;

    A data receiving module, configured to receive the screen projection data transmitted by the wireless terminal through the data communication link;

    a display module for outputting a picture based on the image data; and,

    A third transmission module, configured to transmit the audio data to the audio output device through the second Bluetooth link, so that the audio output device outputs sound based on the audio data.
16. A wireless terminal, the wireless terminal includes a processor and a memory, at least one program is stored in the memory, and the at least one program is loaded and executed by the processor to implement any one of claims 1 to 8 The screen projection method in the wireless terminal.
17. A screen projection device, the screen projection device includes a processor and a memory, at least one program is stored in the memory, and the at least one program is loaded and executed by the processor to implement any one of claims 9 to 13. The screen projection method in the screen projection device.
18. A computer-readable storage medium, at least one program is stored in the computer-readable storage medium, and the at least one program is loaded and executed by a processor to implement the wireless terminal according to any one of claims 1 to 8. A screen projection method, or, realize the screen projection method in the screen projection device according to any one of claims 9 to 13.
19. A computer program product, the computer program product includes computer instructions, the computer instructions are stored in a computer-readable storage medium; the bluetooth chip of the electronic device reads the computer instructions from the computer-readable storage medium, the The processor executes the computer instructions, so that the electronic device executes to realize the screen projection method in the wireless terminal according to any one of claims 1 to 8, or, to realize the projection method according to any one of claims 9 to 13 The screen casting method in the screen device.

Images