CN114979899A

CN114979899A - Audio redirection method, device, equipment and storage medium

Info

Publication number: CN114979899A
Application number: CN202210417067.XA
Authority: CN
Inventors: 何�轩; 杨俊拯; 刘科洋; 普明君
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2022-04-20
Filing date: 2022-04-20
Publication date: 2022-08-30
Also published as: WO2023202152A1

Abstract

The embodiment of the application discloses an audio redirection method, an audio redirection device, audio redirection equipment and a storage medium, and belongs to the technical field of redirection. The method comprises the following steps: receiving an audio redirection instruction; creating a source audio redirector based on the audio redirection instruction; performing audio acquisition based on an audio redirection mode indicated by the audio redirection instruction to obtain a redirected audio, wherein the audio redirection mode comprises device-level redirection and application-level redirection; and transmitting the redirected audio to the destination device through a link between the source audio redirector and the destination audio redirector, wherein the destination audio redirector is created by the destination device, and then the redirected audio is played through the destination audio output device. By adopting the scheme provided by the embodiment of the application, the problem of audio redirection at the equipment level and the application level can be solved, multi-level many-to-many audio redirection can be realized, and the applicability to complex audio redirection scenes is improved.

Description

Audio redirection method, device, equipment and storage medium

Technical Field

The embodiment of the application relates to the technical field of redirection, in particular to an audio redirection method, an audio redirection device, audio redirection equipment and a storage medium.

Background

Redirect refers to a technique for transferring certain capabilities from one end device to another, including video, audio, and control, among others. Audio redirection is a common redirection technique in everyday life.

With the help of the audio redirection function, the source device can transmit the audio to the destination device, thereby achieving better playing effect. For example, for redirecting the audio in the mobile phone to the car-mounted scene, when the audio needs to be played at the mobile phone end, the mobile phone end can redirect the audio to the vehicle-mounted speaker, and then the vehicle-mounted speaker plays the audio.

Disclosure of Invention

The embodiment of the application provides an audio redirection method, an audio redirection device, an audio redirection equipment and a storage medium. The technical scheme is as follows:

in one aspect, an embodiment of the present application provides an audio redirection method, where the method is used for a source device, and the method includes:

receiving an audio redirection instruction;

creating a source audio redirector based on the audio redirection instruction;

acquiring audio based on an audio redirection mode indicated by the audio redirection instruction to obtain a redirected audio, wherein the audio redirection mode comprises equipment-level redirection and application-level redirection;

and transmitting the redirected audio to a destination device through a link between the source audio redirector and the destination audio redirector, wherein the destination audio redirector is created by the destination device.

In another aspect, an embodiment of the present application provides an audio redirection method, where the method is used for a destination device, and the method includes:

receiving an audio redirection instruction;

creating a destination audio redirector based on the audio redirection instruction;

receiving a redirected audio transmitted by a source device through a link between the destination audio redirector and the source audio redirector, wherein the source audio redirector is created by the source device, the redirected audio is obtained by the source device through audio acquisition based on an audio redirection mode indicated by the audio redirection instruction, and the audio redirection mode comprises device level redirection and application level redirection;

and playing the redirected audio through the destination audio output equipment.

In another aspect, an embodiment of the present application provides an audio redirection apparatus, where the apparatus is used for a source device, and the apparatus includes:

the first instruction receiving module is used for receiving an audio redirection instruction;

a creating module, configured to create a source audio redirector based on the audio redirection instruction;

the audio acquisition module is used for acquiring audio based on an audio redirection mode indicated by the audio redirection instruction to obtain a redirection audio, wherein the audio redirection mode comprises equipment-level redirection and application-level redirection;

a first transmission module, configured to transmit the redirected audio to a destination device through a link between the source audio redirector and a destination audio redirector, where the destination audio redirector is created by the destination device.

In another aspect, an embodiment of the present application provides an audio redirection apparatus, where the apparatus is used for a destination device, and the apparatus includes:

the first establishing module is used for establishing a destination audio redirector based on the audio redirection instruction;

a first receiving module, configured to receive, through a link between the destination audio redirector and a source audio redirector, a redirected audio transmitted by a source device, where the source audio redirector is created by the source device, the redirected audio is obtained by the source device by performing audio acquisition based on an audio redirection mode indicated by the audio redirection instruction, and the audio redirection mode includes device-level redirection and application-level redirection;

and the playing module is used for playing the redirected audio through the destination audio output equipment.

In another aspect, an embodiment of the present application provides a computer device, which includes a processor and a memory; the memory stores at least one program for execution by the processor to implement the audio redirection method as described in the above aspect.

In another aspect, embodiments of the present application provide a computer-readable storage medium having at least one instruction stored therein, where the at least one instruction is executed by a processor to implement the audio redirection method according to the above aspect.

In another aspect, embodiments of the present application provide a computer program product including computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the audio redirection method provided in the various alternative implementations of the above aspects.

In the audio redirection process, after receiving an audio redirection instruction, a source device creates a source audio redirector based on the audio redirection instruction, further performs audio acquisition based on an audio redirection mode indicated by the audio redirection instruction, and finally transmits the redirected audio to a destination device through a link between the source audio redirector and the destination audio redirector; by adopting the scheme provided by the embodiment of the application, the problem of audio redirection at a device level and an application level can be solved, the device audio of the source device can be played through the audio output device of the destination device, and the application audio of the specified application in the source device can also be played.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 illustrates a flow chart of an audio redirection method provided by an exemplary embodiment of the present application;

FIG. 2 is a schematic diagram of an implementation of the encoding, transmission, and decoding processes provided by an exemplary embodiment of the present application;

FIG. 3 is a schematic diagram of an implementation of the encoding, transmission, and decoding processes provided by another exemplary embodiment of the present application;

FIG. 4 illustrates two audio output modes provided by an exemplary embodiment of the present application;

FIG. 5 is a diagram illustrating an implementation environment of a device-level redirect mode audio redirection method according to an exemplary embodiment of the present application;

FIG. 6 illustrates a flow chart of a device level redirect mode audio redirect method provided by an exemplary embodiment of the present application;

FIG. 7 illustrates a flow diagram of redirecting audio data in an environment implementing a device-level redirect mode;

fig. 8 is a schematic diagram illustrating an implementation environment under an application-level pitch scheme provided by another exemplary embodiment of the present application;

FIG. 9 illustrates a flow chart of a method for device level redirect mode audio redirection provided by an exemplary embodiment of the present application;

FIG. 10 illustrates a flow diagram of redirecting audio data in an implementation environment in an application-level redirection mode;

FIG. 11 is a block diagram illustrating an audio redirection device according to an embodiment of the present application;

fig. 12 is a block diagram illustrating an audio redirection device according to an embodiment of the present application;

fig. 13 is a block diagram illustrating a computer device according to an exemplary embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

In the related art, the policy for multiple audio channels mostly does not consider the situation that multiple audio output devices exist at the destination, and even if the situation that multiple audio output devices exist at the destination is considered, only one audio output device is allowed to output in a single channel, that is, only one audio output device is allowed to output in the same sound zone, which audio is output is determined by the priority and the focus of sound sources, and the mixed sound output under the specific situation is not supported.

In addition, the audio redirection scenario in the related art only mentions a many-to-one case, and does not mention a one-to-many, even a many-to-many case, that is, a case where sounds of the same application are simultaneously output to a plurality of destination terminals or a plurality of audio output devices. It should be noted that in this case, the destination does not interfere with each other, and the destination device is required to support simultaneous output.

In view of this, in the embodiment of the present application, for an audio redirection scenario, in a situation where multiple channels of audio coexist, a certain channel of audio output may be designated, and also a certain number of channels of audio mixed output may be selected, when an application is projected from a source end device to a destination end device, if multiple destination end devices exist, the audio of the application may be simultaneously output to the multiple destination end devices, and when multiple audio output devices exist in the destination end device, the multiple channels of audio may be respectively output to the multiple audio output devices, so that multiple channels of audio separate output is implemented, and also a closing of a certain channel of audio is supported, so as to improve user experience of multiple channels of audio in redirection.

The source device is an electronic device with redirection (redirect) requirement, which may be a mobile terminal such as a smart phone, a tablet computer, a personal computer, etc. An object having a redirection requirement in a source device is referred to as a redirection object, the redirection object may be a screen image or a redirection application, and redirection content of the redirection object may include at least one of video, audio, and control.

In this embodiment, the same source device may perform audio redirection on at least two redirection objects at the same time. For example, the audio redirection may be performed on the game application and the video application at the same time, or the audio redirection may be performed on the video application and the navigation application at the same time. The number of redirection objects that the source device supports simultaneous audio redirection has an upper limit, and the upper limit is related to the processing performance of the source device.

The destination device is an electronic device for displaying the redirection result, and may be a smart phone, a tablet computer, a personal computer, a smart television, or a vehicle-mounted terminal (such as a car machine), and the like. The destination terminal equipment has an audio playing function, and the audio played by the destination terminal equipment is the audio of the screen projection object.

Whether the source device or the destination device has an audio output device, common audio output devices include: the device is provided with a loudspeaker, a wired earphone, a Bluetooth earphone, a wired sound box, a Bluetooth sound box and the like. It is possible for some terminal devices to have multiple audio output devices. Such as a car machine, typically contains multiple screens, each of which may be wired or wirelessly connected to a headset separately.

In some embodiments, when the destination device has an audio output device and at least two audio output devices, the at least two audio output devices may play different audios simultaneously, or the same audio, and the screen-projected audio played by each audio output device may be a single audio redirection object or multiple audio redirection objects (at this time, multiple audio redirection objects are displayed on the screen of the destination device in a split-screen manner).

Optionally, the connection manner adopted between the source device and the destination device may include at least one of a Wlan AP mode, a WiFi-P2P, a USB wired connection, and a mobile data network, which is not limited in this embodiment of the present application.

Referring to fig. 1, a flowchart of an audio redirection method provided by an exemplary embodiment of the present application is shown, where the method includes:

step 101, a source device receives an audio redirection instruction.

When audio redirection needs to be performed through the source device, the source device receives an audio redirection instruction in response to the audio redirection operation.

Optionally, the audio redirection operation may be triggered at the source device side, or may be triggered by a third-party device, where the third-party device and the source device are in the same scheduling domain, for example, the third-party device and the source device log in the same user account.

Regarding the specific content of the audio redirection of the source device, in some embodiments, the source device may redirect the screen image, and may also redirect an application installed and running (i.e., a redirection application). Optionally, when the redirection object is an application, the application may be in a background running state in the redirection process.

Optionally, the redirection application may be a navigation application, a video application, a game application, or even a pure audio application, and the specific type of the screen-projection application is not limited in the embodiment of the present application.

And 102, receiving an audio redirection instruction by the destination equipment.

In a possible implementation manner, after receiving the audio redirection instruction, the source device transmits the audio redirection instruction to the destination device, and the destination device receives the audio redirection instruction.

Regarding the transmission manner of the audio redirection instruction, optionally, the source device may transmit the audio redirection instruction by a wireless manner, for example, bluetooth, Wlan AP, WiFi-P2P, or a mobile data network; the redirection data may also be transmitted in a wired manner, such as a USB wired connection; the redirection data may also be transmitted in a wired and wireless hybrid manner, which is not limited in the embodiment of the present application.

Step 103, the source device creates a source audio redirector based on the audio redirection instruction.

In a possible implementation manner, after receiving the audio redirection instruction, the source device further creates a source audio redirector based on the audio redirection instruction, where the source audio redirector performs grouping based on the destination device, and the source audio redirectors in the same group share audio transmission.

In one possible implementation, the source device creates a source audio redirector based on the source device identification, the application identification, the destination device identification, and the audio output device identification indicated by the audio redirection instruction.

Optionally, when the source device needs to perform audio redirection to different destination devices (which may be the same audio redirection object or different audio redirection objects), the source device creates multiple source audio redirectors; when a source end device casts a screen of the same redirection object to a plurality of audio output devices of a destination end device, the source end device creates a plurality of source end audio redirectors aiming at different audio output devices; when a source device casts different redirection objects to a plurality of audio output devices of a destination device, the source device creates a plurality of source audio redirectors for the different redirection objects.

For example, when a game application needs to be audio-redirected to a first audio output device of a first destination device and a second audio output device of a second destination device, the source device creates a first source audio redirector based on the source device identifier, the first destination identifier, the game application identifier and the first audio output device identifier, and creates a second source audio redirector based on the source device identifier, the second destination identifier, the navigation application identifier and the second audio output device identifier; when the game application needs to be redirected to the audio of a first audio output device of a first destination end device and the navigation application needs to be redirected to the audio of a second audio output device of the first destination end device, the source end device creates a first source end audio redirector based on a source end device identification, a first destination end identification, a game application identification and the first audio output device identification, and creates a second source end audio redirector based on the source end device identification, the first destination end identification, the navigation application identification and the second audio output device identification; when the game application needs to be simultaneously audio-redirected to a first audio output device and a second audio output device of a first destination device, the source device creates a first source audio redirector based on the source device identifier, the first destination device identifier, the game application identifier and the first audio output device identifier, and creates a second source audio redirector based on the source device identifier, the first destination device identifier, the game application identifier and the second audio output device identifier.

And 104, the destination device creates a destination audio redirector based on the audio redirection instruction.

Corresponding to the source device, the destination device creates a destination audio redirector based on the audio redirection instruction, the destination audio redirector groups based on the source device, and the same group of destination audio redirectors share audio transmission.

In one possible implementation, the destination device creates a destination audio redirector based on the source device identification, the application identification, the destination device identification, and the audio output device identification indicated by the audio redirection instruction.

When the source device redirects audio to different destination devices (which may be the same audio redirection object or different audio redirection objects), the different destination devices create different destination redirectors; when a source end device redirects the same audio redirection object to a plurality of audio output devices of a destination end device, the destination end device creates a plurality of destination end redirectors aiming at different audio output devices; when the source device audio redirects different audio redirection objects to a plurality of audio output devices of the destination device, the destination device creates a plurality of destination redirectors for the different audio redirection objects.

For example, when the source device redirects the game application to a first audio output device of the first destination device and a second audio output device of the second destination device, the first destination device creates a first destination audio redirector based on the source device identifier, the first destination identifier, the game application identifier and the first audio output device identifier, and the second destination device creates a second destination audio redirector based on the source device identifier, the second destination identifier, the game application identifier and the second audio output device identifier; when a source end device redirects a game application to a first audio output device audio of a first destination end device and redirects a navigation application to a second audio output device audio of the first destination end device, a destination end device creates a first destination end audio redirector based on a source end device identifier, a first destination end identifier, a game application identifier and the first audio output device identifier, and creates a second destination end audio redirector based on the source end device identifier, the first destination end identifier, the navigation application identifier and the second audio output device identifier; when the source device redirects the game application to the first audio output device and the second audio output device of the first destination device, the destination device creates a first destination audio redirector based on the source device identifier, the first destination identifier, the game application identifier and the first audio output device identifier, and creates a second destination audio redirector based on the source device identifier, the first destination identifier, the game application identifier and the second audio output device identifier.

And 105, the source end equipment acquires audio based on the audio redirection mode indicated by the audio redirection instruction to obtain the redirection audio.

In one possible implementation, the source device performs audio acquisition based on an audio redirection mode indicated by the audio redirection instruction, where the audio redirection mode includes a device-level redirection and an application-level redirection.

In the device-level redirection mode, the source device performs device-level audio acquisition, and at this time, audio of each application in the device is acquired in a sound mixing manner.

In the application-level redirection mode, the source device performs application-level audio acquisition, and at this time, the sound of each application in the device can be acquired respectively.

Step 106, the source device transmits the redirected audio to the destination device through the link between the source audio redirector and the destination audio redirector.

In a possible embodiment, after completing audio acquisition, the source device transmits the encoded redirected audio to the destination device through at least one link between at least one source redirector and one destination redirector.

Regarding the transmission manner of the redirected audio, optionally, the source device may transmit the redirected audio by wireless, for example, Wlan AP, WiFi-P2P or mobile data network; the redirected audio may also be transmitted in a wired manner, such as a USB wired connection; the redirected audio may also be transmitted in a wired and wireless hybrid manner, which is not limited in the embodiment of the present application.

Step 107, the destination device receives the redirected audio transmitted by the source device through the link between the destination audio redirector and the source audio redirector.

In one possible implementation, the destination device receives redirected audio transmitted by the source device over at least one link between at least one destination redirector and at least one source redirector.

And step 108, the destination terminal equipment plays the redirected audio through the destination terminal audio output equipment.

In a possible implementation manner, when the destination device has at least two audio output devices, the destination device determines a target audio output device according to the target audio output device identifier, and then performs audio playing through the target audio output device.

To sum up, in the embodiment of the present application, in an audio redirection process, after receiving an audio redirection instruction, a source device creates a source audio redirector based on the audio redirection instruction, further performs audio acquisition based on an audio redirection mode indicated by the audio redirection instruction, and finally transmits a redirected audio to a destination device through a link between the source audio redirector and the destination audio redirector; by adopting the scheme provided by the embodiment of the application, the problem of audio redirection at a device level and an application level can be solved, the device audio of the source device can be played through the audio output device of the destination device, and the application audio of the specified application in the source device can also be played.

In a possible implementation manner, the source device performs audio coding on the device redirection audio through a uniform audio encoder to obtain a device redirection audio data stream, and then redirects the device redirection audio data stream to each source audio redirector shunting transmission device.

Optionally, before transmitting the audio to the destination device, the source device encodes the acquired content through the encoder after acquiring the audio, and generates audio data, where the encoding overhead is generated in the process. Correspondingly, after the destination device receives the audio data, the destination device needs to analyze the audio data by using a decoder, so as to restore the audio, and decoding overhead is generated in the process.

In a possible audio redirection scenario, the same redirection object in a source device needs to be redirected by audio to a different destination device, or redirected by audio to a different output device of the same destination device. In the related art, the method shown in fig. 2 is adopted, that is, when it is required to redirect the audio in the source device to the audio output device 1 and the audio output device 2 of the destination device 1, and the audio output device 3 of the destination device 2 at the same time, audio encoding is performed through the encoders 1, 2, and 3, audio decoding is performed through the decoders 1, 2, and 3, and audio data stream transmission is performed in three paths, which may result in triple encoding and decoding overhead.

In this embodiment, the source device and the destination device use a multiplexing strategy, that is, the source device encodes the audio through the multiplexing encoder to generate audio data, and the destination device analyzes the audio data through the multiplexing decoder to restore the audio. Compared with the related technology, the source end device and the destination end device respectively adopt multiplexing strategies, and the encoding and decoding expenses are reduced. As shown in fig. 3, similarly, when it is required to redirect the audio in the source device to the audio output device 1 and the audio output device 2 of the destination device 1 and the audio output device 3 of the destination device 2 at the same time, the source device multiplexes the encoder 1 to perform audio encoding to obtain an audio data stream, after receiving the audio data stream, the destination device 1 performs audio decoding through the multiplexing decoder 1, so that the decoded audio is played through the audio output device 1 and the audio output device 2, after receiving the audio data stream, the destination device 2 performs audio decoding through the decoder 2, so that the decoded audio is played through the audio output device 3.

In this embodiment, the source device and the destination device respectively use a multiplexing strategy to multiplex the encoder and the decoder, thereby reducing encoding overhead and decoding overhead.

In another possible implementation, the destination device may also create an audio player based on the audio redirection mode indicated by the audio redirection instruction, and output the redirected audio to the destination audio output device through the audio player.

Alternatively, there are many possibilities for the audio player to output the redirected audio to the destination audio output device.

When an audio player corresponds to a destination audio output device, the destination device outputs a redirected audio to a single destination audio output device through the audio player, and in a multi-channel audio scene, two audio output modes can occur according to the corresponding relationship between a plurality of audio players and a plurality of audio output devices: a mixed sound output and a split output.

Illustratively, as shown in fig. 4, when one audio player corresponds to at least two destination audio output devices, the destination device shunts and outputs the redirected audio to the at least two destination audio output devices through the audio player. The shunt output means that one audio player corresponds to a plurality of audio output devices, and the same channel of audio of the audio player is shunted and output to the plurality of audio output devices. The implementation principle can be used for shunting and multiplexing from an application layer or a system layer.

Schematically, as shown in fig. 4, when at least two audio players correspond to a destination audio output device, the destination device performs audio mixing processing on redirected audio output by the at least two audio players, and outputs the redirected audio after the audio mixing processing to the destination audio output device. The audio mixing output means that a plurality of audio players correspond to one audio output device, each audio player is responsible for playing one path of audio, audio mixing output is performed in the audio output device, and the android system layer supports the capability.

In the embodiment of the application, the method is divided into an equipment-level multi-channel audio method and an application-level multi-channel audio method according to different bottom-layer audio acquisition modes. In order to solve the multiplexing and shunting problems in multi-channel audio acquisition, and aiming at the topological structure of the audio output equipment of the destination end equipment, strategies such as audio mixing output, audio shunting and the like are adopted, so that the audio performance is improved, and the power consumption is reduced.

Referring to fig. 5, a schematic diagram of an implementation environment of a device-level redirection mode audio redirection method according to an exemplary embodiment of the present application is shown, where the implementation environment may include: at least one source end device 510 and at least one destination end device 520.

In fig. 5, the source device 510 includes a smart phone 511 and a tablet computer 512, and the destination device 520 includes a vehicle-mounted terminal 521 and an intelligent large-screen device 522. The vehicle-mounted terminal 521 and the smart large-screen device 522 are controlled by an SoC (System on Chip).

As shown in fig. 5, the vehicle-mounted terminal 521 has a main-drive central control long screen 5211, a first audio output device 5214 of the main-drive central control long screen 5211, a secondary-drive entertainment screen 5212 and a second audio output device 5215 of the secondary-drive entertainment screen 5212 (all controlled by the SoC5213 of the vehicle-mounted terminal 521), the first audio output device 5214 and the second audio output device 5215 are independent from each other, and the intelligent large screen device 522 has a screen 5221 and a third audio output device 5222.

The many-to-many redirection in the embodiment of the present application is embodied in a multi-source device (multiple source devices participate in redirection), a multi-directed object (multiple redirection objects participate in redirection in the same source device), a multi-destination device (multiple destination devices participate in redirection), and a multi-audio output device (multiple audio output devices participate in redirection in the same destination device). In a possible many-to-many screen projection scenario, as shown in fig. 5, the navigation application in the smartphone 511 is redirected to the main driving center control long screen 5211 of the vehicle-mounted terminal 521, and the navigation voice is played by the first audio output device 5214; the first game application is redirected to the main driving center long screen 5211 of the vehicle-mounted terminal 521 and the screen 5221 of the intelligent large screen device 522, that is, the screen 5221 and the main driving center long screen 5211 display the same redirection content, and the first audio output device 5214 and the third audio output device 5222 both play a first game voice, wherein the first game application and the navigation application in the main driving center long screen 5211 are displayed in a split screen manner, and the first game voice and the navigation voice in the first audio output device 5214 are output in a mixed manner; the second game application in the tablet computer 512 is redirected to the secondary entertainment screen 5212 of the in-vehicle terminal 521, and the second game voice is played by the second audio output device 5215.

It should be noted that, the foregoing embodiment is only schematically described by taking an example that the mobile terminal performs audio redirection to the vehicle-mounted terminal and the intelligent large-screen device, and the scheme provided by the embodiment of the application may be applied to other many-to-many redirection scenarios, and the embodiment does not limit a specific application scenario.

The embodiment of the application supports two sound collection schemes, namely a device-level sound collection scheme and an application-level sound collection scheme, wherein the sound collection scheme is indicated by an audio redirection instruction, and the source end device collects audio according to a sound collection mode indicated by the audio redirection instruction. Referring to fig. 6, which shows a flowchart of a method for device-level redirection mode audio redirection according to an exemplary embodiment of the present application, and the embodiment of the present application is described by taking an application of the method to the implementation environment shown in fig. 5 as an example, the method may include the following steps:

step 601, a source device receives an audio redirection instruction.

The step 101 may be referred to in the implementation manner of this step, and this embodiment is not described herein again.

In step 602, the destination device receives an audio redirection instruction.

The step 102 may be referred to in the implementation manner of this step, and this embodiment is not described herein again.

Step 603, the source device creates a source audio redirector based on the audio redirection instruction.

The step 103 may be referred to in the implementation manner of this step, which is not described herein again.

In step 604, the destination device creates a destination audio redirector based on the audio redirection instruction.

The step 104 can be referred to in the implementation manner of this step, and this embodiment is not described herein again.

Step 605, the source device performs audio acquisition through the device-level audio collector based on the audio redirection instruction to obtain a device redirection audio.

And under the condition that the audio redirection mode indicated by the audio redirection instruction is the equipment level redirection mode, the source end equipment carries out audio acquisition through the equipment level audio collector to obtain the equipment redirection audio of the source end equipment.

Optionally, when the audio redirection mode is the device-level redirection mode, one source device corresponds to one device-level audio collector, and the device-level audio collector is configured to collect device-level audio.

Taking an android system as an example, the recording function provided by a standard android system collects audio after mixing of multiple applications at a system layer, that is, the audio is equipment-level redirected audio.

Optionally, after the source device performs device-level Audio acquisition, the encoder performs Audio encoding on the acquired Audio content to obtain a device redirection Audio data stream, where the source device may encode in an Audio encoding format such as AAC (Advanced Audio Coding), and the like, which is not limited in this embodiment of the present application.

Step 606, under the condition that at least two source end audio redirectors are created, the source end device groups the source end audio redirectors to obtain at least one source end redirector group.

In a possible implementation manner, in a case that at least two source-side audio redirectors are created, a source-side device groups the source-side audio redirectors based on destination-side device identifiers corresponding to the source-side audio redirectors to obtain at least one source-side redirector group, where the source-side audio redirectors corresponding to the same destination-side device identifier are divided into the same source-side redirector group.

Since the source device creates the source audio redirector based on the source device identifier, the application identifier, the destination device identifier and the audio output device identifier indicated by the audio redirection instruction, the source device identifiers and the destination device identifiers in the same source redirector group are consistent.

Optionally, the source audio redirectors in the same source redirector group share audio transmission.

Step 607, under the condition that at least two destination audio redirectors are created, the destination device groups the destination audio redirectors to obtain at least one destination redirector group.

Corresponding to the source device, in a possible implementation manner, in the case that at least two destination audio redirectors are created, the destination device groups the destination audio redirectors based on source device identifiers corresponding to the destination audio redirectors to obtain at least one destination redirector group, where the destination audio redirectors corresponding to the same source device identifier are divided into the same destination redirector group.

For example, 3 destination audio redirectors are created in the destination device, where the destination audio redirector 1 and the destination audio redirector 2 are both destination audio redirectors corresponding to the source device 1, and the destination audio redirector 3 is a destination audio redirector corresponding to the source device 2, where the destination audio redirector 1 and the destination audio redirector 2 are divided into the same destination redirector group.

Because the destination device creates the destination audio redirector based on the source device identifier, the application identifier, the destination device identifier, and the audio output device identifier indicated by the audio redirection instruction, the source device identifier and the destination device identifier in the same destination redirector group are consistent.

In step 608, the source device determines a first source audio redirector from the source redirector group when the source redirector group includes at least two source audio redirectors.

Optionally, the first source-end audio redirector may be a source-end audio redirector created first in the source-end redirector group, or may be a source-end audio redirector randomly determined in the source-end redirector group.

Correspondingly, the destination audio redirector corresponding to the first source redirector is the first destination audio redirector.

Step 609, the source device transmits the device redirection audio to the destination device through the link between the first source audio redirector and the first destination audio redirector.

In the device-level multi-channel audio method, for multiple link channels established by the same source device and the same destination device, device-level audio is transmitted in a shared manner (i.e., transmitted in only one channel), and the multiple link channels do not interfere with each other.

The source end equipment groups the source end audio redirectors to obtain at least one source end redirector group, and in order to avoid pushing multiple audio streams to the same destination end, thereby causing the repetition of the audio streams and generating the conditions of wrong sound effects such as reverberation and the like, each source end redirector group only selects a first path to push the streams, namely the source end equipment transmits equipment redirected audio to the destination end equipment through a link between the first source end audio redirector and the first destination end audio redirector.

Optionally, the source device transmits the device redirected audio data stream after audio coding to the destination device through a link between the first source audio redirector and the first destination audio redirector.

Step 610, in a case that the destination audio redirector group includes at least two destination audio redirectors, the destination device receives the device-level redirected audio transmitted by the source device through a link between the first destination audio redirector and the first source audio redirector.

Optionally, when the audio redirection mode indicated by the audio redirection instruction is device-level redirection, the destination device creates a device-level audio player corresponding to the source device indicated by the audio redirection instruction, and outputs the redirected audio to the destination audio output device through the device-level audio player.

Optionally, the destination audio redirectors in a destination redirector group correspond to the same device-level audio player.

Optionally, the device-level audio player and the destination audio output device may be one-to-one, and there may be a split output and a mixed output, depending on the corresponding relationship between the output devices and the applications.

In step 611, the destination device plays the redirected audio through the destination audio output device.

The step 108 may be referred to in the implementation manner of this step, and this embodiment will not be described herein again.

In this embodiment, when the audio redirection mode is the device-level redirection mode, one source device corresponds to one device-level audio recorder, the source device identifier, the application identifier, and the destination device identifier correspond to the source audio redirector, the source audio redirector is grouped based on the destination device, the same group of source audio redirectors share audio transmission, the destination device creates an audio player based on the source device, the source device identifier, the application identifier, and the destination device identifier correspond to the destination audio redirector, the destination audio redirector is grouped based on the source device, and the same group of destination audio redirectors correspond to the same audio player, so that multi-level many-to-many audio redirection can be implemented, and applicability to a complex audio redirection scene is improved.

Since each link can enter and exit at any time, if the link between the first source audio redirector and the first destination audio redirector is disconnected or exits, in order to ensure that the source device can normally transmit the device redirected audio to the destination device, in a possible implementation manner, the source device can also receive an audio redirection cancellation instruction and send the audio redirection cancellation instruction to the destination device, in the case that the audio redirection cancellation instruction indicates that the link corresponding to the first source audio redirector exits, the source device determines a second source audio redirector from the source redirector group, the destination device deletes the first destination audio redirector from the destination redirector group, and then the source device transmits the device redirected audio to the destination device through the link between the second source audio redirector and the second destination audio redirector, and the source end equipment deletes the first source end audio redirector, and finally, the destination end equipment receives the equipment redirection audio transmitted by the source end equipment through a link between a second destination end audio redirector and a second source end audio redirector in the destination end redirector group.

The method of disconnecting or exiting the first link and switching to the second link to continue outputting to the audio player is called audio streaming relay.

Fig. 7 schematically shows a schematic flow diagram of redirected audio data in an implementation environment of a device-level redirection mode, in fig. 7, a source device 1 corresponds to a device-level audio collector 1, a source device 2 corresponds to a device-level audio collector 2, if the source device 1 is a smart phone, the source device 2 is a tablet computer, a destination audio redirector 1 and a destination audio redirector 2 in a destination redirector group 1 correspond to an audio player 1 and a destination audio output device 1, a destination audio redirector 3 corresponds to an audio player 2 and a destination audio output device 2, and a destination audio redirector 4 corresponds to an audio player 3 and a destination audio output device 3.

The navigation application in the source end device 1 is redirected to a main driving center control long screen of the vehicle-mounted terminal, and navigation voice is played by audio output equipment of the main driving center control long screen, wherein the audio output equipment is the destination end audio output equipment 1; a first game application in the source end device 1 is redirected to screens of a main driving center control long screen and an intelligent large screen device of the vehicle-mounted terminal, and audio output devices of the main driving center control long screen and the intelligent large screen device play first game voice, wherein the audio output device of the main driving center control long screen is a destination end audio output device 1, the audio output device of the intelligent large screen device is a destination end audio output device 3, and the first game voice and navigation voice in the destination end audio output device 1 are mixed and output; and a second game application in the tablet personal computer is redirected to the secondary driving entertainment screen of the vehicle-mounted terminal, and second game voice is played by the audio output device of the secondary driving entertainment screen, wherein the audio output device is the destination audio output device 2.

In fig. 7, a source audio redirector 1 is a source audio redirector corresponding to a navigation voice of a navigation application in a source device 1 that needs audio redirection to a destination audio output device 1 in a destination device 1, a source audio redirector 2 is a source audio redirector corresponding to a first game voice of a first game application in the source device 1 that needs audio redirection to the destination audio output device 1 in the destination device 1, a source audio redirector 3 is a source audio redirector corresponding to a first game voice of a first game application in the source device 1 that needs audio redirection to a destination audio output device 3 in the destination device 2, the source audio redirector 4 is a source audio redirector corresponding to a second game voice of a second game application that needs audio redirection to the destination audio output device 2 in the destination device 1 in the source device 2. The destination audio redirector 1 is a destination audio redirector corresponding to the navigation speech of the navigation application in the source device 1 that needs audio redirection to the destination audio output device 1 in the destination device 1, the destination audio redirector 2 is a destination audio redirector corresponding to a first game voice of a first game application in the source device 1 that needs audio redirection to the destination audio output device 1 in the destination device 1, the destination audio redirector 3 is a destination audio redirector corresponding to a second game voice of a second game application in the source device 2 that needs audio redirection to the destination audio output device 2 in the destination device 1, the destination audio redirector 4 is a destination audio redirector corresponding to a first game voice of a first game application in the source device 1 that needs audio redirection to the destination audio output device 3 in the destination device 2.

In fig. 7, a source audio redirector 1 and a source audio redirector 2 corresponding to the same destination audio output device 1 are divided into a source redirector group 1, and in the source redirector group 1, a link corresponding to the source audio redirector 1 and a link corresponding to the source audio redirector 2 and the destination audio redirector 2 are included, because the two links share audio transmission, in order to avoid the situation that multiple audio streams are pushed to the same destination, so that the audio streams are repeated and generate wrong sound effects such as reverberation, the source device usually uses the links corresponding to the source audio redirector 1 and the destination audio redirector 1 to perform device redirection audio transmission, and in the case that the links corresponding to the source audio redirector 1 and the destination audio redirector 1 are disconnected or exited, and then switching to the link corresponding to the source audio redirector 2 and the destination audio redirector 2 to perform equipment redirection audio transmission.

Fig. 8 is a schematic diagram illustrating an implementation environment under an application-level pitch scheme according to another exemplary embodiment of the present application. The implementation environment may include: at least one source device 810 and at least one destination device 820.

In fig. 8, it is described by taking an example that the source device 810 includes a smart phone 811 and a smart phone 812, and the destination device 820 includes a first vehicle-mounted terminal 821 and a second vehicle-mounted terminal 822, where the first vehicle-mounted terminal 821 and the second vehicle-mounted terminal 822 are disposed in the same vehicle, and the first vehicle-mounted terminal 821 and the second vehicle-mounted terminal 822 are respectively controlled by different socs (System on Chip ). For example, the first vehicle-mounted terminal 821 is a vehicle-mounted terminal disposed on a front row of a vehicle, and the second vehicle-mounted terminal 822 is a vehicle-mounted terminal disposed on a rear row of the vehicle.

As shown in fig. 8, the in-vehicle terminal 821 has a main-drive center-controlled screen 8211, a first audio output device 8214 of the main-drive center-controlled screen 8211, a sub-drive entertainment screen 8212, and a second audio output device 8215 of the sub-drive entertainment screen 8212 (each controlled by the first SoC8213 of the in-vehicle terminal 821) independent of each other, the in-vehicle terminal 822 has a rear-row entertainment screen left screen 8221, a third audio output device 8224 of the rear-row entertainment screen left screen 8221, a rear-row entertainment screen right screen 8222, and a fourth audio output device 8225 of the rear-row entertainment screen right screen 8222 (each controlled by the second SoC8223 of the second in-vehicle terminal 822), and the third audio output device 8224 and the fourth audio output device 8225 are independent of each other.

The many-to-many redirection in the embodiment of the present application is embodied in a multi-source device (multiple source devices participate in redirection), a multi-directional object (multiple redirection objects in the same source device participate in redirection), a multi-destination device (multiple destination devices participate in redirection), and a multi-screen (multiple screens of the same destination device participate in redirection). In a possible many-to-many redirection scenario, as shown in fig. 8, a navigation application in the smartphone 811 is redirected to a main driving center control long screen 8211 of the first in-vehicle terminal 821, and a navigation voice is played by the first audio output device 8214; the first game application is redirected to a main driving center control long screen 8211 of the first vehicle-mounted terminal 821 and a rear row entertainment screen left screen 8221 and a rear row entertainment screen right screen 8222 of the second vehicle-mounted terminal 822, namely the main driving center control long screen 8211, the rear row entertainment screen left screen 8221 and the rear row entertainment screen right screen 8222 display the same redirected content, and a first audio output device 8214, a third audio output device 8224 and a fourth audio output device 8225 play a first game voice, wherein the first game application and the navigation application in the main driving center control long screen 8211 are displayed in a split screen mode, and the first game voice and the navigation voice are played in a mixed mode in the first audio output device 8214; a second gaming application in the smartphone 812 is redirected to the secondary entertainment screen 8212 of the first in-vehicle terminal 821 and a second gaming voice is played by the second audio output device 8215.

It should be noted that, the foregoing embodiment is only schematically described by taking an example that the mobile terminal performs audio redirection to the in-vehicle terminal, and the scheme provided in the embodiment of the present application may also be applied to other many-to-many redirection scenarios, and the embodiment does not limit a specific application scenario.

Referring to fig. 9, which shows a flowchart of an application-level redirection mode audio redirection method according to an exemplary embodiment of the present application, and the embodiment of the present application is described by taking an application of the method to the implementation environment shown in fig. 8 as an example, the method may include the following steps:

in step 901, a source device receives an audio redirection instruction.

In step 902, the destination device receives an audio redirection instruction.

In step 903, the source device creates a source audio redirector based on the audio redirection instruction.

In step 904, the destination device creates a destination audio redirector based on the audio redirection instruction.

Step 905, the source device performs audio acquisition through a target application level audio collector corresponding to the target application based on the audio redirection instruction to obtain application redirection audio.

And under the condition that the audio redirection mode indicated by the audio redirection instruction is the application level redirection mode, the source end equipment acquires audio through a target application level audio collector corresponding to the target application to obtain application redirection audio of the target application, wherein different applications correspond to different application level audio collectors, and the application level audio collector is used for collecting application level audio.

In a possible implementation manner, the source device performs audio coding on the application redirection audio through an audio encoder corresponding to the target application to obtain an application redirection audio data stream, and then performs shunt transmission on the application redirection audio data stream to each source audio redirector corresponding to the target application.

Optionally, after the source device performs application-level audio acquisition, the encoder performs audio encoding on the acquired audio content to obtain an application redirection audio data stream, where the source device may encode in an audio encoding format such as AAC.

Step 906, under the condition that at least two source end audio redirectors are created, the source end device groups the source end audio redirectors to obtain at least one source end redirector group.

In a possible implementation manner, in a case that at least two source-side audio redirectors are created, a source-side device groups the source-side audio redirectors based on a destination-side device identifier and an application identifier corresponding to the source-side audio redirectors to obtain at least one source-side redirector group, where the source-side audio redirectors corresponding to the same destination-side device identifier and the same application identifier are divided into the same source-side redirector group.

Because the source device creates the source audio redirector based on the source device identifier, the application identifier, the destination device identifier and the audio output device identifier indicated by the audio redirection instruction, the source device identifier, the destination device identifier and the application identifier in the same source redirector group are consistent.

Step 907, under the condition that at least two destination audio redirectors are created, the destination device groups the destination audio redirectors to obtain at least one destination redirector group.

Corresponding to the source device, in a possible implementation manner, in a case that at least two destination audio redirectors are created, the destination device groups the destination audio redirectors based on a source device identifier and an application identifier corresponding to the destination audio redirectors to obtain at least one destination redirector group, where the destination audio redirectors corresponding to the same source device identifier and the same application identifier are divided into the same destination redirector group.

Because the destination device creates the destination audio redirector based on the source device identifier, the application identifier, the destination device identifier, and the audio output device identifier indicated by the audio redirection instruction, the source device identifier, the destination device identifier, and the application identifier in the same destination redirector group are consistent.

Step 908, the source device determines a third source audio redirector from the source redirector group if the source redirector group includes at least two source audio redirectors.

Optionally, the third source audio redirector may be a first source audio redirector in the source audio redirector group, and a destination audio redirector corresponding to the source audio redirector is referred to as a third destination audio redirector.

In step 909, the source device transmits the application redirection audio to the destination device through the link between the third source audio redirector and the third destination audio redirector.

In the application-level multi-channel audio method, for multiple link channels established by the same application of the same source end device and the same destination end device, application-level audio is transmitted in a shared mode (namely, the audio is transmitted in only one channel), and the multiple link channels do not interfere with each other.

After the source end audio manager groups a plurality of source end audio redirectors according to the unique identifiers of the paired destination end devices, in order to avoid pushing multiple audio streams to the same destination end, thereby causing duplication of the audio streams and generating wrong sound effects such as reverberation, each source end redirector group only selects a first path to push the streams, namely, the source end device transmits application redirected audio to the destination end device through a link between a third source end audio redirector and a third destination end audio redirector.

Step 910, in a case that the destination audio redirector group includes at least two destination audio redirectors, the destination device receives an application redirection audio transmitted by the source device through a link between the third destination audio redirector and the third source audio redirector.

Optionally, when the audio redirection mode indicated by the audio redirection instruction is application-level redirection, the destination device creates an application-level audio player corresponding to the source device indicated by the audio redirection instruction, and outputs the redirection audio to the destination audio output device through the application-level audio player.

Optionally, the destination creates an application-level audio player for each application that needs to be audio-redirected, whether they are from the same source device or not, and whether they are output to the same destination audio output device or not.

Optionally, the same set of destination audio directors correspond to the same audio player.

Optionally, the audio player of the destination device corresponds to the same application under the source device one to one, and is configured to process all audio plays of the specified application of the source device on the destination device.

Alternatively, the destination audio player and the destination audio output device may be one-to-one, and there may also be a split output and a mixed output, which depend on the corresponding relationship between the output devices and the applications.

And step 911, the destination device plays the redirected audio through the destination audio output device.

The step 108 may be referred to in the implementation manner of this step, and this embodiment is not described herein again.

In this embodiment, in the case that the audio redirection mode is the application level redirection mode, different applications correspond to different application level audio recorders, and the source device identifier, the application identifier, and the destination device identifier correspond to a source audio redirector, and the source end audio redirectors are grouped based on the destination end equipment identification and the application identification, the source end audio redirectors in the same group share audio transmission, the destination end equipment creates an audio player based on the source end equipment identification and the application identification, the source end equipment identification, the application identification and the destination end equipment identification correspond to the destination end audio redirectors, and the destination audio redirectors are grouped based on the source device identifier and the application identifier, and the same group of destination audio redirectors correspond to the same audio player, so that multi-level many-to-many audio redirection can be realized, and the applicability to complex audio redirection scenes is improved.

Similar to the device level redirection mode, in the case of the application level redirection mode, each link in the structure can enter and exit at any time, if the first link is disconnected or exits, in order to ensure that the source device can normally transmit the device redirection audio to the destination device, in a possible implementation manner, the source device can further receive an audio redirection cancellation instruction and send the audio redirection cancellation instruction to the destination device, in the case that the audio redirection cancellation instruction indicates that the link corresponding to the third source audio redirector exits, the source device determines a fourth source audio redirector from the source redirector group, the destination device deletes the third destination audio redirector from the destination redirector group, and then the source device passes through the link between the fourth source audio redirector and the fourth destination audio redirector, and finally, the destination device receives the device redirected audio transmitted by the source device through a link between a fourth destination audio redirector and a fourth source audio redirector in the destination redirector group.

Fig. 10 schematically shows a schematic flow diagram of redirected audio data in an implementation environment in an application-level redirection mode, in fig. 10, a source device 1 has two applications, a navigation application corresponds to an application-level audio collector 1, a first game application corresponds to an application-level audio collector 2, a second game application in the source device 2 corresponds to an application-level audio collector 3, the source device 1 and the source device 2 are both smartphones, and the destination device 1 and the destination device 2 are both vehicle-mounted terminals.

The navigation application in the source end device 1 is redirected to a main driving center control long screen of the first vehicle-mounted terminal, and navigation voice is played by audio output equipment of the main driving center control long screen, wherein the audio output equipment is destination end audio output equipment 1; a first game application in the source end device 1 is redirected to a main driving center control long screen of a first vehicle-mounted terminal and a rear row entertainment screen left screen and a rear row entertainment screen right screen of a second vehicle-mounted terminal, namely the main driving center control long screen, the rear row entertainment screen left screen and the rear row entertainment screen right screen display the same redirection content, namely a destination end audio output device 1 of the main driving center control long screen of the first vehicle-mounted terminal, a destination end audio output device 3 of the rear row entertainment screen left screen and a destination end audio output device 4 of the rear row entertainment screen right screen all play a first game voice, wherein the first game application and a navigation application in the main driving center control long screen are displayed in a split screen mode, and the first game voice and the navigation voice are played in a mixed mode in the destination end audio output device 1; the second game application in the source device 2 is redirected to the secondary driving entertainment screen of the first vehicle-mounted terminal, and the second game voice is played by the destination audio output device 2 of the secondary driving entertainment screen.

In fig. 10, a source audio redirector 1 is a source audio redirector corresponding to a navigation voice of a navigation application in a source device 1 that requires audio redirection to a destination audio output device 1 in a destination device 1, a source audio redirector 2 is a source audio redirector corresponding to a first game voice of a first game application in the source device 1 that requires audio redirection to a destination audio output device 1 in the destination device 1, a source audio redirector 3 is a source audio redirector corresponding to a first game voice of a first game application in the source device 1 that requires audio redirection to a destination audio output device 3 in the destination device 2, a source audio redirector 4 is a source audio redirector corresponding to a first game voice of a first game application in the source device 1 that requires audio redirection to a destination audio output device 4 in the destination device 2, the source audio redirector 5 is a source audio redirector corresponding to a second game voice of a second game application in the source device 2 that needs audio redirection to the destination audio output device 2 in the destination device 1.

The destination audio redirector 1 is a destination audio redirector corresponding to a navigation voice of a navigation application of a destination audio output device 1 of the destination device 1, the destination audio redirector 2 is a destination audio redirector corresponding to a first game voice of a first game application of the source device 1, which needs audio redirection to the destination audio output device 1 of the destination device 1, the destination audio redirector 3 is a destination audio redirector corresponding to a second game voice of a second game application of the source device 2, which needs audio redirection to the destination audio output device 2 of the destination device 1, the destination audio redirector 4 is a source audio redirector corresponding to a first game voice of a first game application of the source device 1, which needs audio redirection to the destination audio output device 3 of the destination device 2, the destination audio redirector 5 is a destination audio redirector corresponding to a first game voice of a first game application in the source device 1 that needs audio redirection to the destination audio output device 4 in the destination device 2.

In fig. 10, a source audio redirector 3 and a source audio redirector 4 corresponding to the same application of the same destination audio output device 1 are divided into a source redirector group 1, where the source redirector group 1 includes a link corresponding to the source audio redirector 3 and a link corresponding to the source audio redirector 4 and the destination audio redirector 4, and in order to avoid the situation that multiple audio streams are pushed to the same destination and the audio streams are repeated and generate wrong sound effects such as reverberation and the like due to the two links sharing audio transmission, the source device usually uses the links corresponding to the source audio redirector 3 and the destination audio redirector 3 to perform device-redirected audio transmission, and when the links corresponding to the source audio redirector 3 and the destination audio redirector 3 are disconnected or quit, and then switching to the link corresponding to the source audio redirector 4 and the destination audio redirector 4 to perform device redirection audio transmission.

It can be seen from the above embodiments that the only difference between the application level redirection mode and the device level redirection mode is that the device level redirection mode performs grouping and audio redirection in units of devices, and the application level multi-channel audio policy performs grouping and audio redirection in units of devices plus applications.

Referring to fig. 11, a block diagram of an audio redirection device according to an embodiment of the present application is shown. The apparatus is used for a source device, and the apparatus may include:

a first instruction receiving module 1101, configured to receive an audio redirection instruction;

a creating module 1102, configured to create a source audio redirector based on the audio redirection instruction;

an audio collecting module 1103, configured to collect audio based on an audio redirection mode indicated by the audio redirection instruction, to obtain a redirection audio, where the audio redirection mode includes device-level redirection and application-level redirection;

a first transmission module 1104, configured to transmit the redirected audio to a destination device through a link between the source audio redirector and a destination audio redirector, where the destination audio redirector is created by the destination device.

Optionally, the audio acquiring module 1103 is configured to:

under the condition that the audio redirection mode indicated by the audio redirection instruction is the equipment level redirection mode, audio collection is carried out through an equipment level audio collector to obtain equipment redirection audio of the source end equipment;

and under the condition that the audio redirection mode indicated by the audio redirection instruction is the application level redirection mode, performing audio acquisition through a target application level audio collector corresponding to a target application to obtain application redirection audio of the target application, wherein different applications correspond to different application level audio collectors.

Optionally, the audio redirection mode is the device-level redirection mode;

a first transmission module 1104 comprising:

the first grouping unit is used for grouping the source end audio redirectors based on destination end equipment identifications corresponding to the source end audio redirectors under the condition that at least two source end audio redirectors are created to obtain at least one source end redirector group, wherein the source end audio redirectors corresponding to the same destination end equipment identification are divided into the same source end redirector group;

a first determining unit, configured to determine a first source audio redirector from the source redirector group when the source redirector group includes at least two source audio redirectors;

a first transmission unit, configured to transmit the device redirect audio to the destination device through a link between the first source-end audio redirector and a first destination-end audio redirector.

Optionally, the apparatus further comprises:

the second instruction receiving module is used for receiving an audio redirection canceling instruction;

a first determining module, configured to determine a second source-end audio redirector from the source-end redirector group when the audio redirection canceling instruction indicates that the link corresponding to the first source-end audio redirector exits;

a second transmission module, configured to transmit the device redirected audio to the destination device through a link between the second source-end audio redirector and a second destination-end audio redirector;

and the first deleting module is used for deleting the first source end audio redirector.

Optionally, the audio redirection mode is the application level redirection mode;

a first transmission module 1104, comprising:

the second grouping unit is used for grouping the source-end audio redirectors based on the destination-end equipment identifiers and the application identifiers corresponding to the source-end audio redirectors to obtain at least one source-end redirector group under the condition that at least two source-end audio redirectors are created, wherein the source-end audio redirectors corresponding to the same destination-end equipment identifier and application identifier are divided into the same source-end redirector group;

a second determining unit, configured to determine a third source audio redirector from the source redirector group when the source redirector group includes at least two source audio redirectors;

a second transmission unit, configured to transmit the application redirection audio to the destination device through a link between the third source audio redirector and a third destination audio redirector.

Optionally, the apparatus further comprises:

the third instruction receiving module is used for receiving an audio redirection canceling instruction;

a second determining module, configured to determine a fourth source-end audio redirector from the source-end redirector group when the audio redirection canceling instruction indicates that the link corresponding to the third source-end audio redirector exits;

a third transmission module, configured to transmit the application redirection audio to the destination device through a link between the fourth source-end audio redirector and a fourth destination-end audio redirector;

and the second deleting module is used for deleting the third source end audio redirector.

Optionally, the audio redirection mode is the device-level redirection mode, and the apparatus further includes:

the first audio coding module is used for carrying out audio coding on the equipment redirection audio through a unified audio coder to obtain an equipment redirection audio data stream;

a fourth transmission module, configured to shunt and transmit the device redirected audio data stream to each source-end audio redirector;

the audio redirection mode is the application-level redirection mode, and the apparatus further comprises:

the second audio coding module is used for carrying out audio coding on the application redirection audio through an audio coder corresponding to the target application to obtain an application redirection audio data stream;

and a fifth transmission module, configured to transmit the application redirection audio data stream to each source-end audio redirector corresponding to the target application in a shunting manner.

Optionally, the creating module 1102 is configured to:

and creating the source audio redirector based on the source equipment identification, the application identification, the destination equipment identification and the audio output equipment identification indicated by the audio redirection instruction.

Referring to fig. 12, a block diagram of an audio redirection device according to an embodiment of the present application is shown. The device is used for destination equipment, and the device can comprise:

a first instruction receiving module 1201, configured to receive an audio redirection instruction;

a first creating module 1202, configured to create a destination audio redirector based on the audio redirection instruction;

a first receiving module 1203, configured to receive, through a link between the destination audio redirector and a source audio redirector, a redirected audio transmitted by a source device, where the source audio redirector is created by the source device, the redirected audio is obtained by the source device by performing audio acquisition based on an audio redirection mode indicated by the audio redirection instruction, and the audio redirection mode includes device-level redirection and application-level redirection;

a playing module 1204, configured to play the redirected audio through a destination audio output device.

Optionally, the apparatus further comprises:

a second creating module, configured to create an audio player based on the audio redirection mode indicated by the audio redirection instruction;

and the output module is used for outputting the redirected audio to the destination audio output equipment through the audio player.

Optionally, the second creating module is configured to:

under the condition that the audio redirection mode indicated by the audio redirection instruction is the device-level redirection, creating a device-level audio player corresponding to the source device indicated by the audio redirection instruction;

and under the condition that the audio redirection mode indicated by the audio redirection instruction is the application-level redirection, creating an application-level audio player corresponding to the target application indicated by the audio redirection instruction.

Optionally, the output module is configured to:

outputting the redirected audio to a single destination audio output device through the audio player; or the like, or, alternatively,

shunting and outputting the redirected audio to at least two destination audio output devices through the audio player; or the like, or, alternatively,

performing sound mixing processing on the redirected audio output by at least two audio players; and outputting the redirected audio after the audio mixing processing to the destination audio output equipment.

Optionally, the audio redirection mode is the device-level redirection mode;

the first receiving module 1203 includes:

a first grouping unit, configured to, when at least two destination audio redirectors are created, group the destination audio redirectors based on source device identifiers corresponding to the destination audio redirectors to obtain at least one destination redirector group, where the destination audio redirectors corresponding to the same source device identifier are divided into the same destination redirector group;

a first receiving unit, configured to receive, through a link between a first destination audio redirector and a first source audio redirector, a device redirection audio transmitted by a source device when the destination audio redirector group includes at least two destination audio redirectors, where the first source audio redirector is determined by the source device.

Optionally, the apparatus further comprises:

a first deleting module, configured to delete the first destination audio redirector from the destination audio redirector group when the audio redirection canceling instruction indicates that the link corresponding to the first source audio redirector exits;

a second receiving module, configured to receive, through a link between a second destination audio redirector in the destination audio redirector group and a second source audio redirector, a device redirection audio transmitted by the source device, where the second source audio redirector is determined by the source device.

the first receiving module 1203 includes:

the second grouping unit is used for grouping the destination audio redirectors based on source equipment identifiers and application identifiers corresponding to the destination audio redirectors under the condition that at least two destination audio redirectors are created to obtain at least one destination redirector group, wherein the destination audio redirectors corresponding to the same source equipment identifier and application identifier are divided into the same destination redirector group;

a second receiving unit, configured to receive, through a link between a third destination audio redirector and a third source audio redirector, an application redirection audio transmitted by the source device when the destination audio redirector group includes at least two destination audio redirectors, where the third source audio redirector is determined by the source device.

Optionally, the apparatus further comprises:

a second deleting module, configured to delete the third destination audio redirector from the destination audio redirector group when the audio redirection canceling instruction indicates that the link corresponding to the third source audio redirector exits;

a third receiving module, configured to receive an application redirection audio transmitted by the source end device through a link between a fourth destination-end audio redirector in the destination-end redirector group and a fourth source-end audio redirector, where the fourth source-end audio redirector is determined by the source end device.

Optionally, the first creating module 1202 is configured to:

and creating the destination audio redirector based on the source device identification, the application identification, the destination device identification and the audio output device identification indicated by the audio redirection instruction.

Referring to fig. 13, a block diagram of a computer device according to an exemplary embodiment of the present application is shown. The computer device 1300 may be implemented as a source device or a destination device in the various embodiments described above. Computer device 1300 may include one or more of the following components: a processor 1310 and a memory 1320.

Processor 1310 may include one or more processing cores. The processor 1310 interfaces with various interfaces and circuitry throughout the computer device 1300 to perform various functions of the computer device 1300 and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 1320, as well as invoking data stored in the memory 1320. Alternatively, the processor 1310 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 1310 may integrate one or a combination of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a Neural-Network Processing Unit (NPU), a modem, and the like. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing contents required to be displayed by the touch display screen; the NPU is used for realizing an Artificial Intelligence (AI) function; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 1310, but may be implemented by a single chip.

The Memory 1320 may include a Random Access Memory (RAM) or a Read-Only Memory (ROM). Optionally, the memory 1320 includes a non-transitory computer-readable medium. The memory 1320 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 1320 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like; the stored data area may store data (such as audio data, a phonebook) created according to the use of the computer apparatus 1300, and the like.

In addition, those skilled in the art will appreciate that the configuration of the computer device 1300 illustrated in the above-described figures does not constitute a limitation of the computer device, and that the computer device may include more or less components than those illustrated, or some components may be combined, or a different arrangement of components. For example, the computer device 1300 further includes a display screen, a camera assembly, a microphone, a speaker, a radio frequency circuit, an input unit, a sensor (such as an acceleration sensor, an angular velocity sensor, a light sensor, and the like), an audio circuit, a WiFi module, a power supply, a bluetooth module, and the like, which are not described herein again.

The present embodiments also provide a computer-readable storage medium storing at least one program code, which is loaded and executed by a processor to implement the audio redirection method according to the above embodiments.

Embodiments of the present application provide a computer program product comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the audio redirection method provided in the various alternative implementations of the above aspects.

It should be understood that reference to "a plurality" herein means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. In addition, the step numbers described herein only exemplarily show one possible execution sequence among the steps, and in some other embodiments, the steps may also be executed out of the numbering sequence, for example, two steps with different numbers are executed simultaneously, or two steps with different numbers are executed in a reverse order to the order shown in the figure, which is not limited by the embodiment of the present application.

The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. An audio redirection method, wherein the method is used for a source device, and the method comprises:

receiving an audio redirection instruction;

creating a source audio redirector based on the audio redirection instruction;

2. The method of claim 1, wherein the performing audio acquisition based on the audio redirection mode indicated by the audio redirection instruction to obtain redirected audio comprises:

3. The method of claim 2, wherein the audio redirection mode is the device-level redirection mode;

the transmitting the redirected audio to the destination device through the link between the source audio redirector and the destination audio redirector includes:

under the condition that at least two source end audio redirectors are created, grouping the source end audio redirectors based on destination end equipment identifications corresponding to the source end audio redirectors to obtain at least one source end redirector group, wherein the source end audio redirectors corresponding to the same destination end equipment identification are divided into the same source end redirector group;

determining a first source audio redirector from the source redirector group when the source audio redirector group comprises at least two source audio redirectors;

and transmitting the device redirected audio to the destination device through a link between the first source audio redirector and the first destination audio redirector.

4. The method of claim 3, further comprising:

receiving an audio redirection canceling instruction;

determining a second source-end audio redirector from the source-end redirector group under the condition that the audio redirection canceling instruction indicates that the link corresponding to the first source-end audio redirector exits;

transmitting the device redirect audio to the destination device over a link between the second source audio redirector and a second destination audio redirector;

and deleting the first source end audio redirector.

5. The method of claim 2, wherein the audio redirection mode is the application-level redirection mode;

under the condition that at least two source end audio redirectors are created, grouping the source end audio redirectors based on destination end equipment identifications and application identifications corresponding to the source end audio redirectors to obtain at least one source end redirector group, wherein the source end audio redirectors corresponding to the same destination end equipment identification and application identification are divided into the same source end redirector group;

determining a third source audio redirector from the source redirector group if the source redirector group comprises at least two source audio redirectors;

transmitting the application redirection audio to the destination device through a link between the third source audio redirector and a third destination audio redirector.

6. The method of claim 5, further comprising:

receiving an audio redirection canceling instruction;

determining a fourth source audio redirector from the source audio redirector group when the audio redirection cancel instruction indicates that the link corresponding to the third source audio redirector exits;

transmitting the application redirection audio to the destination device through a link between the fourth source audio redirector and a fourth destination audio redirector;

deleting the third source audio redirector.

7. The method of claim 2, wherein the audio redirection mode is the device-level redirection mode, the method further comprising:

carrying out audio coding on the equipment reorientation audio through a uniform audio coder to obtain equipment reorientation audio data flow;

shunting and transmitting the equipment redirected audio data stream to each source end audio redirector;

the audio redirection mode is the application-level redirection mode, the method further comprising:

performing audio coding on the application redirection audio through an audio coder corresponding to the target application to obtain an application redirection audio data stream;

and shunting and transmitting the application redirection audio data stream to each source end audio redirector corresponding to the target application.

8. The method of any of claims 1 to 7, wherein creating a source audio redirector based on the audio redirection instructions comprises:

and creating the source audio redirector based on the source device identification, the application identification, the destination device identification and the audio output device identification indicated by the audio redirection instruction.

9. An audio redirection method, wherein the method is used for a destination device, and wherein the method comprises:

receiving an audio redirection instruction;

10. The method of claim 9, further comprising:

creating an audio player based on the audio redirection mode indicated by the audio redirection instruction;

and outputting the redirected audio to the destination audio output equipment through the audio player.

11. The method of claim 10, wherein the creating an audio player based on the audio redirection mode indicated by the audio redirection instruction comprises:

12. The method of claim 10, wherein the outputting, by the audio player, the redirected audio to the destination audio output device comprises:

13. The method of any of claims 9 to 12, wherein the audio redirection mode is the device-level redirection mode;

the receiving, through the link between the destination audio redirector and the source audio redirector, a redirected audio transmitted by the source device includes:

under the condition that at least two destination audio redirectors are created, grouping the destination audio redirectors based on source equipment identifiers corresponding to the destination audio redirectors to obtain at least one destination redirector group, wherein the destination audio redirectors corresponding to the same source equipment identifier are divided into the same destination redirector group;

and receiving the device redirected audio transmitted by the source device through a link between a first destination audio redirector and the first source audio redirector under the condition that the destination audio redirector group comprises at least two destination audio redirectors, wherein the first source audio redirector is determined by the source device.

14. The method of claim 13, further comprising:

receiving an audio redirection canceling instruction;

deleting the first destination audio redirector from the destination audio redirector group under the condition that the audio redirection canceling instruction indicates that the link corresponding to the first source audio redirector exits;

and receiving the device redirection audio transmitted by the source end device through a link between a second destination end audio redirector in the destination end redirector group and a second source end audio redirector, wherein the second source end audio redirector is determined by the source end device.

15. The method according to any of claims 9 to 12, wherein the audio redirection mode is the application-level redirection mode;

under the condition that at least two destination audio redirectors are created, grouping the destination audio redirectors based on source equipment identifiers and application identifiers corresponding to the destination audio redirectors to obtain at least one destination redirector group, wherein the destination audio redirectors corresponding to the same source equipment identifier and application identifier are divided into the same destination redirector group;

and under the condition that the destination audio redirector group comprises at least two destination audio redirectors, receiving application redirection audio transmitted by the source equipment through a link between a third destination audio redirector and a third source audio redirector, wherein the third source audio redirector is determined by the source equipment.

16. The method of claim 15, further comprising:

receiving an audio redirection canceling instruction;

deleting the third destination audio redirector from the destination audio redirector group when the audio redirection canceling instruction indicates that the link corresponding to the third source audio redirector exits;

and receiving the application redirection audio transmitted by the source end equipment through a link between a fourth destination end audio redirector in the destination end redirector group and a fourth source end audio redirector, wherein the fourth source end audio redirector is determined by the source end equipment.

17. The method according to any of claims 9 to 12, wherein the creating a destination audio redirector based on the audio redirection instruction comprises:

and creating the destination audio redirector based on the source equipment identifier, the application identifier, the destination equipment identifier and the audio output equipment identifier indicated by the audio redirection instruction.

18. An audio redirection device, wherein the device is used for a source device, the device comprising:

the audio acquisition module is used for acquiring audio based on an audio redirection mode indicated by the audio redirection instruction to obtain a redirection audio, and the audio redirection mode comprises equipment-level redirection and application-level redirection;

19. An audio redirection apparatus, wherein the apparatus is used for a destination device, the apparatus comprising:

the first creating module is used for creating a destination audio redirector based on the audio redirection instruction;

20. A computer device, wherein the computer device comprises a processor and a memory; the memory stores at least one program for execution by the processor to implement the audio redirection method as claimed in any one of claims 1 to 8, or to implement the audio redirection method as claimed in any one of claims 9 to 17.

21. A computer-readable storage medium having stored therein at least one instruction for execution by a processor to implement the audio redirection method of any of claims 1 to 8 or the audio redirection method of any of claims 9 to 17.

22. A computer program product, characterized in that the computer program product comprises computer instructions, the computer instructions being stored in a computer readable storage medium; a processor of a computer device reads the computer instructions from the computer readable storage medium, the processor executing the computer instructions to cause the computer device to perform the audio redirection method as claimed in any of claims 1 to 8, or to implement the audio redirection method as claimed in any of claims 9 to 17.