WO2021103920A1

WO2021103920A1 - Audio output device switching method and device

Info

Publication number: WO2021103920A1
Application number: PCT/CN2020/124878
Authority: WO
Inventors: 方振芳; 汪碧海; 宋丽成
Original assignee: 华为技术有限公司
Priority date: 2019-11-25
Filing date: 2020-10-29
Publication date: 2021-06-03
Also published as: CN112835549B; CN112835549A

Abstract

Embodiments of the present application relate to the technical field of electronics, and provide an audio output device switching method and device, capable of switching playback of an audio between a source end device, a screen projection device or other devices in a process when the screen projection device controls screen projection, making playback of the audio more flexible, and providing better experience for users. The specific solution is that: an electronic device respectively receives screen projection operations from a first source end device and a second source end device; respectively display a first interface of the first source end device and a second interface of the second source end device in a first screen projection area and a second screen projection area; a first audio generated by the first source end device is played by a first audio output device; if it is determined that a first condition is satisfied, configure an output device of the first audio as a third audio output device; the third audio output device is any one of the first source end device, an electronic device, or an external audio device, and is different from the first audio output device. Embodiments of the present application are used for screen projection.

Description

Method and device for switching audio output device

This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office on November 25, 2019, the application number is 201911168270.2, and the application name is "A method and device for switching audio output devices", the entire content of which is incorporated by reference In this application.

Technical field

The embodiments of the present application relate to the field of electronic technology, and in particular, to a method and device for switching audio output devices.

Background technique

With the development of artificial intelligence (AI) technology and smart home products, more and more large-screen devices such as smart TVs and smart large screens continue to emerge. Users can project audio/video from terminals such as mobile phones or tablets to large-screen devices for playback, so that they can use the high-definition characteristics of large-screen devices, large screens or the high sound quality of their own speakers to share the terminal Contents such as video or music on the screen enhance the fun and user experience.

Summary of the invention

The embodiments of the present application provide a method and device for switching audio output devices, which can control the audio during the screen projection process on the screen projection device to switch and play between the source device, the projection device or other devices, making audio playback more flexible , The user experience is better.

In order to achieve the foregoing objectives, the following technical solutions are adopted in the embodiments of this application:

On the one hand, the embodiments of the present application provide a method for switching audio output devices suitable for multi-person projection mode, which can be applied to electronic devices, and the electronic devices are connected to at least one external audio device. The method includes: the electronic device receives screen projection operations from a first source device and a second source device respectively. The electronic device receives the first image data from the first source device and the second image data from the second source device respectively. The first image data is data corresponding to the first interface of the first source device; the second image data is data corresponding to the second interface of the second source device. The electronic device displays the first interface and the second interface in the first projection area and the second projection area, respectively, according to the first image data and the second image data. The output device of the first audio generated by the first source device during the projection process is the first audio output device; the output device of the second audio generated by the second source device during the projection process is the second audio output equipment. If the electronic device determines that the first condition is met, the electronic device sets the first audio output device as the third audio output device. The third audio output device is any one of the first source device, electronic device, or external audio device, and the third audio output device is different from the first audio output device. If the electronic device determines that the second condition is met, the electronic device sets the second audio output device as the fourth audio output device. The fourth audio output device is any one of a second source device, an electronic device, or an external audio device, and the fourth audio output device is different from the second audio output device.

In this way, during the screen projection process, the electronic device can uniformly control and coordinate the audio output devices corresponding to different sources, and freely switch to use different audio output devices to play the audio shared by different sources during the screen projection process, thereby making full use of External audio devices with different sound quality, different sound effects, different locations, different power consumption, or different power levels in the environment can play audio shared by mobile phones, which can improve the selectivity of audio output devices, increase the flexibility of audio output, and improve users Audio playback experience.

In a possible design, the electronic device determines that the first condition is satisfied, including: the electronic device detects a user's first instruction operation, and the first instruction operation is used to instruct to set the first audio output device as the third audio output device . The electronic device determining that the second condition is satisfied includes: the electronic device detects a second instruction operation of the user, and the second instruction operation is used to instruct to set the second audio output device as the fourth audio output device.

In this solution, the electronic device can switch the output device of the first audio of the first source device and/or switch the output device of the second audio of the second source device according to the instruction of the user, so that the electronic device can The audio output device of the source device is controlled uniformly.

In another possible design, the first instruction operation and the second instruction operation are operations performed by the user through an input device or voice instruction operations; the input device includes any one of a remote control, a touch screen, a mouse, or a keyboard.

In other words, the user can instruct the electronic device to switch the audio output device during the screen projection process through input devices such as a remote control, touch screen, mouse or keyboard, or instruct the electronic device to switch the audio output device during the screen projection process through voice.

In another possible design, the first instruction operation and the second instruction operation may be at least one of a user input operation, a user voice instruction operation, a preset gesture operation, a preset action operation or a preset expression operation, etc. .

In this way, the user can control the audio output devices of the first audio and the second audio in a variety of ways.

In another possible design, before the electronic device detects the first instruction operation or the second instruction operation, the method further includes: after the electronic device detects the user's operation on the preset control on the input device, displaying the control menu, The control menu includes audio switching controls. After the electronic device detects that the user selects the operation of the audio switching control, the audio switching menu is displayed. The first instruction operation is an operation for the user to select a third audio output device for the first audio of the first source device based on the audio switching menu. The second instruction operation is an operation in which the user selects the fourth audio output device for the second audio of the second source device based on the audio switching menu.

That is, the electronic device may display the audio switching menu according to the user's instruction, so that the user can switch the output device of the first audio and/or the second audio based on the audio switching menu.

In another possible design, the first interface is the first game interface from the first source device, the second interface is the second game interface from the second source device, and the third audio output device is at least one external The first speaker in the audio device, and the fourth audio output device is the second speaker in at least one external audio device.

In this way, different users can cast and play the game through the first source device and the second source device respectively, and listen to the game sound through different external audio devices.

In another possible design, determining that the electronic device satisfies the first condition includes: the electronic device determines that the output device of the first audio is the third audio output device according to the switching rule. The electronic device determining that the second condition is satisfied includes: the electronic device determines that the output device of the second audio is the fourth audio output device according to the switching rule.

In this solution, the electronic device can automatically switch the first audio output device of the first source device and/or switch the second audio output device of the second source device according to the switching rule, so that the electronic device can automatically check The audio output device of each source device is controlled in a unified manner, which saves user operations and improves user experience.

In another possible design, the switching rule includes the correspondence between the first trigger condition and the target audio output device of the first source device; and the relationship between the second trigger condition and the target audio output device of the second source device. Correspondence between: the first trigger condition and the second trigger condition include at least one of a trigger time, a trigger event, or a trigger scenario. The electronic device determines that the output device of the first audio is the third audio output device according to the switching rule, including: after detecting the first trigger condition, the electronic device determines that the target audio output device of the first source device is the third audio according to the switching rule Output device. The electronic device determines that the output device of the second audio is the fourth audio output device according to the switching rule, including: after detecting the second trigger condition, the electronic device determines that the target audio output device of the second source device is the fourth audio according to the switching rule Output device.

In other words, the electronic device can switch the audio output device in the screen projection process according to the switching rule after detecting the trigger condition.

In another possible design, the first trigger condition includes a trigger event, and the trigger event includes a call event. After the electronic device detects the call event, the target audio output device of the first source device determined according to the switching rule is the first Source device. Alternatively, the first trigger condition includes a trigger event, and the trigger event includes a call end event. After the electronic device detects the call end event, the target audio output device of the first source device determined according to the switching rule is the electronic device.

That is to say, the electronic device can automatically switch to the source to play the audio during the call according to the switching rules after detecting the call event at the source end; after the call is over, it can automatically switch to the electronic device to play the screencasting process according to the switching rules. Follow-up audio.

In another possible design, the method further includes: the electronic device detects a user's operation on the preset control on the input device. The electronic device displays a control menu, and the control menu includes a rule setting menu. The electronic device generates a new switching rule according to the user's operation on the rule setting menu.

In other words, the user can set the switching rule through the rule setting menu.

In another possible design, the control menu further includes a switching rule list, and the switching rule list includes at least one rule control. The method further includes: the electronic device detects that the user selects an operation of the rule control of the first switching rule. The electronic device displays a rule view menu corresponding to the first switching rule, and the rule view menu includes rule content of the first switching rule, enable/stop enable control, and return control.

In other words, the user can view the content of the switching rule through the rule view menu.

In another possible design, the electronic device may be a large-screen device such as a smart TV, a smart screen, or a projector.

On the other hand, an embodiment of the present application provides an electronic device, which is connected to at least one external audio device. The electronic device includes: a screen for displaying an interface; an audio player for playing audio; one or more processors; and a memory with codes stored in the memory. When the code is executed by one or more processors, the electronic device is caused to perform the following steps: receiving screen projection operations from the first source device and the second source device respectively. The first image data from the first source device and the second image data from the second source device are respectively received, the first image data is data corresponding to the first interface of the first source device; the second image data is the first Data corresponding to the second interface of the second source device. According to the first image data and the second image data, the first interface and the second interface are displayed in the first projection area and the second projection area, respectively. The output device of the first audio generated by the first source device during the projection process is the first audio output device; the output device of the second audio generated by the second source device during the projection process is the second audio output equipment. If it is determined that the first condition is met, the first audio output device is set as the third audio output device; the third audio output device is any one of the first source device, the electronic device, or the external audio device, and the third The audio output device is different from the first audio output device. If it is determined that the second condition is met, the second audio output device is set as the fourth audio output device; the fourth audio output device is any one of the second source device, the electronic device, or the external audio device, and the fourth audio output device The audio output device is different from the second audio output device.

In a possible design, determining that the first condition is satisfied includes: detecting a first instruction operation of the user, and the first instruction operation is used to instruct to set the first audio output device as the third audio output device. Determining that the second condition is satisfied includes: detecting a second instruction operation of the user, where the second instruction operation is used to instruct to set the second audio output device as the fourth audio output device.

In another possible design, when the code is executed by one or more processors, the electronic device is also caused to perform the following steps: before detecting the first instruction operation or the second instruction operation, it is detected that the user is on the input device After the operation of the preset controls, the control menu is displayed, and the control menu includes audio switching controls. After detecting the user's selection of the audio switching control, the audio switching menu is displayed. The first instruction operation is an operation for the user to select a third audio output device for the first audio of the first source device based on the audio switching menu. The second instruction operation is an operation in which the user selects the fourth audio output device for the second audio of the second source device based on the audio switching menu.

In another possible design, determining that the first condition is satisfied includes: determining that the first condition is satisfied, including: determining that the output device of the first audio is the third audio output device according to the switching rule. Determining that the second condition is satisfied includes: determining that the output device of the second audio is the fourth audio output device according to the switching rule.

In another possible design, the switching rule includes the correspondence between the first trigger condition and the target audio output device of the first source device; and the relationship between the second trigger condition and the target audio output device of the second source device. Correspondence between: the first trigger condition and the second trigger condition include at least one of a trigger time, a trigger event, or a trigger scenario. Determining the output device of the first audio as the third audio output device according to the switching rule includes: after detecting the first trigger condition, determining the target audio output device of the first source device as the third audio output device according to the switching rule. Determining the output device of the second audio as the fourth audio output device according to the switching rule includes: after detecting the second trigger condition, determining the target audio output device of the second source device as the fourth audio output device according to the switching rule.

In another possible design, when the code is executed by one or more processors, the electronic device is also caused to perform the following steps: detecting the user's operation on the preset control on the input device. The control menu is displayed, and the control menu includes a rule setting menu. According to the user's operation on the rule setting menu, a new switching rule is generated.

In another possible design, the control menu also includes a switching rule list, and the switching rule list includes at least one rule control; when the code is executed by one or more processors, the electronic device is also caused to perform the following steps: detecting that the user selects The operation of the rule control of the first switching rule. The rule view menu corresponding to the first switching rule is displayed. The rule view menu includes the rule content of the first switching rule, enable/stop enable control, and return control.

On the other hand, an embodiment of the present application provides a method for switching audio output devices suitable for single-person projection mode, which is applied to an electronic device, and the electronic device is connected to at least one external audio device. The method includes: the electronic device receives from a source Screen projection operation of the end device. The electronic device receives image data from the source device, and the image data is data corresponding to the interface of the source device. The electronic device displays the interface according to the image data. Wherein, the audio generated by the source device during the screen projection process is played through the first audio output device. After the electronic device determines that the conditions are met, the audio output device is set as the second audio output device; the second audio output device is any one of the source device, the electronic device or the external audio device, and the second audio output device is connected to the second audio output device. One audio output device is different.

In this way, during the screen projection process, the electronic device can control and coordinate the audio output device of the source end, freely switch to use different audio output devices to play the audio shared by the source end during the screen projection process, so as to make full use of the different sound quality in the environment , Different sound effects, different locations, different power consumption, or different power consumption and other characteristics of external audio devices to play the audio shared by the mobile phone, which can improve the selectivity of audio output devices, increase the flexibility of audio output, and improve the user's audio playback experience.

In a possible design, determining that the electronic device satisfies the condition includes: the electronic device detects a user's instruction operation, and the instruction operation is used to instruct to set the audio output device as the second audio output device.

In another possible design, the instruction operation is an operation through an input device or a voice instruction operation, and the input device includes any one of a remote control, a touch screen, a mouse, or a keyboard.

In another possible design, the electronic device detecting the user's instruction operation includes: the electronic device detecting the user's operation of selecting the second audio output device from the audio switching menu. Before the electronic device detects the user's instruction operation, the method further includes: the electronic device detects the user's operation on the preset control on the input device. The electronic device displays a control menu, and the control menu includes audio switching controls. The electronic device detects that the user selects the operation of the audio switching control. The electronic device displays an audio switching menu, and the audio switching menu includes the source device, the electronic device, and the external audio device.

In another possible design, the electronic device determines that the condition is satisfied, including: the electronic device determines that the audio output device is the second audio output device according to the switching rule, and the switching rule includes the trigger condition and the target audio output device of the source device The corresponding relationship; the trigger condition includes at least one of a trigger time, a trigger event, or a trigger scenario.

In another possible design, the trigger event includes a call event, and the target audio output device of the source device corresponding to the call event is the source device. Or, the trigger event includes a call end event, and the target audio output device of the source device corresponding to the call end event is an electronic device.

In another possible design, the method further includes: the electronic device detects a user's operation on the preset control on the input device. The electronic device displays a control menu, and the control menu includes a rule setting menu. The electronic device generates a new switching rule based on the user's operation on the rule setting menu.

On the other hand, an embodiment of the present application provides a display processing device, which is included in an electronic device. The device has the function of realizing the behavior of the electronic device in any of the above aspects and possible design methods. This function can be realized by hardware, or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above-mentioned functions. For example, processing module/unit, receiving module/unit, display module/unit, switching module/unit, etc.

In another aspect, an embodiment of the present application provides an electronic device, including: one or more processors; and a memory, in which code is stored. When the code is executed by the electronic device, the electronic device is caused to execute the method for switching the audio output device executed by the electronic device in any one of the possible designs in the foregoing aspects.

On the other hand, an embodiment of the present application provides a computer-readable storage medium, including computer instructions, when the computer instructions run on an electronic device, the electronic device executes the switching audio output device in any one of the above-mentioned possible designs. Methods.

In another aspect, the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the method for switching audio output devices executed by the electronic device in any one of the above-mentioned possible designs.

On the other hand, an embodiment of the present application provides a chip system, which is applied to an electronic device. The chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected by wires; the interface circuit is used to receive signals from the memory of the electronic device and send signals to the processor. The signals include the memory Stored computer instructions; when the processor executes the computer instructions, it causes the electronic device to execute the method for switching audio output devices in any one of the possible designs of the above aspects.

For the beneficial effects of the corresponding method for switching audio output devices in the single-person projection mode, please refer to the description of the beneficial effects of the corresponding method for switching audio output devices in the multi-person projection mode, which will not be repeated here.

For the corresponding beneficial effects of the other aspects mentioned above, please refer to the description of the beneficial effects of the method, which will not be repeated here.

Description of the drawings

FIG. 1 is a schematic diagram of a communication system provided by an embodiment of this application;

FIG. 2 is a schematic structural diagram of a smart TV provided by an embodiment of the application;

FIG. 3A is a schematic diagram of opening a screen projection application provided by an embodiment of the application;

FIG. 3B is a schematic diagram of a screen projection QR code provided by an embodiment of this application;

4A is a schematic diagram of opening another screen projection application provided by an embodiment of this application;

4B is a schematic diagram of a code scanning interface provided by an embodiment of the application;

4C is a schematic diagram of an operation for opening a shortcut panel provided by an embodiment of the application;

FIG. 4D is a schematic diagram of an operation for opening a code scanning interface provided by an embodiment of this application;

(A)-(b) in FIG. 5A are schematic diagrams of a set of screen projection interfaces provided by an embodiment of this application;

(A)-(b) in FIG. 5B are schematic diagrams of another set of screen projection interfaces provided by embodiments of this application;

FIG. 5C is a schematic diagram of another set of screen projection interfaces provided by an embodiment of the application;

FIG. 6 is a schematic diagram of an audio switching menu provided by an embodiment of the application;

(A)-(b) in FIG. 7 are schematic diagrams of opening an audio switching menu provided by an embodiment of this application;

(A)-(b) in FIG. 8 are schematic diagrams of switching audio output devices provided by embodiments of this application;

FIG. 9 is a flowchart of a method for switching audio output devices according to an embodiment of the application;

(A)-(c) in FIG. 10 are schematic diagrams of the interface of another group of smart TVs provided by an embodiment of the application;

(A)-(e) in FIG. 11 are the division methods of a group of projection areas provided by the embodiments of this application;

FIG. 12A is a schematic diagram of an interface of a smart TV during a screen projection process provided by an embodiment of the application; FIG.

FIG. 12B is a schematic diagram of an interface of a smart TV during another screen projection process provided by an embodiment of the application; FIG.

12C is a schematic diagram of an interface after screen projection provided by an embodiment of the application;

FIG. 13 is a schematic diagram of another screen projection QR code provided by an embodiment of the application;

(A)-(c) in FIG. 14 are schematic diagrams of a set of interfaces or scenes in the screen projection process provided by the embodiments of this application;

(A)-(b) in FIG. 15 are schematic diagrams of the interface of another group of smart TVs provided by an embodiment of the application;

(A)-(b) in FIG. 16 are schematic diagrams of the interface of another group of smart TVs provided by an embodiment of the application;

FIG. 17 is a method for switching audio output devices according to an embodiment of the application.

Detailed ways

The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Wherein, in the description of the embodiments of the present application, unless otherwise specified, "/" means or, for example, A/B can mean A or B; "and/or" in this document is only a description of related objects The association relationship of indicates that there can be three kinds of relationships, for example, A and/or B, which can indicate: A alone exists, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" refers to two or more than two.

Hereinafter, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of these features. In the description of the present embodiment, unless otherwise specified, "plurality" means two or more.

The projection screen technology can enable the audio/video content on mobile phones and other terminals to be played on large-screen devices such as smart TVs, so that the large screen of large-screen devices or the high sound quality characteristics of the large-screen device’s own speakers can be used to share from the terminal Content such as video and audio to improve user experience.

During the screen projection process, since the audio content shared by the terminal may involve user privacy, the audio content shared by the terminal may be played through the large-screen device, which may easily leak the user’s privacy, and the audio content shared by the terminal may be played through the large-screen device. Will disturb others.

The embodiment of the present application provides a method for switching audio output devices, which can be applied to the communication system 10 shown in FIG. 1. As shown in FIG. 1, the communication system 10 includes a source device 01 and a sink device 02. In some embodiments, as shown in FIG. 1, the communication system 10 may further include one or more external audio devices 03 connected to the receiving end device 01. The external audio device 03 can be used to play audio.

Wherein, a wireless connection can be established between the source device and the sink device. For example, the source device and the sink device can access the same wireless network to establish a wireless connection. Exemplarily, the same wireless network may be based on wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) technology, Bluetooth (bluetooth, BT) technology, and global navigation satellite system). navigation satellite system, GNSS technology, frequency modulation (FM) technology, near field communication (NFC) technology, Zigbee technology, infrared (IR) technology, or general 2.4G/5G frequency band wireless communication A communication network formed by technology, etc. For example, the source device and the sink device can access the same Wi-Fi network, and the same Wi-Fi network can be the Wi-Fi network generated by the wireless router 04 shown in Figure 1, or It can be a Wi-Fi hotspot generated by the source device itself.

For another example, the source device and the sink device can be connected through a P2P wireless direct connection. Exemplarily, a wireless connection can be established between the source device and the sink device through Wi-Fi P2P direct connection or Bluetooth P2P direct connection.

The above-mentioned receiving end device and the external audio device can be connected through various wired or wireless methods, for example, through USB, Bluetooth, or Wi-Fi.

Exemplarily, the aforementioned source device may be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR)/virtual reality (VR) device, a notebook computer, an ultra mobile personal computer (ultra -Mobile personal computer (UMPC), netbook or personal digital assistant (personal digital assistant, PDA) and other terminal devices. The source device may have a screen to display image information such as an interface.

The receiving end device includes a screen, such as a smart TV, a smart screen, a smart TV, or a computer. Or, the receiving end device may be a device such as a projector capable of displaying images.

The external audio device is a device with audio playback function connected to the receiving end device. For example, the external audio device can be smart home devices such as smart speakers, smart refrigerators, or smart lights, robots (such as sweeping robots), or various types of devices such as mobile phones, tablets, or wearable devices that are different from the source device.

In the embodiment of the present application, the source device can share its content to the sink device for display through a wireless connection with the sink device. Among them, the source device and the sink device can share content based on the AirPlay protocol or the digital living network alliance (digital living network alliance, DLNA) protocol.

The content shared by the source device may include images, sounds, or texts of the source device. For example, the source device can share content such as video, audio, pictures (such as photos), PPT with audio, or documents to the sink device for display. The sink device can display the image in the shared content of the source device on the screen, and control the audio in the shared content to switch between the sink device, the source device or an external audio device.

In some embodiments, the receiving end device may be a large-screen device with a larger screen, which can make the receiving end device have a better display effect on the image screen in the shared content.

Among them, the function of the source device to share content to the sink device for display can be called a sharing function, or it can be called a screen projection function, a synchronization function, or a moving function.

In the following embodiments, this function is referred to as a screen projection function as an example for description. Corresponding to the screen projection function, the receiving end device can also be called a screen projection device. In the following embodiments, the receiving end device is referred to as a screen projection device as an example for description. In the following embodiments, the source end device may also be referred to as the source end for short.

In some embodiments, after the source device starts the screen projection function, the interface generated subsequently by the source device can be shared on the screen projection device for display. Regarding the audio in the content shared after the source device turns on the screen projection, the screen projection device can be controlled to switch and play between the screen projection device, the source device or an external audio device. In other words, the projection device can control the audio to be played through any of the projection device, the source device, or the external audio device.

In this way, during the screen projection process, the projection device can freely switch the output device of the audio shared by the source device. When using the projection device to play the audio shared by the source device, if it involves user privacy or may disturb other people, the projection device can switch to the source device or an external audio device closer to the user at any time. Play, which can protect the privacy of users and avoid causing interference to others.

In addition, during the screen projection process, the projection device can make full use of external audio devices with different sound quality, different sound effects, different locations, different power consumption, or different power levels in the environment to play the audio shared by the source device, thereby improving The selectivity of audio output devices improves the flexibility of audio output and improves the user's audio playback experience.

In some embodiments, the screen projection device may be an electronic device with a relatively fixed position. In this way, the screen projection device may be connected to more external audio devices, which can make the audio output device more selective during the screen projection process, and the audio output is more flexible.

In an existing technology, the source device can project its own audio/video content on the screen projection device. The source device can control whether the audio during the screen projection process is played at the sink or locally on the source device. Since this solution is controlled on the source device side, it can only control the audio during the projection process to be played on the source device or the projection device, and the flexibility of audio output is poor.

In the multi-person projection mode, multiple source devices can share their content to the same projection device for display. In the multi-person projection mode, the screen of the projection device may include multiple areas to display content shared by different source devices in different areas.

In the multi-person projection mode, if the existing technology is adopted, each source device needs to be individually controlled at the local end to choose whether to play audio at the local source or the projection device. If multiple terminals choose to play audio on the projection device, the projection device will mix and play the multiple audio signals corresponding to multiple source devices. It is difficult for the user to distinguish different audio signals from different source devices. The experience is poor. In order to prevent the projection device from performing audio mixing processing, the projection device can only play one audio signal. However, multiple source devices do not know each other’s screen projections, so it is difficult to coordinate, which makes it difficult to achieve the purpose of only one audio signal being played on the receiving end and the other audio signals being played on the source device. . For example, users of multiple source devices need to negotiate with each other to determine a source device that uses a projection device to play audio signals, and control other source devices to play audio locally.

In the multi-person screen projection mode, using the method provided in the embodiment of the present application, the screen projection device can be uniformly controlled and coordinated to set corresponding audio output devices for the audio shared by different source devices. Therefore, each audio signal corresponding to each source device can have a corresponding audio output device. Different audio signals can be played through different audio output devices in different locations, and different audio signals can be mixed without the projection device, and the user's hearing experience is better.

In other words, the projection device is the switching control center of the audio output device during the projection process, and the forwarding control center of the audio stream. The projection device can forward the audio stream to an external audio device to play audio through the external audio device; the projection device can also instruct the source device to stop sending the audio stream to the projection device, thereby playing audio locally on the source device.

It should be noted that when the user shares the content of the source device on the projection device for display, the user usually wants to use the large screen of the projection device to enjoy the shared content. At this time, the user may no longer use the mobile phone, and the mobile phone can also enter the lock screen or rest screen state. In the projection scene, the user's main focus and operation are transferred to the projection device. Therefore, it is more reasonable to use the screen projection device as the switching control center of the audio output device during the screen projection process, which is more suitable for the screen projection scene, and is more in line with the user's usage habits in the screen projection scene, and the user experience is better.

The following takes the screen projection device as a smart TV as an example to describe the structure of the screen projection device. Exemplarily, FIG. 2 shows a schematic structural diagram of a smart TV 100 provided by an embodiment of the present application. As shown in FIG. 2, the smart TV 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a power management module 140, an antenna, and a wireless communication module 160 , Audio module 170, speaker 170A, microphone 170C, speaker interface 170B, sensor module 180, buttons 190, indicator 191, camera 193, display 192 and so on.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Among them, the different processing units may be independent devices or integrated in one or more processors.

The controller may be the nerve center and command center of the smart TV 100. The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.

A memory may also be provided in the processor 110 to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter/receiver (universal asynchronous) interface. receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, and/or USB interface, etc.

It can be understood that the interface connection relationship between the modules illustrated in this embodiment is merely a schematic description, and does not constitute a structural limitation of the smart TV 100. In other embodiments, the smart TV 100 may also adopt different interface connection modes in the above-mentioned embodiments, or a combination of multiple interface connection modes.

The power management module 140 is used to connect to a power source. The charging management module 140 may also be connected to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 receives power input, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. In some embodiments, the power management module 141 may also be provided in the processor 110.

The wireless communication function of the smart TV 100 can be realized by an antenna, a wireless communication module 160, and the like. Among them, the wireless communication module 160 can provide wireless communication solutions including wireless local area network (such as Wi-Fi), Bluetooth, GNSS, FM, NFC, IR, etc., which are applied to the smart TV 100.

The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be sent from the processor 110, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna 2. In some embodiments, the antenna of the smart TV 100 and the wireless communication module 160 are coupled, so that the smart TV 100 can communicate with the network and other devices through wireless communication technology.

In the embodiment of the present application, the smart TV 100 may establish a wireless connection with the source device through the wireless communication module 160. For example, the smart TV 100 can access the same wireless network as the source device through the wireless communication module 160; or, the smart TV 100 can be directly connected to the source device through the wireless communication module 100 in a P2P wireless direct connection. Therefore, the source device can share the content to the smart TV 100 for display through the wireless connection.

The smart TV 100 can also establish a wireless connection with an external audio device through the wireless communication module 160, so that the smart TV 100 can play the audio shared by the source device through the external audio device during the screen projection process.

The smart TV 100 implements a display function through a GPU, a display screen 192, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 192 and the application processor. The GPU is used to perform mathematical and geometric calculations and is used for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 192 is used to display images, videos, and the like. The display screen 192 includes a display panel. The display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). emitting diode, AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.

After the screen projection function is turned on, the display screen 192 can be used to display images in the content shared by the source device. For example, after the screen projection function is turned on, the display screen 192 can be used to synchronously display the interface of the source device.

The smart TV 100 can realize a shooting function through an ISP, a camera 193, a video codec, a GPU, a display 192, and an application processor. The ISP is used to process the data fed back from the camera 193. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and is projected to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some embodiments, the smart TV 100 may include 1 or N cameras 193, and N is a positive integer greater than 1.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the smart TV 100 selects the frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point. Video codecs are used to compress or decompress digital video. The smart TV 100 may support one or more video codecs. In this way, the smart TV 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.

NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, for example, the transfer mode between human brain neurons, it can quickly process input information, and it can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the smart TV 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, and so on.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the smart TV 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.

The internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the smart TV 100 by running instructions stored in the internal memory 121. For example, in the embodiment of the present application, the processor 110 may execute instructions stored in the internal memory 121, and the internal memory 121 may include a program storage area and a data storage area.

In the embodiment of the present application, the processor 110 can implement functions such as starting/stopping the screen projection by running instructions stored in the internal memory 121, and controlling the switching of the audio output device during the projection process.

Among them, the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like. The data storage area can store data (such as audio data, phone book, etc.) created during the use of the smart TV 100. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.

The smart TV 100 can implement audio functions through an audio module 170, a speaker 170A, a microphone 170C, a speaker interface 170B, and an application processor. For example, music playback, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110, or part of the functional modules of the audio module 170 may be provided in the processor 110. The speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. The microphone 170C, also called "microphone", "microphone", is used to convert sound signals into electrical signals.

The speaker interface 170B is used to connect wired speakers. The speaker interface 170B may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, and a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

In the embodiment of the present application, the audio module 170 can play the audio shared by the source device according to the control of the processor 110. The speaker interface 170B can be used for connecting the smart TV 100 to an external audio device such as a speaker. The smart TV 100 can also be connected to other external audio devices through an ISB interface or the like.

The sensor module 180 may include sensors such as a distance sensor, a proximity light sensor, a touch sensor, a fingerprint sensor, a temperature sensor, and an ambient light sensor. Among them, the touch sensor is also called "touch panel". The touch sensor may be provided on the display screen 192, and the touch screen is composed of the touch sensor and the display screen 192, which is also called a “touch screen”. The touch sensor is used to detect touch operations acting on or near it. The touch sensor may transfer the detected touch operation to the processor 110 to determine the type of the touch event. The visual output related to the touch operation can be provided through the display screen 192. In other embodiments, the touch sensor may also be disposed on the surface of the smart TV 100, which is different from the position of the display screen 192.

In the embodiment of the present application, the touch screen can receive the user's touch input, generate key signal input related to the user settings and function control of the smart TV 100, and send corresponding control signals to the smart TV 100 to control the smart TV 100 to switch Audio output devices, configuration switching rules and other related functions.

The button 190 includes a power button, a volume button, and so on. The button 190 may be a mechanical button. It can also be a touch button. The smart TV 100 can receive key input, and generate key signal input related to user settings and function control of the smart TV 100.

The indicator 191 may be an indicator light, which may be used to indicate that the smart TV 100 is in a power-on state, a standby state, or a power-off state. For example, when the indicator light is off, it can indicate that the smart TV 100 is in the off state; the indicator light is green or blue, which can indicate that the smart TV 100 is in the standby state; the indicator light is red, which can indicate that the smart TV 100 is in the standby state.

Generally, the smart TV 100 is equipped with a remote control, which can be used as an input device. The remote control is used to control the smart TV 100. The remote control may include multiple buttons, such as a power button, a volume button, and other multiple selection buttons. The buttons on the remote control can be mechanical buttons or touch buttons. For example, the remote controller may send a control signal to the smart TV 100 through an infrared signal or the like. The remote control may also include a battery storage cavity for installing batteries to supply power to the remote control.

The smart TV 100 may also be connected with input devices such as a mouse or a keyboard. The input device can receive input signals, generate key signal inputs related to the user settings and function control of the smart TV 100, and send corresponding control signals to the smart TV 100 to control the smart TV 100 to switch audio output devices, configure switching rules, etc. Features.

It is understandable that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the smart TV 100. It may have more or fewer components than shown in FIG. 2, may combine two or more components, or may have a different component configuration. For example, the television may also include components such as speakers. The various components shown in FIG. 2 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing or application specific integrated circuits.

In the embodiment of the present application, the smart TV 100 may establish a wireless connection with the source device based on the wireless communication module 160, and may also establish a connection with an external audio device based on the wireless communication module 160 or the speaker interface 170B, so as to use the external audio device source The audio shared by the end device. After the screen projection is turned on, the smart TV 100 can display the content shared by the source device based on the wireless connection with the source device. The display screen 192 can display images included in the content shared by the source device. During the screen projection process, the processor 110 can control the switching of the audio output device according to the user's instructions or switching rules, so as to play the audio shared by the source device through the smart TV 100, the source device or the connected external audio device, and improve the audio playback Flexibility.

Hereinafter, the method for switching audio output devices provided by the embodiments of the present application will be explained by taking the source device as a mobile phone, the projection device as a smart TV, the smart TV is connected with an external audio device, and the external audio device includes devices such as smart speakers.

Among them, there may be multiple screen projection modes, such as a single-person screen-casting mode (or called one-shot-one mode), or a multi-person screen-casting mode (or called a multi-cast and one mode). The following is a detailed description of different scenarios.

(1), single-player projection mode

In the single-player projection mode, a source device can share content to the projection device for display. Take the mobile phone 1 to project the shared content to the smart TV for display as an example for description.

Mobile phone 1 cast screen to smart TV. There are many ways to project the screen of the mobile phone 1 to the smart TV, which will be explained by way of examples below.

In some embodiments, the mobile phone 1 can start the screen projection by scanning the code. The smart TV can display the screen projection QR code, the mobile phone 1 scans the screen projection QR code displayed on the smart TV to initiate the screen projection, and the smart TV can accept the screen projection initiated by the mobile phone 1.

For example, a smart TV may include screen projection APP1. After the smart TV opens the screen projection APP1 according to the user's instruction, it can display the screen projection QR code on the screen. Among them, the user can instruct the user to open the projection screen APP1 through various methods such as remote control, voice, keys, or through the touch screen of the TV. Exemplarily, the icon of the screen projection APP1 may be the icon 301 shown in FIG. 3A, the user can instruct to open the screen projection APP1 through the remote control 302 shown in FIG. 3A, and the smart TV can display the second screen projection shown in FIG. 3B. Dimension code.

For another example, a screen projection control is displayed on the interface of a smart TV, and the smart TV displays a screen projection QR code after detecting that the user clicks the screen projection control through the remote control.

For another example, the projection QR code is preset on the outer surface of the smart TV, or preset on the manual of the smart TV.

For example, the mobile phone 1 may also include the screen projection APP2. After the mobile phone 1 opens the screen projection APP2 according to the user's instruction, it can display a code scanning interface to scan the screen projection QR code of the smart TV. Among them, the user can instruct the user to open the screen projection APP2 through various methods such as the touch screen of the mobile phone, voice or keys. Exemplarily, the icon of the screen projection APP2 may be the icon 401 shown in FIG. 4A. After the mobile phone 1 detects the user's operation of clicking the icon 401, the screen projection APP2 is opened and displays the screen projection QR code as shown in FIG. 4B.

For another example, as shown in FIG. 4C, after the mobile phone 1 detects the user's sliding operation from the top of the screen, it displays a shortcut panel as shown in FIG. 4D, and the shortcut panel includes a projection control 402. After the mobile phone 1 detects that the user has clicked on the screen projection control 402, it displays the code scanning interface as shown in FIG. 4B to scan the screen projection QR code of the smart TV.

For another example, the mobile phone 1 can open the code scanning interface of an APP such as WeChat to scan the QR code of the smart TV.

After the mobile phone 1 scans the screen projection QR code displayed on the smart TV, it can establish a wireless connection with the smart TV. For example, the mobile phone 1 and the smart TV can be connected to the same Wi-Fi network, or the smart TV can be connected to a Wi-Fi hotspot opened by the mobile phone 1, or the mobile phone 1 and the smart TV can be directly connected via Wi-Fi P2P. After the wireless connection is established, the mobile phone 1 starts to project to the smart TV based on the wireless connection, so as to share the content to the smart TV for display. The subsequent display interface of the mobile phone 1 can be simultaneously displayed on the smart TV through the screen projection.

In other embodiments, a wireless connection is established between the mobile phone 1 and the smart TV. After the mobile phone 1 detects the user's sliding operation from the top of the screen, it displays a shortcut panel, and the shortcut panel includes another screen projection control. After the mobile phone 1 detects that the user has clicked another screen projection control, it scans for screen projection devices and displays a list of screen projection devices. After the mobile phone 1 detects that the user selects the smart TV from the list of screen-capable devices, it starts to cast to the smart TV based on the wireless connection with the smart TV, and the subsequent display interface of the mobile phone 1 is displayed on the smart TV synchronously through the screen projection. on.

Exemplarily, after the screen projection is turned on, the interface displayed by the mobile phone 1 and the smart TV can be seen in (a)-(b) in FIG. 5A.

After the screen projection is turned on, the mobile phone 1 displays a different interface as the user uses it. The mobile phone 1 can send image data corresponding to the interface to the smart TV based on the wireless connection with the smart TV, and the smart TV synchronously displays the interface of the mobile phone 1 according to the image data received from the mobile phone 1.

In some other embodiments, the mobile phone 1 can be touched and projected. For example, the mobile phone 1 and the smart TV are provided with a projection detection component group. For example, the smart TV and the mobile phone 1 are respectively preset with detection devices such as an NFC scanner and an NFC tag. Alternatively, the smart TV and the mobile phone 1 are respectively preset with detection components such as Hall devices or magnetic elements. After the mobile phone 1 touches a specific area of the smart TV, the screen can be quickly projected to the smart TV. Wherein, the specific area may be an area covered by the scanning range of the NFC scanner.

In other embodiments, the mobile phone 1 can quickly project the screen to the smart TV after touching the remote control of the smart TV. Alternatively, the mobile phone 1 can quickly screen to the smart TV after touching the detection label. The detection label can be affixed to the remote control, on the table, on the coffee table or other convenient location.

It should be noted that the “synchronization” in the interface of the mobile phone 1 is displayed on the smart TV synchronously, which is used to indicate that the interface content displayed by the smart TV is consistent with the interface content after the screen projection of the mobile phone 1 is turned on, but does not mean that the smart TV and the mobile phone 1 The interface of mobile phone 1 is displayed at the same time.

Exemplarily, after the screen projection is turned on, if the mobile phone 1 detects that the user has clicked the home button (or Home button), as shown in (a) in Figure 5B, the mobile phone 1 displays the desktop; as in Figure 5B ( As shown in b), the smart TV displays the desktop of the mobile phone 1 synchronously. As another example, if the mobile phone 1 detects the user's operation to open the video application, as shown in Figure 5C (a), the mobile phone 1 displays the video screen; as shown in Figure 5C (b), the smart TV displays synchronously Video screen. It is understandable that the smart TV can also display content such as game screens, photos, PPT documents or text documents of the mobile phone 1 through screen projection, which will not be listed here.

In some embodiments of the present application, after the screen projection is turned on, if the mobile phone 1 generates audio data to be played, the audio data can be sent to the smart TV. By default, the smart TV uses its own audio player (such as its own speakers or its own integrated speakers, etc.) to play the audio generated by the mobile phone 1 during the screen projection process, that is, to play the audio shared by the mobile phone 1.

Later, the user can instruct the smart TV to switch the audio output device during the screen projection process according to the needs of the scene, their own usage habits, protecting privacy or avoiding interference with others and other factors. The smart TV can control the use of different audio output devices to play the audio shared by the mobile phone 1 during the screen projection process according to the user's instruction.

For example, the user can instruct the smart TV to switch the audio output device through any input device of the smart TV's remote control, touch screen, or mouse and keyboard connected to the smart TV. In some embodiments, terminal devices such as mobile phones can also be used as remote controls for smart TVs.

For example, the user can press the preset button 1 on the remote control. The remote controller can send the control signal corresponding to the preset button 1 to the smart TV through infrared signals or the like. After the smart TV detects the control signal sent by the remote control, it can display the audio switching menu. The audio switching menu includes an audio output device list, which is used by the user to indicate the target audio output device for the audio shared by the mobile phone 1. For example, the audio switching menu may be the menu 601 shown in FIG. 6.

As another example, referring to (a) in FIG. 7, the user can press the Menu button 701 on the remote control. The remote controller can send the control signal corresponding to the Menu button 701 to the smart TV through infrared signals or the like. After the smart TV detects the control signal sent by the remote control, it can pop up the control menu 702 shown in (b) in FIG. 7, and the control menu 702 includes an audio switching control 703. After the smart TV detects that the user has clicked the audio switching control 703 through the remote control, it can display the audio switching menu 601 shown in FIG. 6.

As another example, the screen of the smart TV is a touch screen, and the smart TV displays an audio switching menu after detecting that the user has clicked a preset control on the touch screen.

For another example, the smart TV displays the audio switching menu after detecting the preset voice instruction.

As another example, after the camera of the smart TV detects the user's preset gesture, preset expression, or preset action, it displays the audio switching menu.

It is understandable that the smart TV can display the audio switching menu through a variety of triggering methods.

For another example, the smart TV automatically pops up the audio switching menu after receiving the audio data from the mobile phone 1.

Wherein, the device list in the audio switching menu may include the smart TV and the source terminal, and may also include the external audio device of the smart TV. The device list includes the current audio output device used to play the audio shared by the mobile phone 1 (for example, the smart TV in the bold box shown in FIG. 6), and other audio output devices that can be switched by the user.

After the smart TV detects that the user uses a remote control, a touch screen, or a mouse or keyboard connected to the smart TV to instruct to switch to the target audio output device in the audio switching menu, the target audio output device is instructed to play the audio shared by the mobile phone 1.

For example, during the screen projection process, for the audio shared by the mobile phone 1, the current audio output device is a smart TV. See (a)-(b) in Figure 8. The user can use the arrow keys 801 and the OK key 802 in the remote control. Control the smart TV to select "source" in the audio switching menu, that is, the target audio output device indicated by the user is mobile phone 1, then the smart TV instructs mobile phone 1 to play the audio shared by mobile phone 1 during the screen casting process.

For example, in the case where the audio content played by the smart TV may involve user privacy or may disturb others, the user may want to use the mobile phone 1 to play audio at close range or listen to the audio content through the earphone connected to the mobile phone 1, and thus can instruct The target audio output device is mobile phone 1. For example, scenarios where the audio content to be played may involve user privacy may include: the user is about to make a call, the mobile phone 1 receives an incoming call, the mobile phone 1 receives a WeChat voice message, or the mobile phone 1 receives a video call.

If the target audio output device is the mobile phone 1, the smart TV can send a control command to the mobile phone 1 to instruct the mobile phone 1 to stop sending audio data to the smart TV, and directly play audio on the mobile phone 1. In some embodiments, the smart TV may send a control command 1 to the mobile phone 1 based on a transmission protocol such as TCP or UDP, and the content of the control command 1 may be "play audio at the source". The mobile phone 1 receives and parses the control command 1, and then stops sending audio data to the smart TV, and directly plays the audio locally on the mobile phone 1.

For another example, during the screen projection process, for the audio shared by mobile phone 1, the current audio output device is a smart TV, and the target audio output device indicated by the user is an external audio device, then the smart TV can instruct the external audio device to play the mobile phone 1’s share Audio. Among them, the external audio device of the smart TV may include devices such as smart speakers, sweeping robots, mobile phones other than mobile phone 1, wearable devices, or tablet computers. Different external audio devices have different characteristics such as sound quality, sound effects, location, or power consumption, and the user can instruct to play the audio shared by the mobile phone 1 through external audio devices with different characteristics.

Among them, the sound quality of external audio equipment such as external speakers may be better, the sound effect modes may be more, and the audio playback effect may be better. In scenes such as watching a video, watching a movie, or watching a MV, the user may want to use a better external speaker to play audio, and the user can instruct the target audio output device to be an external speaker. For example, when a user is watching a movie, he wants to use the 3D surround sound mode of an external speaker to play audio, so as to improve the user's audiovisual experience when watching a movie. Therefore, the target audio output device can be selected as the external speaker. In this case, the smart TV can forward audio data to an external speaker. The external speaker starts to play audio after receiving the audio data.

For another example, when the audio content played on a smart TV may involve user privacy or may disturb other people, etc., the user may want to use a wearable device closer to the user to play audio, and the user can instruct the target audio output The device is a wearable device. In this case, the smart TV can forward audio data to the wearable device. The wearable device starts to play audio after receiving the audio data.

As another example, if the current audio output device is the mobile phone 1 and the target audio output device indicated by the user is a smart TV, the smart TV sends the control command 2 to the mobile phone 1. After receiving the control command 2, the mobile phone 1 stops playing audio and sends audio data to the smart TV. The smart TV plays audio according to the audio data. For example, in a scenario where the user continues to watch a movie after the call ends, the user may want to continue to use the smart TV to play the audio during the screen casting process, and thus may indicate that the target audio output device is a smart TV.

As another example, if the current audio output device is the mobile phone 1, the current power of the mobile phone 1 is insufficient, and the power of the external audio device such as the wearable device or the cleaning robot is relatively sufficient, the user can instruct the wearable device or the cleaning robot as the target audio output device. The smart TV sends a control command 2 to the mobile phone 1 according to the user's instruction. After receiving the control command 2, the mobile phone 1 stops playing audio and sends audio data to the smart TV. Smart TVs send audio data to external audio devices such as wearable devices or sweeping robots. The external audio device starts to play audio after receiving the audio data.

As another example, if the current audio output device is an external audio device and the target audio output device indicated by the user is a smart TV, the smart TV stops sending audio data to the external audio device, and the smart TV plays audio.

As another example, if the current audio output device is an external audio device and the target audio output device indicated by the user is the mobile phone 1, the smart TV stops sending audio data to the external audio device and sends a control command 1 to the mobile phone 1. After receiving the control command 1, the mobile phone 1 stops sending audio data to the smart TV and plays audio.

In this way, during the screen projection process, the user can instruct the smart TV to switch the output device of the audio shared by the mobile phone 1 at any time according to the needs of the scene, their own usage habits, protection of privacy or avoiding interference with others and other factors. Smart TVs can switch to use different audio output devices to play the audio shared during the screen projection process in real time according to the user's instructions, so that they can make full use of different sound quality, different sound effects, different locations, different power consumption, or different power consumption in the environment. The audio device is used to play the audio shared by the source, which can increase the selectivity of the audio output device, increase the flexibility of the audio output, and improve the user's audio playback experience.

Moreover, a smart TV is an electronic device with a relatively fixed location. In this way, the smart TV can be connected to more external audio devices, which can make the audio output device more selective and the audio output more flexible during the screen projection process.

Among them, when the smart TV is playing the audio shared by the mobile phone 1, if the user's privacy is involved or other people may be disturbed, the smart TV can switch to the mobile phone 1 or an external audio closer to the user at any time according to the user's instructions The device can play, so as to protect the privacy of the user and avoid causing interference to others.

According to the above description, the flowchart of the method for switching audio output devices provided in the above embodiments can be seen in FIG. 9. As shown in Fig. 9, the method may include: 901, the mobile phone 1 and the smart TV start to cast screens. 902. After the screen projection is turned on, the mobile phone 1 may send the video stream in the screen projection process to the smart TV. Wherein, the video stream is an image data stream corresponding to the interface of the mobile phone 1. 903. The smart TV displays the interface of the mobile phone 1 according to the received video stream. 904. After starting the screen projection, the mobile phone 1 may send the audio stream during the screen projection process to the smart TV. 905. The smart TV plays audio according to the received audio stream. 906. If the smart TV detects the operation of the user indicating that the target audio output device is the mobile phone 1, the smart TV sends a control command 1 to the mobile phone 1. 907. The mobile phone 1 stops sending audio streams to the smart TV according to the received control command 1. 908. Mobile phone 1 plays audio locally. Alternatively, the method further includes: 908. If the smart TV detects an operation that the user indicates that the target audio output device is an external audio device, the smart TV forwards the audio stream to the external audio device. 909. The external audio device starts to play audio after receiving the audio stream.

In some other embodiments, the smart TV can automatically display the audio switching menu after the screen projection is turned on, so that the user can preset the target audio output device through the audio switching menu. After the smart TV subsequently receives the audio data from the mobile phone 1, it can control to play audio using a target audio output device preset by the user. If the target audio output device is a smart TV or an external audio device, after mobile phone 1 generates audio, mobile phone 1 sends audio data to the smart TV; if the target audio output device is mobile phone 1, the smart TV informs mobile phone 1 and generates audio on mobile phone 1. After the audio, the mobile phone 1 does not send audio data to the smart TV, and the mobile phone 1 plays the audio on the local end.

In some other embodiments, the smart TV automatically displays the audio switching menu after starting the projection screen and receiving the audio data sent by the mobile phone 1, so that the user can set the target audio output device through the audio switching menu. Smart TV control uses the target audio output device instructed by the user to play audio.

In some other embodiments, the smart TV uses the target audio output device instructed by the user during the last screen projection to play the audio shared by the mobile phone 1 after starting the screen projection.

In some other embodiments, after the screen projection is turned on, the smart TV can set or switch the audio output device according to the user's voice command. For example, if the current audio output device is a smart TV, the user can say the voice command "switch to external speaker to play sound" to the smart TV, and then the smart TV switches to play audio through the external speaker according to the user's voice command.

In some other embodiments, different preset gestures, preset expressions, or preset actions have corresponding relationships with different audio output devices. The smart TV can detect the user's preset gestures, preset expressions, or preset actions through the camera, and play audio through the target audio output device corresponding to the preset gestures, preset expressions, or preset actions.

Exemplarily, after the smart TV detects the user's motion of waving the remote control toward the first speaker through the camera, it sets the target audio output device as the first speaker. As another example, the current audio output device is a smart TV. After the smart TV detects the operation of waving the user's palm from the direction of the smart TV to the direction of the mobile phone 1 through the camera, the target audio output device is set to the mobile phone 1.

In other embodiments, during the screen projection process, the smart TV can automatically switch the target audio output device according to the switching rule, thereby automatically controlling the use of different output devices to play the audio shared by the mobile phone 1. The switching rule includes the corresponding relationship between the trigger condition and the target audio output device. The trigger condition may include at least one of a trigger time, a trigger event, or a trigger scene. In this way, the smart TV can automatically control the switching of the target audio output device according to the switching rule, thereby reducing the user's operation, freeing the user's hands, and improving the user's experience.

Wherein, the switching rule may be preset in the smart TV at the factory, or set by the user, or may be received by the smart TV from the mobile phone 1 or other devices.

In some technical solutions, the switching rule enabled by the smart TV is only valid for this screen projection process, and the smart TV automatically stops enabling the switching rule after this screen projection is completed. After the smart TV turns on the screen projection again, the user needs to re-enable the switching rule, so as to automatically switch the target audio output device corresponding to the screen projection according to the switching rule enabled this time.

In other technical solutions, if the user does not instruct to stop enabling the switching rule, the enabled switching rule will continue to be effective during multiple screen projections. After the screen projection is turned on, the smart TV continues to automatically switch the target audio output device corresponding to the screen projection according to the switching rule that has not stopped being activated. In this way, after the smart TV starts the switching rule once, the target audio output device switching control can be automatically performed in each subsequent screen projection process, which can save the user's startup control operation, simplify the control process, and improve the user experience.

After the smart TV is turned on, if there are no switching rules or no enabled switching rules, in some technical solutions, the smart TV uses the smart TV to play audio by default, and subsequently after detecting the user settings or enabling the switching rules, Then switch the target audio output device according to the switching rule.

After the smart TV is turned on for screen projection, if there is an enabled switching rule, the target audio output device will be automatically switched using the switching rule. If the enabled switching rule does not apply to the current scenario, the user can set a new switching rule or switch to enable another switching rule.

Among them, there may be multiple ways for the user to set the switching rule or to switch the enabled switching rule.

For example, the user can instruct the smart TV to display the rule setting menu or rule list through the remote control, touch screen of the smart TV, or input devices such as a mouse or keyboard connected to the smart TV. The rule setting menu can be used for the user to set the switching rule. The rule list includes the controls of the existing switching rule, and can be used for the user to enable, stop enabling or view the existing switching rule.

Exemplarily, the smart device may display the control menu in the manner described in the above embodiment. As shown in (a) of FIG. 10, the control menu 1001 includes a rule setting control 1002. After the smart TV detects that the user selects the rule setting control 1002, it can display the rule setting menu so that the user can set the switching rule through the rule setting menu 1003.

Among them, the switching rule may specify switching to different target audio output devices according to factors such as trigger time, trigger event, or trigger scene.

For example, the user’s mobile phone 1 is screened onto the smart TV at home, and the family’s lunch break is between 12:00 and 13:00. To avoid disturbing family members, the target audio output device specified in the switching rules can be switched from smart TV to mobile phone 1 at 12:00 and back to smart TV at 13:00.

For another example, the user's mobile phone 1 casts a screen to the smart TV at home, and the broadcast time of news broadcast starts at 19:00 in the evening, and the target audio output device specified by the switching rule can be switched to the smart TV at 19:00.

For another example, the switching rule may be associated with the alarm clock application of the mobile phone 1, and the target audio output device is switched with the time point set by the alarm clock application as the trigger time. For example, if the user's mobile phone 1 casts a screen to the smart TV in the office, the alarm clock application sets 08:30-09:00 in the morning as the screen-casting meeting, and the target audio output device specified in the switching rule can be switched to the smart TV at 08:30 in the morning , And switch to mobile phone 1 at 09:00 in the morning. For another example, if the user’s mobile phone 1 is projected to the smart TV at home, the alarm clock application sets 19:30-20:00 as the writing time, and the target audio output device specified by the switching rule can be switched to mobile phone 1 at 19:30. And switch to smart TV at 20:00 in the evening. For another example, the user's mobile phone 1 casts a screen to the smart TV at home, the alarm clock application sets 20:00-20:30 as home entertainment time, and the target audio output device specified by the switching rule can be switched to the smart TV at 20:00.

Among them, the trigger event can be detected by the smart TV, or it can be notified to the smart TV after being recognized by the mobile phone 1. For example, if a smart TV detects a trigger event such as an incoming call, a video call, or a voice message (such as WeChat voice message), the voice to be played may involve user privacy, and the voice to be played may involve user privacy. Therefore, the switching rule is based on the target specified by the trigger event The audio output device can be switched to the mobile phone 1, so that audio can be played through the mobile phone 1 in the user's hand or the earphone connected via the mobile phone 1 (for example, a wired earphone or a Bluetooth earphone, etc.). Alternatively, if the mobile phone 1 detects a trigger event such as an incoming call, a video call or a voice message, it can notify the smart TV; after receiving the notification from the mobile phone 1, the smart TV switches the target audio output device to the mobile phone 1 according to the switching rule.

For another example, if a smart TV detects a trigger event such as an incoming call, a video call, or a voice message, the voice to be played may involve user privacy. Therefore, the target audio output device specified by the switching rule can be switched to a wearable device according to the trigger event.

For another example, if the smart TV detects a trigger event such as the end of the incoming call, the end of the video call, or the voice message has been played, the target audio output device specified by the switching rule can be switched to the smart TV according to the trigger event, so that the smart TV can play subsequent screencasts. Audio in process.

For another example, if the camera of the smart TV recognizes that there is a triggering scene such as a family at work or a child writing homework, the switching rule may switch to the mobile phone 1 according to the target audio output device specified by the triggering scene.

In some embodiments, the priority of the event trigger mode or the scene trigger mode may be higher than the time trigger mode, and the smart TV may preferentially play the audio shared by the mobile phone 1 according to the target audio output device corresponding to the event trigger or the scene trigger.

For example, the aforementioned rule setting menu may be the menu 1003 shown in (b) of FIG. 10. The user can set the trigger mode as time, event or scene in the first column of the rule setting menu. When the smart TV determines that the trigger condition (or trigger node) specified in the switching rule is satisfied, it switches to the corresponding target audio output device to play the audio generated in the screen projection process.

For the time trigger mode, the user can set the trigger time as the trigger condition and the target audio output device that triggers the switch when the trigger time arrives.

For the event trigger mode, the user can set the trigger event as the trigger condition and the target audio output device for the trigger event to trigger the switch. Exemplarily, as shown in (b) of FIG. 10, after the smart TV detects that the user selects the control 1000, it may pop up a list of trigger events for the user to select. For example, the list of trigger events includes events such as the end of an incoming call, an incoming call, and a video call. Alternatively, the user can also input a trigger event in the control 1000 through an input device such as a remote control or a keyboard.

In some embodiments, incoming calls and video calls can be collectively referred to as calls. The trigger event can be a call event detected or a call end event. The target audio output device corresponding to the detected call event specified in the switching rule may be the source end; the target audio output device corresponding to the call end event specified in the switching rule may be a smart TV.

For the scene trigger mode, the user can set the trigger scene as the trigger condition and the target audio output device that triggers the scene to trigger the switch.

In addition, as shown in (a) of FIG. 10, the control menu 1001 also includes a rule list 1004. The rule list 1004 includes rule controls 1005 that have switching rules. In some embodiments, in the rule list, an enable mark is displayed on the currently enabled rule control to facilitate prompting the user of the switching rule currently used. For example, the activation mark may be a check mark shown in (a) in FIG. 10.

After the smart TV detects that the user selects the rule control 1005 in the rule list 1004, it can display the rule view menu corresponding to the rule control 1005 so that the user can view the specific content of the switching rule. For example, the rule viewing menu may be the menu 1006 shown in (c) in FIG. 10. The rule view menu 1006 may include controls that are convenient for user operations, such as enabling controls, stopping enabling controls, editing controls, or returning controls.

In some embodiments, the target audio output devices indicated by multiple switching rules may conflict. In the case where the user activates multiple switching rules, in order to avoid conflicts between target audio output devices indicated by different switching rules, the smart TV may prompt the user to change the switching rules by displaying prompt messages or voice prompts.

In some other technical solutions, the smart TV automatically displays the control menu after the screen projection is turned on, so that the user can enable/stop the activation or set the switching rule. After the audio is generated on the mobile phone 1 subsequently, the smart TV can switch to use different audio output devices according to the enabled switching rules. After mobile phone 1 generates audio, if the target audio output device is a smart TV or an external audio device, mobile phone 1 sends audio data to the smart TV; if the target audio output device is mobile phone 1, mobile phone 1 does not send audio data to the smart TV. The mobile phone 1 plays audio by itself.

In some other embodiments, the smart TV automatically displays the control menu after starting the screen projection and receiving the audio data sent by the mobile phone 1, so that the user can enable/stop the activation or set the switching rule. The smart TV plays audio through the target audio output device determined by the switching rule.

In some other embodiments, the smart TV can set the switching rule according to the user's voice instruction, or switch the switched rule that has been enabled.

In other embodiments, the user instructs the target audio output device and the switching rule to be used in combination. If the smart TV detects that the user has instructed the target audio output device and then detects that the user has enabled the switching rule, the smart TV will play audio through the target audio output device determined by the switching rule.

If the smart TV has an enabled switching rule and then detects the operation of the user instructing the target audio output device, the smart TV uses the target audio output device instructed by the user to output audio. In addition, the smart TV may also include automatic controls, and the automatic controls may be located on the screen projection interface of the smart TV or in the control menu. After the smart TV detects the user's operation of clicking the automatic control, it resumes automatically switching the target audio output device according to the switching rule.

(2) Multiplayer projection mode

In the multi-person projection mode, multiple source devices can project the shared content to the same projection device for display. For example, in a multiplayer game scenario, multiple game users project the game interface to the same screen projection device. For another example, in a screencasting conference scenario, the content of the conference involves PPT, documents, pictures, or comparison design schemes projected by multiple source-end devices, and multiple source-end devices are projected on the same screen-casting device for display. For another example, in a family scenario, parents and children respectively cast movies and cartoons from different source devices to the same screen projection device for viewing.

The following will take the mobile phone 1 and the mobile phone 2 to project the shared content to the smart TV for display as an example.

In the multi-person projection mode, both mobile phone 1 and mobile phone 2 can project to the same smart TV to share the large-screen resources of the smart TV. The screen of a smart TV can be divided into multiple projection areas, and different projection areas are used to display different screen projection interfaces of different mobile phones. There are many ways to divide the projection area.

Exemplarily, referring to (a)-(e) in FIG. 11, the projection area may be up/down pattern, left/right pattern, left/middle/right pattern, four-square pattern, or nine-square pattern, etc. It is understandable that the smart TV can also use other methods to display the screen projection interfaces of multiple mobile phones at the same time, for example, using picture-in-picture or floating windows.

For example, the mobile phone 1 can use the method described in the above embodiment to project a screen to a smart TV. The mobile phone 2 can also be screened to a smart TV in the manner described in the above embodiment. Mobile phone 1 and mobile phone 2 can be screened to the smart TV at the same time or successively.

For another example, a smart TV can display the projection screen QR code in the manner described in the above embodiment. The screen projection two-dimensional code may be as shown in FIG. 12A, and the mobile phone 1 first projects the screen to the smart TV by scanning the code. Referring to Figure 12B, the smart TV displays the screen projection interface of the mobile phone 1 in the first projection area on the left side of the screen, and the first projection area is the projection window corresponding to the mobile phone 1; and displays the projection screen in the second projection area on the right. QR code. The mobile phone 2 scans the screen projection QR code shown in FIG. 12B to project the screen to the smart TV. Referring to FIG. 12C, the second screen projection area on the right side of the smart TV screen is the screen projection window corresponding to the mobile phone 2 for displaying the screen projection interface of the mobile phone 2.

In some embodiments, the correspondence between the projection area and the source can be switched. For example, in the case shown in Figure 12C, the smart TV can be switched to display the screen of mobile phone 2 in the first screen area on the left of the screen, and display the screen of mobile phone 1 in the second screen area on the right of the screen according to the user's voice command. Screen projection interface.

For another example, as shown in FIG. 12C, a zone switching control 1201 is displayed on the interface of the smart TV. After the smart TV detects that the user clicks on the area switching control 1201, it switches to display the screen projection interface of the mobile phone 2 in the first projection area on the left side of the screen, and display the screen projection interface of the mobile phone 1 in the second projection area on the right side of the screen.

In some embodiments, smart TVs and mobile phones may provide multiple different screen projection modes such as one-shot, one-shot or one-shot, so that the user can choose to enter the corresponding mode when the screen is turned on. Exemplarily, referring to Fig. 13, the projection QR code displayed on the smart TV includes a projection QR code with one projection and one mode and a projection QR code with multiple projection and one mode. The user can choose to scan different projection QR codes. Code to enter different projection modes.

Among them, the switching method of the audio output device in the multi-person projection mode is similar to that in the single-person projection mode, and the differences are mainly explained below.

In the multi-person projection mode, the smart TV can select the target audio output device 1 of the mobile phone 1 and/or the target audio output device 2 of the mobile phone 2 according to the user's instructions. The user can also instruct the smart TV to switch the audio output device of the mobile phone 1 and/or the mobile phone 2 at any time according to the needs of the scene, their own usage habits, protecting privacy or avoiding interference with others and other factors.

In the multi-person projection mode, similar to the single-person projection mode, the target audio output device 1 can be a smart TV, the source mobile phone 1 or an external audio device of the smart TV; the target audio output device 2 can be a smart TV, a source The external audio equipment of the mobile phone 1 or smart TV at the end. The smart TV can control the target audio output device 1 to play the audio generated by the mobile phone 1 during the screen projection process, and control the target audio output device 2 to play the audio generated by the mobile phone 2 during the screen projection process according to the user's instruction.

Exemplarily, user A and user B use mobile phone 1 and mobile phone 2 to cast screens to a smart TV to play games. The smart TV can display the screen projection interface 1401 and the screen projection interface 1402 as shown in (a) of FIG. 14.

Among them, the user A and the user B play different games, or the user A and the user B join different teams of the same game, and the audio generated by the mobile phone 1 and the mobile phone 2 have different contents. The smart TV can play the audio generated during the screen projection of the mobile phone 1 and the mobile phone 2 through its own audio playback device by default. In this way, the game sounds of user A and user B are mixed on the smart TV, and the user's hearing experience is poor.

In order to improve the user's hearing experience, the user may instruct to use different target audio output devices to play the audio generated by the mobile phone 1 and the mobile phone 2 respectively. For example, the user can use the audio switching menu to set the target audio output device corresponding to the audio signal of mobile phone 1 to the external speaker A close to user A; and set the target audio output device corresponding to the audio signal of mobile phone 2 to the external speaker A close to user B Speaker B.

The smart TV can use the method described in the above embodiment to display the audio switching menu 1403 as shown in (b) in Figure 14, and the user can set the target audio output corresponding to the mobile phone 1 and/or the mobile phone 2 based on the audio switching menu 1403. equipment.

In the audio switching menu 1403 shown in (b) in Figure 14, the audio line X: Y in Y represents the number of sources in the multi-person projection mode, that is, the number of audio lines, each source device corresponds to one Audio line; X represents the label of a corresponding source and audio line. The source and audio lines can be numbered in a preset order.

In some embodiments, the source/audio lines may be numbered according to the sequence of screen projection. For example, the mobile phone 1 and its audio line (such as the first audio) that first projected to the smart TV corresponds to 1:2; the mobile phone 2 and its audio line (such as the second audio) which projected to the smart TV later corresponds to 2:2.

In other embodiments, the source and audio lines are numbered according to the position of the projection area. For example, the mobile phone 1 and its audio line corresponding to the projection area on the left correspond to 1:2; the mobile phone 2 and its audio line corresponding to the projection area on the right correspond to 2:2.

Based on the user settings shown in (b) in FIG. 14, the screen projection scene diagram corresponding to the mobile phone 1 and the mobile phone 2 can be seen in (c) in FIG. 14.

In some other embodiments, the smart TV can learn the device information of the screen projection source, such as the device type or model. The smart TV can display an audio switching menu according to the user's instructions, and the audio switching menu displays device information of multiple source devices. The user can set one or more target audio output devices corresponding to the source device according to the device information.

In some other embodiments, the smart TV can also set target audio output devices of different source devices according to different instructions from the user. For example, the smart TV detects that the user selects the first projection area through the remote control and displays a corresponding interface, so that the user can set the target audio output device of the source device corresponding to the first projection area. The smart TV detects that the user selects the second projection area through the remote control and displays a corresponding interface so that the user can set the target audio output device of the source device corresponding to the second projection area.

Illustratively again, parents and children use mobile phone 1 and mobile phone 2 to cast screens to watch movies and cartoons on a smart TV. The smart TV can play the audio of the cartoon corresponding to the mobile phone 2 locally according to the user's instruction; and control the mobile phone 1 to play the audio of the movie corresponding to the mobile phone 1 at the source end. Parents can listen to the audio content of the movie through the earphone connected to the mobile phone 1 .

Illustratively again, user A and user B use mobile phone 1 and mobile phone 2 to cast screens to watch MVs and learn videos on a smart TV, respectively. The smart TV can control the smart TV to play the audio of the MV corresponding to mobile phone 1 through high-quality external speakers according to the user's instructions, and control mobile phone 2 to play the audio of the learning video corresponding to mobile phone 2 at the source end. User B can connect to mobile phone 2 through Headphones to listen to the audio content of the learning video.

As another example, the user A and the user B use the mobile phone 1 and the mobile phone 2 to cast screens to the smart TV to watch the learning video. The smart TV can control mobile phone 1 and mobile phone 2 to play audio at the source according to the user's instructions. User A and user B listen to the audio content of the learning video through headphones connected to mobile phone 1 and mobile phone 2 to avoid mutual interference.

In some other embodiments, the smart TV can also set or switch the target audio output device of the mobile phone 1 and/or the mobile phone 2 respectively according to the user's voice instructions or preset gestures.

In this way, during the screen projection process, the user can instruct the smart TV to switch the target audio output device of the mobile phone 1 and the mobile phone 2 at any time according to the needs of the scene, their own usage habits, protection of privacy or avoiding interference with others and other factors. The smart TV can switch to use different target audio output devices in real time according to the user's instructions to play the audio shared by different sources during the screen projection process, and uniformly control the target audio output devices corresponding to different sources, so as to make full use of the different sound quality in the environment. Sound effects, different locations, different power consumption, or different power consumption and other characteristics of the external audio device to play the audio shared by the mobile phone, which can improve the selectivity of audio output devices, increase the flexibility of audio output, and improve the user's audio playback experience.

When the smart TV is playing the audio shared by mobile phone 1 or mobile phone 2, if it involves user privacy or may disturb other people, the smart TV can switch to mobile phone 1 or mobile phone 2 for playback at any time according to the user's instructions, thereby protecting the user Privacy to avoid causing interference to others.

In addition, in the multi-person projection mode, if the existing technology is adopted, each mobile phone needs to be individually controlled at the local end to choose whether to play audio at the local source end or play audio on the smart TV. If multiple terminals choose to play audio on a smart TV, the smart TV will mix and play multiple audio signals corresponding to multiple mobile phones. It is difficult for users to distinguish different audio signals from different mobile phones, and the user experience is poor. In order to prevent the smart TV from performing audio mixing processing, the smart TV can only play one audio signal. However, multiple mobile phones do not know each other's screen projections, so it is difficult to coordinate, and it is difficult to achieve the purpose of playing only one audio signal on the smart TV side and other audio signals on the mobile phone. For example, users of multiple mobile phones need to negotiate with each other to determine a mobile phone that uses a smart TV to play audio signals, and control other mobile phones to play audio locally.

Moreover, in the multi-person screen projection mode, using the method provided in the embodiments of the present application, the smart TV can be uniformly controlled and coordinated to set corresponding target audio output devices for the audio shared by different mobile phones. Therefore, each audio signal corresponding to each source device can have a corresponding target audio output device. Different audio signals can be played through different audio output devices in different locations, and different audio signals can be mixed without the projection device, and the user's hearing experience is better.

Similar to the single-person projection mode, the smart TV can also automatically determine the target audio output devices corresponding to the mobile phone 1 and the mobile phone 2 according to the switching rules in the multi-person projection mode. The switching rule may include the trigger condition, the corresponding relationship between the source/audio line, and the target audio output device. In this way, the smart TV can automatically control the switching of target audio output devices corresponding to different sources according to the switching rules, thereby reducing user operations, freeing users' hands, and improving user experience.

In some embodiments, the mobile phone 1 and the mobile phone 2 may use the same switching rule. In some technical solutions, the target audio output devices corresponding to different source terminals specified in the switching rules may be different, so that audio mixing caused by conflicts between audio output devices corresponding to different mobile phones can be avoided. The audio of different sources is output on different audio output devices, which can make the user's auditory resolution higher and the user experience higher.

In the multi-person projection mode, the smart TV can also set switching rules according to the user's instructions. Exemplarily, the corresponding rule setting menu in the multi-person projection mode may be as shown in (a) in FIG. 15. Different from the single-player projection mode, when the user sets the switching rules in the multi-player projection mode, as shown in (a) in Figure 15, it is necessary to set the trigger conditions and destinations of the multi-channel audio corresponding to multiple sources. Audio output device and other information. It is understandable that one trigger condition can trigger one source device to switch the target audio output device, or multiple source devices to switch the target audio output device.

In some embodiments, when the user sets the switching rule, if the smart TV determines that different sources correspond to the same target audio output device, the smart TV may prompt the user that the current settings may be mixed, so as to facilitate the user to modify in time.

In the multiplayer screencast mode, the user can also view the specific content of the switching rule. Exemplarily, the rule view menu can refer to (b) in FIG. 15. As shown in (b) of FIG. 15, the specific content of the switching rule may include information such as trigger conditions and target audio output devices corresponding to multiple audio channels corresponding to multiple sources respectively.

In other embodiments, the mobile phone 1 and the mobile phone 2 may adopt different handover rules respectively. In this way, different mobile phone users can set or enable different switching rules that meet their own usage habits or business scenarios to output audio, so as to improve user experience. Exemplarily, the rule setting menu of the smart TV setting the switching rule corresponding to the mobile phone 1 can be seen in (a) in FIG. 16; the rule setting menu of the smart TV setting the switching rule corresponding to the mobile phone 2 can be seen in the (b) of FIG. 16.

That is to say, in the multi-person projection mode, the smart TV can automatically control the switching of target audio output devices corresponding to different sources according to the switching rules, thereby reducing user operations, freeing users' hands, and improving user experience.

Moreover, in the multi-person projection mode, the smart TV can automatically and uniformly match, control and coordinate to set the corresponding target audio output devices for the audio shared by different mobile phones, instead of requiring mobile phones as in the prior art1 Users of mobile phone 2 and mobile phone 2 respectively perform settings on the mobile phone side. Therefore, each audio signal corresponding to each source device can have a corresponding target audio output device. Different audio signals can be played through different audio output devices in different locations, and different audio signals can be mixed without the projection device, and the user's hearing experience is better. In addition, smart TVs can make full use of external audio devices with different sound quality, different sound effects, different locations, different power consumption, or different power levels in the environment to play audio shared by mobile phones, which can increase the selectivity of audio output devices and improve audio The flexibility of output improves the user's audio playback experience.

In addition, in the multi-person projection mode, the smart TV may not be connected to an external audio device. In this case, the target audio output device can be a smart TV or a source, but cannot be an external audio device of the smart TV. The smart TV can uniformly control the audio output devices corresponding to multiple sources without requiring users to operate on their respective sources.

When an external audio device is not connected, in order to improve the visual experience, users usually do not want the smart TV to perform audio mixing. Therefore, usually only one source end's audio is played on the smart TV side, and the other source ends need to be played on their respective local ends. At this time, the smart TV can determine that a channel of audio corresponding to one source is played on the smart TV according to the user's instructions or switching rules, and send control commands to other sources to instruct the other sources to play audio on their local ends, thereby The audio playback conditions of multiple sources can be coordinated in a unified manner to avoid conflicts caused by multiple sources playing on the smart TV. This solution does not need to control the respective target audio output devices individually, multiple times, and separately at each mobile phone source as in the prior art, and requires each mobile phone user to negotiate to avoid multiple sources playing audio on the smart TV side. Conflict.

That is to say, even if the smart TV does not have an external audio device, the smart TV can also perform unified control and coordination, select one audio signal for playback, and uniformly control the other audio signals for playback on the source device; instead of the existing technology, It needs to be operated and controlled separately on the side of each source end device; therefore, the control process can be simplified, and all source end devices can be coordinated uniformly, saving user operations and improving user experience.

The above description is based on an example in which both the smart TV and the source mobile phone display the interface of the mobile phone after the screen projection is turned on. In some other embodiments, after the screen projection is turned on, the source mobile phone can transfer the subsequently generated interface to the smart TV for display, and the mobile phone no longer displays the subsequently generated interface, and can stop the screen or display the preset specific interface ( For example, including simple interfaces such as controls to stop the screen projection), to save the power consumption of the mobile phone and extend the battery life of the mobile phone. After the phone stops screencasting, the interface display is restored.

In some other embodiments, after the screen projection is turned on, the source mobile phone can transfer the subsequently generated interface to the smart TV for display, and the mobile phone no longer displays the interface by default, so as to save the power consumption of the mobile phone and extend the battery life of the mobile phone. After the mobile phone detects the preset event, the interface corresponding to the preset event is simultaneously displayed on the mobile phone side. After the preset event ends, the mobile phone stops displaying the user interface that changes in real time. For example, the preset event may be an event with high privacy such as an incoming call or a video call.

The above description is based on an example in which the smart TV controls and switches the target audio output device corresponding to the source end during the screen projection process. In some other embodiments of the present application, during the screen projection process, the smart TV can also control and switch the target interface output device corresponding to the source end. Among them, the target interface output device can be switched between the source, smart TV, or external video device. Exemplarily, the external video device may be a device capable of displaying images, such as a projector, a notebook computer, or a desktop computer.

For example, after starting the screen projection, the smart TV can switch the target interface output device corresponding to the source end according to the user's instruction or switching rule.

Exemplarily, the smart TV can switch the interface output device from the smart TV to the source according to the user's instructions through the remote control.

For another example, the source mobile phone is playing a movie, and the smart TV simultaneously displays an interface for playing the movie. Movie playback applications can recognize content such as highlights or horror clips. The image data sent by the mobile phone to the smart TV may include key point information or highlight segment information or horror segment information of the movie screen. According to the image data, the smart TV determines that the interface to be displayed is a horror picture, and when a child is detected in front of the smart TV through the camera, it is determined to stop playing the movie picture on the smart TV according to the switching rule, and the picture is played on the mobile phone. After the horror screen is played, the smart TV can resume displaying the interface generated by the source mobile phone during the screen projection process.

For another example, after the smart TV detects the video call, it is determined according to the switching rules to stop displaying the interface shared by the source end and stop playing the audio, and switch both the interface and audio back to the source mobile phone for display and playback, which is more suitable for users. Habits, it is convenient for users to move to a more suitable place to make calls, protect user privacy, and improve user experience. After the video call ends, the smart TV resumes displaying the interface shared by the source terminal and resumes audio playback.

The above description is mainly based on the example that the source device is a mobile phone and the screen projection device is a smart TV. During the screen projection process, when the source device or the screen projection device is another device, the method provided in the embodiment of this application can still be used to switch the audio output device or the interface output device, which will not be repeated here.

In combination with the above-mentioned embodiments and related drawings, this embodiment provides a method for switching audio output devices, which can be implemented in a projection device (such as a smart TV or a projector, etc.) as shown in Figure 1-Figure 2 . The electronic device can be connected to at least one external audio device. As shown in Figure 17, the method may include the following steps:

1701. The electronic device receives screen projection operations from a first source device and a second source device respectively.

Exemplarily, the electronic device may be a smart TV, the first source device may be a mobile phone 1, and the second source device may be a mobile phone 2. Mobile phone 1 and mobile phone 2 can respectively scan the screen projection QR code shown in Figure 12 to initiate a screen projection operation to the smart TV; the smart TV receives the screen projection operation initiated by mobile phone 1 and mobile phone 2 respectively, so that it can be used in the subsequent screen projection process Display the content shared by mobile phone 1 and mobile phone 2.

1702. The electronic device respectively receives first image data from a first source device and second image data from a second source device, where the first image data is data corresponding to the first interface of the first source device; The image data is data corresponding to the second interface of the second source device.

Exemplarily, when the electronic device is a smart TV, the first source device is the mobile phone 1, and the second source device is the mobile phone 2, the smart TV can receive the image data of the interface to be displayed sent by the mobile phone 1, and receive the mobile phone 2 Send the image data of the interface to be displayed.

1703. The electronic device displays the first interface and the second interface in the first projection area and the second projection area, respectively, according to the first image data and the second image data.

Exemplarily, the first interface may refer to the interface 1401 shown in (a) in FIG. 14, and the second interface may refer to the interface 1402 shown in (b) in FIG. 14.

The output device of the first audio generated by the first source device during the projection process is the first audio output device; the output device of the second audio generated by the second source device during the projection process is the second audio output equipment.

1704. If the electronic device determines that the first condition is met, the electronic device sets the first audio output device as the third audio output device.

The third audio output device is any one of the first source device, electronic device, or external audio device, and the third audio output device is different from the first audio output device. For example, if the third audio output device is an external audio device, the electronic device forwards the audio data from the first source device to the external audio device, so that the external audio device plays the first audio.

Exemplarily, when the electronic device is a smart TV, the first source device is mobile phone 1, and the second source device is mobile phone 2, the first audio output device may be a smart TV, and the third audio output device may be a mobile phone 1.

1705. If the electronic device determines that the second condition is met, the electronic device sets the second audio output device as the fourth audio output device.

The fourth audio output device is any one of a second source device, an electronic device, or an external audio device, and the fourth audio output device is different from the second audio output device. For example, if the fourth audio output device is an external audio device, the electronic device forwards the audio data from the second source device to the external audio device, so that the external audio device plays the second audio.

Exemplarily, the electronic device may be a smart TV, the first source device is mobile phone 1, and the second source device is mobile phone 2, the second audio output device may be mobile phone 2, and the fourth audio output device may be External speakers for smart TVs.

In some embodiments, determining that the electronic device satisfies the first condition includes: the electronic device detects a first instruction operation of the user, and the first instruction operation is used to instruct the output device of the first audio to be the third audio output device. The electronic device determining that the second condition is satisfied includes: the electronic device detects a second instruction operation of the user, and the second instruction operation is used to instruct to set the second audio output device as the fourth audio output device.

In this solution, the electronic device can switch the output device of the first audio of the first source device and/or switch the audio output device of the second audio of the second source device according to the instruction of the user, so that the electronic device can The audio output device of each source device is controlled uniformly.

In other embodiments, determining that the electronic device satisfies the first condition includes: the electronic device determines that the output device of the first audio is the third audio output device according to the switching rule. The electronic device determining that the second condition is satisfied includes: the electronic device determines that the output device of the second audio is the fourth audio output device according to the switching rule.

In this solution, the electronic device can automatically switch the audio output device of the first audio of the first source device and/or switch the audio output device of the second audio of the second source device according to the switching rule, so as to pass the electronic device The audio output device of each source device is automatically controlled in a unified manner, saving user operations and improving user experience.

It can be understood that, in order to realize the above-mentioned functions, the screen projection device includes hardware and/or software modules corresponding to each function. In combination with the algorithm steps of the examples described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Those skilled in the art can use different methods for each specific application in combination with the embodiments to implement the described functions, but such implementation should not be considered as going beyond the scope of the present application.

In this embodiment, the screen projection device can be divided into functional modules according to the above method examples. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.

An embodiment of the present application also provides an electronic device including one or more processors and one or more memories. The one or more memories are coupled with one or more processors, and the one or more memories are used to store computer program codes. The computer program codes include computer instructions. When the one or more processors execute the computer instructions, the electronic device executes The steps of the screen projection device in the foregoing method embodiment realize the foregoing method of switching audio output devices.

The embodiments of the present application also provide a computer-readable storage medium that stores computer instructions, and when the computer instructions run on the screen projection device, the screen projection device executes the above-mentioned related method steps to achieve the above The method of switching audio output devices in the embodiment.

The embodiments of the present application also provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the above-mentioned related steps, so as to implement the method for switching the audio output device executed by the screen projection device in the above-mentioned embodiment.

In addition, the embodiments of the present application also provide a device. The device may specifically be a chip, component or module. The device may include a processor and a memory connected to each other. The memory is used to store computer execution instructions. When the device is running, The processor can execute the computer-executable instructions stored in the memory, so that the chip executes the method for switching the audio output device executed by the projection device in the foregoing method embodiments.

Among them, the electronic device, computer readable storage medium, computer program product, or chip provided in this embodiment are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the above provided The beneficial effects of the corresponding method will not be repeated here.

Another embodiment of the present application provides a communication system. The communication system may include the above-mentioned at least one source device, the above-mentioned screen projection device, and an external audio device of the screen projection device, which can be used to implement the above-mentioned method for switching audio output devices. .

Through the description of the above implementation manners, those skilled in the art can understand that for the convenience and conciseness of the description, only the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be assigned to different functions as required. The function module is completed, that is, the internal structure of the device is divided into different function modules to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed device and method may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be It can be combined or integrated into another device, or some features can be omitted or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and the parts displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. . Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product, and the software product is stored in a storage medium. It includes several instructions to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

The above content is only the specific implementation of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Covered in the scope of protection of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

A method for switching audio output devices, applied to an electronic device, the electronic device is connected with at least one external audio device, characterized in that the method includes:

The electronic device receives screen projection operations from the first source device and the second source device respectively;

The electronic device receives first image data from the first source device and second image data from the second source device respectively, and the first image data is the first image data of the first source device. Data corresponding to an interface; the second image data is data corresponding to the second interface of the second source device;

The electronic device displays the first interface and the second interface in a first projection area and a second projection area, respectively, according to the first image data and the second image data;

The output device of the first audio generated by the first source device during the screen projection process is a first audio output device; the output device of the second audio generated by the second source device during the screen projection process is Second audio output device;

If the electronic device determines that the first condition is met, the electronic device sets the output device of the first audio as a third audio output device; the third audio output device is the first source device, the Any one of the electronic device or the external audio device, and the third audio output device is different from the first audio output device;

If the electronic device determines that the second condition is met, the electronic device sets the second audio output device as a fourth audio output device; the fourth audio output device is the second source device, the Any one of the electronic device or the external audio device, and the fourth audio output device is different from the second audio output device.
The method according to claim 1, wherein the determining that the electronic device satisfies the first condition comprises:

The electronic device detects a user's first instruction operation, where the first instruction operation is used to instruct to set the first audio output device as the third audio output device;

The electronic device determining that the second condition is satisfied includes:

The electronic device detects a second instruction operation of the user, and the second instruction operation is used to instruct to set the second audio output device as the fourth audio output device.
The method according to claim 2, wherein the first instruction operation and the second instruction operation are operations performed by the user through an input device or voice instruction operations; the input device includes a remote control, Either touch screen, mouse or keyboard.
The method according to claim 2 or 3, wherein before the electronic device detects the first instruction operation or the second instruction operation, the method further comprises:

The electronic device displays a control menu after detecting the user's operation on the preset control on the input device, and the control menu includes an audio switching control;

After the electronic device detects that the user selects the audio switching control, display an audio switching menu;

The first instruction operation is an operation of the user selecting the third audio output device for the first audio of the first source device based on the audio switching menu;

The second instruction operation is an operation of the user selecting the fourth audio output device for the second audio of the second source device based on the audio switching menu.
The method according to any one of claims 1-4, wherein the first interface is a first game interface from the first source device, and the second interface is a game interface from the second source. The second game interface of the terminal device, the third audio output device is the first speaker in the at least one external audio device, and the fourth audio output device is the second speaker in the at least one external audio device.
The method according to claim 1, wherein the determining that the electronic device satisfies the first condition comprises:

Determining, by the electronic device, that the output device of the first audio is the third audio output device according to the switching rule;

The electronic device determining that the second condition is satisfied includes:

The electronic device determines that the output device of the second audio is the fourth audio output device according to the switching rule.
The method according to claim 6, wherein the switching rule comprises a corresponding relationship between a first trigger condition and a target audio output device of the first source device; and a second trigger condition and the first Correspondence between target audio output devices of two source devices; the first trigger condition and the second trigger condition include at least one of a trigger time, a trigger event, or a trigger scenario;

The electronic device determining that the output device of the first audio is the third audio output device according to the switching rule includes:

After detecting the first trigger condition, the electronic device determines, according to the switching rule, that the target audio output device of the first source device is the third audio output device;

The electronic device determining that the output device of the second audio is the fourth audio output device according to the switching rule includes:

After detecting the second trigger condition, the electronic device determines that the target audio output device of the second source device is the fourth audio output device according to the switching rule.
The method according to claim 7, wherein the first trigger condition includes a trigger event, the trigger event includes a call event, and the electronic device determines according to the handover rule after detecting the call event The target audio output device of the first source device is the first source device;

Alternatively, the first trigger condition includes a trigger event, and the trigger event includes a call end event. After detecting the call end event, the electronic device determines the value of the first source device according to the switching rule. The target audio output device is the electronic device.
The method according to claim 7 or 8, wherein the method further comprises:

The electronic device detects the user's operation on the preset control on the input device;

The electronic device displays a control menu, and the control menu includes a rule setting menu;

The electronic device generates a new switching rule according to the user's operation on the rule setting menu.
The method according to claim 9, wherein the control menu further comprises a switching rule list, and the switching rule list includes at least one rule control; the method further comprises:

The electronic device detects that the user selects the operation of the rule control of the first switching rule;

The electronic device displays a rule view menu corresponding to the first switching rule, and the rule view menu includes rule content of the first switching rule, enable/stop enable control, and return control.
An electronic device connected with at least one external audio device, characterized in that it comprises:

Screen, used to display the interface;

Audio player, used to play audio;

One or more processors;

And a memory, in which code is stored;

When the code is executed by the one or more processors, the electronic device is caused to execute the following steps:

Receiving screen projection operations from the first source device and the second source device respectively;

Receive first image data from the first source device and second image data from the second source device respectively, where the first image data is corresponding to the first interface of the first source device Data; the second image data is data corresponding to the second interface of the second source device;

Displaying the first interface and the second interface in a first projection area and a second projection area, respectively, according to the first image data and the second image data;

Wherein, the output device of the first audio generated by the first source device in the screen projection process is a first audio output device; the output device of the second audio generated by the second source device in the screen projection process is Second audio output device;

If it is determined that the first condition is met, the output device of the first audio is set as a third audio output device; the third audio output device is the first source device, the electronic device, or the external audio Any one of the devices, and the third audio output device is different from the first audio output device;

If it is determined that the second condition is met, the second audio output device is set as a fourth audio output device; the fourth audio output device is the second source device, the electronic device, or the external audio Any one of the devices, and the fourth audio output device is different from the second audio output device.
The electronic device according to claim 11, wherein the determining that the first condition is satisfied comprises:

A first instruction operation of the user is detected, where the first instruction operation is used to instruct to set the first audio output device as the third audio output device;

The determining that the second condition is satisfied includes:

A second instruction operation of the user is detected, and the second instruction operation is used to instruct to set the second audio output device as the fourth audio output device.
The electronic device according to claim 12, wherein the first instruction operation and the second instruction operation are operations performed by the user through an input device or voice instruction operations; the input device includes a remote control , Touch screen, mouse or keyboard.
The electronic device according to claim 12 or 13, wherein when the code is executed by the one or more processors, the electronic device further causes the electronic device to perform the following steps:

Before detecting the first instruction operation or the second instruction operation, display a control menu after detecting the user's operation on a preset control on the input device, the control menu including an audio switching control;

After detecting that the user selects the audio switching control, display an audio switching menu;

The first instruction operation is an operation of the user selecting the third audio output device for the first audio of the first source device based on the audio switching menu;

The second instruction operation is an operation for the user to select the fourth audio output device for the second audio of the second source device based on the audio switching menu.
The electronic device according to claim 11, wherein the determining that the first condition is satisfied comprises:

Determine, according to a switching rule, that the output device of the first audio is the third audio output device;

The determining that the second condition is satisfied includes:

It is determined that the output device of the second audio is the fourth audio output device according to the switching rule.
The electronic device according to claim 15, wherein the switching rule comprises a corresponding relationship between a first trigger condition and a target audio output device of the first source device; and a second trigger condition and the target audio output device; The corresponding relationship between the target audio output devices of the second source device; the first trigger condition and the second trigger condition include at least one of a trigger time, a trigger event, or a trigger scenario;

The determining that the output device of the first audio is the third audio output device according to the switching rule includes:

After detecting the first trigger condition, determine the target audio output device of the first source device as the third audio output device according to the switching rule;

The determining that the output device of the second audio is the fourth audio output device according to the switching rule includes:

After the second trigger condition is detected, it is determined according to the switching rule that the target audio output device of the second source device is the fourth audio output device.
The electronic device according to claim 16, wherein the first trigger condition includes a trigger event, the trigger event includes a call event, and the electronic device detects the call event according to the switching rule The determined target audio output device of the first source device is the first source device;

Alternatively, the first trigger condition includes a trigger event, and the trigger event includes a call end event. After detecting the call end event, the electronic device determines the value of the first source device according to the switching rule. The target audio output device is the electronic device.
The electronic device according to claim 16 or 17, wherein when the code is executed by the one or more processors, the electronic device further causes the electronic device to perform the following steps:

It is detected that the user's operation on the preset control on the input device is detected;

Display a control menu, the control menu including a rule setting menu;

According to the user's operation on the rule setting menu, a new switching rule is generated.
The electronic device according to claim 18, wherein the control menu further comprises a switching rule list, and the switching rule list includes at least one rule control; when the code is executed by the one or more processors , And also causes the electronic device to perform the following steps:

The operation of the rule control of the first switching rule selected by the user is detected;

A rule view menu corresponding to the first switching rule is displayed, and the rule view menu includes rule content of the first switching rule, enable/stop enable control, and return control.
The electronic device according to any one of claims 11-19, wherein the electronic device is a TV or a projector.
A computer-readable storage medium, characterized by comprising computer instructions, when the computer instructions run on an electronic device, cause the electronic device to execute the switching audio output according to any one of claims 1-10 Method of equipment.
A computer program product, characterized in that, when the computer program product runs on a computer, the computer is caused to execute the method for switching audio output devices according to any one of claims 1-10.