WO2020134756A1

WO2020134756A1 - Call making method and related device

Info

Publication number: WO2020134756A1
Application number: PCT/CN2019/120044
Authority: WO
Inventors: 张斌; 蒲辉
Original assignee: 华为技术有限公司
Priority date: 2018-12-28
Filing date: 2019-11-21
Publication date: 2020-07-02
Also published as: CN111385513B; CN111385513A; CN113612957B; CN113612957A

Abstract

The present application provides a call making method, device, and system. The method comprises: a first mobile terminal stops acquiring audio data and/or video data, and receives audio data and/or video data acquired by a first external device, the audio acquisition capability of the first external device being superior to the audio acquisition capability of the first mobile terminal, and/or the video acquisition capability of the first external device being superior to the video acquisition capability of the first mobile terminal, the audio acquisition capability being affected by an audio acquisition parameter, the audio acquisition parameter comprising one or more of sensitivity, frequency response characteristics, and directivity, the video acquisition capability being affected by a video acquisition parameter, and the video acquisition parameter comprising one or more of resolution, color space, frame rate, color fidelity, texture fidelity, denoising, dynamic speed, photosensitive component, and lens; the first mobile terminal sends the audio data and/or video data acquired by the first external device to a second mobile terminal by means of session.

Description

Call method and related equipment

This application requires the priority of the Chinese patent application submitted to the State Intellectual Property Office of China on December 28, 2018, with the application number 201811622216.6 and the invention name "call method and related equipment", the entire content of which is incorporated by reference in this application .

Technical field

The present application relates to the field of terminals, in particular to a call method, related equipment and system.

Background technique

Audio and video calls generally refer to communication methods based on the Internet and mobile Internet, where audio data and video data are transferred in real time between the mobile terminal and the mobile terminal. Audio and video calls have brought great changes to people's lives. For example, loved ones can communicate through audio and video calls anytime and anywhere, and R&D personnel can discuss technical solutions through audio and video calls. The birth of audio and video calls has greatly improved the work efficiency of the entire society and has a major impact on people's lives.

However, the volume of the mobile terminal is usually relatively small, and due to the limitation of the volume, the capability of the audio and video equipment of the mobile terminal is usually relatively weak, which affects the effect of audio and video calls.

Summary of the invention

This application provides a call method and related equipment, which can effectively improve the effect of audio and video calls.

In the first aspect, a call method is provided, including the following steps:

During the conversation between the first mobile terminal and the second mobile terminal through the conversation, the first mobile terminal stops receiving audio data and/or video data, and receives audio data and/or video data collected by the first external device. The audio acquisition capability of the first external device is superior to the audio acquisition capability of the first mobile terminal, and/or the video acquisition capability of the first external device is superior to the video acquisition capability of the first mobile terminal; The audio acquisition capability is affected by audio acquisition parameters, which include: one or more of sensitivity, frequency response characteristics, and directivity; the video acquisition capability is affected by video acquisition parameters, and the video acquisition parameters include : One or more of resolution, color space, frame rate, color reproduction, texture restoration, denoising, dynamic speed, photosensitive parts and lens;

The first mobile terminal sends the audio data and/or video data collected by the first external device to the second mobile terminal through the session.

In some possible designs, when the signal strength of the first external device is less than the signal strength of the second external device, the first mobile terminal stops receiving audio data and/or video data collected by the first external device And receive audio data and/or video data collected by the second external device, wherein the audio collection capability of the second external device is superior to the audio collection capability of the first mobile terminal, and/or, the The video acquisition capability of the second external device is superior to the video acquisition capability of the first mobile terminal.

In some possible designs, when the first mobile terminal and the first external device are located in the same local area network, the first mobile terminal sends multicast information in the local area network, where the multicast The information is used to instruct the external device that received the multicast message to send a first response message to the first mobile terminal;

The first mobile terminal receives a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, and the first response message carries Audio acquisition parameters and/or video acquisition parameters of the first external device, the first response message also carries address information of the first external device;

When receiving the first response, the first mobile terminal establishes a data transmission channel with the first external device according to the address information,

Determining that the audio collection capability of the first external device is superior to the audio collection capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to the video collection capability of the first mobile terminal In the case of capability, the first mobile terminal stops receiving audio data and/or video data, and receives audio data and/or video data collected by the first external device.

In some possible designs, in the case where the first mobile terminal is a wireless direct-connected device, the first mobile terminal sends a broadcast message, where the broadcast message is used to indicate that the broadcast message is received The external device sends a second response message to the first mobile terminal;

When receiving the second response message, the first mobile terminal establishes a data transmission channel with the first external device, where the first external device belongs to the receiver that received the broadcast message external device;

Receiving, by the first mobile terminal, audio acquisition parameters and/or video acquisition parameters of the first external device sent by the first external device through the data transmission channel;

In some possible designs, in a case where the first mobile terminal and the first external device are respectively located in different local area networks, the first mobile terminal sends a request message to a central server, where the central server and The first external device is located in the same local area network, the central server stores audio acquisition parameters and/or video acquisition parameters of the first external device, and the central server also stores address information of the first external device, The request message is used to request audio acquisition parameters and/or video acquisition parameters of the first external device, and the request message is also used to request address information of the first external device;

The first mobile terminal receives a third response message sent by the central server, where the third response message includes audio collection parameters and/or video collection parameters of the first external device, and the third response message further includes Address information of the first external device;

When receiving the third response message, the first mobile terminal establishes a data transmission channel with the first external device according to the address information;

During a conversation between the first mobile terminal and the second mobile terminal through a conversation, if the audio collection capability of the first external device is better than the audio collection capability of the first mobile terminal, and/or, the first external terminal The video collection capability of the device is better than that of the first mobile terminal, so the first terminal device can use the first external device to collect audio data and/or video data, thereby improving the effect of audio and video calls.

In a second aspect, a call method is provided, which includes the following steps:

During a conversation between the first mobile terminal and the second mobile terminal in a conversation, the first mobile terminal receives audio data and/or video data sent by the second mobile terminal through the conversation, wherein the The audio playback capability is superior to the audio playback capability of the first mobile terminal, and/or the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal; the audio playback capability is affected by audio Playback parameters, the audio playback parameters include: one or more of frequency response range, impedance size, distortion level, sensitivity, and signal-to-noise ratio; the video playback capability is affected by the video playback parameters, the video playback parameters Including: one or more of dot pitch, size, resolution, pixels, refresh speed and color;

The first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data and/or video data sent by the second mobile terminal through the session Sent to the first external device for the first external device to play.

In some possible designs, when the signal strength of the first external device is less than the signal strength of the second external device, the first mobile terminal stops sending audio data and/or video data to the first external device, And send audio data and/or video data to the second external device for playback by the second external device, wherein the audio playback capability of the second external device is superior to the audio of the first mobile terminal Playback capability, and/or, the video playback capability of the second external device is superior to the video playback capability of the first mobile terminal.

The first mobile terminal receives a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, and the first response message carries Audio playback parameters and/or video playback parameters of the first external device, the first response message also carries address information of the first external device;

Determining that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or that the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal In the case of capability, the first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data sent by the second mobile terminal through the session And/or video data is sent to the first external device.

Receiving, by the first mobile terminal, audio playback parameters and/or video playback parameters of the first external device sent by the first external device through the data transmission channel;

In some possible designs, in a case where the first mobile terminal and the first external device are respectively located in different local area networks, the first mobile terminal sends a request message to a central server, where the central server and The first external device is located in the same local area network, the central server stores audio playback parameters and/or video playback parameters of the first external device, and the central server also stores address information of the first external device, The request message is used to request audio playback parameters and/or video playback parameters of the first external device, and the request message is also used to request address information of the first external device;

The first mobile terminal receives a third response message sent by the central server, where the third response message includes audio playback parameters and/or video playback parameters of the first external device, and the third response message further includes Address information of the first external device;

During a conversation between the first mobile terminal and the second mobile terminal through a conversation, if the audio playback capability of the first external device is better than the audio playback capability of the first mobile terminal, and/or, the first external terminal The video playback capability of the device is better than the video playback capability of the first mobile terminal, so the first terminal device can use the first external device to play audio data and/or video data, thereby improving the effect of audio and video calls.

In a third aspect, a mobile terminal is provided, including a receiving module and a sending module,

The receiving module is used to stop receiving audio data and/or video data and receive audio data and/or video data collected by the first external device during the conversation between the first mobile terminal and the second mobile terminal through a conversation , The audio acquisition capability of the first external device is superior to the audio acquisition capability of the first mobile terminal, and/or the video acquisition capability of the first external device is superior to the video acquisition capability of the first mobile terminal The audio acquisition capability is affected by audio acquisition parameters, which include: one or more of sensitivity, frequency response characteristics, and directivity; the video acquisition capability is affected by video acquisition parameters, and the video acquisition The parameters include: one or more of resolution, color space, frame rate, color reproduction degree, texture restoration degree, denoising, dynamic speed, photosensitive parts and lens;

The sending module is configured to send the audio data and/or video data collected by the first external device to the second mobile terminal through the session.

In some possible designs, the receiving module is further configured to stop receiving audio data and/or video collected by the first external device when the signal strength of the first external device is less than the signal strength of the second external device Data and receive audio data and/or video data collected by the second external device, wherein the audio collection capability of the second external device is superior to the audio collection capability of the first mobile terminal, and/or The video acquisition capability of the second external device is superior to the video acquisition capability of the first mobile terminal.

In some possible designs, the mobile terminal further includes a processing module,

The sending module is further configured to send multicast information in the local area network when the first mobile terminal and the first external device are on the same local area network, wherein the multicast information is used to indicate that the The external device of the multicast message sends a first response message to the first mobile terminal;

The receiving module is further configured to receive a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, and the first response message carries The audio collection parameters and/or video collection parameters of the first external device, the first response message also carries the address information of the first external device;

The processing module is configured to establish a data transmission channel with the first external device according to the address information when the first response is received,

The receiving module is further configured to determine that the audio collection capability of the first external device is superior to the audio collection capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to the In the case of the video collection capability of the first mobile terminal, stop receiving audio data and/or video data, and receive audio data and/or video data collected by the first external device.

The sending module is used to send a broadcast message when the first mobile terminal is a wireless direct-connected device, wherein the broadcast message is used to instruct the external device that received the broadcast message to send the broadcast message to the first The mobile terminal sends a second response message;

The processing module is configured to establish a data transmission channel with the first external device when the second response message is received, wherein the first external device belongs to the receiver receiving the broadcast message external device;

The receiving module is configured to receive the audio collection parameters and/or video collection parameters of the first external device sent by the first external device through the data transmission channel;

The receiving module is configured to determine that the audio collection capability of the first external device is superior to the audio collection capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to the first In the case of a video collection capability of a mobile terminal, stop receiving audio data and/or video data, and receive audio data and/or video data collected by the first external device.

The sending module is configured to send a request message to a central server when the first mobile terminal and the first external device are respectively located in different local area networks, where the central server and the first external device are located In the same local area network, the central server stores audio acquisition parameters and/or video acquisition parameters of the first external device, the central server also stores address information of the first external device, and the request message is used to request Audio acquisition parameters and/or video acquisition parameters of the first external device, the request message is also used to request address information of the first external device;

The receiving module is configured to receive a third response message sent by the central server, where the third response message includes audio collection parameters and/or video collection parameters of the first external device, and the third response message further includes Address information of the first external device;

The processing module is used for the first mobile terminal to establish a data transmission channel with the first external device according to the address information when receiving the third response message;

According to a fourth aspect, a mobile terminal is provided, which includes a receiving module and a playing module,

The receiving module is configured to receive audio data and/or video data sent by the second mobile terminal through the session during a conversation between the first mobile terminal and the second mobile terminal through the session, wherein the first external device Audio playback capability is better than the audio playback capability of the first mobile terminal, and/or the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal; the audio playback capability Affected by audio playback parameters, the audio playback parameters include: one or more of frequency response range, impedance size, distortion level, sensitivity, and signal-to-noise ratio; the video playback capability is affected by the video playback parameters, the video Play parameters include: one or more of dot pitch, size, resolution, pixels, refresh speed and color;

The playing module is configured to stop playing audio data and/or video data sent by the second mobile terminal through the session, and to send audio data and/or video data sent by the second mobile terminal through the session Sent to the first external device for the first external device to play.

In some possible designs, the playback module is further configured to stop sending audio to the first external device when the signal strength of the first external device is less than the signal strength of the second external device Data and/or video data, and send audio data and/or video data to the second external device for playback by the second external device, wherein the audio playback capability of the second external device is better than all The audio playback capability of the first mobile terminal, and/or the video playback capability of the second external device is superior to the video playback capability of the first mobile terminal.

In some possible designs, the terminal further includes a sending module and a processing module,

The sending module is used to send multicast information in the local area network when the first mobile terminal and the first external device are on the same local area network, where the multicast information is used to indicate The external device for the multicast message sends a first response message to the first mobile terminal;

The receiving module is further configured to receive a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, and the first response message carries The audio playback parameters and/or video playback parameters of the first external device, the first response message also carries the address information of the first external device;

The playback module is further configured to determine that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or that the video playback capability of the first external device is superior to the In the case of the video playback capability of the first mobile terminal, stop playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio sent by the second mobile terminal through the session The data and/or video data is sent to the first external device.

The receiving module is configured to receive audio playback parameters and/or video playback parameters of the first external device sent by the first external device through the data transmission channel;

The sending module is configured to send a request message to a central server when the first mobile terminal and the first external device are respectively located in different local area networks, where the central server and the first external device are located In the same local area network, the central server stores audio playback parameters and/or video playback parameters of the first external device, the central server also stores address information of the first external device, and the request message is used to request Audio playback parameters and/or video playback parameters of the first external device, the request message is also used to request address information of the first external device;

The receiving module is configured to receive a third response message sent by the central server, where the third response message includes audio playback parameters and/or video playback parameters of the first external device, and the third response message further includes Address information of the first external device;

The processing module is configured to establish a data transmission channel with the first external device according to the address information when the third response message is received;

The playback module is used to determine that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or that the video playback capability of the first external device is superior to the first In the case of the video playback capability of a mobile terminal, stop playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data sent by the second mobile terminal through the session And/or video data is sent to the first external device.

According to a fifth aspect, a terminal device is provided, including: a processor and a memory, where the processor executes the code in the memory to perform the method according to any one of the first aspect or the second aspect.

According to a sixth aspect, a computer non-volatile storage medium is provided, which includes instructions, which when executed on a terminal device, causes the terminal device to perform any one of the first aspect or the second aspect Item.

According to a seventh aspect, a computer program product is provided, characterized in that when the computer program product is read and executed by a computer, the method according to any one of the first aspect or the second aspect will be executed.

In an eighth aspect, an apparatus is provided for use in a terminal device. The apparatus is coupled to a memory for reading and executing a software program stored in the memory, so that the terminal device implements the first aspect or the first The method of any one of the two aspects. Wherein, the device is a chip or an on-chip processing system.

BRIEF DESCRIPTION

In order to more clearly explain the technical solutions in the embodiments or the background technology of the present application, the drawings required in the embodiments or the background technology of the present application will be described below.

1A to 1B are schematic diagrams of some application scenarios involved in this application;

2A and 2B are schematic diagrams of an existing module of a first mobile terminal and a new module added to the existing module of the first mobile terminal;

FIG. 3A to FIG. 3B are schematic diagrams of some applications of the present application for improving the capabilities of the first mobile terminal by using the first external device;

4A to 4C are schematic flowcharts of establishing a data transmission path between some first mobile terminals and first external devices provided by this application;

5 is a schematic diagram of a first mobile terminal switching from a first external device to a second external device in this application;

6 is a schematic flowchart of a call method provided by this application;

7 is a schematic flowchart of another calling method provided by this application;

8 is a schematic structural diagram of a mobile terminal provided by this application;

9 is a schematic structural diagram of another mobile terminal provided by this application;

10 is a schematic diagram of the physical structure of a mobile terminal provided by this application.

detailed description

Taking a home scene as an example, as shown in FIGS. 1A and 1B, a user’s home usually has both a first mobile terminal that can move around with the user and a first external device installed at a fixed location. among them,

The first mobile terminal is usually small in size, easy for users to carry, and is provided with one or more terminal devices such as a mobile phone, a tablet computer, an audio collection device, an audio playback device, a video collection device, a video playback device, etc. Smart wearable devices, etc. However, limited by the volume of the first mobile terminal, the audio acquisition capability of the audio acquisition device on the first mobile terminal, the audio playback capability of the audio playback device, the video acquisition capability of the video acquisition device, and the video playback capability of the video playback device are usually Slightly inferior. As an example, the audio collection device on the first mobile terminal may include a small speaker on the first mobile terminal, and the audio playback device on the first mobile terminal may include a speaker on the first mobile terminal. The video acquisition device may include a camera on the first mobile terminal, and the video playback device on the first mobile terminal may include a display screen on the first mobile terminal, and so on. It should be understood that the above example is only an example, and should not constitute a specific limitation.

The first external device is usually relatively large in volume, and the user does not need to carry it frequently, and one or more terminal devices such as a television set, an audio collection device, an audio playback device, a video collection device, and a video playback device are provided. Audio, camera, projector, etc. Due to the relatively large size of the first external device, the audio acquisition capability of the audio acquisition device on the first external device, the audio playback capability of the audio playback device, the video acquisition capability of the video acquisition device, and the video playback capability of the video playback device are generally relatively good . For example, the audio capture device of the first external device may include a large microphone, the audio playback device of the first external device may include a speaker, the video capture device of the first external device may include a camera, and the video playback of the first external device The device may include a projector and the like. It should be understood that the above example is only an example, and should not constitute a specific limitation.

The first mobile terminal and the first external device may be connected by wireless local area network or wireless direct connection, etc., which is not specifically limited here.

The above application scenario is described by taking the family scenario as an example. However, in actual applications, the application scenario may also be an enterprise scenario, a hotel scenario, or other scenarios that have both the first mobile terminal and the first external device, and are not specifically limited here. .

The relationship between the audio acquisition capability of the audio acquisition device and the audio acquisition parameter, the relationship between the audio playback capability of the audio playback device and the audio playback parameter, the relationship between the video acquisition capability of the video acquisition device and the video acquisition parameter, and the relationship between the video playback device The relationship between video playback capabilities and video playback parameters is described in detail.

Audio acquisition devices have audio acquisition capabilities, and audio acquisition capabilities are usually affected by audio acquisition parameters of audio acquisition devices. Audio acquisition capabilities of audio acquisition devices are usually affected by audio acquisition parameters of audio acquisition devices. Here, the audio collection capability is the ability to convert the collected sound into a digital signal. The audio acquisition parameters of the audio acquisition device include: one or more of sensitivity, frequency response characteristics, and directivity. Among them, the higher the sensitivity of the audio collection device, the better the audio collection capability of the audio collection device. The flatter the frequency response characteristics of the audio acquisition device, the better the audio acquisition capability of the audio acquisition device. The stronger the directivity of the audio collection device, the better the audio collection capability of the audio collection device.

The audio playback device has audio playback capability, and the audio playback capability of the audio playback device is usually affected by the audio playback parameters of the audio playback device. Here, the audio playback capability is the ability to convert digital signals into sound. The audio playback parameters of the audio playback device include one or more of frequency response range, impedance size, distortion degree, sensitivity, and signal-to-noise ratio. Among them, the flatter the frequency response characteristics of the audio playback device, the better the audio playback capability of the audio playback device. The smaller the impedance of the audio playback device, the better the audio playback capability of the audio playback device. The smaller the degree of distortion of the audio playback device, the better the audio playback capability of the audio playback device. The higher the sensitivity of the audio playback device, the better the audio playback capability of the audio playback device. The higher the signal-to-noise ratio of the audio playback device, the better the audio playback capability of the audio playback device.

Video capture devices have video capture capabilities, and the video capture capabilities of video capture devices are usually affected by the video capture parameters of the video playback device. Here, the video acquisition capability is the ability to convert the collected light into a digital signal. The video capture parameters of the video capture device include: one or more of resolution, color space, frame rate, color reproduction degree, texture restoration degree, denoising, dynamic speed, photosensitive part and lens. Among them, the higher the resolution of the video capture device, the better the video capture capability of the video capture device. The wider the color space of the video capture device, the better the video capture capability of the video capture device. The higher the frame rate of the video capture device, the better the video capture capability of the video capture device. The higher the color reproduction of the video capture device, the better the video capture capability of the video capture device. The higher the degree of texture reduction of the video capture device, the better the video capture capability of the video capture device. The better the denoising of the video capture device, the better the video capture capability of the video capture device. The higher the dynamic speed of the video capture device, the better the video capture capability of the video capture device. The more sensitive the photosensitive component of the video capture device, the better the video capture capability of the video capture device. The larger the field angle of the lens of the video capture device, the larger the zoom factor, the greater the contrast, and the higher the resolution, the better the video capture capability of the video capture device.

Video playback devices have video playback capabilities, and the video playback capabilities of video players are generally affected by the video playback parameters of the video playback device. Here, the video playback capability is the ability to convert digital signals into digital images. The video playback parameters of the video playback device include: one or more of dot pitch, size, resolution, pixels, refresh speed, and color. Among them, the smaller the pitch of the video playback device, the better the video playback capability of the video acquisition device. The larger the size of the video playback device, the better the video playback capability of the video capture device. The higher the resolution of the video playback device, the better the video playback capability of the video capture device. The more pixels the video playback device has, the better the video playback capability of the video acquisition device. The faster the refresh rate of the video playback device, the better the video playback capability of the video capture device. The richer the color of the video playback device, the better the video playback capability of the video capture device.

It should be understood that the above examples of audio collection parameters, audio playback parameters, video collection parameters, and video playback parameters are merely examples, and should not constitute a specific limitation.

Since the audio acquisition capability, video acquisition capability, audio playback capability, and video playback capability of the first external device are generally better than the audio acquisition capability, video acquisition capability, audio playback capability, and video playback capability of the first mobile terminal, you can consider using The audio acquisition capability, video acquisition capability, audio playback capability, and video playback capability of the first external device improve the audio acquisition capability, video acquisition capability, audio playback capability, and video playback capability of the first mobile terminal.

In order to achieve the above purpose, the present application provides a first mobile terminal, which adds a new module to the existing mobile terminal, so that the audio data and video data collected by the first external device can be transmitted to the first The mobile terminal can also enable audio data and video data in the first mobile terminal to be transmitted to the first external device for playback.

2A and 2B, FIG. 2A is a module included in the existing mobile terminal, and FIG. 2B is a module included in the first mobile terminal. As shown in FIG. 2B, the first mobile terminal adds a new module on the basis of the existing mobile terminal, and the modules in the dotted frame in FIG. 2B are all new modules.

As shown in FIG. 2A, the existing mobile terminal includes an application layer, a development source code project framework, an external framework, a hardware abstraction layer, a kernel layer, and so on. Among them, the development source code project framework includes telephone application program interface, multimedia, view system, Internet of Things and so on. The external framework includes audio addition, fingerprint navigation, digital cinema system sound effects, private controls, and global search. The hardware abstraction layer includes audio, codec, display, LCD screen, camera and short distance. The kernel layer includes audio driver, wifi driver, display driver and camera driver. It can be understood that the existing module of the first mobile terminal may not change compared with the existing technology, and the description will not be made here.

As shown in FIG. 2B, in addition to the modules included in the existing mobile terminal shown in FIG. 2A, the first mobile terminal may also include: a virtual hardware service layer located in the external framework, a virtual hardware channel located in the external framework, and a The virtual hardware abstraction layer of the hardware abstraction layer and the virtual hardware driver at the kernel layer. Among them, the virtual hardware service layer is responsible for providing external interfaces and the implementation of device control instructions, such as turning on and off the device and so on. The virtual hardware channel is used to call the virtual hardware abstraction layer to provide methods to complete data processing. The virtual hardware abstraction layer is used for secondary processing of audio data and video data, for example, scaling, rotation, color space conversion and other operations. The virtual hardware driver is used to complete the device self-inspection and establish a virtual driver to satisfy the upper layer's call to the driver. The virtual hardware service layer includes a virtual camera interface, a virtual audio interface, and a virtual display interface. The virtual camera interface is used to provide an interface for processing a virtual camera, the virtual audio interface is used to provide an interface for processing a microphone and a speaker, and the virtual display interface is used to provide an interface for processing a virtual display screen. Virtual hardware channels include data link channels and data transmission channels. The data link channel is used to establish a connection with the first external device and receive audio data and/or video data sent by the first external device. The data transmission channel is used to send the preprocessed data to the graphics processor (graphics processing unit, GPU). The virtual hardware abstraction layer includes data preprocessing, data input and output, and effect enhancement. Data preprocessing is used to encode and decode data. Data input and output are used for data interaction with the upper layer, for example, to return the data pre-processed result to the upper layer. The effect enhancement is used to perform secondary processing on audio data and/or video data, for example, scaling, rotation, color space conversion and other operations.

Before adding a new module, the first mobile terminal can only receive audio data collected by its own audio collection device, receive video data collected by its own video collection device, and play the received audio data through its own audio playback device And play the received video data through its own video playback device. After adding a new module, the first mobile terminal can receive the audio data collected by the audio collection device of the first external device in addition to the audio data collected by its own audio collection device, in addition to receiving its own video collection In addition to the video data collected by the device, it can also receive the video data collected by the video collection device of the first external device. In addition to playing the received audio data through its own audio playback device, it can also receive the received The audio data is played through the audio player of the first external device. In addition to playing the received video data through its own video playback device, it can also play the received video data through the video player of the first external device .

It should be understood that the modules of the existing mobile terminal and the module of the first mobile terminal in the above example are only examples, and in actual applications, more or fewer modules may also be included, which are not specifically limited herein.

When the first mobile terminal is located at home and the second mobile terminal is located outdoors, the first mobile terminal and the second mobile terminal can talk through the session. The first mobile terminal may adopt the structure of the first mobile terminal in FIG. 2B. The second mobile terminal may adopt the structure of the existing mobile terminal in FIG. 2A or the structure of the first mobile terminal in FIG. 2B. The call between the first mobile terminal and the second mobile terminal may be an audio call, a video call, or an audio-video call, which is not specifically limited here. Here, the audio call means that only audio data is transmitted between the first mobile terminal and the second mobile terminal. Video call refers to the transmission of only video data between the first mobile terminal and the second mobile terminal. Audio and video calls refer to the simultaneous transmission of audio data and video data between the first mobile terminal and the second mobile terminal. In the above example, the first mobile terminal is located at home as an example for description. In practical applications, the first mobile terminal may also be located outdoors, which is not specifically limited here.

During the conversation between the first mobile terminal and the second mobile terminal through a conversation, if the first mobile terminal located at home and the first external device at home have established a data transmission channel, the first mobile with weak audio collection capability The terminal may use the first external device with strong audio collection capability to improve the audio collection effect of the first mobile terminal, and the first mobile terminal with weak audio playback capability may use the first external device with strong audio playback capability to improve the first The audio playback effect of the mobile terminal, the first mobile terminal with weak video acquisition capability can use the first external device with strong video acquisition capability to improve the video acquisition effect of the first mobile terminal, and the first mobile terminal with weak video playback capability The first external device with strong video playback capability may be used to improve the video playback effect of the first mobile terminal.

In the examples shown in FIG. 3A and FIG. 3B below, how to improve the audio collection capability, video collection capability, audio playback capability, and video playback capability of the first mobile terminal by using the first external device will be described in detail.

Corresponding to the application scenario shown in FIG. 1A, as shown in FIG. 3A, at the beginning of establishing a conversation between the first mobile terminal and the second mobile terminal for a call, the first mobile terminal can collect audio data through its own audio collection device, Collect video data through its own video capture device, and send the collected audio data and video data to the second mobile terminal device through the session. In addition, the first mobile terminal can receive the audio data sent by the second mobile terminal through the session through the session And video data, and play audio data through its own audio playback device and play video data through its own video playback device.

During the conversation between the first mobile terminal and the second mobile terminal through a conversation, if the first mobile terminal establishes a data transmission path with the first external device, and it is determined that the audio collection capability of the first external device is better than the The audio collection capability of the first mobile terminal, and, if the video collection capability of the first external device is better than the video collection capability of the first mobile terminal, the first mobile terminal stops collecting audio data and Collect video data through its own video collection device, and receive audio data collected by the audio collection device of the first external device and video data collected by the video collection device of the first external device.

Corresponding to the application scenario shown in FIG. 1B, as shown in FIG. 3B, at the beginning of establishing a conversation between the first mobile terminal and the second mobile terminal for the call, the first mobile terminal can collect audio data through its own audio collection device, Collect video data through its own video capture device, and send the collected audio data and video data to the second mobile terminal device through the session. In addition, the first mobile terminal can receive the audio data sent by the second mobile terminal through the session through the session And video data, and play audio data through its own audio playback device and play video data through its own video playback device.

During a conversation between the first mobile terminal and the second mobile terminal through a conversation, if the first mobile terminal establishes a data transmission path with the first external device, and it is determined that the audio playback capability of the first external device is better than the The audio playback capability of the first mobile terminal, and the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal, the first mobile terminal stops playing the second mobile terminal through the Audio data and/or video data sent by the session, and sending audio data and/or video data sent by the second mobile terminal through the session to the first external device for the first external Device to play.

It should be understood that the foregoing FIG. 3A and FIG. 3B are only used as a specific example, and should not constitute a specific limitation. For example, if there are multiple first external devices of the same type, the first mobile terminal may select the first external device with the strongest capability among the multiple first external devices to establish a data transmission path. For example, when the first external device includes a liquid crystal display and a liquid crystal display TV, the resolution of the liquid crystal display TV is greater than the resolution of the liquid crystal display, and therefore, the liquid crystal display TV may be preferentially selected to play video data. Alternatively, the first mobile terminal may select the first external device with the strongest signal among the plurality of first external devices to establish a data transmission path. For example, when the first external device includes a liquid crystal display and a liquid crystal display TV, the signal strength of the liquid crystal display TV is weaker than the signal strength of the liquid crystal display. Therefore, the liquid crystal display may be preferentially selected to play video data.

4A to 4C respectively introduce three ways of establishing a data transmission path between the first mobile terminal and the first external device, which will be described in detail below.

In the first way, the first mobile terminal and the first external device are located in the same local area network. As shown in FIG. 4A, the establishment of a data transmission path between the first mobile terminal and the first external device includes the following steps: S101: When the first mobile terminal and the first external device are on the same local area network, the first The mobile terminal sends multicast information in the local area network, where the multicast information is used to instruct an external device that receives the multicast message to send a first response message to the first mobile terminal. S102: The first mobile terminal receives a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, and the first response message Carrying the audio collection parameters and/or video collection parameters of the first external device, and the first response message also carries the address information of the first external device. S103: When receiving the first response, the first mobile terminal establishes a data transmission channel with the first external device according to the address information.

In the second way, the first mobile terminal and the first external device are connected by wireless direct connection. The wireless direct connection may include wifi direct connection and Bluetooth direct connection. As shown in FIG. 4B, the establishment of a data transmission path between the first mobile terminal and the first external device includes the following steps: S201: When the first mobile terminal is a wireless direct-connected device, the first mobile terminal sends a broadcast Message, wherein the broadcast message is used to instruct an external device that receives the broadcast message to send a second response message to the first mobile terminal. S202: When receiving the second response message, the first mobile terminal establishes a data transmission channel with the first external device, where the first external device belongs to the received broadcast The external device of the message. S203: The first mobile terminal receives the audio collection parameters and/or video collection parameters of the first external device sent by the first external device through the data transmission channel.

In a third manner, the first mobile terminal and the first external device are located in different local area networks. As shown in FIG. 4C, establishing a data transmission path between the first mobile terminal and the first external device includes the following steps: S301: In the case where the first mobile terminal and the first external device are located in different local area networks, respectively, the The first mobile terminal sends a request message to a central server, where the central server and the first external device are on the same local area network, and the central server stores the audio acquisition parameters and/or video acquisition parameters of the first external device , The central server also stores address information of the first external device, the request message is used to request audio collection parameters and/or video collection parameters of the first external device, and the request message is also used to request Address information of the first external device. S302: The first mobile terminal receives a third response message sent by the central server, where the third response message includes audio collection parameters and/or video collection parameters of the first external device, and the third response message It also includes address information of the first external device. S303: When receiving the third response message, the first mobile terminal establishes a data transmission channel with the first external device according to the address information.

It should be understood that the manner in which the first mobile terminal and the first external device shown in FIG. 4A to FIG. 4C establish a data transmission path is only used as some specific examples and should not constitute a specific limitation.

When the user moves at home with the first mobile terminal device (from the living room into the bedroom), the signal between the first mobile terminal and the first external device (located in the living room) gradually weakens, and the first mobile terminal and the second external device ( The signal between the bedrooms) gradually increases. At this time, the first mobile terminal may switch from the first external device to the second external device.

As shown in FIG. 5, when the signal strength of the first external device is less than the signal strength of the second external device, the first mobile terminal stops sending audio data and/or video data to the first external device, and Sending audio data and/or video data to the second external device for playback by the second external device, wherein the audio playback capability of the second external device is superior to the audio playback of the first mobile terminal Capability, and/or, the video playback capability of the second external device is superior to the video playback capability of the first mobile terminal.

In the case where the signal strength of the first external device is less than the signal strength of the second external device, the first mobile terminal stops receiving audio data and/or video data collected by the first external device and receives the second Audio data and/or video data collected by an external device, wherein the audio collection capability of the second external device is superior to the audio collection capability of the first mobile terminal, and/or, the video collection of the second external device The capability is better than the video collection capability of the first mobile terminal.

It should be understood that the above-mentioned switching of the first mobile terminal from the first external device to the second external device is only used as some examples and should not be specifically limited.

Referring to FIG. 6, FIG. 6 is a schematic flowchart of a call method provided by the present application. The call method in the embodiment of the present application includes the following steps:

S401: During a conversation between the first mobile terminal and the second mobile terminal through a conversation, the first mobile terminal stops receiving audio data and/or video data, and receives audio data and/or video data collected by the first external device, where , The audio acquisition capability of the first external device is superior to the audio acquisition capability of the first mobile terminal, and/or the video acquisition capability of the first external device is superior to the video acquisition capability of the first mobile terminal The audio acquisition capability is affected by audio acquisition parameters, which include: one or more of sensitivity, frequency response characteristics, and directivity; the video acquisition capability is affected by video acquisition parameters, and the video acquisition The parameters include: one or more of resolution, color space, frame rate, color reproduction degree, texture restoration degree, denoising, dynamic speed, photosensitive parts and lens;

S402: The first mobile terminal sends the audio data and/or video data collected by the first external device to the second mobile terminal through the session.

Here, the relationship between the first mobile terminal, the second mobile terminal, and the first external device, the relationship between the audio collection capability and the audio collection parameter, the relationship between the video collection capability and the video collection parameter, the relationship between the audio playback capability and the audio playback parameter, the video For the relationship between playback capabilities and video playback parameters, please refer to FIGS. 1A to 2A and related descriptions. The internal structure of the first mobile terminal may refer to FIG. 2B and related descriptions. The first mobile terminal stops collecting audio data and video data by itself, and calls the first external device to collect audio data and video data. Refer to FIG. 3A and related descriptions. For the establishment of the data connection path between the first mobile terminal and the first external device, refer to FIGS. 4A to 4C and related descriptions.

Referring to FIG. 7, FIG. 7 is a schematic flowchart of another calling method provided by this application. The call method in the embodiment of the present application includes the following steps:

S501: During a conversation between the first mobile terminal and the second mobile terminal in a conversation, the first mobile terminal receives audio data and/or video data sent by the second mobile terminal through the conversation, where the first external device Audio playback capability is better than the audio playback capability of the first mobile terminal, and/or the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal; the audio playback capability Affected by audio playback parameters, the audio playback parameters include: one or more of frequency response range, impedance size, distortion level, sensitivity, and signal-to-noise ratio; the video playback capability is affected by the video playback parameters, the video The playback parameters include one or more of dot pitch, size, resolution, pixels, refresh speed, and color.

S502: The first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data and/or sent by the second mobile terminal through the session Video data is sent to the first external device for playback by the first external device.

Here, the relationship between the first mobile terminal, the second mobile terminal, and the first external device, the relationship between the audio collection capability and the audio collection parameter, the relationship between the video collection capability and the video collection parameter, the relationship between the audio playback capability and the audio playback parameter, the video For the relationship between playback capabilities and video playback parameters, please refer to FIGS. 1A to 2A and related descriptions. The internal structure of the first mobile terminal may refer to FIG. 2B and related descriptions. The first mobile terminal stops collecting audio data and video data by itself, and calls the first external device to collect audio data and video data. Refer to FIG. 3B and related descriptions. For the establishment of the data connection path between the first mobile terminal and the first external device, refer to FIGS. 4A to 4C and related descriptions.

Referring to FIG. 8, FIG. 8 is a schematic structural diagram of a mobile terminal provided by this application. The mobile terminal in the embodiment of the present application includes: a receiving module 110, a sending module 120, and a processing module 130.

The receiving module 110 is configured to stop receiving audio data and/or video data and receive audio data and/or video data collected by the first external device during a conversation between the first mobile terminal and the second mobile terminal through a conversation. Wherein, the audio acquisition capability of the first external device is superior to the audio acquisition capability of the first mobile terminal, and/or the video acquisition capability of the first external device is superior to the video acquisition capability of the first mobile terminal Ability; the audio acquisition capability is affected by audio acquisition parameters, which include: one or more of sensitivity, frequency response characteristics, and directivity; the video acquisition capability is affected by video acquisition parameters, the video Acquisition parameters include: one or more of resolution, color space, frame rate, color reproduction, texture restoration, denoising, dynamic speed, photosensitive parts, and lens;

The sending module 120 is configured to send the audio data and/or video data collected by the first external device to the second mobile terminal through the session.

Optionally, the receiving module 110 is further configured to stop receiving audio data and/or video data collected by the first external device when the signal strength of the first external device is less than the signal strength of the second external device, And receive audio data and/or video data collected by the second external device, wherein the audio collecting capability of the second external device is superior to the audio collecting capability of the first mobile terminal, and/or, the first 2. The video collection capability of the external device is superior to that of the first mobile terminal.

Optionally, the sending module 120 is further configured to send multicast information in the local area network when the first mobile terminal and the first external device are on the same local area network, where the multicast information It is used to instruct the external device receiving the multicast message to send a first response message to the first mobile terminal; the receiving module 110 is also used to receive the first response message sent by the first external device, wherein, The first external device belongs to the external device that receives the multicast message, and the first response message carries audio collection parameters and/or video collection parameters of the first external device, and the first response The message also carries the address information of the first external device; the processing module 130 is used to establish a data transmission channel with the first external device according to the address information when the first response is received, The receiving module 110 is further configured to determine that the audio acquisition capability of the first external device is superior to the audio acquisition capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to all In the case of the video collection capability of the first mobile terminal, stop receiving audio data and/or video data, and receive audio data and/or video data collected by the first external device.

Optionally, the sending module 120 is used to send a broadcast message when the first mobile terminal is a wireless direct-connected device, where the broadcast message is used to indicate an external device that received the broadcast message Sending a second response message to the first mobile terminal; the processing module 130 is configured to establish a data transmission channel with the first external device when the second response message is received, wherein, the The first external device belongs to the external device that receives the broadcast message; the receiving module 110 is configured to receive the audio collection parameters and the first external device sent by the first external device through the data transmission channel /Or video acquisition parameters; the receiving module 110 is used to determine that the audio acquisition capability of the first external device is superior to the audio acquisition capability of the first mobile terminal, and/or, the video of the first external device If the collection capability is better than the video collection capability of the first mobile terminal, stop receiving audio data and/or video data, and receive audio data and/or video data collected by the first external device.

Optionally, the sending module 120 is configured to send a request message to a central server when the first mobile terminal and the first external device are respectively located in different local area networks, wherein the central server and the The first external device is located in the same local area network, the central server stores audio acquisition parameters and/or video acquisition parameters of the first external device, and the central server also stores address information of the first external device, the The request message is used to request audio collection parameters and/or video collection parameters of the first external device, the request message is also used to request address information of the first external device; the receiving module 110 is used to receive the A third response message sent by the central server, where the third response message includes audio collection parameters and/or video collection parameters of the first external device, and the third response message further includes address information of the first external device The processing module 130 is used for the first mobile terminal to establish a data transmission channel with the first external device according to the address information when receiving the third response message; the receiving module 110 For determining that the audio acquisition capability of the first external device is superior to the audio acquisition capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to that of the first mobile terminal In the case of video collection capability, stop receiving audio data and/or video data, and receive audio data and/or video data collected by the first external device.

For simplicity, the above-mentioned first mobile terminal is not described in detail, please refer to FIGS. 1A to 1B, 2B, 3A, 4A to 4C and related descriptions for details.

Referring to FIG. 9, FIG. 9 is a schematic structural diagram of a mobile terminal provided by this application. The mobile terminal in the embodiment of the present application includes: a receiving module 210, a sending module 220, a processing module 230, and a playing module 240.

The receiving module 210 is configured to receive audio data and/or video data sent by the second mobile terminal through the session during a conversation between the first mobile terminal and the second mobile terminal through the session, wherein the first external The audio playback capability of the device is superior to the audio playback capability of the first mobile terminal, and/or the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal; the audio playback The capability is affected by the audio playback parameters. The audio playback parameters include: one or more of frequency response range, impedance size, distortion level, sensitivity, and signal-to-noise ratio; the video playback capability is affected by the video playback parameters. Video playback parameters include: one or more of dot pitch, size, resolution, pixels, refresh speed, and color;

The playing module 240 is configured to stop playing audio data and/or video data sent by the second mobile terminal through the session, and to send audio data and/or video sent by the second mobile terminal through the session The data is sent to the first external device for the first external device to play.

Optionally, the playback module 240 is further configured to stop sending audio data to the first external device when the signal strength of the first external device is less than the signal strength of the second external device and And/or video data, and send audio data and/or video data to the second external device for playback by the second external device, wherein the audio playback capability of the second external device is better than the first The audio playback capability of a mobile terminal, and/or the video playback capability of the second external device is superior to the video playback capability of the first mobile terminal.

Optionally, the sending module 220 is configured to send multicast information in the local area network when the first mobile terminal and the first external device are on the same local area network, where the multicast information is used Instructing the external device that received the multicast message to send a first response message to the first mobile terminal; the receiving module 210 is further configured to receive the first response message sent by the first external device, where The first external device belongs to the external device that has received the multicast message, the first response message carries audio playback parameters and/or video playback parameters of the first external device, and the first response message It also carries the address information of the first external device; the processing module 230 is used to establish a data transmission channel with the first external device according to the address information when the first response is received. The playback module 240 is further configured to determine that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or that the video playback capability of the first external device is superior to the In the case of the video playback capability of the first mobile terminal, stop playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio sent by the second mobile terminal through the session The data and/or video data is sent to the first external device.

Optionally, the sending module 220 is used to send a broadcast message when the first mobile terminal is a wireless direct-connected device, where the broadcast message is used to indicate an external device that received the broadcast message Sending a second response message to the first mobile terminal; the processing module 230 is configured to establish a data transmission channel with the first external device when the second response message is received, wherein, the The first external device belongs to the external device that has received the broadcast message; the receiving module 210 is configured to receive the audio playback parameters and the audio parameters of the first external device sent by the first external device through the data transmission channel /Or video playback parameters; the playback module 240 is also used to determine that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or, the When the video playback capability is better than the video playback capability of the first mobile terminal, stop playing the audio data and/or video data sent by the second mobile terminal through the session, and the second mobile terminal The audio data and/or video data sent through the session is sent to the first external device.

Optionally, the sending module 220 is configured to send a request message to a central server when the first mobile terminal and the first external device are located on different local area networks, wherein the central server and the The first external device is located in the same local area network, the central server stores audio playback parameters and/or video playback parameters of the first external device, and the central server also stores address information of the first external device, the The request message is used to request audio playback parameters and/or video playback parameters of the first external device, the request message is also used to request address information of the first external device; the receiving module 210 is used to receive the A third response message sent by the central server, where the third response message includes audio playback parameters and/or video playback parameters of the first external device, and the third response message also includes address information of the first external device The processing module 230 is used to establish a data transmission channel with the first external device according to the address information when the third response message is received; the playback module 240 is used to determine the The audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal , Stop playing the audio data and/or video data sent by the second mobile terminal through the session, and send the audio data and/or video data sent by the second mobile terminal through the session to the first An external device.

For simplicity, the above-mentioned first mobile terminal is not described in detail, please refer to FIGS. 1A to 1B, 2B, 3B, 4A to 4C and related descriptions for details.

Taking the mobile terminal as a mobile phone as an example, FIG. 10 shows a block diagram of a partial structure of a mobile phone related to an embodiment of the present invention. Referring to FIG. 10, the mobile phone includes a wireless communication circuit (including a radio frequency circuit 311 and a wifi circuit/Bluetooth circuit 312), a memory 320, other input devices 330, a video playback device 340, a video acquisition device 350, an audio circuit 360, and an I/O subsystem 370, processor 380, and power supply 390 and other components. Those skilled in the art may understand that the structure of the mobile phone shown in FIG. 9 does not constitute a limitation on the mobile phone, and may include more or fewer components than the illustration, or combine some components, or split some components, or Different parts arrangement. Those skilled in the art can understand that the video playback device 340 belongs to a user interface (UI, User Interface), and the mobile phone may include a user interface that is less than that illustrated or less.

The following describes each component of the mobile phone in detail with reference to FIG. 10:

Wireless communication circuit (including radio frequency circuit 311 and wifi circuit/Bluetooth circuit 312). The RF circuit 310 can be used to receive and send signals during receiving and sending information or during a call. In particular, after receiving the downlink information of the base station, it is processed by the processor 380; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. In addition, the RF circuit 110 can also communicate with other devices via a wireless communication network. The wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access) , Code division multiple access), WCDMA (Wideband Code Division Multiple Access, broadband code division multiple access), LTE (Long Term Evolution), email, SMS (Short Messaging Service, short message service), etc. The wifi circuit and the Bluetooth circuit 312 can be used for short-range wireless communication.

The memory 320 may be used to store software programs and modules, and the processor 380 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 320. The memory 320 may mainly include a storage program area and a storage data area, where the storage program area may store an operating system, application programs required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; the storage data area may store Data created according to the use of mobile phones (such as audio data, phonebooks, etc.), etc. In addition, the memory 320 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

Other input devices 330 may be used to receive inputted numeric or character information, and generate key signal input related to user settings and function control of the mobile phone. Specifically, other input devices 330 may include but are not limited to physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and light mice (light mice are touch sensitive that do not display visual output Surface, or an extension of a touch-sensitive surface formed by a touch screen, etc.). The other input device 330 is connected to the other input device controller 371 of the I/O subsystem 370, and performs signal interaction with the processor 380 under the control of the other device input controller 371.

The video playback device 340 can be used to display information input by the user or information provided to the user and various menus of the mobile phone, and can also accept user input. In a specific embodiment, the video playback device may be a display screen. The specific display screen may include a display panel 341 and a touch panel 342. The display panel 341 can be configured in the form of an LCD (Liquid Crystal), an OLED (Organic Light-Emitting Diode, organic light emitting diode), or the like. The touch panel 342, also known as a touch screen, touch sensitive screen, etc., can collect user contact or non-contact operations on or near it (such as the user using a finger, stylus, or any suitable object or accessory on the touch panel 342 Or operations near the touch panel 342 may also include somatosensory operations; the operations include single-point control operations, multi-point control operations and other operation types.), and drive the corresponding connection device according to a preset program. Optionally, the touch panel 342 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation and posture, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device and converts it into a processor capable of The processed information is then sent to the processor 380, and can receive the command sent by the processor 380 and execute it. In addition, the touch panel 342 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves, or the touch panel 342 may be implemented using any technology developed in the future. Further, the touch panel 342 can cover the display panel 341, and the user can display on the display panel 341 according to the content displayed by the display panel 341 (the display content includes but is not limited to a soft keyboard, a virtual mouse, a virtual key, an icon, etc.) Operate on or near the covered touch panel 342. After detecting the operation on or near it, the touch panel 342 transmits it to the processor 380 through the I/O subsystem 370 to determine the user input, and then the processor 380 according to the user The input provides corresponding visual output on the display panel 341 through the I/O subsystem 370. Although in FIG. 10, the touch panel 342 and the display panel 341 are two separate components to realize the input and input functions of the mobile phone, in some embodiments, the touch panel 342 and the display panel 341 may be integrated and Realize the input and output functions of the mobile phone.

The mobile phone may further include a video capture device 350, which may collect ambient light and convert the ambient light into a digital signal. In a specific embodiment, the video capture device 350 may be a camera. The camera includes an optical lens and an image sensor. The optical lens is composed of multiple lenses. The lens may be a plastic lens or a glass lens. The image sensor may include a charge-coupled device (CCD) and a complementary metal oxide semiconductor (complementary) metal oxide (semiconductor, CMOS) and so on.

The mobile phone may also include an audio playback device (for example, a speaker 361) and an audio collection device (for example, a microphone 362). The audio circuit 360 may provide an audio interface between the user and the mobile phone 100. The audio circuit 360 can transmit the converted signal of the received audio data to the speaker 361, and the speaker 361 converts it into a sound signal output; on the other hand, the microphone 362 converts the collected sound signal into a signal, which is received by the audio circuit 360 Convert to audio data, and then output the audio data to the RF circuit 311 to send to, for example, another mobile phone, or output the audio data to the memory 320 for further processing.

The I/O subsystem 370 is used to control input and output external devices, and may include other device input controllers 371, video capture control controllers 372, and display controllers 373. Optionally, one or more other input control device controllers 371 receive signals from other input devices 330 and/or send signals to other input devices 330. The other input devices 330 may include physical buttons (press buttons, rocker buttons, etc.) , Dial, slide switch, joystick, click wheel, light mouse (light mouse is a touch sensitive surface that does not display visual output, or an extension of a touch sensitive surface formed by a touch screen). It is worth noting that the other input control device controller 371 can be connected to any one or more of the above devices. The display controller 373 in the I/O subsystem 370 receives signals from the video playback device (eg, display screen) 340 and/or sends signals to the video playback device 340. After the video playback device 340 detects the user input, the display controller 373 converts the detected user input into interaction with the user interface object displayed on the video playback device 340, that is, realizes human-computer interaction. The video capture controller 32 may receive signals from one or more video capture devices (eg, cameras) 350.

The processor 380 is the control center of the mobile phone, connects various parts of the entire mobile phone with various interfaces and lines, executes or executes the software programs and/or modules stored in the memory 320, and calls the data stored in the memory 320 to execute Various functions and processing data of the mobile phone, so as to monitor the mobile phone as a whole. Optionally, the processor 380 may include one or more processing units; preferably, the processor 380 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, and application programs, etc. The modem processor mainly handles wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 380.

The mobile phone also includes a power supply 390 (such as a battery) that supplies power to various components. Preferably, the power supply can be logically connected to the processor 380 through the power management system, so as to realize functions such as charging, discharging, and power consumption management through the power management system.

Although not shown, the mobile phone may also include multiple sensors, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 341 according to the brightness of the ambient light, and the proximity sensor may close the display panel 341 and/or when the mobile phone moves to the ear Or backlight. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when at rest, and can be used to identify mobile phone gesture applications (such as horizontal and vertical screen switching, related Games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, percussion), etc. As for the mobile phone can also be configured with gyro, barometer, hygrometer, thermometer, infrared sensor and other sensors, no longer here Repeat.

It can be understood that the mobile terminal can implement the call methods shown in FIG. 6 and FIG. 7 above. For details, please refer to FIG. 6 to FIG. 7 and related descriptions, which will not be repeated here.

The present application also provides a communication system, including a first mobile terminal, a second mobile terminal, and a first external device, where the first mobile terminal can communicate with the second mobile terminal and the first external device, respectively. The first mobile terminal may be the first mobile terminal in FIG. 1A and FIG. 2A. The first mobile terminal may adopt the software architecture in FIG. 2B. The first mobile terminal may be the first mobile terminal in FIGS. 3A and 3B. The first mobile terminal may execute the call method shown in FIGS. 6 and 7. The first mobile terminal may be any one of FIG. 8 to FIG. 10. For details, please refer to the related diagrams and descriptions, which will not be expanded here.

In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a dedicated computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be from a website site, computer, server or data center Transmission to another website, computer, server or data center via wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device including a server, a data center, and the like integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a storage disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, Solid State Disk (SSD)) or the like.

Claims

A call method, characterized in that it includes the following steps:

During the conversation between the first mobile terminal and the second mobile terminal through the conversation, the first mobile terminal stops receiving audio data and/or video data, and receives audio data and/or video data collected by the first external device. The audio acquisition capability of the first external device is superior to the audio acquisition capability of the first mobile terminal, and/or the video acquisition capability of the first external device is superior to the video acquisition capability of the first mobile terminal; The audio acquisition capability is affected by audio acquisition parameters, which include: one or more of sensitivity, frequency response characteristics, and directivity; the video acquisition capability is affected by video acquisition parameters, and the video acquisition parameters include : One or more of resolution, color space, frame rate, color reproduction, texture restoration, denoising, dynamic speed, photosensitive parts and lens;

The first mobile terminal sends the audio data and/or video data collected by the first external device to the second mobile terminal through the session.
The method of claim 1, comprising:

In the case where the signal strength of the first external device is less than the signal strength of the second external device, the first mobile terminal stops receiving audio data and/or video data collected by the first external device and receives the second Audio data and/or video data collected by an external device, wherein the audio collection capability of the second external device is superior to the audio collection capability of the first mobile terminal, and/or, the video collection of the second external device The capability is better than the video collection capability of the first mobile terminal.
The method according to claim 1 or 2, characterized in that, before the first mobile terminal stops receiving audio data and/or video data and receives audio data and/or video data collected by the first external device, the method Also includes:

When the first mobile terminal and the first external device are located in the same local area network, the first mobile terminal sends multicast information in the local area network, where the multicast information is used to indicate that the The external device for the multicast message sends a first response message to the first mobile terminal;

The first mobile terminal receives a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, and the first response message carries Audio acquisition parameters and/or video acquisition parameters of the first external device, the first response message also carries address information of the first external device;

When receiving the first response, the first mobile terminal establishes a data transmission channel with the first external device according to the address information,

The first mobile terminal stops receiving audio data and/or video data, and receives audio data and/or video data collected by the first external device, including:

Determining that the audio collection capability of the first external device is superior to the audio collection capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to the video collection capability of the first mobile terminal In the case of capability, the first mobile terminal stops receiving audio data and/or video data, and receives audio data and/or video data collected by the first external device.
The method according to claim 1 or 2, characterized in that, before the first mobile terminal stops receiving audio data and/or video data and receives audio data and/or video data collected by the first external device, the method Also includes:

In the case that the first mobile terminal is a wireless direct-connected device, the first mobile terminal sends a broadcast message, where the broadcast message is used to instruct the external device that received the broadcast message to send to the first The mobile terminal sends a second response message;

When receiving the second response message, the first mobile terminal establishes a data transmission channel with the first external device, where the first external device belongs to the receiver that received the broadcast message external device;

Receiving, by the first mobile terminal, audio acquisition parameters and/or video acquisition parameters of the first external device sent by the first external device through the data transmission channel;

The first mobile terminal stops receiving audio data and/or video data, and receives audio data and/or video data collected by the first external device, including:

Determining that the audio collection capability of the first external device is superior to the audio collection capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to the video collection capability of the first mobile terminal In the case of capability, the first mobile terminal stops receiving audio data and/or video data, and receives audio data and/or video data collected by the first external device.
The method according to claim 1 or 2, characterized in that, before the first mobile terminal stops receiving audio data and/or video data and receives audio data and/or video data collected by the first external device, the method Also includes:

In the case where the first mobile terminal and the first external device are respectively located in different local area networks, the first mobile terminal sends a request message to a central server, where the central server and the first external device are located In the same local area network, the central server stores audio acquisition parameters and/or video acquisition parameters of the first external device, the central server also stores address information of the first external device, and the request message is used to request Audio acquisition parameters and/or video acquisition parameters of the first external device, the request message is also used to request address information of the first external device;

The first mobile terminal receives a third response message sent by the central server, where the third response message includes audio collection parameters and/or video collection parameters of the first external device, and the third response message further includes Address information of the first external device;

When receiving the third response message, the first mobile terminal establishes a data transmission channel with the first external device according to the address information;

The first mobile terminal stops receiving audio data and/or video data, and receives audio data and/or video data collected by the first external device, including:

Determining that the audio collection capability of the first external device is superior to the audio collection capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to the video collection capability of the first mobile terminal In the case of capability, the first mobile terminal stops receiving audio data and/or video data, and receives audio data and/or video data collected by the first external device.
A call method, characterized in that it includes the following steps:

During a conversation between the first mobile terminal and the second mobile terminal in a conversation, the first mobile terminal receives audio data and/or video data sent by the second mobile terminal through the conversation, wherein the The audio playback capability is superior to the audio playback capability of the first mobile terminal, and/or the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal; the audio playback capability is affected by audio Playback parameters, the audio playback parameters include: one or more of frequency response range, impedance size, distortion level, sensitivity, and signal-to-noise ratio; the video playback capability is affected by the video playback parameters, the video playback parameters Including: one or more of dot pitch, size, resolution, pixels, refresh speed and color;

The first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data and/or video data sent by the second mobile terminal through the session Sent to the first external device for the first external device to play.
The method of claim 6, comprising:

In the case where the signal strength of the first external device is less than the signal strength of the second external device, the first mobile terminal stops sending audio data and/or video data to the first external device and sends the second external device The device sends audio data and/or video data for playback by the second external device, wherein the audio playback capability of the second external device is superior to the audio playback capability of the first mobile terminal, and/or, The video playback capability of the second external device is superior to the video playback capability of the first mobile terminal.
The method according to claim 6 or 7, wherein the first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the Before the audio data and/or video data sent by the mobile terminal through the session is sent to the first external device, the method further includes:

When the first mobile terminal and the first external device are located in the same local area network, the first mobile terminal sends multicast information in the local area network, where the multicast information is used to indicate that the The external device for the multicast message sends a first response message to the first mobile terminal;

The first mobile terminal receives a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, and the first response message carries Audio playback parameters and/or video playback parameters of the first external device, the first response message also carries address information of the first external device;

When receiving the first response, the first mobile terminal establishes a data transmission channel with the first external device according to the address information,

The first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data and/or video data sent by the second mobile terminal through the session Sent to the first external device, including:

Determining that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or that the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal In the case of capability, the first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data sent by the second mobile terminal through the session And/or video data is sent to the first external device.
The method according to claim 6 or 7, wherein the first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the Before the audio data and/or video data sent by the mobile terminal through the session is sent to the first external device, the method further includes:

In the case that the first mobile terminal is a wireless direct-connected device, the first mobile terminal sends a broadcast message, where the broadcast message is used to instruct the external device that received the broadcast message to send to the first The mobile terminal sends a second response message;

When receiving the second response message, the first mobile terminal establishes a data transmission channel with the first external device, where the first external device belongs to the receiver that received the broadcast message external device;

Receiving, by the first mobile terminal, audio playback parameters and/or video playback parameters of the first external device sent by the first external device through the data transmission channel;

The first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data and/or video data sent by the second mobile terminal through the session Sent to the first external device, including:

Determining that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or that the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal In the case of capability, the first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data sent by the second mobile terminal through the session And/or video data is sent to the first external device.
The method according to claim 6 or 7, wherein the first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the Before the audio data and/or video data sent by the mobile terminal through the session is sent to the first external device, the method further includes:

In the case where the first mobile terminal and the first external device are respectively located in different local area networks, the first mobile terminal sends a request message to a central server, where the central server and the first external device are located In the same local area network, the central server stores audio playback parameters and/or video playback parameters of the first external device, the central server also stores address information of the first external device, and the request message is used to request Audio playback parameters and/or video playback parameters of the first external device, the request message is also used to request address information of the first external device;

The first mobile terminal receives a third response message sent by the central server, where the third response message includes audio playback parameters and/or video playback parameters of the first external device, and the third response message further includes Address information of the first external device;

When receiving the third response message, the first mobile terminal establishes a data transmission channel with the first external device according to the address information;

The first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data and/or video data sent by the second mobile terminal through the session Sent to the first external device, including:

Determining that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or that the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal In the case of capability, the first mobile terminal stops playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data sent by the second mobile terminal through the session And/or video data is sent to the first external device.
A mobile terminal is characterized by comprising a receiving module and a sending module,

The receiving module is used to stop receiving audio data and/or video data and receive audio data and/or video data collected by the first external device during the conversation between the first mobile terminal and the second mobile terminal through a conversation , The audio acquisition capability of the first external device is superior to the audio acquisition capability of the first mobile terminal, and/or the video acquisition capability of the first external device is superior to the video acquisition capability of the first mobile terminal The audio acquisition capability is affected by audio acquisition parameters, which include: one or more of sensitivity, frequency response characteristics, and directivity; the video acquisition capability is affected by video acquisition parameters, and the video acquisition The parameters include: one or more of resolution, color space, frame rate, color reproduction degree, texture restoration degree, denoising, dynamic speed, photosensitive parts and lens;

The sending module is configured to send the audio data and/or video data collected by the first external device to the second mobile terminal through the session.
The terminal according to claim 11, wherein the receiving module is further configured to stop receiving the data collected by the first external device when the signal strength of the first external device is less than the signal strength of the second external device Audio data and/or video data, and receiving audio data and/or video data collected by the second external device, wherein the audio collection capability of the second external device is superior to the audio collection capability of the first mobile terminal , And/or, the video acquisition capability of the second external device is superior to the video acquisition capability of the first mobile terminal.
The terminal according to claim 11 or 12, wherein the mobile terminal further includes a processing module,

The sending module is further configured to send multicast information in the local area network when the first mobile terminal and the first external device are on the same local area network, wherein the multicast information is used to indicate that the The external device of the multicast message sends a first response message to the first mobile terminal;

The receiving module is further configured to receive a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, and the first response message carries The audio collection parameters and/or video collection parameters of the first external device, the first response message also carries the address information of the first external device;

The processing module is configured to establish a data transmission channel with the first external device according to the address information when the first response is received,

The receiving module is further configured to determine that the audio collection capability of the first external device is superior to the audio collection capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to the In the case of the video collection capability of the first mobile terminal, stop receiving audio data and/or video data, and receive audio data and/or video data collected by the first external device.
The terminal according to claim 11 or 12, wherein the mobile terminal further includes a processing module,

The sending module is used to send a broadcast message when the first mobile terminal is a wireless direct-connected device, wherein the broadcast message is used to instruct the external device that received the broadcast message to send the broadcast message to the first The mobile terminal sends a second response message;

The processing module is configured to establish a data transmission channel with the first external device when the second response message is received, wherein the first external device belongs to the receiver receiving the broadcast message external device;

The receiving module is configured to receive the audio collection parameters and/or video collection parameters of the first external device sent by the first external device through the data transmission channel;

The receiving module is configured to determine that the audio collection capability of the first external device is superior to the audio collection capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to the first In the case of a video collection capability of a mobile terminal, stop receiving audio data and/or video data, and receive audio data and/or video data collected by the first external device.
The terminal according to claim 11 or 12, wherein the mobile terminal further includes a processing module,

The sending module is configured to send a request message to a central server when the first mobile terminal and the first external device are respectively located in different local area networks, where the central server and the first external device are located In the same local area network, the central server stores audio acquisition parameters and/or video acquisition parameters of the first external device, the central server also stores address information of the first external device, and the request message is used to request Audio acquisition parameters and/or video acquisition parameters of the first external device, the request message is also used to request address information of the first external device;

The receiving module is configured to receive a third response message sent by the central server, where the third response message includes audio collection parameters and/or video collection parameters of the first external device, and the third response message further includes Address information of the first external device;

The processing module is used for the first mobile terminal to establish a data transmission channel with the first external device according to the address information when receiving the third response message;

The receiving module is configured to determine that the audio collection capability of the first external device is superior to the audio collection capability of the first mobile terminal, and/or that the video acquisition capability of the first external device is superior to the first In the case of a video collection capability of a mobile terminal, stop receiving audio data and/or video data, and receive audio data and/or video data collected by the first external device.
A mobile terminal is characterized by comprising a receiving module and a playing module,

The receiving module is configured to receive audio data and/or video data sent by the second mobile terminal through the session during a conversation between the first mobile terminal and the second mobile terminal through the session, wherein the first external device Audio playback capability is better than the audio playback capability of the first mobile terminal, and/or the video playback capability of the first external device is superior to the video playback capability of the first mobile terminal; the audio playback capability Affected by audio playback parameters, the audio playback parameters include: one or more of frequency response range, impedance size, distortion level, sensitivity, and signal-to-noise ratio; the video playback capability is affected by the video playback parameters, the video Play parameters include: one or more of dot pitch, size, resolution, pixels, refresh speed and color;

The playing module is configured to stop playing audio data and/or video data sent by the second mobile terminal through the session, and to send audio data and/or video data sent by the second mobile terminal through the session Sent to the first external device for the first external device to play.
The terminal according to claim 16, wherein:

The playing module is further configured to stop sending audio data and/or video data to the first external device when the signal strength of the first external device is less than the signal strength of the second external device, And send audio data and/or video data to the second external device for playback by the second external device, wherein the audio playback capability of the second external device is superior to the audio of the first mobile terminal Playback capability, and/or, the video playback capability of the second external device is superior to that of the first mobile terminal.
The terminal according to claim 16 or 17, wherein the terminal further comprises a sending module and a processing module,

The sending module is used to send multicast information in the local area network when the first mobile terminal and the first external device are on the same local area network, where the multicast information is used to indicate The external device for the multicast message sends a first response message to the first mobile terminal;

The receiving module is further configured to receive a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, and the first response message carries The audio playback parameters and/or video playback parameters of the first external device, the first response message also carries the address information of the first external device;

The processing module is configured to establish a data transmission channel with the first external device according to the address information when the first response is received,

The playback module is further configured to determine that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or that the video playback capability of the first external device is superior to the In the case of the video playback capability of the first mobile terminal, stop playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio sent by the second mobile terminal through the session The data and/or video data is sent to the first external device.
The terminal according to claim 16 or 17, wherein the terminal further comprises a sending module and a processing module,

The sending module is used to send a broadcast message when the first mobile terminal is a wireless direct-connected device, wherein the broadcast message is used to instruct the external device that received the broadcast message to send the broadcast message to the first The mobile terminal sends a second response message;

The processing module is configured to establish a data transmission channel with the first external device when the second response message is received, wherein the first external device belongs to the receiver receiving the broadcast message external device;

The receiving module is configured to receive audio playback parameters and/or video playback parameters of the first external device sent by the first external device through the data transmission channel;

The playback module is further configured to determine that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or that the video playback capability of the first external device is superior to the In the case of the video playback capability of the first mobile terminal, stop playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio sent by the second mobile terminal through the session The data and/or video data is sent to the first external device.
The terminal according to claim 16 or 17, wherein the terminal further comprises a sending module and a processing module,

The sending module is configured to send a request message to a central server when the first mobile terminal and the first external device are respectively located in different local area networks, where the central server and the first external device are located In the same local area network, the central server stores audio playback parameters and/or video playback parameters of the first external device, the central server also stores address information of the first external device, and the request message is used to request Audio playback parameters and/or video playback parameters of the first external device, the request message is also used to request address information of the first external device;

The receiving module is configured to receive a third response message sent by the central server, where the third response message includes audio playback parameters and/or video playback parameters of the first external device, and the third response message further includes Address information of the first external device;

The processing module is configured to establish a data transmission channel with the first external device according to the address information when the third response message is received;

The playback module is used to determine that the audio playback capability of the first external device is superior to the audio playback capability of the first mobile terminal, and/or that the video playback capability of the first external device is superior to the first In the case of the video playback capability of a mobile terminal, stop playing the audio data and/or video data sent by the second mobile terminal through the session, and the audio data sent by the second mobile terminal through the session And/or video data is sent to the first external device.
A terminal device, comprising: a processor and a memory, and the processor executes the code in the memory to execute the method according to any one of claims 1 to 10.
A computer non-volatile storage medium, characterized by comprising instructions, which when executed on a terminal device, causes the terminal device to execute the method according to any one of claims 1 to 10.
A computer program product, characterized in that, when the computer program product is read and executed by a computer, the method according to any one of claims 1 to 10 will be executed.
An apparatus characterized in that it is applied to a terminal device, the apparatus is coupled to a memory, and is used to read and execute a software program stored in the memory, so that the terminal device implements any one of claims 1 to 10. Item.
The device of claim 24, wherein the device is a chip or a system on chip.