CN113612957A

CN113612957A - Call method and related equipment

Info

Publication number: CN113612957A
Application number: CN202110791960.4A
Authority: CN
Inventors: 张斌; 蒲辉
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2018-12-28
Filing date: 2018-12-28
Publication date: 2021-11-05
Anticipated expiration: 2038-12-28
Also published as: CN111385513B; WO2020134756A1; CN111385513A; CN113612957B

Abstract

The application provides a communication method, equipment and system. The method comprises the following steps: the first mobile terminal stops collecting audio data and/or video data and receives the audio data and/or video data collected by first external equipment, wherein the audio collecting capacity of the first external equipment is superior to that of the first mobile terminal, and/or the video collecting capacity of the first external equipment is superior to that of the first mobile terminal; the audio acquisition capabilities are affected by audio acquisition parameters, including: one or more of sensitivity, frequency response, and directivity; the video capture capability is affected by video capture parameters, including: one or more of resolution, color space, frame rate, color rendition, texture rendition, denoising, dynamic speed, photosensitive component and lens; and the first mobile terminal sends the audio data and/or the video data collected by the first external equipment to the second mobile terminal through the session.

Description

Call method and related equipment

Technical Field

The present application relates to the field of terminals, and in particular, to a call method, a related device, and a system.

Background

The audio and video call generally refers to a communication mode for transmitting audio data and video data between the mobile terminal and the mobile terminal in real time based on the internet and the mobile internet. The audio and video communication brings great changes to the life of people, for example, relatives can communicate with each other at any time and any place through the audio and video communication, and research personnel can discuss the technical scheme through the audio and video communication. The production of the audio and video call greatly improves the working efficiency of the whole society and has great influence on the life of people.

However, the volume of the mobile terminal is usually small and limited by the size, and the audio and video device capability of the mobile terminal is usually weak, which affects the audio and video call effect.

Disclosure of Invention

The application provides a communication method and related equipment, which can effectively improve the effect of audio and video communication.

In a first aspect, a call method is provided, which includes the following steps:

in the conversation process between a first mobile terminal and a second mobile terminal through a conversation, the first mobile terminal stops receiving audio data and/or video data and receives audio data and/or video data collected by first external equipment, wherein the audio collection capacity of the first external equipment is superior to that of the first mobile terminal, and/or the video collection capacity of the first external equipment is superior to that of the first mobile terminal; the audio capture capability is affected by audio capture parameters including: one or more of sensitivity, frequency response, and directivity; the video capture capability is affected by video capture parameters, including: one or more of resolution, color space, frame rate, color rendition, texture rendition, denoising, dynamic speed, photosensitive component and lens;

and the first mobile terminal sends the audio data and/or the video data collected by the first external equipment to the second mobile terminal through the session.

In some possible designs, in a case that the signal strength of the first external device is less than that of the second external device, the first mobile terminal stops receiving the audio data and/or the video data collected by the first external device and receives the audio data and/or the video data collected by the second external device, wherein the audio collection capability of the second external device is better than that of the first mobile terminal, and/or the video collection capability of the second external device is better than that of the first mobile terminal.

In some possible designs, in a case where the first mobile terminal and the first external device are located in the same local area network, the first mobile terminal sends multicast information in the local area network, where the multicast information is used to instruct the external device that receives the multicast message to send a first response message to the first mobile terminal;

the first mobile terminal receives a first response message sent by the first external device, wherein the first external device belongs to the external device which receives the multicast message, the first response message carries audio acquisition parameters and/or video acquisition parameters of the first external device, and the first response message also carries address information of the first external device;

the first mobile terminal establishes a data transmission channel with the first external device according to the address information under the condition of receiving the first response,

and under the condition that the audio acquisition capability of the first external equipment is determined to be better than the audio acquisition capability of the first mobile terminal and/or the video acquisition capability of the first external equipment is determined to be better than the video acquisition capability of the first mobile terminal, the first mobile terminal stops receiving the audio data and/or the video data and receives the audio data and/or the video data acquired by the first external equipment.

In some possible designs, in a case that the first mobile terminal is a wireless directly connected device, the first mobile terminal sends a broadcast message, where the broadcast message is used to instruct an external device that receives the broadcast message to send a second response message to the first mobile terminal;

the first mobile terminal establishes a data transmission channel with the first external device under the condition of receiving the second response message, wherein the first external device belongs to the external device which receives the broadcast message;

the first mobile terminal receives audio acquisition parameters and/or video acquisition parameters of the first external equipment, which are sent by the first external equipment through the data transmission channel;

In some possible designs, in a case that the first mobile terminal and the first external device are located in different local area networks, the first mobile terminal sends a request message to a central server, where the central server and the first external device are located in the same local area network, the central server stores audio acquisition parameters and/or video acquisition parameters of the first external device, the central server also stores address information of the first external device, the request message is used to request the audio acquisition parameters and/or video acquisition parameters of the first external device, and the request message is used to request address information of the first external device;

the first mobile terminal receives a third response message sent by the central server, wherein the third response message comprises audio acquisition parameters and/or video acquisition parameters of first external equipment, and the third response message also comprises address information of the first external equipment;

the first mobile terminal establishes a data transmission channel with the first external equipment according to the address information under the condition of receiving the third response message;

In the process of carrying out conversation between a first mobile terminal and a second mobile terminal through conversation, if the audio acquisition capacity of first external equipment is superior to the audio acquisition capacity of the first mobile terminal and/or the video acquisition capacity of the first external equipment is superior to the video acquisition capacity of the first mobile terminal, the first terminal equipment can utilize the first external equipment to carry out audio data and/or video data acquisition, so that the effect of audio and video conversation is improved.

In a second aspect, a call method is provided, which is characterized by including the following steps:

in the conversation process between a first mobile terminal and a second mobile terminal through a conversation, the first mobile terminal receives audio data and/or video data sent by the second mobile terminal through the conversation, wherein the audio playing capability of first external equipment is superior to that of the first mobile terminal, and/or the video playing capability of the first external equipment is superior to that of the first mobile terminal; the audio playing capability is influenced by audio playing parameters, and the audio playing parameters comprise: one or more of frequency response range, impedance magnitude, distortion degree, sensitivity and signal-to-noise ratio; the video playing capability is influenced by video playing parameters, and the video playing parameters comprise: one or more of dot pitch, size, resolution, pixels, refresh rate, and color;

and the first mobile terminal stops playing the audio data and/or the video data sent by the second mobile terminal through the session, and sends the audio data and/or the video data sent by the second mobile terminal through the session to the first external equipment so as to be played by the first external equipment.

In some possible designs, in a case that the signal strength of the first external device is less than that of the second external device, the first mobile terminal stops sending audio data and/or video data to the first external device, and sends audio data and/or video data to the second external device for playing by the second external device, wherein the audio playing capability of the second external device is better than that of the first mobile terminal, and/or the video playing capability of the second external device is better than that of the first mobile terminal.

the first mobile terminal receives a first response message sent by the first external device, wherein the first external device belongs to the external device which receives the multicast message, the first response message carries an audio playing parameter and/or a video playing parameter of the first external device, and the first response message also carries address information of the first external device;

and under the condition that the audio playing capability of the first external equipment is determined to be better than the audio playing capability of the first mobile terminal, and/or the video playing capability of the first external equipment is determined to be better than the video playing capability of the first mobile terminal, the first mobile terminal stops playing the audio data and/or the video data sent by the second mobile terminal through the session, and sends the audio data and/or the video data sent by the second mobile terminal through the session to the first external equipment.

the first mobile terminal receives audio playing parameters and/or video playing parameters of the first external equipment, which are sent by the first external equipment through the data transmission channel;

In some possible designs, in a case that the first mobile terminal and the first external device are located in different local area networks, respectively, the first mobile terminal sends a request message to a central server, where the central server and the first external device are located in the same local area network, the central server stores audio playing parameters and/or video playing parameters of the first external device, the central server also stores address information of the first external device, the request message is used to request the audio playing parameters and/or video playing parameters of the first external device, and the request message is used to request address information of the first external device;

the first mobile terminal receives a third response message sent by the central server, wherein the third response message comprises audio playing parameters and/or video playing parameters of first external equipment, and the third response message also comprises address information of the first external equipment;

the first mobile terminal establishes a data transmission channel with the first external device according to the address information under the condition of receiving the third response message;

In the process of carrying out conversation between a first mobile terminal and a second mobile terminal through conversation, if the audio playing capability of the first external equipment is superior to the audio playing capability of the first mobile terminal and/or the video playing capability of the first external equipment is superior to the video playing capability of the first mobile terminal, the first terminal equipment can play audio data and/or video data by using the first external equipment, so that the effect of audio and video conversation is improved.

In a third aspect, a mobile terminal is provided, which includes a receiving module and a sending module,

the receiving module is used for stopping receiving audio data and/or video data and receiving audio data and/or video data collected by first external equipment in the conversation process between the first mobile terminal and the second mobile terminal, wherein the audio collecting capacity of the first external equipment is superior to that of the first mobile terminal, and/or the video collecting capacity of the first external equipment is superior to that of the first mobile terminal; the audio capture capability is affected by audio capture parameters including: one or more of sensitivity, frequency response, and directivity; the video capture capability is affected by video capture parameters, including: one or more of resolution, color space, frame rate, color rendition, texture rendition, denoising, dynamic speed, photosensitive component and lens;

the sending module is used for sending the audio data and/or the video data collected by the first external equipment to the second mobile terminal through the session.

In some possible designs, the receiving module is further configured to stop receiving the audio data and/or the video data collected by the first external device and receive the audio data and/or the video data collected by the second external device when the signal strength of the first external device is smaller than the signal strength of the second external device, where an audio collection capability of the second external device is better than an audio collection capability of the first mobile terminal and/or a video collection capability of the second external device is better than a video collection capability of the first mobile terminal.

In some possible designs, the mobile terminal further includes a processing module,

the sending module is further configured to send multicast information within a local area network when the first mobile terminal and the first external device are located in the same local area network, where the multicast information is used to indicate that the external device that receives the multicast message sends a first response message to the first mobile terminal;

the receiving module is further configured to receive a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, the first response message carries an audio acquisition parameter and/or a video acquisition parameter of the first external device, and the first response message also carries address information of the first external device;

the processing module is used for establishing a data transmission channel with the first external equipment according to the address information under the condition of receiving the first response,

the receiving module is further configured to stop receiving the audio data and/or the video data and receive the audio data and/or the video data acquired by the first external device when it is determined that the audio acquisition capability of the first external device is better than the audio acquisition capability of the first mobile terminal and/or that the video acquisition capability of the first external device is better than the video acquisition capability of the first mobile terminal.

the sending module is configured to send a broadcast message when the first mobile terminal is a wireless directly-connected device, where the broadcast message is used to instruct an external device that receives the broadcast message to send a second response message to the first mobile terminal;

the processing module is configured to establish a data transmission channel with the first external device when the second response message is received, where the first external device belongs to the external device that receives the broadcast message;

the receiving module is used for receiving the audio acquisition parameters and/or the video acquisition parameters of the first external equipment, which are sent by the first external equipment through the data transmission channel;

the receiving module is used for stopping receiving the audio data and/or the video data and receiving the audio data and/or the video data collected by the first external equipment under the condition that the audio collecting capability of the first external equipment is better than the audio collecting capability of the first mobile terminal and/or the video collecting capability of the first external equipment is better than the video collecting capability of the first mobile terminal.

the sending module is configured to send a request message to a central server when the first mobile terminal and the first external device are located in different local area networks, respectively, where the central server and the first external device are located in the same local area network, the central server stores audio acquisition parameters and/or video acquisition parameters of the first external device, the central server also stores address information of the first external device, the request message is used to request the audio acquisition parameters and/or video acquisition parameters of the first external device, and the request message is also used to request address information of the first external device;

the receiving module is configured to receive a third response message sent by the central server, where the third response message includes an audio acquisition parameter and/or a video acquisition parameter of a first external device, and the third response message further includes address information of the first external device;

the processing module is used for establishing a data transmission channel with the first external device according to the address information under the condition that the first mobile terminal receives the third response message;

In a fourth aspect, a mobile terminal is provided, which is characterized by comprising a receiving module and a playing module,

the receiving module is used for receiving audio data and/or video data sent by a second mobile terminal through a session in the process that the first mobile terminal and the second mobile terminal are in a conversation, wherein the audio playing capability of the first external equipment is superior to that of the first mobile terminal, and/or the video playing capability of the first external equipment is superior to that of the first mobile terminal; the audio playing capability is influenced by audio playing parameters, and the audio playing parameters comprise: one or more of frequency response range, impedance magnitude, distortion degree, sensitivity and signal-to-noise ratio; the video playing capability is influenced by video playing parameters, and the video playing parameters comprise: one or more of dot pitch, size, resolution, pixels, refresh rate, and color;

the playing module is configured to stop playing the audio data and/or the video data sent by the second mobile terminal through the session, and send the audio data and/or the video data sent by the second mobile terminal through the session to the first external device for playing by the first external device.

In some possible designs, the playing module is further configured to, when the signal strength of the first external device is less than that of the second external device, stop sending audio data and/or video data to the first external device by the first mobile terminal, and send audio data and/or video data to the second external device for playing by the second external device, where an audio playing capability of the second external device is better than an audio playing capability of the first mobile terminal, and/or a video playing capability of the second external device is better than a video playing capability of the first mobile terminal.

In some possible designs, the terminal further includes a transmitting module and a processing module,

the sending module is configured to send multicast information in a local area network when the first mobile terminal and the first external device are located in the same local area network, where the multicast information is used to indicate an external device that receives the multicast message to send a first response message to the first mobile terminal;

the receiving module is further configured to receive a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, the first response message carries an audio playing parameter and/or a video playing parameter of the first external device, and the first response message also carries address information of the first external device;

the playing module is further configured to stop playing the audio data and/or the video data sent by the second mobile terminal through the session and send the audio data and/or the video data sent by the second mobile terminal through the session to the first external device when it is determined that the audio playing capability of the first external device is better than the audio playing capability of the first mobile terminal and/or the video playing capability of the first external device is better than the video playing capability of the first mobile terminal.

the receiving module is used for receiving the audio playing parameters and/or the video playing parameters of the first external equipment, which are sent by the first external equipment through the data transmission channel;

the sending module is configured to send a request message to a central server when the first mobile terminal and the first external device are located in different local area networks, where the central server and the first external device are located in the same local area network, the central server stores audio playing parameters and/or video playing parameters of the first external device, the central server also stores address information of the first external device, the request message is used to request the audio playing parameters and/or video playing parameters of the first external device, and the request message is also used to request address information of the first external device;

the receiving module is configured to receive a third response message sent by the central server, where the third response message includes an audio playing parameter and/or a video playing parameter of a first external device, and the third response message further includes address information of the first external device;

the processing module is used for establishing a data transmission channel with the first external equipment according to the address information under the condition of receiving the third response message;

the playing module is used for stopping playing the audio data and/or the video data sent by the second mobile terminal through the session and sending the audio data and/or the video data sent by the second mobile terminal through the session to the first external device under the condition that the audio playing capability of the first external device is better than the audio playing capability of the first mobile terminal and/or the video playing capability of the first external device is better than the video playing capability of the first mobile terminal.

In a fifth aspect, a terminal device is provided, which includes: a processor and a memory, the processor executing code in the memory to perform the method of any of the first or second aspects.

In a sixth aspect, a computer non-volatile storage medium is provided, which comprises instructions that, when run on a terminal device, cause the terminal device to perform the method according to any one of the first or second aspects.

In a seventh aspect, a computer program product is provided, which, when being read and executed by a computer, is characterized in that the method according to any one of the first aspect or the second aspect is executed.

In an eighth aspect, an apparatus is provided, which is applied to a terminal device, and is coupled to a memory, and configured to read and execute a software program stored in the memory, so that the terminal device implements the method according to any one of the first aspect or the second aspect. Wherein the device is a chip or a processing system on a chip.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments or the background art of the present application, the drawings required to be used in the embodiments or the background art of the present application will be described below.

FIGS. 1A-1B are schematic diagrams of some application scenarios to which the present application relates;

fig. 2A and 2B are schematic diagrams of an existing module of a first mobile terminal and the first mobile terminal adding a new module on the basis of the existing module, respectively;

fig. 3A-3B are schematic diagrams of some of the present application's capabilities for enhancing a first mobile terminal with a first external device;

fig. 4A to 4C are schematic flow charts illustrating establishment of a data transmission path between a first mobile terminal and a first external device according to the present application;

FIG. 5 is a schematic diagram of a first mobile terminal switching from a first external device to a second external device in the present application;

fig. 6 is a schematic flow chart of a call method provided in the present application;

fig. 7 is a schematic flow chart of another call method provided in the present application;

fig. 8 is a schematic structural diagram of a mobile terminal provided in the present application;

fig. 9 is a schematic structural diagram of another mobile terminal provided in the present application;

fig. 10 is a schematic physical structure diagram of a mobile terminal provided in the present application.

Detailed Description

Taking a home scenario as an example, as shown in fig. 1A and 1B, a user's home usually has both a first mobile terminal that can move around with the user and a first external device installed at a fixed location. Wherein the content of the first and second substances,

the first mobile terminal is generally a terminal device which is small in size and convenient for a user to carry, and is provided with one or more of an audio acquisition device, an audio playing device, a video acquisition device, a video playing device and the like, for example, a mobile phone, a tablet computer, an intelligent wearable device and the like. However, limited by the size of the first mobile terminal, the audio capturing capability of the audio capturing device, the audio playing capability of the audio playing device, the video capturing capability of the video capturing device, and the video playing capability of the video playing device on the first mobile terminal are generally slightly inferior. For example, the audio capture device on the first mobile terminal may include a small speaker on the first mobile terminal, the audio playback device on the first mobile terminal may include a speaker on the first mobile terminal, the video capture device on the first mobile terminal may include a camera on the first mobile terminal, the video playback device on the first mobile terminal may include a display screen on the first mobile terminal, and so forth. It is to be understood that the above examples are by way of illustration only and should not be construed as limiting in any way.

The first external device is generally a terminal device that is large in size and does not need to be carried by a user frequently, and is provided with one or more of an audio acquisition device, an audio playback device, a video acquisition device, a video playback device, and the like, for example, a television, a stereo, a camera, a projector, and the like. Because the volume of the first external device is relatively large, the audio acquisition capability of the audio acquisition device, the audio playing capability of the audio playing device, the video acquisition capability of the video acquisition device and the video playing capability of the video playing device on the first external device are generally excellent. For example, the audio capturing device of the first external device may include a large microphone, the audio playing device of the first external device may include a speaker, the video capturing device of the first external device may include a camera, the video playing device of the first external device may include a projector, and so on. It is to be understood that the above examples are by way of illustration only and should not be construed as limiting in any way.

The first mobile terminal and the first external device may be connected through a wireless local area network or a wireless direct connection, and the like, which is not specifically limited herein.

The application scenario is described by taking a home scenario as an example, but in practical application, the application scenario may also be an enterprise scenario, a hotel scenario, or another scenario having both the first mobile terminal and the first external device, and is not limited specifically here.

The relationship between the audio capture capability of the audio capture device and the audio capture parameter, the relationship between the audio playback capability of the audio playback device and the audio playback parameter, the relationship between the video capture capability of the video capture device and the video capture parameter, and the relationship between the video playback capability of the video playback device and the video playback parameter will be described in detail below.

The audio capture device has audio capture capabilities, and the audio capture capabilities of the audio capture device are typically affected by audio capture parameters of the audio capture device. Here, the audio capture capability is a capability capable of converting captured sound into a digital signal. The audio acquisition parameters of the audio acquisition device include: one or more of sensitivity, frequency response, and directivity. Wherein, the higher the sensitivity of the audio acquisition device is, the better the audio acquisition capability of the audio acquisition device is. The flatter the frequency response characteristic of the audio acquisition device, the better the audio acquisition capability of the audio acquisition device. The stronger the directivity of the audio acquisition device, the better the audio acquisition capability of the audio acquisition device.

The audio playback device has audio playback capabilities, and the audio playback capabilities of the audio playback device are typically affected by audio playback parameters of the audio playback device. Here, the audio playback capability is a capability capable of converting a digital signal into sound. The audio playing parameters of the audio playing device comprise: frequency response range, impedance magnitude, distortion level, sensitivity, and signal-to-noise ratio. Wherein, the flatter the frequency response characteristic of the audio playing device, the better the audio playing capability of the audio playing device. The smaller the impedance of the audio playing device is, the better the audio playing capability of the audio playing device is. The smaller the distortion degree of the audio playing device is, the better the audio playing capability of the audio playing device is. The higher the sensitivity of the audio playback device, the better the audio playback capability of the audio playback device. The higher the signal-to-noise ratio of the audio playing device, the better the audio playing capability of the audio playing device.

The video capture device has video capture capability, and the video capture capability of the video capture device is generally affected by video capture parameters of the video playback device. Here, the video capture capability is a capability of converting captured light into a digital signal. The video acquisition parameters of the video acquisition device include: one or more of resolution, color space, frame rate, color rendition, texture rendition, denoising, dynamic speed, photosensitive member, and shot. The higher the resolution of the video acquisition device is, the better the video acquisition capacity of the video acquisition device is. The wider the color space of the video capture device, the better the video capture capability of the video capture device. The higher the frame rate of the video acquisition device is, the better the video acquisition capability of the video acquisition device is. The higher the color reduction degree of the video acquisition device is, the better the video acquisition capability of the video acquisition device is. The higher the texture reduction degree of the video acquisition device is, the better the video acquisition capability of the video acquisition device is. The better the denoising of the video acquisition device is, the better the video acquisition capability of the video acquisition device is. The higher the dynamic speed of the video capture device, the better the video capture capability of the video capture device. The more sensitive the photosensitive member of the video capture device, the better the video capture capability of the video capture device. The larger the field angle of the lens of the video acquisition device is, the larger the zoom multiple is, the larger the contrast is and the higher the resolution ratio is, the better the video acquisition capability of the video acquisition device is.

The video playing device has video playing capability, and the video playing capability of the video player is usually affected by video playing parameters of the video playing device. Here, the video playback capability is a capability capable of converting a digital signal into a digital image. The video playing parameters of the video playing device comprise: dot pitch, size, resolution, pixels, refresh rate, and color. The smaller the point distance of the video playing device is, the better the video playing capability of the video acquisition device is. The larger the size of the video playing device is, the better the video playing capability of the video acquisition device is. The higher the resolution of the video playing device is, the better the video playing capability of the video acquisition device is. The more pixels of the video playing device, the better the video playing capability of the video acquisition device. The faster the refresh rate of the video playing device is, the better the video playing capability of the video capturing device is. The richer the color of the video playing device is, the better the video playing capability of the video acquisition device is.

It should be understood that the above list of audio capture parameters, audio playback parameters, video capture parameters, and video playback parameters is merely an example, and should not be construed as being particularly limited.

Because the audio acquisition capability, the video acquisition capability, the audio playing capability and the video playing capability of the first external device are generally superior to the audio acquisition capability, the video acquisition capability, the audio playing capability and the video playing capability of the first mobile terminal, it can be considered that the audio acquisition capability, the video acquisition capability, the audio playing capability and the video playing capability of the first mobile terminal are improved by means of the audio acquisition capability, the video acquisition capability, the audio playing capability and the video playing capability of the first external device.

In order to achieve the above object, the present application provides a first mobile terminal, where a new module is added on the basis of an existing mobile terminal, so that audio data and video data collected by a first external device can be transmitted to the first mobile terminal for use, and also audio data and video data in the first mobile terminal can be transmitted to the first external device for playing.

Referring to fig. 2A and 2B, fig. 2A is a block diagram included in a conventional mobile terminal, and fig. 2B is a block diagram included in a first mobile terminal. As shown in fig. 2B, the first mobile terminal is a new module added on the basis of the existing mobile terminal, and all the modules in the dashed box in fig. 2B are new modules.

As shown in fig. 2A, the existing mobile terminal includes an application layer, a development source code project framework, an external framework, a hardware abstraction layer, a kernel layer, and the like. The development source code project framework comprises a telephone application program interface, multimedia, a view system, an internet of things and the like. The external framework includes audio augmentation, fingerprint navigation, digital cinema system sound effects, private controls, and global searches, among others. The hardware abstraction layer comprises audio, coding and decoding, display, a liquid crystal display screen, a camera and a short distance. The kernel layer comprises an audio driver, a wifi driver, a display driver and a camera driver. It is to be understood that the existing modules of the first mobile terminal may be unchanged from the prior art and will not be described herein.

As shown in fig. 2B, the first mobile terminal may further include, in addition to the modules included in the existing mobile terminal shown in fig. 2A: the hardware interface comprises a virtual hardware service layer positioned on an external framework, a virtual hardware channel positioned on the external framework, a virtual hardware abstraction layer positioned on the hardware abstraction layer and a virtual hardware driver positioned on a kernel layer. The virtual hardware service layer is responsible for providing an interface for external use and implementing a device control instruction, such as turning on or off a device. The virtual hardware channel is used for calling a virtual hardware abstraction layer to provide a method to complete data processing. The virtual hardware abstraction layer is used for performing secondary processing operations on the audio data and the video data, such as scaling, rotation, color space conversion, and the like. The virtual hardware driver is used for completing equipment self-check and establishing the virtual driver to meet the calling of the upper layer to the driver. The virtual hardware service layer comprises a virtual camera interface, a virtual audio interface and a virtual display interface. The virtual camera interface is used for providing an interface for processing a virtual camera, the virtual audio interface is used for providing an interface for processing a microphone and a loudspeaker, and the virtual display interface is used for providing an interface for processing a virtual display screen. The virtual hardware channel comprises a data link channel and a data transmission channel. The data link channel is used for establishing connection with the first external equipment and receiving audio data and/or video data sent by the first external equipment. The data transmission channel is used for sending the preprocessed data to a Graphics Processing Unit (GPU). The virtual hardware abstraction layer includes data pre-processing, data input and output, and effect enhancement. The data preprocessing is used for coding and decoding data. The data input and output are used for data interaction with the upper layer, for example, the result after data preprocessing is returned to the upper layer. Effect enhancement is used to perform secondary processing operations on audio data and/or video data, such as scaling, rotation, color space conversion, and the like.

Before a new module is not added, the first mobile terminal can only receive audio data collected by an audio collection device of the first mobile terminal and video data collected by a video collection device of the first mobile terminal, and plays the received audio data through an audio playing device of the first mobile terminal and plays the received video data through a video playing device of the first mobile terminal. After the new module is added, the first mobile terminal can receive audio data collected by the audio collection device of the first external device, can receive video data collected by the video collection device of the first external device, can play the received audio data through the audio player of the first external device, and can play the received video data through the video player of the first external device.

It should be understood that the modules of the existing mobile terminal and the modules of the first mobile terminal in the above examples are only used as an example, and in practical applications, more or fewer modules may be included, and are not specifically limited herein.

When the first mobile terminal is located at home and the second mobile terminal is located outdoors, conversation can be carried out between the first mobile terminal and the second mobile terminal through conversation. Wherein, the first mobile terminal may adopt the structure of the first mobile terminal in fig. 2B. The second mobile terminal may adopt the structure of the existing mobile terminal in fig. 2A, or may adopt the structure of the first mobile terminal in fig. 2B. The call between the first mobile terminal and the second mobile terminal may be an audio call, a video call, or an audio/video call, and is not limited specifically here. Here, the audio call means that only audio data is transmitted between the first mobile terminal and the second mobile terminal. The video call refers to the transmission of only video data between the first mobile terminal and the second mobile terminal. The audio and video call refers to the simultaneous transmission of audio data and video data between the first mobile terminal and the second mobile terminal. In the above example, the first mobile terminal is taken as an example to be located at home, and in practical applications, the first mobile terminal may also be located outdoors, and is not limited herein.

During the conversation between the first mobile terminal and the second mobile terminal through the session, if the first mobile terminal located at home and the first external device at home have established the data transmission channel, the first mobile terminal with weaker audio acquisition capability can improve the audio acquisition effect of the first mobile terminal by means of the first external device with stronger audio acquisition capability, the first mobile terminal with weaker audio playing capability can improve the audio playing effect of the first mobile terminal by means of the first external device with stronger audio playing capability, the first mobile terminal with weaker video acquisition capability can improve the video acquisition effect of the first mobile terminal by means of the first external device with stronger video acquisition capability, and the first mobile terminal with weaker video playing capability can improve the video playing effect of the first mobile terminal by means of the first external device with stronger video playing capability.

In the following examples shown in fig. 3A and fig. 3B, how to enhance the audio capturing capability, the video capturing capability, the audio playing capability and the video playing capability of the first mobile terminal by the first external device will be described in detail.

Corresponding to the application scenario shown in fig. 1A, as shown in fig. 3A, at the beginning of a session established between a first mobile terminal and a second mobile terminal for a call, the first mobile terminal may collect audio data through its own audio collecting device, collect video data through its own video collecting device, and send the collected audio data and video data to a second mobile terminal device through the session, in addition, the first mobile terminal may receive the audio data and video data sent by the second mobile terminal through the session, and play the audio data through its own audio playing device and play the video data through its own video playing device.

In the conversation process between a first mobile terminal and a second mobile terminal through a conversation, if the first mobile terminal and a first external device establish a data transmission path, and the audio acquisition capacity of the first external device is determined to be superior to the audio acquisition capacity of the first mobile terminal, and the video acquisition capacity of the first external device is determined to be superior to the video acquisition capacity of the first mobile terminal, the first mobile terminal stops acquiring audio data through an audio acquisition device of the first mobile terminal and video data through a video acquisition device of the first mobile terminal, and receives the audio data acquired by the audio acquisition device of the first external device and the video data acquired by the video acquisition device of the first external device.

Corresponding to the application scenario shown in fig. 1B, as shown in fig. 3B, at the beginning of a session established between a first mobile terminal and a second mobile terminal for a call, the first mobile terminal may collect audio data through its own audio collecting device, collect video data through its own video collecting device, and send the collected audio data and video data to a second mobile terminal device through the session, in addition, the first mobile terminal may receive the audio data and video data sent by the second mobile terminal through the session, and play the audio data through its own audio playing device and play the video data through its own video playing device.

In the process that a first mobile terminal and a second mobile terminal are in conversation through a session, if the first mobile terminal and a first external device establish a data transmission channel, and the audio playing capability of the first external device is determined to be superior to the audio playing capability of the first mobile terminal, and the video playing capability of the first external device is determined to be superior to the video playing capability of the first mobile terminal, the first mobile terminal stops playing audio data and/or video data sent by the second mobile terminal through the session, and sends the audio data and/or video data sent by the second mobile terminal through the session to the first external device for the first external device to play.

It should be understood that fig. 3A and 3B are only one specific example and should not be construed as being particularly limited. For example, if the number of the first external devices of the same type is multiple, the first mobile terminal may select the first external device with the strongest capability from the multiple first external devices to establish the data transmission path. For example, when the first external device includes a liquid crystal display panel and a liquid crystal display television, the resolution of the liquid crystal display television is larger than that of the liquid crystal display panel, and therefore, the liquid crystal display television can be preferentially selected to play video data. Still alternatively, the first mobile terminal may select the first external device with the strongest signal from the plurality of first external devices to establish the data transmission path. For example, when the first external device includes a liquid crystal display and a liquid crystal display television, the signal intensity of the liquid crystal display television is weaker than that of the liquid crystal display, and therefore, the liquid crystal display can be preferentially selected to play video data.

Fig. 4A to 4C respectively illustrate three ways of establishing a data transmission path between the first mobile terminal and the first external device, which will be described in detail below.

In the first mode, the first mobile terminal and the first external device are located in the same local area network. As shown in fig. 4A, the step of establishing the data transmission path between the first mobile terminal and the first external device includes the following steps: s101: and under the condition that the first mobile terminal and the first external device are located in the same local area network, the first mobile terminal sends multicast information in the local area network, wherein the multicast information is used for indicating the external device receiving the multicast message to send a first response message to the first mobile terminal. S102: the first mobile terminal receives a first response message sent by the first external device, wherein the first external device belongs to the external device which receives the multicast message, the first response message carries audio acquisition parameters and/or video acquisition parameters of the first external device, and the first response message also carries address information of the first external device. S103: and the first mobile terminal establishes a data transmission channel with the first external equipment according to the address information under the condition of receiving the first response.

In the second mode, the first mobile terminal and the first external device are connected through wireless direct connection. Wherein, wireless directly connecting can include wifi directly connecting and bluetooth directly connecting. As shown in fig. 4B, the step of establishing the data transmission path between the first mobile terminal and the first external device includes the following steps: s201: the method comprises the steps that under the condition that a first mobile terminal is a wireless direct-connection device, the first mobile terminal sends a broadcast message, wherein the broadcast message is used for indicating an external device receiving the broadcast message to send a second response message to the first mobile terminal. S202: and the first mobile terminal establishes a data transmission channel with the first external device under the condition of receiving the second response message, wherein the first external device belongs to the external device which receives the broadcast message. S203: and the first mobile terminal receives the audio acquisition parameters and/or the video acquisition parameters of the first external equipment, which are sent by the first external equipment through the data transmission channel.

In a third mode, the first mobile terminal and the first external device are respectively located in different local area networks. As shown in fig. 4C, the step of establishing the data transmission path between the first mobile terminal and the first external device includes the following steps: s301: the method comprises the steps that under the condition that a first mobile terminal and a first external device are respectively located in different local area networks, the first mobile terminal sends a request message to a central server, wherein the central server and the first external device are located in the same local area network, the central server stores audio acquisition parameters and/or video acquisition parameters of the first external device, the central server also stores address information of the first external device, the request message is used for requesting the audio acquisition parameters and/or the video acquisition parameters of the first external device, and the request message is also used for requesting the address information of the first external device. S302: the first mobile terminal receives a third response message sent by the central server, wherein the third response message comprises audio acquisition parameters and/or video acquisition parameters of first external equipment, and the third response message further comprises address information of the first external equipment. S303: and the first mobile terminal establishes a data transmission channel with the first external equipment according to the address information under the condition of receiving the third response message.

It should be understood that the manner in which the first mobile terminal and the first external device establish the data transmission path shown in fig. 4A to 4C is only used as some specific examples, and should not be construed as a specific limitation.

When the user moves at home (enters the bedroom from the living room) with the first mobile terminal device, the signal between the first mobile terminal and the first external device (located in the living room) is slowly weakened, and the signal between the first mobile terminal and the second external device (located in the bedroom) is slowly strengthened. At this time, the first mobile terminal may be handed over from the first external device to the second external device.

As shown in fig. 5, in a case that the signal strength of the first external device is less than the signal strength of the second external device, the first mobile terminal stops sending audio data and/or video data to the first external device, and sends audio data and/or video data to the second external device for the second external device to play, where the audio playing capability of the second external device is better than the audio playing capability of the first mobile terminal, and/or the video playing capability of the second external device is better than the video playing capability of the first mobile terminal.

Under the condition that the signal intensity of the first external equipment is smaller than that of the second external equipment, the first mobile terminal stops receiving the audio data and/or the video data collected by the first external equipment and receives the audio data and/or the video data collected by the second external equipment, wherein the audio collection capability of the second external equipment is superior to that of the first mobile terminal, and/or the video collection capability of the second external equipment is superior to that of the first mobile terminal.

It should be understood that the above-mentioned switching of the first mobile terminal from the first external device to the second external device is only a few examples and should not be construed as a specific limitation.

Referring to fig. 6, fig. 6 is a schematic flow chart of a call method provided in the present application. The communication method in the embodiment of the application comprises the following steps:

s401: in the conversation process between a first mobile terminal and a second mobile terminal through a conversation, the first mobile terminal stops receiving audio data and/or video data and receives audio data and/or video data collected by first external equipment, wherein the audio collection capacity of the first external equipment is superior to that of the first mobile terminal, and/or the video collection capacity of the first external equipment is superior to that of the first mobile terminal; the audio capture capability is affected by audio capture parameters including: one or more of sensitivity, frequency response, and directivity; the video capture capability is affected by video capture parameters, including: one or more of resolution, color space, frame rate, color rendition, texture rendition, denoising, dynamic speed, photosensitive component and lens;

s402: and the first mobile terminal sends the audio data and/or the video data collected by the first external equipment to the second mobile terminal through the session.

Here, the relationship between the first mobile terminal, the second mobile terminal, and the first external device, the relationship between the audio capture capability and the audio capture parameter, the relationship between the video capture capability and the video capture parameter, the relationship between the audio play capability and the audio play parameter, and the relationship between the video play capability and the video play parameter may all refer to fig. 1A to fig. 2A and related descriptions. The internal construction of the first mobile terminal can be seen in fig. 2B and the related description. The first mobile terminal stops capturing the audio data and the video data by itself, and invokes the first external device to capture the audio data and the video data may refer to fig. 3A and the related description. Fig. 4A to 4C and the related description may be referred to for the first mobile terminal to establish a data connection path with the first external device.

Referring to fig. 7, fig. 7 is a schematic flow chart of another call method provided in the present application. The communication method in the embodiment of the application comprises the following steps:

s501: in the conversation process between a first mobile terminal and a second mobile terminal through a conversation, the first mobile terminal receives audio data and/or video data sent by the second mobile terminal through the conversation, wherein the audio playing capability of first external equipment is superior to that of the first mobile terminal, and/or the video playing capability of the first external equipment is superior to that of the first mobile terminal; the audio playing capability is influenced by audio playing parameters, and the audio playing parameters comprise: one or more of frequency response range, impedance magnitude, distortion degree, sensitivity and signal-to-noise ratio; the video playing capability is influenced by video playing parameters, and the video playing parameters comprise: dot pitch, size, resolution, pixels, refresh rate, and color.

S502: and the first mobile terminal stops playing the audio data and/or the video data sent by the second mobile terminal through the session, and sends the audio data and/or the video data sent by the second mobile terminal through the session to the first external equipment so as to be played by the first external equipment.

Here, the relationship between the first mobile terminal, the second mobile terminal, and the first external device, the relationship between the audio capture capability and the audio capture parameter, the relationship between the video capture capability and the video capture parameter, the relationship between the audio play capability and the audio play parameter, and the relationship between the video play capability and the video play parameter may all refer to fig. 1A to fig. 2A and related descriptions. The internal construction of the first mobile terminal can be seen in fig. 2B and the related description. The first mobile terminal stops capturing the audio data and the video data by itself, and invokes the first external device to capture the audio data and the video data may refer to fig. 3B and the related description. Fig. 4A to 4C and the related description may be referred to for the first mobile terminal to establish a data connection path with the first external device.

Referring to fig. 8, fig. 8 is a schematic structural diagram of a mobile terminal provided in the present application. The mobile terminal in the embodiment of the application comprises: a receiving module 110, a transmitting module 120 and a processing module 130.

The receiving module 110 is configured to stop receiving audio data and/or video data and receive audio data and/or video data acquired by a first external device during a call between a first mobile terminal and a second mobile terminal through a session, where an audio acquisition capability of the first external device is better than an audio acquisition capability of the first mobile terminal and/or a video acquisition capability of the first external device is better than a video acquisition capability of the first mobile terminal; the audio capture capability is affected by audio capture parameters including: one or more of sensitivity, frequency response, and directivity; the video capture capability is affected by video capture parameters, including: one or more of resolution, color space, frame rate, color rendition, texture rendition, denoising, dynamic speed, photosensitive component and lens;

the sending module 120 is configured to send the audio data and/or the video data collected by the first external device to the second mobile terminal through the session.

Optionally, the receiving module 110 is further configured to stop receiving the audio data and/or the video data collected by the first external device and receive the audio data and/or the video data collected by the second external device when the signal strength of the first external device is less than the signal strength of the second external device, where an audio collecting capability of the second external device is better than an audio collecting capability of the first mobile terminal and/or a video collecting capability of the second external device is better than a video collecting capability of the first mobile terminal.

Optionally, the sending module 120 is further configured to send multicast information in a local area network when the first mobile terminal and the first external device are located in the same local area network, where the multicast information is used to instruct an external device that receives the multicast message to send a first response message to the first mobile terminal; the receiving module 110 is further configured to receive a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, the first response message carries an audio acquisition parameter and/or a video acquisition parameter of the first external device, and the first response message also carries address information of the first external device; the processing module 130 is configured to establish a data transmission channel with the first external device according to the address information when the first response is received, and the receiving module 110 is further configured to stop receiving the audio data and/or the video data and receive the audio data and/or the video data collected by the first external device when it is determined that the audio collection capability of the first external device is better than the audio collection capability of the first mobile terminal and/or the video collection capability of the first external device is better than the video collection capability of the first mobile terminal.

Optionally, the sending module 120 is configured to send a broadcast message when the first mobile terminal is a wireless directly connected device, where the broadcast message is used to instruct an external device that receives the broadcast message to send a second response message to the first mobile terminal; the processing module 130 is configured to establish a data transmission channel with the first external device when the second response message is received, where the first external device belongs to the external device that receives the broadcast message; the receiving module 110 is configured to receive an audio capture parameter and/or a video capture parameter of the first external device sent by the first external device through the data transmission channel; the receiving module 110 is configured to stop receiving the audio data and/or the video data and receive the audio data and/or the video data collected by the first external device when it is determined that the audio collection capability of the first external device is better than the audio collection capability of the first mobile terminal and/or that the video collection capability of the first external device is better than the video collection capability of the first mobile terminal.

Optionally, the sending module 120 is configured to send a request message to a central server under the condition that the first mobile terminal and the first external device are located in different local area networks, respectively, where the central server and the first external device are located in the same local area network, the central server stores an audio acquisition parameter and/or a video acquisition parameter of the first external device, the central server further stores address information of the first external device, the request message is used to request the audio acquisition parameter and/or the video acquisition parameter of the first external device, and the request message is further used to request address information of the first external device; the receiving module 110 is configured to receive a third response message sent by the central server, where the third response message includes an audio capture parameter and/or a video capture parameter of a first external device, and the third response message further includes address information of the first external device; the processing module 130 is configured to establish a data transmission channel with the first external device according to the address information when the first mobile terminal receives the third response message; the receiving module 110 is configured to stop receiving the audio data and/or the video data and receive the audio data and/or the video data collected by the first external device when it is determined that the audio collection capability of the first external device is better than the audio collection capability of the first mobile terminal and/or that the video collection capability of the first external device is better than the video collection capability of the first mobile terminal.

For the sake of simplicity, the first mobile terminal is not described in detail, please refer to fig. 1A to 1B, fig. 2B, fig. 3A, fig. 4A to 4C and related descriptions.

Referring to fig. 9, fig. 9 is a schematic structural diagram of a mobile terminal provided in the present application. The mobile terminal in the embodiment of the application comprises: a receiving module 210, a sending module 220, a processing module 230, and a playing module 240.

The receiving module 210 is configured to receive audio data and/or video data sent by a second mobile terminal through a session when a first mobile terminal and the second mobile terminal are in a call through the session, where an audio playing capability of the first external device is better than an audio playing capability of the first mobile terminal, and/or a video playing capability of the first external device is better than a video playing capability of the first mobile terminal; the audio playing capability is influenced by audio playing parameters, and the audio playing parameters comprise: one or more of frequency response range, impedance magnitude, distortion degree, sensitivity and signal-to-noise ratio; the video playing capability is influenced by video playing parameters, and the video playing parameters comprise: one or more of dot pitch, size, resolution, pixels, refresh rate, and color;

the playing module 240 is configured to stop playing the audio data and/or the video data sent by the second mobile terminal through the session, and send the audio data and/or the video data sent by the second mobile terminal through the session to the first external device for playing by the first external device.

Optionally, the playing module 240 is further configured to, when the signal strength of the first external device is less than the signal strength of the second external device, stop sending audio data and/or video data to the first external device by the first mobile terminal, and send audio data and/or video data to the second external device for playing by the second external device, where an audio playing capability of the second external device is better than an audio playing capability of the first mobile terminal, and/or a video playing capability of the second external device is better than a video playing capability of the first mobile terminal.

Optionally, the sending module 220 is configured to send multicast information in a local area network when the first mobile terminal and the first external device are located in the same local area network, where the multicast information is used to instruct an external device that receives the multicast message to send a first response message to the first mobile terminal; the receiving module 210 is further configured to receive a first response message sent by the first external device, where the first external device belongs to the external device that receives the multicast message, the first response message carries an audio playing parameter and/or a video playing parameter of the first external device, and the first response message also carries address information of the first external device; the processing module 230 is configured to establish a data transmission channel with the first external device according to the address information when the first response is received, and the playing module 240 is further configured to stop playing the audio data and/or the video data sent by the second mobile terminal through the session and send the audio data and/or the video data sent by the second mobile terminal through the session to the first external device when it is determined that the audio playing capability of the first external device is better than the audio playing capability of the first mobile terminal and/or the video playing capability of the first external device is better than the video playing capability of the first mobile terminal.

Optionally, the sending module 220 is configured to send a broadcast message when the first mobile terminal is a wireless directly connected device, where the broadcast message is used to instruct an external device that receives the broadcast message to send a second response message to the first mobile terminal; the processing module 230 is configured to, in a case that the second response message is received, establish a data transmission channel with the first external device, where the first external device belongs to the external device that receives the broadcast message; the receiving module 210 is configured to receive an audio playing parameter and/or a video playing parameter of the first external device sent by the first external device through the data transmission channel; the playing module 240 is further configured to, when it is determined that the audio playing capability of the first external device is better than the audio playing capability of the first mobile terminal, and/or the video playing capability of the first external device is better than the video playing capability of the first mobile terminal, stop playing the audio data and/or the video data sent by the second mobile terminal through the session, and send the audio data and/or the video data sent by the second mobile terminal through the session to the first external device.

Optionally, the sending module 220 is configured to send a request message to a central server under the condition that the first mobile terminal and the first external device are located in different local area networks, respectively, where the central server and the first external device are located in the same local area network, the central server stores an audio playing parameter and/or a video playing parameter of the first external device, the central server further stores address information of the first external device, the request message is used to request the audio playing parameter and/or the video playing parameter of the first external device, and the request message is further used to request address information of the first external device; the receiving module 210 is configured to receive a third response message sent by the central server, where the third response message includes an audio playing parameter and/or a video playing parameter of a first external device, and the third response message further includes address information of the first external device; the processing module 230 is configured to establish a data transmission channel with the first external device according to the address information when the third response message is received; the playing module 240 is configured to stop playing the audio data and/or the video data sent by the second mobile terminal through the session and send the audio data and/or the video data sent by the second mobile terminal through the session to the first external device when it is determined that the audio playing capability of the first external device is better than the audio playing capability of the first mobile terminal and/or the video playing capability of the first external device is better than the video playing capability of the first mobile terminal.

For the sake of simplicity, the first mobile terminal is not described in detail, please refer to fig. 1A to 1B, fig. 2B, fig. 3B, fig. 4A to 4C and related descriptions.

Taking a mobile terminal as an example of a mobile phone, fig. 10 is a block diagram illustrating a part of a structure of a mobile phone according to an embodiment of the present invention. Referring to fig. 10, the handset includes components such as wireless communication circuitry (including rf circuitry 311 and wifi/bluetooth circuitry 312), memory 320, other input devices 330, video playback device 340, video capture device 350, audio circuitry 360, I/O subsystem 370, processor 380, and power supply 390. Those skilled in the art will appreciate that the handset configuration shown in fig. 9 is not intended to be limiting and may include more or fewer components than those shown, or may combine certain components, or split certain components, or arranged in different components. Those skilled in the art will appreciate that the video playback device 340 belongs to a User Interface (UI) and that the cell phone may include fewer or more User interfaces than shown.

The following describes each component of the mobile phone in detail with reference to fig. 10:

wireless communication circuits (including rf circuit 311 and wifi circuit/bluetooth circuit 312). The RF circuit 310 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, receives downlink information of a base station and then processes the received downlink information to the processor 380; in addition, the data for designing uplink is transmitted to the base station. Typically, the RF circuit includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. In addition, the RF circuitry 110 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), and the like. The wifi circuit and the bluetooth circuit 312 may be used for wireless communication over short distances.

The memory 320 may be used to store software programs and modules, and the processor 380 executes various functional applications and data processing of the mobile phone by operating the software programs and modules stored in the memory 320. The memory 320 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 320 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

Other input devices 330 may be used to receive entered numeric or character information and generate key signal inputs relating to user settings and function controls of the handset. In particular, other input devices 330 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, a light mouse (a light mouse is a touch-sensitive surface that does not display visual output, or is an extension of a touch-sensitive surface formed by a touch screen), and the like. The other input device 330 is connected to the other input device controller 371 of the I/O subsystem 370 and is in signal communication with the processor 380 under control of the other device input controller 371.

The video playback device 340 may be used to display information input by or provided to the user as well as various menus of the handset, and may also accept user input. In a particular embodiment, the video playback device may be a display screen. Specific display screens may include a display panel 341, and a touch panel 342. The Display panel 341 may be configured by an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. The touch panel 342, also referred to as a touch screen, a touch-sensitive screen, etc., may collect contact or non-contact operations (e.g., operations performed by a user on or near the touch panel 342 or body sensing operations, including single-point control operations, multi-point control operations, etc.) by using any suitable object or accessory, such as a finger, a stylus, etc., and drive the corresponding connection device according to a preset program. Alternatively, the touch panel 342 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction and gesture of a user, detects signals brought by touch operation and transmits the signals to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into information that can be processed by the processor, sends the information to the processor 380, and receives and executes commands sent by the processor 380. In addition, the touch panel 342 can be implemented by various types such as resistive, capacitive, infrared, and surface acoustic wave, and the touch panel 342 can also be implemented by any technology developed in the future. Further, touch panel 342 may cover display panel 341, a user may operate on or near touch panel 342 covered on display panel 341 according to content displayed on display panel 341 (the display content includes, but is not limited to, a soft keyboard, a virtual mouse, virtual keys, icons, etc.), touch panel 342 detects the operation on or near touch panel 342, and transmits the operation to processor 380 through I/O subsystem 370 to determine user input, and processor 380 then provides corresponding visual output on display panel 341 through I/O subsystem 370 according to the user input. Although in fig. 10, the touch panel 342 and the display panel 341 are two separate components to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 342 and the display panel 341 may be integrated to implement the input and output functions of the mobile phone.

The handset may also include a video capture device 350, where the video capture device 350 may capture ambient light and convert the ambient light to a digital signal. In a particular embodiment, video capture device 350 may be a camera. The camera includes an optical lens and an image sensor, wherein the optical lens includes a plurality of lenses, the lenses may be plastic lenses or glass lenses, and the image sensor may include a charge-coupled device (CCD), a Complementary Metal Oxide Semiconductor (CMOS), and the like.

The handset may also include audio playback devices (e.g., speaker 361) and audio capture devices (e.g., microphone 362). The audio circuit 360 may provide an audio interface between the user and the handset 100. The audio circuit 360 may transmit the converted signal of the received audio data to the speaker 361, and the converted signal is converted into a sound signal by the speaker 361 and output; on the other hand, the microphone 362 converts the collected sound signals into signals, which are received by the audio circuit 360 and converted into audio data, which are then output to the RF circuit 311 to be transmitted to, for example, another cellular phone, or to the memory 320 for further processing.

The I/O subsystem 370 may be used to control input and output of external devices, including other device input controller 371, video capture control controller 372, and display controller 373. Optionally, one or more other input control device controllers 371 receive signals from and/or send signals to other input devices 330, and other input devices 330 may include physical buttons (push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, a light mouse (a light mouse is a touch-sensitive surface that does not display visual output, or is an extension of a touch-sensitive surface formed by a touch screen). It is noted that other input control device controllers 371 may be connected to any one or more of the above-described devices. The display controller 373 of the I/O subsystem 370 receives signals from the video playback device (e.g., display screen) 340 and/or sends signals to the video playback device 340. After the video playback device 340 detects the user input, the display controller 373 converts the detected user input into an interaction with the user interface object displayed on the video playback device 340, that is, realizes a human-computer interaction. Video capture controller 32 may receive signals from one or more video capture devices (e.g., cameras) 350.

The processor 380 is a control center of the mobile phone, connects various parts of the whole mobile phone by using various interfaces and lines, and performs various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 320 and calling data stored in the memory 320, thereby performing overall monitoring of the mobile phone. Optionally, processor 380 may include one or more processing units; preferably, the processor 380 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 380.

The handset also includes a power supply 390 (e.g., a battery) for powering the various components, which may preferably be logically connected to the processor 380 via a power management system to manage charging, discharging, and power consumption via the power management system.

Although not shown, the handset may also include a plurality of sensors, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel 341 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 341 and/or the backlight when the mobile phone is moved to the ear. As one of the motion sensors, the accelerometer sensor may detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when stationary, and may be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), and the like, for identifying the attitude of the mobile phone, and as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which may be configured to the mobile phone, further description is omitted here.

It can be understood that the mobile terminal may implement the call method shown in fig. 6 and fig. 7, please refer to fig. 6 to fig. 7 and the related description specifically, which will not be described herein again.

The application also provides a communication system, which comprises a first mobile terminal, a second mobile terminal and a first external device, wherein the first mobile terminal can be respectively communicated with the second mobile terminal and the first external device. The first mobile terminal may be the first mobile terminal in fig. 1A and fig. 2A. The first mobile terminal may employ the software architecture of fig. 2B. The first mobile terminal may be the first mobile terminal in fig. 3A and 3B. The first mobile terminal may perform the call method as shown in fig. 6 and 7. The first mobile terminal may be the mobile terminal of any one of fig. 8 to 10. Please refer to the related drawings and description specifically, which will not be expanded herein.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, memory Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

Claims

1. A conversation method is characterized by comprising the following steps:

in the conversation process between a first mobile terminal and a second mobile terminal through a conversation, the first mobile terminal stops receiving audio data and/or video data and receives audio data and/or video data collected by first external equipment, and the first mobile terminal and the first external equipment are in wireless connection, wherein the audio collection capacity of the first external equipment is superior to that of the first mobile terminal, and/or the video collection capacity of the first external equipment is superior to that of the first mobile terminal; the audio capture capability is affected by audio capture parameters including: one or more of sensitivity, frequency response, and directivity; the video capture capability is affected by video capture parameters, including: one or more of resolution, color space, frame rate, color rendition, texture rendition, denoising, dynamic speed, photosensitive component and lens;

2. The method of claim 1, comprising:

3. The method according to claim 1 or 2, wherein before the first mobile terminal stops receiving the audio data and/or the video data and receives the audio data and/or the video data collected by the first external device, the method further comprises:

under the condition that the first mobile terminal and the first external device are located in the same local area network, the first mobile terminal sends multicast information in the local area network, wherein the multicast information is used for indicating the external device receiving the multicast message to send a first response message to the first mobile terminal;

and the first mobile terminal establishes a data transmission channel with the first external equipment according to the address information under the condition of receiving the first response.

4. The method according to claim 1 or 2, wherein before the first mobile terminal stops receiving the audio data and/or the video data and receives the audio data and/or the video data collected by the first external device, the method further comprises:

the method comprises the steps that under the condition that a first mobile terminal is a wireless direct-connection device, the first mobile terminal sends a broadcast message, wherein the broadcast message is used for indicating an external device receiving the broadcast message to send a second response message to the first mobile terminal;

and the first mobile terminal receives the audio acquisition parameters and/or the video acquisition parameters of the first external equipment, which are sent by the first external equipment through the data transmission channel.

5. The method according to claim 1 or 2, wherein before the first mobile terminal stops receiving the audio data and/or the video data and receives the audio data and/or the video data collected by the first external device, the method further comprises:

the method comprises the steps that under the condition that a first mobile terminal and first external equipment are respectively located in different local area networks, the first mobile terminal sends a request message to a central server, wherein the central server and the first external equipment are located in the same local area network, the central server stores audio acquisition parameters and/or video acquisition parameters of the first external equipment, the central server also stores address information of the first external equipment, the request message is used for requesting the audio acquisition parameters and/or the video acquisition parameters of the first external equipment, and the request message is also used for requesting the address information of the first external equipment;

and the first mobile terminal establishes a data transmission channel with the first external equipment according to the address information under the condition of receiving the third response message.

6. The method according to any one of claims 1 to 5,

the method for stopping receiving the audio data and/or the video data and receiving the audio data and/or the video data collected by the first external device by the first mobile terminal includes:

7. A conversation method is characterized by comprising the following steps:

in the conversation process between a first mobile terminal and a second mobile terminal through a conversation, the first mobile terminal receives audio data and/or video data sent by the second mobile terminal through the conversation, wherein the first mobile terminal and a first external device are in wireless connection, the audio playing capability of the first external device is superior to that of the first mobile terminal, and/or the video playing capability of the first external device is superior to that of the first mobile terminal; the audio playing capability is influenced by audio playing parameters, and the audio playing parameters comprise: one or more of frequency response range, impedance magnitude, distortion degree, sensitivity and signal-to-noise ratio; the video playing capability is influenced by video playing parameters, and the video playing parameters comprise: one or more of dot pitch, size, resolution, pixels, refresh rate, and color;

8. The method of claim 7, comprising:

and under the condition that the signal intensity of the first external equipment is smaller than that of the second external equipment, the first mobile terminal stops sending audio data and/or video data to the first external equipment and sends the audio data and/or the video data to the second external equipment for the second external equipment to play, wherein the audio playing capability of the second external equipment is superior to that of the first mobile terminal, and/or the video playing capability of the second external equipment is superior to that of the first mobile terminal.

9. The method according to claim 7 or 8, wherein before the first mobile terminal stops playing the audio data and/or video data transmitted by the second mobile terminal through the session and transmits the audio data and/or video data transmitted by the second mobile terminal through the session to the first external device, the method further comprises:

10. The method according to claim 7 or 8, wherein before the first mobile terminal stops playing the audio data and/or video data transmitted by the second mobile terminal through the session and transmits the audio data and/or video data transmitted by the second mobile terminal through the session to the first external device, the method further comprises:

and the first mobile terminal receives the audio playing parameters and/or the video playing parameters of the first external equipment, which are sent by the first external equipment through the data transmission channel.

11. The method according to claim 7 or 8, wherein before the first mobile terminal stops playing the audio data and/or video data transmitted by the second mobile terminal through the session and transmits the audio data and/or video data transmitted by the second mobile terminal through the session to the first external device, the method further comprises:

the method comprises the steps that under the condition that a first mobile terminal and first external equipment are respectively located in different local area networks, the first mobile terminal sends a request message to a central server, wherein the central server and the first external equipment are located in the same local area network, the central server stores audio playing parameters and/or video playing parameters of the first external equipment, the central server also stores address information of the first external equipment, the request message is used for requesting the audio playing parameters and/or the video playing parameters of the first external equipment, and the request message is also used for requesting the address information of the first external equipment;

and the first mobile terminal establishes a data transmission channel with the first external device according to the address information under the condition of receiving the third response message.

12. The method according to any one of claims 7 to 11,

the first mobile terminal stopping playing the audio data and/or the video data sent by the second mobile terminal through the session, and sending the audio data and/or the video data sent by the second mobile terminal through the session to the first external device, includes:

13. A terminal device, comprising: a processor and memory, the processor executing code in the memory to perform the method of any of claims 1 to 12.

14. A computer non-volatile storage medium comprising instructions that, when executed on a terminal device, cause the terminal device to perform the method of any one of claims 1 to 12.

15. A computer program product, characterized in that the method according to any of claims 1 to 12 is to be performed when the computer program product is read and executed by a computer.