CN114844736B

CN114844736B - Equipment and call control method

Info

Publication number: CN114844736B
Application number: CN202210317361.3A
Authority: CN
Inventors: 邓子敬; 曹圆圆; 郑鹏
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-03-28
Filing date: 2022-03-28
Publication date: 2023-10-27
Anticipated expiration: 2042-03-28
Also published as: CN114844736A

Abstract

The disclosure relates to equipment and a call control method, and relates to the technical field of communication. Comprising the following steps: under the condition that a target broadcast message sent by the second device is monitored, the first device sends a telephone hands-free protocol HFP Bluetooth connection request to the second device, wherein the target broadcast message is used for indicating the second device to receive an incoming call, or the target broadcast message is used for indicating the second device to request to dial a target telephone; after receiving a response message for the Bluetooth connection request sent by the second device, establishing HFP Bluetooth connection with the second device; after establishing the HFP Bluetooth connection with the second device, processing the incoming call received by the second device, or controlling the second device to make a call. The embodiment of the disclosure is used for realizing the call making and answering of the second device through the first device.

Description

Equipment and call control method

Technical Field

The disclosure relates to the field of communication technologies, and in particular, to a device and a call control method.

Background

The intelligent home can bring convenience to the life of the user. In actual life, if a user wants to make or receive a call when a call device such as a mobile phone of the user is far away from the user, the user needs to search for the mobile phone and then operate the mobile phone, so that the user cannot make or receive the call by using the mobile phone in a place far away from the mobile phone.

Disclosure of Invention

In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a device and a call control method, which can implement call making and call answering of a second device through a first device.

In order to achieve the above object, the technical solution provided by the embodiments of the present disclosure is as follows:

in a first aspect, there is provided a first device comprising:

a communication interface configured to: transmitting a bluetooth connection request based on a telephone Hands Free Protocol (HFP) to a second device when a target broadcast message transmitted by the second device is monitored, wherein the target broadcast message is used for indicating that the second device receives an incoming call or the target broadcast message is used for indicating that the second device requests to dial a target telephone;

the communication interface is further configured to: after receiving a response message for the Bluetooth connection request sent by the second device, establishing HFP Bluetooth connection with the second device;

a controller configured to: after establishing the HFP bluetooth connection with the second device, the incoming call received by the second device is processed, or the target phone is dialed.

As some embodiments of the present disclosure, the first device is a display device, the second device is a call device, and the target broadcast message is used to indicate that the call device receives the incoming call;

the target broadcast message includes: call identification information;

the controller is further configured to: and controlling the communication interface to send an HFP Bluetooth connection request to the second device under the condition that the communication interface monitors the target broadcast message sent by the second device and determines that the call identification information exists in an incoming call white list.

As some embodiments of the disclosure, the target broadcast message further includes audio feature information supported by the HFP bluetooth connection of at least one of the following;

audio coding mode, sound channel, sampling rate and sampling depth;

the communication interface is specifically configured to: and establishing an HFP Bluetooth connection with the second device based on the audio feature information supported by the HFP Bluetooth connection.

As some embodiments of the present disclosure, the first device is a display device, the second device is a call device, and the response message includes call identification information;

The controller is further configured to: and controlling the communication interface to establish HFP Bluetooth connection with the second device under the condition that the communication interface receives a response message for the Bluetooth connection request sent by the second device and determines that the call identification information exists in an incoming call white list.

the call identification information includes at least one of:

a media access control address (Media Access Control Address, MAC) address of the telephony device, an incoming number of the incoming call, an incoming name of the incoming call.

As some embodiments of the present disclosure, the controller is specifically configured to:

after the HFP Bluetooth connection is established with the second device, answering the incoming call received by the second device under the condition that an answering control signal sent by a control device is received;

the controller is further configured to: receiving voice data sent by a control device, wherein the control device is connected with the first equipment based on a universal attribute (Generic Attribute, GATT) protocol (The Human Interface Device Over GATT Profile, hopp) of a human-computer interface equipment;

Forwarding the voice data to the second device.

As some embodiments of the present disclosure, the first device is a call device, the second device is a display device, and the target broadcast message is used to instruct the second device to request to dial the target phone;

the call identification information includes at least one of:

the MAC address of the display device, the number of the target telephone, and name information of the target telephone.

after the HFP Bluetooth connection is established with the second device, voice data sent by the second device is received, the voice data are output, and the voice data are received by the second device through a control device, wherein the control device is connected with the second device through a HOGP mode.

In a second aspect, there is provided a second device comprising: a communication interface configured to:

sending a target broadcast message, wherein the target broadcast message is used for indicating that the second device receives an incoming call, or the target broadcast message is used for indicating that the second device requests to dial a target call;

And receiving an HFP Bluetooth connection request sent by the first equipment, and sending a response message aiming at the Bluetooth connection request to the first equipment.

In a third aspect, a call control method is provided, including: under the condition that a target broadcast message sent by second equipment is monitored, a Bluetooth connection request based on a telephone hands-free protocol HFP is sent to the second equipment, wherein the target broadcast message is used for indicating the second equipment to receive an incoming call or the target broadcast message is used for indicating the second equipment to request to dial a target telephone;

after receiving a response message for the Bluetooth connection request sent by the second device, establishing HFP Bluetooth connection with the second device;

and after establishing HFP Bluetooth connection with the second device, processing the incoming call received by the second device, or controlling the second device to make a call.

In a fourth aspect, a call control method is provided, including: sending a target broadcast message, wherein the target broadcast message is used for indicating that the second device receives an incoming call, or the target broadcast message is used for indicating that the second device requests to dial a target call;

In a fifth aspect, the present disclosure provides a computer-readable storage medium comprising: the computer-readable storage medium stores thereon a computer program which, when executed by a processor, implements the call control method as shown in the third or fourth aspect.

In a sixth aspect, the present disclosure provides a computer program product comprising a computer program which, when run on a computer, causes the computer to implement the call control method as shown in the third or fourth aspect.

According to the device and the call control method, the HFP Bluetooth connection is established between the call device and the display device, the display device is used as an HF role, the call device is used as an AG role, the call device can be supported in the display device to answer a call, the call device is controlled to dial a target call, the role of the central device of the display device is linked with the control device, the display device is controlled to process the call of the display device, and the call is dialed, so that the interaction performance of the device is improved, and even if the call device is far away, the call can be dialed and answered through the control of the display device.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments of the present disclosure or the solutions in the prior art, the drawings that are required for the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 is a schematic view of a scene in some embodiments provided by embodiments of the present disclosure;

FIG. 2 is a block diagram of a configuration of a smart device 300 in some embodiments provided by the present disclosure;

fig. 3 is a block diagram of a configuration of a control device 100 in some embodiments provided by the present disclosure;

fig. 4 is a hardware configuration block diagram of a display device 200 in some embodiments provided by the present disclosure;

fig. 5 is a schematic software configuration diagram of a display device 200 or a smart device 300 in some embodiments provided in the embodiments of the present disclosure;

FIG. 6 is a schematic diagram of a Bluetooth protocol framework;

fig. 7 is a schematic diagram of protocols and entities used in applications of the HFP-based bluetooth protocol;

Fig. 8 is a schematic diagram of a bluetooth framework when HFP protocol is applied in an Android operating system;

FIG. 9 is a diagram illustrating a call function implemented based on HFP;

fig. 10 is a schematic diagram showing association between HFP and a voice module (Audio) in HF of the Android operating system;

fig. 11 is a schematic diagram of a state machine control state in HF of the Android system;

FIG. 12 is a schematic view of another scenario provided by an embodiment of the present disclosure;

FIG. 13 is a schematic view of yet another scenario provided by an embodiment of the present disclosure;

fig. 14 is a flow chart of a call control method according to an embodiment of the disclosure;

fig. 15 is a flowchart of another call control method according to an embodiment of the present disclosure;

fig. 16 is a schematic diagram of an interaction flow between a remote controller and a television in some embodiments provided in the embodiments of the present disclosure;

fig. 17 is a schematic diagram of establishing dual connection between a television and a mobile phone according to an embodiment of the present disclosure;

fig. 18 is a flowchart of a voice forwarding method according to an embodiment of the present disclosure;

fig. 19 is a schematic flow chart of real-time control of pickup of a remote control according to an embodiment of the present disclosure;

fig. 20 is a schematic diagram of a forwarding flow of voice data in the related art according to an embodiment of the present disclosure;

Fig. 21 is a schematic diagram of a forwarding flow of voice data in an embodiment of the present disclosure according to an embodiment of the present disclosure;

fig. 22 is a flowchart of a screen projection control method according to an embodiment of the present disclosure;

fig. 23 is a schematic diagram of a screen interface for displaying a mobile phone on a television according to an embodiment of the disclosure.

Detailed Description

For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided by the embodiment of the application can have various implementation forms, for example, a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table) and the like.

As shown in fig. 1, a schematic view of a scene in some embodiments provided by embodiments of the present disclosure. In fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication, bluetooth protocol communication, and wireless or other wired manner to control the display device 200. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device. The display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, voice instruction control of a user may be directly received through a module for acquiring voice instructions configured inside the display device 200 device, or voice instruction control of a user may be received through a voice control device provided outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

In some embodiments, the smart device 300 may install a software application with the display device 200, implementing connection communication through a network communication protocol, achieving the purpose of one-to-one control operation and data communication. The audio/video content displayed on the intelligent device 300 can also be transmitted to the display device 200, so that the display device 200 can also perform data communication with the server 400 through various communication modes. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The display device 200 may additionally provide an intelligent network television function of a computer support function in addition to the broadcast receiving television function.

In some embodiments, as shown in fig. 2, a block diagram of a configuration of a smart device 300 in some embodiments provided by embodiments of the present disclosure. The smart device 300 includes a controller 310, a communication interface 330, a user input/output interface 340, a memory, a power supply, and the like. The communication interface 330 is configured to communicate with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 340 includes at least one of a microphone, a speaker, a display screen, a sensor, a camera, or an alternative module.

The smart device 300 may be a device supporting a call function, which is called a call device, and the functions of the communication interface 330 and the controller 310 of the smart device 300 are different in different scenarios, and are described below:

in the HFP session scenario:

in one case: the smart device 300 may be referred to as a first device in embodiments of the present disclosure.

The first device may trigger the smart device 300 to place a target call via the display device 200 by interacting with a second device (which may be the display device 200 as shown in fig. 1).

A communication interface 330 in the smart device 300, configured to send a bluetooth connection request based on a phone hands-free protocol HFP to the second device when a target broadcast message sent by the second device is monitored, and establish an HFP bluetooth connection with the second device after receiving a response message for the bluetooth connection request sent by the second device; after establishing the HFP Bluetooth connection with the second device, the target telephone is placed.

The target broadcast message is used for indicating that the second device requests to make a target call.

In some embodiments, the target broadcast message further includes: audio coding, audio channels, sampling rate, sampling depth, etc. and audio feature information supported by the HFP bluetooth connection.

The communication interface 330 is specifically configured to establish an HFP bluetooth connection with the second device based on the audio feature information supported by the HFP bluetooth connection.

Because the audio feature information supported by the HFP bluetooth connection is negotiated before the first device and the second device establish the HFP bluetooth connection, and the audio channels supported by both sides are established, the first device negotiates with the second device based on the audio feature information supported by the HFP bluetooth connection, and establishes the HFP bluetooth connection.

In some embodiments, the call identification information includes at least one of:

the MAC address of the device, the number of the destination phone, and name information of the destination phone are displayed.

In some embodiments, the controller 310 is specifically configured to receive voice data sent by the second device after the HFP bluetooth connection is established with the second device, and output the voice data.

Wherein the control device is connected with the second equipment in a HOGP mode, the voice data is the voice data received by the second equipment through the control device,

In the screen-projection scene:

a communication interface 330, configured to send a first broadcast message when an incoming call is received, where the first broadcast message is used to instruct a call device to receive the incoming call; receiving screen-throwing related information sent by display equipment, and sending a screen-throwing request to the display equipment based on the screen-throwing related information;

and the controller 310 is configured to establish a screen-throwing channel with the display device after receiving a response message of the screen-throwing request sent by the display device, so as to display a screen-throwing interface of the incoming call on the display device.

In some embodiments, the communication interface 330 is further configured to receive a MAC address of the display device sent by the display device; the communication interface 330 is specifically configured to send a screen-throwing request to the display device based on the screen-throwing related information when it is determined that the MAC address of the display device exists in the whitelist.

In some embodiments, the communication interface 330 is specifically configured to receive a scan request sent by the display device. The scanning request comprises information related to screen projection and the MAC address of the display device. The communication interface 330 is further configured to send a screen-casting request to the display device, and receive a scan response message of the scan request sent by the display device, where the scan response message includes audio feature information supported by the HFP bluetooth connection; the controller 310 negotiates the audio feature information supported by the HFP bluetooth connection and establishes the audio channel supported by both sides before establishing the HFP bluetooth connection, so that the first device negotiates with the second device based on the audio feature information supported by the HFP bluetooth connection and establishes the HFP bluetooth connection. The HFP Bluetooth connection is also established with the display equipment according to the audio characteristic information; the audio characteristic information includes one or more of audio coding mode, sound channel, sampling rate, sampling depth.

In another case: the smart device 300 is referred to as a second device in the presently disclosed embodiments.

The first device (which may be the display device 200 shown in fig. 1) may process the incoming call of the smart device 300 through the display device 200 by interacting with the second device. A communication interface 330, configured to send a target broadcast message to the first device in the case of receiving an incoming call, where the target broadcast message is used to instruct the second device to receive the incoming call; and receiving the HFP Bluetooth connection request sent by the first equipment, and sending a response message aiming at the Bluetooth connection request to the first equipment.

Fig. 3 is a block diagram of a configuration of a control device 100 in some embodiments provided by the present disclosure. As shown in fig. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200. The communication interface 130 is configured to communicate with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, keys, or an alternative module.

In some embodiments, the control device 100 may be a remote control, and the control device 100 may be configured to pick up voice data and forward the voice data to a television.

In some embodiments, the control apparatus 100 is further configured to send an instruction (may also be referred to as a control signal) to the display device 200 in response to a touch by a user.

Fig. 4 is a block diagram of a hardware configuration of a display device 200 in some embodiments provided by the present disclosure. As shown in fig. 4, the display device 200 includes: a modem 210, a communication interface 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, and the like. The controller 250 includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, and first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals. The detector 230 is used to collect signals of the external environment or interaction with the outside. The controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box.

In some embodiments, the display device may be a television, a computer, a learning machine, or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

An output interface (display 260, and/or audio output interface 270) for outputting user interaction information;

the communication interface 220 is used for communicating with the server 400 or other devices.

In some embodiments, the communication interface 220 is used to communicate with the control device 100, or the smart device 300.

The functions of the respective modules in the display apparatus 200 are different in different scenarios, and are described below:

in the HFP session scenario:

in one case: the display device 200 may be a first device, the smart device 300 may be a second device, and the HFP session may be implemented by interaction between the display device 200 and the smart device 300, and the incoming call of the smart device 300 may be processed by the display device 200.

A communication interface 220, configured to send a bluetooth connection request based on a phone handsfree protocol HFP to the second device when a target broadcast message sent by the second device is monitored, where the target broadcast message is used to instruct the second device to receive an incoming call; after receiving a response message for the Bluetooth connection request sent by the second device, establishing HFP Bluetooth connection with the second device;

the controller 250 is configured to place a target call after the HFP bluetooth connection is established with the second device.

In some embodiments, the second device is authenticated before the HFP bluetooth connection by the incoming white list to determine whether to establish the HFP bluetooth connection, and the target broadcast message includes: call identification information; the controller 250 is further configured to control the communication interface 220 to send an HFP bluetooth connection request to the second device when it is determined that the call identifier information exists in the incoming white list and the communication interface listens to the target broadcast message sent by the second device.

In some embodiments, the targeted broadcast message further includes audio feature information supported by the HFP bluetooth connection of at least one of the following;

audio coding mode, sound channel, sampling rate and sampling depth;

The communication interface 220 is specifically configured to establish an HFP bluetooth connection with the second device based on the audio feature information supported by the HFP bluetooth connection.

In some embodiments, the second device is verified before the HFP bluetooth connection through the incoming white list, to determine whether to establish the HFP bluetooth connection, where the response message includes call identifier information; the controller 250 is further configured to, when the communication interface 220 receives a response message for the bluetooth connection request sent by the second device and it is determined that the call identifier information exists in the incoming white list, control the communication interface 220 to establish HFP bluetooth connection with the second device.

the MAC address of the call device, the incoming number of the incoming call, and the incoming name of the incoming call.

In some embodiments, the controller 250 is specifically configured to answer an incoming call received by the second device when receiving an answer control signal sent by the control device after the HFP bluetooth connection is established with the second device; the controller 250 is further configured to receive voice data sent by the control device, where the control device is connected to the first device based on the hopp; the voice data is forwarded to the second device.

In another case: the display device 200 may be a second device, with HFP conversation being effected by interaction between a first device (which may be a smart device 300 as shown in fig. 1) and the second device, by triggering the smart device 300 to place a target call on the display device 200.

In some embodiments, the communication interface 220 is configured to send a target broadcast message to the first device when an incoming call is received, where the target broadcast message is used to instruct the second device to request to make a target call; and receiving the HFP Bluetooth connection request sent by the first equipment, and sending a response message aiming at the Bluetooth connection request to the first equipment.

In the screen-projection scene:

in some embodiments, a screen-casting channel may be established, and an interface of the call device is cast onto the display device 200, and the communication interface 220 is configured to receive a first broadcast message sent by the call device, where the first broadcast message is used to indicate that the call device receives an incoming call; transmitting screen-throwing related information to the call equipment, so that the call equipment transmits a screen-throwing request to the display equipment based on the screen-throwing related information; the controller 250 is configured to receive a screen-throwing request sent by the call device, and send a response message of the screen-throwing request to the call device, so as to establish a screen-throwing channel with the call device, so as to control the display 260 to display a screen-throwing interface of an incoming call.

In some embodiments, the communication interface 220 is further configured to send the MAC address of the display device to the call device, so that the call device sends a screen-throwing request to the display device based on the screen-throwing related information if it is determined that the MAC address of the display device exists in the screen-throwing white list.

In some embodiments, the screen throwing related information is sent to the call device through a scanning request.

In some embodiments, the MAC address of the display device is sent to the telephony device via a scan request.

In some embodiments, the screen shot related information is transmitted via a second broadcast message.

In some embodiments, the MAC address of the display device is sent to the telephony device via a second broadcast message.

In some embodiments, after the screen-drop channel is established, the HFP bluetooth connection may be further requested to be established, and the communication interface 220 is further configured to send a target request message to the telephony device, where the target request message is an HFP bluetooth connection request message, or the target request message is used to request the telephony device to send a bluetooth HFP bluetooth connection request message. And sending a target request message to the call equipment, wherein the target request message is an HFP Bluetooth connection request message, or the target request message is used for requesting the call equipment to send the HFP Bluetooth connection request message.

In some embodiments, the communication interface 220 is specifically configured to send a scan request to the call device, where the scan request includes information about screen projection and a MAC address of the display device; the communication interface 220 is further configured to receive a screen-drop request sent by the call device, and send a scan response message of the scan request to the call device, where the scan response message includes audio feature information supported by the HFP bluetooth connection, so that the call device establishes the HFP bluetooth connection with the display device based on the audio feature information; the audio feature information supported by the HFP bluetooth connection includes at least one of:

audio coding scheme, sound channel, sampling rate, sampling depth.

In the voice forwarding scenario:

in some embodiments, the communication interface 220 is configured to receive first voice data sent by the control device, where the control device is connected to the display device based on the HOGP, and the first voice data is voice data based on the HOGP; the controller 250 is configured to transmit voice data to a kernel node of the display device, then convert the first voice data into second voice data through the adaptation driver, and forward the second voice data to the HFP voice driver, where the second voice data is voice data based on a phone hands-free protocol HFP, and write the second voice data to the communication interface through the HFP voice driver;

The communication interface 220 is controlled to forward the second voice data to the telephony device, wherein the telephony device and the display device are connected through HFP bluetooth.

In some embodiments, the communication interface 220 is further configured to send, to the telephony device, a bluetooth connection request based on a phone handsfree protocol HFP, before the receiving the first voice data sent by the control device, when a target broadcast message sent by the telephony device is monitored, where the target broadcast message is used to indicate that the telephony device receives an incoming call; after receiving a response message for the Bluetooth connection request sent by the call equipment, establishing HFP Bluetooth connection with the call equipment; the communication interface 220 is specifically configured to include: after the HFP Bluetooth connection is established with the call equipment, the call equipment receives an incoming call and receives first voice data sent by the control device.

In some embodiments, the communication interface 220 is further configured to: after the HFP Bluetooth connection is established with the communication equipment, a notification message is sent to the control device, wherein the notification message is used for indicating the display equipment to establish the HFP Bluetooth connection with the communication equipment; the communication interface 220 is specifically configured to include: and receiving the first voice data sent by the control device under the condition that the receiving control signal sent by the control device is received so as to receive the incoming call received by the call equipment.

In some embodiments, the communication interface 220 is specifically configured to answer an incoming call received by the call device, where the answering includes: receiving an answering control signal sent by a control device to answer an incoming call received by the call equipment; receiving first voice data sent by a control device in a first time period; the first duration is a duration from receiving an audio input start identifier sent by the control device to receiving an audio input end identifier sent by the control device.

In some embodiments, the targeted broadcast message includes: the call identifier information controller 250 is further configured to, when the communication interface 220 monitors a target broadcast message sent by the call device and determines that call identifier information exists in the incoming white list, control the communication interface 220 to send an HFP bluetooth connection request to the call device;

in some embodiments, the controller 250 is further configured to control the communication interface 220 to send an HFP bluetooth connection request to the call device when the communication interface 220 listens to the target broadcast message sent by the call device and determines that the call identifier information is not present in the incoming blacklist.

In some embodiments, the targeted broadcast message further includes audio feature information for at least one of the following; audio coding mode, sound channel, sampling rate and sampling depth; the communication interface is specifically used for establishing HFP Bluetooth connection with the call equipment based on the audio characteristic information.

In some embodiments, the bluetooth connection request is a bluetooth pairing connection request;

in some embodiments, the bluetooth connection request is a bluetooth echo connection request.

As shown in fig. 5, fig. 5 is a schematic diagram of software configuration of the display device 200 or the smart device 300 in some embodiments provided by the present disclosure, and as shown in fig. 5, the system is divided into four layers, namely, an application layer (abbreviated as "application layer"), an application framework layer (Application Framework) layer (abbreviated as "framework layer"), an Android run layer (abbreviated as "system runtime layer"), a An Zhuoyun-line (Android run layer) and a system library layer (abbreviated as "system runtime layer"), and a kernel layer from top to bottom. The kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In order to more clearly illustrate the aspects of the embodiments of the present disclosure, the concepts related to the related art will be described as follows:

1. HFP base knowledge introduction:

the distinction between HFP and HSP (Headset Profile) is made for bluetooth telephony, and the functions implemented are related to bluetooth telephony.

Wherein, HSP only implements the most basic call operations: answering calls, hanging up calls, adjusting volume, switching sounds between cell phones/bluetooth headsets, etc.

HFP is an extension to HSP, and includes, in addition to the above functions, high-level functions such as controlling three-way call, call rejection, and earphone-side caller identification. In the current Android (Android) operating system design, the two protocols are not separately displayed, but are both expressed as mobile phone audio, when the mobile phone audio is used, HFP is preferentially connected, and only if the opposite party only supports HSP or HFP Bluetooth connection fails, the connection of the HSP is attempted.

The current HFP usage scenario may include a scenario where a mobile phone is connected to a vehicle bluetooth through HFP bluetooth, a scenario where a mobile phone is connected to a bluetooth headset through HFP bluetooth, etc., where two roles of an Audio Gateway (AG) and a Hands Free device (HF) are defined in the HFP usage scenario.

AG is an input/output gateway for audio

HF is a remote audio input/output mechanism for audio gateways and may provide several remote control functions.

Illustratively, in the scenario where the handset is connected to the vehicle bluetooth via HFP bluetooth, the handset is AG and the vehicle bluetooth is HF. Among them, in the Android source code, the AG side is referred to as HFP/AG, and the HF side is referred to as HFP client (HFPClient)/HF.

2. Audio of bluetooth technology communication:

the content of bluetooth technology communications is diverse, with the audio portion containing media audio and telephone audio.

Media audio: data of bluetooth music is played, which has high quality requirements, and the data transmission has a retransmission mechanism, so that the access control list (Access Control List, ACL) link is walked in the form of data of the logical link control and adaptation protocol (Logical Link Control and Adaptation Protocol, L2 cap). The coding mode comprises the following steps: the most basic coding modes are SBC, which is five coding modes, namely subband coding (SBC), advanced audio coding (Advanced Audio Coding, AAC), digital audio compression coding (Audio Processing Technology-X APTX), high resolution APTX (aptx_high Definition, aptx_hd), and wireless audio coding (LDAC), which must be supported by the device supporting bluetooth multimedia playback. The selection of the coding mode requires mutual negotiation determination between Bluetooth connection devices.

Telephone audio: voice data for bluetooth telephony, such audio, has high demands on timeliness, typically by transmitting the data over a special synchronous link (Synchronous Connection Oriented link, SCO) or enhanced SCO (eSCO) link. The coding mode comprises the following steps: continuously variable slope delta modulation voice coding (Continuous Variable Slope Delta, CVSD), modified subband coding (mscb). The most basic coding mode is CVSD, the hands-free Bluetooth device needs to support the coding mode, and the device supporting broadband voice can select mSBC coding data.

3. HFP-based bluetooth protocol framework:

as shown in fig. 6, a schematic diagram of a bluetooth protocol framework is shown in fig. 6, where the bluetooth protocol framework includes: HFP protocol, serial port protocol (Serial Port Profile, SPP), universal access protocol (Generic Access Profile, GAP), service discovery protocol (Service Discover Protocol, SDP), SCO and eSCO, serial emulation protocol (RFCOMM) logical link and adapter protocol (Logical Link and Adaptation Protocol, L2 CAP); host Controller interface (Host Controller interface, HCI) and Controller (S)). The HFP protocol includes: an instruction set (Command Attention, AT CMD) in the command prompt.

Fig. 7 is a schematic diagram of protocols and entities used in applications of the HFP-based bluetooth protocol. The corresponding entities in fig. 7 include an audio gateway side and a handsfree device side, wherein protocols and entities used in the audio gateway side and the handsfree device side are as shown in the figure, and include: application, hands-free control, serial emulation protocol (RFCOMM), session description protocol (Session Description Protocol, SDP), link management protocol (Link Manager Protocol) LMP, L2CAP, baseband (Baseband), wherein an Audio port emulation (Audio Port Emulation) module is provided in Application on the Audio network side, and an Audio driver is provided in Application on the Hands-free device side.

As shown in fig. 8, a schematic diagram of a bluetooth Framework when the HFP protocol is applied in the Android operating system can be seen that the bluetooth Framework can be divided into an application layer, a Java Framework (Framework) layer, a local Framework layer, a Java running environment layer, and a Linnux kernel layer.

The application layer is provided with an Android Bluetooth application program, namely a program using an API of Bluetooth, and the Android Bluetooth application program can comprise: bluetooth setup related applications (Settings), bluetooth debug assistant applications (Phone), bluetooth interface applications (BT Demo), bluetooth application packages (bluetooth. Apk), etc.;

a Bluetooth software development kit (BT SDK) is arranged in a Java Framework (Framework) layer;

a local framework layer provided with a hardware abstraction interface (Hardware abstract interface);

a Java running environment layer provided with a Bluetooth protocol stack (Bluetooth stack);

and the kernel layer is provided with a driver.

As shown in fig. 9, an ACL link needs to be established between HF and AG first, after the ACL link is established, the SDP service discovery HFP protocol may be triggered by an internal event of HF or a user event, or the SDP service discovery HFP protocol may be triggered by an internal time of AG or a user time, then a connection is established by RFCOMM protocol, after the connection is established by RFCOMM protocol, the HFP-based bluetooth connection may be implemented by AT command interaction between HF and AG, and after the HFP-based bluetooth connection is implemented by HF and AG, various phone functions may be implemented based on a handset audio protocol.

Fig. 10 is a schematic diagram showing association between HFP and a voice module (Audio) in HF of the Android operating system. The following association procedure may be included: (1) An Application (APP) may notify a bluetooth virtual host (BT host) in user space (user space) that an HFP bluetooth connection needs to be established (e.g., receive a call on the UI); (2) BT host informs bluetooth firmware (Bluetooth Firmware, BT FW) to establish HFP bluetooth connection via host control layer interface (Host Controller Interface, HCI) instruction (commamd); after HFP bluetooth connection establishment is completed, (3) BT FW notifies BT host that HFP bluetooth connection establishment is completed; (4) BT host informs Audio that an HFP bluetooth connection is currently present, such that Audio is active, (5) Audio and BT FW transmit pulse code modulated (Pulse Code Modulation, PCM) data over an Integrated Circuit (IC) Audio bus (Inter-IC Sound I2S) bus.

the two devices HF and AG need to establish an HFP bluetooth connection first, establish a voice connection after establishing the HFP bluetooth connection, and make a call.

As shown in fig. 12, another schematic view of a scenario provided in an embodiment of the disclosure is shown, where the scenario includes a television 121, a mobile phone 122, and a bluetooth remote controller 123; the HFP Bluetooth connection needs to be established between the television and the mobile phone, and the BLE HOGP Bluetooth connection needs to be established between the television and the Bluetooth remote controller.

As shown in fig. 13, another schematic view of a scenario provided in an embodiment of the present disclosure, where the scenario includes a television 131, a call handset 132, and a control handset 133; the HFP bluetooth connection needs to be established between the tv set 131 and the call handset 132, and a bluetooth connection based on classical bluetooth (Basic Rate/Enhanced Data Rate, BR/EDR) may be selected between the tv set 131 and the control handset 124.

When the control device of the television is a remote controller, as shown in fig. 12, the bluetooth connection based on BLE HOGP is needed for low-power devices such as remote controllers to reduce the power consumption of the devices, and when the control device of the television is a mobile phone, as shown in fig. 13, the bluetooth connection based on BR/EDR is needed for devices such as mobile phones (i.e., control mobile phone 124).

In the following embodiments, an exemplary explanation will be made with a display device as a television, an intelligent device as a mobile phone, and a control device as a remote controller. The television can be used as central equipment, a dual-mode Bluetooth module is carried, meanwhile, the roles of the central equipment are fully utilized, the television is used as a signal transfer center, and Bluetooth voice data forwarding and voice pickup are realized. It can be understood that when the control device in the embodiment of the present disclosure is other non-low power consumption devices such as a mobile phone, the television may also use a single-mode bluetooth device, which only supports BR/EDR.

In the embodiment of the disclosure, the television is connected with the mobile phone through the HFP Bluetooth, the television is used as an HF role, the mobile phone is used as an AG role, and the incoming call answering and dialing of the mobile phone can be supported in the television, so that the call answering and dialing can be realized through the control of the display equipment even if the call equipment is far away. Further, the interaction performance of the equipment is improved and the user experience is also improved by linking the role of the central equipment of the television with the connected internet of things (Internet of things, IOT) equipment (for example, a remote controller).

In the embodiment of the present disclosure, the transmission of a broadcast message is related to the interaction process of a television, a mobile phone and a remote controller, and the broadcast message related to the embodiment of the present disclosure may include:

in some embodiments, the broadcast message referred to in the embodiments of the present disclosure may be connectible non-directional broadcast (Connectable Undirected Event Type):

connectible non-directional broadcasts are one of the most widely used types of broadcasts, including broadcast data and scan response data, and indicate that the current device may accept connection requests from any other device. The device that performs the general broadcast can be scanned by the scanning device or enter a connection as a slave device upon receiving a connection request.

In some embodiments, the broadcast messages referred to in the embodiments of the present disclosure may be connectible targeted broadcasts (Connectable Directed Event Type):

the type of directional broadcast is to set up the connection as soon as possible. Such a message contains two addresses: the address of the broadcaster and the address of the initiator. After receiving the directed broadcast message sent to the initiator, the initiator can immediately send a connection request as a response. The directional broadcast type has special timing requirements. The complete broadcast event must be repeated every 3.75ms, which requires that the scanning device only need to scan 3.75ms to receive the message directed to the broadcasting device.

Since the scanning device only needs to scan 3.75ms to receive the message directed to the broadcasting device, such a fast transmission will flood the broadcasting channel with the message, and thus other devices in the area cannot broadcast. Thus, the directional broadcasting cannot last for more than 1.28 s. If the host does not actively request a stop, or if a connection is not established, the controller automatically stops broadcasting. Once 1.28s is reached, the host can only connect to other devices using much longer interval connectable non-directional broadcasts.

When using directional broadcasting, the device cannot be actively scanned. In addition, the payload of the directional broadcast message cannot carry other additional data. The payload can only contain two necessary addresses.

In some embodiments, the broadcast messages referred to in the embodiments of the present disclosure may be Non-connectible Non-directional broadcasts (Non-connectable Undirected Event Type):

using non-connectible non-directional broadcast means that the device only transmits broadcast data and does not want to be scanned or connected. This is also the only broadcast type available to only the transmitter and not the receiver device. The non-connectible broadcast device does not enter the connected state and therefore it can only switch between the broadcast state and the ready state according to the requirements of the host.

In some embodiments, the broadcast message referred to in the embodiments of the present disclosure may be a scannable non-directional broadcast (Scannable Undirected Event Type):

scannable non-directional broadcasts are also known as discoverable broadcasts, which cannot be used to initiate a connection, but allow other devices to scan the broadcast device, meaning that the device can be discovered. Either broadcast data or scan response data may be sent in response to the scan, but no connection can be established. This is a broadcasting form suitable for broadcasting data, and dynamic data may be included in the broadcasting data, and static data may be included in the scanning response data.

It should be noted that, in the embodiments of the present disclosure, embodiments in various scenarios are described below by taking HFP call scenario, voice conversion scenario, and screen projection scenario as examples, respectively:

for more detailed description of the present solution, the following description will be given by way of example with reference to the accompanying drawings, and it will be understood that the steps involved in the drawings may include more steps or fewer steps when actually implemented, and the order between the steps may also be different, so as to enable the call control method, the voice forwarding method, and the screen-drop control method provided in the embodiments of the present disclosure.

In an HFP call scenario, as shown in fig. 14, a flow chart of a call control method according to an embodiment of the present disclosure is provided, where the method includes:

1401. the mobile phone receives the incoming call.

When receiving the calls made by other devices, the mobile phone receives the incoming calls.

1402. The handset sends the target broadcast message.

Correspondingly, the television receives the target broadcast message sent by the mobile phone.

The target broadcast message is used for indicating the second device to receive the incoming call. The target broadcast message may be a BLE broadcast message.

When the mobile phone receives an incoming call, the mobile phone broadcasts that the mobile phone has the incoming call by sending a BLE broadcast message.

There are two kinds of role center devices (Central) and Peripheral devices (Peripheral) in BLE. The mobile phone is a peripheral device, and the television is a central device. The central device may actively connect to the peripheral device, which transmits a broadcast message or is connected by the central device. The peripheral device is discovered by the central device via a broadcast message which may carry information about the peripheral device itself.

The broadcast message may include: broadcast packets (advertisement Data) and Response packets (Scan Response). Wherein the broadcast packet is that each device must broadcast and the response packet is optional. The broadcast packet includes 31 bytes, and the broadcast packet includes: valid data (significant) and invalid data (non-significant).

The payload data portion comprises a number of broadcast data units (AD structures). The composition of the AD Structure is: the first byte is a length value, denoted "Len", indicating that the next Len bytes are data portions. The first byte of the data portion indicates the Type of data (AD Type), and the remaining Len-1 bytes are true data (AD data). The AD type is very critical, which Data the Data of the AD Data represents, how the AD Data is parsed.

Since the packet length must be 31 bytes, if the valid data portion is less than 31 itself, the remainder is complemented with 0. The data of this part is invalid, i.e. the above-mentioned invalid data part, and is ignored when interpreting the data in the data packet.

The broadcast packet further includes: vendor custom data: in the vendor customized data, the first two bytes represent vendor identification, and the rest is that the vendor adds the vendor according to the requirement, and the data content in the vendor is defined by the vendor, for example, the mac address of the device can be added. In the embodiment of the disclosure, the custom data may be carried in vendor custom data of the broadcast packet, or in scan response.

The custom data in the embodiment of the disclosure can include call identification information and/or audio feature information, and the television can reduce information exchange in the HFP Bluetooth connection process by acquiring the custom data, and can quickly finish quick connection with the mobile phone according to the custom data in a broadcast packet or a scan response.

1403. The television sends an HFP Bluetooth connection request to the mobile phone.

Correspondingly, the mobile phone receives an HFP Bluetooth connection request sent by the television.

In some embodiments, the HFP bluetooth connection request is an HFP-based bluetooth pairing connection request for a case where the tv set and the mobile phone do not establish an HFP bluetooth connection. The television is in a scanning state, monitors a target broadcast message of the mobile phone, and actively initiates a Bluetooth pairing connection request based on HFP to the television.

In some embodiments, the HFP bluetooth connection request is an HFP based bluetooth loopback connection request for the case where the tv set and the mobile phone have already established an HFP bluetooth connection. The television is in a scanning state, and after the television monitors the target broadcast message of the mobile phone, the Bluetooth callback connection request based on HFP can be actively initiated to the television.

In some embodiments, in the case where the tv monitors the target broadcast message sent by the mobile phone, the tv may directly send an HFP bluetooth connection request to the mobile phone.

In some embodiments, the television may further receive call identifier information sent by the mobile phone, so that the television may directly send an HFP bluetooth connection request to the mobile phone when determining that call identifier information exists in the incoming white list.

In some embodiments, the television may send a scan request (scan request) in a scan state, and the call identifier information may be carried in a scan response message (scan response) sent by the mobile phone to the television, or may carry the call identifier information in a scan response message sent by the mobile phone to the television, so that the television may send an HFP bluetooth connection request directly to the mobile phone when the television determines that the call identifier information exists in the incoming white list.

In some embodiments, the target broadcast message includes: call identification information; and under the condition that the television monitors the target broadcast message sent by the mobile phone and determines that the call identifier information exists in the incoming call white list, the television can send an HFP Bluetooth connection request to the mobile phone.

The call identification information comprises one or more of a MAC address of a mobile phone, an incoming call number of an incoming call and an incoming call name of the incoming call. It may be understood that the call identifier information in the embodiments of the present disclosure may further include other information that may identify the mobile phone or an incoming call of the mobile phone, which embodiments of the present disclosure are not limited to.

The incoming call name may refer to a user name of the incoming call device, and the incoming call number may be a number of a subscriber identity card (Subscriber Identity Module, SIM) of the incoming call device.

In some embodiments, a white list of calls may be set in the tv, where the white list of calls may store the MAC address of the device that allows the HFP bluetooth connection to be established, and call information (e.g., a call number, a call name, etc.), after the tv receives call identification information sent by the mobile phone, the call identification information may be compared with information in the white list of calls, and when it is determined that there is information matching the call identification information in the white list of calls, it is considered that there is call identification information in the white list of calls, so that the HFP bluetooth connection may be allowed to be established between the mobile phone and the tv; accordingly, when it is determined that the information matched with the call identification information does not exist in the incoming call white list, the incoming call white list is considered to have no call identification information, so that the target broadcast message sent by the mobile phone can be ignored, and the HFP Bluetooth connection request is not sent to the mobile phone.

In some embodiments, a blacklist of calls may be further set, where the blacklist of calls may store the MAC address of the device that is not allowed to establish the HFP bluetooth connection, and call information (e.g., the caller number, the caller name, etc.) may compare the call identification information with information in the blacklist of calls after the television receives the call identification information sent by the mobile phone, and when it is determined that there is no information matching the call identification information in the blacklist of calls, consider that there is no call identification information in the blacklist of calls, so that the HFP bluetooth connection may be allowed to be established between the mobile phone and the television; accordingly, when it is determined that the incoming call blacklist has the information matching with the call identification information, the incoming call blacklist is considered to have the call identification information, so that the target broadcast message sent by the mobile phone can be ignored, and the HFP Bluetooth connection request is not sent to the mobile phone.

The incoming call white list and the incoming call black list can be used for verifying whether the mobile phone to be subjected to HFP Bluetooth connection is equipment allowed by a television for establishing HFP Bluetooth connection and verifying whether the incoming call name and the incoming call number related to the incoming call of the current mobile phone are the incoming calls allowed by the television for establishing HFP Bluetooth connection, so that the equipment to be connected and the incoming call related information can be verified before the HFP Bluetooth connection is established, and the safety is improved.

1404. The mobile phone sends a response message for the Bluetooth connection request to the television.

Accordingly, the television can receive a response message sent by the mobile phone and aiming at the Bluetooth connection request.

In some embodiments, the response message of the bluetooth connection request includes call identification information; and under the condition that the television receives a response message sent by the mobile phone and aiming at the Bluetooth connection request and determines that call identification information exists in the incoming call white list, controlling the communication interface to establish HFP Bluetooth connection with the second equipment.

1405. And establishing HFP Bluetooth connection between the mobile phone and the television.

The HFP Bluetooth connection is a BR/EDR Bluetooth connection.

In some embodiments, the targeted broadcast message further includes audio feature information supported by the HFP bluetooth connection of at least one of:

audio coding mode, sound channel, sampling rate and sampling depth;

after receiving the audio feature information supported by the mobile phones based on the HFP Bluetooth connection, the television can establish the HFP Bluetooth connection with the mobile phones based on the audio feature information supported by the HFP Bluetooth connection.

Illustratively, there are currently two coding modes for the audio link, CVSD and mSBC, respectively. The coding mode is determined by the negotiation of both parties establishing connection, during the negotiation, both HF and AG will send the own supported audio coding mode to the other party in the AT command "+BRSF", if both parties support the coding negotiation. Specifically, HF can actively inform the AG of the numbers of two coding modes through the AT command of "at+bac" as follows: 1-CVSD;2-mSBC, and the encoding mode of mSBC is adopted when the audio link is established, otherwise, CVSD encoding is adopted. The AG can also reply the encoding mode supported by the HF itself, and finally determines the audio encoding mode supported by both sides to establish HFP Bluetooth connection.

The television can reduce the exchange of information in the HFP Bluetooth connection process by acquiring the audio characteristic information, and quickly connect the television with the mobile phone according to the self-defined data in the broadcast packet or the scan response.

1406. The television processes the incoming call received by the mobile phone.

After the HFP Bluetooth connection is established between the television and the mobile phone, the incoming call received by the mobile phone is answered under the condition that an answer control signal sent by the remote controller is received, voice data sent by the remote controller is received, and after the voice data is received by the television, the voice data is forwarded to the second device. Wherein, the remote controller is connected with the mobile phone based on the HOGP.

The voice data can be voice data obtained by pickup of the remote controller, after the remote controller controls the television to answer the incoming call of the mobile phone, the voice data can be obtained by picking up the voice of the user through the remote controller, and the voice data is sent to the mobile phone through the television, so that the normal call flow can be realized. The method and the device have the advantages that user voice of the opposite terminal device received by the mobile phone is played through the loudspeaker of the television, the user voice of the mobile phone terminal is picked up through the remote controller, corresponding voice data are sent back to the opposite terminal device, so that the mobile phone can be received through the television, and a call flow is realized.

In the above embodiment, in the mobile phone incoming call scene, the mobile phone is connected with the television through the HFP bluetooth, the television is used as the HF role, the mobile phone is used as the AG role, and the mobile phone can support the incoming call answering of the mobile phone in the television, so that the telephone answering through the television is realized, and the mobile phone incoming call can be handled by controlling the television through the linkage of the role of the central equipment of the television and the remote controller, thereby improving the equipment interaction performance and the user experience.

In an HFP call scenario, as shown in fig. 15, another call control method provided in an embodiment of the present disclosure includes:

1501. the television sends a target broadcast message to the mobile phone.

Correspondingly, the mobile phone receives the target broadcast message sent by the television.

The target broadcast message is used for indicating the television to request to dial a target telephone. I.e. the television requests control of the mobile phone to dial the target phone.

The targeted broadcast message may include a broadcast packet or a scan response.

In some embodiments, call identification information may be included in the targeted broadcast message. Wherein the call identification information includes at least one of:

the MAC address of the television, the number of the destination telephone, and name information of the destination telephone.

1502. The handset sends an HFP Bluetooth connection request to the television.

Correspondingly, the television receives an HFP Bluetooth connection request sent by the mobile phone.

In some embodiments, the HFP bluetooth connection request is an HFP-based bluetooth pairing connection request for a case where the tv set and the mobile phone do not establish an HFP bluetooth connection.

In some embodiments, the HFP bluetooth connection request is an HFP based bluetooth loopback connection request for the case where the tv set and the mobile phone have already established an HFP bluetooth connection.

In some embodiments, a dialing blacklist may be further set, where the dialing blacklist may store a MAC address of a device that is not allowed to establish HFP bluetooth connection, and call information (for example, a call number, a call name, etc.) may compare the call identification information with information in the call blacklist after the television receives call identification information sent by the mobile phone, and when it is determined that there is no information matching the call identification information in the call blacklist, it is considered that there is no call identification information in the call blacklist, so that HFP bluetooth connection may be allowed to be established between the mobile phone and the television; accordingly, when it is determined that the incoming call blacklist has the information matching with the call identification information, the incoming call blacklist is considered to have the call identification information, so that the target broadcast message sent by the mobile phone can be ignored, and the HFP Bluetooth connection request is not sent to the mobile phone.

1503. The television sends a response message for the Bluetooth connection request to the mobile phone.

Correspondingly, the mobile phone receives a response message for the Bluetooth connection request sent by the television.

1504. And establishing HFP Bluetooth connection between the mobile phone and the television.

The HFP Bluetooth connection is a BR/EDR Bluetooth connection.

audio coding scheme, sound channel, sampling rate, sampling depth.

After receiving the audio feature information supported by the television set based on the HFP bluetooth connection, the mobile phone may establish an HFP bluetooth connection with the television set based on the audio feature information supported by the HFP bluetooth connection.

1505. The television controls the mobile phone to dial the target telephone.

After HFP Bluetooth connection is established with the second device, voice data sent by the second device is received, the voice data are output, and the voice data are received by the second device through a remote controller, wherein the remote controller is connected with the second device through a HOGP mode.

In the above embodiment, the mobile phone is connected with the television through the HFP bluetooth, the television is used as the HF role, the mobile phone is used as the AG role, the mobile phone can be controlled to dial the target phone through the television, the answering of the phone through the television is realized, the remote controller can be linked with the role of the central equipment of the television, the dialing of the television is controlled, the interaction performance of the equipment is improved, and meanwhile, the user experience is also improved.

In some embodiments, after the tv and the mobile phone establish the HFP bluetooth connection, the tv may send a notification message to the remote controller to notify the remote controller that the tv and the mobile phone establish the HFP bluetooth connection, and may send some control signals to the tv through a control operation on the remote controller to control the tv to process the incoming call received by the mobile phone, for example, answer the incoming call, hang up the incoming call, etc.

As shown in fig. 16, in some embodiments provided by the present disclosure, after the tv and the mobile phone establish the HFP bluetooth connection, the tv may send a notification message to the remote controller to notify the remote controller that the tv and the mobile phone establish the HFP bluetooth connection, and after the remote controller receives the notification message, the remote controller enters an HFP operation mode, in which the remote controller may control the tv to process a call through the mobile phone by sending a control signal to the tv, for example, to answer an incoming call of the mobile phone, or play a target phone through the mobile phone.

In some embodiments, as shown in fig. 17, a schematic diagram of establishing dual connection between a television and a mobile phone is provided in the embodiments of the present disclosure, in addition to establishing an HFP bluetooth connection between a mobile phone 171 and a television 172, a bluetooth low energy (BLE GATT) bluetooth connection may also be established, and the BLE GATT bluetooth connection established between the mobile phone and the television may be used for auxiliary information interaction between the television and the mobile phone.

Wherein, the auxiliary information interaction can comprise at least one of the following information interactions: the IP address of the television, the IP address of the mobile phone, the MAC address of the television, the MAC address of the mobile phone, the audio related information supported by the television and the audio related information supported by the mobile phone. The audio related information may include: coding format, rate of adoption, sampling depth, port information of the application.

In a voice forwarding scenario, as shown in fig. 18, a flow chart of a voice forwarding method provided by an embodiment of the present disclosure is shown, where the method includes the following steps:

1801. the television receives first voice data sent by the remote controller.

The remote controller is connected with the display device based on the HOGP, and the first voice data are voice data based on the HOGP.

The television receives the first voice data sent by the remote controller, specifically, receives the first voice data through a Bluetooth module in the television, and writes the first voice data into a kernel node of the television through a Bluetooth protocol stack.

In some embodiments, the first voice data may be voice data picked up by a remote controller, or the first voice data may be voice data sent to the remote controller by other devices.

In some embodiments, the television receives an incoming call received by the mobile phone after establishing the HFP bluetooth connection with the mobile phone, and receives first voice data sent by the remote controller. For example, the process of processing the voice data obtained by the remote controller in the process of processing the incoming call received by the mobile phone by the television in the HFP call scene can be described.

The process of establishing HFP Bluetooth connection between the television and the mobile phone may include: under the condition that the television monitors a target broadcast message sent by the mobile phone, sending an HFP Bluetooth connection request to the mobile phone, and after receiving a response message sent by the mobile phone and aiming at the Bluetooth connection request, establishing HFP Bluetooth connection with the mobile phone; after the HFP Bluetooth connection is established with the mobile phone, the television receives an incoming call received by the mobile phone and receives first voice data sent by the remote controller.

The target broadcast message is used for indicating that the mobile phone receives an incoming call.

In some embodiments, the bluetooth connection request is a bluetooth pairing connection request.

For the process of establishing HFP bluetooth connection between the television and the mobile phone in the voice forwarding scenario, reference may be made to the process of establishing HFP bluetooth connection between the television and the mobile phone in the HFP call scenario, which is not described herein.

In some embodiments, the foregoing tv set may answer an incoming call received by the mobile phone, and specifically may answer the incoming call received by the mobile phone by receiving an answer control signal sent by the remote controller.

In some embodiments, the television may receive first voice data transmitted by the remote control during a first period of time; the first duration is a duration from receiving an audio input start identifier sent by the remote controller to receiving an audio input end identifier sent by the remote controller.

The input and output of the adaptive drive can be controlled through the keys of the remote controller, if the user does not want real-time pickup, the voice data output of the adaptive drive can be controlled through key triggering, and the voice data output is similar to a mute function in a telephone, only key input triggers the beginning of audio input, and key lifting stops outputting, namely the audio input ends.

For example, the remote controller may receive a pressing operation of a key of the remote controller by a user, trigger the remote controller to transmit an audio input start identifier to the television in response to the pressing operation, and start continuous pickup, trigger end pickup for a cancel operation of the pressing operation after a first time, and transmit an audio input end identifier to the television.

As shown in fig. 19, an exemplary flow chart for controlling pickup of a remote controller in real time according to an embodiment of the present disclosure is provided, when the remote controller presses a key, the remote controller sends an audio input start identifier (voice start) to the television, and starts pickup and transmits voice data obtained by pickup of the remote controller to the television, after the television receives the voice start, the first voice data is ready to be received, after the remote controller cancels the pressing of the key, the pickup is stopped, the remote controller sends an audio input end identifier (voice stop) to the television, after the television receives the voice stop, the reception of the voice data obtained by pickup of the remote controller is stopped, wherein the first voice data is the voice data obtained by pickup of the remote controller from the time when the television receives the voice start to the time when the voice stop is received.

In some embodiments, after the HFP bluetooth connection is established with the mobile phone, a notification message is sent to the remote controller, where the notification message is used to instruct the television to establish the HFP bluetooth connection with the mobile phone, and the television receives an incoming call received by the mobile phone and receives first voice data sent by the remote controller when receiving an answer control signal sent by the remote controller.

1802. The television transmits the first voice data to a kernel node of the display device.

The kernel node is a kernel hidrownode and is also written as a kernel hidrownode.

The hidraw node is a man-machine interaction node provided by an operating system linux kernel of the television for a universal serial bus (Universal Serial Bus, USB) and Bluetooth in a user space, and can be used for realizing USB or Bluetooth communication, and further, other functions such as equipment firmware upgrading and the like can be completed.

In the embodiment of the disclosure, after the television receives the first voice data, the first voice data can be directly transmitted to the kernel node of the display device, so that the user-state complex process forwarding is not needed, and the user-state complex process forwarding is directly entered.

1803. The television obtains first voice data in the kernel node through the adaptive driver.

In the embodiment of the disclosure, a special adaptation driver is set for forwarding voice data, and based on the adaptation driver, conversion of different protocol data can be realized.

1804. The television converts the first voice data into the second voice data through the adaptive drive.

Wherein the second voice data is HFP-based voice data.

1805. The television forwards the second voice data in the adaptation drive to the HFP voice drive.

In this embodiment of the present disclosure, the voice driver may be an HFP voice driver that is designed separately, and the adaptation driver is an adaptation driver set for the hid data in the kernel node.

Based on the adaptation driver, the HOGP based voice data may be converted into HFP based voice data.

1806. The television writes the second voice data to the communication interface of the television through HFP voice driving.

1807. The television forwards the second voice data to the mobile phone through the communication interface.

The television serves as a central device, receives the first voice data sent by the remote controller, and after converting the first voice data into the second voice data, can also forward the second voice data to the mobile phone.

Under the condition that the protocol according to which the Bluetooth connection is established between the television and the remote controller is different from the protocol according to which the Bluetooth connection is established between the television and the mobile phone, before the voice data is forwarded, the first voice data is required to be converted into the second voice data, so that the data forwarding between different devices of the Bluetooth connection of the television based on different protocols can be realized.

The voice forwarding method provided by the embodiment of the disclosure can simplify the complex forwarding flow of the user state and the kernel state in the voice forwarding process and improve the forwarding efficiency of voice data.

In the related art, in the forwarding process of voice data, user state flow forwarding is performed in the television, and then kernel state flow forwarding is performed. An exemplary forwarding flow of voice data in the related art is shown in fig. 20. As can be seen from fig. 20, after receiving the first voice data sent by the remote controller, the bluetooth module in the television writes the first voice data into the kernel node of the television through the bluetooth protocol stack, reads the first voice data in the kernel node in a user mode, sends the first voice data to the voice Service (Audio Service) and the voice hardware abstraction module (Audio hal) in the television for processing, converts the first voice data into second voice data, sends the second voice data to the voice driver, and finally sends the second voice data to the mobile phone through the bluetooth module of the television. In the forwarding flow shown in fig. 20, firstly, processing is performed by a bluetooth protocol stack in a user state, then a kernel node in a kernel state is written, then the user state is entered and processed by the Audio Service and the Audio hal, and finally, conversion of voice data in different protocols can be realized.

Exemplary, as shown in fig. 21, a schematic diagram of a forwarding flow of voice data in an embodiment of the disclosure is provided in an embodiment of the disclosure. As can be seen from fig. 21, after receiving the first voice data sent by the remote controller, the bluetooth module in the television writes the first voice data into the kernel node of the television through the bluetooth protocol stack, then reads the first voice data in the kernel node to the adaptation driver in the kernel mode, converts the first voice data into the second voice data, then sends the second voice data to the voice driver, and finally sends the second voice data to the mobile phone through the bluetooth module of the television. The whole process finishes the conversion of the first voice data and the second voice data in the kernel mode, simplifies the complex forwarding process of the user mode and the kernel mode in the related technology, and improves the forwarding efficiency of the voice data.

In a screen-projection scenario, as shown in fig. 22, an embodiment of the present disclosure provides a screen-projection control method, which includes:

2201. the mobile phone receives the incoming call.

2202. The handset sends a first broadcast message to the television.

Correspondingly, the television receives a first broadcast message sent by the mobile phone.

The first broadcast message is used for indicating that the mobile phone receives an incoming call.

When the mobile phone receives an incoming call, the mobile phone can send a first broadcast message.

Wherein the first broadcast message is a BLE broadcast message.

In some embodiments, the first broadcast message may be a directional broadcast packet, which may improve the efficiency with which the mobile phone is discovered. If the MAC address of the television is known, a directional broadcast packet can be sent, with the MAC address of the television carried in the directional broadcast packet.

In some embodiments, the first broadcast message may also be a non-directional broadcast packet.

In some embodiments, the first broadcast message may include: the MAC address of the mobile phone (i.e., the MAC address of the wireless WIFI of the mobile phone), the mobile phone identifier, the incoming call information, etc.

2203. And the television sends the relevant information of screen throwing to the mobile phone.

In some embodiments, after the television receives the first broadcast message sent by the mobile phone, the television may directly send the screen-casting related information to the mobile phone.

In some embodiments, after the television receives the first broadcast message sent by the mobile phone, it is determined that the mobile phone has an incoming call, and after the mobile phone is judged to be a device allowing to establish a screen-throwing channel according to the MAC address of the mobile phone, the incoming call information, and the like, the television sends screen-throwing related information to the mobile phone.

The method comprises the steps that a screen throwing white list can be set in a television, the screen throwing white list is compared with the MAC address and the telephone information of equipment recorded in the screen throwing white list according to the MAC address, the incoming call information and the like of a mobile phone, and when the fact that information matched with the MAC address, the incoming call information and the like of the mobile phone exists in the screen throwing white list is determined, the mobile phone is determined to be equipment allowing a screen throwing channel to be established. In some embodiments, the tv set may also send the MAC address of the tv set, i.e. the MAC address of the wireless WIFI of the tv set, to the mobile phone.

In some embodiments, the television may send the screen-casting related information to the mobile phone through a scan request, or the television may send the screen-casting related information to the mobile phone through a second broadcast message.

In some embodiments, the tv may send the MAC address of the tv to the mobile phone through a scan request, or the tv may send the screen-cast related information to the mobile phone through a second broadcast message.

In some embodiments, the television may also send a scan request to the mobile phone, and after the television receives a scan response sent by the mobile phone, the television confirms that the mobile phone has received information about the screen of the television. The screen-throwing related information and the MAC address of the television can be sent through the same message, for example, the television sends a scanning request to the mobile phone, the scanning request comprises the screen-throwing related information and the MAC address of the television, the mobile phone correspondingly receives the scanning request sent by the television, the scanning request comprises the screen-throwing related information and the MAC address of the television, and the mobile phone replies a scan response to the television, so that the television confirms that the screen-throwing related information and the MAC address of the television are received.

2204. And the mobile phone sends a screen throwing request to the television based on the screen throwing related information.

Wherein, the screen-throwing related information can comprise at least one of the following information: the IP address of the television, the MAC address of the television, the port information of the screen-throwing application network, the channel information, the authentication related information and the like.

After receiving the relevant information of screen throwing, the mobile phone can quickly search for the television, and perform authentication verification to quickly establish a screen throwing channel.

In some embodiments, after the television receives the scan response information of the mobile phone and receives the screen-casting request sent by the mobile phone, the television also sends a scan response to the mobile phone to confirm and requests the mobile phone to send an HFP connection request.

In some embodiments, after the mobile phone receives the MAC address of the television, the mobile phone sends a screen-throwing request to the television based on the screen-throwing related information if it is determined that the MAC address of the television exists in the screen-throwing white list.

The method comprises the steps that the MAC address of equipment allowing a screen-throwing channel to be built can be stored in a screen-throwing white list of a mobile phone, and when the MAC address of the television exists in the screen-throwing white list, the mobile phone is confirmed to build the screen-throwing channel with the television, and at the moment, a screen-throwing request is sent to the television.

In some embodiments, the mobile phone sends a screen-throwing request to the television, and receives a scanning response message of a scanning request sent by the television, wherein the scanning response message comprises audio feature information supported by HFP Bluetooth connection;

establishing HFP Bluetooth connection with the television according to the audio characteristic information;

the audio feature information supported by the HFP bluetooth connection includes one or more of audio coding mode, sound channel, sampling rate, and sampling depth.

2205. And the television sends a response message of the screen throwing request to the mobile phone.

The television receives a screen throwing request sent by the mobile phone and sends a scanning response message of the scanning request to the mobile phone, wherein the scanning response message comprises audio characteristic information supported by HFP Bluetooth connection, so that the mobile phone establishes HFP Bluetooth connection with the television based on the audio characteristic information;

2206. and the television and the mobile phone establish a screen-throwing channel.

2207. And displaying a screen-throwing interface of the incoming call on the television.

And displaying a screen-throwing interface of the mobile phone on the television, wherein the screen-throwing interface is the screen-throwing interface of the incoming call because the incoming call is received by the current mobile phone.

As shown in fig. 23, a schematic diagram of a screen-throwing interface of a mobile phone displayed on a television according to an embodiment of the present disclosure is shown in fig. 23, in which, after a screen-throwing channel is established between the television and the mobile phone, the mobile phone 231 receives a third call, a screen-throwing interface 232a may be displayed on the television 232, and the screen-throwing interface 232a displays the content of the interface in the mobile phone 231.

In the above embodiment, in the mobile phone call scene, through the interaction between the mobile phone and the television, a screen-throwing channel can be established between the mobile phone and the television, and the screen-throwing interface of the call is displayed on the television, so that the call interface on the mobile phone is displayed through the television, the user can conveniently check the call information (for example, the call number or the call name), the interaction performance of the device is improved, and the user experience is also improved.

In some embodiments, the television may further send a target request message to the mobile phone, where the target request message is an HFP bluetooth connection request message, or the target request message is used to request the mobile phone to send a bluetooth HFP bluetooth connection request message, so as to request the mobile phone to establish an HFP bluetooth connection with the television. The manner of establishing the HFP bluetooth connection between the mobile phone and the television is described in detail in the embodiments of other scenarios, and will not be described herein.

After the HFP bluetooth connection is established between the television and the mobile phone, the incoming call of the mobile phone can be answered through the television, specifically, the manner of answering the incoming call of the mobile phone through the television is also described in detail in the embodiments of other scenes, and the details are not repeated here.

Furthermore, in the incoming call scene of the mobile phone, a screen-throwing channel can be established between the mobile phone and the television, a screen-throwing interface of the incoming call can be displayed on the television, and HFP Bluetooth connection between the mobile phone and the television can be established, so that the incoming call interface on the mobile phone can be displayed through the television to facilitate a user to check incoming call information, the television can answer the incoming call on the mobile phone or hang up the incoming call on the mobile phone through HFP Bluetooth connection, the control of the user on the mobile phone is facilitated, the interaction performance of equipment is improved, and meanwhile, the user experience is also improved.

The disclosed embodiments provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs at least one of the following:

each process executed by the television in the call control method;

each process executed by the mobile phone in the call control method;

and each process executed by the remote controller in the call control method.

The disclosed embodiments also provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs at least one of the following:

Each process executed by the television in the voice forwarding method;

each process executed by the mobile phone in the voice forwarding method;

and each process executed by the remote controller in the voice forwarding method.

each process executed by the television in the screen-throwing control method;

each process executed by the mobile phone in the screen-throwing control method;

and each process executed by the remote controller in the screen-throwing control method.

The computer readable storage medium may be a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, an optical disk, or the like.

The present disclosure provides a computer program product, which includes a computer program, and when the computer program runs on a computer, makes the computer implement at least one of the above-mentioned call control method, voice forwarding method and screen-drop control method.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the above discussion in some examples is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A first device, comprising:

a communication interface configured to: and under the condition that a target broadcast message sent by a second device is monitored, sending a telephone hands-free protocol HFP Bluetooth connection request to the second device, wherein the target broadcast message is used for indicating that the second device receives an incoming call, or the target broadcast message is used for indicating that the second device requests to dial a target telephone, and the target broadcast message comprises the following components: call identification information; the call identification information includes at least one of: displaying the MAC address of the equipment, the number of the target telephone and the name information of the target telephone; the target broadcast message further includes audio feature information supported by the HFP bluetooth connection, at least one of: audio coding mode, sound channel, sampling rate and sampling depth;

the communication interface is specifically configured to: establishing an HFP Bluetooth connection with the second device based on audio feature information supported by the HFP Bluetooth connection;

2. The first device of claim 1, wherein the first device is a display device and the second device is a call device, and wherein the targeted broadcast message is configured to instruct the call device to receive the incoming call;

3. The first device of claim 1, wherein the first device is a display device, the second device is a call device, and the response message includes call identification information;

4. A first device according to any of claims 2 or 3, wherein the first device is a display device and the second device is a telephony device, and wherein the targeted broadcast message is used to instruct the telephony device to receive the incoming call.

5. The first device of claim 4, wherein the controller is specifically configured to:

the controller is further configured to: receiving voice data sent by a control device, wherein the control device is connected with the first equipment based on HOGP;

forwarding the voice data to the second device.

6. The first device of claim 1, wherein the first device is a telephony device and the second device is a display device, and wherein the target broadcast message is used to instruct the second device to request to place the target call.

7. The first device of claim 6, wherein the controller is specifically configured to:

8. A second device, comprising:

a communication interface configured to:

sending a target broadcast message, wherein the target broadcast message is used for indicating that the second device receives an incoming call, or the target broadcast message is used for indicating that the second device requests to dial a target call, and the target broadcast message comprises: call identification information; the call identification information includes at least one of: displaying the MAC address of the equipment, the number of the target telephone and the name information of the target telephone; the target broadcast message further comprises audio feature information supported by the HFP Bluetooth connection at least one of the following: audio coding mode, sound channel, sampling rate and sampling depth; establishing an HFP Bluetooth connection with the second device based on audio feature information supported by the HFP Bluetooth connection;

9. A call control method, comprising:

and under the condition that a target broadcast message sent by a second device is monitored, sending an HFP Bluetooth connection request to the second device, wherein the target broadcast message is used for indicating that the second device receives an incoming call, or the target broadcast message is used for indicating that the second device requests to dial a target telephone, and the target broadcast message comprises the following components: call identification information; the call identification information includes at least one of: displaying the MAC address of the equipment, the number of the target telephone and the name information of the target telephone; the target broadcast message further includes audio feature information supported by the HFP bluetooth connection, at least one of: audio coding mode, sound channel, sampling rate and sampling depth; establishing an HFP Bluetooth connection with the second device based on audio feature information supported by the HFP Bluetooth connection;