CN114844736A

CN114844736A - Equipment and call control method

Info

Publication number: CN114844736A
Application number: CN202210317361.3A
Authority: CN
Inventors: 邓子敬; 曹圆圆; 郑鹏
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-03-28
Filing date: 2022-03-28
Publication date: 2022-08-02
Anticipated expiration: 2042-03-28
Also published as: CN114844736B

Abstract

The disclosure relates to equipment and a call control method, and relates to the technical field of communication. The method comprises the following steps: under the condition that a target broadcast message sent by the second device is monitored, the first device sends a phone hands-free protocol (HFP) Bluetooth connection request to the second device, wherein the target broadcast message is used for indicating that the second device receives an incoming call, or the target broadcast message is used for indicating that the second device requests to dial a target phone; establishing an HFP bluetooth connection with the second device after receiving a response message for the bluetooth connection request transmitted by the second device; and after the HFP Bluetooth connection is established with the second device, processing the incoming call received by the second device, or controlling the second device to make a call. The embodiment of the disclosure is used for realizing the telephone dialing and the telephone answering of the second equipment through the first equipment.

Description

Equipment and call control method

Technical Field

The present disclosure relates to the field of communications technologies, and in particular, to an apparatus and a call control method.

Background

The smart home can facilitate the life of a user. In actual life, when a user wants to make a call or answer a call in a situation where a call device such as a mobile phone of the user is far away from the user, the user needs to perform an operation after searching for the mobile phone, and cannot make and answer the call in a place far away from the mobile phone.

Disclosure of Invention

In order to solve the technical problem or at least partially solve the technical problem, the present disclosure provides a device and a call control method, which can implement call making and call receiving of a second device through a first device.

In order to achieve the above purpose, the technical solutions provided by the embodiments of the present disclosure are as follows:

in a first aspect, a first device is provided, which includes:

a communication interface configured to: under the condition that a target broadcast message sent by a second device is monitored, sending a Bluetooth connection request based on a telephone Hands-free protocol (HFP) to the second device, wherein the target broadcast message is used for indicating that the second device receives an incoming call, or indicating that the second device requests to dial a target telephone;

the communication interface further configured to: establishing an HFP Bluetooth connection with the second device after receiving a response message for the Bluetooth connection request transmitted by the second device;

a controller configured to: and after the HFP Bluetooth connection is established with the second device, processing the incoming call received by the second device, or dialing the target telephone.

As some embodiments of the present disclosure, the first device is a display device, the second device is a communication device, and the target broadcast message is used to indicate that the communication device receives the incoming call;

the target broadcast message comprises: call identification information;

the controller further configured to: and controlling the communication interface to send an HFP Bluetooth connection request to the second device under the condition that the communication interface monitors a target broadcast message sent by the second device and determines that the call identification information exists in a call white list.

As some embodiments of the disclosed embodiments, the targeted broadcast message further includes audio feature information supported by the HFP bluetooth connection of at least one of the following;

audio coding mode, sound channel, sampling rate and sampling depth;

the communication interface is specifically configured to: establishing an HFP Bluetooth connection with the second device based on the audio feature information supported by the HFP Bluetooth connection.

As some embodiments of the present disclosure, the first device is a display device, the second device is a call device, and the response message includes call identification information;

the controller further configured to: and controlling the communication interface to establish HFP Bluetooth connection with the second device under the condition that the communication interface receives a response message aiming at the Bluetooth connection request sent by the second device and determines that the call identification information exists in a call white list.

the call identification information includes at least one of:

a Media Access Control (MAC) Address of the communication device, a call number of the incoming call, and a call name of the incoming call.

As some embodiments of the present disclosure, the controller is specifically configured to:

after the HFP Bluetooth connection with the second equipment is established, answering the incoming call received by the second equipment under the condition of receiving an answering control signal sent by a control device;

the controller further configured to: receiving voice data sent by a control Device, wherein The control Device is connected with The first Device based on a General Attribute (GATT) protocol (HOGP) of a Human Interface Device;

forwarding the voice data to the second device.

As some embodiments of the present disclosure, the first device is a call device, the second device is a display device, and the target broadcast message is used to indicate the second device to request to dial the target phone;

the call identification information includes at least one of:

the MAC address of the display equipment, the number of the target telephone and the name information of the target telephone.

As some embodiments of the disclosed embodiments, the controller is specifically configured to:

after the HFP Bluetooth connection with the second device is established, receiving voice data sent by the second device, and outputting the voice data, wherein the voice data is the voice data received by the second device through a control device, and the control device is connected with the second device through a HOGP mode.

In a second aspect, there is provided a second apparatus comprising: a communication interface configured to:

sending a target broadcast message, wherein the target broadcast message is used for indicating that the second device receives an incoming call, or the target broadcast message is used for indicating that the second device requests to dial a target telephone;

receiving an HFP Bluetooth connection request sent by the first device, and sending a response message aiming at the Bluetooth connection request to the first device.

In a third aspect, a call control method is provided, including: under the condition that a target broadcast message sent by a second device is monitored, sending a Bluetooth connection request based on a phone hands-free protocol (HFP) to the second device, wherein the target broadcast message is used for indicating that the second device receives an incoming call, or indicating that the second device requests to dial a target phone;

establishing an HFP Bluetooth connection with the second device after receiving a response message for the Bluetooth connection request transmitted by the second device;

after the HFP Bluetooth connection is established with the second device, the incoming call received by the second device is processed, or the second device is controlled to make a call.

In a fourth aspect, a call control method is provided, including: sending a target broadcast message, wherein the target broadcast message is used for indicating that the second device receives an incoming call, or the target broadcast message is used for indicating that the second device requests to dial a target telephone;

In a fifth aspect, the present disclosure provides a computer-readable storage medium comprising: the computer-readable storage medium stores thereon a computer program that, when executed by a processor, implements the call control method as shown in the third or fourth aspect.

In a sixth aspect, the present disclosure provides a computer program product comprising a computer program which, when run on a computer, causes the computer to implement the call control method as shown in the third or fourth aspect.

According to the device and the call control method provided by the embodiment of the disclosure, the call device is connected with the display device through HFP Bluetooth, the display device serves as an HF role, the call device serves as an AG role, the call device can be supported in the display device to answer an incoming call, the call device is controlled to make a target call, the display device can be linked with the control device through the role of the central device of the display device, the display device is controlled to process the incoming call of the display device and make a call, the interaction performance of the device is improved, and the call can be made and answered through the control of the display device even when the call device is far away.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.

Fig. 1 is a schematic view of a scenario in some embodiments provided by embodiments of the present disclosure;

fig. 2 is a block diagram of a configuration of a smart device 300 in some embodiments provided by embodiments of the present disclosure;

fig. 3 is a block diagram of a configuration of the control device 100 in some embodiments provided by the embodiments of the present disclosure;

fig. 4 is a block diagram of a hardware configuration of the display device 200 in some embodiments provided by the embodiments of the present disclosure;

fig. 5 is a schematic software configuration diagram of the display device 200 or the smart device 300 in some embodiments provided by the embodiments of the present disclosure;

FIG. 6 is a schematic diagram of a Bluetooth protocol framework;

fig. 7 is a schematic diagram of protocols and entities used in an application by the HFP-based bluetooth protocol;

fig. 8 is a schematic diagram of a bluetooth framework when an HFP protocol is applied in an Android operating system;

fig. 9 is a schematic diagram of implementing a call function based on HFP;

FIG. 10 is a schematic diagram of HFP and Audio module (Audio) association in HF of Android operating system;

FIG. 11 is a schematic diagram of a state machine control state in HF of an Android system;

fig. 12 is a schematic view of another scenario provided by an embodiment of the present disclosure;

fig. 13 is a schematic view of another scenario provided by the embodiment of the present disclosure;

fig. 14 is a flowchart illustrating a call control method according to an embodiment of the disclosure;

fig. 15 is a flowchart illustrating another call control method according to an embodiment of the present disclosure;

fig. 16 is a schematic view illustrating an interaction flow between a remote controller and a television in some embodiments provided by the present disclosure;

fig. 17 is a schematic diagram of establishing a dual connection between a television and a mobile phone according to an embodiment of the present disclosure;

fig. 18 is a schematic flowchart of a voice forwarding method according to an embodiment of the present disclosure;

fig. 19 is a schematic flow chart illustrating a process of controlling pickup of a remote controller in real time according to an embodiment of the present disclosure;

fig. 20 is a schematic diagram illustrating a forwarding flow of voice data in a related art according to an embodiment of the disclosure;

fig. 21 is a schematic diagram illustrating a forwarding flow of voice data in an embodiment of the present disclosure;

fig. 22 is a schematic flowchart of a screen projection control method according to an embodiment of the present disclosure;

fig. 23 is a schematic diagram illustrating a screen projection interface of a mobile phone displayed on a television according to an embodiment of the present disclosure.

Detailed Description

To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided by the embodiment of the present application may have various implementation forms, and for example, the display device may be a television, a smart television, a laser projection device, a display (monitor), an electronic whiteboard (electronic whiteboard), an electronic desktop (electronic table), and the like.

As shown in fig. 1, a scene schematic in some embodiments is provided for embodiments of the present disclosure. In fig. 1, a user may operate the display apparatus 200 through the smart device 300 or the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication, a bluetooth protocol communication, a wireless or other wired method to control the display device 200. The user may input a user command through a key on a remote controller, voice input, control panel input, etc. to control the display apparatus 200.

In some embodiments, a smart device 300 (e.g., a mobile terminal, a tablet, a computer, a laptop, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received by a module configured inside the display device 200 to obtain the voice command, or may be received by a voice control device provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

In some embodiments, the smart device 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. The audio and video content displayed on the intelligent device 300 can also be transmitted to the display device 200, so that the display device 200 with the synchronous display function can also perform data communication with the server 400 through multiple communication modes. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function.

In some embodiments, as shown in fig. 2, a block diagram of a configuration of a smart device 300 in some embodiments is provided for embodiments of the present disclosure. The smart device 300 includes a controller 310, a communication interface 330, a user input/output interface 340, a memory, a power supply, and the like. The communication interface 330 is used for communicating with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 340 includes at least one of a microphone, a speaker, a display screen, a sensor, a camera, or an alternative module.

The smart device 300 may be a device supporting a call function, and is called a call device, and the functions of the communication interface 330 and the controller 310 of the smart device 300 are different in different scenarios, which are described below:

in the HFP call scenario:

in one case: the smart device 300 may be referred to as a first device in embodiments of the present disclosure.

The first device may trigger the smart device 300 to dial the target phone through the display device 200 by interacting with the second device (which may be the display device 200 shown in fig. 1).

The communication interface 330 in the smart device 300 is configured to send a bluetooth connection request based on the phone hands-free protocol HFP to the second device if a target broadcast message sent by the second device is monitored, and establish a bluetooth connection with the second device HFP after receiving a response message for the bluetooth connection request sent by the second device; after the HFP bluetooth connection is established with the second device, the target phone is dialed.

Wherein the target broadcast message is used to indicate that the second device requests to make the target phone call.

In some embodiments, the target broadcast message further comprises: one or more of audio feature information supported by the HFP Bluetooth connection, such as an audio coding mode, a sound channel, a sampling rate, a sampling depth and the like.

The communication interface 330 is specifically configured to establish the HFP bluetooth connection with the second device based on the audio feature information supported by the HFP bluetooth connection.

Before the first device and the second device establish the HFP for bluetooth connection, the audio feature information supported by the HFP bluetooth connection is negotiated, and the audio channels supported by both sides are established, so that the first device negotiates with the second device based on the audio feature information supported by the HFP bluetooth connection, and establishes the HFP bluetooth connection.

In some embodiments, the call identification information includes at least one of:

displaying MAC address of the device, number of the target telephone and name information of the target telephone.

In some embodiments, the controller 310 is specifically configured to receive the voice data sent by the second device after the HFP bluetooth connection is established with the second device, and output the voice data.

Wherein the control device is connected with the second equipment by HOGP mode, the voice data is the voice data received by the second equipment through the control device,

in the screen projection scene:

a communication interface 330, configured to send a first broadcast message when an incoming call is received, where the first broadcast message is used to indicate that a call device receives the incoming call; receiving screen projection related information sent by display equipment, and sending a screen projection request to the display equipment based on the screen projection related information;

and the controller 310 is configured to establish a screen projection channel with the display device after receiving a response message of the screen projection request sent by the display device, so as to display a screen projection interface of the incoming call on the display device.

In some embodiments, the communication interface 330 is further configured to receive the MAC address of the display device sent by the display device; the communication interface 330 is specifically configured to send a screen projection request to the display device based on the screen projection related information when it is determined that the MAC address of the display device exists in the white list.

In some embodiments, the communication interface 330 is specifically configured to receive a scan request sent by a display device. The scanning request comprises screen projection related information and the MAC address of the display device. The communication interface 330 is further configured to send a screen projection request to the display device, and receive a scanning response message of the scanning request sent by the display device, where the scanning response message includes audio feature information supported by HFP bluetooth connection; the controller 310 negotiates the audio feature information supported by the HFP bluetooth connection before the HFP bluetooth connection is established, and establishes the audio channels supported by both sides, so that the first device negotiates with the second device based on the audio feature information supported by the HFP bluetooth connection, and establishes the HFP bluetooth connection. The audio processing device is also used for establishing HFP Bluetooth connection with the display device according to the audio characteristic information; the audio characteristic information comprises one or more of audio coding mode, sound channel, sampling rate and sampling depth.

In another case: the smart device 300 is referred to as a second device in the embodiments of the present disclosure.

The first device (which may be the display device 200 shown in fig. 1) may enable processing of incoming calls of the smart device 300 through the display device 200 by interacting with the second device. A communication interface 330, configured to send a target broadcast message to the first device in a case that an incoming call is received, where the target broadcast message is used to indicate that the second device receives the incoming call; receiving an HFP Bluetooth connection request sent by the first device, and sending a response message aiming at the Bluetooth connection request to the first device.

Fig. 3 is a block diagram of a configuration of the control device 100 in some embodiments provided by the embodiments of the present disclosure. As shown in fig. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. The communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key, or an alternative module.

In some embodiments, the control device 100 may be a remote controller, and the control device 100 may be configured to pick up voice data and forward the voice data to the television.

In some embodiments, the control apparatus 100 is further configured to send an instruction (which may also be referred to as a control signal) to the display device 200 in response to a user's touch.

Fig. 4 is a block diagram of a hardware configuration of the display device 200 in some embodiments provided by the embodiments of the present disclosure. As shown in fig. 4, the display device 200 includes: a tuner demodulator 210, a communication interface 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and the like. The controller 250 includes a central processing unit, a video processor, an audio processor, a graphic processor, a RAM, a ROM, a first interface to an nth interface for input/output, among others. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner demodulator 210 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals. The detector 230 is used to collect signals of the external environment or interaction with the outside. The controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the display device may be a television, a computer, a learning machine, or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

An output interface (display 260, and/or audio output interface 270) for outputting user interaction information;

a communication interface 220 for communicating with the server 400 or other devices.

In some embodiments, the communication interface 220 is used to communicate with the control apparatus 100, or the smart device 300.

The functions of the modules in the display device 200 are different in different scenes, and are described below:

in the HFP call scenario:

in one case: the display device 200 may be a first device, the smart device 300 may be a second device, and the display device 200 interacts with the smart device 300 to realize HFP conversation, so that incoming calls of the smart device 300 are processed through the display device 200.

A communication interface 220, configured to send a bluetooth connection request based on a phone hands-free protocol HFP to the second device in a case of monitoring a target broadcast message sent by the second device, where the target broadcast message is used to indicate that the second device receives an incoming call; establishing an HFP bluetooth connection with the second device after receiving a response message for the bluetooth connection request transmitted by the second device;

a controller 250 for dialing a target phone after the HFP bluetooth connection is established with the second device.

In some embodiments, the second device is verified before HFP bluetooth connection through the white list of incoming calls, and whether HFP bluetooth connection is established is determined, wherein the target broadcast message includes: call identification information; the controller 250 is further configured to control the communication interface to send an HFP bluetooth connection request to the second device when the communication interface 220 monitors a target broadcast message sent by the second device and determines that the call white list has the call identification information.

In some embodiments, the target broadcast message further includes audio feature information supported by the HFP bluetooth connection of at least one of;

audio coding mode, sound channel, sampling rate and sampling depth;

the communication interface 220 is specifically configured to establish the HFP bluetooth connection with the second device based on the audio feature information supported by the HFP bluetooth connection.

In some embodiments, the second device is verified before HFP bluetooth connection through the incoming call white list, and whether HFP bluetooth connection is established is determined, wherein the response message includes call identification information; the controller 250 is further configured to control the communication interface 220 to establish the HFP bluetooth connection with the second device when the communication interface 220 receives a response message sent by the second device for the bluetooth connection request and determines that the call white list has the call identification information.

the MAC address of the communication equipment, the incoming call number of the incoming call and the incoming call name of the incoming call.

In some embodiments, the controller 250 is specifically configured to answer an incoming call received by the second device when receiving an answer control signal sent by the control apparatus after the HFP bluetooth connection is established with the second device; a controller 250, further configured to receive voice data sent by a control apparatus, where the control apparatus is connected to the first device based on the HOGP; the voice data is forwarded to the second device.

In another case: the display device 200 may be a second device, and the HFP call is implemented by interaction between the first device (which may be the smart device 300 as shown in fig. 1) and the second device, and the target phone call is dialed by triggering the smart device 300 on the display device 200.

In some embodiments, the communication interface 220 is configured to send a target broadcast message to the first device in case of receiving an incoming call, wherein the target broadcast message is configured to indicate that the second device requests to make a target call; receiving an HFP Bluetooth connection request sent by the first device, and sending a response message aiming at the Bluetooth connection request to the first device.

In the screen projection scene:

in some embodiments, a screen projection channel may be established, and an interface of the telephony device is projected onto the display device 200, and the communication interface 220 is configured to receive a first broadcast message sent by the telephony device, where the first broadcast message is used to indicate that the telephony device receives an incoming call; sending screen projection related information to the call equipment so that the call equipment sends a screen projection request to the display equipment based on the screen projection related information; the controller 250 is configured to receive a screen-casting request sent by the telephony device, and send a response message of the screen-casting request to the telephony device, so as to establish a screen-casting channel with the telephony device, and control the display 260 to display a screen-casting interface of an incoming call.

In some embodiments, the communication interface 220 is further configured to send the MAC address of the display device to the telephony device, so that the telephony device sends a screen projection request to the display device based on the screen projection related information when determining that the MAC address of the display device exists in the screen projection white list.

In some embodiments, the screen projection related information is sent to the telephony device via a scan request.

In some embodiments, the MAC address of the display device is sent to the telephony device by a scan request.

In some embodiments, the screen-shot related information is transmitted through a second broadcast message.

In some embodiments, the MAC address of the display device is sent to the telephony device via a second broadcast message.

In some embodiments, after the screen-casting channel is established, the HFP bluetooth connection may also be requested to be established, and the communication interface 220 is further configured to send a targeting request message to the telephony device, where the targeting request message is an HFP bluetooth connection request message, or the targeting request message is configured to request the telephony device to send a bluetooth HFP bluetooth connection request message. And sending a target request message to the communication device, wherein the target request message is an HFP Bluetooth connection request message, or the target request message is used for requesting the communication device to send the Bluetooth HFP Bluetooth connection request message.

In some embodiments, the communication interface 220 is specifically configured to send a scan request to the call device, where the scan request includes screen projection related information and a MAC address of the display device; the communication interface 220 is further configured to receive a screen projection request sent by the telephony device, and send a scanning response message of the scanning request to the telephony device, where the scanning response message includes audio feature information supported by HFP bluetooth connection, so that the telephony device establishes HFP bluetooth connection with the display device based on the audio feature information; the audio feature information supported by the HFP bluetooth connection includes at least one of:

audio coding mode, sound channel, sampling rate and sampling depth.

In a voice forwarding scenario:

in some embodiments, the communication interface 220 is configured to receive first voice data sent by the control apparatus, where the control apparatus is connected to the display device based on the hopp, and the first voice data is voice data based on the hopp; the controller 250 is configured to transmit voice data to a core node of the display device, convert the first voice data into second voice data through the adaptation driver, and forward the second voice data to the HFP voice driver, where the second voice data is voice data based on a phone hands-free protocol HFP, and write the second voice data into the communication interface through the HFP voice driver;

and controlling the communication interface 220 to forward the second voice data to the call device, wherein the call device is connected with the display device through HFP bluetooth.

In some embodiments, the communication interface 220 is further configured to, before receiving the first voice data sent by the control apparatus, send a bluetooth connection request based on a phone hands-free protocol HFP to the telephony device in a case of monitoring a target broadcast message sent by the telephony device, where the target broadcast message is used to indicate that the telephony device receives an incoming call; after receiving a response message for the Bluetooth connection request sent by the communication device, establishing HFP Bluetooth connection with the communication device; the communication interface 220 is specifically configured to receive the first voice data sent by the control device, where the first voice data includes: after the HFP Bluetooth connection with the communication device is established, the call received by the communication device is answered, and the first voice data sent by the control device is received.

In some embodiments, communication interface 220 is further configured to: after the HFP Bluetooth connection with the communication device is established, sending a notification message to the control device, wherein the notification message is used for indicating the display device to establish the HFP Bluetooth connection with the communication device; the communication interface 220 is specifically configured to receive the first voice data sent by the control device, where the first voice data includes: and under the condition of receiving an answering control signal sent by the control device, answering the incoming call received by the call equipment and receiving first voice data sent by the control device.

In some embodiments, the communication interface 220 is specifically configured to answer an incoming call received by the telephony device, where the answering comprises: receiving an answering control signal sent by a control device so as to answer an incoming call received by the communication equipment; receiving first voice data sent by a control device in a first time period; the first time length is the time length from the time when the audio input start identifier sent by the control device is received to the time when the audio input end identifier sent by the control device is received.

In some embodiments, the targeted broadcast message includes: the call identifier information controller 250 is further configured to control the communication interface 220 to send an HFP bluetooth connection request to the call device when the communication interface 220 monitors a target broadcast message sent by the call device and determines that the call identifier information exists in the incoming call white list;

in some embodiments, the controller 250 is further configured to control the communication interface 220 to send the HFP bluetooth connection request to the communication device when the communication interface 220 monitors a target broadcast message sent by the communication device and determines that the call identification information does not exist in the incoming call blacklist.

In some embodiments, the target broadcast message further includes audio characteristic information of at least one of the following; audio coding mode, sound channel, sampling rate and sampling depth; and the communication interface is specifically used for establishing HFP Bluetooth connection with the communication device based on the audio characteristic information.

In some embodiments, the bluetooth connection request is a bluetooth pairing connection request;

in some embodiments, the bluetooth connection request is a bluetooth backhaul connection request.

As shown in fig. 5, fig. 5 is a schematic software configuration diagram of a display device 200 or an intelligent device 300 in some embodiments provided by the present disclosure, and as shown in fig. 5, a system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as an "Application layer"), an Application Framework (Application Framework) layer (referred to as a "Framework layer"), an Android runtime (Android runtime) and a system library layer (referred to as a "system runtime library layer"), respectively. The inner core layer comprises at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

In order to more clearly illustrate the solution of the embodiments of the present disclosure, the concepts involved in the related art are explained:

firstly, introducing HFP basic knowledge:

the distinction between HFP and hsp (headset profile) is established for the purpose of implementing bluetooth calls, and the implemented functions are related to bluetooth calls.

Among them, HSPs only implement the most basic telephony operations: answering the call, hanging up the call, adjusting the volume, switching the sound between the mobile phone and the Bluetooth headset, and the like.

HFP is an extension of HSP, and includes advanced functions such as controlling three-party call, call rejection, and displaying a call at an earphone end, in addition to the above functions. In the design of the current Android operating system, the two protocols are not separately displayed, but are both expressed as mobile phone audio, HFP is preferentially connected when the system is used, and only under the condition that the opposite side only supports HSP or the condition that Bluetooth connection of HFP fails, HSP connection is attempted.

The current usage scenarios of HFP may include a scenario in which a mobile phone and a vehicle-mounted bluetooth are connected through HFP bluetooth, a scenario in which a mobile phone and a bluetooth headset are connected through HFP bluetooth, and the like, and two roles of an Audio Gateway (AG) and a Hands-Free unit (HF) are defined in the usage scenarios of HFP.

AG is audio input/output gateway

The HF is a remote audio input/output mechanism for the audio gateway and may provide several remote control functions.

For example, in a scenario where the mobile phone is connected to the bluetooth in vehicle via HFP, the mobile phone is AG and the bluetooth in vehicle is HF. In the Android source code, the AG side is referred to as HFP/AG, and the HF side is referred to as HFP client (HFPClient)/HF.

Second, audio frequency of bluetooth communication:

bluetooth technology communication is diverse in content, wherein the audio portion includes media audio and telephone audio.

Media audio: the data of the bluetooth music is played, the audio has high quality requirement, and the data is sent with a retransmission mechanism, so that an Access Control List (ACL) Link is accessed in a data form of a Logical Link Control and Adaptation Protocol (L2 cap). The coding method comprises the following steps: five encoding modes, namely, secondary band encoding (SBC), Advanced Audio Coding (AAC), digital Audio compression encoding (Audio Processing Technology-X APTX), High-resolution APTX (APTX _ High Definition, APTX _ HD), and wireless Audio encoding (LDAC), are the most basic encoding mode, which must be supported by a device that supports bluetooth multimedia playback. The selection of the coding mode needs to be determined by mutual negotiation between the Bluetooth connection devices.

Telephone audio: voice data during a bluetooth call, which audio has a high time-sensitive requirement, is generally transmitted through a special Synchronous Connection Oriented link (SCO) or enhanced SCO (esco) link. The coding method comprises the following steps: continuous Variable Slope Delta modulation speech Coding (CVSD), modified subband coding (mSBC). The most basic coding mode is CVSD, hands-free Bluetooth equipment needs to support the coding mode, and equipment supporting broadband voice can select mSBC coding data.

Third, the HFP-based bluetooth protocol framework:

as shown in fig. 6, which is a schematic diagram of a bluetooth protocol framework, it can be seen in fig. 6 that the bluetooth protocol framework includes: HFP Protocol, Serial Port Protocol (SPP), General Access Protocol (GAP), Service Discovery Protocol (SDP), SCO and eSCO, Serial simulation Protocol (RFCOMM) Logical Link and adapter Protocol (L2 CAP); host Controller Interface (HCI) and Controller (s)). Wherein, the HFP protocol includes: instruction set in Command prompt (AT CMD).

As shown in fig. 7, a schematic diagram of protocols and entities used in an application by the HFP-based bluetooth protocol is shown. The corresponding entities in fig. 7 include an audio gateway side and a hands-free device side, where the protocols and entities used in the audio gateway side and the hands-free device side are as shown in the figure, and include: the Application comprises Application (Application), Hands-free control (Hands-free control), serial Port simulation Protocol (RFCOMM), Session Description Protocol (SDP), Link management Protocol (Link Manager Protocol) LMP, L2CAP and Baseband (Baseband), wherein an Audio Port simulation (Audio Port simulation) module is arranged in the Application on the Audio network side, and an Audio driver (Audio driver) is arranged in the Application on the Hands-free equipment side.

As shown in fig. 8, which is a schematic diagram of a bluetooth Framework when an HFP protocol is applied in an Android operating system, it can be seen that the bluetooth Framework can be divided into an application layer, a Java Framework (Framework) layer, a local Framework layer, a Java runtime environment layer, and a Linnux kernel layer.

The application layer is provided with an Android bluetooth application program, that is, a program using an API of bluetooth, and may include: bluetooth setting related applications (Settings), bluetooth debugging assistant applications (Phone), bluetooth interface applications (BT Demo), and bluetooth application packages (bluetooth. apk), etc.;

a Bluetooth software development kit (BT SDK) is arranged in a Java Framework (Framework) layer;

a local framework layer provided with a Hardware abstraction interface (Hardware abstract interface);

a Java running environment layer provided with a Bluetooth protocol stack (Bluetooth stack);

and the inner core layer is provided with a driving program.

As shown in fig. 9, for a schematic diagram of implementing a call function based on HFP, as shown in fig. 9, an ACL link needs to be established between HF and AG first, after the ACL link is established, an SDP service discovery HFP protocol may be triggered by an internal event of HF or a user event, or an SDP service discovery HFP protocol may be triggered by an internal time of AG or a user time, and then a connection is established through an RFCOMM protocol, after the connection is established through the RFCOMM protocol, a bluetooth connection based on HFP may be implemented through AT command interaction between HF and AG, and after the HFP bluetooth connection is implemented between HF and AG, various phone functions may be implemented based on a mobile phone audio protocol.

Fig. 10 is a schematic diagram illustrating the relationship between HFP and a voice module (Audio) in HF of the Android operating system. The following association flow may be included: (1) the Application (APP) may notify a bluetooth virtual host (BT host) in user space (user space) that HFP bluetooth connection needs to be established (e.g., receive a call on the UI); (2) the BT Host informs a Bluetooth Firmware (BT FW) to establish HFP Bluetooth connection through a Host Controller Interface (HCI) instruction (comm); after HFP bluetooth connection establishment is completed, (3) BT FW notifies BT host that HFP bluetooth connection establishment is completed; (4) BT host informs Audio that HFP bluetooth connection currently exists, so that Audio is enabled, (5) Audio and BT FW transmit Pulse Code Modulation (PCM) data through an Inter-IC Sound I2S bus.

As shown in fig. 11, it is a schematic diagram of a state machine control state in HF of an Android system;

the two devices HF and AG need to be connected with each other through HFP Bluetooth firstly, voice connection is established after the HFP Bluetooth connection is established, conversation is carried out, and after the conversation is finished, the HF and the AG are disconnected with each other through the voice connection first and then the HFP Bluetooth connection of the HF and the AG is disconnected.

Exemplarily, as shown in fig. 12, another scene schematic diagram provided for the embodiment of the present disclosure includes a television 121, a mobile phone 122, and a bluetooth remote controller 123; the television and the mobile phone need to be connected through HFP Bluetooth, and the television and the Bluetooth remote controller need to be connected through BLE HOGP Bluetooth.

As shown in fig. 13, another schematic view of a scenario provided in the embodiment of the present disclosure includes a television 131, a call handset 132, and a control handset 133; the HFP bluetooth connection needs to be established between the television 131 and the call handset 132, and the bluetooth connection based on the classic bluetooth (Basic Rate/Enhanced Data Rate, BR/EDR) can be selected between the television 131 and the control handset 124.

When the control device of the television is a remote controller, as shown in fig. 12, for a low-power-consumption device such as a remote controller, bluetooth connection based on BLE hog is required to reduce the power consumption of the device, and when the control device of the television is a mobile phone, as shown in fig. 13, for a device such as a mobile phone (i.e., a control mobile phone 124), bluetooth connection based on BR/EDR may be used.

In the following embodiments, an exemplary description will be given by taking the display device as a television, the smart device as a mobile phone, and the control device as a remote controller. The television can be used as central equipment, carries the dual-mode Bluetooth module, can support BR/EDR and BLE, makes full use of the role of the central equipment, realizes that the television is used as a transfer center of signals, and realizes Bluetooth voice data forwarding and voice pickup. It can be understood that, when the control device in the embodiment of the present disclosure is other non-low power consumption devices such as a mobile phone, the television may also adopt a single-mode bluetooth device, and only supports BR/EDR.

In the embodiment of the disclosure, the television is connected with the mobile phone through HFP bluetooth, the television serves as an HF role, the mobile phone serves as an AG role, and the television can support incoming call answering and call making of the mobile phone, so that even if the communication device is far away, call making and call answering can be realized through control of the display device. Furthermore, the role of the central equipment of the television can be linked with the connected Internet of things (IOT) equipment (for example, a remote controller), so that the interaction performance of the equipment is improved, and the user experience is improved.

In the embodiment of the present disclosure, the sending of the broadcast message is involved in the interactive process of the television, the mobile phone and the remote controller, and the broadcast message involved in the embodiment of the present disclosure may include:

in some embodiments, the broadcast message involved in embodiments of the present disclosure may be a Connectable unidirectional broadcast (Connectable outputted Event Type):

connectable non-directional broadcasting is a most widely used type of broadcasting including broadcasting data and scanning response data, and indicates that a current device can accept a connection request of any other device. The device performing the general broadcast can be scanned by the scanning device or enter a connection as a slave device when receiving a connection request.

In some embodiments, the broadcast message involved in embodiments of the present disclosure may be a Connectable Directed broadcast (Connectable Directed Event Type):

the directional broadcast type is to establish a connection as quickly as possible. This message contains two addresses: the address of the broadcaster and the address of the originator. After receiving the directional broadcast message sent to the initiator, the initiator can immediately send a connection request as a response. The directional broadcast type has special timing requirements. The requirement that the complete broadcast event must be repeated every 3.75ms makes it possible for the scanning device to scan only 3.75ms for messages directed to the broadcast device.

Since the scanning device only needs to scan for 3.75ms to receive the message from the directional broadcasting device, such a fast transmission would cause the message to flood the broadcasting channel, which would result in that other devices in the area could not broadcast. Thus, the directional broadcast may not last for more than 1.28 s. If the host does not actively request a stop, or a connection is not established, the controller will automatically stop the broadcast. Once it is 1.28s, the host can only let other devices connect using connectable non-directional broadcasts with much longer intervals.

When using directional broadcasting, the device cannot be actively scanned. In addition, the payload of the directional broadcast message cannot carry other additional data. The payload can only contain two necessary addresses.

In some embodiments, the broadcast message involved in embodiments of the present disclosure may be a Non-connectable unidirectional broadcast (Non-connected unused Event Type):

the use of non-directional broadcast without connectivity illustrates that devices only send broadcast data and do not want to be scanned or connected. This is also the only type of broadcast available to only the transmitter and no receiver device. The non-connectable broadcast device does not enter the connected state, and therefore it can only switch between the broadcast state and the ready state according to the requirements of the host.

In some embodiments, the broadcast message involved in embodiments of the present disclosure may be a Scannable non-directed broadcast (Scannable unused Event Type):

scannable non-directed broadcasts, also known as discoverable broadcasts, cannot be used to initiate a connection, but allow other devices to scan for the broadcast device, meaning that the device can be discovered. Either broadcast data or scan response data may be sent in response to the scan, but no connection can be established. This is a form of broadcasting suitable for broadcast data, and dynamic data may be included in the broadcast data, and static data may be included in the scan response data.

It should be noted that, in the embodiments of the present disclosure, embodiments under various scenarios are related, and an HFP call scenario, a voice conversion scenario, and a screen projection scenario are respectively described as follows:

for more detailed description of the present solution, the following description is made in conjunction with the accompanying drawings in an exemplary manner, and it is understood that the steps involved in the drawings may include more steps or fewer steps in actual implementation, and the sequence between the steps may also be different, so as to enable the call control method, the voice forwarding method, and the screen projection control method provided in the embodiments of the present disclosure to be implemented.

In an HFP call scenario, as shown in fig. 14, a flow diagram of a call control method provided in an embodiment of the present disclosure is shown, where the method includes:

1401. the mobile phone receives the incoming call.

When receiving calls made by other equipment, the mobile phone receives the incoming calls.

1402. The mobile phone sends a target broadcast message.

Correspondingly, the television receives the target broadcast message sent by the mobile phone.

The target broadcast message is used for indicating that the second equipment receives the incoming call. The target broadcast message may be a BLE broadcast message.

When the mobile phone receives an incoming call, the mobile phone broadcasts the incoming call by sending BLE broadcast messages.

There are two kinds of role center (Central) and Peripheral (Peripheral) in BLE. The mobile phone is a peripheral device, and the television is a central device. The central device may actively connect with the peripheral device, and the peripheral device transmits the broadcast message or is connected by the central device. The peripheral device is discovered by the central device through a broadcast message, and the broadcast message can contain the relevant information of the peripheral device.

The broadcast message may include: broadcast packets (Advertising Data) and Response packets (Scan Response). Wherein the broadcast packet is necessarily broadcast by each device, and the response packet is optional. The broadcast packet includes 31 bytes, and the broadcast packet includes: valid data (significant) and invalid data (non-significant).

The valid data part contains a number of broadcast data units (AD Structure). The composition of the AD Structure is: the first byte is a length value, denoted "Len", indicating that the next Len bytes are data portions. The first byte of the data part represents the Type of data (AD Type), and the remaining Len-1 bytes are real data (AD data). The AD type is very critical, and determines what Data the AD Data represents, and how to analyze the AD Data.

Since the packet must be 31 bytes in length, if the valid data portion is less than 31 itself, the remainder is complemented with 0. This part of the data is invalid, i.e. the invalid data part mentioned above, is ignored when interpreting the data in the data packet.

The broadcast packet further comprises: vendor-defined data: in the vendor-defined data, the first two bytes represent vendor identifiers, and the rest is added by the vendor according to the requirement, and the content of the data in the vendor-defined data is defined by the vendor, for example, the mac address of the device can be added. In the embodiment of the present disclosure, the custom data may be carried in vendor custom data of the broadcast packet, or scan response.

The customized data of the embodiment of the disclosure can include call identification information and/or audio characteristic information, and the television can reduce the exchange of information in the HFP bluetooth connection process by acquiring the customized data, and can quickly complete the quick connection with the mobile phone according to the customized data in the broadcast packet or scan response.

1403. And the television sends an HFP Bluetooth connection request to the mobile phone.

Correspondingly, the mobile phone receives the HFP Bluetooth connection request sent by the television.

In some embodiments, the HFP bluetooth connection request is an HFP-based bluetooth pairing connection request for a case where the tv and the mobile phone have not established an HFP bluetooth connection. The television is in a scanning state, monitors the target broadcast message of the mobile phone, and actively initiates a Bluetooth pairing connection request based on HFP to the television.

In some embodiments, the HFP bluetooth connection request is an HFP-based bluetooth backhaul connection request for a case where the tv and the mobile phone have already established the HFP bluetooth connection. The television is in a scanning state, and after the television monitors the target broadcast message of the mobile phone, the HFP-based bluetooth loopback connection request can be actively initiated to the television.

In some embodiments, in the case where the television listens for targeted broadcast messages sent to the handset, the television may send HFP bluetooth connection requests directly to the handset.

In some embodiments, the television may further receive call identification information sent by the mobile phone, so that the television may directly send the HFP bluetooth connection request to the mobile phone when the television determines that the call identification information exists in the incoming call white list.

In some embodiments, the television may send a scan request (scan request) in the scan state, the call identification information may be carried in a scan response message (scan response) from the mobile phone to the television, and the scan response message from the mobile phone to the television may also carry the call identification information, so that the television may directly send the HFP bluetooth connection request to the mobile phone when it is determined that the call identification information exists in the white list of incoming calls.

In some embodiments, the targeted broadcast message includes: call identification information; the television can send an HFP bluetooth connection request to the mobile phone when the television monitors a target broadcast message sent by the mobile phone and determines that the call white list has call identification information.

The call identification information includes one or more items of the MAC address of the mobile phone, the incoming call number of the incoming call and the incoming call name of the incoming call. It can be understood that the call identification information in the embodiment of the present disclosure may also include other information that can identify the mobile phone or the incoming call of the mobile phone, and the embodiment of the present disclosure is not limited.

The calling name may be a user name of the calling device, and the calling number may be a number of a Subscriber Identity Module (SIM) of the calling device.

In some embodiments, an incoming call white list may be set in the television, where the incoming call white list may store a MAC address and incoming call information (e.g., an incoming call number, an incoming call name, etc.) of a device that allows HFP bluetooth connection to be established, and after the television receives call identification information sent by the mobile phone, the call identification information may be compared with information in the incoming call white list, and when it is determined that information matching the call identification information exists in the incoming call white list, it is determined that the call identification information exists in the incoming call white list, so that HFP bluetooth connection between the mobile phone and the television may be allowed; correspondingly, when the fact that the information matched with the call identification information does not exist in the call white list is determined, the fact that the call identification information does not exist in the call white list is considered, and therefore the target broadcast message sent by the mobile phone can be ignored, and the HFP Bluetooth connection request is not sent to the mobile phone.

In some embodiments, an incoming call blacklist may be further set, where the incoming call blacklist may store a MAC address of a device that is not allowed to establish HFP bluetooth connection, and after the television receives call identification information sent by the mobile phone, the call identification information may be compared with information in the incoming call blacklist, and when it is determined that there is no information matching with the call identification information in the incoming call blacklist, it is determined that there is no call identification information in the incoming call blacklist, so that HFP bluetooth connection between the mobile phone and the television may be allowed; correspondingly, when the information matched with the call identification information exists in the incoming call blacklist, so that the target broadcast message sent by the mobile phone can be ignored, and the HFP Bluetooth connection request is not sent to the mobile phone.

The incoming call white list and the incoming call black list can be used for verifying whether the mobile phone to be subjected to HFP Bluetooth connection is a device which is allowed by the television and is connected with the HFP Bluetooth, and verifying whether the incoming call name and the incoming call number related to the incoming call of the current mobile phone are the incoming call which is allowed by the television and is connected with the HFP Bluetooth, so that the device to be connected and the information related to the incoming call can be verified before the HFP Bluetooth connection is established, and the safety is improved.

1404. And the mobile phone sends a response message aiming at the Bluetooth connection request to the television.

Accordingly, the television can receive a response message sent by the mobile phone for the bluetooth connection request.

In some embodiments, the response message of the bluetooth connection request includes call identification information; and when the television receives a response message aiming at the Bluetooth connection request sent by the mobile phone and the call white list is determined to have the call identification information, controlling the communication interface to establish HFP Bluetooth connection with the second equipment.

1405. The mobile phone is connected with the television through HFP Bluetooth.

Wherein, HFP bluetooth connection is BR EDR's bluetooth connection.

In some embodiments, the targeted broadcast message further includes audio feature information supported by the HFP bluetooth connection of at least one of:

audio coding mode, sound channel, sampling rate and sampling depth;

after receiving the audio feature information supported by the HFP bluetooth connection of the mobile phones, the television can establish the HFP bluetooth connection with the mobile phones based on the audio feature information supported by the HFP bluetooth connection.

For example, there are currently two encoding modes for the audio link, CVSD and mSBC. The coding mode is decided by the negotiation between the two parties establishing the connection, during the negotiation process, the HF and AG parties respectively send the audio coding modes supported by the HF and AG parties to the opposite party in the AT command "+ BRSF", if both parties support the coding negotiation. Specifically, the HF can actively inform the AT command of "AT + BAC" that the numbers of the two coding modes of AG are: 1-CVSD; 2-mSBC, and the mSBC coding mode is mostly adopted when the audio link is established, otherwise, the mSBC coding mode is CVSD coding. The AG may also reply to the encoding mode supported by the HF itself, and finally determine that the audio encoding modes supported by both sides establish HFP bluetooth connection.

The television can reduce the exchange of information in the HFP Bluetooth connection process by acquiring the audio characteristic information, and can quickly complete the quick connection with the mobile phone according to the custom data in the broadcast packet or scan response.

1406. The television processes the incoming call received by the mobile phone.

After the HFP Bluetooth connection between the television and the mobile phone is established, the phone call received by the mobile phone is answered and the voice data sent by the remote controller is received under the condition that an answering control signal sent by the remote controller is received, and after the television receives the voice data, the voice data is forwarded to the second device. Wherein, the remote controller is connected with the mobile phone based on HOGP.

The voice data can be the voice data acquired by the remote controller, and after the remote controller controls the television to answer the incoming call of the mobile phone, the voice of the user can be acquired through the remote controller, so that the voice data can be acquired and sent to the mobile phone through the television, and the normal call flow can be realized. The user voice of the opposite terminal equipment received by the mobile phone is played through the loudspeaker of the television, the user voice of the mobile phone terminal is picked up through the remote controller, and the corresponding voice data is sent back to the opposite terminal equipment, so that the mobile phone can be answered through the television, and a call flow is realized.

In the embodiment, in a mobile phone call scene, the mobile phone is connected with the television through HFP bluetooth, the television serves as an HF role, the mobile phone serves as an AG role, call answering of the mobile phone can be supported in the television, call answering through the television is realized, and the television is controlled to process a call of the mobile phone by linking the role of the central device of the television and the remote controller, so that the interaction performance of the device is improved, and the user experience is also improved.

In an HFP call scenario, as shown in fig. 15, another call control method provided in the embodiment of the present disclosure includes:

1501. the television set sends a target broadcast message to the mobile phone.

Correspondingly, the mobile phone receives the target broadcast message sent by the television.

Wherein the target broadcast message is used to instruct the television to request to make a target call. That is, the television requests to control the mobile phone to dial the target telephone.

The targeted broadcast message may include a broadcast packet or scan response.

In some embodiments, the call identification information may be included in the targeted broadcast message. Wherein the call identification information includes at least one of:

MAC address of TV set, number of destination telephone, name information of destination telephone.

1502. The mobile phone sends an HFP Bluetooth connection request to the television.

Correspondingly, the television receives the HFP Bluetooth connection request sent by the mobile phone.

In some embodiments, the HFP bluetooth connection request is an HFP-based bluetooth pairing connection request for a case where the tv and the mobile phone have not established an HFP bluetooth connection.

In some embodiments, the HFP bluetooth connection request is an HFP-based bluetooth backhaul connection request for a case where the tv and the mobile phone have already established the HFP bluetooth connection.

In some embodiments, a dialing blacklist may be further set, where the dialing blacklist may store a MAC address of a device that is not allowed to establish HFP bluetooth connection, and after the television receives call identification information sent by the mobile phone, call information (e.g., a call number, a call name, etc.) may compare the call identification information with information in the call blacklist, and when it is determined that there is no information matching the call identification information in the call blacklist, it is determined that there is no call identification information in the call blacklist, so that HFP bluetooth connection may be allowed to be established between the mobile phone and the television; correspondingly, when the information matched with the call identification information exists in the incoming call blacklist, so that the target broadcast message sent by the mobile phone can be ignored, and the HFP Bluetooth connection request is not sent to the mobile phone.

1503. The television set sends a response message for the Bluetooth connection request to the mobile phone.

Correspondingly, the mobile phone receives a response message which is sent by the television and aims at the Bluetooth connection request.

1504. The HFP Bluetooth connection is established between the mobile phone and the television.

Wherein, HFP bluetooth connection is BR EDR's bluetooth connection.

audio coding mode, sound channel, sampling rate and sampling depth.

After receiving the audio feature information supported by the HFP bluetooth connection based on the television, the mobile phone may establish the HFP bluetooth connection with the television based on the audio feature information supported by the HFP bluetooth connection.

1505. The television controls the mobile phone to dial the target telephone.

After the HFP Bluetooth connection with the second device is established, voice data sent by the second device is received, and the voice data is output, wherein the voice data is the voice data received by the second device through a remote controller, and the remote controller is connected with the second device in an HOGP mode.

In the embodiment, the mobile phone is connected with the television through the HFP Bluetooth, the television is used as an HF role, the mobile phone is used as an AG role, the mobile phone can be controlled to make a target call through the television, call answering through the television is realized, the television can be controlled to make a call through linkage between the role of the central equipment of the television and the remote controller, the interaction performance of the equipment is improved, and meanwhile, the user experience is also improved.

In some embodiments, after the tv is connected to the mobile phone via the HFP bluetooth, the tv may send a notification message to the remote controller to notify the remote controller that the tv is connected to the mobile phone via the HFP bluetooth, and may send some control signals to the tv through a control operation on the remote controller to control the tv to process the incoming call received by the mobile phone, for example, answer the incoming call, hang up the incoming call, and the like.

As shown in fig. 16, in some embodiments of the interaction flow diagram of the remote controller and the television according to the embodiments of the present disclosure, after the HFP bluetooth connection between the television and the mobile phone is established, the television may send a notification message to the remote controller to notify the remote controller that the television is connected to the mobile phone in the HFP bluetooth connection, and after the remote controller receives the notification message, the remote controller enters an HFP operation mode, in which the remote controller may send a control signal to the television to control the television to process a call through the mobile phone, for example, to receive an incoming call from the mobile phone, or to broadcast a target phone through the mobile phone.

In some embodiments, as shown in fig. 17, in the schematic diagram of establishing a dual connection between a television and a mobile phone provided in the embodiment of the present disclosure, in addition to the HFP bluetooth connection, a bluetooth low energy (BLE GATT) connection may be established between the mobile phone 171 and the television 172, and the BLE GATT bluetooth connection established between the mobile phone and the television may be used for auxiliary information interaction between the television and the mobile phone.

The auxiliary information interaction may include interaction of at least one of the following information: the IP address of the television, the IP address of the mobile phone, the MAC address of the television, the MAC address of the mobile phone, audio related information supported by the television and audio related information supported by the mobile phone. The audio-related information may include: one or more of coding format, adoption rate, sampling depth, port information of application.

In a voice forwarding scenario, as shown in fig. 18, a schematic flow diagram of a voice forwarding method provided in the embodiment of the present disclosure is shown, where the method includes the following steps:

1801. the television receives first voice data sent by the remote controller.

The remote controller is connected with the display device based on HOGP, and the first voice data is voice data based on HOGP.

Specifically, the television receives the first voice data sent by the remote controller, and the first voice data is received by a bluetooth module in the television and written into a kernel node of the television by a bluetooth protocol stack.

In some embodiments, the first voice data may be voice data picked up by the remote controller, or the first voice data may be voice data sent to the remote controller by other devices.

In some embodiments, after the HFP bluetooth connection is established with the mobile phone, the television receives an incoming call received by the mobile phone and receives first voice data sent by the remote controller. For example, the process of obtaining the voice data through the remote controller may be performed during the process of processing the incoming call received by the mobile phone for the television in the HFP conversation scene.

Wherein, the process that TV set and cell-phone establish HFP bluetooth and be connected can include: the method comprises the steps that the television sends an HFP Bluetooth connection request to the mobile phone under the condition that a target broadcast message sent by the mobile phone is monitored, and after a response message aiming at the Bluetooth connection request sent by the mobile phone is received, the HFP Bluetooth connection is established with the mobile phone; after the HFP Bluetooth connection is established between the television and the mobile phone, the television receives an incoming call received by the mobile phone and receives first voice data sent by the remote controller.

The target broadcast message is used for indicating the mobile phone to receive the incoming call.

In some embodiments, the bluetooth connection request is a bluetooth pairing connection request.

For the process of establishing HFP bluetooth connection between the television and the mobile phone in the voice forwarding scenario, reference may be made to the process of establishing HFP bluetooth connection between the television and the mobile phone in the HFP conversation scenario, which is not repeated here.

In some embodiments, the receiving of the incoming call by the television set may specifically be receiving an incoming call received by the mobile phone by receiving an answer control signal sent by a remote controller.

In some embodiments, the television may receive first voice data transmitted by the remote controller for a first time period; the first duration is the duration from the time when the audio input start identifier sent by the remote controller is received to the time when the audio input end identifier sent by the remote controller is received.

The adaptive drive input and output can be controlled through the keys of the remote controller, if a user does not want to pick up sound in real time, the adaptive drive voice data output can be triggered and controlled through the keys, similar to the mute function in a telephone, only the key input triggers the audio input to start, the keys are lifted to stop the output, namely the audio input is finished.

For example, the remote controller may receive a pressing operation of a key of the remote controller by a user, trigger the remote controller to send an audio input start identifier to the television in response to the pressing operation, and start continuous sound pickup, trigger the sound pickup to end after a first time period and send an audio input end identifier to the television in response to a cancel operation of the pressing operation.

For example, as shown in fig. 19, in order to provide a flowchart for controlling sound pickup of a remote controller in real time according to an embodiment of the present disclosure, when the remote controller presses a key, the remote controller sends an audio input start identifier (voice start) to a television, starts sound pickup and transmits voice data obtained by sound pickup of the remote controller to the television, after the television receives the voice start, the television prepares to receive first voice data, after the remote controller cancels the pressing operation of the key, sound pickup is stopped, the remote controller sends an audio input end identifier (voice stop) to the television, and after the television receives the voice stop, the television stops receiving the voice data obtained by sound pickup of the remote controller, where the first voice data is voice data obtained by sound pickup of the remote controller between the time when the television receives the voice start and the time when the television receives the voice stop.

In some embodiments, after the HFP bluetooth connection with the mobile phone is established, a notification message is sent to the remote controller, the notification message is used for instructing the television to establish the HFP bluetooth connection with the mobile phone, and the television answers an incoming call received by the mobile phone and receives first voice data sent by the remote controller when receiving an answering control signal sent by the remote controller.

1802. And the television transmits the first voice data to a core node of the display equipment.

The kernel node is a kernel hidraw node and is also written as a kernel hid node.

The hidraw node is an operating system linux kernel of the television set, is provided for a user space Universal Serial Bus (USB) and a bluetooth man-machine interaction node, and can realize USB or bluetooth communication by using the hidraw node, and further can complete other functions, such as device firmware upgrade and the like.

In the embodiment of the disclosure, after the television receives the first voice data, the first voice data can be directly transmitted to the kernel node of the display device, so that the user-mode complex flow forwarding is not needed, and the user-mode complex flow forwarding directly enters the kernel-mode flow forwarding.

1803. The television acquires first voice data in the kernel node through the adaptive driver.

In the embodiment of the disclosure, a dedicated adaptation driver is set for forwarding voice data, and based on the adaptation driver, conversion of different protocol data can be realized.

1804. The television converts the first voice data into second voice data through the adaptive driver.

Wherein the second voice data is HFP-based voice data.

1805. The television forwards the second voice data in the adaptation driver to the HFP voice driver.

In the embodiment of the present disclosure, the voice driver may be an HFP voice driver designed separately, and the adaptation driver is an adaptation driver set for hid data in the kernel node.

Based on the adaptation driver, the HOGP-based voice data may be converted to HFP-based voice data.

1806. The television writes the second voice data into the communication interface of the television through the HFP voice driver.

1807. And the television forwards the second voice data to the mobile phone through the communication interface.

The television serves as a central device, receives first voice data sent by the remote controller, converts the first voice data into second voice data, and then can forward the second voice data to the mobile phone.

Under the condition that the protocol according to which the television and the remote controller establish the Bluetooth connection is different from the protocol according to which the television and the mobile phone establish the Bluetooth connection, the first voice data needs to be converted into the second voice data before the voice data is forwarded, so that the data can be forwarded between different devices connected by the Bluetooth through the television based on different protocols.

The voice forwarding method provided by the embodiment of the disclosure can simplify the complex forwarding flow of the user mode and the kernel mode in the voice forwarding process, and improve the forwarding efficiency of the voice data.

In the related art, in the process of forwarding voice data, a user-mode flow is first entered into a television for forwarding, and then a kernel-mode flow is entered for forwarding. Fig. 20 is a schematic diagram illustrating an exemplary forwarding process of voice data in the related art. As can be seen from fig. 20, after receiving the first voice data sent by the remote controller, the bluetooth module in the television firstly writes the first voice data into the kernel node of the television through the bluetooth protocol stack, then reads the first voice data in the kernel node in the user mode, sends the first voice data to the voice Service (Audio Service) and the voice hardware abstraction module (Audio hal) in the television for processing, converts the first voice data into the second voice data, sends the second voice data to the voice driver, and finally sends the second voice data to the mobile phone through the bluetooth module of the television. It can be seen that, in the forwarding flow shown in fig. 20, the processing is performed by the bluetooth protocol stack of the user mode, and then the processing is written into the kernel node of the kernel mode, and then the processing enters the user mode and is performed by the Audio Service and the Audio hall, so that the conversion of the voice data of different protocols can be finally realized.

Exemplarily, as shown in fig. 21, a schematic diagram of a forwarding flow of voice data in an embodiment of the present disclosure is provided. As can be seen from fig. 21, after receiving first voice data sent by a remote controller, a bluetooth module in a television firstly writes the first voice data into a kernel node of the television through a bluetooth protocol stack, then reads the first voice data in the kernel node in a kernel state to an adaptation driver, converts the first voice data into second voice data by the adaptation driver, sends the second voice data to a voice driver, and finally sends the second voice data to a mobile phone through the bluetooth module of the television. The whole process completes the conversion of the first voice data and the second voice data in the kernel mode, simplifies the complex forwarding process of the user mode and the kernel mode in the related technology, and improves the forwarding efficiency of the voice data.

In a screen projection scene, as shown in fig. 22, an embodiment of the present disclosure provides a screen projection control method, including:

2201. the mobile phone receives the incoming call.

2202. The mobile phone sends a first broadcast message to the television.

Correspondingly, the television receives the first broadcast message sent by the mobile phone.

The first broadcast message is used for indicating the mobile phone to receive an incoming call.

When the mobile phone receives the incoming call, the mobile phone can send a first broadcast message.

Wherein the first broadcast message is a BLE broadcast message.

In some embodiments, the first broadcast message may be a directed broadcast packet, and the directed broadcast packet may improve the efficiency of discovering the mobile phone. If the MAC address of the television is known, a directional broadcast packet can be sent, and the MAC address of the television is carried in the directional broadcast packet.

In some embodiments, the first broadcast message may also be a non-directed broadcast packet.

In some embodiments, the first broadcast message may include: the mobile phone MAC address (i.e. the wireless WIFI MAC address of the mobile phone), the mobile phone identifier, and the incoming call information.

2203. And the television sends screen projection related information to the mobile phone.

In some embodiments, after the television receives the first broadcast message sent by the mobile phone, the television can directly send the screen projection related information to the mobile phone.

In some embodiments, after the television receives the first broadcast message sent by the mobile phone, it is determined that the mobile phone has an incoming call, and after the mobile phone is determined to be a device allowing to establish a screen projection channel according to the MAC address, the incoming call information, and the like of the mobile phone, the television sends screen projection related information to the mobile phone.

The screen-casting white list can be set in the television, the MAC address and the telephone information of the equipment recorded in the screen-casting white list are compared according to the MAC address, the incoming call information and the like of the mobile phone, and when the condition that the information matched with the MAC address, the incoming call information and the like of the mobile phone exists in the screen-casting white list is determined, the mobile phone is determined to be the equipment which allows the screen-casting channel to be established. In some embodiments, the television may also send the MAC address of the television, i.e., the WIFI wireless MAC address of the television, to the cell phone.

In some embodiments, the television may send the screen-casting related information to the mobile phone through a scan request, or the television may send the screen-casting related information to the mobile phone through a second broadcast message.

In some embodiments, the tv may send the MAC address of the tv to the mobile phone through a scan request, or the tv may send the screen projection related information to the mobile phone through a second broadcast message.

In some embodiments, the television may further send a scan request to the mobile phone, and after the television receives the scan response sent by the mobile phone, it is confirmed that the mobile phone has received the screen-casting related information of the television. The screen projection related information and the MAC address of the television may be sent through the same message, for example, the television sends a scan request to the mobile phone, the scan request includes the screen projection related information and the MAC address of the television, correspondingly, the mobile phone receives the scan request sent by the television, the scan request includes the screen projection related information and the MAC address of the television, and the mobile phone replies a scan response to the television, so that the television confirms that the screen projection related information and the MAC address of the television have been received.

2204. And the mobile phone sends a screen projection request to the television based on the screen projection related information.

Wherein, the screen projection related information may include at least one of the following: IP address of the television, MAC address of the television, port information of the screen projection application network, channel information, authentication related information and the like.

After receiving the screen projection related information, the mobile phone can quickly search the television, carry out authentication verification and quickly establish a screen projection channel.

In some embodiments, after the television receives scan response information received from the mobile phone and receives a screen-casting request sent by the mobile phone, the television also sends scan response to the mobile phone for confirmation and requests the mobile phone to send a HFP connection request.

In some embodiments, after the mobile phone receives the MAC address of the television, the mobile phone sends a screen-casting request to the television based on the screen-casting related information if it is determined that the MAC address of the television exists in the screen-casting white list.

The method comprises the steps that the MAC address of equipment allowing to establish a screen projection channel can be stored in a screen projection white list of the mobile phone, when the MAC address of the television exists in the screen projection white list, the mobile phone is confirmed to be capable of establishing the screen projection channel with the television, and at the moment, a screen projection request is sent to the television.

In some embodiments, the mobile phone sends a screen-casting request to the television, and receives a scanning response message of the scanning request sent by the television, wherein the scanning response message includes audio feature information supported by the HFP bluetooth connection;

establishing HFP Bluetooth connection with the television according to the audio characteristic information;

the audio feature information supported by the HFP bluetooth connection includes one or more of an audio coding mode, a sound channel, a sampling rate, and a sampling depth.

2205. And the television sends a response message of the screen projection request to the mobile phone.

The television receives a screen projection request sent by the mobile phone and sends a scanning response message of the scanning request to the mobile phone, wherein the scanning response message comprises audio feature information supported by HFP Bluetooth connection, so that the mobile phone is connected with the television through the HFP Bluetooth based on the audio feature information;

2206. and the television and the mobile phone establish a screen projection channel.

2207. And displaying a screen projection interface of the incoming call on the television.

And displaying a screen projection interface of the mobile phone on the television, wherein the screen projection interface is the screen projection interface of the incoming call because the current mobile phone receives the incoming call.

As shown in fig. 23, for a schematic diagram that shows a screen-projecting interface of a mobile phone on a television according to an embodiment of the present disclosure, for example, in fig. 23, a mobile phone 231 receives a call of zhang san, and after a screen-projecting channel is established between the television and the mobile phone, a screen-projecting interface 232a may be displayed on the television 232, where the screen-projecting interface 232a shows content of an interface in the mobile phone 231.

In the embodiment, in a mobile phone call scene, a screen projection channel can be established between the mobile phone and the television through interaction between the mobile phone and the television, and a screen projection interface of the call is displayed on the television, so that the call interface on the mobile phone is displayed through the television, a user can conveniently check call information (such as a call number or a call name), the equipment interaction performance is improved, and the user experience is also improved.

In some embodiments, the television may further send a targeting request message to the mobile phone, where the targeting request message is an HFP bluetooth connection request message, or the targeting request message is used to request the mobile phone to send a bluetooth HFP bluetooth connection request message to request the mobile phone to establish a bluetooth connection with the television in HFP. The manner of establishing HFP bluetooth connection between the mobile phone and the television is described in detail in embodiments of other scenarios, and is not described herein again.

After the HFP bluetooth connection is established between the television and the mobile phone, the incoming call of the mobile phone can be answered through the television, and specifically, the manner of answering the incoming call of the mobile phone through the television is also described in detail in embodiments of other scenarios, and is not described here again.

Furthermore, in a mobile phone incoming call scene, a screen projection channel can be established between the mobile phone and the television, a screen projection interface of the incoming call is displayed on the television, and HFP (HFP) Bluetooth connection between the mobile phone and the television can be established, so that the incoming call interface displayed on the mobile phone by the television is convenient for a user to check incoming call information, the television can answer the incoming call on the mobile phone or hang up the incoming call on the mobile phone through the HFP Bluetooth connection, the control of the mobile phone by the user is convenient, the interaction performance of equipment is improved, and the user experience is also improved.

Embodiments of the present disclosure provide a computer-readable storage medium having stored thereon a computer program that, when executed by a processor, performs at least one of the following:

each process executed by the television in the call control method;

each process executed by the mobile phone in the call control method;

the remote controller executes each process in the call control method.

Embodiments of the present disclosure also provide a computer-readable storage medium on which a computer program is stored, the computer program, when executed by a processor, implementing at least one of the following processes:

each process executed by the television in the voice forwarding method;

each process executed by the mobile phone in the voice forwarding method;

the voice forwarding method comprises the steps executed by the remote controller.

each process executed by the television in the screen projection control method;

each process executed by the mobile phone in the screen projection control method;

the screen projection control method comprises the steps executed by the remote controller.

The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

The present disclosure provides a computer program product including a computer program, which when run on a computer, causes the computer to implement at least one of the above-described call control method, voice forwarding method, and screen projection control method.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A first device, comprising:

a communication interface configured to: under the condition that a target broadcast message sent by second equipment is monitored, sending a phone hands-free protocol (HFP) Bluetooth connection request to the second equipment, wherein the target broadcast message is used for indicating that the second equipment receives an incoming call, or indicating that the second equipment requests to dial a target phone;

2. The first device of claim 1, wherein the first device is a display device, the second device is a telephony device, and the target broadcast message is used to indicate that the telephony device receives the incoming call;

the target broadcast message comprises: call identification information;

3. The first device of claim 1, wherein the targeted broadcast message further includes audio feature information supported by the HFP bluetooth connection of at least one of the following;

audio coding mode, sound channel, sampling rate and sampling depth;

4. The first device according to claim 1, wherein the first device is a display device, the second device is a call device, and the response message includes call identification information;

5. The first device according to any one of claims 2 to 4, wherein the first device is a display device, the second device is a telephony device, and the target broadcast message is used to indicate that the telephony device receives the incoming call;

the call identification information includes at least one of:

the MAC address of the communication equipment, the incoming call number and the incoming call name of the incoming call.

6. The first device of claim 5, wherein the controller is specifically configured to:

the controller further configured to: receiving voice data sent by a control device, wherein the control device is connected with the first equipment based on HOGP;

forwarding the voice data to the second device.

7. The first device according to any one of claims 2 to 4, wherein the first device is a telephony device, the second device is a display device, and the target broadcast message is used for indicating that the second device requests to make the target telephone;

the call identification information includes at least one of:

8. The first device of claim 7, wherein the controller is specifically configured to:

9. A second apparatus, comprising:

a communication interface configured to:

10. A call control method is characterized by comprising the following steps:

under the condition that a target broadcast message sent by second equipment is monitored, sending an HFP (HFP) Bluetooth connection request to the second equipment, wherein the target broadcast message is used for indicating that the second equipment receives an incoming call, or indicating that the second equipment requests to make a target call;