WO2023092785A1 - 终端控制方法、终端控制系统及存储介质 - Google Patents

终端控制方法、终端控制系统及存储介质 Download PDF

Info

Publication number
WO2023092785A1
WO2023092785A1 PCT/CN2021/140694 CN2021140694W WO2023092785A1 WO 2023092785 A1 WO2023092785 A1 WO 2023092785A1 CN 2021140694 W CN2021140694 W CN 2021140694W WO 2023092785 A1 WO2023092785 A1 WO 2023092785A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
access device
ear canal
bluetooth
terminal
Prior art date
Application number
PCT/CN2021/140694
Other languages
English (en)
French (fr)
Inventor
李加云
Original Assignee
歌尔科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 歌尔科技有限公司 filed Critical 歌尔科技有限公司
Publication of WO2023092785A1 publication Critical patent/WO2023092785A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/06—Authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/14—Direct-mode setup
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Definitions

  • the present invention relates to the technical field of earphones, in particular to a terminal control method, a terminal control system and a storage medium.
  • Bluetooth earphones including TWS earphones have become a part of daily life of more and more people, especially TWS earphones, which are small and easy to carry.
  • TWS earphones which are small and easy to carry.
  • the headset and the mobile phone communicate through Bluetooth.
  • the communication between the headset and the terminal will be affected.
  • the Bluetooth communication range of the headset is exceeded, the communication will be interrupted and affect the user. Control and normal use of terminals such as mobile phones.
  • the main purpose of the present invention is to provide a terminal control method, a terminal control system and a storage medium, aiming to solve the problem of interruption of communication with the terminal when the distance between the terminal and the Bluetooth headset in the prior art exceeds the Bluetooth communication range of the Bluetooth headset.
  • the present invention also provides a terminal control method applied to a Bluetooth headset in a terminal control system
  • the terminal control system also includes an access device, a server, and a controlled terminal
  • the terminal control method includes The following steps:
  • the server determines the target account according to the ear canal information, and controls the controlled terminal corresponding to the target account to perform the operation corresponding to the voice control instruction.
  • the step of establishing a communication connection with the access device includes:
  • the access device includes one or more, and when the access device includes multiple, after the step of establishing a Bluetooth communication connection with the access device according to the pairing request, it further includes:
  • the method further includes:
  • target operation information corresponding to the voice control instruction returned by the access device
  • the target operation information is an operation corresponding to the voice control instruction received by the controlled terminal received by the server type of return information sent by voice conversion, the return information includes text information and voice information
  • the server sends the target operation information to the access device, so that the access device sends the target operational information
  • the present invention also provides a terminal control method applied to a server in a terminal control system, the terminal control system also includes a bluetooth headset, an access device, and a controlled terminal, and the terminal control method includes The following steps:
  • the access device receives the voice control instruction and ear canal information sent by the access device, wherein the ear canal information is acquired by the Bluetooth headset when detecting the user's voice control instruction, and the Bluetooth headset is connected with the access
  • the device establishes a communication connection, and the Bluetooth headset authenticates the user according to the ear canal information, and if the verification is passed, sends the voice control command and the ear canal information to the access device, so that The access device sends the voice control instruction and the ear canal information;
  • a target account is determined according to the ear canal information, and a controlled terminal corresponding to the target account is controlled to perform an operation corresponding to the voice control instruction.
  • the step of controlling the controlled terminal corresponding to the target account to perform the operation corresponding to the voice control instruction it further includes:
  • the controlled terminal receiving return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction, wherein the return information includes text information and voice information;
  • the returned information includes text information
  • the present invention also provides a terminal control method applied to the first access device in the terminal control system, the terminal control system also includes a bluetooth headset, a server and a controlled terminal, the terminal control The method includes the following steps:
  • the server sends the voice control instruction and the ear canal information to the server, so that the server can determine a target account according to the ear canal information, and control the controlled terminal corresponding to the target account to execute the voice control instruction corresponding operation.
  • the step of receiving the Bluetooth address information of the Bluetooth headset and establishing a communication connection with the Bluetooth headset includes:
  • the communication connection between the first access device and the second access device, the second access device includes one or more, after the step of receiving the Bluetooth address information sent by the Bluetooth headset ,Also includes:
  • the Bluetooth headset sends the Bluetooth address details to the Bluetooth headset through NFC, so that when the communication signal strength with the Bluetooth headset is lower than the preset strength threshold, the Bluetooth headset scans each access corresponding to the Bluetooth address details. For the signal strength of the device, determine the target access device with the strongest signal strength from each of the access devices, and establish a Bluetooth communication connection with the target access device.
  • the step of sending the voice control instruction and the ear canal information to the server further include:
  • the target operation information is obtained by performing voice conversion by the server on the received return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction , the returned information includes text information and voice information;
  • the present invention also provides a terminal control system, the terminal control system includes a bluetooth earphone, and the bluetooth earphone includes:
  • An ear canal identification module configured to acquire the user's ear canal information and authenticate the user according to the ear canal information when the user's voice control instruction is detected;
  • the NFC module is used to establish a communication connection with the access device if the verification is passed;
  • a Bluetooth module configured to send the ear canal information and the voice control instruction to the access device based on the communication connection, so that the access device sends the ear canal information and the voice control instruction
  • the server determines the target account according to the ear canal information, and controls the controlled terminal corresponding to the target account to perform the operation corresponding to the voice control instruction.
  • the present invention also provides a terminal device, which includes: a memory, a processor, and a terminal control program stored in the memory and operable on the processor, the terminal When the control program is executed by the processor, the steps of the above-mentioned terminal control method are realized.
  • the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a terminal control program, and when the terminal control program is executed by a processor, the above-mentioned terminal control method is implemented A step of.
  • a terminal control method, a terminal control system, and a storage medium proposed by an embodiment of the present invention when the method is applied to a Bluetooth headset in the terminal control system, the terminal control system also includes an access device, a server, and a controlled terminal .
  • the terminal control system when the user is inconvenient to carry terminal equipment such as mobile phones and only carries a Bluetooth headset, if the terminal exceeds the Bluetooth communication range with the Bluetooth headset, communication will be interrupted, affecting the user's control and normal operation of terminal equipment such as mobile phones. use.
  • the access device establishes a communication connection; based on the communication connection, the ear canal information and the voice control instruction are sent to the access device, so that the access device sends the ear canal information and the voice control instruction sent to the server, for the server to determine the target account according to the ear canal information, and control the controlled terminal corresponding to the target account to perform the operation corresponding to the voice control instruction.
  • the access device and the server are used as the communication with the controlled terminal.
  • Inter-communication relay realizing the communication between the Bluetooth headset and the controlled terminal, so that the user can control the mobile phone and other terminal equipment through the Bluetooth headset, ensuring the normal use of the terminal equipment by the user.
  • FIG. 1 is a schematic diagram of a hardware structure of an implementation manner of a terminal device provided by an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of a first embodiment of a terminal control method according to the present invention
  • FIG. 3 is a schematic diagram of the distribution of access devices in the first embodiment of the terminal control method of the present invention.
  • Fig. 4 is a schematic diagram of functional modules of an embodiment of the terminal control system of the present invention.
  • the terminal (also called terminal, device or terminal device) of the embodiment of the present invention may be a PC, and may also be a mobile terminal device with display and data processing functions such as a smart phone, a tablet computer, and a portable computer.
  • the terminal may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 .
  • the communication bus 1002 is used to realize connection and communication between these components.
  • the user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1005 can be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory.
  • the memory 1005 may also be a storage device independent of the aforementioned processor 1001 .
  • the terminal may also include a camera, an RF (Radio Frequency, radio frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like.
  • sensors such as light sensors, motion sensors and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display screen according to the brightness of the ambient light, and the proximity sensor may turn off the display screen and/or backlight.
  • the gravitational acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used for applications that recognize the posture of mobile terminals (such as horizontal and vertical screen switching, Related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tap), etc.; of course, the mobile terminal can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. No longer.
  • terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or less components than those shown in the figure, or combine some components, or arrange different components.
  • memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and a terminal control program.
  • the network interface 1004 is mainly used to connect to the background server and perform data communication with the background server;
  • the user interface 1003 is mainly used to connect to the client (client) and perform data communication with the client;
  • the processor 1001 may be used to call the terminal control program stored in the memory 1005, and when the terminal control program is executed by the processor, operations in the terminal control method provided in the following embodiments are implemented.
  • a terminal control system in the terminal control method of the present invention, a terminal control system is provided, and the system includes a Bluetooth headset, an access device, a server and a controlled terminal, etc., and the terminal control method of the present invention can be applied to the terminal control system in the terminal control system.
  • Different devices or devices such as Bluetooth headsets, access devices, servers, and controlled terminals can realize the control function of the terminal.
  • the terminal control method of the present invention will be described in detail below by applying it to different devices or equipment.
  • the terminal method is applied to the Bluetooth headset in the terminal control system, the terminal control system also includes an access device, a server and a controlled terminal, the Terminal control methods include:
  • Step S10 when the user's voice control instruction is detected, acquire the user's ear canal information and perform identity verification on the user according to the ear canal information;
  • the terminal control method is applied to a Bluetooth headset in the terminal control system.
  • the Bluetooth headset may be a TWS headset or other headsets with Bluetooth and NFC communication functions, which is not limited here.
  • the terminal control system also includes an access device, a server, and a controlled terminal, wherein the controlled terminal can be a mobile phone, or a mobile terminal device such as a tablet computer.
  • the controlled terminal Take the controlled terminal as an example for description. It can be seen that when users are in some specific scenarios, such as outdoor sports, it is inconvenient to carry mobile phones and other terminal devices, but due to the small size and portability of TWS earphones, users generally carry TWS earphones and establish TWS earphones with mobile phones through Bluetooth.
  • the user's voice control instruction is detected, the user's ear canal information is obtained, and the current user's identity is verified according to the obtained ear canal information.
  • the purpose of verifying the user's identity based on the ear canal information is to determine whether the current user is For the real users of mobile phones and TWS earphones, so as to ensure the user's privacy and information security.
  • the user's voice control commands such as playing music, calling someone in the address book, and reading unread messages, etc.
  • the verification of the user identity may be performed in the earphone or in the charging box of the earphone, which is not limited here.
  • Step S20 if the verification is passed, establish a communication connection with the access device
  • the user’s voice control command will not be responded to to ensure the user’s information security. If the verification is passed, it will detect whether the mobile phone is within the communication range. If so, it will directly establish a communication with the mobile phone. Communication connection, and send the user's voice control command to the mobile phone, so as to control the mobile phone to perform corresponding operations in response to the user's voice control command. If the mobile phone is not within the communication range, establish a communication connection with the access device, which is Bluetooth communication.
  • the access device can be installed on public facilities such as outdoor street light poles, and generally has NFC, Bluetooth, 4G/5G /WIFI and other communication functions, as well as self-power supply function. Before establishing a Bluetooth communication connection with the access device, information exchange is performed with the access device through NFC, so as to realize the establishment of the communication connection.
  • the communication connection established with the access device is a Bluetooth communication connection
  • the step of establishing the communication connection includes:
  • Step S201 sending Bluetooth address information to the access device through NFC, so that the access device can send Bluetooth address details and pairing requests according to the Bluetooth address information;
  • Step S202 receiving the Bluetooth address details and pairing request sent by the access device, and establishing a Bluetooth communication connection with the access device according to the pairing request.
  • the access device When establishing a Bluetooth communication connection with the access device, first send its own Bluetooth address information to the access device through NFC, so that the access device can return corresponding information according to the Bluetooth address information after receiving the Bluetooth address information. Receive the information returned by the access device, where the information returned by the access device includes Bluetooth address details and pairing requests including the Bluetooth address information of each access device. When receiving the Bluetooth address details and pairing requests returned by the access device, according to The pairing request establishes a Bluetooth communication connection with the access device.
  • the access device includes one or more, that is, within the preset range of the user's location, there can be one access device or multiple access devices, which can be determined according to the size of the site and the communication environment. Make custom settings.
  • the distance between the user and the device with which the communication connection is established may gradually increase, causing the communication signal to gradually weaken.
  • the distance between the user and the access device exceeds the preset distance threshold, communication may be interrupted. Therefore, when there are multiple access devices, after establishing a communication connection with one access device, it also includes:
  • Step S203 when it is detected that the communication signal strength with the access device is lower than a preset threshold, scan the signal strength of each access device corresponding to the Bluetooth address details;
  • Step S204 determining the target access device with the strongest signal strength, and establishing a Bluetooth communication connection with the target access device.
  • the access device When it is detected that the signal strength of the communication with the access device is lower than the preset threshold, based on the received Bluetooth address details, scan the signal strength of each access device corresponding to the Bluetooth address details, and select the access device with the strongest signal strength As the target access device, then establish a Bluetooth communication connection with the target access device. Among them, the scanning of the signal strength of each access device and the establishment of a communication connection with the target access device are performed during the communication gap with the access device that establishes the communication connection. When the device is connected, it will not affect the normal communication.
  • FIG. 3 is a schematic diagram of the distribution of access devices when multiple access devices are set in the terminal control system in this embodiment.
  • BT2 to BT20 represent 20 access devices respectively. Take 20 access devices in a 400-meter playground as an example in an outdoor sports scene. Set up an access device every 20 meters around the playground. The distance between the headset and any access device is less than 10 meters during the user's exercise. meters, all within the Bluetooth communication distance of the headset. Assuming that the user initially connects with the BT1 access device, during the NFC information exchange process, BT1 will also send the Bluetooth address information of the BT2-BT20 in the same group to the headset.
  • the headset will use the communication gap to scan the signal strength of each access device and sort them. When the signal strength of the currently connected access device is found to be less than the preset strength threshold, it means that the distance from the connected access device is far away. , the headset will actively switch devices and establish a Bluetooth communication connection with the access device with the strongest signal.
  • Step S30 sending the ear canal information and the voice control instruction to the access device based on the communication connection, so that the access device sends the ear canal information and the voice control instruction to the
  • the server is configured for the server to determine a target account according to the ear canal information, and control the controlled terminal corresponding to the target account to perform the operation corresponding to the voice control instruction.
  • the Bluetooth communication connection After the Bluetooth communication connection is established with the access device, based on the established Bluetooth communication connection, the acquired ear canal information and the user's voice control instruction are sent to the access device, so that the access device will receive the ear canal information and voice control instruction Send it to the server for the server to determine the target account corresponding to the user according to the ear canal information, so as to control the controlled terminal corresponding to the target account to perform the operation corresponding to the user's voice control instruction. For example, control your phone to call someone, play music, or read unread messages, etc.
  • the target account of the user is that the user registers in advance through the mobile phone and saves it in the server.
  • the registered account contains the user's ear canal information.
  • the user can be determined based on the acquired ear canal information.
  • target account and determine the controlled terminal corresponding to the target account, that is, the user's mobile phone.
  • the server may store one or more user account information, the account information includes the user's ear canal information and the device identification of the controlled terminal, and the account information of different users is identified and distinguished according to the user's ear canal information , and the target account is pre-registered by the user through the controlled terminal and stored in the server.
  • the acquired ear canal information and voice control instructions are sent to the access device, it is based on the Bluetooth communication established between the access device and the access device sends the ear canal information and When the command is sent to the server, it is sent through a communication connection such as 4G/5G/WIFI, and the relay is made between the access device and the server, which makes up for the limitation of the Bluetooth communication range.
  • the access device After sending the ear canal information and the voice control instruction to the access device, it also includes:
  • Step S40 receiving the target operation information corresponding to the voice control instruction returned by the access device, wherein the target operation information is received by the server and the controlled terminal according to the voice control instruction
  • the return information sent by the corresponding operation type is converted into voice, the return information includes text information and voice information, and the server sends the target operation information to the access device, so that the access device sends Said target operation information;
  • Step S50 playing the target operation information to the user.
  • the access device After sending the ear canal information and voice control instructions to the access device, the access device forwards the received ear canal information and voice control instructions to the server, and the server determines the user's target account according to the ear canal information, and then according to the user's The voice control command controls the terminal corresponding to the target account to perform corresponding operations. Then the target operation information corresponding to the user's voice control instruction returned by the access device is received.
  • the target operation information is obtained by performing voice conversion by the server on the received return information sent by the mobile phone according to the operation type corresponding to the voice control command. Specifically, when the server controls the mobile phone to perform the corresponding operation according to the voice control command, according to The operation type corresponding to the voice control command determines the data packet that the mobile phone needs to return.
  • the operation type includes calling, information reading, and voice playback.
  • the voice playback includes playing music, video, and broadcasting.
  • the mobile phone sends different types of data packets to the server as return information, and the return information includes text information and voice information.
  • the return information includes text information and voice information.
  • the operation type corresponding to the voice control command is a call
  • the mobile phone returns the call voice of the called party to the server after the call is connected
  • the operation type corresponding to the voice control command is information reading
  • the unread message For example, the mobile phone reads the unread information and sends the text information corresponding to the read unread information to the server, and the server converts the text information in the returned information to obtain the target operation information, and then sends it to the access device, so that the access device sends target operation information.
  • the voice corresponding to the target operation information is played to the user, so that the user can read the unread information in the mobile phone to achieve the purpose of terminal control.
  • the server controls the controlled terminal to perform the operation corresponding to the voice control command, it first performs voice recognition on the received user's voice control command, for example, when the server receives the user's voice control command as "read unread information", the corresponding text command "read unread information" is obtained through voice recognition, and an information reading command is issued to the mobile phone according to the voice recognition result to control the mobile phone to start the information application and query unread messages.
  • voice recognition for example, when the server receives the user's voice control command as "read unread information", the corresponding text command "read unread information” is obtained through voice recognition, and an information reading command is issued to the mobile phone according to the voice recognition result to control the mobile phone to start the information application and query unread messages.
  • the mobile phone starts the information application and inquires about the unread information, it reads the text information in the unread information and returns it to the server.
  • the server When the server receives the text information returned by the mobile phone, it converts the text information into voice information and It is forwarded to the access device, and when the voice information sent by the access device is received, the voice information is played to the user in response to the user's voice control instruction of "reading unread information" sent to the mobile phone.
  • the terminal control method is applied to the Bluetooth headset in the terminal control system.
  • the terminal control system also includes an access device, a server, and a controlled terminal.
  • the user's voice control command When a user's voice control command is detected, the user's ear canal information and authenticate the user according to the ear canal information; if the verification is successful, establish a communication connection with the access device; based on the communication connection, send the ear canal information and the voice control instruction to The access device, so that the access device sends the ear canal information and the voice control instruction to a server, so that the server can determine a target account according to the ear canal information, and control the target account to correspond to The controlled terminal executes the operation corresponding to the voice control instruction.
  • the access device and the server are used as the communication with the controlled terminal.
  • Inter-communication relay realizing the communication between the Bluetooth headset and the controlled terminal, so that the user can control the mobile phone and other terminal equipment through the Bluetooth headset, ensuring the normal use of the terminal equipment by the user.
  • the terminal control method is applied to the server in the terminal control system, and the terminal control system also includes a Bluetooth headset, an access device, and a controlled terminal.
  • the terminal control method is applied to the terminal control
  • the following steps are involved:
  • Step A10 receiving the voice control command and ear canal information sent by the access device, wherein the ear canal information is acquired by the Bluetooth headset when detecting the user's voice control command, and the Bluetooth headset is connected to the ear canal information
  • the access device establishes a communication connection, the Bluetooth headset performs identity verification on the user according to the ear canal information, and if the verification passes, the voice control command and the ear canal information are sent to the access device so that the access device sends the voice control instruction and the ear canal information;
  • the terminal control method is applied to the server, and the method also includes a Bluetooth headset, an access device, and a controlled terminal.
  • the TWS headset is still used as the Bluetooth headset (hereinafter Headphones for short), and the mobile phone is used as the controlled terminal for illustration.
  • the terminal control method When the terminal control method is applied to the server, it receives the voice control execution and ear canal information sent by the access device, wherein the received ear canal information is acquired by the earphone when it detects the user's voice control instruction, and the earphone is based on the acquired When the user's identity verification by the ear canal information is passed, the ear canal information and voice control instructions are sent to the access device, so that the access device forwards the ear canal information and voice control instructions.
  • Step A20 Determine the target account according to the ear canal information, and control the controlled terminal corresponding to the target account to perform the operation corresponding to the voice control instruction.
  • the corresponding mobile terminal After receiving the ear canal information and voice control instructions sent by the access device, determine the target account corresponding to the user according to the received ear canal information, and control the target account according to the user's voice control instructions after determining the target account corresponding to the user
  • the corresponding mobile terminal performs corresponding operations.
  • controlling the controlled terminal to perform the operation corresponding to the voice control command first perform voice recognition on the received user's voice control command, for example, if the received user's voice control command is "read unread information", then the Recognize the corresponding text command "read unread information”, and send an information reading command to the mobile phone according to the voice recognition result, so as to control the mobile phone to start the information application and query the unread message.
  • the mobile phone After the mobile phone starts the information application and inquires about the unread information, it reads the text information in the unread information and returns it. After receiving the text information returned by the mobile phone, it converts the text information into voice information and forwards it to the receiver. input device, so that the access device sends the converted voice information to the bluetooth headset, and plays it to the user through the bluetooth headset, in response to the voice control instruction of "reading unread information" sent by the user to the mobile phone.
  • the mobile phone after controlling the mobile phone to execute the operation corresponding to the voice control command, it also includes:
  • Step A30 receiving return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction, wherein the return information includes text information and voice information;
  • the return information sent by the mobile phone is received.
  • the return information is returned by the mobile phone after performing the corresponding operation according to the operation type corresponding to the voice control command.
  • the mobile phone For different operation types corresponding to the voice control command, Such as calling, reading information or playing music, etc., the mobile phone returns different types of data packets as return information.
  • the returned information sent by the mobile phone is received, the returned information is processed differently according to the different operation types of the voice control command.
  • the returned information includes text information and voice information.
  • Step A40 when the returned information includes text information, perform speech conversion on the text information in the returned information to obtain target operation information;
  • Step A50 sending the target operation information to the access device, so that the access device sends the target operation information to the Bluetooth headset, and sends the target operation information to the Bluetooth headset through the Bluetooth headset.
  • the user plays.
  • the target operation information After obtaining the target operation information, send the target operation information to the access device through communication methods such as 4G/5GWIFI, so that the access device will send the obtained target operation information to the Bluetooth headset, and send the target operation information to the Bluetooth headset in the form of voice through the Bluetooth headset.
  • the user plays to realize the user's control and use of the terminal.
  • the mobile phone When the mobile phone is not within the communication range with the headset, the mobile phone can still be controlled and used normally through the headset, which improves the user experience.
  • the terminal control method is applied to the server in the terminal control system, by receiving voice control instructions and ear canal information sent by the access device, wherein the ear canal information is detected by the Bluetooth headset when the user's voice is detected.
  • the Bluetooth headset establishes a communication connection with the access device, the Bluetooth headset performs identity verification on the user according to the ear canal information, and if the verification passes, the voice control command and the Send the ear canal information to the access device, so that the access device sends the voice control instruction and the ear canal information; determine a target account according to the ear canal information, and control the target account to correspond to
  • the controlled terminal executes the operation corresponding to the voice control instruction.
  • the server and the access device act as a communication relay between the Bluetooth headset and the controlled terminal to realize the communication between the Bluetooth headset and the controlled terminal. communication, so that users can control terminal devices such as mobile phones through Bluetooth headsets, ensuring the normal use of terminal devices by users and improving user experience.
  • the terminal control method is applied to the first access device in the terminal control system, and a communication connection is established between the first access device and the second access device in the terminal control system
  • the terminal control system also includes a bluetooth headset, a server and a controlled terminal, and when the terminal control method is applied to the first access device in the terminal control system, the following steps are included:
  • Step B10 receiving the Bluetooth address information of the Bluetooth headset, and establishing a communication connection with the Bluetooth headset;
  • the terminal control method is applied to the first access device in the terminal control system.
  • the terminal control system also includes a Bluetooth headset, a server, and a controlled terminal.
  • the TWS headset is still used as the The bluetooth earphone (hereinafter referred to as the earphone) is described by taking the mobile phone as the controlled terminal as an example. Specifically, first establish a communication connection with the headset, the established communication connection is a Bluetooth communication connection, and before establishing the Bluetooth communication connection, perform information interaction with the headset through NFC to complete the establishment of the Bluetooth communication connection.
  • Step B20 receiving the voice control command and ear canal information sent by the Bluetooth headset, wherein the ear canal information is acquired by the Bluetooth headset when it detects the user's voice control command, the voice control command and the ear canal information
  • the ear canal information is sent by the bluetooth headset when the user's identity is verified according to the ear canal information;
  • the ear canal information and voice control instructions sent by the earphones are received.
  • the ear canal information is obtained when the earphones detect the user's voice control instructions.
  • the channel information is sent when the authentication of the user is passed.
  • the step of establishing a Bluetooth communication connection with the headset includes:
  • Step B101 receiving the Bluetooth address information sent by the Bluetooth headset, and sending a pairing request to the Bluetooth headset through NFC according to the Bluetooth address information;
  • Step B102 establishing a Bluetooth communication connection with the Bluetooth headset according to the pairing request.
  • the first access device establishes a communication connection with the second access device, and the communication connection may be one or more of NFC communication, Bluetooth communication, and 4G/5G/WIFI communication, which is not limited here.
  • the second access device includes one or more, after establishing a communication connection with the headset, it also includes:
  • Step B103 detecting whether there is a second access device within the preset range, and if so, obtaining the Bluetooth address information of the second access device, and generating Bluetooth address details including its own Bluetooth address information;
  • Step B104 Send the Bluetooth address details to the Bluetooth headset through NFC, so that when the communication signal strength with the Bluetooth headset is lower than a preset strength threshold, the Bluetooth headset scans the corresponding Bluetooth address details. For the signal strength of each access device, determine the target access device with the strongest signal strength from the second access device, and establish a Bluetooth communication connection with the target access device.
  • the headset After receiving the Bluetooth address information sent by the headset, it is detected whether there is a second access device within the preset range, and if there is, the Bluetooth address of each second access device is obtained based on the communication connection with the second access device. Address information, and generate Bluetooth address details including its own Bluetooth address information. Then, when a pairing request is sent to the headset through NFC, the generated Bluetooth address details are sent to the headset together, so that when the strength of the communication signal with the headset is lower than the preset strength threshold, the headset scans the corresponding Bluetooth address details. The signal strength of each access device, and determine the target access device with the strongest signal strength from each access device, re-establish the Bluetooth communication connection with the target access device, realize the switching of communication devices, and prevent communication interruption.
  • the headset scans the signal strength of the access device in the communication gap, therefore, the switching of the access device that establishes a Bluetooth communication connection with the headset, and the scan of the headset for the access device will not affect the Communications have an impact or a minor impact.
  • Step B30 sending the voice control instruction and the ear canal information to the server, so that the server can determine the target account according to the ear canal information, and control the controlled terminal corresponding to the target account to execute the Operations corresponding to voice control commands.
  • the ear canal information and voice control commands are sent to the server, so that the server can determine the target account corresponding to the user according to the ear canal information, and control the controlled account corresponding to the target account.
  • the terminal executes the operation corresponding to the user's voice control instruction.
  • the server may store one or more user account information, the account information includes the user's ear canal information and the device identification of the controlled terminal, and the account information of different users is identified and distinguished according to the user's ear canal information , and the target account is pre-registered by the user through the controlled terminal and stored in the server. Control the mobile phone corresponding to the target account to perform the operation corresponding to the user's voice control command, for example, control the mobile phone to call someone, play music, or read unread information.
  • the server controls the controlled terminal to perform the operation corresponding to the voice control command, it first performs voice recognition on the received user's voice control command, for example, when the server receives the user's voice control command as "read unread information", the corresponding text command "read unread information" is obtained through voice recognition, and an information reading command is issued to the mobile phone according to the voice recognition result to control the mobile phone to start the information application and query unread messages.
  • voice recognition for example, when the server receives the user's voice control command as "read unread information", the corresponding text command "read unread information” is obtained through voice recognition, and an information reading command is issued to the mobile phone according to the voice recognition result to control the mobile phone to start the information application and query unread messages.
  • the mobile phone starts the information application and inquires about the unread information, it reads the text information in the unread information and returns it to the server.
  • the server When the server receives the text information returned by the mobile phone, it converts the text information into voice information and Forwarding, when the voice information sent by the access device is received, the voice information is forwarded to the Bluetooth headset, so that the Bluetooth headset can play the voice information to the user, so as to respond to the "read unread information" sent by the user to the mobile phone Voice control commands.
  • the server When sending the ear canal information and voice control instructions to the server, it is based on 4G/5GWIFI and other communication methods. After sending the ear canal information and voice control instructions to the server, it also includes:
  • Step B40 receiving the target operation information sent by the server, wherein the target operation information is voiced by the server to the received return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction converted, the returned information includes text information and voice information;
  • Step B50 sending the target operation information to the Bluetooth headset, so that the Bluetooth headset can play the target operation information to the user.
  • the server After sending the ear canal information and the voice control command to the server, the server determines the user's target account according to the received ear canal information, and controls the mobile phone corresponding to the target account to execute the user's voice control command according to the user's voice control command. operate. After the mobile phone executes the operation corresponding to the voice control command, according to the operation type corresponding to the voice control command, different types of data packets are returned to the server as return information, and the return information is the execution result of the voice control command by the mobile phone.
  • the returned information from the mobile phone received by the server includes text information and voice information
  • the operation types of the voice control commands include calling, information reading, and voice playing.
  • the mobile phone when the operation type corresponding to the voice control command is a call, the mobile phone returns the call voice of the called party to the server after the call is connected; when the operation type corresponding to the voice control command is information reading, the mobile phone reads the Read the information and send the text information corresponding to the read unread information to the server, and the server performs voice conversion on the text information in the returned information to obtain the target operation information, and then sends the target operation information.
  • After receiving the target operation information sent by the server send the target operation information to the headset, so that the headset can play the voice corresponding to the target operation information to the user, so that the user can obtain the unread information in the mobile phone and achieve the purpose of terminal control .
  • the terminal control method is applied to the first access device in the terminal control system.
  • the terminal control system also includes a second access device, a Bluetooth headset, a server, and a controlled terminal.
  • a Bluetooth headset By establishing Bluetooth communication with the Bluetooth headset, Connect, and receive the voice control command and ear canal information sent by the Bluetooth headset, wherein the ear canal information is acquired by the Bluetooth headset when it detects the user's voice control command, the voice control command and the ear canal information
  • the ear canal information is sent by the bluetooth earphone when the user passes the identity verification based on the ear canal information; the voice control command and the ear canal information are sent to the server for the
  • the server determines the target account according to the ear canal information, and controls the controlled terminal corresponding to the target account to perform the operation corresponding to the voice control instruction.
  • the access device and the server together serve as a communication relay between the Bluetooth headset and the controlled terminal to realize the communication between the Bluetooth headset and the controlled terminal, so that the user can control the mobile phone and other terminal devices through the Bluetooth headset, ensuring that the user can The normal use of terminal equipment improves user experience.
  • the terminal control method in the present invention can also be applied to the controlled terminal in the terminal control system.
  • the terminal control system also includes a Bluetooth headset, an access device and a server.
  • the control terminal receives the voice control command issued by the server, it performs the corresponding operation, and returns different types of data packets to the server as the return information according to the operation type corresponding to the voice control command, so that the server can pass the return information through the receiving
  • the input device forwards it to the Bluetooth headset, and plays it to the user in the form of voice through the Bluetooth headset.
  • the received instruction issued by the server may also be an instruction generated by the server after performing voice recognition according to the user's voice control instruction, which is not limited herein.
  • an embodiment of the present invention also proposes a terminal control system, the terminal control system includes a Bluetooth headset, and the Bluetooth headset includes:
  • the ear canal identification module 10 is configured to acquire the user's ear canal information and authenticate the user according to the ear canal information when the user's voice control instruction is detected;
  • the NFC module 20 is used to establish a communication connection with the access device if the verification is passed;
  • Bluetooth module 30 configured to send the ear canal information and the voice control instruction to the access device based on the communication connection, so that the access device sends the ear canal information and the voice control instruction sent to the server, for the server to determine the target account according to the ear canal information, and control the controlled terminal corresponding to the target account to perform the operation corresponding to the voice control instruction.
  • the NFC module 20 is also used for:
  • the Bluetooth headset also includes a connection management module for:
  • the bluetooth headset also includes a voice playback module for:
  • target operation information corresponding to the voice control instruction returned by the access device
  • the target operation information is an operation corresponding to the voice control instruction received by the controlled terminal received by the server type of return information sent by voice conversion, the return information includes text information and voice information
  • the server sends the target operation information to the access device, so that the access device sends the target operational information
  • an embodiment of the present invention also proposes a terminal control system, the terminal control system further includes a server, and the server includes:
  • the first communication module is configured to receive the voice control instruction and ear canal information sent by the access device, wherein the ear canal information is acquired by the Bluetooth headset when the user's voice control instruction is detected, the The bluetooth earphone establishes a communication connection with the access device, and the bluetooth earphone authenticates the user according to the ear canal information, and if the authentication is passed, sends the voice control command and the ear canal information to the the access device, so that the access device sends the voice control instruction and the ear canal information;
  • a terminal control module configured to determine a target account according to the ear canal information, and control the controlled terminal corresponding to the target account to perform the operation corresponding to the voice control instruction.
  • the server also includes:
  • a first information receiving module configured to receive return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction, wherein the return information includes text information and voice information;
  • An information conversion module configured to perform voice conversion on the text information in the returned information when the returned information includes text information, to obtain target operation information
  • a first information sending module configured to send the target operation information to the access device, so that the access device sends the target operation information to the Bluetooth headset, and sends the target operation information to the Bluetooth headset through the Bluetooth headset.
  • the target operation information is played to the user.
  • an embodiment of the present invention also proposes a terminal control system, the terminal control system further includes a first access device, and the first access device includes:
  • NFC receiving module for receiving the bluetooth address information of described bluetooth earphone, and establish communication connection with described bluetooth earphone
  • the Bluetooth receiving module is configured to receive the voice control instruction and ear canal information sent by the Bluetooth headset, wherein the ear canal information is acquired by the Bluetooth headset when it detects the user's voice control instruction, and the voice control The instruction and the ear canal information are sent by the Bluetooth headset when the user's identity is verified according to the ear canal information;
  • the second information sending module is configured to send the voice control instruction and the ear canal information to the server, so that the server can determine a target account according to the ear canal information, and control the target account corresponding to the target account.
  • the control terminal executes the operation corresponding to the voice control instruction.
  • the NFC communication module is also used for:
  • the first access device further includes:
  • the information detection module is used to detect whether there is a second access device within the preset range, and if it exists, obtain the Bluetooth address information of the second access device, and generate Bluetooth address details including its own Bluetooth address information;
  • the NFC communication module is further configured to send the Bluetooth address details to the Bluetooth headset through NFC, so that when the communication signal strength with the Bluetooth headset is lower than a preset strength threshold, the Bluetooth headset scans the Determine the signal strength of each access device corresponding to the Bluetooth address details, determine the target access device with the strongest signal strength from each of the access devices, and establish a Bluetooth communication connection with the target access device.
  • the first access device further includes:
  • the second information receiving module is configured to receive the target operation information sent by the server, wherein the target operation information is sent by the server to the operation type corresponding to the voice control instruction received by the controlled terminal
  • the returned information is converted into voice, and the returned information includes text information and voice information;
  • a Bluetooth sending module configured to send the target operation information to the Bluetooth headset, so that the Bluetooth headset can play the target operation information to the user.
  • an embodiment of the present invention also proposes a computer-readable storage medium, where a terminal control program is stored on the computer-readable storage medium, and when the terminal control program is executed by a processor, the terminal control method provided in the above-mentioned embodiments is implemented. operation.
  • system embodiment since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to part of the description of the method embodiment.
  • system embodiments described above are illustrative only, where units illustrated as separate components may or may not be physically separate. Part or all of the modules can be selected according to actual needs to realize the purpose of the solution of the present invention. It can be understood and implemented by those skilled in the art without creative effort.
  • the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation.
  • the technical solution of the present invention can be embodied in the form of a software product in essence or in other words, the part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , magnetic disk, optical disk), including several instructions to make a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) execute the terminal control method described in each embodiment of the present invention.
  • a terminal device which can be a mobile phone, computer, server, air conditioner, or network device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Security & Cryptography (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Telephone Function (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

本发明公开了一种终端控制方法、系统及存储介质，该系统还包括接入设备、服务器和被控终端。所述方法应用于所述系统中的蓝牙耳机时包括：检测到用户的语音控制指令时，获取用户的耳道信息以对用户进行身份验证；若验证通过，与接入设备建立通信连接；基于该通信连接将耳道信息和语音控制指令发送给接入设备，以使接入设备将耳道信息和语音控制指令发送给服务器，供服务器根据耳道信息确定目标账户，并控制该目标账户对应的被控终端执行所述语音控制指令对应的操作。当终端不在蓝牙耳机的通信范围内时，将接入设备和服务器作为通信中转，实现耳机与终端的通信，使用户通过蓝牙耳机实现对终端的控制，保证用户对终端的正常使用，提升用户体验。

Description

终端控制方法、终端控制系统及存储介质
本申请要求于2021年11月26日提交中国专利局、申请号为202111428747.3、发明名称为“终端控制方法、终端控制系统及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及耳机技术领域，尤其涉及一种终端控制方法、终端控制系统及存储介质。
背景技术
随着耳机技术的发展，包括TWS耳机在内的蓝牙耳机已成为越来越多人日常生活的一部分，特别是TWS耳机，小巧易携带。在一些应用场景下，例如当用户进行户外体育运动时，在不方便携带手机等设备的情况下，一般只携带耳机。可知地，耳机与手机通过蓝牙进行通信，当手机等终端设备与用户距离较远时，则会影响耳机与终端之间的通信，一旦超出耳机的蓝牙通信范围，则会造成通信中断，影响用户对手机等终端的控制和正常使用。
发明内容
本发明的主要目的在于提供一种终端控制方法、终端控制系统及存储介质，旨在解决现有技术终端与蓝牙耳机之间的距离超出蓝牙耳机的蓝牙通信范围时，造成与终端的通信中断，影响用户对终端的控制和使用的技术问题。
此外，为实现上述目的，本发明还提供一种应用于终端控制系统中的蓝牙耳机的终端控制方法，所述终端控制系统还包括接入设备、服务器和被控终端，所述终端控制方法包括以下步骤：
当检测到用户的语音控制指令时，获取所述用户的耳道信息并根据所述耳道信息对所述用户进行身份验证；
若验证通过，与所述接入设备建立通信连接；
基于所述通信连接将所述耳道信息和所述语音控制指令发送给所述接入 设备，以使所述接入设备将所述耳道信息和所述语音控制指令发送给所述服务器，供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
可选地，所述与所述接入设备建立通信连接的步骤，包括：
通过NFC向接入设备发送蓝牙地址信息，以供所述接入设备根据所述蓝牙地址信息发送蓝牙地址明细和配对请求；
接收所述接入设备发送的蓝牙地址明细和配对请求，并根据所述配对请求与所述接入设备建立蓝牙通信连接。
可选地，所述接入设备包括一个或多个，当所述接入设备包括多个时，所述根据所述配对请求与所述接入设备建立蓝牙通信连接的步骤之后，还包括：
当检测到与所述接入设备的通信信号强度低于预设阈值时，扫描所述蓝牙地址明细对应的各所述接入设备的信号强度；
确定所述信号强度最强的目标接入设备，并与所述目标接入设备建立蓝牙通信连接。
可选地，所述基于所述通信连接将所述耳道信息和所述语音控制指令发送给所述接入设备的步骤之后，还包括：
接收所述接入设备返回的与所述语音控制指令对应的目标操作信息，其中，所述目标操作信息是由所述服务器对接收的由所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息进行语音转化得到的，所述返回信息包括文本信息和语音信息，所述服务器将所述目标操作信息发送至所述接入设备，以使所述接入设备发送所述目标操作信息；
将所述目标操作信息向所述用户播放。
此外，为实现上述目的，本发明还提供一种应用于终端控制系统中的服务器的终端控制方法，所述终端控制系统还包括蓝牙耳机、接入设备和被控终端，所述终端控制方法包括以下步骤：
接收所述接入设备发送的语音控制指令和耳道信息，其中，所述耳道信息是由所述蓝牙耳机在检测到用户的语音控制指令时获取的，所述蓝牙耳机与所述接入设备建立有通信连接，所述蓝牙耳机根据所述耳道信息对所述用 户进行身份验证，若验证通过，将所述语音控制指令和所述耳道信息发送至所述接入设备，以使所述接入设备发送所述语音控制指令和所述耳道信息；
根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
可选地，所述控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作的步骤之后，还包括：
接收所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息，其中，所述返回信息包括文本信息和语音信息；
当所述返回信息中包括文本信息时，对所述返回信息中的文本信息进行语音转化，得到目标操作信息；
将所述目标操作信息发送至所述接入设备，以使所述接入设备将所述目标操作信息发送给所述蓝牙耳机，并通过所述蓝牙耳机将所述目标操作信息向所述用户播放。
此外，为实现上述目的，本发明还提供一种应用于终端控制系统中的第一接入设备的终端控制方法，所述终端控制系统还包括蓝牙耳机、服务器和被控终端，所述终端控制方法包括以下步骤：
与蓝牙耳机建立通信连接，并接收所述蓝牙耳机发送的语音控制指令和耳道信息，其中，所述耳道信息是由所述蓝牙耳机在检测到用户的语音控制指令时获取的，所述语音控制指令和所述耳道信息是由所述蓝牙耳机根据所述耳道信息对所述用户的身份验证通过时发送的；
将所述语音控制指令和所述耳道信息发送给所述服务器，以供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
可选地，所述接收所述蓝牙耳机的蓝牙地址信息，并与所述蓝牙耳机建立通信连接的步骤，包括：
接收所述蓝牙耳机发送的蓝牙地址信息，根据所述蓝牙地址信息通过NFC向所述蓝牙耳机发送配对请求；
根据所述配对请求与所述蓝牙耳机建立蓝牙通信连接。
可选地，所述第一接入设备与第二接入设备之间通信连接，所述第二接 入设备包括一个或多个，所述接收所述蓝牙耳机发送的蓝牙地址信息的步骤之后，还包括：
检测预设范围内是否存在第二接入设备，若存在，获取所述第二接入设备的蓝牙地址信息，并生成包含自身蓝牙地址信息的蓝牙地址明细；
通过NFC将所述蓝牙地址明细发送给所述蓝牙耳机，以在与所述蓝牙耳机的通信信号强度低于预设强度阈值时，供所述蓝牙耳机扫描所述蓝牙地址明细对应的各接入设备的信号强度，从各所述接入设备中确定信号强度最强的目标接入设备，并与所述目标接入设备建立蓝牙通信连接。
可选地，所述将所述语音控制指令和所述耳道信息发送给所述服务器的步骤之后，还包括：
接收所述服务器发送的目标操作信息，其中，所述目标操作信息是由所述服务器对接收的由所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息进行语音转化得到的，所述返回信息包括文本信息和语音信息；
将所述目标操作信息发送给所述蓝牙耳机，以供所述蓝牙耳机将所述目标操作信息向所述用户播放。
此外，为实现上述目的，本发明还提供一种终端控制系统，所述终端控制系统包括蓝牙耳机，所述蓝牙耳机包括：
耳道识别模块，用于当检测到用户的语音控制指令时，获取所述用户的耳道信息并根据所述耳道信息对所述用户进行身份验证；
NFC模块，用于若验证通过，与接入设备建立通信连接；
蓝牙模块，用于基于所述通信连接将所述耳道信息和所述语音控制指令发送给所述接入设备，以使所述接入设备将所述耳道信息和所述语音控制指令发送给服务器，供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
此外，为实现上述目的，本发明还提供一种终端设备，所述终端设备包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的终端控制程序，所述终端控制程序被所述处理器执行时实现如上述的终端控制方法的步骤。
此外，为实现上述目的，本发明还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有终端控制程序，所述终端控制程序被处理器执行时实现如上述的终端控制方法的步骤。
本发明实施例提出的一种终端控制方法、终端控制系统和存储介质，所述方法应用于终端控制系统中的蓝牙耳机时，所述终端控制系统中还包括接入设备、服务器和被控终端。现有技术中，当用户不方便携带手机等终端设备，而只携带蓝牙耳机时，若终端超出与蓝牙耳机的蓝牙通信范围，则会造成通信中断，影响用户对手机等终端设备的控制和正常使用。基于此，本发明实施例中，当检测到用户的语音控制指令时，获取所述用户的耳道信息并根据所述耳道信息对所述用户进行身份验证；若验证通过，与所述接入设备建立通信连接；基于所述通信连接将所述耳道信息和所述语音控制指令发送给所述接入设备，以使所述接入设备将所述耳道信息和所述语音控制指令发送给所述服务器，供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。当手机等终端设备不在与用户所携带的蓝牙耳机的蓝牙通信范围内时，基于蓝牙耳机与接入设备、接入设备和服务器之间的通信，将接入设备和服务器作为与被控终端之间的通信中转，实现蓝牙耳机与被控终端之间的通信，从而使得用户可以通过蓝牙耳机对手机等终端设备进行控制，保证用户对终端设备的正常使用。
附图说明
图1为本发明实施例提供的终端设备一种实施方式的硬件结构示意图；
图2为本发明终端控制方法第一实施例的流程示意图；
图3为本发明终端控制方法第一实施例中的接入设备分布示意图；
图4为本发明终端控制系统一实施例的功能模块示意图。
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。
在后续的描述中，使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本发明的说明，其本身没有特定的意义。因此，“模块”、“部件”或“单元”可以混合地使用。
本发明实施例终端(又叫终端、设备或者终端设备)可以是PC，也可以是智能手机、平板电脑和便携计算机等具有显示和数据处理功能的可移动式终端设备。
如图1所示，该终端可以包括：处理器1001，例如CPU，网络接口1004，用户接口1003，存储器1005，通信总线1002。其中，通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard)，可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器，也可以是稳定的存储器(non-volatile memory)，例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。
可选地，终端还可以包括摄像头、RF(Radio Frequency，射频)电路，传感器、音频电路、WiFi模块等等。其中，传感器比如光传感器、运动传感器以及其他传感器。具体地，光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示屏的亮度，接近传感器可在移动终端移动到耳边时，关闭显示屏和/或背光。作为运动传感器的一种，重力加速度传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别移动终端姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；当然，移动终端还可配置陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
本领域技术人员可以理解，图1中示出的终端结构并不构成对终端的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部 件布置。
如图1所示，作为一种存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及终端控制程序。
在图1所示的终端中，网络接口1004主要用于连接后台服务器，与后台服务器进行数据通信；用户接口1003主要用于连接客户端(用户端)，与客户端进行数据通信；而处理器1001可以用于调用存储器1005中存储的终端控制程序，所述终端控制程序被处理器执行时实现下述实施例提供的终端控制方法中的操作。
基于上述设备硬件结构，提出了本发明终端控制方法的各实施例。
需要说明的是，在本发明终端控制方法中，设有终端控制系统，该系统中包括蓝牙耳机、接入设备、服务器和被控终端等，本发明终端控制方法可应用于终端控制系统中的蓝牙耳机、接入设备、服务器和被控终端等不同的装置或设备，进而实现对终端的控制功能。以下以应用于不同的装置或设备，对本发明终端控制方法进行详细说明。
参照图2，在本发明终端控制方法的第一实施例中，所述终端方法应用于终端控制系统中的蓝牙耳机，该终端控制系统中还包括接入设备、服务器和被控终端，所述终端控制方法包括：
步骤S10，当检测到用户的语音控制指令时，获取所述用户的耳道信息并根据所述耳道信息对所述用户进行身份验证；
在本实施例中，终端控制方法应用于终端控制系统中的蓝牙耳机，该蓝牙耳机可以是TWS耳机也可以是其他具有蓝牙和NFC通信功能的耳机，在此不作限定。以下以TWS耳机为例，所述终端控制系统中还包括接入设备、服务器和被控终端，其中，被控终端可以是手机，也可以是平板电脑等可移动式的终端设备，以下以手机作为被控终端为例进行说明。可知地，当用户在一些特定场景下，例如进行户外运动时，不方便携带手机等终端设备，但是由于TWS耳机的小巧便携性，用户一般会携带TWS耳机，并将TWS耳机与手机通过蓝牙建立通信连接，一方面可以在运动时收听音乐，另一方面可以通过蓝牙耳机控制手机进行通话等。但当手机与用户之间的距离超出与TWS耳机的蓝牙通信范围时，则会造成通信中断，影响用户对终端设备的控 制和使用。基于此，本实施例中提出一种终端控制方法，可以应用于终端控制系统中的蓝牙耳机，当手机超出与TWS耳机的蓝牙通信范围时，通过接入设备和服务器作为通信中转，实现与手机的通信和控制，保证用户的正常使用。
具体地，当检测到用户的语音控制指令时，获取用户的耳道信息，并根据获取的耳道信息对当前用户进行身份验证，基于耳道信息对用户身份进行验证，是为了确定当前用户是否为手机和TWS耳机的真正用户，从而确保用户的隐私和信息安全。其中，用户的语音控制指令例如播放音乐、呼叫通讯录中的某人以及读取未读消息等，而对用户进行身份验证时，是将获取的耳道信息与预设的耳道信息进行对比、匹配等，确认获取的耳道信息与用户在蓝牙耳机中预存的耳道信息是否一致，从而对当前用户进行身份验证。进一步地，对用户身份的验证可以是在耳机中进行的，也可以是在耳机的充电盒中进行的，在此不作限定。
步骤S20，若验证通过，与所述接入设备建立通信连接；
在对用户进行身份验证后，若验证不通过，则不响应用户的语音控制指令，以确保用户的信息安全性，若验证通过，则检测手机是否处于通信范围内，若是，则直接与手机建立通信连接，并将用户的语音控制指令发送给手机，以控制手机响应于用户的语音控制指令，执行对应的操作。若手机不在通信范围内，则与接入设备建立通信连接，该通信连接为蓝牙通信，其中，接入设备可以是安装在室外路灯杆等公共设施上的，一般具有NFC、蓝牙、4G/5G/WIFI等通信功能，以及自供电功能。在与接入设备建立蓝牙通信连接之前，与接入设备通过NFC进行信息交互，从而实现通信连接的建立。
进一步地，与接入设备建立的通信连接是蓝牙通信连接，建立通信连接的步骤，包括：
步骤S201，通过NFC向接入设备发送蓝牙地址信息，以供所述接入设备根据所述蓝牙地址信息发送蓝牙地址明细和配对请求；
步骤S202，接收所述接入设备发送的蓝牙地址明细和配对请求，并根据所述配对请求与所述接入设备建立蓝牙通信连接。
在与接入设备建立蓝牙通信连接时，首先通过NFC向接入设备发送自身的蓝牙地址信息，以供接入设备在接收到蓝牙地址信息后，根据该蓝牙地址 信息返回相应的信息。接收接入设备返回的信息，其中，接入设备返回的信息包括包含各个接入设备蓝牙地址信息的蓝牙地址明细和配对请求，当接收到接入设备返回的蓝牙地址明细和配对请求时，根据该配对请求与接入设备建立蓝牙通信连接。
更进一步地，接入设备包括一个或多个，即在用户所在位置的预设范围内，可以设有一个接入设备，也可以设有多个接入设备，具体可以根据场地大小及通信环境进行自定义设置。当接入设备有多个时，在与其中一个接入设备建立通信连接后，若用户处于移动状态，则与建立通信连接的设备之间的距离可能逐渐增大，致使通信信号逐渐减弱。当用户与接入设备之间的距离超过预设的距离阈值时，则可能会导致通信中断，因此，当接入设备包括多个时，在与一个接入设备建立通信连接之后，还包括：
步骤S203，当检测到与所述接入设备的通信信号强度低于预设阈值时，扫描所述蓝牙地址明细对应的各所述接入设备的信号强度；
步骤S204，确定所述信号强度最强的目标接入设备，并与所述目标接入设备建立蓝牙通信连接。
当检测到与接入设备的通信信号强度低于预设阈值时，基于接收到的蓝牙地址明细，扫描蓝牙地址明细对应的各个接入设备的信号强度，并将信号强度最强的接入设备作为目标接入设备，然后与该目标接入设备建立蓝牙通信连接。其中，对各接入设备信号强度的扫描，以及与目标接入设备建立通信连接，是在与建立通信连接的接入设备的通信间隙进行的，因此，在扫描信号强度和切换建立通信连接的接入设备时，不会对正常的通信造成影响。
如图3所示，图3为本实施例中在终端控制系统中设置多个接入设备时，接入设备的分布示意图，在图3中，BT2至BT20分别表示20个接入设备。以户外运动场景下在一个400米的操场中布局20个接入设备为例，围绕操场周围每隔20米设置一个接入设备，耳机在用户运动过程中和任一接入设备的距离小于10米时，都在耳机的蓝牙通信距离范围内。假设用户最开始与BT1接入设备连接，在NFC信息交换过程中，BT1会将同组的BT2-BT20的蓝牙地址信息也一同发送给耳机。耳机在移动过程中会利用通信间隙扫描各个接入设备的信号强度，并进行排序，当发现当前连接的接入设备的信号强度小于预设强度阈值时，说明距离连接的接入设备距离较远，则耳机会主动进行 设备切换，并与信号最强的接入设备建立蓝牙通信连接。
步骤S30，基于所述通信连接将所述耳道信息和所述语音控制指令发送给所述接入设备，以使所述接入设备将所述耳道信息和所述语音控制指令发送给所述服务器，供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
在与接入设备建立蓝牙通信连接后，基于建立的蓝牙通信连接向接入设备发送获取的耳道信息和用户的语音控制指令，以使接入设备将接收到的耳道信息和语音控制指令发送给服务器，供服务器根据耳道信息确定用户对应的目标账户，从而控制该目标账户对应的被控终端执行用户的语音控制指令对应的操作。例如，控制手机呼叫某人、播放音乐或读取未读信息等。其中，用户的目标账户是用户通过手机端提前注册并保存到服务器中，注册的账户中包含用户的耳道信息，因此，当对用户的身份验证通过时，基于获取的耳道信息可以确定用户的目标账户，并确定该目标账户对应的被控终端，即用户的手机。可知地，服务器中可能存储有一个或多个用户的账户信息，该账户信息中包含用户的耳道信息和被控终端的设备标识，不同用户的账户信息根据用户的耳道信息进行标识和区分，且该目标账户是用户通过被控终端提前注册并预存到服务器中的。
需要说明的是，在将获取的耳道信息和语音控制指令发送给接入设备时，是基于与接入设备之间建立的蓝牙通信发送的，而接入设备将耳道信息和与因控制指令发送给服务器时，是通过4G/5G/WIFI等通信连接发送的，通过接入设备和服务器做中转，弥补了蓝牙通信范围受限的不足。
进一步地，在将耳道信息和语音控制指令发送给接入设备之后，还包括：
步骤S40，接收所述接入设备返回的与所述语音控制指令对应的目标操作信息，其中，所述目标操作信息是由所述服务器对接收的由所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息进行语音转化得到的，所述返回信息包括文本信息和语音信息，所述服务器将所述目标操作信息发送至所述接入设备，以使所述接入设备发送所述目标操作信息；
步骤S50，将所述目标操作信息向所述用户播放。
在将耳道信息和语音控制指令发送给接入设备后，接入设备将接收到的耳道信息和语音控制指令转发给服务器，服务器根据该耳道信息确定用户的 目标账户，从而根据用户的语音控制指令，控制该目标账户对应的终端执行对应的操作。然后接收接入设备返回的与用户的语音控制指令对应的目标操作信息。其中，该目标操作信息是由服务器对接收到的由手机根据语音控制指令对应的操作类型发送的返回信息进行语音转化得到的，具体地，服务器在根据语音控制指令控制手机执行相应操作时，根据语音控制指令对应的操作类型确定手机需要返回的数据包，操作类型包括通话呼叫、信息读取和语音播放，其中，语音播放包括播放音乐、视频和广播等。根据操作类型的不同，手机向服务器发送不同类型的数据包作为返回信息，该返回信息包括文本信息和语音信息。例如，当语音控制指令对应的操作类型是通话呼叫时，手机在呼叫接通后，向服务器返回被呼叫方的通话语音；当语音控制指令对应的操作类型是信息读取时，以未读信息的读取为例，手机读取未读信息并将读取的未读信息对应的文本信息发送给服务器，服务器对该返回信息中的文本信息进行语音转化得到目标操作信息，然后发送给接入设备，以使接入设备发送目标操作信息。在接收到接入设备发送的目标操作信息后，将该目标操作信息对应的语音向用户播放，以使用户读取手机中的未读信息，达到终端控制的目的。
进一步地，服务器在控制被控终端执行语音控制指令对应的操作时，首先对接收到的用户的语音控制指令进行语音识别，例如，当服务器接收到的用户的语音控制指令为“读取未读信息”，则经过语音识别得到对应的文本指令“读取未读信息”，根据该语音识别结果向手机下发信息读取指令，以控制手机启动信息应用并查询未读消息。其中，手机在启动信息应用并查询到未读信息后，读取该未读信息中的文本信息并向服务器返回，当服务器接收到手机返回的文本信息后，将该文本信息转化为语音信息并转发至接入设备，当接收到接入设备发送的语音信息时，将该语音信息向用户播放，以响应用户对手机发出的“读取未读信息”的语音控制指令。
在本实施例中，终端控制方法应用于终端控制系统中的蓝牙耳机，所述终端控制系统还包括接入设备、服务器和被控终端，当检测到用户的语音控制指令时，获取所述用户的耳道信息并根据所述耳道信息对所述用户进行身份验证；若验证通过，与接入设备建立通信连接；基于所述通信连接将所述 耳道信息和所述语音控制指令发送给所述接入设备，以使所述接入设备将所述耳道信息和所述语音控制指令发送给服务器，供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。当手机等终端设备不在与用户所携带的蓝牙耳机的蓝牙通信范围内时，基于蓝牙耳机与接入设备、接入设备和服务器之间的通信，将接入设备和服务器作为与被控终端之间的通信中转，实现蓝牙耳机与被控终端之间的通信，从而使得用户可以通过蓝牙耳机对手机等终端设备进行控制，保证用户对终端设备的正常使用。
进一步地，在本发明上述实施例的基础上，提出了本发明终端控制方法的第二实施例。
基于上述实施例，本实施例中，终端控制方法应用于终端控制系统中的服务器，所述终端控制系统还包括蓝牙耳机、接入设备和被控终端，当所述终端控制方法应用于终端控制系统中的服务器时，包括以下步骤：
步骤A10，接收所述接入设备发送的语音控制指令和耳道信息，其中，所述耳道信息是由所述蓝牙耳机在检测到用户的语音控制指令时获取的，所述蓝牙耳机与所述接入设备建立有通信连接，所述蓝牙耳机根据所述耳道信息对所述用户进行身份验证，若验证通过，将所述语音控制指令和所述耳道信息发送至所述接入设备，以使所述接入设备发送所述语音控制指令和所述耳道信息；
基于上述实施例，本实施例中，终端控制方法应用于服务器，该方法中还包括蓝牙耳机、接入设备和被控终端，同样地，本实施例中，仍以TWS耳机作为蓝牙耳机(以下简称耳机)、以手机作为被控终端进行说明。
当终端控制方法应用于服务器时，接收接入设备发送的语音控制执行和耳道信息，其中，接收到的耳道信息是由耳机在检测到用户的语音控制指令时获取的，耳机在根据获取的耳道信息对用户的身份验证通过时，将互殴去的耳道信息和语音控制指令发送给接入设备，以使接入设备对耳道信息和语音控制指令进行转发。
步骤A20，根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
在接收到接入设备发送的耳道信息和语音控制指令后，根据接收到的耳道信息确定用户对应的目标账户，在确定用户对应的目标账户后，根据用户的语音控制指令控制该目标账户对应的手机端(被控终端)执行相应的操作。在控制被控终端执行语音控制指令对应的操作时，首先对接收到的用户的语音控制指令进行语音识别，例如，接收到的用户的语音控制指令为“读取未读信息”，则经过语音识别得到对应的文本指令“读取未读信息”，根据该语音识别结果向手机下发信息读取指令，以控制手机启动信息应用并查询未读消息。其中，手机在启动信息应用并查询到未读信息后，读取该未读信息中的文本信息并返回，当接收到手机返回的文本信息后，将该文本信息转化为语音信息并转发至接入设备，以使接入设备将该转化后的语音信息发送至蓝牙耳机，并通过蓝牙耳机向用户播放，以响应用户对手机发出的“读取未读信息”的语音控制指令。
进一步地，在控制手机执行语音控制指令对应的操作之后，还包括：
步骤A30，接收所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息，其中，所述返回信息包括文本信息和语音信息；
在控制手机执行语音控制指令对应的操作之后，接收手机发送的返回信息，该返回信息是由手机根据语音控制指令对应的操作类型执行相应操作后返回的，对于语音控制指令对应的不同操作类型，如通话呼叫、信息读取或音乐播放等，手机返回不同类型的数据包作为返回信息。当接收到手机发送的返回信息时，根据语音控制指令的操作类型不同，对该返回信息进行不同的处理。其中，该返回信息中包括文本信息和语音信息。
步骤A40，当所述返回信息中包括文本信息时，对所述返回信息中的文本信息进行语音转化，得到目标操作信息；
在对接收到的返回信息进行处理时，首先检测返回信息中是否包含文本信息，若包含，则将文本信息转化为语音信息，得到目标操作信息，即手机端对语音控制指令的执行结果。
步骤A50，将所述目标操作信息发送至所述接入设备，以使所述接入设备将所述目标操作信息发送给所述蓝牙耳机，并通过所述蓝牙耳机将所述目标操作信息向所述用户播放。
在得到目标操作信息后，将该目标操作信息通过4G/5GWIFI等通信方式 发送给接入设备，以使接入设备将得到的目标操作信息发送给蓝牙耳机，并通过蓝牙耳机以语音的形式向用户播放，实现用户对终端的控制和使用，在手机不在与耳机的通信范围内的情况下，仍然可以通过耳机正常控制和使用手机，提升用户体验。
在本实施例中，终端控制方法应用于终端控制系统中的服务器，通过接收接入设备发送的语音控制指令和耳道信息，其中，所述耳道信息是由蓝牙耳机在检测到用户的语音控制指令时获取的，所述蓝牙耳机与所述接入设备建立有通信连接，所述蓝牙耳机根据所述耳道信息对所述用户进行身份验证，若验证通过，将所述语音控制指令和所述耳道信息发送至所述接入设备，以使所述接入设备发送所述语音控制指令和所述耳道信息；根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。当用户未携带被控终端且被控终端不在与蓝牙耳机的通信范围内时，服务器与接入设备一起，作为蓝牙耳机与被控终端之间的通信中转，实现蓝牙耳机与被控终端之间的通信，从而使得用户可以通过蓝牙耳机对手机等终端设备进行控制，保证用户对终端设备的正常使用，提升用户体验。
进一步地，在本发明上述第一和/或第二实施例的基础上，提出了本发明终端控制方法的第三实施例。
基于上述实施例，本实施例中，终端控制方法应用于终端控制系统中的第一接入设备，所述第一接入设备与终端控制系统中的第二接入设备之间建立有通信连接，所述终端控制系统还包括蓝牙耳机、服务器和被控终端，当所述终端控制方法应用于终端控制系统中的第一接入设备时，包括以下步骤：
步骤B10，接收所述蓝牙耳机的蓝牙地址信息，并与所述蓝牙耳机建立通信连接；
本实施例中，终端控制方法应用于终端控制系统中的第一接入设备，该终端控制系统还包括蓝牙耳机、服务器和被控终端，基于上述实施例，本实施例中仍以TWS耳机作为蓝牙耳机(以下简称耳机)、以手机作为被控终端为例进行说明。具体地，首先与耳机建立通信连接，建立的通信连接为蓝牙通信连接，在建立蓝牙通信连接之前，与耳机通过NFC进行信息交互，完成蓝牙通信连接的建立。
步骤B20，接收所述蓝牙耳机发送的语音控制指令和耳道信息，其中，所述耳道信息是由所述蓝牙耳机在检测到用户的语音控制指令时获取的，所述语音控制指令和所述耳道信息是由所述蓝牙耳机根据所述耳道信息对所述用户的身份验证通过时发送的；
在建立蓝牙通信连接后，接收耳机发送的耳道信息和语音控制指令，其中，耳道信息是耳机在检测到用户的语音控制指令时获取的，耳道信息和语音控制指令是在耳机根据耳道信息对用户的身份验证通过时发送的。
进一步地，与耳机建立蓝牙通信连接步骤包括：
步骤B101，接收所述蓝牙耳机发送的蓝牙地址信息，根据所述蓝牙地址信息通过NFC向所述蓝牙耳机发送配对请求；
步骤B102，根据所述配对请求与所述蓝牙耳机建立蓝牙通信连接。
在与耳机建立蓝牙通信连接时，首先接收耳机通过NFC发送的蓝牙地址信息，基于该蓝牙地址信息，通过NFC向耳机发送配对请求，以供耳机基于该配对请求进行配对，从而根据发送的配对请求与耳机建立蓝牙通信连接。
更进一步地，第一接入设备与第二接入设备建立有通信连接，该通信连接可以是NFC通信、蓝牙通信、4G/5G/WIFI通信中的一种或多种，在此不作限定。第二接入设备包括一个或多个，在与耳机建立通信连接之后，还包括：
步骤B103，检测预设范围内是否存在第二接入设备，若存在，获取所述第二接入设备的蓝牙地址信息，并生成包含自身蓝牙地址信息的蓝牙地址明细；
步骤B104，通过NFC将所述蓝牙地址明细发送给所述蓝牙耳机，以在与所述蓝牙耳机的通信信号强度低于预设强度阈值时，供所述蓝牙耳机扫描所述蓝牙地址明细对应的各接入设备的信号强度，从所述第二接入设备中确定信号强度最强的目标接入设备，并与所述目标接入设备建立蓝牙通信连接。
当接收到耳机发送的蓝牙地址信息后，检测预设范围内是否存在第二接入设备，若存在，则基于与第二接入设备之间的通信连接，获取各第二接入设备的蓝牙地址信息，并生成包含自身蓝牙地址信息的蓝牙地址明细。然后在通过NFC向耳机发送配对请求时，一并将生成的蓝牙地址明细发送给耳机，以在与耳机之间的通信信号的强度低于预设强度阈值时，供耳机扫描该蓝牙地址明细对应的各个接入设备的信号强度，并从各接入设备中确定信号强度 最强的目标接入设备，与该目标接入设备重新建立蓝牙通信连接，实现通信设备的切换，防止通信中断。
需要说明的是，耳机对接入设备信号强度的扫描，是在通信间隙进行的，因此，与耳机建立蓝牙通信连接的接入设备的切换、以及耳机对接入设备的扫描等，不会对通信造成影响或者影响较小。
步骤B30，将所述语音控制指令和所述耳道信息发送给所述服务器，以供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
在接收到耳机发送的耳道信息和语音控制指令后，将耳道信息和语音控制指令发送给服务器，以供服务器根据耳道信息确定用户对应的目标账户，并控制该目标账户对应的被控终端执行用户的语音控制指令对应的操作。可知地，服务器中可能存储有一个或多个用户的账户信息，该账户信息中包含用户的耳道信息和被控终端的设备标识，不同用户的账户信息根据用户的耳道信息进行标识和区分，且该目标账户是用户通过被控终端提前注册并预存到服务器中的。控制目标账户对应的手机执行用户的语音控制指令对应的操作，例如，控制手机呼叫某人、播放音乐或读取未读信息等。
进一步地，服务器在控制被控终端执行语音控制指令对应的操作时，首先对接收到的用户的语音控制指令进行语音识别，例如，当服务器接收到的用户的语音控制指令为“读取未读信息”，则经过语音识别得到对应的文本指令“读取未读信息”，根据该语音识别结果向手机下发信息读取指令，以控制手机启动信息应用并查询未读消息。其中，手机在启动信息应用并查询到未读信息后，读取该未读信息中的文本信息并向服务器返回，当服务器接收到手机返回的文本信息后，将该文本信息转化为语音信息并转发，当接收到接入设备发送的语音信息时，将该语音信息转发至蓝牙耳机，以供蓝牙耳机将该语音信息向用户播放，从而响应用户对手机发出的“读取未读信息”的语音控制指令。
在将耳道信息和语音控制指令发送给服务器时，是基于4G/5GWIFI等通信方式发送的，在将耳道信息和语音控制指令发送给服务器之后，还包括：
步骤B40，接收所述服务器发送的目标操作信息，其中，所述目标操作信息是由所述服务器对接收的由所述被控终端根据所述语音控制指令对应的 操作类型发送的返回信息进行语音转化得到的，所述返回信息包括文本信息和语音信息；
步骤B50，将所述目标操作信息发送给所述蓝牙耳机，以供所述蓝牙耳机将所述目标操作信息向所述用户播放。
在将耳道信息和语音控制指令发送给服务器之后，服务器根据接收到的耳道信息确定用户的目标账户，并根据用户的语音控制指令控制该目标账户对应的手机执行用户的语音控制指令对应的操作。当手机执行语音控制指令对应的操作后，根据该语音控制指令对应的操作类型，向服务器返回不同类型的数据包作为返回信息，该返回信息即为手机对语音控制指令的执行结果。其中，服务器接收到的手机的返回信息中包括文本信息和语音信息，语音控制指令的操作类型包括通话呼叫、信息读取和语音播放等。例如，当语音控制指令对应的操作类型是通话呼叫时，手机在呼叫接通后，向服务器返回被呼叫方的通话语音；当语音控制指令对应的操作类型是信息读取时，手机读取未读信息并将读取的未读信息对应的文本信息发送给服务器，服务器对该返回信息中的文本信息进行语音转化得到目标操作信息，然后将该目标操作信息发送出去。在接收到服务器发送的目标操作信息后，将该目标操作信息发送给耳机，以供耳机将目标操作信息对应的语音向用户播放，使用户获取到手机中的未读信息，达到终端控制的目的。
在本实施例中，终端控制方法应用于终端控制系统中的第一接入设备，该终端控制系统还包括第二接入设备、蓝牙耳机、服务器和被控终端，通过与蓝牙耳机建立蓝牙通信连接，并接收所述蓝牙耳机发送的语音控制指令和耳道信息，其中，所述耳道信息是由所述蓝牙耳机在检测到用户的语音控制指令时获取的，所述语音控制指令和所述耳道信息是由所述蓝牙耳机根据所述耳道信息对所述用户的身份验证通过时发送的；将所述语音控制指令和所述耳道信息发送给所述服务器，以供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。接入设备与服务器一起，作为蓝牙耳机与被控终端之间的通信中转，实现蓝牙耳机与被控终端之间的通信，从而使得用户可以通过蓝牙耳机对手机等终端设备进行控制，保证用户对终端设备的正常使用，提升用户体验。
可以理解的是，本发明中的终端控制方法还可以应用于终端控制系统中 的被控终端，当应用于被控终端时，终端控制系统中还包括蓝牙耳机、接入设备和服务器，当被控终端接收到服务器下发的语音控制指令时，执行相应的操作，并根据该语音控制指令对应的操作类型，向服务器返回不同类型的数据包作为返回信息，以供服务器将该返回信息通过接入设备转发至蓝牙耳机，并通过蓝牙耳机想用户以语音的形式播放。其中，接收的服务器下发的指令也可以是由服务器根据用户的语音控制指令进行语音识别后生成的指令，在此不作限定。可知地，本发明中的终端控制方法应用于终端控制系统中的被控终端时，所实现的功能与功能实现的过程均与上述实施例相同，在此不再赘述。
此外，参照图4，本发明实施例还提出一种终端控制系统，所述终端控制系统包括蓝牙耳机，所述蓝牙耳机包括：
耳道识别模块10，用于当检测到用户的语音控制指令时，获取所述用户的耳道信息并根据所述耳道信息对所述用户进行身份验证；
NFC模块20，用于若验证通过，与所述接入设备建立通信连接；
蓝牙模块30，用于基于所述通信连接将所述耳道信息和所述语音控制指令发送给所述接入设备，以使所述接入设备将所述耳道信息和所述语音控制指令发送给所述服务器，供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
可选地，所述NFC模块20，还用于：
通过NFC向接入设备发送蓝牙地址信息，以供所述接入设备根据所述蓝牙地址信息发送蓝牙地址明细和配对请求；
接收所述接入设备发送的蓝牙地址明细和配对请求，并根据所述配对请求与所述接入设备建立蓝牙通信连接。
可选地，所述蓝牙耳机还包括连接管理模块，用于：
当检测到与所述接入设备的通信信号强度低于预设阈值时，扫描所述蓝牙地址明细对应的各所述接入设备的信号强度；
确定所述信号强度最强的目标接入设备，并与所述目标接入设备建立蓝牙通信连接。
可选地，所述蓝牙耳机还包括语音播放模块，用于：
接收所述接入设备返回的与所述语音控制指令对应的目标操作信息，其中，所述目标操作信息是由所述服务器对接收的由所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息进行语音转化得到的，所述返回信息包括文本信息和语音信息，所述服务器将所述目标操作信息发送至所述接入设备，以使所述接入设备发送所述目标操作信息；
将所述目标操作信息向所述用户播放。
此外，本发明实施例还提出一种终端控制系统，所述终端控制系统还包括服务器，所述服务器包括：
第一通信模块，用于接收所述接入设备发送的语音控制指令和耳道信息，其中，所述耳道信息是由所述蓝牙耳机在检测到用户的语音控制指令时获取的，所述蓝牙耳机与所述接入设备建立有通信连接，所述蓝牙耳机根据所述耳道信息对所述用户进行身份验证，若验证通过，将所述语音控制指令和所述耳道信息发送至所述接入设备，以使所述接入设备发送所述语音控制指令和所述耳道信息；
终端控制模块，用于根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
可选地，所述服务器还包括：
第一信息接收模块，用于接收所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息，其中，所述返回信息包括文本信息和语音信息；
信息转化模块，用于当所述返回信息中包括文本信息时，对所述返回信息中的文本信息进行语音转化，得到目标操作信息；
第一信息发送模块，用于将所述目标操作信息发送至所述接入设备，以使所述接入设备将所述目标操作信息发送给所述蓝牙耳机，并通过所述蓝牙耳机将所述目标操作信息向所述用户播放。
此外，本发明实施例还提出一种终端控制系统，所述终端控制系统还包括第一接入设备，所述第一接入设备包括：
NFC接收模块，用于接收所述蓝牙耳机的蓝牙地址信息，并与所述蓝牙耳机建立通信连接；
蓝牙接收模块，用于接收所述蓝牙耳机发送的语音控制指令和耳道信息，其中，所述耳道信息是由所述蓝牙耳机在检测到用户的语音控制指令时获取的，所述语音控制指令和所述耳道信息是由所述蓝牙耳机根据所述耳道信息对所述用户的身份验证通过时发送的；
第二信息发送模块，用于将所述语音控制指令和所述耳道信息发送给所述服务器，以供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
可选地，所述NFC通信模块，还用于：
接收所述蓝牙耳机发送的蓝牙地址信息，根据所述蓝牙地址信息通过NFC向所述蓝牙耳机发送配对请求；
根据所述配对请求与所述蓝牙耳机建立蓝牙通信连接。
可选地，所述第一接入设备还包括：
信息检测模块，用于检测预设范围内是否存在第二接入设备，若存在，获取所述第二接入设备的蓝牙地址信息，并生成包含自身蓝牙地址信息的蓝牙地址明细；
所述NFC通信模块，还用于通过NFC将所述蓝牙地址明细发送给所述蓝牙耳机，以在与所述蓝牙耳机的通信信号强度低于预设强度阈值时，供所述蓝牙耳机扫描所述蓝牙地址明细对应的各接入设备的信号强度，从各所述接入设备中确定信号强度最强的目标接入设备，并与所述目标接入设备建立蓝牙通信连接。
可选地，所述第一接入设备还包括：
第二信息接收模块，用于接收所述服务器发送的目标操作信息，其中，所述目标操作信息是由所述服务器对接收的由所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息进行语音转化得到的，所述返回信息包括文本信息和语音信息；
蓝牙发送模块，用于将所述目标操作信息发送给所述蓝牙耳机，以供所述蓝牙耳机将所述目标操作信息向所述用户播放。
此外，本发明实施例还提出一种计算机可读存储介质，所述计算机可读存储介质上存储有终端控制程序，所述终端控制程序被处理器执行时实现上 述实施例提供的终端控制方法中的操作。
本发明存储介质各实施例，均可参照本发明终端控制方法各个实施例，此处不再赘述。
需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体/操作/对象与另一个实体/操作/对象区分开来，而不一定要求或者暗示这些实体/操作/对象之间存在任何这种实际的关系或者顺序；术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。
对于系统实施例而言，由于其基本相似于方法实施例，所以描述得比较简单，相关之处参见方法实施例的部分说明即可。以上所描述的系统实施例仅仅是示意性的，其中作为分离部件说明的单元可以是或者也可以不是物理上分开的。可以根据实际的需要选择中的部分或者全部模块来实现本发明方案的目的。本领域普通技术人员在不付出创造性劳动的情况下，即可以理解并实施。
上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本发明各个实施例所述的终端控制方法。
以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是 利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。

Claims (10)

  1. 一种终端控制方法，应用于终端控制系统中的蓝牙耳机，其特征在于，所述终端控制系统还包括接入设备、服务器和被控终端，所述终端控制方法包括以下步骤：
    当检测到用户的语音控制指令时，获取所述用户的耳道信息并根据所述耳道信息对所述用户进行身份验证；
    若验证通过，与所述接入设备建立通信连接；
    基于所述通信连接将所述耳道信息和所述语音控制指令发送给所述接入设备，以使所述接入设备将所述耳道信息和所述语音控制指令发送给所述服务器，供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
  2. 如权利要求1所述的终端控制方法，其特征在于，所述与所述接入设备建立通信连接的步骤，包括：
    通过NFC向接入设备发送蓝牙地址信息，以供所述接入设备根据所述蓝牙地址信息发送蓝牙地址明细和配对请求；
    接收所述接入设备发送的蓝牙地址明细和配对请求，并根据所述配对请求与所述接入设备建立蓝牙通信连接；
    其中，所述接入设备包括一个或多个，当所述接入设备包括多个时，所述根据所述配对请求与所述接入设备建立蓝牙通信连接的步骤之后，还包括：
    当检测到与所述接入设备的通信信号强度低于预设阈值时，扫描所述蓝牙地址明细对应的各所述接入设备的信号强度；
    确定所述信号强度最强的目标接入设备，并与所述目标接入设备建立蓝牙通信连接。
  3. 如权利要求1所述的终端控制方法，其特征在于，所述基于所述通信连接将所述耳道信息和所述语音控制指令发送给所述接入设备的步骤之后，还包括：
    接收所述接入设备返回的与所述语音控制指令对应的目标操作信息，其中，所述目标操作信息是由所述服务器对接收的由所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息进行语音转化得到的，所述返回信息包括文本信息和语音信息，所述服务器将所述目标操作信息发送至所述接入设备，以使所述接入设备发送所述目标操作信息；
    将所述目标操作信息向所述用户播放。
  4. 一种终端控制方法，应用于终端控制系统中的服务器，其特征在于，所述终端控制系统还包括蓝牙耳机、接入设备和被控终端，所述终端控制方法包括以下步骤：
    接收所述接入设备发送的语音控制指令和耳道信息，其中，所述耳道信息是由所述蓝牙耳机在检测到用户的语音控制指令时获取的，所述蓝牙耳机与所述接入设备建立有通信连接，所述蓝牙耳机根据所述耳道信息对所述用户进行身份验证，若验证通过，将所述语音控制指令和所述耳道信息发送至所述接入设备，以使所述接入设备发送所述语音控制指令和所述耳道信息；
    根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
  5. 如权利要求4所述的终端控制方法，其特征在于，所述控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作的步骤之后，还包括：
    接收所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息，其中，所述返回信息包括文本信息和语音信息；
    当所述返回信息中包括文本信息时，对所述返回信息中的文本信息进行语音转化，得到目标操作信息；
    将所述目标操作信息发送至所述接入设备，以使所述接入设备将所述目标操作信息发送给所述蓝牙耳机，并通过所述蓝牙耳机将所述目标操作信息向所述用户播放。
  6. 一种终端控制方法，应用于终端控制系统中的第一接入设备，其特征 在于，所述终端控制系统还包括蓝牙耳机、服务器和被控终端，所述终端控制方法包括以下步骤：
    接收所述蓝牙耳机的蓝牙地址信息，并与所述蓝牙耳机建立通信连接；
    接收所述蓝牙耳机发送的语音控制指令和耳道信息，其中，所述耳道信息是由所述蓝牙耳机在检测到用户的语音控制指令时获取的，所述语音控制指令和所述耳道信息是由所述蓝牙耳机根据所述耳道信息对所述用户的身份验证通过时发送的；
    将所述语音控制指令和所述耳道信息发送给所述服务器，以供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
  7. 如权利要求6所述的终端控制方法，其特征在于，所述第一接入设备与第二接入设备之间通信连接，所述第二接入设备包括一个或多个，所述接收所述蓝牙耳机的蓝牙地址信息，并与所述蓝牙耳机建立通信连接的步骤，包括：
    接收所述蓝牙耳机发送的蓝牙地址信息，根据所述蓝牙地址信息通过NFC向所述蓝牙耳机发送配对请求；
    根据所述配对请求与所述蓝牙耳机建立蓝牙通信连接；
    所述接收所述蓝牙耳机发送的蓝牙地址信息的步骤之后，还包括：
    检测预设范围内是否存在第二接入设备，若存在，获取所述第二接入设备的蓝牙地址信息，并生成包含自身蓝牙地址信息的蓝牙地址明细；
    通过NFC将所述蓝牙地址明细发送给所述蓝牙耳机，以在与所述蓝牙耳机的通信信号强度低于预设强度阈值时，供所述蓝牙耳机扫描所述蓝牙地址明细对应的各接入设备的信号强度，从各所述接入设备中确定信号强度最强的目标接入设备，并与所述目标接入设备建立蓝牙通信连接。
  8. 如权利要求6所述的终端控制方法，其特征在于，所述将所述语音控制指令和所述耳道信息发送给所述服务器的步骤之后，还包括：
    接收所述服务器发送的目标操作信息，其中，所述目标操作信息是由所 述服务器对接收的由所述被控终端根据所述语音控制指令对应的操作类型发送的返回信息进行语音转化得到的，所述返回信息包括文本信息和语音信息；
    将所述目标操作信息发送给所述蓝牙耳机，以供所述蓝牙耳机将所述目标操作信息向所述用户播放。
  9. 一种终端控制系统，其特征在于，所述终端控制系统包括蓝牙耳机，所述蓝牙耳机包括：
    耳道识别模块，用于当检测到用户的语音控制指令时，获取所述用户的耳道信息并根据所述耳道信息对所述用户进行身份验证；
    NFC模块，用于若验证通过，与所述接入设备建立通信连接；
    蓝牙模块，用于基于所述通信连接将所述耳道信息和所述语音控制指令发送给所述接入设备，以使所述接入设备将所述耳道信息和所述语音控制指令发送给所述服务器，供所述服务器根据所述耳道信息确定目标账户，并控制所述目标账户对应的被控终端执行所述语音控制指令对应的操作。
  10. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质上存储有终端控制程序，所述终端控制程序被处理器执行时实现如权利要求1至8中任一项所述的终端控制方法的步骤。
PCT/CN2021/140694 2021-11-26 2021-12-23 终端控制方法、终端控制系统及存储介质 WO2023092785A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111428747.3 2021-11-26
CN202111428747.3A CN114158019A (zh) 2021-11-26 2021-11-26 终端控制方法、终端控制系统及存储介质

Publications (1)

Publication Number Publication Date
WO2023092785A1 true WO2023092785A1 (zh) 2023-06-01

Family

ID=80784238

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/140694 WO2023092785A1 (zh) 2021-11-26 2021-12-23 终端控制方法、终端控制系统及存储介质

Country Status (2)

Country Link
CN (1) CN114158019A (zh)
WO (1) WO2023092785A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115190197B (zh) * 2022-09-13 2023-02-17 荣耀终端有限公司 基于蓝牙耳机的通话方法、装置及存储介质
CN116744267B (zh) * 2022-11-16 2024-05-21 荣耀终端有限公司 数据处理方法、系统、电子设备和存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107591152A (zh) * 2017-08-30 2018-01-16 百度在线网络技术（北京）有限公司 基于耳机的语音控制方法、装置及其设备
US20180113673A1 (en) * 2016-10-20 2018-04-26 Qualcomm Incorporated Systems and methods for in-ear control of remote devices
CN108710486A (zh) * 2018-05-28 2018-10-26 Oppo广东移动通信有限公司 音频播放方法、装置、耳机及计算机可读存储介质
US20200202868A1 (en) * 2018-12-21 2020-06-25 Cirrus Logic International Semiconductor Ltd. Methods, systems and apparatus for managing voice-based commands
CN111462746A (zh) * 2020-04-08 2020-07-28 歌尔科技有限公司 基于tws耳机的控制方法、系统、装置和设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180113673A1 (en) * 2016-10-20 2018-04-26 Qualcomm Incorporated Systems and methods for in-ear control of remote devices
CN107591152A (zh) * 2017-08-30 2018-01-16 百度在线网络技术（北京）有限公司 基于耳机的语音控制方法、装置及其设备
CN108710486A (zh) * 2018-05-28 2018-10-26 Oppo广东移动通信有限公司 音频播放方法、装置、耳机及计算机可读存储介质
US20200202868A1 (en) * 2018-12-21 2020-06-25 Cirrus Logic International Semiconductor Ltd. Methods, systems and apparatus for managing voice-based commands
CN111462746A (zh) * 2020-04-08 2020-07-28 歌尔科技有限公司 基于tws耳机的控制方法、系统、装置和设备

Also Published As

Publication number Publication date
CN114158019A (zh) 2022-03-08

Similar Documents

Publication Publication Date Title
RU2608948C2 (ru) Способ, устройство и система для управления доступом к маршрутизатору
US10304461B2 (en) Remote electronic service requesting and processing method, server, and terminal
WO2017092417A1 (zh) 基于智能终端设备的网络接入的方法和装置
WO2023092785A1 (zh) 终端控制方法、终端控制系统及存储介质
JP6105023B1 (ja) 画面共有サーバ、画面共有方法及び画面共有サーバ用プログラム
CN108965306B (zh) 一种通话处理方法及移动终端
WO2018121086A1 (zh) 连接隐藏ap的方法与终端设备
US8892088B2 (en) Systems and methods for handling incoming calls on a media device
WO2020164526A1 (zh) 一种分布式系统中的节点控制方法和相关装置
US20120158979A1 (en) Method and apparatus for controlling access to access point in mobile terminal
CN107846516B (zh) 一种通话场景提示方法及移动终端
CN107959952B (zh) 一种异系统小区的检测方法及终端
CN111432386B (zh) 蓝牙耳机的连接切换方法、装置、设备及存储介质
KR20150026654A (ko) 전자장치의 네트워크 연결을 위한 방법 및 장치
WO2021204056A1 (zh) 网关接入方法及电子设备
WO2021190373A1 (zh) 一种交互方法、交互系统和显示设备
WO2019214706A1 (zh) 接入控制方法、消息广播方法及相关设备
JPWO2010131771A1 (ja) 情報処理装置、外部機器拡張システム、外部機器拡張方法、外部機器拡張プログラムおよびプログラム記録媒体
WO2021077898A1 (zh) 网络注册方法及电子设备
CN112752353A (zh) 一种连接方法及终端设备
WO2021175244A1 (zh) 授权和策略参数配置方法、终端及网络功能
CN104618987B (zh) 接入网络的方法及装置
CN112654073B (zh) 网络附着方法及用户设备
KR20190098346A (ko) 위급한 상황에 처한 사용자의 위치 정보를 제공하는 전자 장치 및 방법
JP2016212752A (ja) 画面共有サーバ、画面共有方法及び画面共有プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21965504

Country of ref document: EP

Kind code of ref document: A1