WO2022193883A1 - Method and apparatus for responding to control voice, terminal, storage medium, and program product - Google Patents

Method and apparatus for responding to control voice, terminal, storage medium, and program product Download PDF

Info

Publication number
WO2022193883A1
WO2022193883A1 PCT/CN2022/076078 CN2022076078W WO2022193883A1 WO 2022193883 A1 WO2022193883 A1 WO 2022193883A1 CN 2022076078 W CN2022076078 W CN 2022076078W WO 2022193883 A1 WO2022193883 A1 WO 2022193883A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
component
distance
relationship
angle
Prior art date
Application number
PCT/CN2022/076078
Other languages
French (fr)
Chinese (zh)
Inventor
徐炜楠
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2022193883A1 publication Critical patent/WO2022193883A1/en

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1016Earpieces of the intra-aural type
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1041Mechanical or electronic switches, or control elements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1091Details not provided for in groups H04R1/1008 - H04R1/1083
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/10Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups
    • H04R2201/107Monophonic and stereophonic headphones with microphone for two-way hands free communication

Definitions

  • the embodiments of the present application relate to the technical field of voice control, and in particular, to a method, apparatus, terminal, storage medium, and program product for responding to control voice.
  • an intelligent device is provided with a microphone (Microphone) for monitoring the user's voice. After the user speaks the control voice, the smart device will perform corresponding actions in response to the control voice.
  • a microphone Microphone
  • the smart device will perform corresponding actions in response to the control voice.
  • Embodiments of the present application provide a method, apparatus, terminal, storage medium, and program product for responding to a control voice.
  • the technical solution is as follows:
  • a method for responding to a control voice which is applied to a first terminal, and the method includes:
  • the facing relationship is used to indicate that the front side of the user faces the first terminal.
  • an apparatus for responding to a control voice which is applied in a first terminal, and the apparatus includes:
  • the voice receiving module is used to receive the control voice through the microphone
  • a relationship obtaining module configured to obtain a first relative orientation relationship between the front face of the user and the first terminal through a positioning component in response to the control voice meeting a preset condition
  • An operation execution module configured to execute an operation corresponding to the control voice in response to the first relative orientation relationship being a facing relationship, where the facing relationship is used to indicate that the front of the user faces the first terminal.
  • a terminal includes a processor and a memory, the memory stores at least one computer instruction, the computer instruction is loaded and executed by the processor to implement the Methods of responding to control speech provided by various aspects of the present application.
  • a computer-readable storage medium having stored therein at least one computer instruction, the computer instruction being loaded and executed by a processor to implement various aspects of the present application. Response to control voice method.
  • a computer program product comprising computer instructions stored in a computer-readable storage medium.
  • a processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method of responding to control speech as provided by various aspects of the present application.
  • a computer program includes computer instructions, and a processor of a computer device executes the computer instructions, so that the computer device executes the method for responding to control speech provided by various aspects of the present application.
  • the embodiment of the present application can be applied to a first terminal, where a control voice is received through a microphone, and when the control voice meets a preset condition, a first relative orientation relationship between the front face of the user and the first terminal is determined through a positioning component, and when the control voice meets a preset condition
  • the facing relationship indicates that when the front of the user faces the first terminal, the first terminal will perform the corresponding operation of the control voice. It can be seen that the present application enables the first terminal to determine the orientation of the user, thereby determining whether the wearable device faces itself, and enhances the ability to intelligently respond to control voices.
  • FIG. 1 is a schematic diagram of a first relative orientation relationship provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of a first relative orientation relationship provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of an application environment of a method for responding to a control voice provided by an embodiment of the present application
  • FIG. 4 is a structural block diagram of a first terminal provided by an exemplary embodiment of the present application.
  • FIG. 5 is a flowchart of a method for responding to a control voice provided by an exemplary embodiment of the present application
  • FIG. 6 is a flowchart of a method for responding to a control voice provided by another exemplary embodiment of the present application.
  • FIG. 7 is a schematic diagram of a projection position relationship provided based on the embodiment shown in FIG. 6;
  • FIG. 8 is a schematic diagram of an example of a response control voice provided based on the embodiment shown in FIG. 6;
  • FIG. 9 is a schematic diagram of an example of another response control voice provided based on the embodiment shown in FIG. 6;
  • FIG. 10 is a structural block diagram of an apparatus for responding to a control voice provided by an exemplary embodiment of the present application.
  • a plurality means two or more.
  • “And/or”, which describes the association relationship of the associated objects means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone.
  • the character “/” generally indicates that the associated objects are an "or" relationship.
  • Control speech a piece of speech spoken by the user, which has the function of controlling the terminal to perform corresponding operations, wherein the control speech may include semantic content and non-semantic content.
  • the control speech may include a semantic part, that is, the text content corresponding to the control speech has actual language meaning.
  • the control voice may include non-semantic parts, that is, the content corresponding to the control voice does not correspond to the content with actual language meaning, but is controlled by sound characteristics predetermined with the device in advance, such as intonation and volume Sound characteristics such as size.
  • the control speech includes a semantic part and a non-semantic part, and after receiving the control speech, the first terminal can recognize both parts.
  • Preset conditions conditions used in this application to indicate that the content of the control voice meets.
  • the preset condition is used to indicate the corresponding semantic content or text template.
  • the preset condition is used to indicate the corresponding sound feature template. Wherein, that the control speech conforms to the preset condition indicates that the semantic part in the control speech conforms to the corresponding semantic content or conforms to the corresponding text template, and/or that the non-semantic part of the control speech conforms to the corresponding sound feature template.
  • Wearable device a smart device used to indicate that the user is wearing it.
  • the wearable device may be a left-right symmetrical or a left-right asymmetrical device worn on the user's head.
  • the wearable device may include at least one of smart glasses, smart earphones, smart earrings or smart collars.
  • the smart earphone may be a TWS (True Wireless Stereo) earphone.
  • the wearable device includes a first component and a second component.
  • the first component is located on the user's left side and the second component is located on the user's right side.
  • the first component and the second component are independent components, the first component is an independent device in physical form, and the second component is also an independent device in physical form.
  • the first component is the left earphone in the TWS earphone
  • the second component is the right earphone in the TWS earphone.
  • the wearable device is a smart earring
  • the first component is the left earring in the smart earring
  • the second component is the right earring in the smart earring.
  • the first component and the second component are components disposed at different positions in the same wearable device.
  • the wearable device is smart glasses
  • the first component is arranged in the left temple
  • the second component is arranged in the right temple.
  • the first component and the second component are symmetrically arranged about the central axis of the smart glasses.
  • the front of the wearable device is used to indicate the reference surface in the wearable device.
  • the front of the wearable device is the side that faces the same as the user's face when the wearable device is worn (in other words, the direction of the face is perpendicular to the front of the wearable device), that is, the wearable device is worn.
  • the front of the device is the side that the user faces when wearing the wearable device.
  • the front of a wearable is a relative concept. If a reference point is specified, the front of the wearable device relative to the reference point takes the reference point as the origin, and when the first component is located in the clockwise direction of the second component, the connecting plane between the first component and the second component to the side of the reference point.
  • the first relative orientation relationship used to indicate the orientation relationship between the user and the first terminal.
  • the orientation relationship between the user's face and the first terminal may be defined as a first relative orientation relationship.
  • the first relative orientation relationship is a facing relationship.
  • the front of the wearable device faces away from the first terminal, the first relative orientation relationship is a back-to-back relationship.
  • the terminal may divide the 360° range of the frontal orientation of the user into two 180° ranges.
  • the range of the first 180° is the range indicated by the facing relationship, and the range of the other 180° is the range indicated by the back-to-back relationship.
  • the terminal may divide the 360° range of the user's frontal orientation into 180° corresponding to the back-to-back relationship, 30° of the front-facing range corresponding to the facing relationship, and 30° corresponding to the side-to-side relationship. other 150° range.
  • FIG. 1 is a schematic diagram of a first relative orientation relationship provided by an embodiment of the present application.
  • the front of the user is represented by the wearable device, and the first terminal obtains the orientation of the front of the user by locating the wearable device.
  • the front of the wearable device 110 is 1A.
  • the distance between the wearable device 110 and the first terminal 120 The relationship between is a face-to-face relationship.
  • the relationship between the wearable device 110 and the first terminal 120 is a back-to-back relationship.
  • FIG. 2 is a schematic diagram of a first relative orientation relationship provided by an embodiment of the present application.
  • the front of the wearable device is 1A.
  • the first terminal is located in a sector area of plus or minus 15 degrees of the positive half-axis of the y-axis with the center of the wearable device as the reference coordinate system, that is, the first terminal is located at When the front side of the wearable device is in a 30-degree fan-shaped area, the relationship between the wearable device and the first terminal is a facing relationship.
  • the first terminal is located in an area other than the above-mentioned 30-degree area on the front of the wearable device, the relationship between the wearable device and the first terminal is a side-to-side relationship.
  • the first terminal is located in the y-axis negative semi-axis region of the reference coordinate system with the center of the wearable device, the relationship between the wearable device and the first terminal is a back-to-back relationship.
  • the embodiment shown in FIG. 2 is only a schematic illustration of the first relative orientation relationship, and the present application can also take the sector-shaped area where the first terminal is located in other angular ranges on the front of the wearable device as the corresponding orientation. relationship area.
  • the angular range may include [0°, 30°]. It should be noted that when the angle range is 0°, it means that the first terminal is located on the positive half-axis of the y-axis of the reference coordinate system, and the angle can take values such as 5°, 10°, 15° or 20°.
  • the orientation relationship between the first first terminal 121 and the wearable device is a facing relationship.
  • the orientation relationship between the second first terminal 122 and the wearable device is a side-to-side relationship.
  • the orientation relationship between the third first terminal 123 and the wearable device is a back-to-back relationship.
  • FIG. 3 is a schematic diagram of an application environment of a method for responding to a control voice provided by an embodiment of the present application.
  • the viewing angle provided in FIG. 3 is a top-down viewing angle, that is, the plane viewed from the inside of the paper is a horizontal plane, and the direction of the viewing angle is looking from the sky to the ground.
  • the wearable device is a TWS earphone as an example for introduction.
  • the left ear of the user 30 wears the left ear earphone 311 of the TWS earphone, and the right ear of the user 30 wears the right ear earphone 312 of the TWS earphone.
  • the first terminal 120 is located on the front of the TWS headset, and the second terminal 130 and the third terminal 140 exist.
  • the second terminal 130 is located on the side of the TWS headset, and the third terminal 140 is located on the back of the TWS headset.
  • the voice control scheme in the related art after the user speaks the control voice, the first terminal 120 , the second terminal 130 and the third terminal 140 will all respond to the control voice, causing confusion , and according to the method for responding to the control voice provided by the present application, among the three terminals, only the first terminal 120 facing the user will perform corresponding operations in response to the control voice, while the second terminal 130 and the third terminal 140 will not respond to the control voice.
  • the voice should be controlled.
  • FIG. 4 is a structural block diagram of a first terminal provided by an exemplary embodiment of the present application.
  • the terminal includes a processor 420, a memory 440, a positioning component 460, and a microphone 480.
  • the memory At least one instruction is stored in 440, and the instruction is loaded and executed by the processor 420 to implement the method for responding to the control voice according to the various method embodiments of the present application.
  • the first terminal 400 receives the control voice through the microphone 480; in response to the control voice meeting the preset condition, the positioning component obtains the first relative orientation relationship between the front face of the user and the first terminal; in response to the first relative orientation
  • the facing relationship is a facing relationship, an operation corresponding to the control voice is performed, and the facing relationship is used to indicate that the front of the user faces the first terminal.
  • the first terminal may be a smart device with a built-in microphone, and can collect the voice spoken by the user through the microphone.
  • the microphone of the smart device can be in a continuous monitoring state, so as not to miss the control command spoken by the user.
  • the monitoring state may be set according to the time period or the state of the first terminal itself.
  • the first terminal may set the monitoring period from 7:30 to 22:00 every day, and set the non-monitoring period from 22:01 to 7:29 the next day every day.
  • the first device can respond to the control voice uttered by the user during the monitoring period, and the first terminal turns off the microphone during the non-monitoring period and no longer responds to the control voice uttered by the user.
  • the first terminal may divide its own working state into a wake-up state, a standby state and an offline state (the offline state may also be referred to as a shutdown state).
  • the offline state may also be referred to as a shutdown state.
  • the first terminal is in the wake-up state and the standby state, the first terminal is in the listening state.
  • the first terminal is in an offline state, the first terminal is in a non-monitoring state.
  • the first terminal may be at least one of a Bluetooth speaker, a smart TV, a smart air conditioner, a smart refrigerator, a cleaning robot, a smart water heater, an air purifier, or a smart lamp. It should be noted that the first terminal may be any electronic device having a microphone and a function of responding to a user's control voice.
  • Processor 420 may include one or more processing cores.
  • the processor 420 uses various interfaces and lines to connect various parts in the entire terminal 400, and executes the terminal by running or executing the instructions, programs, code sets or instruction sets stored in the memory 440, and calling the data stored in the memory 440. 400 various functions and processing data.
  • the processor 420 may use at least one of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA).
  • DSP Digital Signal Processing
  • FPGA field programmable gate array
  • PROM programmable logic array
  • a hardware form is implemented.
  • the processor 420 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a modem, and the like.
  • the CPU mainly handles the operating system, user interface, and application programs; the GPU is used to render and draw the content that needs to be displayed on the display screen; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 420, but is implemented by a single chip.
  • the memory 440 may include random access memory (Random Access Memory, RAM), or may include read-only memory (Read-Only Memory, ROM).
  • the memory 440 includes a non-transitory computer-readable storage medium.
  • Memory 440 may be used to store instructions, programs, codes, sets of codes, or sets of instructions.
  • the memory 440 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions, etc., used to implement the following method embodiments; the storage data area can store data and the like involved in the following method embodiments.
  • the positioning component 460 is used to determine the relative orientation relationship with the wearable device. In one possible manner, the positioning component 460 can determine the distance and angle to the wearable device. From the principle of positioning implementation, the positioning component 460 may use UWB (Ultra Wide Band, ultra-wideband) technology for positioning. Illustratively, the positioning component 460 may also use other positioning technologies whose positioning accuracy is at the centimeter level or the millimeter level.
  • UWB Ultra Wide Band, ultra-wideband
  • the microphone 480 is used to receive the user's control voice.
  • the microphone 480 may be a separate component.
  • the microphone is a microphone array including a plurality of microphone units. This embodiment of the present application does not limit the specific implementation of the microphone 480 .
  • a communication component may be provided in the first terminal 400 .
  • the communication component is used to send and receive communication signals.
  • the communication component may include at least one of a Bluetooth component, a WiFi component or a 2.4G/5G signal radio frequency component.
  • the communication component may further include other electronic components capable of implementing communication, which is not limited in this embodiment of the present application.
  • FIG. 5 is a flowchart of a method for responding to a control voice provided by an exemplary embodiment of the present application.
  • the method of responding to the control voice can be applied to the first terminal shown in FIG. 4 above.
  • the method of responding to the control voice includes:
  • Step 510 receiving the control voice through the microphone.
  • the first terminal has a microphone
  • the microphone may be a single device or a plurality of microphones.
  • Microphones can be placed in different locations in different devices.
  • the function of the microphone is to monitor the control voice spoken by the user of the wearable device.
  • the microphone may be continuously in a monitoring state, so that when a voice appears in the environment, the voice can be collected in time.
  • the first terminal is a Bluetooth speaker as an example for introduction.
  • the Bluetooth speaker can receive the control voice through its built-in microphone.
  • the Bluetooth speaker can receive the user's voice and perform voice interaction with the user in the home where it is often placed.
  • the Bluetooth speaker can receive a control voice whose loudness is greater than a preset threshold.
  • Step 520 in response to the control voice meeting the preset condition, obtain the first relative orientation relationship between the front face of the user and the first terminal through the positioning component.
  • the user wears a wearable device.
  • the first terminal may obtain the relative orientation relationship between the front surface of the wearable device worn by the user and the first terminal through the positioning component, as the above-mentioned first relative orientation relationship.
  • the Bluetooth speaker can first determine whether the control voice meets the preset conditions. In a possible way, the Bluetooth speaker can locally determine whether the control voice meets the preset conditions.
  • the Bluetooth speaker can transmit the control voice to the cloud, so that the cloud can judge whether the control voice meets the preset conditions.
  • the Bluetooth speaker After the Bluetooth speaker determines that the control voice meets the preset conditions, the Bluetooth speaker can interact with the wearable device through the built-in positioning component, so as to obtain the first relative orientation relationship between the front of the user and the first terminal.
  • the positioning component can obtain the distance and the angle between the positioning component and the corresponding positioning component in the wearable device, and determine the first relative orientation relationship between the front surface of the first terminal and the user accordingly.
  • Step 530 in response to the first relative orientation relationship being a facing relationship, perform an operation corresponding to the control voice, and the facing relationship is used to indicate that the front of the user faces the first terminal.
  • the Bluetooth speaker can perform an operation corresponding to the control voice when the first relative orientation relationship is a facing relationship.
  • the facing relationship is used to indicate that the front of the user faces the first terminal.
  • the first terminal For the operation corresponding to the control voice performed by the first terminal, if the control voice is for the first terminal, the first terminal directly responds to the control voice and executes the corresponding operation. Optionally, if the control voice is for other devices, the first terminal sends a corresponding command to the other device according to the control command, so that the other device performs an operation corresponding to the control voice.
  • the method for responding to the control voice can receive the control voice through the microphone, and when the control voice meets the preset conditions, determine the first position between the front of the user and the first terminal through the positioning component.
  • the orientation relationship when the orientation relationship indicates that the front of the user faces the first terminal, the first terminal will perform the corresponding operation of the control voice. It can be seen that the present application enables the first terminal to determine the orientation of the user, thereby determining whether the user is facing itself, thereby enhancing the ability to intelligently respond to control voices.
  • the first terminal can also make one of the multiple terminals respond to the control voice through a negotiation mechanism, thereby avoiding possible confusion when responding to the control voice. Please refer to the following examples.
  • FIG. 6 is a flowchart of a method for responding to a control voice provided by another exemplary embodiment of the present application.
  • the method of responding to the control voice can be applied to the terminals shown above.
  • the method of this response control speech comprises:
  • Step 611 in response to the first binding instruction, establish a binding relationship with the control terminal.
  • the first terminal can first establish a binding relationship with the control terminal.
  • the control terminal is a mobile phone
  • the first terminal can first establish a binding relationship with the control terminal.
  • the binding relationship can be accomplished through WiFi technology or Bluetooth technology.
  • the first terminal can be bound with multiple control terminals.
  • a family has multiple members, each of which can use a control terminal.
  • the control terminals of the family may have the same control authority, and the control authority is used to control all the smart devices in the family.
  • the first terminal can form a binding relationship with each control terminal in the home.
  • a home is provided with a first terminal.
  • the control terminal is taken as an example for description.
  • Step 612 Receive wearable device information sent by the control terminal.
  • the wearable device information includes first component information and second component information
  • the first component information includes the component identification of the first component and the left and right identifications of the first component
  • the second component information includes the component identification of the second component and the second component identification.
  • the left and right identifiers of the components are used to indicate that they are on the left or right side of the wearer when worn, and the left and right identifiers of the first component are different from the left and right identifiers of the second component.
  • the first terminal after being bound with the control terminal, the first terminal can receive other wearable device information sent by the control terminal. It should be noted that, because the information of the wearable device received by the first terminal is equivalent to the first terminal performing a subsequent verification process according to the information of the wearable device. Therefore, wearable device information needs to be trusted information. Under this premise, in this embodiment of the present application, the wearable device information is set to be sent by the bound control terminal, so that the wearable device information can be trusted.
  • Step 613 Store the wearable device information in a local file of the first terminal.
  • a memory is provided in the first terminal.
  • the first terminal can store the received wearable device information in the memory.
  • the first terminal stores the information in a local file of the first terminal, so that the first terminal can quickly read the information.
  • Step 614 receiving the control voice through the microphone.
  • step 614 the execution process of step 614 is the same as that of step 510, and details are not repeated here.
  • Step 620 acquiring the wearing state of the wearable device.
  • the wearable device is worn by the user, and at this time, the first terminal can acquire the wearing state of the wearable device.
  • the first terminal may agree on a communication protocol with the wearable device in advance, and use the designated bit as the wearing bit.
  • the information sent by the wearable device to the first terminal includes 8 bits (for example, 8 bits), wherein the third bit is the wear bit, and when the wear bit is 1, it indicates that the wearable device is in the wearing state . When the wear bit is 0, it means that the wearable device is in an unworn state.
  • the wearing state is used to indicate that the wearable device is being worn on the user.
  • smart glasses are worn on the user's face
  • TWS earphones are worn in the ear by the user
  • a smart neck ring is worn on the neck by the user.
  • the first terminal can determine the wearing state of the wearable device, and determine the facing direction to the user according to the wearable device, and will not perform voice control on the first terminal without the user wearing the wearable device scene.
  • Step 631 in response to the wearing state being the wearing state and the control voice meeting the preset conditions, obtain the first angle between the first component and the first terminal through the positioning component, and obtain the first angle between the first component and the first terminal. a distance.
  • the first terminal can obtain information such as the wearing state of the wearable device, the first angle, the first distance, etc. in the same information.
  • the first terminal obtains the wearing state of the wearable device in one piece of information, and the first terminal obtains the wearing state of the wearable device in another piece of information.
  • the first terminal when the control voice meets the preset condition, the first terminal obtains the first angle between the first component and the first component through the positioning component.
  • the positioning component itself may have the ability to judge the angle, such as the UWB component.
  • the first terminal can also determine the straight-line distance between the first component and the first terminal through the positioning component.
  • the positioning component may be a UWB component, that is, a positioning component designed based on UWB technology.
  • Step 632 in response to the control voice meeting the preset condition, obtain the second angle between the second component and the first terminal through the positioning component, and obtain the second distance between the second component and the first terminal.
  • the first terminal can also obtain the second angle between the second component and the first terminal through the positioning component, and simultaneously obtain the angle between the second component and the first terminal. second distance.
  • step 631 and step 632 are two independent components. Therefore, the execution order of step 631 and step 632 is not mutually limited.
  • the first terminal may perform step 631 first, and then perform step 632.
  • the first terminal may also perform step 632 first, and then perform step 631.
  • the first terminal may also perform step 631 and step 632 at the same time.
  • Step 633 in response to the difference between the first distance and the second distance being less than the preset threshold, according to the first angle and the second angle, determine that the first terminal is used as the reference point, and the first component and the second component are on the horizontal plane. The positional relationship of the projection.
  • a preset threshold may be preset in the first terminal.
  • the first terminal sets the preset threshold to 2 cm.
  • the terminal can use the first terminal as a reference point, the first angle and the second angle, to determine the distance between the first component and the second component on the horizontal plane Projection position relationship.
  • the value of the preset threshold may be any preset value.
  • the preset threshold may be a value such as 0.5 cm, 1 cm, 2 cm, or 3 cm.
  • Step 634 in response to taking the first terminal as a reference point and the first component in the clockwise direction of the second component, determine that the first relative orientation relationship is a facing relationship.
  • the first terminal may determine that the first relative orientation relationship is a facing relationship when the first component is in the clockwise direction of the second component in response to the position relationship indicating that the first terminal is used as the reference point.
  • the above-mentioned positional relationship includes taking the first terminal as the reference point, and the projected position of the first component on the horizontal plane is located in the clockwise direction of the projected position of the second component on the horizontal plane, it can be considered that the first terminal is taken as the reference point.
  • the first component is in the clockwise direction of the second component at the point of reference.
  • FIG. 7 is a schematic diagram of a projection position relationship provided based on the embodiment shown in FIG. 6 .
  • the coordinate system is set with the location of the first terminal 700 as the origin of the coordinates.
  • the first angle is the included angle between the line connecting the first component 710 and the first terminal, and the positive half-axis of the x-axis of the coordinate system.
  • the second angle is the included angle between the line connecting the second component 720 and the first terminal, and the positive half-axis of the x-axis of the coordinate system.
  • the first angle and the second angle may both belong to the inferior angle (also called the convex angle), that is, the angle range belongs to (0°, 180°).
  • the viewing angle provided in FIG. 7 is a viewing angle looking down on the horizontal plane.
  • the first terminal determines that the facing relationship with the front face of the wearable device is a facing relationship. It should be noted that, taking the first terminal as the vertex, the angle between the first component and the second component belongs to the inferior angle.
  • Step 641 Receive a second relative orientation parameter of the second terminal through a preset network, where the preset network is a local area network or the Internet.
  • the second relative orientation parameter includes a third distance, a third angle, a fourth distance and a fourth angle
  • the third distance is the distance between the first component and the second terminal
  • the third angle is the distance between the first component and the second terminal
  • the angle between the terminals, the fourth distance is the distance between the second component and the second terminal, and the fourth angle is the angle between the second component and the second terminal.
  • the preset network may be a local area network in the home where the first terminal is located.
  • the preset network may be a Wi-Fi local area network provided by a network access point (AP, Access Point) in the home.
  • AP network access point
  • the preset network may also be a network formed by the first terminal and other terminals through a remote network.
  • the preset network may be a 4G network or a 5G network.
  • the number of the second terminal is one. In another possible implementation manner, the number of the second terminals may be multiple.
  • the first terminal may be the master device, and the relative orientations of all the terminals of the mobile phone are output.
  • the master device of the network may also be an AP.
  • the main device can use the second relative orientation parameter and the first relative orientation parameter used to calculate the first relative orientation relationship to determine which terminal meets both the facing wearable device and the distance from the wearable device. the nearest terminal.
  • the master device preferentially determines the terminal facing the wearable device from multiple terminals according to the orientation relationship. If the orientation relationship between only one of the multiple terminals and the wearable device is a facing relationship, the master device directly determines the terminal as the terminal that responds to the control voice.
  • the master device determines that at least two terminals and the wearable device are in a facing relationship at the same time, the master device will further determine the relationship between the multiple terminals and the wearable device. distance, and then finally determine a terminal as the terminal that responds to the control voice.
  • Step 642 Detect whether the second relative orientation relationship is a facing relationship according to the second relative orientation parameter.
  • the second relative orientation relationship may be a relative orientation relationship between the front face of the user and the second terminal.
  • the first terminal itself can detect whether the second relative orientation relationship is a facing relationship according to the second relative orientation parameter.
  • the master device in the network composed of the first terminal and multiple terminals determines whether the second relative orientation relationship is a facing relationship.
  • Step 643 in response to the second relative orientation relationship is not a facing relationship and the first relative orientation relationship is a facing relationship, perform an operation corresponding to the control voice.
  • the first terminal is determined to be the only terminal whose relative orientation relationship with the wearable device is a facing relationship. Therefore, the operation corresponding to the control voice is performed by the first terminal.
  • Step 651 in response to the second relative orientation relationship being a facing relationship and the first relative orientation relationship being a facing relationship, obtain a magnitude relationship between the first average distance and the second average distance.
  • the first average distance is an average value of the first distance and the second distance
  • the second average distance is an average value between the third distance and the fourth distance.
  • Step 652 in response to the first average distance being smaller than the second average distance, perform an operation corresponding to the control voice.
  • FIG. 8 is a schematic diagram of an example of a response control voice provided based on the embodiment shown in FIG. 6 .
  • the wearable device includes a first component 811 and a second component 812 .
  • the first terminal 820 can determine that the first relative orientation relationship is a facing relationship through the built-in UWB component. The first terminal 820 determines that the first second terminal 830 and the wearable device are not in a facing relationship, but in a side-to-side relationship. The first terminal 820 determines that the second second terminal 840 and the wearable device are not in a facing relationship but in a back-to-back relationship.
  • FIG. 9 is a schematic diagram of an example of another response control voice provided based on the embodiment shown in FIG. 6 .
  • the wearable device includes a first component 811 and a second component 812 .
  • the first terminal 820 can determine that the first relative orientation relationship is a facing relationship through the built-in UWB component, and at the same time, it can also receive the second relative orientation parameter between the first second terminal 830 and the wearable device after receiving the second relative orientation parameter. , according to the second relative orientation parameter, it is determined that the first second terminal 830 and the wearable device are also facing each other.
  • the first terminal 820 will further determine which terminal has the shortest distance from the wearable device among the terminals in a facing relationship. It should be noted that, since in the embodiment of the present application, the wearable device includes a first component and a second component, the distance between the wearable device and the terminal may be the distance between the first component and the terminal, and the The average value of the distance between the two components and the terminal.
  • the distance between the first terminal and the first component of the wearable device is 2.35 meters, and the distance between the first terminal and the second component of the wearable device is 2.38 meters, then it is determined that the first terminal The distance from the wearable device is 2.365 meters. Meanwhile, if the distance between the second terminal and the first component of the wearable device is 3.6 meters, and the distance between the second terminal and the first component of the wearable device is 3.62 meters, it is determined that the distance between the second terminal and the first component of the wearable device is 3.62 meters. The distance between them is 3.61 meters. Because the first terminal is closer to the wearable device than the second terminal. Therefore, the first terminal determines itself as a device that responds to the control voice.
  • Step 660 in response to the control voice being used to wake up the first terminal, wake up the first terminal.
  • the first terminal After determining the device responding to the control voice, the first terminal can perform different operations based on the actual situation of the control voice.
  • the control voice When the control voice is used to wake up the first terminal, the first terminal wakes up. For example, if the control voice contains a wake-up word, the first terminal recognizes that the control voice is used to wake up the first terminal.
  • the first terminal determines that it is the terminal that responds to the control voice, the first terminal will directly enter the wake-up state.
  • the first terminal may play a prompt word voice, for example, "I'm here, how can I help you?".
  • Step 671 in response to the control voice being the query voice, obtain a reply text corresponding to the query voice.
  • the first terminal will acquire the reply text corresponding to the query voice when the control voice is the query voice, and in this scenario, the first terminal will also have the ability to synthesize speech.
  • Step 672 Perform speech synthesis on the reply text to obtain reply speech.
  • the first terminal will perform speech synthesis according to the reply text to obtain the reply speech.
  • the operation may be an operation performed locally by the first terminal.
  • the reply voice is synthesized in the cloud, and the first terminal directly receives the reply voice from the cloud.
  • Step 673 play the reply voice through the speaker.
  • the first terminal when the first terminal acquires the reply voice, the first terminal will directly play the reply voice through the speaker.
  • the first terminal can play the reply voice according to one or more of preset voice, intonation and volume settings.
  • Step 681 in response to the control voice being used to indicate the actual preset operation, obtain an operation instruction corresponding to the control voice.
  • the operation instruction is used to instruct the corresponding third terminal to perform a preset operation.
  • the first device when the control voice is used to instruct the device to perform a specific preset operation, the first device will first obtain an instruction corresponding to the control voice.
  • the instructions corresponding to the control voice are divided into local machine instructions and external machine instructions according to the device that specifically executes the instructions.
  • the local machine command is executed by the first terminal
  • the external machine command is executed by a designated terminal other than the first terminal.
  • Step 682 Control the third terminal to perform a corresponding preset operation according to the operation instruction.
  • the first terminal when the operation instruction is an external machine instruction, the first terminal sends the operation instruction to the third terminal, so as to control the third terminal to perform the corresponding preset operation.
  • the first terminal may be a Bluetooth speaker
  • the third terminal may be an air conditioner, a TV, a water heater, an air purifier, a cleaning robot, a smart lamp, or a smart dishwasher.
  • Step 683 Execute a preset operation according to the operation instruction.
  • the first terminal itself is a device capable of performing specific operations.
  • the first terminal may be an air conditioner, a TV, a water heater, an air purifier, a cleaning robot, a smart lamp, or a smart dishwasher.
  • the method provided in this embodiment can indirectly determine the orientation relationship between the user and the first terminal according to the orientation relationship between the wearable device and the first terminal. state, further determine the orientation relationship according to the distance and angle between the first component and the second component in the wearable device and the first terminal respectively, and when the first terminal and the user are in a facing relationship, make the first terminal respond to the control voice , to achieve the effect that the user can control the device facing him from multiple terminals that can respond to voice when wearing the wearable device.
  • the method for responding to the control voice provided in this embodiment can also quickly obtain the distance and angle between the wearable device and the first terminal through the ultra-wideband UWB technology, which improves the reliability of determining the orientation relationship between the first terminal and the wearable device. precision.
  • FIG. 10 is a structural block diagram of an apparatus for responding to a control voice provided by an exemplary embodiment of the present application.
  • the device for responding to the control voice may be implemented as a whole or a part of the terminal through software, hardware or a combination of the two.
  • the device includes:
  • a voice receiving module 1010 configured to receive control voice through a microphone
  • a relationship obtaining module 1020 configured to obtain the first relative orientation relationship between the front face of the user and the first terminal through the positioning component in response to the control voice meeting a preset condition
  • the operation execution module 1030 is configured to execute an operation corresponding to the control voice in response to the first relative orientation relationship being a facing relationship, and the facing relationship is used to indicate that the front side of the wearable device faces the first a terminal.
  • the user wears a wearable device
  • the wearable device includes a first component and a second component
  • the first component is located on the left side of the user side
  • the second component is located on the right side of the user
  • the relationship obtaining module 1020 is configured to obtain the first angle between the first component and the first terminal through the positioning component, and obtain the The first distance between the first component and the first terminal; the second angle between the second component and the first terminal is obtained through the positioning component, and the distance between the second component and the first terminal is obtained.
  • the first terminal is a reference point, and the positional relationship between the first component and the second component is projected on the horizontal plane; in response to the positional relationship indicating that the first terminal is used as the reference point, the first component is in The clockwise direction of the second component determines that the first relative orientation relationship is the facing relationship.
  • the relationship obtaining module 1020 is configured to obtain the wearing state of the wearable device; in response to the wearing state being the wearing state, obtain the first component and the first component The first angle between the terminals is obtained, and the first distance between the first component and the first terminal is obtained.
  • the operation execution module 1030 is configured to receive the second relative orientation parameter of the second terminal through a preset network, where the preset network is a local area network or the Internet, and the second relative orientation
  • the parameters include a third distance, a third angle, a fourth distance, and a fourth angle, the third distance being the distance between the first component and the second terminal, and the third angle being the first the angle between the component and the second terminal, the fourth distance is the distance between the second component and the second terminal, the fourth angle is the second component and the second The angle between terminals; whether the second relative orientation relationship is the facing relationship is detected according to the second relative orientation parameter, and the second relative orientation relationship is the relative orientation between the front of the user and the second terminal relationship; in response to the second relative orientation relationship is not the facing relationship and the first relative orientation relationship is a facing relationship, performing an operation corresponding to the control voice.
  • the operation execution module 1030 is configured to obtain the difference between the first average distance and the second average distance in response to the second relative orientation relationship being the facing relationship and the first relative orientation relationship being the facing relationship
  • the first average distance is the average value of the first distance and the second distance
  • the second average distance is the average value between the third distance and the fourth distance. ; in response to the first average distance being smaller than the second average distance, perform an operation corresponding to the control voice.
  • the apparatus further includes a binding module, configured to establish a binding relationship with the control terminal in response to the first binding instruction; receive wearable device information sent by the control terminal, the The wearable device information includes first component information and second component information, the first component information includes the component identification of the first component and the left and right identifications of the first component, and the second component information includes the first component.
  • the component identifier of the second component and the left and right identifiers of the second component, the left and right identifiers are used to indicate that they are on the left or right side of the wearer when worn, the left and right identifiers of the first component and the second
  • the left and right identifiers of the components are different; the wearable device information is stored in a local file of the first terminal.
  • the operation execution module 1030 is configured to wake up the first terminal in response to the control voice being used to wake up the first terminal.
  • the operation execution module 1030 is configured to, in response to the control voice being an inquiry voice, obtain a reply text corresponding to the inquiry voice; perform speech synthesis on the reply text to obtain a reply voice; Reply voice.
  • the operation execution module 1030 is configured to, in response to the control voice being used to indicate an actual preset operation, obtain an operation instruction corresponding to the control voice, and the operation instruction is used to instruct the corresponding third terminal to execute the operation instruction.
  • the preset operation according to the operation instruction, the third terminal is controlled to perform the corresponding preset operation.
  • the operation execution module 1030 is configured to obtain, through the positioning component, the first angle between the first component and the first terminal through the ultra-wideband UWB technology, and obtain the first angle between the first component and the first terminal. a first distance between the first component and the first terminal. And, the operation execution module 1030 is configured to obtain the second angle between the second component and the first terminal by using the ultra-wideband UWB technology through the positioning component, and obtain the second angle between the second component and the first terminal. a second distance between the first terminals.
  • the device for responding to the control voice can receive the control voice through the microphone, and when the control voice meets the preset conditions, determine the distance between the front face of the wearable device and the first terminal through the positioning component
  • the first relative orientation relationship of when the orientation relationship indicates that the front of the wearable device faces the first terminal, the first terminal will perform the corresponding operation of the control voice. It can be seen from this that the present application enables the first terminal to judge the orientation of the user, thereby determining whether the user faces itself, and enhances the ability to intelligently respond to the control voice.
  • Embodiments of the present application further provide a computer-readable medium, where at least one instruction is stored in the computer-readable medium, and the at least one instruction is loaded and executed by a processor to implement the method for responding to a control voice as described in each of the above embodiments .
  • Embodiments of the present application also provide a computer program product, where the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium.
  • the processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method for responding to control speech provided by various embodiments of the present application.
  • Embodiments of the present application also provide a computer program, where the computer program includes computer instructions, and the processor of the computer device executes the computer instructions, so that the computer device executes the method for responding to control speech provided by various embodiments of the present application.
  • the apparatus for responding to control voice provided by the above-mentioned embodiment executes the method for responding to control voice
  • only the division of the above-mentioned functional modules is used as an example for illustration.
  • the functional modules of the device are completed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.
  • the apparatus for responding to a control voice provided in the above embodiment and the method embodiment for responding to a control voice belong to the same concept, and the specific implementation process thereof is detailed in the method embodiment, which will not be repeated here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A method and apparatus for responding to control voice, a terminal, a storage medium, and a program product, relating to the technical field of voice control. The method for responding to the control voice can be applied to a first terminal, and comprises: receiving control voice by means of a microphone (510); determining a first relative orientation relationship between the front face of a user and the first terminal by means of a positioning component when the control voice meets a preset condition (520); and when the orientation relationship indicates that the front face of the user faces the first terminal, the first terminal being about to execute an operation corresponding to the control voice (530). Hence, the present application enables the first terminal to determine the orientation of the user, so as to determine whether a wearable device faces the user, thereby enhancing the capability of an intelligent response to the control voice.

Description

响应控制语音的方法、装置、终端、存储介质及程序产品Method, device, terminal, storage medium and program product for responding to control speech
本申请要求于2021年03月15日提交的、申请号为202110274474.5、发明名称为“响应控制语音的方法、装置、终端及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed on March 15, 2021, with the application number of 202110274474.5 and the invention titled "Method, Apparatus, Terminal and Storage Medium for Responding to Controlling Voice", the entire contents of which are incorporated by reference in in this application.
技术领域technical field
本申请实施例涉及语音控制技术领域,特别涉及一种响应控制语音的方法、装置、终端、存储介质及程序产品。The embodiments of the present application relate to the technical field of voice control, and in particular, to a method, apparatus, terminal, storage medium, and program product for responding to control voice.
背景技术Background technique
随着智能家居技术的发展,日常生活中的家电也逐渐增加了智能控制功能。其中,语音控制作为一种常见的智能控制方法被广泛使用。With the development of smart home technology, home appliances in daily life have gradually added intelligent control functions. Among them, voice control is widely used as a common intelligent control method.
相关技术中,智能设备(intelligent device)中设置有用于监听用户语音的麦克风(Microphone)。当用户说出控制语音后,智能设备将响应该控制语音执行相应的动作。但在家庭中设置有多个能够响应控制语音的设备时,将会出现用户说出控制语音后,多个设备同时响应的混乱场景。In the related art, an intelligent device (intelligent device) is provided with a microphone (Microphone) for monitoring the user's voice. After the user speaks the control voice, the smart device will perform corresponding actions in response to the control voice. However, when multiple devices capable of responding to the control voice are set up in the home, there will be a chaotic scene in which multiple devices respond simultaneously after the user speaks the control voice.
发明内容SUMMARY OF THE INVENTION
本申请实施例提供了一种响应控制语音的方法、装置、终端、存储介质及程序产品。所述技术方案如下:Embodiments of the present application provide a method, apparatus, terminal, storage medium, and program product for responding to a control voice. The technical solution is as follows:
根据本申请的一方面内容,提供了一种响应控制语音的方法,应用于第一终端中,所述方法包括:According to an aspect of the present application, a method for responding to a control voice is provided, which is applied to a first terminal, and the method includes:
通过麦克风接收控制语音;Receive control voice through microphone;
响应于所述控制语音符合预设条件,通过定位组件获取用户的正面与所述第一终端之间的第一相对朝向关系;In response to the control voice meeting the preset condition, obtain the first relative orientation relationship between the front face of the user and the first terminal through the positioning component;
响应于所述第一相对朝向关系是面对关系,执行所述控制语音对应的操作,所述面对关系用于指示所述用户的正面面对所述第一终端。In response to the first relative orientation relationship being a facing relationship, an operation corresponding to the control voice is performed, and the facing relationship is used to indicate that the front side of the user faces the first terminal.
根据本申请的另一方面内容,提供了一种响应控制语音的装置,应用于第一终端中,所述装置包括:According to another aspect of the present application, an apparatus for responding to a control voice is provided, which is applied in a first terminal, and the apparatus includes:
语音接收模块,用于通过麦克风接收控制语音;The voice receiving module is used to receive the control voice through the microphone;
关系获取模块,用于响应于所述控制语音符合预设条件,通过定位组件获取用户的正面与所述第一终端之间的第一相对朝向关系;a relationship obtaining module, configured to obtain a first relative orientation relationship between the front face of the user and the first terminal through a positioning component in response to the control voice meeting a preset condition;
操作执行模块,用于响应于所述第一相对朝向关系是面对关系,执行所述控制语音对应的操作,所述面对关系用于指示所述用户的正面面对所述第一终端。An operation execution module, configured to execute an operation corresponding to the control voice in response to the first relative orientation relationship being a facing relationship, where the facing relationship is used to indicate that the front of the user faces the first terminal.
根据本申请的另一方面内容,提供了一种终端,所述终端包括处理器和存储器,所述存储器中存储有至少一条计算机指令,所述计算机指令由所述处理 器加载并执行以实现如本申请各个方面提供的响应控制语音的方法。According to another aspect of the present application, a terminal is provided, the terminal includes a processor and a memory, the memory stores at least one computer instruction, the computer instruction is loaded and executed by the processor to implement the Methods of responding to control speech provided by various aspects of the present application.
根据本申请的另一方面内容,提供了一种计算机可读存储介质,所述存储介质中存储有至少一条计算机指令,所述计算机指令由处理器加载并执行以实现如本申请各个方面提供的响应控制语音的方法。According to another aspect of the present application, a computer-readable storage medium is provided, the storage medium having stored therein at least one computer instruction, the computer instruction being loaded and executed by a processor to implement various aspects of the present application. Response to control voice method.
根据本申请的一个方面,提供了一种计算机程序产品,该计算机程序产品包括计算机指令,该计算机指令存储在计算机可读存储介质中。计算机设备的处理器从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该计算机设备执行如本申请各个方面提供的响应控制语音的方法。According to one aspect of the present application, there is provided a computer program product comprising computer instructions stored in a computer-readable storage medium. A processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method of responding to control speech as provided by various aspects of the present application.
根据本申请的一个方面,提供了一种计算机程序,该计算机程序中包括计算机指令,计算机设备的处理器执行该计算机指令,使得该计算机设备执行如本申请各个方面提供的响应控制语音的方法。According to one aspect of the present application, a computer program is provided, the computer program includes computer instructions, and a processor of a computer device executes the computer instructions, so that the computer device executes the method for responding to control speech provided by various aspects of the present application.
本申请实施例能够应用在第一终端中,通过麦克风接收控制语音,并在该控制语音符合预设条件时,通过定位组件确定用户的正面与第一终端之间的第一相对朝向关系,当该朝向关系指示用户的正面面对第一终端时,第一终端将执行控制语音对应操作。由此可见,本申请能够令第一终端判断用户的朝向,从而确定可穿戴设备是否面对自身,增强了智能响应控制语音的能力。The embodiment of the present application can be applied to a first terminal, where a control voice is received through a microphone, and when the control voice meets a preset condition, a first relative orientation relationship between the front face of the user and the first terminal is determined through a positioning component, and when the control voice meets a preset condition The facing relationship indicates that when the front of the user faces the first terminal, the first terminal will perform the corresponding operation of the control voice. It can be seen that the present application enables the first terminal to determine the orientation of the user, thereby determining whether the wearable device faces itself, and enhances the ability to intelligently respond to control voices.
附图说明Description of drawings
图1是本申请实施例提供的一种第一相对朝向关系的示意图;1 is a schematic diagram of a first relative orientation relationship provided by an embodiment of the present application;
图2是本申请实施例提供的一种第一相对朝向关系的示意图;2 is a schematic diagram of a first relative orientation relationship provided by an embodiment of the present application;
图3是本申请实施例提供的一种响应控制语音的方法的应用环境示意图;3 is a schematic diagram of an application environment of a method for responding to a control voice provided by an embodiment of the present application;
图4是本申请一个示例性实施例提供的一种第一终端的结构框图;4 is a structural block diagram of a first terminal provided by an exemplary embodiment of the present application;
图5是本申请一个示例性实施例提供的一种响应控制语音的方法的流程图;5 is a flowchart of a method for responding to a control voice provided by an exemplary embodiment of the present application;
图6是本申请另一个示例性实施例提供的一种响应控制语音的方法流程图;6 is a flowchart of a method for responding to a control voice provided by another exemplary embodiment of the present application;
图7是基于图6所示实施例提供的一种投影位置关系的示意图;7 is a schematic diagram of a projection position relationship provided based on the embodiment shown in FIG. 6;
图8是基于图6所示实施例提供的一种响应控制语音的实例示意图;8 is a schematic diagram of an example of a response control voice provided based on the embodiment shown in FIG. 6;
图9是基于图6所示实施例提供的另一种响应控制语音的实例示意图;9 is a schematic diagram of an example of another response control voice provided based on the embodiment shown in FIG. 6;
图10是本申请一个示例性实施例提供的响应控制语音的装置的结构框图。FIG. 10 is a structural block diagram of an apparatus for responding to a control voice provided by an exemplary embodiment of the present application.
具体实施方式Detailed ways
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.
下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as recited in the appended claims.
在本申请的描述中,需要理解的是,术语“第一”、“第二”等仅用于描述目的,而不能理解为指示或暗示相对重要性。在本申请的描述中,需要说明的是,除非另有明确的规定和限定,术语“相连”、“连接”应做广义理解,例如,可以是固 定连接,也可以是可拆卸连接,或一体地连接;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连。对于本领域的普通技术人员而言,可以具体情况理解上述术语在本申请中的具体含义。此外,在本申请的描述中,除非另有说明,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。In the description of the present application, it should be understood that the terms "first", "second" and the like are used for descriptive purposes only, and should not be construed as indicating or implying relative importance. In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "connected" and "connected" should be understood in a broad sense, for example, it may be a fixed connection, a detachable connection, or an integrated connection. Ground connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood in specific situations. Also, in the description of the present application, unless otherwise specified, "a plurality" means two or more. "And/or", which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are an "or" relationship.
为了本申请实施例所示方案易于理解,下面对本申请实施例中出现的若干名词进行介绍。In order to facilitate the understanding of the solutions shown in the embodiments of the present application, several terms appearing in the embodiments of the present application are introduced below.
控制语音:是用户说出的一段语音,具有控制终端执行相应的操作的功能,其中,该控制语音可以包括语义内容和非语义内容。一种可能的方式中,控制语音可以包括语义部分,也即该控制语音对应的文本内容具有实际的语言含义。另一种可能的方式中,控制语音可以包括非语义部分,也即该控制语音对应的内容不对应具有实际语言含义的内容,而是通过预先与设备预定的声音特征进行控制,例如语调和音量大小等声音特征。在另一种可能的方式中,控制语音中包括语义部分和非语义部分,第一终端在接收到控制语音之后,能够对两种部分均进行识别。Control speech: a piece of speech spoken by the user, which has the function of controlling the terminal to perform corresponding operations, wherein the control speech may include semantic content and non-semantic content. In a possible manner, the control speech may include a semantic part, that is, the text content corresponding to the control speech has actual language meaning. In another possible way, the control voice may include non-semantic parts, that is, the content corresponding to the control voice does not correspond to the content with actual language meaning, but is controlled by sound characteristics predetermined with the device in advance, such as intonation and volume Sound characteristics such as size. In another possible manner, the control speech includes a semantic part and a non-semantic part, and after receiving the control speech, the first terminal can recognize both parts.
预设条件:本申请中用于指示控制语音的内容符合的条件。当控制语音包括语义部分时,预设条件用于指示相应的语义内容或者文本模版。当控制语音包括非语义部分时,预设条件用于指示相应的声音特征模版。其中,控制语音符合预设条件指示该控制语音中的语义部分符合相应的语义内容或者符合相应的文本模版,和/或,控制语音中的非语义部分符合相应的声音特征模版。Preset conditions: conditions used in this application to indicate that the content of the control voice meets. When the control speech includes semantic parts, the preset condition is used to indicate the corresponding semantic content or text template. When the control speech includes non-semantic parts, the preset condition is used to indicate the corresponding sound feature template. Wherein, that the control speech conforms to the preset condition indicates that the semantic part in the control speech conforms to the corresponding semantic content or conforms to the corresponding text template, and/or that the non-semantic part of the control speech conforms to the corresponding sound feature template.
可穿戴设备:用于指示用户穿戴在身上的智能设备。在本申请实施例中,该穿戴设备可以是用户在头部佩戴的左右对称或者左右非对称的设备。可选地,可穿戴设备可以包括智能眼镜、智能耳机、智能耳环或智能项圈中的至少一种。当可穿戴设备是智能耳机时,该智能耳机可以是TWS(True Wireless Stereo,真无线立体声)耳机。Wearable device: a smart device used to indicate that the user is wearing it. In this embodiment of the present application, the wearable device may be a left-right symmetrical or a left-right asymmetrical device worn on the user's head. Optionally, the wearable device may include at least one of smart glasses, smart earphones, smart earrings or smart collars. When the wearable device is a smart earphone, the smart earphone may be a TWS (True Wireless Stereo) earphone.
可选地,该可穿戴设备包括第一组件和第二组件。在佩戴者穿戴可穿戴设备时,第一组件位于用户的左侧,第二组件位于用户的右侧。Optionally, the wearable device includes a first component and a second component. When the wearer wears the wearable device, the first component is located on the user's left side and the second component is located on the user's right side.
可选地,在一种可能的方式中,第一组件和第二组件是各自独立的组件,第一组件在物理形态上是一个独立的设备,第二组件在物理形态上也是一个独立的设备。比如,当可穿戴设备是TWS耳机时,第一组件是TWS耳机中的左侧耳机,第二组件是TWS耳机中的右侧耳机。或者,当可穿戴设备是智能耳环时,第一组件是智能耳环中的左侧耳环,第二组件是智能耳环中的右侧耳环。Optionally, in a possible manner, the first component and the second component are independent components, the first component is an independent device in physical form, and the second component is also an independent device in physical form. . For example, when the wearable device is a TWS earphone, the first component is the left earphone in the TWS earphone, and the second component is the right earphone in the TWS earphone. Alternatively, when the wearable device is a smart earring, the first component is the left earring in the smart earring, and the second component is the right earring in the smart earring.
在另一种可能的实现方式中,第一组件和第二组件是同一个可穿戴设备中设置在不同位置的组件。比如,当可穿戴设备是智能眼镜时,第一组件被设置是左侧眼镜腿中,第二组件被设置在右侧眼镜腿中。第一组件和第二组件关于智能眼镜的中轴线对称设置。In another possible implementation manner, the first component and the second component are components disposed at different positions in the same wearable device. For example, when the wearable device is smart glasses, the first component is arranged in the left temple, and the second component is arranged in the right temple. The first component and the second component are symmetrically arranged about the central axis of the smart glasses.
可穿戴设备的正面用于指示可穿戴设备中的参考面。一种可能的方式中,可穿戴设备的正面是可穿戴设备被穿戴时,与用户的面部朝向相同(也可以说,面部朝向的方向与可穿戴设备的正面垂直)的一面,也即可穿戴设备的正面是用户佩戴可穿戴设备时的面部正对的一面。在另一种可能的描述方式中,可穿戴设备的正面是一个相对概念。若指定一个参考点,则可穿戴设备相对该参考点的正面是以该参考点为原点,第一组件位于第二组件的顺时针方向时,第一组件和第二组件之间的连线面对参考点的一侧。The front of the wearable device is used to indicate the reference surface in the wearable device. In a possible way, the front of the wearable device is the side that faces the same as the user's face when the wearable device is worn (in other words, the direction of the face is perpendicular to the front of the wearable device), that is, the wearable device is worn. The front of the device is the side that the user faces when wearing the wearable device. In another possible way of describing it, the front of a wearable is a relative concept. If a reference point is specified, the front of the wearable device relative to the reference point takes the reference point as the origin, and when the first component is located in the clockwise direction of the second component, the connecting plane between the first component and the second component to the side of the reference point.
第一相对朝向关系:用于指示用户与第一终端之间的朝向关系。其中,用户的面部与第一终端之间的朝向关系可以被定义为第一相对朝向关系。当用户的正面面对第一终端时,第一相对朝向关系是面对关系。从另一个角度介绍,当可穿戴设备的正面背对第一终端时,第一相对朝向关系是背对关系。The first relative orientation relationship: used to indicate the orientation relationship between the user and the first terminal. The orientation relationship between the user's face and the first terminal may be defined as a first relative orientation relationship. When the front of the user faces the first terminal, the first relative orientation relationship is a facing relationship. From another perspective, when the front of the wearable device faces away from the first terminal, the first relative orientation relationship is a back-to-back relationship.
在一种相对朝向关系的分类方式中,终端可以将用户的正面朝向的360°范围划分为两个180°的范围。其中第一个180°的范围是面对关系指示的范围,另一180°的范围是背对关系指示的范围。In a classification manner of the relative orientation relationship, the terminal may divide the 360° range of the frontal orientation of the user into two 180° ranges. The range of the first 180° is the range indicated by the facing relationship, and the range of the other 180° is the range indicated by the back-to-back relationship.
在另一种相对朝向关系的分类方式中,终端可以将用户的正面朝向的360°范围划分为背对关系对应的180°,面对关系对应的正面30°的范围,以及侧对关系对应的其它150°的范围。In another way of classifying the relative orientation relationship, the terminal may divide the 360° range of the user's frontal orientation into 180° corresponding to the back-to-back relationship, 30° of the front-facing range corresponding to the facing relationship, and 30° corresponding to the side-to-side relationship. other 150° range.
请参见图1,图1是本申请实施例提供的一种第一相对朝向关系的示意图。用户的正面通过佩戴的可穿戴设备的表示,第一终端通过定位可穿戴设备来获知用户的正面的朝向。Referring to FIG. 1 , FIG. 1 is a schematic diagram of a first relative orientation relationship provided by an embodiment of the present application. The front of the user is represented by the wearable device, and the first terminal obtains the orientation of the front of the user by locating the wearable device.
在图1中,可穿戴设备110的正面是1A,当第一终端120位于以可穿戴设备110的中心为参考坐标系的y轴正半轴区域时,可穿戴设备110与第一终端120之间的关系是面对关系。当第一终端120位于以可穿戴设备110的中心为参考坐标系的y轴负半轴区域时,可穿戴设备110与第一终端120之间的关系是背对关系。In FIG. 1 , the front of the wearable device 110 is 1A. When the first terminal 120 is located in the positive semi-axis region of the y-axis with the center of the wearable device 110 as the reference coordinate system, the distance between the wearable device 110 and the first terminal 120 The relationship between is a face-to-face relationship. When the first terminal 120 is located in the y-axis negative semi-axis region with the center of the wearable device 110 as the reference coordinate system, the relationship between the wearable device 110 and the first terminal 120 is a back-to-back relationship.
请参见图2,图2是本申请实施例提供的一种第一相对朝向关系的示意图。Please refer to FIG. 2 , which is a schematic diagram of a first relative orientation relationship provided by an embodiment of the present application.
在图2中,可穿戴设备的正面是1A,当第一终端位于以可穿戴设备的中心为参考坐标系的y轴正半轴的正负15度的扇形区域时,也即第一终端位于可穿戴设备正面的30度的扇形区域时,可穿戴设备与第一终端之间的关系是面对关系。当第一终端位于可穿戴设备正面的除上述30度区域之外的区域时,可穿戴设备与第一终端之间的关系是侧对关系。当第一终端位于以可穿戴设备的中心为参考坐标系的y轴负半轴区域时,可穿戴设备与第一终端之间的关系是背对关系。In Fig. 2, the front of the wearable device is 1A. When the first terminal is located in a sector area of plus or minus 15 degrees of the positive half-axis of the y-axis with the center of the wearable device as the reference coordinate system, that is, the first terminal is located at When the front side of the wearable device is in a 30-degree fan-shaped area, the relationship between the wearable device and the first terminal is a facing relationship. When the first terminal is located in an area other than the above-mentioned 30-degree area on the front of the wearable device, the relationship between the wearable device and the first terminal is a side-to-side relationship. When the first terminal is located in the y-axis negative semi-axis region of the reference coordinate system with the center of the wearable device, the relationship between the wearable device and the first terminal is a back-to-back relationship.
可选地,图2所示实施例仅为第一相对朝向关系的一种示意性说明,本申请还可以将以第一终端位于可穿戴设备正面的其它角度范围内的扇形区域作为对应面对关系的区域。可选地,该角度范围可以包括[0°,30°]。需要说明的是,当角度范围是0°时,说明第一终端位于参考坐标系的y轴正半轴上,该角度可以取值5°、10°、15°或20°等数值。Optionally, the embodiment shown in FIG. 2 is only a schematic illustration of the first relative orientation relationship, and the present application can also take the sector-shaped area where the first terminal is located in other angular ranges on the front of the wearable device as the corresponding orientation. relationship area. Optionally, the angular range may include [0°, 30°]. It should be noted that when the angle range is 0°, it means that the first terminal is located on the positive half-axis of the y-axis of the reference coordinate system, and the angle can take values such as 5°, 10°, 15° or 20°.
在图2中,第一个第一终端121与可穿戴设备之间的朝向关系是面对关系。 第二个第一终端122与可穿戴设备之间的朝向关系是侧对关系。第三个第一终端123与可穿戴设备之间的朝向关系是背对关系。In FIG. 2 , the orientation relationship between the first first terminal 121 and the wearable device is a facing relationship. The orientation relationship between the second first terminal 122 and the wearable device is a side-to-side relationship. The orientation relationship between the third first terminal 123 and the wearable device is a back-to-back relationship.
需要说明的是,在图1和图2中,参考坐标系的xOy面都是现实世界中的水平面。It should be noted that, in Figures 1 and 2, the xOy planes of the reference coordinate system are all horizontal planes in the real world.
请参考图3,图3是本申请实施例提供的一种响应控制语音的方法的应用环境示意图。Please refer to FIG. 3 , which is a schematic diagram of an application environment of a method for responding to a control voice provided by an embodiment of the present application.
图3所提供的视角是俯视视角,也即从纸面向内看到的平面是水平面,视角的方向是从天空方向看向地面。在图3中,以可穿戴设备是TWS耳机为例进行介绍。用户30左耳佩戴有TWS耳机的左耳耳机311,用户30右耳佩戴有TWS耳机的右耳耳机312。在图3所示的房间中,第一终端120位于TWS耳机的正面,且存在第二终端130和第三终端140。其中,第二终端130位于TWS耳机的侧边,第三终端140位于TWS耳机的背面。The viewing angle provided in FIG. 3 is a top-down viewing angle, that is, the plane viewed from the inside of the paper is a horizontal plane, and the direction of the viewing angle is looking from the sky to the ground. In FIG. 3 , the wearable device is a TWS earphone as an example for introduction. The left ear of the user 30 wears the left ear earphone 311 of the TWS earphone, and the right ear of the user 30 wears the right ear earphone 312 of the TWS earphone. In the room shown in FIG. 3 , the first terminal 120 is located on the front of the TWS headset, and the second terminal 130 and the third terminal 140 exist. The second terminal 130 is located on the side of the TWS headset, and the third terminal 140 is located on the back of the TWS headset.
在图3所示的环境中,若按照相关技术中的语音控制方案,当用户说出控制语音后,第一终端120、第二终端130和第三终端140均会响应该控制语音,造成混乱,而按照本申请所提供的响应控制语音的方法,三个终端中仅用户面对的第一终端120会响应控制语音执行相应的操作,而第二终端130和第三终端140则不会响应该控制语音。In the environment shown in FIG. 3 , according to the voice control scheme in the related art, after the user speaks the control voice, the first terminal 120 , the second terminal 130 and the third terminal 140 will all respond to the control voice, causing confusion , and according to the method for responding to the control voice provided by the present application, among the three terminals, only the first terminal 120 facing the user will perform corresponding operations in response to the control voice, while the second terminal 130 and the third terminal 140 will not respond to the control voice. The voice should be controlled.
请参考图4,图4是本申请一个示例性实施例提供的一种第一终端的结构框图,如图4所示,该终端包括处理器420、存储器440、定位组件460和麦克风480,存储器440中存储有至少一条指令,指令由处理器420加载并执行以实现如本申请各个方法实施例的响应控制语音的方法。Please refer to FIG. 4. FIG. 4 is a structural block diagram of a first terminal provided by an exemplary embodiment of the present application. As shown in FIG. 4, the terminal includes a processor 420, a memory 440, a positioning component 460, and a microphone 480. The memory At least one instruction is stored in 440, and the instruction is loaded and executed by the processor 420 to implement the method for responding to the control voice according to the various method embodiments of the present application.
在本申请中,第一终端400通过麦克风480接收控制语音;响应于控制语音符合预设条件,通过定位组件获取用户的正面与第一终端之间的第一相对朝向关系;响应于第一相对朝向关系是面对关系,执行控制语音对应的操作,面对关系用于指示用户的正面面对第一终端。In the present application, the first terminal 400 receives the control voice through the microphone 480; in response to the control voice meeting the preset condition, the positioning component obtains the first relative orientation relationship between the front face of the user and the first terminal; in response to the first relative orientation The facing relationship is a facing relationship, an operation corresponding to the control voice is performed, and the facing relationship is used to indicate that the front of the user faces the first terminal.
第一终端可以是内含麦克风的智能设备,能够通过麦克风采集用户说出的语音。其中,智能设备的麦克风可以处于持续监听状态,以免错过用户说出的控制指令。可选地,监听状态可以按照时段或者第一终端自身的状态进行设置。The first terminal may be a smart device with a built-in microphone, and can collect the voice spoken by the user through the microphone. Among them, the microphone of the smart device can be in a continuous monitoring state, so as not to miss the control command spoken by the user. Optionally, the monitoring state may be set according to the time period or the state of the first terminal itself.
例如,当监听状态是按照时段设置时,第一终端可以将每日7:30至22:00设置为监听时段,将每日22:01~次日7:29设置为非监听时段。第一设备能够在监听时段响应用户说出的控制语音,并且第一终端在非监听时段关闭麦克风,不再响应用户说出的控制语音。For example, when the monitoring state is set by time period, the first terminal may set the monitoring period from 7:30 to 22:00 every day, and set the non-monitoring period from 22:01 to 7:29 the next day every day. The first device can respond to the control voice uttered by the user during the monitoring period, and the first terminal turns off the microphone during the non-monitoring period and no longer responds to the control voice uttered by the user.
例如,当监听状态是按照第一终端自身的状态进行设置时,第一终端可以将自身的工作状态分为唤醒状态、待机状态和离线状态(离线状态也可称之为关机状态)。当第一终端处于唤醒状态和待机状态时,第一终端处于监听状态。当第一终端处于离线状态时,第一终端处于非监听状态。For example, when the monitoring state is set according to the state of the first terminal itself, the first terminal may divide its own working state into a wake-up state, a standby state and an offline state (the offline state may also be referred to as a shutdown state). When the first terminal is in the wake-up state and the standby state, the first terminal is in the listening state. When the first terminal is in an offline state, the first terminal is in a non-monitoring state.
可选地,第一终端可以是蓝牙音箱、智能电视、智能空调、智能冰箱、扫 地机器人、智能热水器、空气净化器或智能灯具中的至少一种。需要说明的是,第一终端可以是任意一种具备麦克风,且具有响应用户的控制语音的功能的电子设备。Optionally, the first terminal may be at least one of a Bluetooth speaker, a smart TV, a smart air conditioner, a smart refrigerator, a cleaning robot, a smart water heater, an air purifier, or a smart lamp. It should be noted that the first terminal may be any electronic device having a microphone and a function of responding to a user's control voice.
处理器420可以包括一个或者多个处理核心。处理器420利用各种接口和线路连接整个终端400内的各个部分,通过运行或执行存储在存储器440内的指令、程序、代码集或指令集,以及调用存储在存储器440内的数据,执行终端400的各种功能和处理数据。可选的,处理器420可以采用数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器420可集成中央处理器(Central Processing Unit,CPU)、图像处理器(Graphics Processing Unit,GPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作系统、用户界面和应用程序等;GPU用于负责显示屏所需要显示的内容的渲染和绘制;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器420中,单独通过一块芯片进行实现。 Processor 420 may include one or more processing cores. The processor 420 uses various interfaces and lines to connect various parts in the entire terminal 400, and executes the terminal by running or executing the instructions, programs, code sets or instruction sets stored in the memory 440, and calling the data stored in the memory 440. 400 various functions and processing data. Optionally, the processor 420 may use at least one of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). A hardware form is implemented. The processor 420 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface, and application programs; the GPU is used to render and draw the content that needs to be displayed on the display screen; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 420, but is implemented by a single chip.
存储器440可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory,ROM)。可选的,该存储器440包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器440可用于存储指令、程序、代码、代码集或指令集。存储器440可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作系统的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现下述各个方法实施例的指令等;存储数据区可存储下面各个方法实施例中涉及到的数据等。The memory 440 may include random access memory (Random Access Memory, RAM), or may include read-only memory (Read-Only Memory, ROM). Optionally, the memory 440 includes a non-transitory computer-readable storage medium. Memory 440 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 440 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions, etc., used to implement the following method embodiments; the storage data area can store data and the like involved in the following method embodiments.
定位组件460用于确定与可穿戴设备之间的相对朝向关系。在一种可能的方式中,定位组件460能够确定与可穿戴设备之间的距离和角度。从定位实现原理上,定位组件460可以采用UWB(Ultra Wide Band,超宽带)技术进行定位。示意性的,定位组件460还可以使用其他定位精度处于厘米级或毫米级等精度的定位技术。The positioning component 460 is used to determine the relative orientation relationship with the wearable device. In one possible manner, the positioning component 460 can determine the distance and angle to the wearable device. From the principle of positioning implementation, the positioning component 460 may use UWB (Ultra Wide Band, ultra-wideband) technology for positioning. Illustratively, the positioning component 460 may also use other positioning technologies whose positioning accuracy is at the centimeter level or the millimeter level.
麦克风480用于接收用户的控制语音。一种可能的实现方式中,麦克风480可以是一个单独的组件。另一种可能的方式中,麦克风是包含多个麦克风单元的麦克风阵列。本申请实施例不对麦克风480的具体实现方式进行限定。The microphone 480 is used to receive the user's control voice. In one possible implementation, the microphone 480 may be a separate component. In another possible manner, the microphone is a microphone array including a plurality of microphone units. This embodiment of the present application does not limit the specific implementation of the microphone 480 .
可选地,当第一终端400需要与其它设备进行通信时,第一终端400中可以设置有通信组件。通信组件用于收发通信信号。其中,通信组件可以包括蓝牙组件、WiFi组件或2.4G/5G信号射频组件中的至少一种。示意性的,通信组件还可以包括其他能够实现通信的电子组件,本申请实施例对此不作限定。Optionally, when the first terminal 400 needs to communicate with other devices, a communication component may be provided in the first terminal 400 . The communication component is used to send and receive communication signals. Wherein, the communication component may include at least one of a Bluetooth component, a WiFi component or a 2.4G/5G signal radio frequency component. Illustratively, the communication component may further include other electronic components capable of implementing communication, which is not limited in this embodiment of the present application.
请参考图5,图5是本申请一个示例性实施例提供的一种响应控制语音的方法的流程图。该响应控制语音的方法可以应用在上述图4所示的第一终端中。在图5中,响应控制语音的方法包括:Please refer to FIG. 5 , which is a flowchart of a method for responding to a control voice provided by an exemplary embodiment of the present application. The method of responding to the control voice can be applied to the first terminal shown in FIG. 4 above. In Figure 5, the method of responding to the control voice includes:
步骤510,通过麦克风接收控制语音。 Step 510, receiving the control voice through the microphone.
在本申请实施例中,第一终端具有麦克风,该麦克风的既可以是一个单独的设备,也可以是由多个。麦克风在不同的设备中可以设置在不同的位置中。示意性地,该麦克风的作用是监听可穿戴设备的用户说出的控制语音。在本申请实施例中,麦克风可以持续处于监听状态,以便在环境中出现语音时能及时采集到该语音。In this embodiment of the present application, the first terminal has a microphone, and the microphone may be a single device or a plurality of microphones. Microphones can be placed in different locations in different devices. Illustratively, the function of the microphone is to monitor the control voice spoken by the user of the wearable device. In this embodiment of the present application, the microphone may be continuously in a monitoring state, so that when a voice appears in the environment, the voice can be collected in time.
作为一种可能的实现方式,本实施例以第一终端是蓝牙音箱为例进行介绍。若第一终端是蓝牙音箱,则蓝牙音箱可以通过其内置的麦克风接收控制语音。作为一个常见的场景是,蓝牙音箱在其常放置的家庭中,能够接收用户的语音,并与用户进行语音交互。可选地,蓝牙音箱可以接收声音的响度大于预设阈值的控制语音。As a possible implementation manner, in this embodiment, the first terminal is a Bluetooth speaker as an example for introduction. If the first terminal is a Bluetooth speaker, the Bluetooth speaker can receive the control voice through its built-in microphone. As a common scenario, the Bluetooth speaker can receive the user's voice and perform voice interaction with the user in the home where it is often placed. Optionally, the Bluetooth speaker can receive a control voice whose loudness is greater than a preset threshold.
步骤520,响应于控制语音符合预设条件,通过定位组件获取用户的正面与第一终端之间的第一相对朝向关系。 Step 520, in response to the control voice meeting the preset condition, obtain the first relative orientation relationship between the front face of the user and the first terminal through the positioning component.
可选的,该用户佩戴有可穿戴设备。第一终端可以通过定位组件,获取用户佩戴的可穿戴设备的正面与第一终端之间的相对朝向关系,作为上述第一相对朝向关系。Optionally, the user wears a wearable device. The first terminal may obtain the relative orientation relationship between the front surface of the wearable device worn by the user and the first terminal through the positioning component, as the above-mentioned first relative orientation relationship.
在本申请实施例中,蓝牙音箱能够先判断控制语音是否符合预设条件。一种可能的方式中,蓝牙音箱能够在本地判断控制语音是否符合预设条件。In the embodiment of the present application, the Bluetooth speaker can first determine whether the control voice meets the preset conditions. In a possible way, the Bluetooth speaker can locally determine whether the control voice meets the preset conditions.
另一种可能的方式中,蓝牙音箱能够将控制语音传输至云端,令云端判断控制语音是否符合预设条件。In another possible way, the Bluetooth speaker can transmit the control voice to the cloud, so that the cloud can judge whether the control voice meets the preset conditions.
在蓝牙音箱确定控制语音符合预设条件后,蓝牙音箱能够通过内置的定位组件与可穿戴设备交互,从而获取用户的正面与第一终端之间的第一相对朝向关系。After the Bluetooth speaker determines that the control voice meets the preset conditions, the Bluetooth speaker can interact with the wearable device through the built-in positioning component, so as to obtain the first relative orientation relationship between the front of the user and the first terminal.
在一种可能的实现方式中,定位组件能够获取与可穿戴设备中相应的定位组件之间的距离以及角度,并据此确定第一终端和用户的正面之间的第一相对朝向关系。In a possible implementation manner, the positioning component can obtain the distance and the angle between the positioning component and the corresponding positioning component in the wearable device, and determine the first relative orientation relationship between the front surface of the first terminal and the user accordingly.
步骤530,响应于第一相对朝向关系是面对关系,执行控制语音对应的操作,面对关系用于指示用户的正面面对第一终端。 Step 530, in response to the first relative orientation relationship being a facing relationship, perform an operation corresponding to the control voice, and the facing relationship is used to indicate that the front of the user faces the first terminal.
在本申请实施例中,蓝牙音箱能够在第一相对朝向关系是面对关系时,执行控制语音对应的操作。在本例中,该面对关系用于指示用户的正面面对第一终端。In the embodiment of the present application, the Bluetooth speaker can perform an operation corresponding to the control voice when the first relative orientation relationship is a facing relationship. In this example, the facing relationship is used to indicate that the front of the user faces the first terminal.
对于第一终端执行的控制语音对应的操作,若控制语音是针对第一终端的语音,则第一终端直接响应该控制语音并执行相应的操作。可选地,若控制语音是针对其他设备的语音,则第一终端根据该控制指令向其它设备发送相应的指令,以便其它设备执行控制语音对应的操作。For the operation corresponding to the control voice performed by the first terminal, if the control voice is for the first terminal, the first terminal directly responds to the control voice and executes the corresponding operation. Optionally, if the control voice is for other devices, the first terminal sends a corresponding command to the other device according to the control command, so that the other device performs an operation corresponding to the control voice.
综上所述,本实施例提供的响应控制语音的方法,能够通过麦克风接收控制语音,并在该控制语音符合预设条件时,通过定位组件确定用户的正面与第一终端之间的第一相对朝向关系,当该朝向关系指示用户的正面面对第一终端时,第一终端将执行控制语音对应操作。由此可见,本申请能够令第一终端判 断用户的朝向,从而确定用户是否面对自身,增强了智能响应控制语音的能力。To sum up, the method for responding to the control voice provided by this embodiment can receive the control voice through the microphone, and when the control voice meets the preset conditions, determine the first position between the front of the user and the first terminal through the positioning component. With respect to the orientation relationship, when the orientation relationship indicates that the front of the user faces the first terminal, the first terminal will perform the corresponding operation of the control voice. It can be seen that the present application enables the first terminal to determine the orientation of the user, thereby determining whether the user is facing itself, thereby enhancing the ability to intelligently respond to control voices.
基于上一个实施例所公开的方案,第一终端还能够通过协商机制使得多个终端中的一个第一终端响应控制语音,从而避免响应控制语音时可能发生的混乱情况。请参考如下实施例。Based on the solution disclosed in the previous embodiment, the first terminal can also make one of the multiple terminals respond to the control voice through a negotiation mechanism, thereby avoiding possible confusion when responding to the control voice. Please refer to the following examples.
请参见图6,图6是本申请另一个示例性实施例提供的一种响应控制语音的方法流程图。该响应控制语音的方法可以应用在上述所示的终端中。在图6中,该响应控制语音的方法包括:Please refer to FIG. 6, which is a flowchart of a method for responding to a control voice provided by another exemplary embodiment of the present application. The method of responding to the control voice can be applied to the terminals shown above. In Fig. 6, the method of this response control speech comprises:
步骤611,响应于第一绑定指令,与控制终端建立绑定关系。 Step 611, in response to the first binding instruction, establish a binding relationship with the control terminal.
在本例中,第一终端能够先与控制终端建立绑定关系。当控制终端是手机时,第一终端能够先与控制终端建立起绑定关系。该绑定关系可以通过WiFi技术或者蓝牙技术来完成。In this example, the first terminal can first establish a binding relationship with the control terminal. When the control terminal is a mobile phone, the first terminal can first establish a binding relationship with the control terminal. The binding relationship can be accomplished through WiFi technology or Bluetooth technology.
可选的,作为一种可能实现的方式,第一终端能够与多个控制终端绑定。在该场景中,一个家庭中具有多个成员,每个成员都可以使用一个控制终端。在该场景中,家庭的控制终端可以具有相同的控制权限,该控制权限用于控制家庭的全部智能设备。当第一终端绑定于该智能家庭中时,第一终端即可与该家庭中的各个控制终端均形成绑定关系。Optionally, as a possible implementation manner, the first terminal can be bound with multiple control terminals. In this scenario, a family has multiple members, each of which can use a control terminal. In this scenario, the control terminals of the family may have the same control authority, and the control authority is used to control all the smart devices in the family. When the first terminal is bound in the smart home, the first terminal can form a binding relationship with each control terminal in the home.
比如,家庭中设置有第一终端。该家庭中共有3个成员,每个成员均使用一个控制终端,分别为控制终端C1、控制终端C2和控制终端C3,则第一终端能够分别与上述3个控制终端绑定。在本例中,以控制终端是一个为例进行说明。For example, a home is provided with a first terminal. There are 3 members in the family, and each member uses a control terminal, which are respectively control terminal C1, control terminal C2 and control terminal C3, and the first terminal can be bound to the above-mentioned three control terminals respectively. In this example, the control terminal is taken as an example for description.
步骤612,接收控制终端发送的可穿戴设备信息。Step 612: Receive wearable device information sent by the control terminal.
其中,可穿戴设备信息包括第一组件信息和第二组件信息,第一组件信息包括第一组件的组件标识和第一组件的左右标识,第二组件信息包括第二组件的组件标识和第二组件的左右标识,左右标识用于指示被佩戴时处于佩戴者的左侧或者右侧,第一组件的左右标识和第二组件的左右标识不同。The wearable device information includes first component information and second component information, the first component information includes the component identification of the first component and the left and right identifications of the first component, and the second component information includes the component identification of the second component and the second component identification. The left and right identifiers of the components are used to indicate that they are on the left or right side of the wearer when worn, and the left and right identifiers of the first component are different from the left and right identifiers of the second component.
在本例中,第一终端能够在与控制终端绑定后,接收控制终端发送来的其它可穿戴设备信息。需要说明的是,由于第一终端接收的可穿戴设备的信息相当于第一终端根据该可穿戴设备信息进行后续的验证过程。因此,可穿戴设备信息需要是可信任的信息。在该前提下,本申请实施例通过设置可穿戴设备信息是由已经绑定的控制终端发送的,使得可穿戴设备信息可被相信。In this example, after being bound with the control terminal, the first terminal can receive other wearable device information sent by the control terminal. It should be noted that, because the information of the wearable device received by the first terminal is equivalent to the first terminal performing a subsequent verification process according to the information of the wearable device. Therefore, wearable device information needs to be trusted information. Under this premise, in this embodiment of the present application, the wearable device information is set to be sent by the bound control terminal, so that the wearable device information can be trusted.
步骤613,将可穿戴设备信息存储在第一终端的本地文件中。Step 613: Store the wearable device information in a local file of the first terminal.
示意性的,第一终端中设置有存储器。第一终端能够将接收到的可穿戴设备信息存储在存储器中。从逻辑中来说,第一终端将该信息存储在第一终端的本地文件中,以便于第一终端快速读取该信息。Illustratively, a memory is provided in the first terminal. The first terminal can store the received wearable device information in the memory. Logically speaking, the first terminal stores the information in a local file of the first terminal, so that the first terminal can quickly read the information.
步骤614,通过麦克风接收控制语音。 Step 614, receiving the control voice through the microphone.
在本申请实施例中,步骤614的执行过程和步骤510的执行过程相同,此处不再赘述。In this embodiment of the present application, the execution process of step 614 is the same as that of step 510, and details are not repeated here.
步骤620,获取可穿戴设备的佩戴状态。 Step 620, acquiring the wearing state of the wearable device.
在本例中,用户佩戴由可穿戴设备,此时,第一终端能够获取可穿戴设备的佩戴状态。可选地,第一终端可以预先与可穿戴设备约定通信协议,以指定的位作为穿戴位。例如,可穿戴设备发送给第一终端的信息中包括8个位(比如8个比特位),其中,第3位为穿戴位,当该穿戴位是1时,表示可穿戴设备处于正在佩戴状态。当该穿戴位是0时,表示可穿戴设备处于未佩戴状态。In this example, the wearable device is worn by the user, and at this time, the first terminal can acquire the wearing state of the wearable device. Optionally, the first terminal may agree on a communication protocol with the wearable device in advance, and use the designated bit as the wearing bit. For example, the information sent by the wearable device to the first terminal includes 8 bits (for example, 8 bits), wherein the third bit is the wear bit, and when the wear bit is 1, it indicates that the wearable device is in the wearing state . When the wear bit is 0, it means that the wearable device is in an unworn state.
示意性的,正在佩戴状态用于指示可穿戴设备佩戴在用户身上。例如,智能眼镜被佩戴在用户脸上,TWS耳机被用户佩戴在耳中,或者,智能颈环被用户佩戴在颈部。在该状态中,第一终端能够确定可穿戴设备的穿戴状态,并根据可穿戴设备确定与用户的面对方向,不会出现在用户没有佩戴可穿戴设备的情况下对第一终端进行语音控制的场景。Illustratively, the wearing state is used to indicate that the wearable device is being worn on the user. For example, smart glasses are worn on the user's face, TWS earphones are worn in the ear by the user, or a smart neck ring is worn on the neck by the user. In this state, the first terminal can determine the wearing state of the wearable device, and determine the facing direction to the user according to the wearable device, and will not perform voice control on the first terminal without the user wearing the wearable device scene.
步骤631,响应于佩戴状态是正在佩戴状态且控制语音符合预设条件,通过定位组件获取第一组件与第一终端之间的第一角度,并获取第一组件与第一终端之间的第一距离。 Step 631, in response to the wearing state being the wearing state and the control voice meeting the preset conditions, obtain the first angle between the first component and the first terminal through the positioning component, and obtain the first angle between the first component and the first terminal. a distance.
其中,第一终端能够在同一信息中获取可穿戴设备的穿戴状态以及第一角度、第一距离等信息。或者,第一终端在一条信息中获得可穿戴设备的穿戴状态,第一终端在另一条信息中获取可穿戴设备的穿戴状态。Wherein, the first terminal can obtain information such as the wearing state of the wearable device, the first angle, the first distance, etc. in the same information. Alternatively, the first terminal obtains the wearing state of the wearable device in one piece of information, and the first terminal obtains the wearing state of the wearable device in another piece of information.
在本例中,在控制语音符合预设条件时,第一终端通过定位组件获取第一组件与第一组件之间的第一角度。需要说明的是,该定位组件本身可以具有判断角度的能力,比如UWB组件。在同一时间,第一终端还能够通过定位组件确定第一组件与第一终端之间的直线距离。In this example, when the control voice meets the preset condition, the first terminal obtains the first angle between the first component and the first component through the positioning component. It should be noted that the positioning component itself may have the ability to judge the angle, such as the UWB component. At the same time, the first terminal can also determine the straight-line distance between the first component and the first terminal through the positioning component.
可选地,定位组件可以是UWB组件,也即基于UWB技术设计的定位组件。Optionally, the positioning component may be a UWB component, that is, a positioning component designed based on UWB technology.
步骤632,响应于控制语音符合预设条件,通过定位组件获取第二组件与第一终端之间的第二角度,并获取和第二组件与第一终端之间的第二距离。 Step 632, in response to the control voice meeting the preset condition, obtain the second angle between the second component and the first terminal through the positioning component, and obtain the second distance between the second component and the first terminal.
在本例中,在控制语音符合预设条件时,第一终端同样能够通过定位组件获取第二组件与第一终端之间的第二角度,并同时获取第二组件与第一终端之间的第二距离。In this example, when the control voice meets the preset conditions, the first terminal can also obtain the second angle between the second component and the first terminal through the positioning component, and simultaneously obtain the angle between the second component and the first terminal. second distance.
需要说明的是,由于第二组件和第一组件是两个独立的组件。因此,步骤631和步骤632的执行顺序互相不构成限定。第一终端既可以先执行步骤631,再执行步骤632。或者,第一终端也可以先执行步骤632,再执行步骤631。或者,第一终端也可以同时执行步骤631和步骤632。It should be noted that, since the second component and the first component are two independent components. Therefore, the execution order of step 631 and step 632 is not mutually limited. The first terminal may perform step 631 first, and then perform step 632. Alternatively, the first terminal may also perform step 632 first, and then perform step 631. Alternatively, the first terminal may also perform step 631 and step 632 at the same time.
步骤633,响应于第一距离与第二距离之间的差值小于预设阈值,根据第一角度和第二角度,确定以第一终端为参考点,第一组件和第二组件在水平面上投影的位置关系。 Step 633, in response to the difference between the first distance and the second distance being less than the preset threshold, according to the first angle and the second angle, determine that the first terminal is used as the reference point, and the first component and the second component are on the horizontal plane. The positional relationship of the projection.
在本例中,第一终端中可以预先设定一个预设阈值。例如,第一终端将预设阈值设置为2厘米。当第一距离与第二距离之间的差值小于2厘米时,终端可以将以第一终端为参考点,第一角度和第二角度,来判断第一组件和第二组件在水平面上的投影位置关系。In this example, a preset threshold may be preset in the first terminal. For example, the first terminal sets the preset threshold to 2 cm. When the difference between the first distance and the second distance is less than 2 cm, the terminal can use the first terminal as a reference point, the first angle and the second angle, to determine the distance between the first component and the second component on the horizontal plane Projection position relationship.
看可选地,预设阈值的数值可以是任意预先设置的数值。例如,预设阈值可以是0.5厘米、1厘米、2厘米或者3厘米等数值。Optionally, the value of the preset threshold may be any preset value. For example, the preset threshold may be a value such as 0.5 cm, 1 cm, 2 cm, or 3 cm.
步骤634,响应于以第一终端为参考点,第一组件在第二组件的顺时针方向,确定第一相对朝向关系是面对关系。 Step 634, in response to taking the first terminal as a reference point and the first component in the clockwise direction of the second component, determine that the first relative orientation relationship is a facing relationship.
其中,响应于上述位置关系指示以第一终端为参考点时,第一组件在第二组件的顺时针方向,则第一终端可以确定第一相对朝向关系是面对关系。The first terminal may determine that the first relative orientation relationship is a facing relationship when the first component is in the clockwise direction of the second component in response to the position relationship indicating that the first terminal is used as the reference point.
可选的,当上述位置关系包括以第一终端为参考点,且第一组件在水平面上的投影位置位于第二组件在水平面上的投影位置的顺时针方向时,可以认为以第一终端为参考点时,第一组件在第二组件的顺时针方向。Optionally, when the above-mentioned positional relationship includes taking the first terminal as the reference point, and the projected position of the first component on the horizontal plane is located in the clockwise direction of the projected position of the second component on the horizontal plane, it can be considered that the first terminal is taken as the reference point. The first component is in the clockwise direction of the second component at the point of reference.
请参考图7,图7是基于图6所示实施例提供的一种投影位置关系的示意图。在图7中,以第一终端700所在位置为坐标原点,设置坐标系。在图7中,第一角度为第一组件710与第一终端的连线,与,坐标系的x轴正半轴之间的夹角。类似的,第二角度为第二组件720与第一终端的连线,与,坐标系的x轴正半轴之间的夹角。需要说明的是,在本申请实施例中,第一角度和第二角度可以均属于劣角(也称为凸角),也即角度范围属于(0°,180°)。图7所提供的视角是俯视水平面的视角。Please refer to FIG. 7 , which is a schematic diagram of a projection position relationship provided based on the embodiment shown in FIG. 6 . In FIG. 7 , the coordinate system is set with the location of the first terminal 700 as the origin of the coordinates. In FIG. 7 , the first angle is the included angle between the line connecting the first component 710 and the first terminal, and the positive half-axis of the x-axis of the coordinate system. Similarly, the second angle is the included angle between the line connecting the second component 720 and the first terminal, and the positive half-axis of the x-axis of the coordinate system. It should be noted that, in the embodiment of the present application, the first angle and the second angle may both belong to the inferior angle (also called the convex angle), that is, the angle range belongs to (0°, 180°). The viewing angle provided in FIG. 7 is a viewing angle looking down on the horizontal plane.
在图7中,由于第一组件710位于第二组件720的顺时针方向,因此第一终端确定与可穿戴设备的正面之间的朝向关系是面对关系。需要说明的是,以第一终端为顶点,第一组件和第二组件之间的夹角属于劣角。In FIG. 7 , since the first component 710 is located in the clockwise direction of the second component 720 , the first terminal determines that the facing relationship with the front face of the wearable device is a facing relationship. It should be noted that, taking the first terminal as the vertex, the angle between the first component and the second component belongs to the inferior angle.
步骤641,通过预设网络接收第二终端的第二相对朝向参数,预设网络是局域网络或者互联网。Step 641: Receive a second relative orientation parameter of the second terminal through a preset network, where the preset network is a local area network or the Internet.
其中,第二相对朝向参数包括第三距离、第三角度、第四距离和第四角度,第三距离是第一组件与第二终端之间的距离,第三角度是第一组件与第二终端之间的角度,第四距离是第二组件与第二终端之间的距离,第四角度是第二组件与第二终端之间的角度。The second relative orientation parameter includes a third distance, a third angle, a fourth distance and a fourth angle, the third distance is the distance between the first component and the second terminal, and the third angle is the distance between the first component and the second terminal The angle between the terminals, the fourth distance is the distance between the second component and the second terminal, and the fourth angle is the angle between the second component and the second terminal.
需要说明的是,预设网络可以第一终端所在的家庭中的局域网。例如,预设网络可以是家庭中网络接入点(AP,Access Point)提供的Wi-Fi局域网。It should be noted that the preset network may be a local area network in the home where the first terminal is located. For example, the preset network may be a Wi-Fi local area network provided by a network access point (AP, Access Point) in the home.
另一种可能的实现方式中,预设网络还可以是第一终端通过远程网络与其它终端组成的网络。比如,预设网络可以是4G网络或者5G网络。In another possible implementation manner, the preset network may also be a network formed by the first terminal and other terminals through a remote network. For example, the preset network may be a 4G network or a 5G network.
在一种可能的实现方式中,第二终端的数量是一个。另一种可能的实现方式中,第二终端的数量可以是多个。在该网络中,第一终端可以是主设备,手机全部的终端的相对朝向输出。可选地,当该网络中包括AP时,该网络的主设备还可以是AP。简而言之,主设备能够通过第二相对朝向参数,以及,用于计算第一相对朝向关系的第一相对朝向参数,确定哪一个终端既符合面对可穿戴设备,又是距离可穿戴设备最近的终端。In a possible implementation manner, the number of the second terminal is one. In another possible implementation manner, the number of the second terminals may be multiple. In this network, the first terminal may be the master device, and the relative orientations of all the terminals of the mobile phone are output. Optionally, when the network includes an AP, the master device of the network may also be an AP. In short, the main device can use the second relative orientation parameter and the first relative orientation parameter used to calculate the first relative orientation relationship to determine which terminal meets both the facing wearable device and the distance from the wearable device. the nearest terminal.
在一种可能的实现场景中,主设备优先根据朝向关系从多个终端中确定面对可穿戴设备的终端。若多个终端中仅有一个设备与可穿戴设备之间的朝向关系是面对关系时,则主设备直接将该终端确定为响应控制语音的终端。In a possible implementation scenario, the master device preferentially determines the terminal facing the wearable device from multiple terminals according to the orientation relationship. If the orientation relationship between only one of the multiple terminals and the wearable device is a facing relationship, the master device directly determines the terminal as the terminal that responds to the control voice.
在另一种可能的实现场景中,若主设备同时确定出至少两个终端与可穿戴设备之间是面对关系的设备,则主设备将进一步判断多个终端分别与可穿戴设备之间的距离,进而最终确定一个终端作为响应控制语音的终端。In another possible implementation scenario, if the master device determines that at least two terminals and the wearable device are in a facing relationship at the same time, the master device will further determine the relationship between the multiple terminals and the wearable device. distance, and then finally determine a terminal as the terminal that responds to the control voice.
步骤642,根据第二相对朝向参数检测第二相对朝向关系是否是面对关系。Step 642: Detect whether the second relative orientation relationship is a facing relationship according to the second relative orientation parameter.
第二相对朝向关系可以是用户的正面与第二终端之间的相对朝向关系。The second relative orientation relationship may be a relative orientation relationship between the front face of the user and the second terminal.
在本例中,第一终端自身能够根据第二相对朝向参数检测第二相对朝向关系是否是面对关系。另一种可能的方式中,第一终端与多个终端所组成的网络中的主设备来确定第二相对朝向关系是否是面对关系。In this example, the first terminal itself can detect whether the second relative orientation relationship is a facing relationship according to the second relative orientation parameter. In another possible manner, the master device in the network composed of the first terminal and multiple terminals determines whether the second relative orientation relationship is a facing relationship.
步骤643,响应于第二相对朝向关系不是面对关系且第一相对朝向关系是面对关系,执行控制语音对应的操作。 Step 643, in response to the second relative orientation relationship is not a facing relationship and the first relative orientation relationship is a facing relationship, perform an operation corresponding to the control voice.
在本例中,第一终端被确定为唯一与可穿戴设备之间的相对朝向关系是面对关系的终端,因此,由第一终端执行控制语音对应的操作。In this example, the first terminal is determined to be the only terminal whose relative orientation relationship with the wearable device is a facing relationship. Therefore, the operation corresponding to the control voice is performed by the first terminal.
步骤651,响应于第二相对朝向关系是面对关系且第一相对朝向关系是面对关系,获取第一平均距离和第二平均距离之间的大小关系。 Step 651, in response to the second relative orientation relationship being a facing relationship and the first relative orientation relationship being a facing relationship, obtain a magnitude relationship between the first average distance and the second average distance.
其中,第一平均距离是第一距离和第二距离的平均值,第二平均距离是第三距离和第四距离之间的平均值。The first average distance is an average value of the first distance and the second distance, and the second average distance is an average value between the third distance and the fourth distance.
步骤652,响应于第一平均距离小于第二平均距离,执行控制语音对应的操作。 Step 652, in response to the first average distance being smaller than the second average distance, perform an operation corresponding to the control voice.
请参见图8,图8是基于图6所示实施例提供的一种响应控制语音的实例示意图。在图8中,可穿戴设备包括第一组件811和第二组件812。位于可穿戴设备的四周,分布有3个终端。三个终端分别为第一终端820、第一个第二终端830和第二个第二终端840。Please refer to FIG. 8 , which is a schematic diagram of an example of a response control voice provided based on the embodiment shown in FIG. 6 . In FIG. 8 , the wearable device includes a first component 811 and a second component 812 . There are 3 terminals distributed around the wearable device. The three terminals are the first terminal 820 , the first second terminal 830 and the second second terminal 840 respectively.
其中,第一终端820能够通过内置的UWB组件确定第一相对朝向关系是面对关系。第一终端820确定第一个第二终端830与可穿戴设备之间不是面对关系,而是侧对关系。第一终端820确定第二个第二终端840与可穿戴设备之间不是面对关系,而是背对关系。The first terminal 820 can determine that the first relative orientation relationship is a facing relationship through the built-in UWB component. The first terminal 820 determines that the first second terminal 830 and the wearable device are not in a facing relationship, but in a side-to-side relationship. The first terminal 820 determines that the second second terminal 840 and the wearable device are not in a facing relationship but in a back-to-back relationship.
请参见图9,图9是基于图6所示实施例提供的另一种响应控制语音的实例示意图。在图9中,可穿戴设备包括第一组件811和第二组件812。位于可穿戴设备的四周,分布有3个终端。三个终端分别为第一终端820、第一个第二终端830和第二个第二终端840。Please refer to FIG. 9. FIG. 9 is a schematic diagram of an example of another response control voice provided based on the embodiment shown in FIG. 6 . In FIG. 9 , the wearable device includes a first component 811 and a second component 812 . There are 3 terminals distributed around the wearable device. The three terminals are the first terminal 820 , the first second terminal 830 and the second second terminal 840 respectively.
其中,第一终端820能够通过内置的UWB组件确定第一相对朝向关系是面对关系,同时,也能够在接收到第一个第二终端830与可穿戴设备之间的第二相对朝向参数后,根据该第二相对朝向参数确定第一个第二终端830与可穿戴设备之间也是面对关系。The first terminal 820 can determine that the first relative orientation relationship is a facing relationship through the built-in UWB component, and at the same time, it can also receive the second relative orientation parameter between the first second terminal 830 and the wearable device after receiving the second relative orientation parameter. , according to the second relative orientation parameter, it is determined that the first second terminal 830 and the wearable device are also facing each other.
在该场景中,第一终端820将进一步判断均是面对关系的各个终端中,哪一个终端与可穿戴设备之间的距离最短。需要说明的是,由于本申请实施例中,可穿戴设备包括第一组件和第二组件,因此,可穿戴设备与终端之间的距离,可以是第一组件与终端之间距离,与,第二组件与终端之间的距离的平均值。In this scenario, the first terminal 820 will further determine which terminal has the shortest distance from the wearable device among the terminals in a facing relationship. It should be noted that, since in the embodiment of the present application, the wearable device includes a first component and a second component, the distance between the wearable device and the terminal may be the distance between the first component and the terminal, and the The average value of the distance between the two components and the terminal.
例如,在图9中,第一终端与可穿戴设备的第一组件之间的距离是2.35米,第一终端与可穿戴设备的第二组件之间的距离是2.38米,则确定第一终端与可穿戴设备之间的距离是2.365米。同时,第二终端与可穿戴设备的第一组件之间的距离是3.6米,第二终端与可穿戴设备的第一组件之间的距离是3.62米,则 确定第二终端与可穿戴设备之间的距离是3.61米。由于第一终端相对于第二终端更靠近可穿戴设备。因此,第一终端确定自身作为响应控制语音的设备。For example, in FIG. 9 , the distance between the first terminal and the first component of the wearable device is 2.35 meters, and the distance between the first terminal and the second component of the wearable device is 2.38 meters, then it is determined that the first terminal The distance from the wearable device is 2.365 meters. Meanwhile, if the distance between the second terminal and the first component of the wearable device is 3.6 meters, and the distance between the second terminal and the first component of the wearable device is 3.62 meters, it is determined that the distance between the second terminal and the first component of the wearable device is 3.62 meters. The distance between them is 3.61 meters. Because the first terminal is closer to the wearable device than the second terminal. Therefore, the first terminal determines itself as a device that responds to the control voice.
步骤660,响应于控制语音用于唤醒第一终端,唤醒第一终端。 Step 660, in response to the control voice being used to wake up the first terminal, wake up the first terminal.
当确定响应控制语音的设备之后,第一终端能够基于控制语音的实际情况来执行不同的操作。当控制语音用于唤醒第一终端时,第一终端进行唤醒。例如,控制语音中包含唤醒词,则第一终端识别出该控制语音用于唤醒第一终端。After determining the device responding to the control voice, the first terminal can perform different operations based on the actual situation of the control voice. When the control voice is used to wake up the first terminal, the first terminal wakes up. For example, if the control voice contains a wake-up word, the first terminal recognizes that the control voice is used to wake up the first terminal.
因此,当第一终端确定自身是响应控制语音的终端时,第一终端将直接进入唤醒状态。可选地,当第一终端进入唤醒状态时,第一终端可以播放提示词语音例如,“我在,请问有什么可能帮助您的?”。Therefore, when the first terminal determines that it is the terminal that responds to the control voice, the first terminal will directly enter the wake-up state. Optionally, when the first terminal enters the wake-up state, the first terminal may play a prompt word voice, for example, "I'm here, how can I help you?".
步骤671,响应于控制语音是问询语音,获取问询语音对应的答复文本。 Step 671, in response to the control voice being the query voice, obtain a reply text corresponding to the query voice.
在本例中,第一终端将在控制语音是问询语音时,获取问询语音对应的答复文本,在该场景中,第一终端还将具有语音合成能力。In this example, the first terminal will acquire the reply text corresponding to the query voice when the control voice is the query voice, and in this scenario, the first terminal will also have the ability to synthesize speech.
步骤672,对答复文本进行语音合成,得到答复语音。Step 672: Perform speech synthesis on the reply text to obtain reply speech.
相应的,第一终端将根据答复文本进行语音合成,得到答复语音。在本例中,该操作可以是第一终端在本地执行的操作。可选地,在另一种可能的执行方式中,答复语音在云端合成,第一终端直接从云端接收该答复语音。Correspondingly, the first terminal will perform speech synthesis according to the reply text to obtain the reply speech. In this example, the operation may be an operation performed locally by the first terminal. Optionally, in another possible implementation manner, the reply voice is synthesized in the cloud, and the first terminal directly receives the reply voice from the cloud.
步骤673,通过扬声器播放答复语音。Step 673, play the reply voice through the speaker.
示意性的,当第一终端获取到答复语音时,第一终端将直接通过扬声器播放该答复语音。可选的,第一终端能够按照预设的语音、语调和音量中一种或多种设置播放该答复语音。Illustratively, when the first terminal acquires the reply voice, the first terminal will directly play the reply voice through the speaker. Optionally, the first terminal can play the reply voice according to one or more of preset voice, intonation and volume settings.
步骤681,响应于控制语音用于指示实际的预设操作,获取控制语音对应的操作指令。 Step 681, in response to the control voice being used to indicate the actual preset operation, obtain an operation instruction corresponding to the control voice.
其中,操作指令用于指示对应的第三终端执行预设操作。The operation instruction is used to instruct the corresponding third terminal to perform a preset operation.
可选地,当控制语音用于指示设备执行具体的预设操作时,第一设备将先获取控制语音对应的指令。Optionally, when the control voice is used to instruct the device to perform a specific preset operation, the first device will first obtain an instruction corresponding to the control voice.
需要说明的是,控制语音对应的指令根据具体执行的指令的设备分为本机指令和外机指令。其中,本机指令由第一终端负责执行,外机指令由除第一终端之外的指定终端负责执行。It should be noted that the instructions corresponding to the control voice are divided into local machine instructions and external machine instructions according to the device that specifically executes the instructions. Wherein, the local machine command is executed by the first terminal, and the external machine command is executed by a designated terminal other than the first terminal.
步骤682,根据操作指令,控制第三终端执行对应的预设操作。Step 682: Control the third terminal to perform a corresponding preset operation according to the operation instruction.
在本例中,当操作指令是外机指令时,第一终端将该操作指令发送至第三终端,从而控制第三终端执行对应的预设操作。In this example, when the operation instruction is an external machine instruction, the first terminal sends the operation instruction to the third terminal, so as to control the third terminal to perform the corresponding preset operation.
在该场景中,第一终端可以是蓝牙音箱,第三终端可以是空调、电视、热水器、空气净化器、扫地机器人、智能灯具或者智能洗碗机等。In this scenario, the first terminal may be a Bluetooth speaker, and the third terminal may be an air conditioner, a TV, a water heater, an air purifier, a cleaning robot, a smart lamp, or a smart dishwasher.
步骤683,根据操作指令,执行预设操作。Step 683: Execute a preset operation according to the operation instruction.
在该场景中,第一终端本身就是能够执行具体操作的设备,例如,第一终端可以是是空调、电视、热水器、空气净化器、扫地机器人、智能灯具或者智能洗碗机等。In this scenario, the first terminal itself is a device capable of performing specific operations. For example, the first terminal may be an air conditioner, a TV, a water heater, an air purifier, a cleaning robot, a smart lamp, or a smart dishwasher.
综上所述,本实施例提供的方法,能够根据通过可穿戴设备与第一终端之间的朝向关系,间接确定用户与第一终端之间的朝向关系,在确定可穿戴设备 处于正在被佩戴状态时,进一步根据可穿戴设备中第一组件和第二组件分别与第一终端之间的距离和角度确定朝向关系,在第一终端与用户是面对关系时,令第一终端响应控制语音,实现了用户在佩戴可穿戴设备时能够从多个可响应语音的终端中控制自身面对的设备中的效果。To sum up, the method provided in this embodiment can indirectly determine the orientation relationship between the user and the first terminal according to the orientation relationship between the wearable device and the first terminal. state, further determine the orientation relationship according to the distance and angle between the first component and the second component in the wearable device and the first terminal respectively, and when the first terminal and the user are in a facing relationship, make the first terminal respond to the control voice , to achieve the effect that the user can control the device facing him from multiple terminals that can respond to voice when wearing the wearable device.
本实施例提供的响应控制语音的方法,还能够通过超宽带UWB技术快速获得可穿戴设备与第一终端之间的距离和角度,提高了第一终端确定与可穿戴设备之间的朝向关系的精度。The method for responding to the control voice provided in this embodiment can also quickly obtain the distance and angle between the wearable device and the first terminal through the ultra-wideband UWB technology, which improves the reliability of determining the orientation relationship between the first terminal and the wearable device. precision.
下述为本申请装置实施例,可以用于执行本申请方法实施例。对于本申请装置实施例中未披露的细节,请参照本申请方法实施例。The following are apparatus embodiments of the present application, which can be used to execute the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.
请参考图10,图10是本申请一个示例性实施例提供的一种响应控制语音的装置的结构框图。该响应控制语音的装置可以通过软件、硬件或者两者的结合实现成为终端的全部或一部分。该装置包括:Please refer to FIG. 10 , which is a structural block diagram of an apparatus for responding to a control voice provided by an exemplary embodiment of the present application. The device for responding to the control voice may be implemented as a whole or a part of the terminal through software, hardware or a combination of the two. The device includes:
语音接收模块1010,用于通过麦克风接收控制语音;a voice receiving module 1010, configured to receive control voice through a microphone;
关系获取模块1020,用于响应于所述控制语音符合预设条件,通过定位组件获取用户的正面与所述第一终端之间的第一相对朝向关系;A relationship obtaining module 1020, configured to obtain the first relative orientation relationship between the front face of the user and the first terminal through the positioning component in response to the control voice meeting a preset condition;
操作执行模块1030,用于响应于所述第一相对朝向关系是面对关系,执行所述控制语音对应的操作,所述面对关系用于指示所述可穿戴设备的正面面对所述第一终端。The operation execution module 1030 is configured to execute an operation corresponding to the control voice in response to the first relative orientation relationship being a facing relationship, and the facing relationship is used to indicate that the front side of the wearable device faces the first a terminal.
在一个可选的实施例中,用户佩戴有可穿戴设备,且所述可穿戴设备包括第一组件和第二组件,当所述可穿戴设备被穿戴时,所述第一组件位于用户的左侧,所述第二组件位于所述用户的右侧,所述关系获取模块1020,用于通过定位组件获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离;通过定位组件获取所述第二组件与所述第一终端之间的第二角度,并获取和所述第二组件与所述第一终端之间的第二距离;响应于所述第一距离与所述第二距离之间的差值小于所述预设阈值,根据所述第一角度和所述第二角度,确定以所述第一终端为参考点,所述第一组件和所述第二组件在水平面上投影的位置关系;响应于所述位置关系指示以所述第一终端为参考点,所述第一组件在所述第二组件的顺时针方向,确定所述第一相对朝向关系是所述面对关系。In an optional embodiment, the user wears a wearable device, and the wearable device includes a first component and a second component, and when the wearable device is worn, the first component is located on the left side of the user side, the second component is located on the right side of the user, and the relationship obtaining module 1020 is configured to obtain the first angle between the first component and the first terminal through the positioning component, and obtain the The first distance between the first component and the first terminal; the second angle between the second component and the first terminal is obtained through the positioning component, and the distance between the second component and the first terminal is obtained. a second distance between terminals; in response to the difference between the first distance and the second distance being less than the preset threshold, determining the predetermined distance according to the first angle and the second angle The first terminal is a reference point, and the positional relationship between the first component and the second component is projected on the horizontal plane; in response to the positional relationship indicating that the first terminal is used as the reference point, the first component is in The clockwise direction of the second component determines that the first relative orientation relationship is the facing relationship.
在一个可选的实施例中,所述关系获取模块1020,用于获取所述可穿戴设备的佩戴状态;响应于所述佩戴状态是正在佩戴状态,获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离。In an optional embodiment, the relationship obtaining module 1020 is configured to obtain the wearing state of the wearable device; in response to the wearing state being the wearing state, obtain the first component and the first component The first angle between the terminals is obtained, and the first distance between the first component and the first terminal is obtained.
在一个可选的实施例中,所述操作执行模块1030,用于通过预设网络接收第二终端的第二相对朝向参数,所述预设网络是局域网络或者互联网,所述第二相对朝向参数包括第三距离、第三角度、第四距离和第四角度,所述第三距离是所述第一组件与所述第二终端之间的距离,所述第三角度是所述第一组件与所述第二终端之间的角度,所述第四距离是所述第二组件与所述第二终端之 间的距离,所述第四角度是所述第二组件与所述第二终端之间的角度;根据所述第二相对朝向参数检测第二相对朝向关系是否是所述面对关系,第二相对朝向关系是所述用户的正面与所述第二终端之间的相对朝向关系;响应于所述第二相对朝向关系不是所述面对关系且所述第一相对朝向关系是面对关系,执行所述控制语音对应的操作。或者,所述操作执行模块1030,用于响应于所述第二相对朝向关系是所述面对关系且所述第一相对朝向关系是面对关系,获取第一平均距离和第二平均距离之间的大小关系,所述第一平均距离是所述第一距离和所述第二距离的平均值,所述第二平均距离是所述第三距离和所述第四距离之间的平均值;响应于所述第一平均距离小于所述第二平均距离,执行所述控制语音对应的操作。In an optional embodiment, the operation execution module 1030 is configured to receive the second relative orientation parameter of the second terminal through a preset network, where the preset network is a local area network or the Internet, and the second relative orientation The parameters include a third distance, a third angle, a fourth distance, and a fourth angle, the third distance being the distance between the first component and the second terminal, and the third angle being the first the angle between the component and the second terminal, the fourth distance is the distance between the second component and the second terminal, the fourth angle is the second component and the second The angle between terminals; whether the second relative orientation relationship is the facing relationship is detected according to the second relative orientation parameter, and the second relative orientation relationship is the relative orientation between the front of the user and the second terminal relationship; in response to the second relative orientation relationship is not the facing relationship and the first relative orientation relationship is a facing relationship, performing an operation corresponding to the control voice. Alternatively, the operation execution module 1030 is configured to obtain the difference between the first average distance and the second average distance in response to the second relative orientation relationship being the facing relationship and the first relative orientation relationship being the facing relationship The first average distance is the average value of the first distance and the second distance, and the second average distance is the average value between the third distance and the fourth distance. ; in response to the first average distance being smaller than the second average distance, perform an operation corresponding to the control voice.
在一个可选的实施例中,所述装置还包括绑定模块,用于响应于第一绑定指令,与控制终端建立绑定关系;接收所述控制终端发送的可穿戴设备信息,所述可穿戴设备信息包括第一组件信息和第二组件信息,所述第一组件信息包括所述第一组件的组件标识和所述第一组件的左右标识,所述第二组件信息包括所述第二组件的组件标识和所述第二组件的左右标识,所述左右标识用于指示被佩戴时处于所述佩戴者的左侧或者右侧,所述第一组件的左右标识和所述第二组件的左右标识不同;将所述可穿戴设备信息存储在第一终端的本地文件中。In an optional embodiment, the apparatus further includes a binding module, configured to establish a binding relationship with the control terminal in response to the first binding instruction; receive wearable device information sent by the control terminal, the The wearable device information includes first component information and second component information, the first component information includes the component identification of the first component and the left and right identifications of the first component, and the second component information includes the first component. The component identifier of the second component and the left and right identifiers of the second component, the left and right identifiers are used to indicate that they are on the left or right side of the wearer when worn, the left and right identifiers of the first component and the second The left and right identifiers of the components are different; the wearable device information is stored in a local file of the first terminal.
在一个可选的实施例中,所述操作执行模块1030,用于响应于所述控制语音用于唤醒所述第一终端,唤醒所述第一终端。或,所述操作执行模块1030,用于响应于所述控制语音是问询语音,获取所述问询语音对应的答复文本;对所述答复文本进行语音合成,得到答复语音;通过扬声器播放所述答复语音。或,所述操作执行模块1030,用于响应于所述控制语音用于指示实际的预设操作,获取所述控制语音对应的操作指令,所述操作指令用于指示对应的第三终端执行所述预设操作;根据所述操作指令,控制所述第三终端执行对应的所述预设操作。In an optional embodiment, the operation execution module 1030 is configured to wake up the first terminal in response to the control voice being used to wake up the first terminal. Or, the operation execution module 1030 is configured to, in response to the control voice being an inquiry voice, obtain a reply text corresponding to the inquiry voice; perform speech synthesis on the reply text to obtain a reply voice; Reply voice. Or, the operation execution module 1030 is configured to, in response to the control voice being used to indicate an actual preset operation, obtain an operation instruction corresponding to the control voice, and the operation instruction is used to instruct the corresponding third terminal to execute the operation instruction. the preset operation; according to the operation instruction, the third terminal is controlled to perform the corresponding preset operation.
在一个可选的实施例中,所述操作执行模块1030,用于通过所述定位组件,通过超宽带UWB技术获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离。以及,所述操作执行模块1030,用于通过所述定位组件,通过超宽带UWB技术获取所述第二组件与所述第一终端之间的第二角度,并获取和所述第二组件与所述第一终端之间的第二距离。In an optional embodiment, the operation execution module 1030 is configured to obtain, through the positioning component, the first angle between the first component and the first terminal through the ultra-wideband UWB technology, and obtain the first angle between the first component and the first terminal. a first distance between the first component and the first terminal. And, the operation execution module 1030 is configured to obtain the second angle between the second component and the first terminal by using the ultra-wideband UWB technology through the positioning component, and obtain the second angle between the second component and the first terminal. a second distance between the first terminals.
综上所述,本申请实施例提供的响应控制语音的装置,能够通过麦克风接收控制语音,并在该控制语音符合预设条件时,通过定位组件确定可穿戴设备的正面与第一终端之间的第一相对朝向关系,当该朝向关系指示可穿戴设备的正面面对第一终端时,第一终端将执行控制语音对应操作。由此可见,本申请能够令第一终端判断用户的朝向,从而确定用户是否面对自身,增强了智能响应控制语音的能力。To sum up, the device for responding to the control voice provided by the embodiment of the present application can receive the control voice through the microphone, and when the control voice meets the preset conditions, determine the distance between the front face of the wearable device and the first terminal through the positioning component The first relative orientation relationship of , when the orientation relationship indicates that the front of the wearable device faces the first terminal, the first terminal will perform the corresponding operation of the control voice. It can be seen from this that the present application enables the first terminal to judge the orientation of the user, thereby determining whether the user faces itself, and enhances the ability to intelligently respond to the control voice.
本申请实施例还提供了一种计算机可读介质,该计算机可读介质存储有至少一条指令,所述至少一条指令由处理器加载并执行以实现如上各个实施例所述的响应控制语音的方法。Embodiments of the present application further provide a computer-readable medium, where at least one instruction is stored in the computer-readable medium, and the at least one instruction is loaded and executed by a processor to implement the method for responding to a control voice as described in each of the above embodiments .
本申请实施例还提供了一种计算机程序产品,该计算机程序产品包括计算机指令,该计算机指令存储在计算机可读存储介质中。计算机设备的处理器从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该计算机设备执行如本申请各个实施例提供的响应控制语音的方法。Embodiments of the present application also provide a computer program product, where the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method for responding to control speech provided by various embodiments of the present application.
本申请实施例还提供了一种计算机程序,该计算机程序中包括计算机指令,计算机设备的处理器执行该计算机指令,使得该计算机设备执行如本申请各个实施例提供的响应控制语音的方法。Embodiments of the present application also provide a computer program, where the computer program includes computer instructions, and the processor of the computer device executes the computer instructions, so that the computer device executes the method for responding to control speech provided by various embodiments of the present application.
需要说明的是:上述实施例提供的响应控制语音的装置在执行响应控制语音的方法时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将设备的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的响应控制语音的装置与响应控制语音的方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。It should be noted that when the apparatus for responding to control voice provided by the above-mentioned embodiment executes the method for responding to control voice, only the division of the above-mentioned functional modules is used as an example for illustration. The functional modules of the device are completed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus for responding to a control voice provided in the above embodiment and the method embodiment for responding to a control voice belong to the same concept, and the specific implementation process thereof is detailed in the method embodiment, which will not be repeated here.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages or disadvantages of the embodiments.
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成,也可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps of implementing the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. The storage medium mentioned may be a read-only memory, a magnetic disk or an optical disk, etc.

Claims (18)

  1. 一种响应控制语音的方法,应用于第一终端中,所述方法包括:A method for responding to a control voice, applied in a first terminal, the method comprising:
    通过麦克风接收控制语音;Receive control voice through microphone;
    响应于所述控制语音符合预设条件,通过定位组件获取用户的正面与所述第一终端之间的第一相对朝向关系;In response to the control voice meeting the preset condition, obtain the first relative orientation relationship between the front face of the user and the first terminal through the positioning component;
    响应于所述第一相对朝向关系是面对关系,执行所述控制语音对应的操作,所述面对关系用于指示所述用户的正面面对所述第一终端。In response to the first relative orientation relationship being a facing relationship, an operation corresponding to the control voice is performed, and the facing relationship is used to indicate that the front side of the user faces the first terminal.
  2. 根据权利要求1所述的方法,所述用户佩戴有可穿戴设备,所述可穿戴设备包括第一组件和第二组件,当所述可穿戴设备被穿戴时,所述第一组件位于所述用户的左侧,所述第二组件位于所述用户的右侧,所述通过定位组件获取用户的正面与所述第一终端之间的第一相对朝向关系,包括:The method of claim 1, wherein the wearable device is worn by the user, the wearable device includes a first component and a second component, the first component is located in the wearable device when the wearable device is worn On the left side of the user, the second component is located on the right side of the user, and the obtaining the first relative orientation relationship between the front surface of the user and the first terminal through the positioning component includes:
    通过所述定位组件获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离;Acquire the first angle between the first component and the first terminal through the positioning component, and acquire the first distance between the first component and the first terminal;
    通过所述定位组件获取所述第二组件与所述第一终端之间的第二角度,并获取所述第二组件与所述第一终端之间的第二距离;Acquire a second angle between the second component and the first terminal through the positioning component, and acquire a second distance between the second component and the first terminal;
    响应于所述第一距离与所述第二距离之间的差值小于预设阈值,根据所述第一角度和所述第二角度,确定以所述第一终端为参考点,所述第一组件和所述第二组件在水平面上投影的位置关系;In response to the difference between the first distance and the second distance being less than a preset threshold, it is determined according to the first angle and the second angle that the first terminal is used as a reference point, and the first terminal is used as a reference point. The positional relationship between a component and the second component projected on the horizontal plane;
    响应于所述位置关系指示以所述第一终端为参考点,所述第一组件在所述第二组件的顺时针方向,确定所述第一相对朝向关系是所述面对关系。In response to the position relationship indicating that the first terminal is used as a reference point, and the first component is in a clockwise direction of the second component, it is determined that the first relative orientation relationship is the facing relationship.
  3. 根据权利要求2所述的方法,所述通过所述定位组件获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离,包括:The method according to claim 2, wherein the first angle between the first component and the first terminal is obtained by using the positioning component, and the distance between the first component and the first terminal is obtained the first distance, including:
    获取所述可穿戴设备的佩戴状态;obtain the wearing status of the wearable device;
    响应于所述佩戴状态是正在佩戴状态,执行所述通过所述定位组件获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离的步骤。In response to the wearing state being the wearing state, executing the obtaining of the first angle between the first component and the first terminal through the positioning component, and obtaining the first component and the first step of a first distance between terminals.
  4. 根据权利要求2所述的方法,所述响应于所述第一相对朝向关系是面对关系,执行所述控制语音对应的操作,包括:The method according to claim 2, wherein in response to the first relative orientation relationship being a facing relationship, performing an operation corresponding to the control voice, comprising:
    通过预设网络接收第二终端的第二相对朝向参数,所述预设网络是局域网络或者互联网,所述第二相对朝向参数包括第三距离、第三角度、第四距离和第四角度,所述第三距离是所述第一组件与所述第二终端之间的距离,所述第三角度是所述第一组件与所述第二终端之间的角度,所述第四距离是所述第二组件与所述第二终端之间的距离,所述第四角度是所述第二组件与所述第二终端之间的角度;The second relative orientation parameter of the second terminal is received through a preset network, where the preset network is a local area network or the Internet, and the second relative orientation parameter includes a third distance, a third angle, a fourth distance, and a fourth angle, The third distance is the distance between the first component and the second terminal, the third angle is the angle between the first component and the second terminal, and the fourth distance is the distance between the second component and the second terminal, the fourth angle is the angle between the second component and the second terminal;
    根据所述第二相对朝向参数检测第二相对朝向关系是否是所述面对关系;所述第二相对朝向关系是所述用户的正面与所述第二终端之间的相对朝向关 系;Detecting whether the second relative orientation relationship is the facing relationship according to the second relative orientation parameter; the second relative orientation relationship is the relative orientation relationship between the front of the user and the second terminal;
    响应于所述第二相对朝向关系不是所述面对关系且所述第一相对朝向关系是面对关系,执行所述控制语音对应的操作;或,响应于所述第二相对朝向关系是所述面对关系且所述第一相对朝向关系是面对关系,获取第一平均距离和第二平均距离之间的大小关系,响应于所述第一平均距离小于所述第二平均距离,执行所述控制语音对应的操作,所述第一平均距离是所述第一距离和所述第二距离的平均值,所述第二平均距离是所述第三距离和所述第四距离之间的平均值。In response to the second relative orientation relationship is not the facing relationship and the first relative orientation relationship is a facing relationship, the operation corresponding to the control voice is performed; or, in response to the second relative orientation relationship being any the facing relationship and the first relative orientation relationship is a facing relationship, obtaining a magnitude relationship between the first average distance and the second average distance, and in response to the first average distance being smaller than the second average distance, executing The operation corresponding to the control voice, the first average distance is the average value of the first distance and the second distance, and the second average distance is the distance between the third distance and the fourth distance average of.
  5. 根据权利要求2至4任一所述的方法,所述方法还包括:The method according to any one of claims 2 to 4, further comprising:
    响应于第一绑定指令,与控制终端建立绑定关系;In response to the first binding instruction, establish a binding relationship with the control terminal;
    接收所述控制终端发送的可穿戴设备信息,所述可穿戴设备信息包括第一组件信息和第二组件信息,所述第一组件信息包括所述第一组件的组件标识和所述第一组件的左右标识,所述第二组件信息包括所述第二组件的组件标识和所述第二组件的左右标识,所述左右标识用于指示被佩戴时处于所述佩戴者的左侧或者右侧,所述第一组件的左右标识和所述第二组件的左右标识不同;Receive wearable device information sent by the control terminal, where the wearable device information includes first component information and second component information, and the first component information includes a component identifier of the first component and the first component The left and right identifiers of the second component, the second component information includes the component identifier of the second component and the left and right identifiers of the second component, and the left and right identifiers are used to indicate that they are on the left or right side of the wearer when worn , the left and right marks of the first component are different from the left and right marks of the second component;
    将所述可穿戴设备信息存储在第一终端的本地文件中。The wearable device information is stored in a local file of the first terminal.
  6. 根据权利要求2至4任一所述的方法,所述执行所述控制语音对应的操作,包括:The method according to any one of claims 2 to 4, wherein the performing the operation corresponding to the control voice comprises:
    响应于所述控制语音用于唤醒所述第一终端,唤醒所述第一终端;Wake up the first terminal in response to the control voice being used to wake up the first terminal;
    或,or,
    响应于所述控制语音是问询语音,获取所述问询语音对应的答复文本;对所述答复文本进行语音合成,得到答复语音;通过扬声器播放所述答复语音;In response to the control voice being an inquiry voice, obtain a reply text corresponding to the inquiry voice; perform speech synthesis on the reply text to obtain a reply voice; play the reply voice through a speaker;
    或,or,
    响应于所述控制语音用于指示预设操作,获取所述控制语音对应的操作指令,所述操作指令用于指示对应的第三终端执行所述预设操作;根据所述操作指令,控制所述第三终端执行对应的所述预设操作。In response to the control voice being used to instruct a preset operation, obtain an operation instruction corresponding to the control voice, and the operation instruction is used to instruct the corresponding third terminal to perform the preset operation; according to the operation instruction, control the The third terminal performs the corresponding preset operation.
  7. 根据权利要求2至4任一所述的方法,所述通过所述定位组件获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离,包括:The method according to any one of claims 2 to 4, wherein the first angle between the first component and the first terminal is obtained through the positioning component, and the first angle between the first component and the first terminal is obtained. A first distance between terminals, including:
    通过所述定位组件,通过超宽带UWB技术获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离;Through the positioning component, the first angle between the first component and the first terminal is obtained through the ultra-wideband UWB technology, and the first distance between the first component and the first terminal is obtained;
    所述通过所述定位组件获取所述第二组件与所述第一终端之间的第二角度,并获取和所述第二组件与所述第一终端之间的第二距离,包括:The acquiring the second angle between the second component and the first terminal through the positioning component, and acquiring the second distance between the second component and the first terminal, includes:
    通过所述定位组件,通过超宽带UWB技术获取所述第二组件与所述第一终端之间的第二角度,并获取和所述第二组件与所述第一终端之间的第二距离。Through the positioning component, the second angle between the second component and the first terminal is obtained through the ultra-wideband UWB technology, and the second distance between the second component and the first terminal is obtained .
  8. 一种响应控制语音的装置,所述装置包括:A device for responding to a control voice, the device comprising:
    语音接收模块,用于通过麦克风接收控制语音;The voice receiving module is used to receive the control voice through the microphone;
    关系获取模块,用于响应于所述控制语音符合预设条件,通过定位组件获取用户的正面与第一终端之间的第一相对朝向关系;a relationship obtaining module, configured to obtain the first relative orientation relationship between the front face of the user and the first terminal through the positioning component in response to the control voice meeting a preset condition;
    操作执行模块,用于响应于所述第一相对朝向关系是面对关系,执行所述控制语音对应的操作,所述面对关系用于指示所述用户的正面面对所述第一终端。An operation execution module, configured to execute an operation corresponding to the control voice in response to the first relative orientation relationship being a facing relationship, where the facing relationship is used to indicate that the front of the user faces the first terminal.
  9. 根据权利要求8所述的装置,所述用户佩戴有可穿戴设备,所述可穿戴设备包括第一组件和第二组件,当所述可穿戴设备被穿戴时,所述关系获取模块,用于,The apparatus according to claim 8, wherein the user wears a wearable device, the wearable device includes a first component and a second component, and when the wearable device is worn, the relationship acquisition module is configured to ,
    通过所述定位组件获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离;Acquire the first angle between the first component and the first terminal through the positioning component, and acquire the first distance between the first component and the first terminal;
    通过所述定位组件获取所述第二组件与所述第一终端之间的第二角度,并获取所述第二组件与所述第一终端之间的第二距离;Acquire a second angle between the second component and the first terminal through the positioning component, and acquire a second distance between the second component and the first terminal;
    响应于所述第一距离与所述第二距离之间的差值小于预设阈值,根据所述第一角度和所述第二角度,确定以所述第一终端为参考点,所述第一组件和所述第二组件在水平面上投影的位置关系;In response to the difference between the first distance and the second distance being less than a preset threshold, it is determined according to the first angle and the second angle that the first terminal is used as a reference point, and the first terminal is used as a reference point. The positional relationship between a component and the second component projected on the horizontal plane;
    响应于所述位置关系指示以所述第一终端为参考点,所述第一组件在所述第二组件的顺时针方向,确定所述第一相对朝向关系是所述面对关系。In response to the position relationship indicating that the first terminal is used as a reference point, and the first component is in a clockwise direction of the second component, it is determined that the first relative orientation relationship is the facing relationship.
  10. 根据权利要求9所述的装置,所述关系获取模块,用于,The apparatus according to claim 9, wherein the relationship acquisition module is configured to:
    获取所述可穿戴设备的佩戴状态;obtain the wearing status of the wearable device;
    响应于所述佩戴状态是正在佩戴状态,执行所述通过所述定位组件获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离的步骤。In response to the wearing state being the wearing state, executing the obtaining of the first angle between the first component and the first terminal through the positioning component, and obtaining the first component and the first step of a first distance between terminals.
  11. 根据权利要求9所述的装置,所述操作执行模块,用于,The apparatus according to claim 9, the operation execution module for,
    通过预设网络接收第二终端的第二相对朝向参数,所述预设网络是局域网络或者互联网,所述第二相对朝向参数包括第三距离、第三角度、第四距离和第四角度,所述第三距离是所述第一组件与所述第二终端之间的距离,所述第三角度是所述第一组件与所述第二终端之间的角度,所述第四距离是所述第二组件与所述第二终端之间的距离,所述第四角度是所述第二组件与所述第二终端之间的角度;The second relative orientation parameter of the second terminal is received through a preset network, where the preset network is a local area network or the Internet, and the second relative orientation parameter includes a third distance, a third angle, a fourth distance, and a fourth angle, The third distance is the distance between the first component and the second terminal, the third angle is the angle between the first component and the second terminal, and the fourth distance is the distance between the second component and the second terminal, the fourth angle is the angle between the second component and the second terminal;
    根据所述第二相对朝向参数检测第二相对朝向关系是否是所述面对关系;所述第二相对朝向关系是所述用户的正面与所述第二终端之间的相对朝向关系;Detecting whether the second relative orientation relationship is the facing relationship according to the second relative orientation parameter; the second relative orientation relationship is the relative orientation relationship between the front of the user and the second terminal;
    响应于所述第二相对朝向关系不是所述面对关系且所述第一相对朝向关系是面对关系,执行所述控制语音对应的操作;或,响应于所述第二相对朝向关系是所述面对关系且所述第一相对朝向关系是面对关系,获取第一平均距离和第二平均距离之间的大小关系,响应于所述第一平均距离小于所述第二平均距离,执行所述控制语音对应的操作,所述第一平均距离是所述第一距离和所述第二距离的平均值,所述第二平均距离是所述第三距离和所述第四距离之间的平均值。In response to the second relative orientation relationship is not the facing relationship and the first relative orientation relationship is a facing relationship, the operation corresponding to the control voice is performed; or, in response to the second relative orientation relationship being any the facing relationship and the first relative orientation relationship is a facing relationship, obtaining a magnitude relationship between the first average distance and the second average distance, and in response to the first average distance being smaller than the second average distance, executing The operation corresponding to the control voice, the first average distance is the average value of the first distance and the second distance, and the second average distance is the distance between the third distance and the fourth distance average of.
  12. 根据权利要求9至11任一所述的装置,所述装置还包括:绑定模块,用于,The apparatus according to any one of claims 9 to 11, further comprising: a binding module for:
    响应于第一绑定指令,与控制终端建立绑定关系;In response to the first binding instruction, establish a binding relationship with the control terminal;
    接收所述控制终端发送的可穿戴设备信息,所述可穿戴设备信息包括第一组件信息和第二组件信息,所述第一组件信息包括所述第一组件的组件标识和所述第一组件的左右标识,所述第二组件信息包括所述第二组件的组件标识和所述第二组件的左右标识,所述左右标识用于指示被佩戴时处于所述佩戴者的左侧或者右侧,所述第一组件的左右标识和所述第二组件的左右标识不同;Receive wearable device information sent by the control terminal, where the wearable device information includes first component information and second component information, and the first component information includes a component identifier of the first component and the first component The left and right identifiers of the second component, the second component information includes the component identifier of the second component and the left and right identifiers of the second component, and the left and right identifiers are used to indicate that they are on the left or right side of the wearer when worn , the left and right marks of the first component are different from the left and right marks of the second component;
    将所述可穿戴设备信息存储在第一终端的本地文件中。The wearable device information is stored in a local file of the first terminal.
  13. 根据权利要求9至11任一所述的装置,所述操作执行模块,用于,The apparatus according to any one of claims 9 to 11, wherein the operation execution module is configured to:
    响应于所述控制语音用于唤醒所述第一终端,唤醒所述第一终端;Wake up the first terminal in response to the control voice being used to wake up the first terminal;
    或,or,
    响应于所述控制语音是问询语音,获取所述问询语音对应的答复文本;对所述答复文本进行语音合成,得到答复语音;通过扬声器播放所述答复语音;In response to the control voice being an inquiry voice, obtain a reply text corresponding to the inquiry voice; perform speech synthesis on the reply text to obtain a reply voice; play the reply voice through a speaker;
    或,or,
    响应于所述控制语音用于指示预设操作,获取所述控制语音对应的操作指令,所述操作指令用于指示对应的第三终端执行所述预设操作;根据所述操作指令,控制所述第三终端执行对应的所述预设操作。In response to the control voice being used to instruct a preset operation, obtain an operation instruction corresponding to the control voice, and the operation instruction is used to instruct the corresponding third terminal to perform the preset operation; according to the operation instruction, control the The third terminal performs the corresponding preset operation.
  14. 根据权利要求9至11任一所述的装置,所述操作执行模块,用于,The apparatus according to any one of claims 9 to 11, wherein the operation execution module is configured to:
    通过所述定位组件,通过超宽带UWB技术获取所述第一组件与所述第一终端之间的第一角度,并获取所述第一组件与所述第一终端之间的第一距离;Through the positioning component, the first angle between the first component and the first terminal is obtained through the ultra-wideband UWB technology, and the first distance between the first component and the first terminal is obtained;
    通过所述定位组件,通过超宽带UWB技术获取所述第二组件与所述第一终端之间的第二角度,并获取和所述第二组件与所述第一终端之间的第二距离。Through the positioning component, the second angle between the second component and the first terminal is obtained through the ultra-wideband UWB technology, and the second distance between the second component and the first terminal is obtained .
  15. 一种终端,所述终端包括处理器、和与所述处理器相连的存储器,以及存储在所述存储器上的计算机指令,所述处理器执行所述计算机指令时实现如权利要求1至7任一所述的响应控制语音的方法。A terminal, the terminal includes a processor, a memory connected to the processor, and computer instructions stored on the memory, and when the processor executes the computer instructions, any one of claims 1 to 7 is implemented. A method for controlling speech in response to the described method.
  16. 一种计算机可读存储介质,所述存储介质中存储有计算机指令,所述计算机指令被处理器执行时实现如权利要求1至7任一所述的响应控制语音的方法。A computer-readable storage medium, storing computer instructions in the storage medium, when the computer instructions are executed by a processor, the method for responding to a control voice according to any one of claims 1 to 7 is implemented.
  17. 一种计算机程序产品,所述计算机程序产品包括计算机指令,所述计算机指令存储在计算机可读存储介质中;所述计算机指令被处理器执行时实现如权利要求1至7任一所述的响应控制语音的方法。A computer program product, the computer program product comprising computer instructions, the computer instructions being stored in a computer-readable storage medium; when the computer instructions are executed by a processor, the response according to any one of claims 1 to 7 is implemented A method of controlling speech.
  18. 一种计算机程序,所述计算机程序包括计算机指令,所述计算机指令被处理器执行时实现如权利要求1至7任一所述的响应控制语音的方法。A computer program comprising computer instructions which, when executed by a processor, implement the method of responding to a control voice according to any one of claims 1 to 7.
PCT/CN2022/076078 2021-03-15 2022-02-11 Method and apparatus for responding to control voice, terminal, storage medium, and program product WO2022193883A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110274474.5A CN115083402A (en) 2021-03-15 2021-03-15 Method, device, terminal and storage medium for responding control voice
CN202110274474.5 2021-03-15

Publications (1)

Publication Number Publication Date
WO2022193883A1 true WO2022193883A1 (en) 2022-09-22

Family

ID=83240485

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/076078 WO2022193883A1 (en) 2021-03-15 2022-02-11 Method and apparatus for responding to control voice, terminal, storage medium, and program product

Country Status (2)

Country Link
CN (1) CN115083402A (en)
WO (1) WO2022193883A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105122361A (en) * 2013-04-03 2015-12-02 Lg电子株式会社 Terminal and control method thereof
CN207965967U (en) * 2017-12-29 2018-10-12 深圳正品创想科技有限公司 A kind of system of processing user request
CN110853619A (en) * 2018-08-21 2020-02-28 上海博泰悦臻网络技术服务有限公司 Man-machine interaction method, control device, controlled device and storage medium
CN111124123A (en) * 2019-12-24 2020-05-08 苏州思必驰信息科技有限公司 Voice interaction method and device based on virtual robot image and intelligent control system of vehicle-mounted equipment
CN111443801A (en) * 2020-03-25 2020-07-24 北京百度网讯科技有限公司 Man-machine interaction method, device, equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105122361A (en) * 2013-04-03 2015-12-02 Lg电子株式会社 Terminal and control method thereof
CN207965967U (en) * 2017-12-29 2018-10-12 深圳正品创想科技有限公司 A kind of system of processing user request
CN110853619A (en) * 2018-08-21 2020-02-28 上海博泰悦臻网络技术服务有限公司 Man-machine interaction method, control device, controlled device and storage medium
CN111124123A (en) * 2019-12-24 2020-05-08 苏州思必驰信息科技有限公司 Voice interaction method and device based on virtual robot image and intelligent control system of vehicle-mounted equipment
CN111443801A (en) * 2020-03-25 2020-07-24 北京百度网讯科技有限公司 Man-machine interaction method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN115083402A (en) 2022-09-20

Similar Documents

Publication Publication Date Title
CN106898348B (en) Dereverberation control method and device for sound production equipment
US9271103B2 (en) Audio control based on orientation
KR20190090069A (en) Changing companion communication device behavior based on status of wearable device
WO2020019821A1 (en) Microphone hole-blockage detection method and related product
WO2021218190A1 (en) Primary-secondary ear switching method and apparatus for tws earphones in communication scenario, and medium
WO2017181365A1 (en) Earphone channel control method, related apparatus, and system
CN110147557A (en) The charging box and storage medium of a kind of interpretation method, system and wireless headset
CN109151789A (en) Interpretation method, device, system and bluetooth headset
US20230379615A1 (en) Portable audio device
CN109195058B (en) Earphone sound channel switching method, earphone sound channel switching device, terminal and storage medium
CN108777827A (en) Wireless headset, method for regulation of sound volume and Related product
CN106302974B (en) information processing method and electronic equipment
CN105847566A (en) Mobile terminal audio volume adjusting method and device
CN115002934A (en) Audio service processing system, electronic equipment and Bluetooth headset
CN113921002A (en) Equipment control method and related device
CN113965715B (en) Equipment cooperative control method and device
CN114710739A (en) Head related function HRTF (head related transfer function) determination method, electronic equipment and storage medium
CN109151669A (en) Headset control method, device, electronic equipment and storage medium
WO2022193883A1 (en) Method and apparatus for responding to control voice, terminal, storage medium, and program product
WO2022193884A1 (en) Method and apparatus for responding to control voice, and device, storage medium and program product
WO2022198980A1 (en) Control method for head-mounted display device, head-mounted display device, and storage medium
EP4258259A1 (en) Wakeup method and electronic device
GB2610459A (en) Audio processing method, apparatus, electronic device and storage medium
CN111343420A (en) Voice enhancement method and wearing equipment
WO2020019822A1 (en) Microphone hole blockage detecting method and related product

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22770238

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22770238

Country of ref document: EP

Kind code of ref document: A1