CN114915916A - Method for directionally controlling electronic equipment, electronic equipment and readable medium - Google Patents

Method for directionally controlling electronic equipment, electronic equipment and readable medium Download PDF

Info

Publication number
CN114915916A
CN114915916A CN202110172178.4A CN202110172178A CN114915916A CN 114915916 A CN114915916 A CN 114915916A CN 202110172178 A CN202110172178 A CN 202110172178A CN 114915916 A CN114915916 A CN 114915916A
Authority
CN
China
Prior art keywords
electronic device
electronic
broadcast signal
angle
bluetooth
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110172178.4A
Other languages
Chinese (zh)
Other versions
CN114915916B (en
Inventor
乐超
蒋钟寅
王洋
凌波
李丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202110172178.4A priority Critical patent/CN114915916B/en
Publication of CN114915916A publication Critical patent/CN114915916A/en
Application granted granted Critical
Publication of CN114915916B publication Critical patent/CN114915916B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/06Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • H04W76/11Allocation or use of connection identifiers
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Selective Calling Equipment (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The application relates to the field of intelligent equipment, and discloses a method for directionally controlling electronic equipment, the electronic equipment and a readable medium. The method for directionally controlling the electronic equipment comprises the following steps: the method comprises the steps that a first electronic device determines device angles between the first electronic device and a plurality of second electronic devices according to first wireless broadcast signals received from the plurality of second electronic devices, the first electronic device obtains first device identifications of the second electronic devices of which the device angles meet preset conditions, the first electronic device broadcasts second wireless broadcast signals containing the first device identifications, the second electronic devices of which the second device identifications are matched with the first device identifications in the received second wireless broadcast signals in the plurality of second electronic devices respond to instructions sent by a user of the first electronic device, and therefore directional control over the electronic devices is achieved.

Description

Method for directionally controlling electronic equipment, electronic equipment and readable medium
Technical Field
The present disclosure relates to the field of smart devices, and in particular, to a method for directionally controlling an electronic device, and a readable medium.
Background
Along with the continuous development of intelligent technology, smart devices such as intelligent audio amplifier, intelligent TV, intelligent air conditioner, intelligent refrigerator, intelligent bracelet, intelligent wrist-watch, intelligent glasses get into the family more and more. The user may interact with the smart device in a variety of ways, such as voice, gesture, face recognition, and so forth. With the increase of intelligent devices in a home, instructions sent by a user are often acquired by a plurality of intelligent devices and respectively responded, thereby bringing about a user experience problem. Taking a user instruction as a voice instruction as an example, as shown in fig. 1(a) and 1(b), the user issues a voice instruction "a small art, how today is the weather? ", three peripheral intelligent devices: the television, the sound box A and the sound box B receive the voice instruction and respectively perform voice response, and the user cannot hear the content of the voice response due to the voice responses, so that the user experience is poor.
Disclosure of Invention
The embodiment of the application provides a method for directionally controlling electronic equipment, which can obtain an equipment angle between the electronic equipment and the controlled electronic equipment by receiving a wireless broadcast signal of the controlled electronic equipment, and further inform the controlled electronic equipment with the equipment angle meeting preset conditions to respond to a user instruction, so that the directional control of the controlled electronic equipment is realized.
In a first aspect, an embodiment of the present application provides a method for directionally controlling an electronic device, where the method includes:
the method comprises the steps that a first electronic device determines device angles with a plurality of second electronic devices according to first wireless broadcast signals received from the plurality of second electronic devices; the method comprises the steps that first electronic equipment obtains a first equipment identifier of second electronic equipment, wherein the equipment angle of the first electronic equipment meets a preset condition; the first electronic equipment broadcasts a second wireless broadcast signal containing a first equipment identification; and the second electronic equipment with the second equipment identification matched with the first equipment identification in the received second wireless broadcast signal in the plurality of second electronic equipment responds to the instruction sent by the user of the first electronic equipment. The first electronic device determines a device angle between the first electronic device and the second electronic device by receiving a first wireless broadcast signal from the second electronic device, and broadcasts a device identifier of the second electronic device, where the device angle meets a preset condition, so that the second electronic device matched with the broadcasted device identifier responds to a user instruction, and the user controls the orientation of the second electronic device by pointing the first electronic device to the second electronic device.
In one possible implementation of the first aspect, the method further includes:
the first electronic device includes an antenna array including at least two antennas.
In a possible implementation of the first aspect, the method further includes:
the device angle is an angle between an antenna array plane of the first electronic device and the received first wireless broadcast signal.
In a possible implementation of the first aspect, the method further includes:
the method for determining the device angle between a first electronic device and a plurality of second electronic devices according to a first wireless broadcast signal received from the plurality of second electronic devices includes:
the first electronic device determines a device angle between the first electronic device and the plurality of second electronic devices according to the information of the angle of arrival obtained when the first wireless broadcast signal from the plurality of second electronic devices is received.
In a possible implementation of the first aspect, the method further includes:
the angle of arrival information includes at least one of: the antenna spacing, the phase difference when the wireless broadcast signal reaches different antennas, and the wavelength of the wireless broadcast signal.
In a possible implementation of the first aspect, the method further includes:
the device angle θ between the first electronic device and the plurality of second electronic devices is calculated using the following formula:
θ=arccos(ψλ/2πd),
where d denotes an antenna pitch, ψ denotes a phase difference when a radio broadcast signal reaches different antennas, and λ denotes a wavelength of the radio broadcast signal.
In a possible implementation of the first aspect, the method further includes:
the wireless broadcast signal is a Bluetooth signal or a Bluetooth low energy signal.
In a possible implementation of the first aspect, the method further includes:
the first device identification or the second device identification comprises at least one of: a hardware identification code or a network address.
In a possible implementation of the first aspect, the method further includes:
the preset conditions include at least one of the following: a fixed value, a value range, or a value range centered on a fixed value.
In a possible implementation of the first aspect, the method further includes:
the first electronic device comprises a main processor and a coprocessor, and the first electronic device uses the coprocessor to complete the following steps under the condition that the main processor is in a sleep state:
determining a device angle between the plurality of second electronic devices according to the first wireless broadcast signals received from the plurality of second electronic devices;
acquiring a first device identifier of a second electronic device with a device angle meeting a preset condition;
a second wireless broadcast signal containing the first device identification is broadcast.
In a possible implementation of the first aspect, the method further includes:
the instruction sent by the user at least comprises the following one:
a voice instruction; limb instruction. The body instruction may be a gesture instruction, a human body posture instruction, a facial expression instruction, and the like sent by the user.
In a possible implementation of the first aspect, the method further includes:
the response of the second electronic device to the instruction sent by the user at least comprises one of the following:
responding to the voice; corresponding operations are executed. The corresponding operation can be specifically executed by turning off, turning on, heating up an air conditioner, turning up the volume of a sound box and the like.
In a possible implementation of the first aspect, the method further includes:
the first electronic equipment is a mobile terminal, and the second electronic equipment is intelligent household equipment.
In a second aspect, embodiments of the present application provide a machine-readable medium having instructions stored thereon, which when executed on a machine, may cause the machine to perform any one of the possible methods of the first aspect.
In a third aspect, an embodiment of the present application provides an electronic device, including: a memory for storing instructions for execution by one or more processors of the system, and the processor being one of the processors of the system for performing any one of the possible methods of the first aspect described above.
In a fourth aspect, the present application provides an electronic device having a function of implementing the method for directionally controlling an electronic device. The functions can be realized by hardware, and the functions can also be realized by executing corresponding software by hardware. The hardware or software includes one or more units corresponding to the above functions.
Drawings
Fig. 1(a), 1(b) illustrate a scenario in which a user interacts with multiple smart devices through voice instructions, according to some embodiments of the present application.
Fig. 2(a), fig. 2(b), and fig. 2(c) illustrate scenarios for a user to perform directional control on a smart device through voice instruction in the current scheme, according to some embodiments of the present application.
FIG. 3 illustrates a scenario 10 for directional control of an electronic device, according to some embodiments of the present application.
Fig. 4(a), 4(b), and 4(c) illustrate scenarios where a user performs directional control of a smart device through voice commands in the solution according to some embodiments of the present application.
Fig. 5 illustrates a schematic diagram of a handset 100, according to some embodiments of the present application.
FIG. 6 illustrates an interaction flow diagram of a method of directionally controlling an electronic device, according to some embodiments of the present application.
Fig. 7 illustrates a scenario in which an electronic device transmits a bluetooth broadcast signal to a handset 100, according to some embodiments of the present application.
Fig. 8 illustrates a scenario in which a transmitting device transmits a bluetooth signal for reception by different antennas of a receiving device, according to some embodiments of the present application.
Fig. 9(a) illustrates a mapping of bluetooth signal wavelength versus phase, according to some embodiments of the present application.
Fig. 9(b) illustrates waveforms of bluetooth signals received by different antennas, according to some embodiments of the present application.
Fig. 10 illustrates a schematic diagram of an angle between a bluetooth broadcast signal transmitted by an electronic device and an antenna of a handset 100, according to some embodiments of the present application.
Fig. 11 illustrates a schematic view of a device angle when the handset 100 is pointed at the speaker 200, according to some embodiments of the present application.
Fig. 12 illustrates a schematic diagram of a bluetooth broadcast signal transmitted by the handset 100, according to some embodiments of the present application.
Fig. 13 illustrates a scenario in which the handset 100 transmits a bluetooth broadcast signal to an electronic device, according to some embodiments of the application.
Fig. 14(a), 14(b) illustrate a scenario where a user sends a device identification of an electronic device pointed to by the handset 100 through a trigger operation, according to some embodiments of the present application.
Fig. 15(a), 15(b) illustrate an interaction flow diagram for a processor 110 in a handset 100 to control the on/off of a directional control function in a co-processor 111, according to some embodiments of the present application.
Fig. 16 is a block diagram of a coprocessor 111 in a handset 100 according to some embodiments of the present application.
Fig. 17 illustrates an interaction flow diagram for shutting down a voice system in the co-processor 111 of the handset 100, according to some embodiments of the present application.
Detailed Description
Illustrative embodiments of the present application include, but are not limited to, a method of directionally controlling an electronic device, and a readable medium to solve a problem of difficulty in controlling a specific smart device in an environment where a plurality of smart devices exist.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements should not be limited by these terms unless otherwise specified. These terms are only used to distinguish one element from another.
Embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
Some current solutions can implement response control on a smart device through sound intensity, a tag, a combination of sound intensity and a tag, and the like, but these solutions still have possible interference, so that the responding smart device is not a smart device desired by a user, and accurate control on the smart device is difficult to implement. As shown in fig. 2(a), a scheme of implementing response control on a smart device through sound intensity is shown, in the scenario shown in fig. 2(a), a user desires that a smart television with a longer distance and a smaller pickup sound intensity responds, and a voice instruction issued by the user is actually responded by a smart speaker with a shorter distance and a larger pickup sound intensity, so that user experience is affected. For another example, fig. 2(B) shows a scheme of implementing response control on a smart device through a tag, in the scenario shown in fig. 2(B), a user wants to respond by one of the sound box a or the sound box B, and since the sound box a and the sound box B belong to the same type of smart device and the corresponding tags are the same, a voice command issued by the user is actually responded by the sound box a and the sound box B having the same tags, and there is also a problem in user experience. Fig. 2(c) shows a scheme of implementing response control on the smart device by combining sound intensity and tags, in the scenario shown in fig. 2(c), a user wants to respond by one of the sound box a or the sound box B, and the sound intensities received by the sound box a and the sound box B with the same tag are similar in the case of being at a distance from the user, so that the voice command issued by the user is actually still responded by the sound box a and the sound box B, and the user experience is also affected.
FIG. 3 illustrates a scenario 10 of an orientation control electronic device, according to some embodiments of the present application. Specifically, as shown in fig. 3, a first electronic device 100, a second electronic device 200, and a third electronic device 300 are included in this scenario 10. Wherein, when the user wants to perform voice interaction with the second electronic device 200 through the voice instruction, the first electronic device 100 may be pointed at the second electronic device 200. The first electronic device 100 can calculate device angles between the first electronic device 100 and the second electronic device 200 and the third electronic device 300 respectively according to the wireless broadcast signals sent by the second electronic device 200 and the third electronic device 300, where, as shown in fig. 8, the device angle between the first electronic device 100 and the second electronic device 200 is an angle between an antenna array surface of the first electronic device 100 and the received wireless broadcast signal sent by the second electronic device 200, and the device angle between the first electronic device 100 and the third electronic device 300 is an angle between the antenna array surface of the first electronic device 100 and the received wireless broadcast signal sent by the third electronic device 300.
When the user points the first electronic device 100 at the second electronic device 200, the first electronic device 100 detects that the device angle with the second electronic device 200 is 95 ° and the angle with the third electronic device 300 is 15 °. The first electronic device 100 transmits the device identification AOA ID2 of the second electronic device 200 included in the received wireless broadcast signal transmitted by the second electronic device 200 as the first device identification, and includes the first device identification in the second wireless broadcast signal. After receiving the second wireless broadcast signal, the second electronic device 200 compares its own device identifier with the first device identifier in the second wireless broadcast signal, and if the comparison is the same, the second electronic device 200 performs a corresponding voice response to the voice command of the user. The third electronic device 300 does not perform a voice response to the voice command of the user number because the device identifier of the third electronic device 300 is different from the first device identifier in the received second wireless broadcast signal.
In this way, in the embodiment of the present application, the user can designate the second electronic device 200 to respond to the voice command of the user by pointing the first electronic device 100 to the second electronic device 200 that desires to respond, and the third electronic device 300 that the user does not designate through the first electronic device 100 does not respond to the voice command of the user even if the user receives the voice command, so that the user can precisely control the electronic device that the user desires to respond to.
It can be understood that the technical solution of the present application is not only suitable for voice interaction, but also suitable for video interaction, for example, when the first electronic device 100 points to the second electronic device 200, the user issues an instruction to ask for weather by using a shaking gesture.
Referring to the scenario in fig. 4, taking the first electronic device 100 as a mobile phone, the second electronic device 200 as a sound box, and the third electronic device 300 as a television, as shown in fig. 4(a), the user points the mobile phone 100 at the television 300 and sends a voice control command "the baby art, i want to watch the baby pig, because the device angle between the television 300 and the mobile phone 100 satisfies the preset condition, even if the user is closer to the sound box 200 and farther from the television 300, the television 300 performs a voice response" well, and plays the baby pig, which is called "for your watching the baby" now, and performs subsequent response processing, thereby overcoming the problem of the conventional sound intensity scheme. Taking the second electronic device 200 as the sound box a and the fourth electronic device 201 added in the scene as the sound box B for further explanation, as shown in fig. 4(B), the user points the mobile phone 100 to the sound box a 200 and issues a voice instruction, "how is the day of the art, how is today? Because the device angle between the speaker a 200 and the mobile phone 100 satisfies the preset condition, even though the speaker a 200 and the speaker B201 are the same type of electronic device, the speaker a 200 performs voice response "weather XX, temperature XX" to the user voice command, thereby overcoming the problem that the speaker a and the speaker B respond to the user voice command simultaneously in the existing label scheme.
In addition, the drawing may include not only two electronic devices but also more than two electronic devices. For example, in the scenario shown in fig. 4(c), a second electronic device 200, a fourth electronic device 201, and a third electronic device 300 may be included. Further, taking the second electronic device 200 as the sound box a, the fourth electronic device 201 as the sound box B, and the third electronic device 300 as the television as an example, as shown in fig. 4(c), the user points the mobile phone 100 to the sound box a 200 and sends a voice control instruction, "a feature art, how today? Because the device angle between the sound box a 200 and the mobile phone 100 meets the preset condition, even though the television 300 is closer, the sound box a 200 and the sound box B201 are farther, and the sound box a 200 and the sound box B201 are the same type of electronic device, the sound box a 200 performs voice response to the voice command of the user, namely 'today weather XX, temperature XX', so that the problem that the sound box a 200 and the sound box B201 simultaneously respond to the voice command of the user in the existing sound intensity and label scheme is solved.
It is understood that, in the embodiment of the present application, the second electronic device 200 and the third electronic device 300 may include, but are not limited to: intelligent household devices such as smart television, intelligent audio amplifier, intelligent wrist-watch, intelligent bracelet, intelligent refrigerator, intelligent air conditioner.
It is understood that, in the embodiment of the present application, the first electronic device 100 may include, but is not limited to: a cell phone, tablet, wearable device, portable game, portable music player, reader device, or other electronic device having an antenna array. In the following description, for simplicity of explanation, the first electronic device 100 is taken as a mobile phone, and the user control command is taken as a voice command as an example to explain the technical solution of the present application.
Fig. 5 shows a schematic structural diagram of a mobile phone 100 according to some embodiments of the present application, where the mobile phone 100 may be configured to receive wireless broadcast signals sent by a plurality of smart devices, determine device angles between the mobile phone 100 and the plurality of smart devices according to angle of arrival information obtained when the wireless broadcast signals are received, and send a wireless broadcast signal containing a device identifier of a certain smart device in response to a user trigger operation, where the device angle between the smart device and the mobile phone 100 meets a preset condition, so that the smart device can respond to a control instruction of the user.
Specifically, as shown in fig. 5, the mobile phone 100 may include a processor 110, a co-processor 111, a wireless communication module 120, a mobile communication module 130, a power module 140, an audio module 150, an interface module 160, a camera 170, a memory 180, a sensor module 190, keys 101, a display screen 102, and the like.
It is to be understood that the illustrated structure of the embodiment of the present invention does not specifically limit the mobile phone 100. In other embodiments of the present application, the handset 100 may include more or fewer components than shown, or some components may be combined, some components may be separated, or a different arrangement of components may be used. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 110 may include one or more Processing units, for example, a Processing module or a Processing circuit that may include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a Digital Signal Processor (DSP), a Microprocessor (MCU), an Artificial Intelligence (AI) processor, or a Programmable logic device (FPGA), among others. The different processing units may be separate devices or may be integrated into one or more processors. A memory unit may be provided in the processor 110 for storing instructions and data. In some embodiments, the storage unit in processor 110 is cache 180.
The coprocessor 111 is a processor that assists the processor in performing certain tasks, and may include a control unit for controlling the execution of instructions in the coprocessor, an execution unit for coprocessor-related instructions, and a storage unit for storing data during coprocessor instruction execution. In the embodiment of the present application, the coprocessor 111 may be configured to control the wireless communication module 120 to implement wireless broadcasting and wireless scanning, so as to implement directional control of the electronic device in case that the processor 110 is asleep. In an embodiment of the present application, the coprocessor may further process data related to bluetooth communication, in particular data related to BLE communication.
The wireless communication module 120 may include an antenna array 1, and implement transceiving of electromagnetic waves via the antenna array 1. In the embodiment of the present application, the wireless communication module 120 receives a wireless broadcast signal sent by an electronic device through the antenna array 1, and determines the information of the arrival angle according to the difference between the wireless broadcast signals received by different antennas in the antenna array 1. The wireless communication module 120 may provide solutions for wireless communication applied to the mobile phone 10, including Wireless Local Area Networks (WLANs), wireless fidelity (Wi-Fi) networks, Bluetooth (BT), Global Navigation Satellite Systems (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The handset 100 may communicate with a network and other devices via wireless communication techniques.
The mobile communication module 130 may include, but is not limited to, the antenna array 2, a power amplifier, a filter, a Low Noise Amplifier (LNA), and the like. The mobile communication module 130 can provide a solution including wireless communication of 2G/3G/4G/5G and the like applied to the handset 100. The mobile communication module 130 may receive electromagnetic waves from the antenna, filter, amplify, etc. the received electromagnetic waves, and transmit the electromagnetic waves to the modem processor for demodulation. The mobile communication module 130 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 130 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 130 may be disposed in the same device as at least some of the modules of the processor 110.
In some embodiments, the mobile communication module 130 and the wireless communication module 120 of the handset 100 may also be located in the same module.
The power module 140 may include a power supply, power management components, and the like. The power source may be a battery. The power management component is used for managing the charging of the power supply and the power supply of the power supply to other modules.
The display screen 102 is used for displaying human-computer interaction interfaces, images, videos and the like. The display screen 102 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a Micro OLED, a quantum dot light-emitting diode (QLED), and the like.
The sensor module 190 may include a proximity light sensor, a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like. In an embodiment of the present application, the sensor module 190 may be used to detect a trigger operation of a user. For example, the user's operation is shaking the cellular phone 100 so as to be detected by the acceleration sensor.
The audio module 150 is used to convert digital audio information into an analog audio signal output or convert an analog audio input into a digital audio signal. The audio module 150 may also be used to encode and decode audio signals. In some embodiments, the audio module 150 may be disposed in the processor 110, or some functional modules of the audio module 150 may be disposed in the processor 110. In some embodiments, audio module 150 may include speakers, an earpiece, a microphone, and a headphone interface. In an embodiment of the application, the audio module 150 may be turned off when the user issues a voice command to avoid possible interference. In the scenario shown in fig. 3, after the mobile phone 100 sends the wireless broadcast signal containing the device identifier of the second electronic device 200, the audio module 150 of the mobile phone 100 is turned off to avoid interfering with the voice command sent by the user next.
The camera 170 is used to capture still images or video. An optical image of the object generated by the lens is projected onto the photosensitive element. The photosensitive element converts the optical Signal into an electrical Signal, and then transfers the electrical Signal to an Image Signal Processor (ISP) to be converted into a digital Image Signal. The mobile phone 10 may implement a shooting function through an ISP, a camera 170, a video codec, a Graphics Processing Unit (GPU), a display screen 102, an application processor, and the like.
The interface module 160 includes an external memory interface, a Universal Serial Bus (USB) interface, a Subscriber Identity Module (SIM) card interface, and the like. The external memory interface may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the mobile phone 10. The external memory card communicates with the processor 110 through an external memory interface to implement a data storage function. The usb interface is used for communication between the handset 10 and other electronic devices. The SIM card interface is used to communicate with a SIM card attached to the handset 1010, such as to read a telephone number stored in the SIM card or to write a telephone number into the SIM card.
In some embodiments, the handset 100 also includes keys 101, motors, indicators, and the like. The keys 101 may include a volume key, an on/off key, and the like. The motor is used to generate a vibration effect to the mobile phone 100, for example, when the mobile phone 100 is called, to prompt the user to answer the call of the mobile phone 100. The indicators may include laser indicators, radio frequency indicators, LED indicators, and the like.
Based on the structure shown in fig. 5, the technical solution of the present application will be described in detail with reference to fig. 6 and a specific scenario. In the embodiment shown in fig. 6, the second electronic device 200 is exemplified by a speaker, and the third electronic device 300 is exemplified by a television. Furthermore, in this embodiment, in order to reduce the overall power consumption, the wireless scanning and wireless broadcasting of the handset 100 are handled by the co-processor 111, while the processor 110 is in a sleep state.
As shown in fig. 6, the solution of the directional control electronic device of the present application includes:
in step S601, the mobile phone 100 initiates a wireless scan. The wireless scanning is used for receiving a wireless broadcast signal sent by an external electronic device, and before the mobile phone 100 initiates the wireless scanning, the mobile phone 100 does not receive the wireless broadcast signal sent by the electronic device, such as the sound box 200 or the television 300.
In some embodiments of the present application, the mobile phone 100 may perform wireless scanning through the bluetooth communication module or the bluetooth low energy communication module to receive a bluetooth broadcast signal transmitted by an external electronic device. Here, the bluetooth communication module or the bluetooth low energy communication module may be used for communication via bluetooth as well as Bluetooth Low Energy (BLE). The term "bluetooth" has its full scope of ordinary meaning and includes at least any of the various implementations of the existing bluetooth standard, including Bluetooth Low Energy (BLE), including future implementations of the bluetooth standard, and the like. For example, a bluetooth connection comprises a bluetooth connection based on the bluetooth protocol 4.x, e.g. 4.2, or comprises a bluetooth connection based on the bluetooth protocol 5.x, e.g. 5.0. In addition, the bluetooth connection may also include Bluetooth Low Energy (BLE). BLE aims at significantly reducing power consumption and cost compared to classical bluetooth, while maintaining a similar communication range as classical bluetooth. In some embodiments the bluetooth communication module may additionally be incorporated in other communication modules, such as modules for Wi-Fi or WLAN (e.g., 802.11) communication, and the like. For simplicity, only the application of BLE technology in various embodiments is described below, it being understood that classic bluetooth, Wi-Fi, and other short-range communication technologies may be applied in various embodiments of the present application.
In some embodiments of the present application, the coprocessor 111 in the mobile phone 100 sends a bluetooth scanning instruction to the bluetooth communication module or the bluetooth low energy communication module, so that the bluetooth communication module or the bluetooth low energy communication module completes receiving a bluetooth broadcast signal sent by the smart device. When the processor 110 of the handset 100 is in a sleep state, the power consumption of the handset 100 can be reduced to a large extent by using the co-processor 111 to complete bluetooth scanning.
Here, the coprocessor 111 includes a bluetooth protocol stack and a bluetooth driver. The bluetooth protocol stack and the bluetooth driver in the coprocessor 111 are formed by migrating at least part of functions of the bluetooth protocol stack and the bluetooth driver operated at the processor 110 side to the coprocessor 111 side in a code migration manner, such as bluetooth broadcasting (ADV), bluetooth Scanning (Scanning), and the like. The bluetooth protocol stack in the coprocessor 111 may execute the respective bluetooth protocol for broadcasting and scanning, and the bluetooth driver may include part or all of a driver that drives the bluetooth communication module.
In some embodiments, the bluetooth protocol stack in the co-processor 111 is provided with the same security protocol as the bluetooth protocol stack of the processor 110, so that the data security of bluetooth communication via the co-processor 111 can be protected by the bluetooth security protocol.
In addition, the bluetooth communication module and the coprocessor 111 perform data transmission via an Inter Integrated Circuit (I2C) or a modified Inter Integrated Circuit (I3C). The I2C interface is a bidirectional synchronous Serial bus including a Serial Data Line (SDA) and a Serial Clock Line (SCL). I3C is an improvement over I2C, is compatible with the I2C protocol, and combines the advantages of I2C (two-wire, simple) and SPI (low power consumption, high speed).
In steps S602 and S603, sound box 200 and television 300 respectively transmit wireless broadcast signals.
For example, the sound box 200 and the television 300 periodically transmit the radio broadcast signal to the outside, and the transmission time interval may be set according to the user's needs or factory settings, for example, 5 seconds or 10 seconds.
In some embodiments of the application, the sound box 200 and the television 300 respectively send a bluetooth broadcast signal to the outside, the bluetooth broadcast signal sent by the sound box 200 includes an equipment identifier of the sound box 200, the bluetooth broadcast signal sent by the television 300 includes an equipment identifier of the television 300, the equipment identifier is used for uniquely identifying a corresponding electronic equipment, the equipment identifier may be, for example, a hardware identification code corresponding to the electronic equipment, or a network address corresponding to the electronic equipment, and the mobile phone 100 receives the bluetooth broadcast signal sent by the sound box 200 and the television 300 through a bluetooth communication module or a bluetooth low-power communication module, and uploads the bluetooth broadcast signal to the coprocessor 111.
Fig. 7 shows a scenario in which the electronic device transmits a bluetooth broadcast signal to the cellular phone 100. As shown in fig. 7, the second electronic device is a television 300, the third electronic device is a sound box 200, the device identifier is a wave arrival angle identifier, the television 300 and the sound box 200 respectively control the bluetooth communication module or the bluetooth low energy communication module to send bluetooth broadcast signals through the processor, the bluetooth broadcast signals respectively include the device identifiers AOA ID1 and AOA ID2, and the mobile phone 100 receives the bluetooth broadcast signals through the bluetooth communication module or the bluetooth low energy communication module that performs bluetooth scanning and transmits the bluetooth broadcast signals to the coprocessor 111.
It can be understood that the bluetooth broadcast signals transmitted by the sound box 200 and the television 300 may be broadcast data transmitted by using a normal bluetooth protocol, or broadcast data transmitted by using a bluetooth low energy protocol, and the embodiment of the present application does not specifically limit which bluetooth protocol is specifically used.
In step S604, the mobile phone 100 determines the angle of arrival information corresponding to each electronic device according to the wireless broadcast signal received from each electronic device. The information on the angle of arrival indicates information on the angle of arrival of a radio broadcast signal transmitted from the electronic device at the mobile phone 100, for example, the antenna pitch d, the phase difference ψ when the radio broadcast signal reaches different antennas, the wavelength λ of the radio broadcast signal, and the like. The distance difference of the wireless broadcast signal to different antennas of the mobile phone 100 can be calculated through the arrival angle information, and the device angle between the mobile phone 100 and the electronic device can be obtained through the distance difference.
Here, the mobile phone 100 receives the radio broadcast signals transmitted from the sound box 200 and the television 300, respectively, and determines the information on the angle of arrival of the radio broadcast signal transmitted from the sound box 200 and the information on the angle of arrival of the radio broadcast signal transmitted from the television 300 of the sound box 200, based on the arrival of the radio broadcast signals at the antenna array of the mobile phone 100.
It should be understood that only two electronic devices are shown in fig. 6, but the number of electronic devices in fig. 6 is not limited to the number of electronic devices in the embodiment of the present application, and the mobile phone 100 may receive the wireless broadcast signals of two or more electronic devices, and the embodiment of the present application does not limit the number of electronic devices that transmit the wireless broadcast signals.
In some embodiments of the present application, the mobile phone 100 receives a bluetooth broadcast signal transmitted by the speaker 200 or the television 300 through a bluetooth communication module or a bluetooth low energy communication module, and determines corresponding information of the angle of arrival according to the received bluetooth broadcast signal. In some embodiments, the angle of arrival information includes, but is not limited to, the following: the antenna spacing d, the phase difference psi when the Bluetooth broadcast signal arrives at different antennas, and the wavelength lambda of the Bluetooth signal.
Here, the antenna pitch refers to a pitch between different antennas in the antenna array of the handset 100. The phase difference psi refers to the difference in phase between the bluetooth signals received by different antennas in the antenna array. Fig. 8 shows a scenario in which a bluetooth signal transmitted by a transmitting device is received by different antennas in an antenna array of a receiving device, as shown in fig. 8, the transmitting device transmits a bluetooth broadcast signal through the antennas, and the receiving device receives the bluetooth broadcast signal through the antenna array, and a distance d exists between different antennas in the antenna array, so that distances through which the bluetooth broadcast signal transmitted by the antennas of the transmitting device propagates to different antennas of the receiving device in the form of electromagnetic waves are different, and therefore phases of the bluetooth signal received by different antennas in the antenna array of the receiving device are also different, and a phase difference ψ exists between the phases.
Further, fig. 9(a) shows a correspondence of a wavelength and a phase of a bluetooth signal, λ being the wavelength of the bluetooth signal, and a signal of one wavelength corresponding to a phase of 0 to 2 π. As described above, since the transmitting device is not at the same distance from different antennas, the phases of the bluetooth signals received by different antennas are different. For example, fig. 9(b) shows a waveform diagram of the bluetooth signal received by the antenna 1 and the antenna 2 at a distance d, and as shown in fig. 9(b), the phase of the bluetooth signal received by the antenna 1 is ψ 1 Phase psi of bluetooth signal received by antenna 2 2 The phase difference between the two antennas is psi 12 According to the corresponding relationship between the wavelength and the phase, the distance difference s between the antenna 1 and the antenna 2 receiving the bluetooth signal is ψ λ/2 pi. Then according to the triangleThe functional relationship can obtain the device angle theta (arccos (psi lambda/2 pi d)).
In some embodiments of the present application, the bluetooth communication module or the bluetooth low energy communication module may determine the phase difference ψ and the bluetooth signal wavelength λ by receiving bluetooth data sent by the sending device, send the phase difference ψ and the bluetooth signal wavelength λ together with a known antenna spacing d to the coprocessor 111 in the mobile phone 100, and perform subsequent processing by the coprocessor 111, thereby avoiding that these information is sent to the processor 110 to wake up the processor 110, and reducing the overall power consumption of the mobile phone 100.
In step S605, the mobile phone 100 determines the device angle between the mobile phone 100 and the speaker 200 or the television 300 according to the information of the angle of arrival.
Here, after the wireless broadcast signal transmitted by the speaker 200 reaches the mobile phone 100, the mobile phone 100 obtains the information of the angle of arrival corresponding to the speaker 200, and after the wireless broadcast signal transmitted by the television 300 reaches the mobile phone 100, the mobile phone 100 obtains the information of the angle of arrival corresponding to the television 300, and the mobile phone 100 uses the coprocessor 111 to calculate the information of the angle of arrival corresponding to the speaker 200 and the information of the angle of arrival corresponding to the television 300, respectively, so as to obtain the device angle between the mobile phone 100 and the speaker 200 and the device angle between the mobile phone 100 and the television 300.
With continued reference to fig. 8, from the distance difference s and the antenna spacing d, we can obtain cos (θ) ═ s/d ψ λ/2 π d, θ is the device angle of the receiving device relative to the transmitting device, so we can derive the formula for θ as follows:
θ=arccos(ψλ/2πd)。
here, the device angle of the receiving device with respect to the transmitting device is an azimuth angle, that is, an angle between an antenna array plane of the receiving device and the received signal, and the antenna array plane refers to a plane formed by the tips of a plurality of antennas in the antenna array.
Fig. 10 shows a scenario in which the handset 100 calculates the device angle from the received bluetooth broadcast signal, respectively. As shown in fig. 10, the third electronic device is a television 300, the second electronic device is a sound box 200, the television 300 and the sound box 200 broadcast the bluetooth signal periodically, the bluetooth signal sent by the television 300 includes the device identifier AOA ID1 of the television 300, and the sound box 200 contains the AOA ID2 of the speaker 200, and the handset 100 has an antenna array. The mobile phone 100 receives the bluetooth broadcast signal from the television 300 or the sound box 200 under the condition that the processor 110 is in sleep, transmits the information of the angle of arrival obtained when the bluetooth broadcast signal is received to the coprocessor 111, and respectively calculates the device angle theta between the mobile phone 100 and the television 300 by the coprocessor 111 1 And the device angle theta between the handset 100 and the speaker 200 2
In step S606, the mobile phone 100 determines the device identifier of the electronic device pointed by the mobile phone 100 according to the device angle. Here, the electronic device pointed by the mobile phone 100 specifically refers to the electronic device pointed by the antenna array of the mobile phone 100. In addition, the mobile phone 100 obtains corresponding angle of arrival information according to the device angle, and then obtains the device identifier included in the corresponding wireless broadcast signal according to the angle of arrival information.
Fig. 11 shows a scenario in which the user points the mobile phone 100 to the electronic device, as shown in fig. 11, the user points the mobile phone 100 to the speaker 200, the mobile phone 100 receives the bluetooth broadcast signals sent by the television 300 and the speaker 200 and determines corresponding information of the angle of arrival under the condition that the processor 110 is asleep, and the co-processor 111 calculates the device angle θ between the mobile phone 100 and the television 300 according to the corresponding information of the angle of arrival 1 And the device angle theta between the handset 100 and the speaker 200 2 ,θ 2 Is approximately 90.
In some embodiments of the present application, the coprocessor 111 in the mobile phone 100 checks whether the calculated device angle satisfies a preset condition, and determines the electronic device corresponding to the device angle as the electronic device pointed by the mobile phone 100 when the device angle satisfies the preset condition, where the device identifier of the electronic device pointed by the mobile phone 100 is the device identifier of the electronic device.
Here, the preset conditions may include, but are not limited to, the following: a fixed value, a value range, or a value range centered on a fixed value, etc. For example, the preset condition may be a fixed angle value such as 90 °, a value range such as [80 °, 100 °, or a value range of ± 15 ° centered at 90 °.
With continued reference to figure 11 of the drawings,setting the preset condition that the angle of the equipment is at [80 degrees ], 100 degrees]Due to the device angle theta between the mobile phone 100 and the sound box 200 2 Approximately 90 °, therefore, when the preset condition is satisfied, the mobile phone 100 uses the device identifier AOA ID2 of the sound box 200 as the device identifier of the electronic device to which the mobile phone 100 points; device angle theta between handset 100 and television 300 1 The preset condition is clearly not met and therefore the handset 100 does not have the device identification AOA ID1 of the television 300 as the device identification of the electronic device to which the handset 100 is pointing.
In some embodiments of the present application, device angles between two or more electronic devices and the mobile phone 100 may satisfy a preset condition, in which case, the mobile phone 100 may use device identifiers of the two or more electronic devices as candidates of device identifiers of the electronic device pointed by the mobile phone 100, and then determine a device identifier from the candidate device identifiers. For example, the mobile phone 100 may determine the device identifier according to the size of the device angle, and determine the device identifier of the electronic device corresponding to the largest device angle as the device identifier of the electronic device pointed by the mobile phone 100, where the largest device angle between the mobile phone 100 and the electronic device indicates that the distance between the pointed direction of the mobile phone 100 and the electronic device is the smallest.
Step S607, the coprocessor 111 in the mobile phone 100 detects a user operation, compares the user operation with a preset user trigger operation, and continues to detect the user operation if the user operation is inconsistent with the preset user trigger operation; if the user operation is consistent with the preset user trigger operation, step S608 is executed.
In some embodiments of the present application, the triggering operation of the user is preset, and may include but is not limited to: sensor trigger operations, screen touch operations, etc. The sensor triggering operation is an operation related to triggering a sensor on the mobile phone 100, such as a process of re-holding the bezel of the mobile phone 100, shaking the mobile phone 100, and the like. The screen touch operation is a plurality of touch operations performed on the screen of the mobile phone 100, for example, a finger clicks a preset screen area, a finger slides on the preset screen area, a plurality of fingers slide on the screen, and the like.
In step S608, the mobile phone 100 transmits a wireless broadcast signal including a device identifier, where the device identifier is a device identifier of an electronic device pointed by the mobile phone 100, and both the speaker 200 and the television 300 can receive the wireless broadcast signal including the device identifier because the mobile phone 100 transmits broadcast data.
With continued reference to fig. 11, in this scenario, the device ID of the electronic device pointed to by handset 100 is the device ID AOA ID2 of sound box 200, so that the wireless broadcast signal transmitted by handset 100 includes the device ID AOA ID2 of sound box 200.
In some embodiments of the present application, the coprocessor 111 of the mobile phone 100 sends the bluetooth broadcast signal through the bluetooth communication module or the bluetooth low energy communication module. The coprocessor 111 sends a bluetooth broadcast instruction to the bluetooth communication module or the bluetooth low energy communication module, and transmits the device identifier of the smart device to which the mobile phone 100 points, and the bluetooth communication module or the bluetooth low energy communication module generates a bluetooth broadcast signal according to the received bluetooth broadcast instruction and the device identifier of the electronic device to which the mobile phone 100 points, and sends the bluetooth broadcast signal.
In some embodiments of the present application, the bluetooth broadcast signal transmitted by the handset 100 includes a bluetooth preamble or a bluetooth low energy preamble in addition to the device identifier of the electronic device pointed to by the handset 100.
Fig. 12 shows the structure of the bluetooth broadcast signal transmitted by the cellular phone 100. As shown in fig. 12, the bluetooth broadcast signal includes a preamble and a device identifier, the preamble is a field necessary for the bluetooth broadcast, and a filter in the bluetooth scan can filter out the bluetooth broadcast signal that is not of interest through the preamble. The device identifier designates a device identifier of an electronic device pointed by the mobile phone 100, and the electronic device can resolve the device identifier after receiving the bluetooth broadcast signal.
Fig. 13 shows a scenario in which the mobile phone 100 transmits a bluetooth broadcast signal to an electronic device. As shown in fig. 13, the coprocessor 111 of the mobile phone 100 sends a bluetooth broadcast signal through the bluetooth communication module, where the bluetooth broadcast signal includes the device identifier AOA ID1, and the television 300 and the speaker 200 receive the bluetooth broadcast signal through the bluetooth communication module and upload the bluetooth broadcast signal to various processors.
Step S609 and step S610, the sound box 200 and the television 300 respectively check the device identifier in the received wireless broadcast signal, that is, compare the device identifier from the wireless broadcast signal with the device identifier of itself, if they are consistent, the electronic device with the consistent comparison result responds to the user instruction, that is, step S611 is executed; if not, the electronic device with inconsistent comparison result closes the response to the user instruction, i.e. step S612 is executed.
In step S611, the sound box 200 enables its own response system to the user instruction, so that the user instruction can be responded to.
In step S612, the television 300 turns off its response system to the user command, and avoids responding to the user command.
Fig. 14(a) and 14(b) show a scenario in which the user transmits the device identification of the electronic device to which the mobile phone 100 is pointing by a trigger operation. As shown in fig. 14(a), the third electronic device is a television 300, the second electronic device is a smart speaker, the electronic device pointed by the mobile phone 100 is a speaker 200, the device identifier of the speaker 200 is AOA ID2, and the user performs a trigger operation to make the mobile phone 100 send a bluetooth broadcast signal containing the device identifier AOA ID2 when the processor 110 is in sleep coprocessor operation.
The tv 300 receives the bluetooth broadcast signal and parses out the device ID AOA 2 therein, and then performs step S610 to compare the device ID AOA 2 with its own device ID, and since the device ID of the tv 300 is AOA ID1, the two are not consistent, so that step S612 is performed to shut down the response of the tv 300 to the user command, such as the voice system. And the sound box 200 receives the bluetooth broadcast signal and analyzes the device identifier AOA ID2 therein, execute step S609 to compare the device identifier AOA ID2 with its own device identifier, and since the device identifier of the sound box 200 is AOA ID2, the two are consistent, execute step S611 to respond to the user 'S instruction, for example, to enable the voice system of the sound box 200, that is, to enable the voice system of the sound box 200 if the voice system of the sound box 200 is in the off state, the voice system of the sound box 200 is turned on, and to keep on if the voice system of the sound box 200 is in the on state, so that the voice response can be performed to the user' S voice instruction. Subsequently, the user issues an instruction such as a voice instruction "art, how today? "and then as shown in fig. 14(b), the sound box 200 makes a voice response to the voice command issued by the user" today weather XX, temperature XX ".
In some embodiments of the present application, the response to the user instruction is turned off for a certain time limit, and the response to the user instruction by the electronic device is turned back on after the turn-off time exceeds a preset time limit threshold. For example, in the above example, the voice response system of television 300 may be turned on again after being turned off for a preset time period threshold, such as 3 minutes.
In some embodiments of the present application, the response of the electronic device to the user instruction may include, but is not limited to, the following: and carrying out voice response, executing corresponding operation and the like. For example, the operations performed by the electronic device may include, but are not limited to: shutdown, startup, air conditioning heating, sound box volume up-regulation and the like.
In some embodiments of the application, the electronic device can also receive the instruction of the user and perform corresponding response in a video acquisition mode in response to the instruction of the user. For example, the camera of the electronic device collects an image of the limb of the user, and performs image recognition on the image of the limb of the user to obtain an instruction sent by the user. Recognizing the image of the user's limb may include, but is not limited to, gesture recognition, face recognition, and the like. The instruction sent by the user can correspond to a preset human body gesture, a preset gesture or a preset human face expression and the like. After determining the instruction sent by the user, the electronic device responds according to the instruction of the user, and the responding mode is, for example, voice response.
In addition, in some embodiments of the application, the processor 110 may control the directional control function in the coprocessor 111 to be turned on or turned off, after the directional control function in the coprocessor 111 is turned on, the user may control the electronic device in a manner that the mobile phone points to the electronic device, and after the directional control function in the coprocessor 111 is turned off, the user may not control the smart device in a manner that the mobile phone points to the electronic device.
Fig. 15(a) and 15(b) show the interaction flow of the processor 110 controlling the orientation control function of the coprocessor 111 to turn on or off in the mobile phone 100. As shown in fig. 15(a), the processor 110 sends a directional control function start instruction to the coprocessor 111, and the coprocessor 111 enables the directional control function after receiving the start instruction, so that the coprocessor 111 can perform related processing of directional control. The electronic device 200 periodically sends a bluetooth broadcast signal, the coprocessor 111 receives the information of the angle of arrival related to the bluetooth broadcast signal uploaded by the bluetooth communication module or the bluetooth low energy communication module, performs a subsequent directional control process such as calculation of a device angle, and sends the bluetooth broadcast signal after detecting a user trigger operation. As shown in fig. 15(b), in the mobile phone 100, the processor 110 sends a command to the coprocessor 111 to turn off the directional control function, and the coprocessor 111 turns off the directional control function after receiving the command to turn off, so that the coprocessor 111 does not process the information of the angle of arrival of the bluetooth broadcast signal even when receiving the bluetooth broadcast signal sent by the electronic device 200.
Fig. 16 is a block diagram of a component module of the coprocessor 111 of the handset 100 to implement the directional control function. As shown in fig. 16, the coprocessor 111 includes a trigger operation detection module, a plurality of modules for implementing a directional control function, a communication module, and a voice system, where the modules for implementing the directional control function include: the device comprises an enabling module, a calculating module, a processing module, a receiving module and a sending module.
The processor 110 in the mobile phone 100 controls the on/off of the directional control function by sending a directional control function on/off instruction to the enabling module in the co-processor 111. The bluetooth communication module realizes the report of the angle of arrival information and the generation and transmission of bluetooth broadcast signals by interacting with the communication module of the coprocessor 111. The trigger operation detection module is used for detecting preset user trigger operation and transmitting data generated by the user trigger operation to the enabling module. The communication module is used for realizing the Bluetooth scanning and Bluetooth broadcasting functions. The voice system is used to implement voice related functions of the handset 100.
The enabling module is used for controlling whether the calculation module processes the obtained information of the angle of arrival, receiving data generated by the triggering operation of the user from the triggering operation checking module, and controlling the enabling and the closing of the voice system. The receiving module is used for receiving the information of the angle of arrival of the Bluetooth broadcast signal from the electronic equipment and the equipment identification of the electronic equipment which are obtained through Bluetooth scanning from the communication module and transmitting the information to the computing module. The calculation module is configured to calculate a device angle between the mobile phone 100 and the electronic device according to the information of the angle of arrival when the enabling module is turned on, that is, when the directional control function is turned on, and send a device identifier of the electronic device corresponding to the device angle that meets the condition to the processing module after receiving data generated by a user trigger operation from the enabling module. The processing module is used for receiving the device identification sent by the computing module and transmitting the device identification to the sending module. The sending module sends the device identification from the processing module to the communication module, so that the communication module sends the Bluetooth data containing the device identification through the Bluetooth communication module in a Bluetooth broadcast mode.
In some embodiments of the present application, the voice system of the handset 100 may be turned off in a directional control scenario, thereby avoiding possible interference with the user's voice control instructions. Fig. 17 shows an interaction flow of turning off the voice system in the coprocessor 111 in the mobile phone 100. As shown in fig. 17, the trigger operation detection module detects a user operation, and after detecting that the user operation is a trigger operation, sends a notification of the detection of the user trigger operation to the enabling module. And after receiving the notification, the enabling module sends a closing instruction to the voice system. After the voice system receives the closing instruction, the voice system is closed for a preset time limit, and within the preset time limit, the voice system of the mobile phone 100 cannot make a voice and cannot respond to the voice instruction of the user.
Further technical solutions of the present application are summarized in the following examples:
example 1: a method of directionally controlling an electronic device, comprising:
the first electronic equipment determines equipment angles with the plurality of second electronic equipment according to the first wireless broadcast signals received from the plurality of second electronic equipment;
the method comprises the steps that first electronic equipment obtains a first equipment identifier of second electronic equipment, wherein the equipment angle of the first electronic equipment meets a preset condition;
the first electronic equipment broadcasts a second wireless broadcast signal containing a first equipment identification;
and the second electronic equipment with the second equipment identification matched with the first equipment identification in the received second wireless broadcast signal in the plurality of second electronic equipment responds to the instruction sent by the user of the first electronic equipment.
Example 2: the method of embodiment 1, wherein the first electronic device comprises an antenna array comprising at least two antennas.
Example 3: the method of embodiment 2, wherein the device angle is an angle between an antenna array face of the first electronic device and the received first wireless broadcast signal.
Example 4: the method of embodiment 3, wherein the first electronic device determining a device angle with the plurality of second electronic devices from the first wireless broadcast signals received from the plurality of second electronic devices, comprises:
the first electronic device determines a device angle between the first electronic device and the plurality of second electronic devices according to the information of the angle of arrival obtained when the first wireless broadcast signal from the plurality of second electronic devices is received.
Example 5: the method of embodiment 4, wherein the angle-of-arrival information includes at least one of: the antenna spacing, the phase difference when the wireless broadcast signal reaches different antennas, and the wavelength of the wireless broadcast signal.
Example 6: the method of embodiment 5, wherein the device angle θ between the first electronic device and the plurality of second electronic devices is calculated using the formula:
θ=arccos(ψλ/2πd),
where d denotes an antenna pitch, ψ denotes a phase difference when a radio broadcast signal reaches different antennas, and λ denotes a wavelength of the radio broadcast signal.
Example 7: the method according to any of embodiments 1-6, wherein the wireless broadcast signal is a Bluetooth signal or a Bluetooth Low energy signal.
Example 8: the method of embodiment 1, wherein the first device identification or the second device identification comprises at least one of: a hardware identification code or a network address.
Example 9: the method of embodiment 1, wherein the preset conditions include at least one of: a fixed value, a value range, or a value range centered on a fixed value.
Example 10: the method of embodiment 1, wherein the first electronic device includes a main processor and a coprocessor, and the first electronic device uses the coprocessor to perform the following steps with the main processor in a sleep state:
determining a device angle between the first electronic device and the plurality of second electronic devices according to the first wireless broadcast signals received from the plurality of second electronic devices;
acquiring a first device identifier of second electronic equipment with an equipment angle meeting a preset condition;
a second wireless broadcast signal containing the first device identification is broadcast.
Example 11: the method of embodiment 1, wherein the user-issued instruction includes at least one of:
a voice instruction; limb instruction.
Example 12: the method of embodiment 1, wherein the response of the second electronic device to the instruction issued by the user comprises at least one of:
responding to the voice; corresponding operations are executed.
Example 13: the method according to embodiment 1, wherein the first electronic device is a mobile terminal, and the second electronic device is an intelligent home device.
Example 14: a readable medium, wherein the readable medium has stored thereon instructions, which when executed on an electronic device, cause the electronic device to execute the above method of directionally controlling the electronic device.
Example 15: an electronic device, comprising: a memory for storing instructions for execution by one or more processors of the system, and a processor, which is one of the processors of the system, for performing the above method of directionally controlling an electronic device.
While the present application has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present application.

Claims (15)

1. A method of directionally controlling an electronic device, comprising:
the method comprises the steps that a first electronic device determines device angles with a plurality of second electronic devices according to first wireless broadcast signals received from the second electronic devices;
the first electronic equipment acquires a first equipment identifier of second electronic equipment of which the equipment angle meets a preset condition;
the first electronic device broadcasts a second wireless broadcast signal containing the first device identification;
and the second electronic equipment with the second equipment identification matched with the first equipment identification in the received second wireless broadcast signal in the plurality of second electronic equipment responds to an instruction sent by a user of the first electronic equipment.
2. The method of claim 1, wherein the first electronic device comprises an antenna array comprising at least two antennas.
3. The method of claim 2, wherein the device angle is an angle between an antenna array face of the first electronic device and the received first wireless broadcast signal.
4. The method of claim 3, wherein the first electronic device determines a device angle with a plurality of second electronic devices according to the first wireless broadcast signal received from the plurality of second electronic devices, comprising:
the first electronic device determines a device angle between the first electronic device and the plurality of second electronic devices according to the information of the angle of arrival obtained when the first wireless broadcast signals from the plurality of second electronic devices are received.
5. The method of claim 4, wherein the information of arrival angle comprises at least one of the following information: the antenna spacing, the phase difference when the wireless broadcast signal reaches different antennas, and the wavelength of the wireless broadcast signal.
6. The method of claim 5, wherein a device angle θ between the first electronic device and a plurality of the second electronic devices is calculated using the following equation:
θ=arccos(ψλ/2πd),
where d denotes an antenna pitch, ψ denotes a phase difference when a radio broadcast signal reaches different antennas, and λ denotes a wavelength of the radio broadcast signal.
7. The method of any one of claims 1 to 6, wherein the wireless broadcast signal is a Bluetooth signal or a Bluetooth Low energy signal.
8. The method of claim 1, wherein the first device identity or the second device identity comprises at least one of: a hardware identification code or a network address.
9. The method of claim 1, wherein the preset condition comprises at least one of: a fixed value, a value range, or a value range centered on a fixed value.
10. The method of claim 1, wherein the first electronic device includes a main processor and a coprocessor, and wherein the first electronic device uses the coprocessor to perform the following steps when the main processor is in a sleep state:
determining a device angle between a plurality of second electronic devices according to first wireless broadcast signals received from the second electronic devices;
acquiring a first device identifier of a second electronic device of which the device angle meets a preset condition;
broadcasting a second wireless broadcast signal containing the first device identification.
11. The method of claim 1, wherein the user-generated instructions include at least one of:
a voice instruction;
limb instruction.
12. The method of claim 1, wherein the response of the second electronic device to the instruction from the user comprises at least one of:
responding to the voice;
and executing corresponding operation.
13. The method according to claim 1, wherein the first electronic device is a mobile terminal and the second electronic device is a smart home device.
14. A readable medium having stored thereon instructions that, when executed on an electronic device, cause the electronic device to perform the method of any one of claims 1 to 13.
15. An electronic device, comprising: a memory for storing instructions for execution by one or more processors of a system, and the processor, being one of the processors of the system, for performing the method of any one of claims 1 to 13.
CN202110172178.4A 2021-02-08 2021-02-08 Method for directionally controlling electronic device, electronic device and readable medium Active CN114915916B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110172178.4A CN114915916B (en) 2021-02-08 2021-02-08 Method for directionally controlling electronic device, electronic device and readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110172178.4A CN114915916B (en) 2021-02-08 2021-02-08 Method for directionally controlling electronic device, electronic device and readable medium

Publications (2)

Publication Number Publication Date
CN114915916A true CN114915916A (en) 2022-08-16
CN114915916B CN114915916B (en) 2023-08-22

Family

ID=82760946

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110172178.4A Active CN114915916B (en) 2021-02-08 2021-02-08 Method for directionally controlling electronic device, electronic device and readable medium

Country Status (1)

Country Link
CN (1) CN114915916B (en)

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130179064A1 (en) * 2012-01-06 2013-07-11 International Business Machines Corporation Hand-held device with directional notification
CN104967726A (en) * 2015-04-30 2015-10-07 努比亚技术有限公司 Voice instruction processing method, voice instruction processing device and mobile terminal
US20180018964A1 (en) * 2016-07-15 2018-01-18 Sonos, Inc. Voice Detection By Multiple Devices
WO2018213401A1 (en) * 2017-05-16 2018-11-22 Apple Inc. Methods and interfaces for home media control
CN109450750A (en) * 2018-11-30 2019-03-08 广东美的制冷设备有限公司 Sound control method, device, mobile terminal and the household appliance of equipment
WO2019120102A1 (en) * 2017-12-21 2019-06-27 安克创新科技股份有限公司 Wireless handheld electronic device, smart electronic device and pairing connection method thereof
CN110213433A (en) * 2019-05-15 2019-09-06 深圳市泰衡诺科技有限公司 Jingle bell control method, device, electric terminal and storage medium
CN110808886A (en) * 2019-10-18 2020-02-18 珠海格力电器股份有限公司 Voice equipment control method and device, storage medium and voice equipment
US20200066279A1 (en) * 2018-08-27 2020-02-27 Samsung Electronics Co., Ltd. Method, device, and system of selectively using multiple voice data receiving devices for intelligent service
US20200184977A1 (en) * 2017-08-09 2020-06-11 Lg Electronics Inc. Method and apparatus for calling voice recognition service by using bluetooth low energy technology
CN111812588A (en) * 2020-07-20 2020-10-23 百度在线网络技术(北京)有限公司 Multi-device voice wake-up implementation method and device, electronic device and medium
CN111833868A (en) * 2020-06-30 2020-10-27 北京小米松果电子有限公司 Voice assistant control method, device and computer readable storage medium
CN111880855A (en) * 2020-07-31 2020-11-03 宁波奥克斯电气股份有限公司 Equipment control method and distributed voice system

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130179064A1 (en) * 2012-01-06 2013-07-11 International Business Machines Corporation Hand-held device with directional notification
CN104967726A (en) * 2015-04-30 2015-10-07 努比亚技术有限公司 Voice instruction processing method, voice instruction processing device and mobile terminal
US20180018964A1 (en) * 2016-07-15 2018-01-18 Sonos, Inc. Voice Detection By Multiple Devices
WO2018213401A1 (en) * 2017-05-16 2018-11-22 Apple Inc. Methods and interfaces for home media control
CN109287140A (en) * 2017-05-16 2019-01-29 苹果公司 Method and interface for home media control
US20200184977A1 (en) * 2017-08-09 2020-06-11 Lg Electronics Inc. Method and apparatus for calling voice recognition service by using bluetooth low energy technology
WO2019120102A1 (en) * 2017-12-21 2019-06-27 安克创新科技股份有限公司 Wireless handheld electronic device, smart electronic device and pairing connection method thereof
US20200066279A1 (en) * 2018-08-27 2020-02-27 Samsung Electronics Co., Ltd. Method, device, and system of selectively using multiple voice data receiving devices for intelligent service
CN109450750A (en) * 2018-11-30 2019-03-08 广东美的制冷设备有限公司 Sound control method, device, mobile terminal and the household appliance of equipment
CN110213433A (en) * 2019-05-15 2019-09-06 深圳市泰衡诺科技有限公司 Jingle bell control method, device, electric terminal and storage medium
CN110808886A (en) * 2019-10-18 2020-02-18 珠海格力电器股份有限公司 Voice equipment control method and device, storage medium and voice equipment
CN111833868A (en) * 2020-06-30 2020-10-27 北京小米松果电子有限公司 Voice assistant control method, device and computer readable storage medium
CN111812588A (en) * 2020-07-20 2020-10-23 百度在线网络技术(北京)有限公司 Multi-device voice wake-up implementation method and device, electronic device and medium
CN111880855A (en) * 2020-07-31 2020-11-03 宁波奥克斯电气股份有限公司 Equipment control method and distributed voice system

Also Published As

Publication number Publication date
CN114915916B (en) 2023-08-22

Similar Documents

Publication Publication Date Title
CN109710080B (en) Screen control and voice control method and electronic equipment
WO2020228815A1 (en) Voice-based wakeup method and device
WO2020156269A1 (en) Display method for electronic device having flexible screen and electronic device
US20240073305A1 (en) Touchscreen, Electronic Device, and Display Control Method
CN113115439B (en) Positioning method and related equipment
CN114513847B (en) Positioning method, device, system, electronic equipment and storage medium
WO2021023046A1 (en) Electronic device control method and electronic device
WO2020259542A1 (en) Control method for display apparatus, and related device
CN114638605A (en) Method and electronic equipment for near field wireless communication
CN110060675B (en) Method and equipment for waking up sound box
WO2022007944A1 (en) Device control method, and related apparatus
CN110742580A (en) Sleep state identification method and device
CN112312366A (en) Method, electronic equipment and system for realizing functions through NFC (near field communication) tag
KR20180055243A (en) Mobile terminal and method for controlling the same
CN114173193A (en) Multimedia stream playing method and electronic equipment
WO2022048453A1 (en) Unlocking method and electronic device
US20230319724A1 (en) Electronic device and operation method therefor
CN114915916B (en) Method for directionally controlling electronic device, electronic device and readable medium
CN115035187A (en) Sound source direction determining method, device, terminal, storage medium and product
CN110427124B (en) Projection device, wearable equipment and detection control method
CN115731923A (en) Command word response method, control equipment and device
CN112185096A (en) Voice remote control method and device, electronic equipment and storage medium
WO2022252938A1 (en) Voice interactive response method and electronic device
US20230205157A1 (en) Electronic device controlling external device and method for controlling the same
CN115379433B (en) Bluetooth equipment pairing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant