CN114915916B - Method for directionally controlling electronic device, electronic device and readable medium - Google Patents

Method for directionally controlling electronic device, electronic device and readable medium Download PDF

Info

Publication number
CN114915916B
CN114915916B CN202110172178.4A CN202110172178A CN114915916B CN 114915916 B CN114915916 B CN 114915916B CN 202110172178 A CN202110172178 A CN 202110172178A CN 114915916 B CN114915916 B CN 114915916B
Authority
CN
China
Prior art keywords
electronic device
electronic
bluetooth
angle
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110172178.4A
Other languages
Chinese (zh)
Other versions
CN114915916A (en
Inventor
乐超
蒋钟寅
王洋
凌波
李丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202110172178.4A priority Critical patent/CN114915916B/en
Publication of CN114915916A publication Critical patent/CN114915916A/en
Application granted granted Critical
Publication of CN114915916B publication Critical patent/CN114915916B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/06Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • H04W76/11Allocation or use of connection identifiers
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The application relates to the field of intelligent equipment, and discloses a method for directionally controlling electronic equipment, the electronic equipment and a readable medium. The method for directionally controlling the electronic equipment comprises the following steps: the first electronic equipment determines equipment angles between the first electronic equipment and the second electronic equipment according to first wireless broadcast signals received from the second electronic equipment, the first electronic equipment acquires first equipment identifiers of the second electronic equipment with the equipment angles meeting preset conditions, the first electronic equipment broadcasts second wireless broadcast signals containing the first equipment identifiers, second electronic equipment with the second equipment identifiers matched with the first equipment identifiers in the received second wireless broadcast signals in the second electronic equipment responds to instructions sent by users of the first electronic equipment, and therefore directional control of the electronic equipment is achieved.

Description

Method for directionally controlling electronic device, electronic device and readable medium
Technical Field
The present application relates to the field of intelligent devices, and in particular, to a method for directionally controlling an electronic device, and a readable medium.
Background
With the continuous development of intelligent technology, intelligent devices such as intelligent sound boxes, intelligent televisions, intelligent air conditioners, intelligent refrigerators, intelligent bracelets, intelligent watches, intelligent glasses and the like are increasingly entering households. The user may interact with the smart device in a variety of ways, such as voice, gestures, face recognition, etc. With the increase of intelligent devices in families, instructions sent by users are often acquired and respectively responded by a plurality of intelligent devices, so that user experience problems are brought. Taking the user instruction as a voice instruction as an example, as shown in fig. 1 (a) and 1 (b), the user issues a voice instruction "small skill, how is the weather the present day? ", three intelligent devices around: the television, the sound box A and the sound box B all receive the voice command and respectively respond to the voice, and the user cannot hear the content of the voice response clearly due to the voice responses, so that the user experience is poor.
Disclosure of Invention
The embodiment of the application provides a method for directionally controlling electronic equipment, which can obtain the equipment angle between the electronic equipment and the controlled electronic equipment by receiving a wireless broadcast signal of the controlled electronic equipment, and further inform the controlled electronic equipment of which the equipment angle meets the preset condition to respond to a user instruction, so that the directional control of the controlled electronic equipment is realized.
In a first aspect, an embodiment of the present application provides a method for directionally controlling an electronic device, where the method includes:
the first electronic device determines device angles between the first electronic device and the second electronic devices according to first wireless broadcast signals received from the second electronic devices; the first electronic equipment acquires a first equipment identifier of second electronic equipment with the equipment angle meeting a preset condition; the first electronic device broadcasts a second wireless broadcast signal containing a first device identification; and responding to the instruction sent by the user of the first electronic device by the second electronic device with the second device identification of the second electronic devices matched with the first device identification in the received second wireless broadcast signal. The first electronic device determines the device angle between the first electronic device and the second electronic device by receiving a first wireless broadcast signal from the second electronic device, and broadcasts the device identification of the second electronic device with the device angle meeting the preset condition, so that the second electronic device matched with the broadcasted device identification responds to the user instruction, and the user realizes the directional control on the second electronic device by pointing the first electronic device to the second electronic device.
In a possible implementation of the first aspect, the method further includes:
the first electronic device comprises an antenna array comprising at least two antennas.
In a possible implementation of the first aspect, the method further includes:
the device angle is an angle between an antenna array face of the first electronic device and the received first wireless broadcast signal.
In a possible implementation of the first aspect, the method further includes:
the first electronic device determining a device angle with the plurality of second electronic devices based on the first wireless broadcast signals received from the plurality of second electronic devices, comprising:
the first electronic device determines a device angle between the first electronic device and the plurality of second electronic devices according to angle-of-arrival information obtained when the first wireless broadcast signals from the plurality of second electronic devices are received.
In a possible implementation of the first aspect, the method further includes:
the angle of arrival information includes at least one of the following information: antenna spacing, phase difference when the radio broadcast signal reaches different antennas, wavelength of the radio broadcast signal.
In a possible implementation of the first aspect, the method further includes:
The device angle θ between the first electronic device and the plurality of second electronic devices is calculated using the following formula:
θ=arccos(ψλ/2πd),
where d denotes an antenna pitch, ψ denotes a phase difference when a radio broadcast signal arrives at different antennas, and λ denotes a wavelength of the radio broadcast signal.
In a possible implementation of the first aspect, the method further includes:
the wireless broadcast signal is a Bluetooth signal or a Bluetooth low power consumption signal.
In a possible implementation of the first aspect, the method further includes:
the first device identification or the second device identification comprises at least one of the following: hardware identification code or network address.
In a possible implementation of the first aspect, the method further includes:
the preset conditions include at least one of the following: a fixed value, a range of values, or a range of values centered around a fixed value.
In a possible implementation of the first aspect, the method further includes:
the first electronic device comprises a main processor and a coprocessor, and the first electronic device uses the coprocessor to complete the following steps when the main processor is in a sleep state:
determining a device angle with the plurality of second electronic devices based on the first wireless broadcast signals received from the plurality of second electronic devices;
Acquiring a first equipment identifier of a second electronic equipment with an equipment angle meeting a preset condition;
a second wireless broadcast signal containing the first device identification is broadcast.
In a possible implementation of the first aspect, the method further includes:
the instruction sent by the user at least comprises one of the following:
a voice instruction; a limb instruction. The limb instruction can be a gesture instruction, a human body gesture instruction, a facial expression instruction and the like sent by a user.
In a possible implementation of the first aspect, the method further includes:
the response of the second electronic device to the instruction sent by the user at least comprises one of the following:
response speech; and executing corresponding operation. The corresponding operation can be specifically power off, power on, temperature rise of an air conditioner, volume adjustment of a sound box and the like.
In a possible implementation of the first aspect, the method further includes:
the first electronic equipment is a mobile terminal, and the second electronic equipment is intelligent household equipment.
In a second aspect, embodiments of the present application provide a machine-readable medium having stored thereon instructions which, when executed on a machine, cause the machine to perform any one of the possible methods of the first aspect described above.
In a third aspect, an embodiment of the present application provides an electronic device, including: a memory for storing instructions for execution by one or more processors of the system, and the processor, which is one of the processors of the system, for performing any one of the possible methods of the first aspect described above.
In a fourth aspect, an embodiment of the present application provides an electronic device having a function of implementing the method for directionally controlling an electronic device described above. The functions may be implemented by hardware, or may be implemented by hardware executing corresponding software. The hardware or software includes one or more units corresponding to the above functions.
Drawings
Fig. 1 (a), 1 (b) illustrate a scenario in which a user interacts with multiple smart devices through voice instructions, according to some embodiments of the application.
Fig. 2 (a), fig. 2 (b), fig. 2 (c) illustrate a scenario in which a user performs directional control on an intelligent device through a voice command in the current scheme according to some embodiments of the present application.
Fig. 3 illustrates a scenario 10 of directional control of an electronic device, according to some embodiments of the application.
Fig. 4 (a), fig. 4 (b), and fig. 4 (c) illustrate a scenario in which a user performs directional control on an intelligent device through a voice command according to some embodiments of the present application.
Fig. 5 illustrates a schematic diagram of a cell phone 100, according to some embodiments of the application.
FIG. 6 illustrates an interactive flow chart of a method of directionally controlling an electronic device, according to some embodiments of the application.
Fig. 7 illustrates a scenario in which an electronic device transmits a bluetooth broadcast signal to a handset 100, according to some embodiments of the application.
Fig. 8 illustrates a scenario in which a transmitting device transmits bluetooth signals to be received by different antennas of a receiving device, according to some embodiments of the present application.
Fig. 9 (a) shows a corresponding plot of bluetooth signal wavelength versus phase, according to some embodiments of the application.
Fig. 9 (b) is a schematic waveform diagram illustrating bluetooth signals received by different antennas according to some embodiments of the present application.
Fig. 10 is a schematic diagram illustrating an angle between a bluetooth broadcast signal transmitted by an electronic device and an antenna of a mobile phone 100 according to some embodiments of the present application.
Fig. 11 is a schematic diagram showing the device angle when the mobile phone 100 is pointing to the speaker 200 according to some embodiments of the present application.
Fig. 12 is a schematic diagram illustrating a structure of a bluetooth broadcast signal transmitted by the mobile phone 100 according to some embodiments of the present application.
Fig. 13 illustrates a scenario in which a handset 100 transmits a bluetooth broadcast signal to an electronic device, according to some embodiments of the application.
Fig. 14 (a), 14 (b) illustrate a scenario in which a user sends a device identification of an electronic device to which the handset 100 is directed by a trigger operation, according to some embodiments of the application.
Fig. 15 (a), 15 (b) shows an interactive flow diagram for the processor 110 of the handset 100 to control the on/off of the directional control function in the co-processor 111, according to some embodiments of the application.
Fig. 16 is a schematic diagram showing the structure of the constituent modules of the coprocessor 111 in the mobile phone 100 according to some embodiments of the present application.
Fig. 17 illustrates an interactive flow diagram for turning off a voice system in the co-processor 111 of the handset 100, according to some embodiments of the application.
Detailed Description
Illustrative embodiments of the present application include, but are not limited to, a method of directionally controlling an electronic device, and a readable medium for solving the problem of difficulty in controlling a particular smart device in an environment where multiple smart devices exist.
It will be understood that the terms "first," "second," and the like, as used herein, may be used to describe various elements, but these elements are not limited by these terms unless otherwise specified. These terms are only used to distinguish one element from another element.
Embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
Some schemes can realize response control on the intelligent device through schemes such as sound intensity, labels, combination of sound intensity and labels, and the like, but the schemes still have possible interference so that the intelligent device responding is not the intelligent device desired by a user, and accurate control on the intelligent device is difficult to realize. As shown in fig. 2 (a), a scheme for implementing response control on the intelligent device through sound intensity is shown, in the scene shown in fig. 2 (a), a user hopes that the intelligent television with a longer distance and a smaller pick-up sound intensity responds, and a voice command sent by the user is actually responded by the intelligent sound box with a shorter distance and a larger pick-up sound intensity, so that user experience is affected. For another example, fig. 2 (B) shows a scheme of implementing response control on the smart device through a tag, in the scenario shown in fig. 2 (B), a user wants to respond by one of the sound box a or the sound box B, and since the sound box a and the sound box B belong to the same type of smart device, the corresponding tags are the same, and a voice instruction sent by the user actually responds by the sound box a and the sound box B with the same tag, which also has a problem of user experience. Fig. 2 (c) shows a scheme of implementing response control on the smart device by combining sound intensity and a tag, in the scenario shown in fig. 2 (c), the user wants to respond by one of the sound box a or the sound box B, while the sound intensity received by the sound box a and the sound box B with the same tag is similar to that received by the user at a distance from the user, so that the voice command sent by the user is actually still responded by the sound box a and the sound box B, and the user experience is also affected.
Fig. 3 illustrates a scenario 10 of a directional control electronic device, according to some embodiments of the application. Specifically, as shown in fig. 3, a first electronic device 100, a second electronic device 200, and a third electronic device 300 are included in the scene 10. Wherein the first electronic device 100 may be directed to the second electronic device 200 when the user wants to interact with the second electronic device 200 by voice instructions. The first electronic device 100 can calculate the device angles between the first electronic device 100 and the second electronic device 200 and the third electronic device 300 according to the wireless broadcast signals sent by the second electronic device 200 and the third electronic device 300, where, as shown in fig. 8, the device angle between the first electronic device 100 and the second electronic device 200 is the angle between the antenna array surface of the first electronic device 100 and the received wireless broadcast signal sent by the second electronic device 200, and the device angle between the first electronic device 100 and the third electronic device 300 is the angle between the antenna array surface of the first electronic device 100 and the received wireless broadcast signal sent by the third electronic device 300.
When the user points the first electronic device 100 at the second electronic device 200, the first electronic device 100 detects a device angle of 95 ° with the second electronic device 200 and an angle of 15 ° with the third electronic device 300. The first electronic device 100 uses the device identification AOA ID2 of the second electronic device 200 included in the received wireless broadcast signal transmitted by the second electronic device 200 as the first device identification, and includes the first device identification in the second wireless broadcast signal to transmit. And after the second electronic device 200 receives the second wireless broadcast signal, comparing the device identifier of the second electronic device 200 with the first device identifier in the second wireless broadcast signal, and under the condition that the comparison is the same, performing corresponding voice response on the voice command of the user by the second electronic device 200. The third electronic device 300 does not respond to the voice command of the user number because the device identifier of the third electronic device 300 is different from the first device identifier in the received second wireless broadcast signal.
Thus, in the embodiment of the present application, the user may designate the second electronic device 200 to respond to the voice command of the user by pointing the first electronic device 100 to the second electronic device 200 that wants to respond, and the third electronic device 300 that is not designated by the user through the first electronic device 100 will not respond to the voice command of the user even if receiving the voice of the user, thereby realizing the accurate control of the user on the electronic device that wants to respond.
It will be appreciated that the technical solution of the present application is not only suitable for voice interaction, but also suitable for video interaction, for example, when the first electronic device 100 points to the second electronic device 200, the user uses a shake gesture to issue a weather inquiry command.
In the following, referring to the scenario in fig. 4 (a) to 4 (c), taking the first electronic device 100 as a mobile phone, taking the second electronic device 200 as a sound box, and taking the third electronic device 300 as a television, further explaining that, as shown in fig. 4 (a), the user directs the mobile phone 100 to the television 300 and sends out a voice control instruction "small skill, i want to watch the piggy peth", because the device angle between the television 300 and the mobile phone 100 satisfies the preset condition, even if the user is closer to the sound box 200 and further away from the television 300, the user performs voice response by the television 300, and now plays the piggy peth "for your, and performs subsequent response processing, thereby overcoming the problem of the existing sound intensity scheme. Further describing the second electronic device 200 as the speaker a and the fourth electronic device 201 added in the scene as the speaker B, as shown in fig. 4 (B), the user directs the mobile phone 100 to the speaker a 200 and sends out a voice command "small skill and artistic skill", how is the weather today? Because the equipment angle between the sound box A200 and the mobile phone 100 meets the preset condition, even if the sound box A200 and the sound box B201 are the same type of electronic equipment, the sound box A200 performs voice response on the voice command of the user, namely the sound box A200 responds to the voice command of the user in the weather XX and the temperature XX today, so that the problem that the sound box A and the sound box B respond to the voice command of the user simultaneously in the existing label scheme is solved.
In addition, there may be not only two electronic devices but also two or more in the figure. For example, in the scenario shown in fig. 4 (c), the second electronic device 200, the fourth electronic device 201, and the third electronic device 300 may be included. Further describing the second electronic device 200 as the speaker a, the fourth electronic device 201 as the speaker B, and the third electronic device 300 as the television, as shown in fig. 4 (c), the user directs the mobile phone 100 to the speaker a 200 and issues a voice control instruction "small skill and small skill", how is the weather today? Because the equipment angle between the sound box A200 and the mobile phone 100 meets the preset condition, even if the television 300 is close and the sound box A200 and the sound box B201 are far, the sound box A200 and the sound box B201 are the same type of electronic equipment, and the sound box A200 is used for performing voice response on the voice command of the user as the weather XX and the temperature XX today, so that the problem that the sound box A200 and the sound box B201 simultaneously respond to the voice command of the user in the existing sound intensity and label scheme is solved.
It is understood that in embodiments of the present application, the second electronic device 200 and the third electronic device 300 may include, but are not limited to: intelligent household equipment such as intelligent television, intelligent audio amplifier, intelligent wrist-watch, intelligent bracelet, intelligent refrigerator, intelligent air conditioner.
It is understood that in embodiments of the present application, the first electronic device 100 may include, but is not limited to: a cell phone, tablet, wearable device, portable game, portable music player, reader device, or other electronic device having an antenna array. In the following description, for simplicity of explanation, the technical solution of the present application is illustrated by taking the first electronic device 100 as a mobile phone and taking the user control instruction as a voice instruction.
Fig. 5 is a schematic structural diagram of a mobile phone 100 according to some embodiments of the present application, where the mobile phone 100 may be configured to receive wireless broadcast signals sent by a plurality of smart devices, determine device angles between the mobile phone 100 and the plurality of smart devices according to angle-of-arrival information obtained when the wireless broadcast signals are received, and send a wireless broadcast signal including a device identifier of a certain smart device in response to a triggering operation of a user, where the device angles between the smart device and the mobile phone 100 satisfy a preset condition, so that the smart device can respond to a control instruction of the user.
Specifically, as shown in fig. 5, the mobile phone 100 may include a processor 110, a coprocessor 111, a wireless communication module 120, a mobile communication module 130, a power module 140, an audio module 150, an interface module 160, a camera 170, a memory 180, a sensor module 190, keys 101, a display screen 102, and the like.
It should be understood that the structure illustrated in the embodiments of the present application is not limited to the specific embodiment of the mobile phone 100. In other embodiments of the application, the handset 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 110 may include one or more processing units, for example, processing modules or processing circuits that may include a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a digital signal processor (Digital Signal Processing, DSP), a microprocessor (Micro-programmed Control Unit, MCU), an artificial intelligence (Artificial Intelligence, AI) processor, or a programmable logic device (Field Programmable Gate Array, FPGA), or the like. Wherein the different processing units may be separate devices or may be integrated in one or more processors. A memory unit may be provided in the processor 110 for storing instructions and data. In some embodiments, the storage unit in the processor 110 is a cache 180.
Coprocessor 111 is a processor that assists a processor in performing certain tasks and may include control means for controlling the execution of instructions in the coprocessor, execution means for coprocessor-related instructions, and storage means for storing data during execution of coprocessor instructions. In an embodiment of the present application, the co-processor 111 may be used to control the wireless communication module 120 to implement wireless broadcasting and wireless scanning, thereby implementing directional control of the electronic device in the case that the processor 110 is asleep. In an embodiment of the application, the coprocessor may also process related data of bluetooth communication, in particular related data of BLE communication.
The wireless communication module 120 may include an antenna array 1, and implement transmission and reception of electromagnetic waves via the antenna array 1. In the embodiment of the present application, the wireless communication module 120 receives the wireless broadcast signal sent by the electronic device through the antenna array 1, and determines the angle of arrival information according to the differences between the wireless broadcast signals received by different antennas in the antenna array 1. The wireless communication module 120 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN), wireless fidelity (wireless fidelity, wi-Fi) network, bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc. applied to the mobile phone 100. The handset 100 may communicate with a network and other devices via wireless communication technology.
The mobile communication module 130 may include, but is not limited to, an antenna array 2, a power amplifier, a filter, a low noise amplifier (Low noise amplify, LNA), etc. The mobile communication module 130 may provide a solution for wireless communication including 2G/3G/4G/5G, etc. applied to the handset 100. The mobile communication module 130 may receive electromagnetic waves from an antenna, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to a modem processor for demodulation. The mobile communication module 130 may amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 130 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 130 may be disposed in the same device as at least some of the modules of the processor 110.
In some embodiments, the mobile communication module 130 and the wireless communication module 120 of the handset 100 may also be located in the same module.
The power module 140 may include a power source, a power management component, and the like. The power source may be a battery. The power management component is used for managing the charging of the power supply and the power supply supplying of the power supply to other modules.
The display screen 102 is used for displaying human-computer interaction interfaces, images, videos, and the like. The display screen 102 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (flex), a Mini LED, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like.
The sensor module 190 may include a proximity light sensor, a pressure sensor, a gyroscope sensor, a barometric sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like. In an embodiment of the present application, the sensor module 190 may be used to detect a triggering operation by a user. For example, the user operates to shake the cellular phone 100 so as to be detected by the acceleration sensor.
The audio module 150 is used to convert digital audio information into an analog audio signal output, or to convert an analog audio input into a digital audio signal. The audio module 150 may also be used to encode and decode audio signals. In some embodiments, the audio module 150 may be disposed in the processor 110, or some functional modules of the audio module 150 may be disposed in the processor 110. In some embodiments, the audio module 150 may include a speaker, an earpiece, a microphone, and an earphone interface. In an embodiment of the present application, the audio module 150 may be turned off when the user issues a voice command to avoid possible interference. In the scenario shown in fig. 3, after the mobile phone 100 sends out the wireless broadcast signal including the device identifier of the second electronic device 200, the audio module 150 of the mobile phone 100 is turned off, so as to avoid interfering with the voice command sent by the user next.
The camera 170 is used to capture still images or video. An optical image of the object generated by the lens is projected onto the photosensitive element. The photosensitive element converts the optical signal into an electrical signal, which is then passed to an image signal processor (Image Signal Processor, ISP) for conversion into a digital image signal. The handset 10 may implement shooting functions through an ISP, a camera 170, a video codec, a graphics processor (Graphic Processing Unit, GPU), a display screen 102, an application processor, and the like.
The interface module 160 includes an external memory interface, a universal serial bus (universal serial bus, USB) interface, a subscriber identity module (subscriber identification module, SIM) card interface, and the like. Wherein the external memory interface may be used to connect an external memory card, such as a Micro SD card, to extend the memory capabilities of the handset 10. The external memory card communicates with the processor 110 through an external memory interface to implement data storage functions. The universal serial bus interface is used for communication between the handset 10 and other electronic devices. The subscriber identity module card interface is used to communicate with a SIM card mounted to the handset 1010, for example, by reading a telephone number stored in the SIM card or by writing a telephone number to the SIM card.
In some embodiments, the handset 100 further includes keys 101, motors, indicators, and the like. The key 101 may include a volume key, an on/off key, and the like. The motor is used to generate a vibration effect on the mobile phone 100, for example, when the mobile phone 100 of the user is called, so as to prompt the user to answer the incoming call of the mobile phone 100. The indicators may include laser indicators, radio frequency indicators, LED indicators, and the like.
The following describes the technical scheme of the present application in detail based on the structure shown in fig. 5 and according to fig. 6 in combination with a specific scenario. In the embodiment shown in fig. 6, the second electronic device 200 is exemplified by a sound box, and the third electronic device 300 is exemplified by a television. Further, in this embodiment, in order to reduce the overall power consumption, wireless scanning and wireless broadcasting of the mobile phone 100 are handled by the coprocessor 111 while the processor 110 is in a sleep state.
As shown in fig. 6, the scheme of the directional control electronic device of the present application includes:
in step S601, the mobile phone 100 initiates wireless scanning. The wireless scanning is used for receiving a wireless broadcast signal sent by an external electronic device, and before the mobile phone 100 initiates the wireless scanning, the mobile phone 100 does not receive the wireless broadcast signal sent by the electronic device, such as the speaker 200 or the television 300.
In some embodiments of the present application, the mobile phone 100 may perform wireless scanning through a bluetooth communication module or a bluetooth low energy communication module to receive a bluetooth broadcast signal sent by an external electronic device. Here, the bluetooth communication module or the bluetooth low energy communication module may be used for communication via bluetooth as well as Bluetooth Low Energy (BLE). The term "bluetooth" has its full scope of ordinary meaning and includes at least any of the various implementations of the existing bluetooth standard, including Bluetooth Low Energy (BLE), including future implementations of the bluetooth standard, and the like. For example, the bluetooth connection comprises a bluetooth connection based on the bluetooth protocol 4.X, e.g. 4.2, or comprises a bluetooth connection based on the bluetooth protocol 5.X, e.g. 5.0. In addition, the bluetooth connection may also include Bluetooth Low Energy (BLE). BLE aims at significantly reducing power consumption and cost compared to classical bluetooth, while maintaining a similar communication range as classical bluetooth. In some embodiments the bluetooth communication module may additionally be incorporated in other communication modules, such as modules for Wi-Fi or WLAN (e.g. 802.11) communication, etc. For simplicity, only the application of BLE technology in various embodiments is described below, it being understood that classical bluetooth, wi-Fi, and other short-range communication technologies may be applied in various embodiments of the present application.
In some embodiments of the present application, the coprocessor 111 in the mobile phone 100 sends a bluetooth scan instruction to the bluetooth communication module or the bluetooth low energy communication module, so that the bluetooth communication module or the bluetooth low energy communication module completes receiving the bluetooth broadcast signal sent by the smart device. The use of the co-processor 111 to perform bluetooth scanning while the processor 110 of the handset 100 is in a sleep state can greatly reduce the power consumption of the handset 100.
Here, the coprocessor 111 includes a bluetooth protocol stack and a bluetooth driver. The bluetooth protocol stack and bluetooth driver in the coprocessor 111 are formed by transplanting at least part of the functions of the bluetooth protocol stack and bluetooth driver running on the processor 110 to the coprocessor 111 in a code-transplanting manner, such as bluetooth broadcasting (ADV), bluetooth Scanning (Scanning), etc. The bluetooth protocol stack in the co-processor 111 may perform the corresponding bluetooth protocol of broadcasting and scanning and the bluetooth driver may include part or all of the driver that drives the bluetooth communication module.
In some embodiments, the bluetooth protocol stack in coprocessor 111 is provided with the same security protocol as the bluetooth protocol stack of processor 110, so that data security for bluetooth communications via coprocessor 111 may be protected by the bluetooth security protocol.
In addition, the bluetooth communication module and the coprocessor 111 perform data transmission through a built-in integrated circuit (Inter Integrated Circuit, I2C) or a modified built-in integrated circuit (Improved Inter Integrated Circuit, I3C). The I2C interface is a bi-directional synchronous Serial bus, comprising a Serial Data Line (SDA) and a Serial clock Line (Serial Clock Line, SCL). I3C is an improvement over I2C, which is compatible with the I2C protocol and fuses the advantages of I2C (two-wire, simple) with SPI (low power consumption, high speed).
Step S602 and step S603, the speaker 200 and the television 300 respectively transmit wireless broadcast signals.
For example, the speaker 200 and the television 300 periodically transmit wireless broadcast signals, and the transmission time interval may be set according to the needs of the user or set at the time of shipment, for example, 5 seconds or 10 seconds.
In some embodiments of the present application, the speaker 200 and the television 300 respectively send bluetooth broadcast signals, where the bluetooth broadcast signals sent by the speaker 200 include a device identifier of the speaker 200, and the bluetooth broadcast signals sent by the television 300 include a device identifier of the television 300, where the device identifier is used to uniquely identify a corresponding electronic device, and the device identifier may be, for example, a hardware identifier corresponding to the electronic device, or a network address corresponding to the electronic device, etc., and the mobile phone 100 receives, through a bluetooth communication module or a bluetooth low energy communication module, the bluetooth broadcast signals sent by the speaker 200 and the television 300 and uploads the bluetooth broadcast signals to the coprocessor 111.
Fig. 7 shows a scenario in which an electronic device transmits a bluetooth broadcast signal to a mobile phone 100. As shown in fig. 7, the second electronic device is a television 300, the third electronic device is a speaker 200, the device identifier is a wave arrival angle identifier, the television 300 and the speaker 200 respectively control the bluetooth communication module or the bluetooth low energy communication module to send bluetooth broadcast signals through the processor, the bluetooth broadcast signals respectively include device identifiers AOA ID1 and AOA ID2, and the mobile phone 100 receives the bluetooth broadcast signals through the bluetooth communication module or the bluetooth low energy communication module that performs bluetooth scanning and transmits the bluetooth broadcast signals to the coprocessor 111.
It can be understood that the bluetooth broadcast signals sent by the sound box 200 and the television 300 may be broadcast data sent by using a common bluetooth protocol, or broadcast data sent by using a bluetooth low energy protocol, which bluetooth protocol is used in particular, and the embodiment of the present application is not limited in particular.
In step S604, the mobile phone 100 determines corresponding angle of arrival information of each electronic device according to the wireless broadcast signals received from each electronic device. The angle of arrival information indicates information about an angle of arrival of a wireless broadcast signal transmitted from the electronic device when the wireless broadcast signal arrives at the mobile phone 100, such as an antenna distance d, a phase difference ψ when the wireless broadcast signal arrives at a different antenna, and a wavelength λ of the wireless broadcast signal. The distance difference between the wireless broadcast signal and different antennas of the mobile phone 100 can be calculated through the angle of arrival information, and then the equipment angle between the mobile phone 100 and the electronic equipment can be obtained through the distance difference.
Here, the mobile phone 100 receives the radio broadcast signals transmitted from the speaker 200 and the television 300, respectively, and determines the angle of arrival information of the radio broadcast signal transmitted from the speaker 200 and the angle of arrival information of the radio broadcast signal transmitted from the speaker 200 television 300 based on the arrival of these radio broadcast signals at the antenna array of the mobile phone 100.
It can be understood that only two electronic devices are shown in fig. 6, but the number of electronic devices in fig. 6 cannot be used as a limitation of the number of electronic devices in the embodiment of the present application, and the mobile phone 100 may receive wireless broadcast signals of two or more electronic devices.
In some embodiments of the present application, the mobile phone 100 receives a bluetooth broadcast signal sent by the sound box 200 or the television 300 through the bluetooth communication module or the bluetooth low energy communication module, and determines corresponding angle of arrival information according to the received bluetooth broadcast signal. In some embodiments, the angle of arrival information includes, but is not limited to, the following: antenna spacing d, phase difference ψ when the bluetooth broadcast signal arrives at the different antennas, and bluetooth signal wavelength λ.
Here, the antenna pitch refers to a pitch between different antennas in an antenna array of the mobile phone 100. The phase difference ψ refers to the phase difference between bluetooth signals received by different antennas in the antenna array. Fig. 8 shows a scenario in which a bluetooth signal transmitted by a transmitting device is received by different antennas in an antenna array of a receiving device, as shown in fig. 8, the transmitting device transmits a bluetooth broadcast signal through the antennas, the receiving device receives the bluetooth broadcast signal through the antenna array, and a distance d exists between the different antennas in the antenna array, so that the distance traveled by the bluetooth broadcast signal transmitted by the antenna of the transmitting device to the different antennas of the receiving device in the form of electromagnetic waves is different, and therefore, phases of the bluetooth signals received by the different antennas in the antenna array of the receiving device are also different, and a phase difference ψ exists between the phases.
Further, fig. 9 (a) shows a correspondence diagram of bluetooth signal wavelength and phase, λ being the wavelength of the bluetooth signal, and a signal of one wavelength corresponding to a phase of 0 to 2pi. As described above, since the distance between the transmitting device and the different antennas is not uniform, the phases of bluetooth signals received by the different antennas are different. For example, fig. 9 (b) shows waveforms of bluetooth signals received by the antennas 1 and 2 with a distance d, and as shown in fig. 9 (b), the phase of the bluetooth signal received by the antenna 1 is ψ 1 The phase ψ of a bluetooth signal received by the antenna 2 2 The phase difference between the two antennas is ψ=ψ 12 According to the corresponding relation between the wavelength and the phase, the distance difference s=ψλ/2pi between the bluetooth signals received by the antenna 1 and the antenna 2 can be obtained. And obtaining the equipment angle theta=arccos (psi lambda/2 pi d) according to the trigonometric function relation.
In some embodiments of the present application, the bluetooth communication module or the bluetooth low energy communication module may determine the phase difference ψ and the bluetooth signal wavelength λ by receiving bluetooth data sent by the sending device, and send the phase difference ψ and the bluetooth signal wavelength λ together with a known antenna distance d to the coprocessor 111 in the mobile phone 100, and perform subsequent processing by the coprocessor 111, so as to avoid that sending these information to the processor 110 leads to waking up the processor 110, and reduce the overall power consumption of the mobile phone 100.
Step S605, the mobile phone 100 determines the device angle between the mobile phone 100 and the sound box 200, the television 300 according to the angle of arrival information.
Here, after the wireless broadcast signal sent by the sound box 200 arrives at the mobile phone 100, the mobile phone 100 obtains the angle of arrival information corresponding to the sound box 200, and after the wireless broadcast signal sent by the television 300 arrives at the mobile phone 100, the mobile phone 100 obtains the angle of arrival information corresponding to the television 300, and the mobile phone 100 uses the coprocessor 111 to calculate the angle of arrival information corresponding to the sound box 200 and the angle of arrival information corresponding to the television 300, respectively, so as to obtain the equipment angle between the mobile phone 100 and the sound box 200 and the equipment angle between the mobile phone 100 and the television 300.
With continued reference to fig. 8, cos (θ) =s/d=ψλ/2ρd can be obtained from the distance difference s and the antenna distance d, θ is the device angle of the receiving device with respect to the transmitting device, so the calculation formula of θ can be obtained as follows:
θ=arccos(ψλ/2πd)。
here, the device angle of the receiving device with respect to the transmitting device is an azimuth angle, that is, an angle between an antenna array surface of the receiving device and the received signal, the antenna array surface being a plane formed by the tips of a plurality of antennas in the antenna array.
Fig. 10 shows a scenario in which the mobile phone 100 calculates the device angles from the received bluetooth broadcast signals, respectively. As shown in fig. 10, the third electronic device is a television 300, the second electronic device is a speaker 200, the television 300 and the speaker 200 periodically broadcast bluetooth signals outwards, the bluetooth broadcast signals sent by the television 300 include an equipment identifier AOA ID1 of the television 300, the bluetooth broadcast signals sent by the speaker 200 include an equipment identifier AOA ID2 of the speaker 200, and the mobile phone 100 is provided with an antenna array. The mobile phone 100 receives the bluetooth broadcast signal from the television 300 or the loudspeaker box 200 when the processor 110 sleeps, and transmits the angle of arrival information obtained when receiving the bluetooth broadcast signal to the coprocessor 111, and the coprocessor 111 calculates the device angle θ between the mobile phone 100 and the television 300 respectively 1 And the device angle theta between the mobile phone 100 and the sound box 200 2
In step S606, the mobile phone 100 determines the device identifier of the electronic device pointed by the mobile phone 100 according to the device angle. Here, the electronic device to which the mobile phone 100 points specifically refers to an electronic device to which the antenna array of the mobile phone 100 points. In addition, the mobile phone 100 obtains corresponding angle of arrival information according to the device angle, and obtains the device identifier included in the corresponding wireless broadcast signal according to the angle of arrival information.
Fig. 11 shows a scenario in which a user directs the mobile phone 100 to an electronic device, as shown in fig. 11, the user directs the mobile phone 100 to the sound box 200, the mobile phone 100 receives bluetooth broadcast signals sent by the television 300 and the sound box 200 and determines corresponding angle of arrival information under the condition that the processor 110 sleeps, and the coprocessor 111 calculates the device angle θ between the mobile phone 100 and the television 300 according to the corresponding angle of arrival information 1 And the device angle theta between the mobile phone 100 and the sound box 200 2 ,θ 2 About 90.
In some embodiments of the present application, the coprocessor 111 in the mobile phone 100 checks whether the calculated device angle meets a preset condition, and determines an electronic device corresponding to the device angle as an electronic device pointed by the mobile phone 100 when the device angle meets the preset condition, and a device identifier of the electronic device pointed by the mobile phone 100 is a device identifier of the electronic device.
Here, the preset conditions may include, but are not limited to, the following: a fixed value, a range of values centered around a fixed value, or the like. For example, the preset condition may be a fixed angle value such as 90 °, a value range such as [80 °,100 ° ], or a value range of ±15° centered on 90 °.
With continued reference to FIG. 11, the preset condition is set such that the device angle is at [80 ], 100 °]In (2), due to the equipment angle theta between the mobile phone 100 and the sound box 200 2 About 90 degrees, so that the preset condition is met, and the mobile phone 100 takes the equipment identifier AOA ID2 of the sound box 200 as the equipment identifier of the electronic equipment pointed by the mobile phone 100; device angle θ between handset 100 and television 300 1 The preset condition is obviously not satisfied, so the mobile phone 100 will not use the device identifier AOA ID1 of the television 300 as the device identifier of the electronic device to which the mobile phone 100 points.
In some embodiments of the present application, there may be two or more electronic devices whose device angles with the mobile phone 100 satisfy the preset conditions, where the mobile phone 100 may use the device identifiers of the two or more electronic devices as candidates for the device identifiers of the electronic devices pointed by the mobile phone 100, and then determine one device identifier from the candidate device identifiers. For example, the mobile phone 100 may determine the device identifier according to the size of the device angle, determine the device identifier of the electronic device corresponding to the maximum device angle as the device identifier of the electronic device pointed by the mobile phone 100, where the maximum device angle between the mobile phone 100 and the electronic device indicates that the distance between the pointed direction of the mobile phone 100 and the electronic device is the minimum.
Step S607, the coprocessor 111 in the mobile phone 100 detects the user operation, compares the user operation with the preset trigger operation of the user, and if the user operation is inconsistent with the preset trigger operation of the user, continues to detect the user operation; if the user operation coincides with the preset trigger operation of the user, step S608 is performed.
In some embodiments of the present application, the triggering operation preset by the user may include, but is not limited to: sensor triggering operations, screen touch operations, etc. The sensor triggering operation is related operations that can trigger a sensor on the mobile phone 100, such as a frame of the mobile phone 100 being re-held, the mobile phone 100 being rocked, and the like. The screen touch operation is a variety of touch operations performed on the screen of the mobile phone 100, such as clicking a preset screen area with a finger, sliding a finger on the preset screen area, sliding a plurality of fingers on the screen, and the like.
In step S608, the mobile phone 100 transmits the wireless broadcast signal containing the device identifier, which is the device identifier of the electronic device to which the mobile phone 100 points, and since the mobile phone 100 transmits the broadcast data, both the speaker 200 and the television 300 can receive the wireless broadcast signal containing the device identifier.
With continued reference to fig. 11, in this scenario, the device identifier of the electronic device to which the mobile phone 100 points is the device identifier AOA ID2 of the speaker 200, so the wireless broadcast signal sent by the mobile phone 100 includes the device identifier AOA ID2 of the speaker 200.
In some embodiments of the present application, the co-processor 111 of the mobile phone 100 transmits a bluetooth broadcast signal through a bluetooth communication module or a bluetooth low energy communication module. The coprocessor 111 transmits a bluetooth broadcast command to the bluetooth communication module or the bluetooth low energy communication module, and simultaneously transmits a device identifier of the intelligent device to which the mobile phone 100 is directed, and the bluetooth communication module or the bluetooth low energy communication module generates a bluetooth broadcast signal according to the received bluetooth broadcast command and the device identifier of the electronic device to which the mobile phone 100 is directed and transmits the bluetooth broadcast signal.
In some embodiments of the present application, the bluetooth broadcast signal sent by the mobile phone 100 includes a bluetooth preamble or a bluetooth low energy preamble in addition to the device identifier of the electronic device to which the mobile phone 100 points.
Fig. 12 shows the structure of a bluetooth broadcast signal transmitted by the mobile phone 100. As shown in fig. 12, the bluetooth broadcast signal includes a preamble, which is a field that must be included in the bluetooth broadcast, and a device identification, and a filter in the bluetooth scan can filter out the bluetooth broadcast signal that is not of interest through the preamble. The device identifier specifies a device identifier of the electronic device to which the mobile phone 100 points, and the electronic device may parse the device identifier after receiving the bluetooth broadcast signal.
Fig. 13 shows a scenario in which the handset 100 transmits a bluetooth broadcast signal to an electronic device. As shown in fig. 13, the coprocessor 111 of the mobile phone 100 transmits a bluetooth broadcast signal through a bluetooth communication module, the bluetooth broadcast signal includes a device identifier AOA ID1, and the television 300 and the speaker 200 receive the bluetooth broadcast signal through the bluetooth communication module and upload the bluetooth broadcast signal to various processors.
Step S609 and step S610, the loudspeaker box 200 and the television 300 respectively check the device identifier in the received wireless broadcast signal, that is, compare the device identifier from the wireless broadcast signal with the device identifier of itself, if they are consistent, the electronic device with consistent comparison result responds to the user instruction, that is, execute step S611; if not, the electronic device with inconsistent comparison results turns off the response to the user instruction, i.e. performs step S612.
In step S611, the sound box 200 enables its own response system to the user instruction so that it can respond to the user instruction.
In step S612, the television 300 turns off its own response system to the user command, avoiding responding to the user command.
Fig. 14 (a) and 14 (b) show a scenario in which a user transmits a device identification of an electronic device to which the mobile phone 100 is directed by a trigger operation. As shown in fig. 14 (a), the third electronic device is a television 300, the second electronic device is an intelligent speaker, the electronic device pointed by the mobile phone 100 is a speaker 200, the device identifier of the speaker 200 is AOA ID2, and the user performs a triggering operation to enable the mobile phone 100 to send a bluetooth broadcast signal containing the device identifier AOA ID2 under the condition that the processor 110 is in sleep coprocessor operation.
The television 300 receives the bluetooth broadcast signal and parses out the device identifier AOA ID2 therein, and performs step S610 to compare the device identifier AOA ID2 with its own device identifier, and since the device identifier of the television 300 is AOA ID1, the two are inconsistent, so that the response of the television 300 to the user command, for example, the voice system is turned off, by performing step S612. And the sound box 200 receives the bluetooth broadcast signal and parses out the device identifier AOA ID2 therein, and performs step S609 to compare the device identifier AOA ID2 with its own device identifier, and since the device identifier of the sound box 200 is AOA ID2, the two are consistent, so that step S611 is performed to respond to the user instruction, for example, to enable the voice system of the sound box 200, that is, to enable the voice system of the sound box 200 if the voice system of the sound box 200 is in the off state, and to keep on if the voice system of the sound box 200 is in the on state, so as to enable the voice response to the user voice instruction. Subsequently, the user issues an instruction such as a voice instruction "small skill, how is the weather today? "the speaker 200 then makes a voice response to the voice command issued by the user" today's weather XX, temperature XX "as shown in fig. 14 (b).
In some embodiments of the present application, the closing of the response to the user command has a time period, and the response of the electronic device to the user command is restarted after the closing time exceeds a preset time period threshold. For example, in the above example, the voice response system of television 300 may be turned on again after turning off a preset time period threshold, such as 3 minutes.
In some embodiments of the application, the response of the electronic device to the user instruction may include, but is not limited to, the following: voice response, performing corresponding operations, etc. For example, operations performed by the electronic device may include, but are not limited to: shutdown, startup, air conditioning heating, sound box volume adjustment, and the like.
In some embodiments of the present application, the electronic device may also receive the user's instruction and respond correspondingly by using a video acquisition method. For example, an image of a limb of a user is acquired through a camera of the electronic device, and the image of the limb of the user is identified, so that an instruction sent by the user is obtained. The recognition of the image of the user's limb may include, but is not limited to, gesture recognition, face recognition, and the like. The instruction sent by the user can correspond to a preset human body gesture, gesture or facial expression and the like. After determining the instruction sent by the user, the electronic device responds according to the instruction of the user, for example, the responding mode is voice response.
In addition, in some embodiments of the present application, the processor 110 may control the on/off of the directional control function in the coprocessor 111, and after the directional control function in the coprocessor 111 is on, the user may control the electronic device by pointing the mobile phone to the electronic device, and after the directional control function in the coprocessor 111 is off, the user may not control the intelligent device by pointing the mobile phone to the electronic device.
Fig. 15 (a) and 15 (b) show the interaction flow of the processor 110 in the mobile phone 100 to control the on or off of the directional control function of the coprocessor 111. As shown in fig. 15 (a), the processor 110 sends an instruction for turning on the directional control function to the coprocessor 111, and the coprocessor 111 enables the directional control function after receiving the instruction for turning on, so that the coprocessor 111 can perform the related processing of directional control. The electronic device 200 periodically transmits a bluetooth broadcast signal, and the coprocessor 111 receives angle of arrival information related to the bluetooth broadcast signal uploaded by the bluetooth communication module or the bluetooth low energy communication module and performs a subsequent directional control process, such as calculation of a device angle, and transmits the bluetooth broadcast signal after detecting a user trigger operation. In addition, as shown in fig. 15 (b), in the mobile phone 100, the processor 110 sends a directional control function turning-off instruction to the coprocessor 111, and the coprocessor 111 turns off the directional control function after receiving the turning-off instruction, and even if a bluetooth broadcast signal sent by the electronic device 200 is received, the coprocessor 111 does not process the angle of arrival information of the bluetooth broadcast signal.
Fig. 16 shows a block diagram of a component module for implementing the directional control function in the coprocessor 111 of the mobile phone 100. As shown in fig. 16, the coprocessor 111 includes a trigger operation detection module, a plurality of modules implementing a directional control function, a communication module, and a voice system, and the modules implementing the directional control function include: the system comprises an enabling module, a calculating module, a processing module, a receiving module and a sending module.
The processor 110 in the mobile phone 100 controls the on/off of the directional control function by sending the directional control function on/off command to the enabling module in the coprocessor 111. The bluetooth communication module interacts with the communication module of the coprocessor 111 to report the angle of arrival information and generate and send bluetooth broadcast signals. The trigger operation detection module is used for detecting preset user trigger operation and transmitting data generated by the user trigger operation to the enabling module. The communication module is used for realizing Bluetooth scanning and Bluetooth broadcasting functions. The voice system is used to implement voice-related functions of the handset 100.
The enabling module is used for controlling whether the computing module processes the obtained angle of arrival information, can also receive data generated by user triggering operation from the triggering operation checking module, and can also control the enabling and the closing of the voice system. The receiving module is used for receiving the angle of arrival information of the Bluetooth broadcast signal from the electronic device and the device identification of the electronic device obtained through Bluetooth scanning from the communication module and transmitting the angle of arrival information and the device identification of the electronic device to the calculating module. The computing module is used for computing the equipment angle between the mobile phone 100 and the electronic equipment according to the angle of arrival information when the enabling module is started, namely the directional control function is started, and sending the equipment identification of the electronic equipment corresponding to the equipment angle meeting the condition to the processing module after receiving the data generated by the user triggering operation from the enabling module. The processing module is used for receiving the equipment identification sent by the computing module and transmitting the equipment identification to the sending module. The transmitting module transmits the device identifier from the processing module to the communication module, so that the communication module transmits the Bluetooth data containing the device identifier in a Bluetooth broadcasting mode through the Bluetooth communication module.
In some embodiments of the present application, the voice system of the mobile phone 100 may be turned off in a directional control scenario, thereby avoiding possible interference with the user's voice control instructions. Fig. 17 shows an interaction flow of turning off the voice system in the coprocessor 111 in the mobile phone 100. As shown in fig. 17, the trigger operation detection module detects a user operation, and after detecting the user operation as a trigger operation, sends a notification of detecting the user trigger operation to the enabling module. And after receiving the notification, the enabling module sends a closing instruction to the voice system. After receiving the closing instruction, the voice system closes the voice system for a preset time period, and the voice system of the mobile phone 100 does not send out voice and does not respond to the voice instruction of the user within the preset time period.
Further technical solutions of the application are summarized in the following examples:
example 1: a method of directionally controlling an electronic device, comprising:
the first electronic device determines device angles between the first electronic device and the second electronic devices according to first wireless broadcast signals received from the second electronic devices;
the first electronic equipment acquires a first equipment identifier of second electronic equipment with the equipment angle meeting a preset condition;
The first electronic device broadcasts a second wireless broadcast signal containing a first device identification;
and responding to the instruction sent by the user of the first electronic device by the second electronic device with the second device identification of the second electronic devices matched with the first device identification in the received second wireless broadcast signal.
Example 2: the method of embodiment 1, wherein the first electronic device comprises an antenna array comprising at least two antennas.
Example 3: the method of embodiment 2, wherein the device angle is an angle between an antenna array face of the first electronic device and the received first wireless broadcast signal.
Example 4: the method of embodiment 3, wherein the first electronic device determining a device angle with the plurality of second electronic devices based on the first wireless broadcast signals received from the plurality of second electronic devices includes:
the first electronic device determines a device angle between the first electronic device and the plurality of second electronic devices according to angle-of-arrival information obtained when the first wireless broadcast signals from the plurality of second electronic devices are received.
Example 5: the method of embodiment 4, wherein the angle of arrival information includes at least one of the following: antenna spacing, phase difference when the radio broadcast signal reaches different antennas, wavelength of the radio broadcast signal.
Example 6: the method of embodiment 5 wherein the device angle θ between the first electronic device and the plurality of second electronic devices is calculated using the formula:
θ=arccos(ψλ/2πd),
where d denotes an antenna pitch, ψ denotes a phase difference when a radio broadcast signal arrives at different antennas, and λ denotes a wavelength of the radio broadcast signal.
Example 7: the method of any one of embodiments 1-6 wherein the wireless broadcast signal is a bluetooth signal or a bluetooth low energy signal.
Example 8: the method of embodiment 1, wherein the first device identification or the second device identification comprises at least one of: hardware identification code or network address.
Example 9: the method of embodiment 1, wherein the preset conditions include at least one of: a fixed value, a range of values, or a range of values centered around a fixed value.
Example 10: the method of embodiment 1, wherein the first electronic device includes a main processor and a coprocessor, and the first electronic device uses the coprocessor to complete the steps of, with the main processor in a sleep state:
determining a device angle with the plurality of second electronic devices based on the first wireless broadcast signals received from the plurality of second electronic devices;
Acquiring a first equipment identifier of a second electronic equipment with an equipment angle meeting a preset condition;
a second wireless broadcast signal containing the first device identification is broadcast.
Example 11: the method of embodiment 1, wherein the instruction issued by the user includes at least one of:
a voice instruction; a limb instruction.
Example 12: the method of embodiment 1, wherein the response of the second electronic device to the instruction issued by the user includes at least one of:
response speech; and executing corresponding operation.
Example 13: the method of embodiment 1, wherein the first electronic device is a mobile terminal and the second electronic device is an intelligent home device.
Example 14: a readable medium having instructions stored thereon which, when executed on an electronic device, cause the electronic device to perform the method of directional control of an electronic device described above.
Example 15: an electronic device, comprising: a memory for storing instructions for execution by one or more processors of the system, and the processor, which is one of the processors of the system, is for performing the method of directional control of an electronic device described above.
While the application has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the application.

Claims (15)

1. A method of directionally controlling an electronic device, comprising:
the first electronic equipment receives each electronic equipment in the plurality of second electronic equipment and sends out a first wireless broadcast signal at set time intervals;
the first electronic device determines device angles between the first electronic device and the second electronic devices according to first wireless broadcast signals received from the second electronic devices;
the first electronic device obtains a first device identifier of a second electronic device of which the device angle meets a preset condition;
the first electronic equipment broadcasts a second wireless broadcast signal containing the first equipment identifier;
and responding to the instruction sent by the user of the first electronic device by a second electronic device with a second device identifier of the second electronic devices matched with the first device identifier in the received second wireless broadcast signal.
2. The method of claim 1, wherein the first electronic device comprises an antenna array comprising at least two antennas.
3. The method of claim 2, wherein the device angle is an angle between an antenna array face of the first electronic device and the received first wireless broadcast signal.
4. The method of claim 3, wherein the first electronic device determining a device angle with the plurality of second electronic devices based on the first wireless broadcast signals received from the plurality of second electronic devices comprises:
and the first electronic equipment determines equipment angles between the first electronic equipment and the second electronic equipment according to the angle-of-arrival information obtained when the first wireless broadcast signals from the second electronic equipment are received.
5. The method of claim 4, wherein the angle of arrival information comprises at least one of: antenna spacing, phase difference when the radio broadcast signal reaches different antennas, wavelength of the radio broadcast signal.
6. The method of claim 5, wherein the device angle θ between the first electronic device and the plurality of second electronic devices is calculated using the formula:
θ=arccos(ψλ/2πd),
where d denotes an antenna pitch, ψ denotes a phase difference when a radio broadcast signal arrives at different antennas, and λ denotes a wavelength of the radio broadcast signal.
7. The method according to any one of claims 1 to 6, wherein the wireless broadcast signal is a bluetooth signal or a bluetooth low energy signal.
8. The method of claim 1, wherein the first device identification or the second device identification comprises at least one of: hardware identification code or network address.
9. The method of claim 1, wherein the preset conditions include at least one of: a fixed value, a range of values, or a range of values centered around a fixed value.
10. The method of claim 1, wherein the first electronic device comprises a main processor and a coprocessor, and wherein the first electronic device uses the coprocessor to perform the following steps with the main processor in a sleep state:
determining a device angle with the plurality of second electronic devices according to first wireless broadcast signals received from the plurality of second electronic devices;
acquiring a first equipment identifier of a second electronic equipment of which the equipment angle meets a preset condition;
a second wireless broadcast signal containing the first device identification is broadcast.
11. The method of claim 1, wherein the user-issued instruction comprises at least one of:
a voice instruction;
a limb instruction.
12. The method of claim 1, wherein the response of the second electronic device to the user-issued instruction includes at least one of:
Response speech;
and executing corresponding operation.
13. The method of claim 1, wherein the first electronic device is a mobile terminal and the second electronic device is a smart home device.
14. A readable medium having stored thereon instructions which, when executed on an electronic device, cause the electronic device to perform the method of any of claims 1 to 13.
15. An electronic device, comprising: memory for storing instructions for execution by one or more processors of the system, and the processor, which is one of the processors of the system, for performing the method of any of claims 1 to 13.
CN202110172178.4A 2021-02-08 2021-02-08 Method for directionally controlling electronic device, electronic device and readable medium Active CN114915916B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110172178.4A CN114915916B (en) 2021-02-08 2021-02-08 Method for directionally controlling electronic device, electronic device and readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110172178.4A CN114915916B (en) 2021-02-08 2021-02-08 Method for directionally controlling electronic device, electronic device and readable medium

Publications (2)

Publication Number Publication Date
CN114915916A CN114915916A (en) 2022-08-16
CN114915916B true CN114915916B (en) 2023-08-22

Family

ID=82760946

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110172178.4A Active CN114915916B (en) 2021-02-08 2021-02-08 Method for directionally controlling electronic device, electronic device and readable medium

Country Status (1)

Country Link
CN (1) CN114915916B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104967726A (en) * 2015-04-30 2015-10-07 努比亚技术有限公司 Voice instruction processing method, voice instruction processing device and mobile terminal
WO2018213401A1 (en) * 2017-05-16 2018-11-22 Apple Inc. Methods and interfaces for home media control
CN109450750A (en) * 2018-11-30 2019-03-08 广东美的制冷设备有限公司 Sound control method, device, mobile terminal and the household appliance of equipment
WO2019120102A1 (en) * 2017-12-21 2019-06-27 安克创新科技股份有限公司 Wireless handheld electronic device, smart electronic device and pairing connection method thereof
CN110213433A (en) * 2019-05-15 2019-09-06 深圳市泰衡诺科技有限公司 Jingle bell control method, device, electric terminal and storage medium
CN110808886A (en) * 2019-10-18 2020-02-18 珠海格力电器股份有限公司 Voice equipment control method and device, storage medium and voice equipment
CN111812588A (en) * 2020-07-20 2020-10-23 百度在线网络技术(北京)有限公司 Multi-device voice wake-up implementation method and device, electronic device and medium
CN111833868A (en) * 2020-06-30 2020-10-27 北京小米松果电子有限公司 Voice assistant control method, device and computer readable storage medium
CN111880855A (en) * 2020-07-31 2020-11-03 宁波奥克斯电气股份有限公司 Equipment control method and distributed voice system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130179064A1 (en) * 2012-01-06 2013-07-11 International Business Machines Corporation Hand-held device with directional notification
US10152969B2 (en) * 2016-07-15 2018-12-11 Sonos, Inc. Voice detection by multiple devices
US11367449B2 (en) * 2017-08-09 2022-06-21 Lg Electronics Inc. Method and apparatus for calling voice recognition service by using Bluetooth low energy technology
US11514917B2 (en) * 2018-08-27 2022-11-29 Samsung Electronics Co., Ltd. Method, device, and system of selectively using multiple voice data receiving devices for intelligent service

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104967726A (en) * 2015-04-30 2015-10-07 努比亚技术有限公司 Voice instruction processing method, voice instruction processing device and mobile terminal
WO2018213401A1 (en) * 2017-05-16 2018-11-22 Apple Inc. Methods and interfaces for home media control
CN109287140A (en) * 2017-05-16 2019-01-29 苹果公司 Method and interface for home media control
WO2019120102A1 (en) * 2017-12-21 2019-06-27 安克创新科技股份有限公司 Wireless handheld electronic device, smart electronic device and pairing connection method thereof
CN109450750A (en) * 2018-11-30 2019-03-08 广东美的制冷设备有限公司 Sound control method, device, mobile terminal and the household appliance of equipment
CN110213433A (en) * 2019-05-15 2019-09-06 深圳市泰衡诺科技有限公司 Jingle bell control method, device, electric terminal and storage medium
CN110808886A (en) * 2019-10-18 2020-02-18 珠海格力电器股份有限公司 Voice equipment control method and device, storage medium and voice equipment
CN111833868A (en) * 2020-06-30 2020-10-27 北京小米松果电子有限公司 Voice assistant control method, device and computer readable storage medium
CN111812588A (en) * 2020-07-20 2020-10-23 百度在线网络技术(北京)有限公司 Multi-device voice wake-up implementation method and device, electronic device and medium
CN111880855A (en) * 2020-07-31 2020-11-03 宁波奥克斯电气股份有限公司 Equipment control method and distributed voice system

Also Published As

Publication number Publication date
CN114915916A (en) 2022-08-16

Similar Documents

Publication Publication Date Title
CN109710080B (en) Screen control and voice control method and electronic equipment
CN110364151B (en) Voice awakening method and electronic equipment
WO2020228815A1 (en) Voice-based wakeup method and device
CN114513847B (en) Positioning method, device, system, electronic equipment and storage medium
WO2021023046A1 (en) Electronic device control method and electronic device
CN112312366B (en) Method, electronic equipment and system for realizing functions through NFC (near field communication) tag
CN110060675B (en) Method and equipment for waking up sound box
KR102144588B1 (en) Sensor module and device therewith
WO2021013196A1 (en) Simultaneous response method and device
WO2022007944A1 (en) Device control method, and related apparatus
CN113472861B (en) File transmission method and electronic equipment
US20230319724A1 (en) Electronic device and operation method therefor
CN114173193A (en) Multimedia stream playing method and electronic equipment
CN114430543A (en) Communication control method and device of mobile terminal, storage medium and electronic equipment
CN114339698A (en) Method for establishing wireless connection through equipment touch, electronic equipment and chip
CN114201738B (en) Unlocking method and electronic equipment
CN116074143A (en) Scene synchronization method and device, electronic equipment and readable storage medium
CN114915916B (en) Method for directionally controlling electronic device, electronic device and readable medium
CN116033342B (en) Geofence processing method, equipment and storage medium
CN116033530A (en) Dynamic configuration method and device for price tag power consumption and computer readable storage medium
CN116261124A (en) Data transmission method and device, electronic equipment and intelligent terminal
CN114116610A (en) Method, device, electronic equipment and medium for acquiring storage information
CN112185096A (en) Voice remote control method and device, electronic equipment and storage medium
CN115460619B (en) Signal control method and electronic equipment
WO2024174672A1 (en) Display screen control method, device, and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant