WO2024002282A1 - Method and apparatus for sensing device, and chip and device - Google Patents

Abstract

A method and apparatus for sensing a device, and a chip and a device. The method comprises: determining whether there are other devices around an electronic device; when there are other devices around the electronic device, acquiring a positioning result corresponding to the other devices; determining whether the positioning result meets a preset first condition; and when the positioning result meets the first condition, waking up a processor of the electronic device, and the processor executing a first operation corresponding to the other devices after being woken up. By means of the embodiments of the present invention, an electronic device can sense other devices around the electronic device in real time and with low levels of power consumption.

Description

Methods, devices, chips and equipment for sensing equipment

This application requires the priority of the Chinese patent application with application number 202210775399.5 submitted to the State Intellectual Property Office of China on July 1, 2022, and the priority of the Chinese patent application with the invention name "Method, device, chip and equipment for sensing equipment" rights, the entire contents of which are incorporated herein by reference.

Technical field

The present invention relates to the field of electronic equipment, and in particular to a method, device, chip and equipment for sensing equipment.

Background technique

In an implementation manner, an ultrasonic medium can be used to realize the purpose of sensing the device. Specifically, the ultrasonic medium can be used to sense the device. Since the sensing processing logic runs in the processor, the power consumption of the processor is high, and the sensing capability cannot be achieved when the processor is asleep.

Contents of the invention

Embodiments of the present invention provide a method, device, chip and equipment for sensing equipment, which can sense equipment in real time and with low power consumption.

In a first aspect, an embodiment of the present invention provides a method for sensing a device, including: determining whether there are other devices around an electronic device; and, if there are other devices around the electronic device, obtaining the positioning corresponding to the other device. Result; determine whether the positioning result satisfies the preset first condition; when the positioning result satisfies the first condition, wake up the processor of the electronic device, and the processor executes the corresponding The first operation of said other equipment.

Optionally, the obtaining the positioning result corresponding to the other device includes: obtaining the first data collected by the ultrasonic medium in the electronic device; and obtaining the positioning result corresponding to the other device according to the first data. .

Optionally, the positioning result includes: direction data of the other device relative to the electronic device; the first condition includes: a preset direction range; the determination of whether the positioning result satisfies the preset The first condition includes: determining whether the direction data is within the direction range; wherein the situation where the positioning result satisfies the first condition includes the situation where the direction data is within the direction range.

Optionally, the positioning result includes: a target distance between the other device and the electronic device; the first condition includes: a preset distance threshold; the determination of whether the positioning result satisfies a preset third A condition includes: determining whether the target distance is not greater than the distance threshold; wherein the situation where the positioning result satisfies the first condition includes: the situation where the target distance is not greater than the distance threshold.

Optionally, after determining that there are other devices around the electronic device and before waking up the processor of the electronic device, the method further includes: determining whether the electronic device is moving; When the electronic device is moving, the step of waking up the processor of the electronic device is performed.

Optionally, the method further includes: obtaining second data collected by an inertial measurement unit in the electronic device; and performing the step of determining whether the electronic device is moving based on the second data.

Optionally, the inertial measurement unit includes at least one of a gyroscope sensor, an acceleration sensor, and a compass sensor.

Optionally, after determining that other devices exist around the electronic device and before waking up the processor of the electronic device, the method further includes: determining whether the other devices and the electronic device are Devices under the same user account; when the positioning result satisfies the first condition, waking up the processor of the electronic device includes: when the positioning result satisfies the first condition and the If the other device and the electronic device are devices under the same user account, wake up the processor of the electronic device.

Optionally, the first operation includes: controlling the electronic device to eject a card, and the card display content includes information related to the usage status of the other device.

Optionally, the method further includes: obtaining third data collected by the wireless medium in the electronic device; and performing the step of determining whether other devices are present around the electronic device according to the third data.

Optionally, the wireless medium includes at least one of a Bluetooth chip and a wireless network communication technology chip.

In a second aspect, an embodiment of the present invention provides an apparatus for sensing a device, including: a first determination module for determining whether other devices exist around the electronic device; and an acquisition module for determining whether other devices exist around the electronic device. In the case of, obtain the positioning result corresponding to the other device; the second determination module is used to determine whether the positioning result satisfies the preset first condition; the wake-up module is used to determine whether the positioning result satisfies the first preset condition; If conditions exist, wake up the processor of the electronic device, and after being awakened, the processor performs a first operation corresponding to the other device.

In a third aspect, the present application provides an electronic chip, including: a processor configured to execute computer program instructions stored in a memory, wherein when the computer program instructions are executed by the processor, the electronic chip is triggered. The chip performs the method described in any one of the first aspects of the application.

In a fourth aspect, the present application provides an electronic device. The electronic device includes a memory for storing computer program instructions, a processor for executing the computer program instructions, and a communication device, wherein when the computer program instructions are processed by the When the electronic device is executed, the electronic device is triggered to execute the method described in any one of the first aspects of this application.

In a fifth aspect, the present application provides a computer-readable storage medium. The computer-readable storage medium stores a computer program that, when run on a computer, causes the computer to execute any one of the steps described in the first aspect of the present application. Methods.

In a sixth aspect, the present application provides a computer program product. The computer program product includes a computer program. When the computer program is run on a computer, it causes the computer to execute any one of the methods described in the first aspect of the present application. method.

The embodiments of this application enable real-time low-power sensing devices.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention and are not relevant to the present invention. Those skilled in the art can also obtain other drawings based on these drawings without exerting creative efforts.

Figure 1 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention;

Figure 2 is a schematic diagram of an implementation of a sensing device provided by an embodiment of the present invention;

Figure 3 is a schematic diagram of a sensing device provided by an embodiment of the present invention;

Figure 4 is a schematic diagram of another sensing device provided by an embodiment of the present invention;

Figure 5 is a schematic diagram of another sensing device provided by an embodiment of the present invention;

Figure 6 is a schematic diagram of another sensing implementation provided by an embodiment of the present invention;

Figure 7 is a schematic diagram of another sensing implementation provided by an embodiment of the present invention;

Figure 8 is a timing diagram of a sensing device provided by an embodiment of the present invention;

Figure 9 is a timing diagram of another sensing device provided by an embodiment of the present invention;

Figure 10 is a timing diagram of yet another sensing device provided by an embodiment of the present invention;

Figure 11 is a flow chart of a perception implementation method provided by an embodiment of the present invention;

Figure 12 is a flow chart of yet another perception implementation method provided by an embodiment of the present invention.

Detailed ways

In order to better understand the technical solution of the present invention, the embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

It should be clear that the described embodiments are only some, but not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.

The terminology used in the embodiments of the present invention is only for the purpose of describing specific embodiments and is not intended to limit the present invention. As used in this embodiment and the appended claims, the singular forms "a," "the" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise.

It should be understood that in the embodiments of this application, "at least one" refers to one or more, and "multiple" refers to two or more. The term "and/or" used in this article is just an association relationship describing related objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist simultaneously, alone There are three situations B. Where A and B can be singular or plural. In addition, the character "/" in this article generally indicates that the related objects are an "or" relationship. “At least one of the following” and similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can mean: a, b, c, a and b, a and c, b and c or a and b and c, where a, b, c can be single, also Can be multiple.

It should be understood that although the terms first, second, etc. may be used to describe the set thresholds in the embodiments of the present invention, these set thresholds should not be limited to these terms. These terms are only used to distinguish set thresholds from each other. For example, without departing from the scope of the embodiments of the present invention, the first set threshold may also be called a second set threshold, and similarly, the second set threshold may also be called a first set threshold.

The terms used in the embodiments of the present application are only used to explain specific embodiments of the present application and are not intended to limit the present application.

In one embodiment, the method provided by the embodiment of the present application can be applied to the electronic device 100 shown in FIG. 1 . FIG. 1 shows a schematic structural diagram of an electronic device 100 .

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors.

The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. Interfaces may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and /or universal serial bus (USB) interface, etc.

The USB interface 130 is an interface that complies with the USB standard specification, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. It can be understood that the interface connection relationships between the modules illustrated in the embodiments of the present application are only schematic illustrations and do not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or Multiple communication bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.

The mobile communication module 150 can provide solutions for wireless communication including 2G/3G/4G/5G applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

A modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT), and global navigation satellites. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi) -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, videos, etc. Display 194 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode). emitting diode (AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

The electronic device 100 can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process the data fed back by the camera 193. Camera 193 is used to capture still images or video. The object passes through the lens to produce an optical image that is projected onto the photosensitive element.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can continuously learn by itself.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. Such as saving music, videos, etc. files in external memory card.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.). The storage data area may store data created during use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.

The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, pressure sensor 180A may be disposed on display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor may include at least two parallel plates of conductive material. When a force is applied to pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is performed on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch location but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold is applied to the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

The gyro sensor 180B may be used to determine the motion posture of the electronic device 100 . Air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation. Magnetic sensor 180D includes a Hall sensor. The acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (generally three axes). Distance sensor 180F for measuring distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may utilize the distance sensor 180F to measure distance to achieve fast focusing. Proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The ambient light sensor 180L is used to sense ambient light brightness. Fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access to application locks, fingerprint photography, fingerprint answering of incoming calls, etc. Temperature sensor 180J is used to detect temperature.

Touch sensor 180K, also known as "touch device". The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation on or near the touch sensor 180K. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a location different from that of the display screen 194 .

The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 . The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. Electronic Equipment 100 Pass The SIM card interacts with the network to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 . The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

In order to facilitate understanding of the improvements made in the solutions provided by the embodiments of the present application, the existing related technical solutions will be briefly described first.

Related technical solution 1: Ultrasonic media can be used to achieve the purpose of sensing the device. Specifically, the ultrasonic medium can be used to measure the distance of the device to locate the direction and distance of the device. Awareness processing logic for the device runs in the processor.

The processor may be an application processor (Application Processor, AP).

In one embodiment, FIG. 2 shows a schematic diagram of a possible implementation of the present technical solution. In this implementation, the device 200A includes a processor 210A (such as an AP), a high-fidelity (HIFI) chip 220A, a speaker 230A/microphone 240A (SPK/MIC), and the processor 210A is provided with a perception processing logic 211A. , the high-fidelity chip 220A is provided with an audio processing algorithm chain 221A.

The device 200B includes a processor 210B, a high-fidelity chip 220B, and a speaker 230B/microphone 240B. The processor 210B is provided with a perceptual processing logic 211B, and the high-fidelity chip 220B is provided with an audio processing algorithm chain 221B.

In this way, device 200A can sense device 200B, and device 200B can also sense device 200A, that is, the two devices can sense each other.

Speaker, referred to as SPK, spelled out as Speaker.

Microphone, abbreviated as MIC, spelled out as microphone.

Please refer to Figure 2, taking the device 200A sensing the device 200B as an example. When the speaker 230A/microphone 240A in the device 200A senses the device 200B, it sends the corresponding perceived audio signal to the high-fidelity chip 220A in the device 200A; The high-fidelity chip 220A in the device 200A processes the audio signal based on the built-in audio processing algorithm chain 221A (such as performing data conversion processing to convert the audio signal into data that can be processed by the processor, etc.), and sends the processing result to the device 200A The processor 210A in the device 200A processes the processing result sent by the high-fidelity chip 220A based on the built-in perception processing logic 211A to perceive the direction and position of the device 200B.

In the same way, device 200B can also sense the direction and position of device 200A. Please refer to the above content for the specific implementation process. This embodiment will not be described in detail here.

Please refer to Table 1 below, which shows the power consumption of the processor for a sensing measurement.

Table 1

As shown in Table 1, the power consumption of the processor for one sensing measurement is 0.04mah. Calculated based on 1,000 sensing measurements a day, the power consumption will increase by 40mah, which is high power consumption.

In this technical solution, since the sensing processing logic for the device runs in the processor, the power consumption of the processor is high. Due to power consumption limitations The ultrasonic sensing capability requires the processor to be awake. Therefore, this technical solution cannot realize the sensing capability when the processor is sleeping, and cannot automatically sense the direction and distance of the device when the processor is sleeping.

Related technical solution 2: UWB (Ultra Wide Band) chip hardware can be added to electronic equipment to realize sensing functions. Among them, UWB technology is a wireless carrier communication technology.

However, new hardware will bring about a corresponding increase in the cost of electronic equipment (for example, the cost is 5 US dollars higher), and this technical solution does not have a low-power solution, and it is also unable to achieve sensing capabilities when the processor is in sleep mode.

In view of this, embodiments of the present application propose a solution that can solve the above-mentioned problems of high power consumption and inability to realize the sensing capability when the processor is in sleep state, and can realize real-time sensing of the device with low power consumption.

Below, a preliminary introduction to the technical solutions provided by the embodiments of this application will be given based on several application scenario examples.

Application scenario example 1:

Next, take the electronic device as the user's smartphone, the sensed device as the smart home appliance in the user's home, and the mobile phone pops up a card for the user to use after sensing the smart home appliance. Application scenario example 1 will be explained.

Application scenario example 1.1:

In one embodiment, please refer to Figure 3, the electronic device is a mobile phone 301, and the smart home appliance is a speaker 302.

When the processor in the phone is in sleep mode, the phone is in sleep mode and the screen of the phone appears as a black screen. However, the built-in sensing component in the low-power normally-on chip in the mobile phone can sense whether there are predetermined devices around the mobile phone in real-time and with low power consumption.

If the user holds the mobile phone in the sleep state and moves it so that the mobile phone is close to the speaker, the sensing component in the mobile phone can sense the speaker.

In implementation mode 1, the sensing component can sense the direction and position of the speaker in real time. If the perceived direction and distance meet the preset conditions, the processor can be awakened. After the processor is awakened, it can perform further processing, such as pop-up The corresponding card is available to the user.

In implementation method 2, after the first-level sensing component senses the speaker in real time, it can trigger the ranging module (secondary sensing component) in the mobile phone to perform precise sensing to sense the direction and position of the speaker. If the direction and distance sensed by the secondary sensing component meet the preset conditions, the processor can be awakened. After being awakened, the processor can perform further processing, such as popping up the corresponding card for the user to use.

In implementation mode 3, the first-level sensing component can wake up the processor after sensing the speaker in real time. After the processor is awakened, it can perform further processing. For example, it can control the ranging module (secondary sensing component) in the mobile phone for precise sensing. , to sense the direction and position of the speaker. If the perceived direction and distance meet the preset conditions, the corresponding card can pop up for the user to use.

In the card that pops up on the mobile phone, information related to the current usage status of the speaker can be displayed for users to use.

For example, assuming that the speaker in the user's living room is playing audio information of music (or song), please refer to Figure 3. The card that pops up on the mobile phone can display the following information: Display information indicating the audio playback device "Speaker in the living room" "; display the image information corresponding to the music (the image information can be the image information of the background picture when the music is played) and the name of the music; the control used to indicate the flow to "local machine"; used to indicate whether Controls that turn on the mobile phone remote control; controls used to control audio playback (such as controls used to control music pause playback, etc.).

Based on the above information displayed in the card, the user can view the device on which the audio information of the music is played, the name of the music being played, the image information corresponding to the music being played, and other information, and can control the audio flow to this device. Control operations such as playing on the phone (i.e. the mobile phone), turning on or off the remote control function of the mobile phone, controlling audio to pause playback, etc.

In addition, the card can also display other information, such as the name of the speaker, controls for controlling the playback effect of the speaker (such as whether to mute, increase/decrease the volume), and the current usage status of the speaker (such as working, standby, Shut down, etc.), a control used to control the speaker usage status.

Please refer to Figure 3. The display area of the card on the mobile phone screen can occupy part of the mobile phone screen area. For example, it can occupy the middle and lower area of the mobile phone screen area. The upper area of the mobile phone screen area can display general information, such as the location. , time, date, weather, mobile phone signal, remaining battery power and other information to meet users’ needs for general information.

In this application scenario example, from the perspective of user experience, when the user's mobile phone is in a dormant state (the mobile phone screen is black) and is close to the speaker, the mobile phone screen automatically lights up, and the card supply card shown in Figure 3 automatically pops up. Users use it and the user experience is good.

Application scenario example 1.2:

In another embodiment, please refer to Figure 4. The electronic device is a mobile phone 401, the smart home appliance is a large-screen device such as a TV 402, and the TV is in a video playback state.

If the user holds the mobile phone in the dormant state and moves it so that the mobile phone is close to the TV, the sensing component in the mobile phone can sense the TV.

Please refer to the above implementation methods 1 to 3. Based on the same implementation principle, if the direction and distance of the TV sensed by the mobile phone meet the preset conditions, the mobile phone can pop up the corresponding card for the user to use.

In the card that pops up on the mobile phone, information related to the current usage status of the TV can be displayed for users to use.

For example, assume that the smart screen (or TV) in the user's living room is playing video images. Please refer to Figure 4. The card that pops up on the mobile phone can display the following information: Display information indicating the video playback device "Wisdom in the Living Room" Screen"; displays the image information used to indicate the video (one of the image frames of the video, such as the cover image, etc.), the name of the video; used to indicate the flow to the "local" control; used to indicate whether to turn on the mobile phone remote control Controls of the browser; controls used to control video playback (such as controls used to control video pause playback, etc.).

Based on the above information displayed in the card, the user can check the device on which the video is played, the name of the played video, the image content of the played video and other information, and can control the video flow to the local machine (i.e. the Mobile phone) playback, control the mobile phone remote control function on or off, control the video pause playback and other control operations.

In addition, the card can also display other information, such as the name of the smart screen, controls for controlling video playback effects (such as whether to mute, increase/decrease the volume), and the current usage status of the smart screen (such as work, Standby, shutdown, etc.), controls used to control the usage status of the smart screen.

The same way as the pop-up card in application scenario example 1.2, please refer to Figure 4. When the phone pops up the card in a specific display area, it can also display general information in other display areas.

Application scenario example 1.3:

In yet another embodiment, please refer to Figure 5. The electronic device is a mobile phone 501, the smart home appliance is a large-screen device such as a TV 502, and the TV is in a video display state.

If the user holds the mobile phone in the dormant state and moves it so that the mobile phone is close to the TV, the sensing component in the mobile phone can sense the TV.

Please refer to the above implementation methods 1 to 3. Based on the same implementation principle, if the direction and distance of the TV sensed by the mobile phone meet the preset conditions, the mobile phone can pop up the corresponding card for the user to use.

In some embodiments, information related to the current usage status of the TV can be displayed in the card that pops up on the mobile phone for the user's use. Please refer to Figure 4 and Figure 5. The current usage status of the TV is different, and the information in the pop-up card can be different accordingly.

As shown in Figure 5, assuming that the TV is in a video display state rather than playing a video, the following information can be displayed in the card that pops up on the mobile phone: information used to indicate the video playback device "smart screen in the living room"; used to indicate whether Turn on the controls of the mobile phone remote control; the video playback record of the TV; and some image information of recommended videos to watch (an image frame of the video).

For the video playback record of the TV, the image information of each video played (an image frame of the video) and the corresponding playback amount (such as the percentage of the playback time to the total time) can be displayed specifically. The current display interface can only display part ( For example, two) image information and corresponding playback volume of videos that have been watched. The user slides the corresponding area of the screen to display image information and corresponding playback volume of other videos that have been watched.

For the image information of recommended videos to watch, the image information of several videos can be displayed specifically. The current display interface can only display the image information of some (such as three) recommended videos, and the image information of other recommended videos can be displayed by the user sliding the corresponding area of the screen.

Based on the above information displayed on the card, the user can check which device the corresponding video is played on, check the videos that have been watched and the corresponding playback volume, check the recommended videos and other information, and can perform control operations to control the video to start playing. . For example, the user can click on the image of any watched video to cause the TV to continue playing the video, and can click on the image of any recommended video to cause the TV to start playing the video.

The same way as the pop-up card in application scenario example 1.2, please refer to Figure 5. When the phone pops up the card in a specific display area, it can also display general information in other display areas.

Application scenario example 2:

Different from the pop-up card in application scenario example 1, in this application scenario example, the electronic device can control the status of any other preset device after sensing the other device. For example, if the other device is in a standby state, the other device is controlled to start working. If the other device is working, the other device is controlled to stand by to suspend working or shut down to stop working.

Next, the implementation of the sensing device provided by the embodiment of the present application will be described in detail.

In one embodiment, please refer to Figure 6. To achieve the purpose of sensing the device, the electronic device 600 may at least include a processor (such as an AP) 610, a high-fidelity chip (HIFI chip) 620, a sensor processor (such as a SensorHub) 630, Speaker 640/microphone 650, sensor 660 (such as inertial measurement unit), wireless network communication technology chip (WiFi chip) 670. Please refer to the arrows shown in Figure 6 for the relationship between each component.

Among them, the high-fidelity chip 620 can be a low-power chip that specializes in processing audio; the sensor processor 630 can be a low-power chip that specializes in processing sensor data.

Among them, both the wireless network communication technology chip 670 and the sensor 660 can be built into the sensor processor 630.

Based on the above components, the electronic device 600 can realize perception of other devices through any one of the above implementation modes 1 to 3.

Corresponding to the above implementation mode 1, the speaker 640/microphone 650 can sense the direction and position of other devices in real time. The high-fidelity chip 620 determines whether the perceived direction and distance meet preset conditions, and if so, the processor 610 can be awakened. After the processor 610 is awakened, it can perform further processing, for example, it can pop up the corresponding card for the user to use.

Corresponding to the above implementation mode 2, the sensor 660 and the wireless network communication technology chip 670 can sense other devices in real time. Based on the sensing data collected by the sensor 660 and the wireless network communication technology chip 670, the sensor processor 630 can trigger the high-fidelity chip 620 for accurate sensing when it determines that other devices are sensed. The high-fidelity chip 620 senses the direction and position of the other device based on the speaker 640/microphone 650. The high-fidelity chip 620 determines whether the perceived direction and distance meet preset conditions, and if so, the processor 610 can be awakened. After the processor 610 is awakened, it can perform further processing, for example, it can pop up the corresponding card for the user to use.

Corresponding to the above implementation mode 3, the sensor 660 and the wireless network communication technology chip 670 can sense other devices in real time. The sensor processor 630 can wake up the processor 610 when it determines that other devices are sensed based on the sensing data collected by the sensor 660 and the wireless network communication technology chip 670 . After being awakened, the processor 610 can perform further processing. For example, it can control the speaker 640/microphone 650 in the electronic device 600 to perform precise sensing to sense the direction and position of the other device. The processor 610 determines whether the perceived direction and distance meet preset conditions, and if the conditions are met, the corresponding card can be popped up for the user to use.

Based on the above content, the above implementation method 2 is taken as an example to further describe the implementation method of the sensing device.

In another embodiment, please refer to FIG. 7 , taking the electronic device 700a sensing the electronic device 700b as an example. To achieve the purpose of sensing the device, the electronic device 700a may at least include a processor 710a, a high-fidelity chip 720a, and a sensor processor. 730a, acceleration sensor 740a/compass sensor 750a, Bluetooth chip 760a, speaker 770a/microphone 780a. Please refer to the arrows shown in Figure 7 for the relationship between each component.

In this embodiment, when the electronic device senses the presence of surrounding devices based on the wireless medium of the Bluetooth chip 760a, it can further determine whether the electronic device is moving. For example, the movement of the electronic device can be determined based on the acceleration sensor 740a or the compass sensor 750a. Condition. For example, if the direction sensed by the compass sensor 750a changes, it can be confirmed that the electronic device is moving; conversely, if the direction sensed by the compass sensor 750a does not change, it can be confirmed that the electronic device is stationary.

In some other embodiments, the electronic device can also sense surrounding devices based on other communication methods, such as sensing surrounding devices based on the wireless network communication technology chip shown in Figure 6, which is not limited in this application.

Among them, the processor 710a includes an application processing module 711a; the high-fidelity chip 720a includes a perception processing module 721a and an audio processing algorithm chain 722a; the sensor processor 730a includes a wake-up processing screening module 731a and a wake-up perception screening module 732a.

In some embodiments, please refer to FIG. 7 , the electronic device 700a and the electronic device 700b may have the same structural composition, so that the electronic device 700a can sense the electronic device 700b, and the electronic device 700b can also sense the electronic device 700a, that is, two Devices can sense each other.

In this case, please refer to Figure 7. The electronic device 700b may at least include a processor 710b, a high-fidelity chip 720b, a sensor processor 730b, acceleration sensor 740b/compass sensor 750b, Bluetooth chip 760b, speaker 770b/microphone 780b. Please refer to the arrows shown in Figure 7 for the relationship between each component.

Among them, the processor 710b includes an application processing module 711b; the high-fidelity chip 720b includes a perception processing module 721b and an audio processing algorithm chain 722b; the sensor processor 730b includes a wake-up processing screening module 731b and a wake-up perception screening module 732b.

In other embodiments, the structural composition of the electronic device 700a and the electronic device 700b may also be different, which is not limited in this application.

Based on the device structure shown in Figure 7, taking the electronic device 700a sensing the electronic device 700b as an example, the implementation process of the sensing device can be as follows.

The acceleration sensor 740a/compass sensor 750a and the Bluetooth chip 760a can sense other devices in real time, and the sensed data is sent to the sensor processor 730a. As mentioned above, for example, whether there is a surrounding device can be sensed based on the Bluetooth chip 760a, and further, whether the electronic device is moving can be determined based on the acceleration sensor 740a or the compass sensor 750a.

The wake-up sensing filtering module 732a in the sensor processor 730a determines whether other devices are sensed based on the sensed data, and if so, the high-fidelity chip 720a is triggered for accurate sensing. If not, the high-fidelity chip 720a is not triggered for accurate sensing.

The high-fidelity chip 720a can trigger the speaker 770a/microphone 780a to sense the direction and position of the other device, and the perceived audio signal is sent to the high-fidelity chip 720a. The audio processing algorithm chain 722a in the high-fidelity chip 720a processes the audio signal, and the processing result is sent to the perceptual processing module 721a. The perception processing module 721a determines the perceived direction and distance based on the processing result, and sends the determined direction and distance to the sensor processor 730a.

The wake-up processing filtering module 731a in the sensor processor 730a determines whether the perceived direction and distance meet preset conditions, and if so, the processor 710a can be woken up. If not, processor 710a is not awakened.

After being awakened, the processor 710a can perform further processing, for example, the corresponding card can be popped up for the user to use.

Please refer to Figure 7. This embodiment sinks the ultrasonic sensing module (speaker 770a/microphone 780a) to run on a high-fidelity chip, a low-power normally-on small core, and combines it with processor wake-up conditions that support customization of third-party applications ( This condition is used to wake up the processor 710a) on demand, which can realize low-power sensing capabilities and support the electronic device to sense the orientation of the surrounding devices in real-time and with low power consumption when sleeping.

In addition, this embodiment can also perform sensing based on a hierarchical sensing management strategy. Specifically, first-level sensing is performed based on Bluetooth chips, acceleration sensors, etc., and when certain conditions are met (such as there are other devices around and the electronic device is moving), The high-precision sensing module in the high-fidelity chip is then triggered for further orientation sensing. Through two-level sensing, lower power consumption sensing capabilities can be achieved.

This embodiment performs high-precision sensing positioning based on the ultrasonic sensing module. In other embodiments, other methods may also be used to perform high-precision sensing positioning. For example, pulses can also be used to perform precise positioning based on UWB (Ultra Wide Band) chips in electronic equipment.

Next, the implementation of the sensing device provided by the embodiment of the present application will be described in detail.

Considering that when users check information of other devices or control other devices through electronic devices (such as mobile phones), the preset card pop-up conditions are usually met. Therefore, it can be determined whether the electronic device pops up the corresponding card by judging whether the card pop-up conditions are met. , so that the user can view the information of the other device or control the other device through the card content.

For example, the card pop-up condition may include some or all of the following sub-conditions 1 to 3:

Sub-condition 1: Other devices are near the user and the electronic device;

Sub-condition 2: The user holds the electronic device and walks towards the other device in advance (or the user brings the electronic device close to the other device);

Sub-condition 3: The other device is within a specific angle range and a specific distance range between the user and the electronic device.

Considering that when there are other devices around the user, it is possible for the user to use electronic devices to view information about the other devices or to control the other devices. Therefore, optionally, you can first confirm whether there are other devices around the user, and if so, then further detect Whether the user is near the other device.

Among them, it can be further confirmed whether there is a possibility for the user to view or control other devices by sensing whether the electronic device used by the user is moving. If the device is moving, it can be assumed that the user is close to the other device, that is, the possibility exists. If the device is not moving, it can be assumed that the user is not close to the other device, that is, the possibility does not exist.

For example, the card ejection condition may include the above-mentioned sub-conditions 1-3 at the same time. For example, the electronic device may first determine whether sub-condition 1 and sub-condition 2 are met, and then determine whether sub-condition 3 is met, without executing the steps related to sub-condition 3 in real time. Judgment operation.

Considering that the processor consumes high power when executing the judgment operations related to sub-condition 3, and may not always satisfy sub-condition 3, the judgment operations related to sub-condition 3 can be performed by low-power components instead of the processor, so as to Avoid repeated, inefficient activation of the processor.

Next, the device awareness implementation process of this embodiment will be described, taking the implementation logic of the above implementation mode 2 as an example.

In one embodiment, please refer to Figure 8. Figure 8 shows a timing diagram for an electronic device to sense the device based on two-level sensing. The timing diagram involves the wireless network communication technology chip 810 and the sensor processor in the electronic device. 820 and Hi-Fi chip 830 operation.

Referring to FIG. 8 , the wireless network communication technology chip 810 is used to sense whether there are other devices around, and when sensing the presence of other devices around, send notification information of the surrounding devices to the sensor processor 820 .

The sensor processor 820 responds to the notification information, senses whether the electronic device is moving, and triggers the high-fidelity chip 830 for accurate sensing when it senses that the electronic device is moving.

In response to the triggering operation for precise sensing, the high-fidelity chip 830 starts the ultrasonic sensing module to perform the ultrasonic sensing operation, and reports the ultrasonic sensing results to the sensor processor 820 .

The sensor processor 820 may subsequently determine whether to wake up the processor to eject the card based on the reported ultrasonic sensing results.

Please refer to the content shown in Figure 8. You can perform first-level perception and then second-level precise perception.

For first-level sensing, specifically, wireless media such as Bluetooth chips and wireless network communication technology chips (WiFi chips) in the sensor processor 820 can be used to sense whether there are other devices around the electronic device, and the gyroscope in the sensor processor 820 can be used. Inertial measurement units such as instrument sensors, acceleration sensors, and compass sensors are used to sense whether the electronic device is moving (which can be equivalent to whether the user is moving to get closer to the other device).

Feasibly, the wireless medium and the inertial measurement unit can be built into the sensor processor 820, installed on the sensor processor 820, or installed outside the sensor processor 820, and connected to the sensor processor 820. In this embodiment, Not limited.

For the second-level precise sensing, if the first-level sensing result is that there are other devices around and the electronic device is moving, the ultrasonic sensing module sunk in the high-fidelity chip 830 can be triggered for precise sensing.

The precise sensing result can be returned to the sensor processor 820, so that the sensor processor 820 can perform on-demand wake-up of the processor based on the communication channel between the sensor processor 820 and the processor for waking up the processor. For example, the processor can control the electronic device to turn on its screen and eject cards.

In another possible implementation, a communication channel for waking up the processor can also be established between the high-fidelity chip 830 and the processor. In this way, the high-fidelity chip 830 does not need to return the precise sensing results to the sensor processor 820, but can directly process the precise sensing results and perform on-demand wake-up of the processor through the communication channel.

In another embodiment, please refer to FIG. 9 , which shows a timing diagram in which an electronic device wakes up a processor to eject a card after sensing other devices. The timing diagram involves the high-fidelity chip 910 and 910 in the electronic device. Sensor processor 920 and processor 930.

The high-fidelity chip 910 reports the ultrasonic sensing results obtained by performing the ultrasonic sensing operation to the sensor processor 920 .

The sensor processor 920 determines whether the conditions for waking up the processor are met based on the reported ultrasonic sensing results. When it is determined that the conditions for waking up the processor are met, an instruction to wake up the processor is sent.

In response to the instruction to wake up the processor, the processor 930 controls the electronic device to turn on the screen and eject the card for use by the user. For example, the user can view the information of the sensed device or control the device based on the card content.

In yet another embodiment, please refer to FIG. 10 , which shows a timing diagram of an electronic device sensing the device based on ultrasonic sensing. The timing diagram involves the microphone 1010 and the audio processing algorithm chain 1020 in the electronic device. For example, FIG. 10 may be a timing diagram of the internal timing of a high-fidelity chip.

The microphone 1010 sends the collected ultrasonic sensing information to the audio processing algorithm chain 1020. The audio processing algorithm chain 1020 calls the ultrasonic algorithm to process the ultrasonic sensing information to obtain ultrasonic sensing results, which include distance and direction.

The above embodiments can use ultrasonic technology to perform high-precision sensing positioning based on the ultrasonic sensing module. In other embodiments, Other methods can also be used for high-precision sensing positioning. For example, pulses can also be used to perform precise positioning based on UWB chips in electronic devices.

Figure 11 is a schematic flowchart of a method for sensing a device according to an embodiment of the present application. The method may include steps 1101 to 1106:

Step 1101: Sense whether there are other devices around the electronic device. If so, execute step 1102; otherwise, end the current process.

Wireless media such as Bluetooth chips and wireless network communication technology chips in electronic devices can be used to discover whether there are other devices around the electronic device.

The Bluetooth chip can be a BLE (Bluetooth Low Energy) chip.

Step 1102: Determine whether the other device and the electronic device are devices under the same user account. If so, execute step 1103; otherwise, end the current process.

Step 1103: Sense whether the electronic device is moving. If so, execute step 1104. Otherwise, end the current process.

The movement of the electronic device can be sensed using one or more of an inertial measurement unit (IMU), an acceleration sensor, a compass sensor, etc. in the electronic device.

For example, if the direction information collected by the compass sensor changes, it can be considered that the electronic device has moved.

Step 1104: Perform an ultrasonic sensing operation to obtain an ultrasonic sensing result.

If the electronic device is moving, the ultrasonic sensing module can be awakened, and the ultrasonic sensing module performs ultrasonic sensing operations to realize orientation (direction and position) sensing. The ultrasonic sensing module can be in a dormant state before being awakened.

Ultrasound sensing modules can be built into high-fidelity chips in electronic devices.

In this embodiment, ultrasonic technology can be used to perform high-precision sensing positioning based on the ultrasonic sensing module. In other embodiments, other methods may also be used to perform high-precision sensing positioning. For example, pulses can also be used to perform precise positioning based on UWB chips in electronic devices.

Step 1105: Determine whether the preset processor wake-up condition is met based on the ultrasonic sensing result. If so, execute step 1106; otherwise, end the current process.

The ultrasonic sensing results may include distance and direction. The distance may be expressed as the distance between the electronic device and other devices, and the direction may be expressed as the direction of other devices relative to the electronic device.

Correspondingly, the preset processor wake-up condition may include: the distance in the ultrasonic sensing result is within the corresponding distance range, and the direction in the ultrasonic sensing result is within the corresponding direction range.

In this way, the processor can be woken up only when other devices are close to the electronic device and deviate from the electronic device at a small angle to ensure accurate wake-up of the processor.

Feasibly, the processor wake-up condition may be a wake-up condition corresponding to the other device. Users can customize the processor wake-up conditions (or wake-up strategies) corresponding to each other device as needed through the application interface of each other device.

Step 1106: Wake up the processor of the electronic device, where the processor is used to control the electronic device to eject a card after being awakened. The card display content includes information related to the usage status of other devices.

Based on the method provided in this embodiment, when the internal processor of the electronic device is in a dormant state, the electronic device can combine the built-in wireless medium of the low-power sensor processor in the electronic device to discover in real time whether there are other devices around the electronic device, and Combined with the inertial measurement unit in the electronic device, it can sense whether the electronic device is moving, and determine whether the electronic device and other devices are devices under the same account. If the above judgment results are all yes, the low-power device sinking in the electronic device will be notified. The ultrasonic sensing module in the high-fidelity chip is used for orientation sensing. The orientation sensing information can be passed back to the sensor processor. The sensor processor determines whether the orientation sensing information satisfies the wake-up strategy customized by the third-party application. If so, it can wake up the processor of the electronic device. After the processor is awakened, it further processes the message, such as popping up a card for the user to use.

As shown in Figure 11, after sensing the presence of other devices in the surrounding area, the electronic device can first determine whether the other devices and the electronic device are devices under the same user account. If they are devices under the same user account, then sense whether the electronic device is moving.

In other feasible implementation methods, after sensing the presence of other devices in the surrounding area, the electronic device may first sense whether the electronic device is moving, and if so, determine whether the other devices and the electronic device are devices under the same user account.

In existing related technical solutions, when an electronic device is close to other devices in a sleep state, it cannot sense the orientation of other devices. This prevents the electronic device from automatically ejecting the card for the user to use. Different from existing related technical solutions, based on the implementation of this embodiment, the electronic device can still measure the orientation of the dormant device and surrounding devices in real time and with low power consumption in the dormant state. Once the dormant device is found to be close to other devices as required, it can Cards automatically pop up for users to use.

It should be noted that the method of sensing the device in the embodiment of the present application is not limited to the content shown in Figure 11. For example, in other feasible implementations, the above step 1102 and/or step 1103, or both of them, may not be performed. The step may not be performed before step 1104. This application does not limit this.

For example, if these two steps are not executed, step 1104 can be executed directly after the determination in step 1101 is "yes". If step 1102 is not executed, step 1103 can be executed directly after the determination in step 1101 is "yes". If step 1103 is not executed, step 1104 can be executed directly after the determination in step 1102 is "yes".

For another example, step 1102 may not be executed before step 1103, but may be executed before step 1106. That is, if step 1105 is determined to be "yes", step 1102 will be executed, and if step 1102 is determined to be "yes", step 1106 will be executed.

Figure 12 is a schematic flowchart of another method of sensing a device provided by another embodiment of the present application. The method includes steps 1201 to 1209:

Step 1201: The wake-up sensing screening module in the sensor processor senses whether there are other devices around the electronic device based on the sensing data of the Bluetooth chip. If so, step 1202 is executed. Otherwise, the current process ends.

Step 1202: The wake-up awareness filtering module determines whether the other device and the electronic device are devices under the same user account. If so, execute step 1203; otherwise, end the current process.

Step 1203: The wake-up sensing screening module senses whether the electronic device is moving based on the sensing data of the acceleration sensor/compass sensor. If so, execute step 1204; otherwise, end the current process.

Step 1204: Wake up the sensing screening module to trigger the high-fidelity chip to perform ultrasonic sensing operations.

In this embodiment, ultrasonic technology can be used to perform high-precision sensing positioning based on the ultrasonic sensing module. In other embodiments, other methods may also be used to perform high-precision sensing positioning. For example, pulses can also be used to perform precise positioning based on UWB chips in electronic devices.

Step 1205: The audio algorithm processing chain in the high-fidelity chip processes the perceptual data of the speaker/microphone and obtains the processing result.

Step 1206: The perception processing module in the high-fidelity chip processes the processing results to obtain ultrasonic perception results.

Step 1207: The wake-up processing screening module in the sensor processor determines whether the preset processor wake-up conditions are met based on the ultrasonic sensing results. If so, step 1208 is executed. Otherwise, the current process ends.

Step 1208: The wake-up processing and filtering module wakes up the processor of the electronic device.

Step 1209: After the processor is awakened, the application processing module in the processor controls the electronic device to pop up a card, and the card display content includes information related to the usage status of other devices.

As shown in Figure 12, after sensing the presence of other devices in the surrounding area, the electronic device can first determine whether the other devices and the electronic device are devices under the same user account. If they are devices under the same user account, then sense whether the electronic device is moving.

In other feasible implementation methods, after sensing the presence of other devices in the surrounding area, the electronic device may first sense whether the electronic device is moving, and if so, determine whether the other devices and the electronic device are devices under the same user account.

It should be noted that the method of sensing the device in the embodiment of the present application is not limited to the content shown in Figure 12. For example, in other feasible implementations, the above step 1202 and/or step 1203, or both of them, may not be performed. The step may not be performed before step 1204. This application does not limit this.

For example, if these two steps are not performed, step 1204 can be performed directly after the determination in step 1201 is "yes". If step 1202 is not executed, step 1203 can be executed directly after the determination in step 1201 is "yes". If step 1203 is not executed, step 1204 can be executed directly after the determination in step 1202 is "yes".

For another example, step 1202 may not be executed before step 1203, but may be executed before step 1208. That is, if step 1207 is determined to be "yes", step 1202 will be executed, and if step 1202 is determined to be "yes", step 1208 will be executed.

In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined. or can to integrate into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

A unit described as a separate component may or may not be physically separate. A component shown as a unit may or may not be a physical unit, that is, it may be located in one place, or it may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

Embodiments of the present application also provide an electronic chip. The electronic chip includes: a processor configured to execute computer program instructions stored in a memory. When the computer program instructions are executed by the processor, the task processing chip is triggered to execute. The steps performed by the electronic device 100 in the above embodiment.

An embodiment of the present application also provides an electronic device, which may include: a processor. The processor is configured to run a computer program stored in a memory, so that the electronic device implements various steps performed by the electronic device 100 in the above embodiment. A feasible product hardware structure of the electronic device provided by the embodiment of the present application can be seen in the schematic hardware structure diagram shown in FIG. 5 .

Specifically, in an embodiment of the present application, one or more computer programs are stored in the above-mentioned memory. The one or more computer programs include instructions. When the instructions are executed by the above-mentioned device, the above-mentioned device executes the implementation of the present application. The method steps described in the example.

Specifically, in an embodiment of the present application, the processor of the electronic device may be an on-chip device SOC, and the processor may include a central processing unit (Central Processing Unit, CPU), and may further include other types of processors. Specifically, in an embodiment of the present application, the processor of the electronic device may be a PWM control chip.

Specifically, in an embodiment of the present application, the processor involved may include, for example, a CPU, a DSP, a microcontroller or a digital signal processor, and may also include a GPU, embedded neural network processor (Neural-network Process Units, NPU). ) and an image signal processor (Image Signal Processing, ISP), which may also include necessary hardware accelerators or logic processing hardware circuits, such as ASIC, or one or more integrated circuits used to control the execution of the program of the technical solution of this application wait. Additionally, the processor may have functionality to operate one or more software programs, which may be stored in a storage medium.

Specifically, in an embodiment of the present application, the memory of the electronic device may be a read-only memory (ROM), other types of static storage devices that can store static information and instructions, or a random access memory (random access memory). memory, RAM) or other types of dynamic storage devices that can store information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory, CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can also be used to carry or Any computer-readable medium that stores desired program code in the form of instructions or data structures and that can be accessed by a computer.

Specifically, in an embodiment of the present application, the processor and the memory can be combined into a processing device, which is more commonly independent of each other. The processor is used to execute the program code stored in the memory to implement the method described in the embodiment of the present application. . During specific implementation, the memory can also be integrated in the processor, or independent of the processor.

Furthermore, the equipment, devices, and modules described in the embodiments of this application may be implemented by computer chips or entities, or by products with certain functions.

Those skilled in the art should understand that embodiments of the present application may be provided as methods, devices, or computer program products. Thus, the invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the invention may take the form of a computer program product embodied on one or more computer-usable storage media embodying computer-usable program code therein.

An embodiment of the present application also provides a computer storage medium, including a computer program. When the computer program is run on an electronic device, the electronic device causes the electronic device to perform the steps performed by the electronic device 100 in the above embodiment.

An embodiment of the present application also provides a computer program product. The computer program product includes a computer program. When the computer program is run on a computer, it causes the computer to perform the steps performed by the electronic device 100 in the above embodiment.

The description of embodiments in the present application refers to methods, apparatuses (devices), and computer program products according to embodiments of the present application. described with flow charts and/or block diagrams. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a use A device for realizing the functions specified in one process or multiple processes of the flowchart and/or one block or multiple blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions The device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device. Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.

It should be understood that the term "unit" in the embodiments of this application can be implemented in the form of software and/or hardware, and there is no specific limitation on this. For example, a "unit" may be a software program, a hardware circuit, or a combination of both that implements the above functions. Hardware circuits may include application specific integrated circuits (ASICs), electronic circuits, and processors (such as shared processors, proprietary processors, or group processors) for executing one or more software or firmware programs. and memory, merged logic circuitry, and/or other suitable components to support the functions described.

Therefore, the units of each example described in the embodiments of the present application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.

In the several embodiments provided in this application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code. .

The integrated unit implemented in the form of a software functional unit may be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium and includes a number of instructions to cause a computer device (which can be a personal computer, server, or network device, etc.) or processor (Processor) to execute the methods described in various embodiments of the present invention. Some steps. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code. .

The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention shall be included in the present invention. within the scope of protection.

Claims (16)

1. A method of sensing equipment, characterized by including:

   Determine whether there are other devices surrounding the electronic device;

   When there are other devices around the electronic device, obtain positioning results corresponding to the other devices;

   Determine whether the positioning result meets a preset first condition;

   If the positioning result satisfies the first condition, the processor of the electronic device is awakened, and the processor performs a first operation corresponding to the other device after being awakened.
2. The method according to claim 1, wherein the obtaining positioning results corresponding to the other devices includes:

   Obtain the first data collected by the ultrasonic medium in the electronic device;

   According to the first data, a positioning result corresponding to the other device is obtained.
3. The method of claim 1, wherein the positioning result includes: orientation data of the other device relative to the electronic device;

   The first condition includes: a preset direction range;

   Determining whether the positioning result meets a preset first condition includes:

   Determine whether the direction data is within the direction range;

   Wherein, the situation where the positioning result satisfies the first condition includes the situation where the direction data is within the direction range.
4. The method according to claim 1, wherein the positioning result includes: a target distance between the other device and the electronic device;

   The first condition includes: a preset distance threshold;

   Determining whether the positioning result meets a preset first condition includes:

   Determine whether the target distance is not greater than the distance threshold;

   Wherein, the situation where the positioning result satisfies the first condition includes the situation where the target distance is not greater than the distance threshold.
5. The method according to claim 1, characterized in that, after determining that there are other devices around the electronic device and before waking up the processor of the electronic device, the method further includes:

   Determine whether the electronic device is moving;

   When it is determined that the electronic device is moving, the step of waking up the processor of the electronic device is performed.
6. The method of claim 5, further comprising:

   Obtain the second data collected by the inertial measurement unit in the electronic device;

   The step of determining whether the electronic device is moving is performed based on the second data.
7. The method of claim 6, wherein the inertial measurement unit includes at least one of a gyroscope sensor, an acceleration sensor, and a compass sensor.
8. The method according to claim 1, characterized in that, after determining that there are other devices around the electronic device and before waking up the processor of the electronic device, the method further includes: determining that the Whether the other devices and the electronic device are devices under the same user account;

   When the positioning result satisfies the first condition, waking up the processor of the electronic device includes:

   If the positioning result satisfies the first condition and the other device and the electronic device are devices under the same user account, wake up the processor of the electronic device.
9. The method of claim 1, wherein the first operation includes controlling the electronic device to eject a card, and the card display content includes information related to the usage status of the other device.
10. The method of claim 1, further comprising:

    Obtain third data collected by the wireless medium in the electronic device;

    According to the third data, the step of determining whether there are other devices around the electronic device is performed.
11. The method of claim 10, wherein the wireless medium includes at least one of a Bluetooth chip and a wireless network communication technology chip.
12. A device for sensing equipment, characterized by including:

    The first determination module is used to determine whether there are other devices around the electronic device;

    An acquisition module, configured to acquire positioning results corresponding to the other devices when there are other devices around the electronic device;

    a second determination module, used to determine whether the positioning result satisfies the preset first condition;

    A wake-up module, configured to wake up the processor of the electronic device if the positioning result satisfies the first condition, and the processor performs a first operation corresponding to the other device after being awakened.
13. An electronic chip, characterized in that it includes: a processor for executing computer program instructions stored in a memory, wherein when the computer program instructions are executed by the processor, the electronic chip is triggered to execute the right The method described in any one of claims 1-11.
14. An electronic device, characterized in that the electronic device includes a memory for storing computer program instructions, a processor for executing computer program instructions, and a communication device, wherein when the computer program instructions are executed by the processor , triggering the electronic device to perform the method according to any one of claims 1-11.
15. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, and when it is run on a computer, it causes the computer to execute the method according to any one of claims 1-11 .
16. A computer program product, characterized in that the computer program product includes a computer program, which when the computer program is run on a computer, causes the computer to perform the method according to any one of claims 1-11.