CN118033541A - Spatial position determining method, system and equipment thereof - Google Patents
Spatial position determining method, system and equipment thereof Download PDFInfo
- Publication number
- CN118033541A CN118033541A CN202211393980.7A CN202211393980A CN118033541A CN 118033541 A CN118033541 A CN 118033541A CN 202211393980 A CN202211393980 A CN 202211393980A CN 118033541 A CN118033541 A CN 118033541A
- Authority
- CN
- China
- Prior art keywords
- electronic device
- audio signal
- analog audio
- processor
- electronic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 188
- 230000005236 sound signal Effects 0.000 claims abstract description 332
- 230000004044 response Effects 0.000 claims abstract description 35
- 230000033001 locomotion Effects 0.000 claims description 41
- 230000015654 memory Effects 0.000 claims description 25
- 230000007958 sleep Effects 0.000 claims description 25
- 238000004590 computer program Methods 0.000 claims description 8
- 230000006855 networking Effects 0.000 abstract description 22
- 238000004891 communication Methods 0.000 description 41
- 238000007726 management method Methods 0.000 description 37
- 230000006870 function Effects 0.000 description 22
- 239000010410 layer Substances 0.000 description 18
- 238000010586 diagram Methods 0.000 description 17
- 230000008569 process Effects 0.000 description 15
- 230000003993 interaction Effects 0.000 description 13
- 238000012545 processing Methods 0.000 description 13
- 238000010295 mobile communication Methods 0.000 description 12
- 238000001514 detection method Methods 0.000 description 9
- 230000001133 acceleration Effects 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 229920001621 AMOLED Polymers 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000003416 augmentation Effects 0.000 description 2
- 210000000988 bone and bone Anatomy 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000010791 quenching Methods 0.000 description 2
- 230000000171 quenching effect Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000012792 core layer Substances 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000002096 quantum dot Substances 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/18—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
- G01S5/22—Position of source determined by co-ordinating a plurality of position lines defined by path-difference measurements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/18—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W64/00—Locating users or terminals or network equipment for network management purposes, e.g. mobility management
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Telephone Function (AREA)
Abstract
The application discloses a method, a system and equipment for determining a spatial position, which can directly determine the spatial position without networking and authentication. A method comprising: the first electronic equipment controls the microphone to collect a first analog audio signal, and controls the loudspeaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, wherein the first analog audio signal is an audio signal played by the loudspeaker of the second electronic equipment, and the second analog audio signal is used for requesting to determine the space position between the electronic equipment; the first electronic device controls the microphone to collect a third analog audio signal, wherein the third analog audio signal is an audio signal played by a loudspeaker of the second electronic device and is used for informing a space position between the second electronic device and the first electronic device; the first electronic device obtains the spatial position between the second electronic device and the first electronic device through the third analog audio signal.
Description
Technical Field
The present application relates to the field of terminals, and in particular, to a method, a system, and an apparatus for determining a spatial location.
Background
At present, ultrasonic waves are part of sound waves, which are sound waves of frequencies above 20KHZ that are inaudible to the human ear. The ultrasonic wave has good directivity, can propagate in a certain direction and can be directionally collected, so that the determination of the distance between two electronic devices, the angle between two electronic devices and other spatial positions can be realized through the ultrasonic wave based on TOA (Time of Arrival) or TDOA (TIME DIFFERENCE of Arrival Time difference) and other methods. But two electronic devices are required to complete networking and authentication before determining the spatial location. Two electronic devices that do not complete networking and authentication cannot achieve spatial location determination.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a method, a system, and an apparatus for determining a spatial location, which can directly determine the spatial location without networking or authentication.
In a first aspect, an embodiment of the present application provides a spatial location determining method, applied to a system including a first electronic device and a second electronic device, where the method includes: the second electronic equipment controls a loudspeaker to play a first analog audio signal, and the first analog audio signal is used for indicating that the second electronic equipment is online; the first electronic equipment controls a microphone to collect the first analog audio signal, and controls a loudspeaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, wherein the second analog audio signal is used for requesting to determine the space position between electronic equipment; the second electronic device controls a microphone to collect the second analog audio signal and determines the spatial position between the second electronic device and the first electronic device according to the second analog audio signal; the second electronic device generates a third analog audio signal according to the spatial position between the second electronic device and the first electronic device, and controls the loudspeaker to play the third analog audio signal, wherein the third analog audio signal is used for informing the spatial position between the second electronic device and the first electronic device; the first electronic device controls the microphone to collect the third analog audio signal, and the spatial position between the second electronic device and the first electronic device is obtained through the third analog audio signal.
According to the first aspect of the application, the second electronic device plays the first analog audio signal through the loudspeaker, and the first electronic device collects the first analog audio signal through the microphone, so that networking authentication of the first electronic device and the second electronic device is not required before transmission, the first analog audio signal can be directly transmitted from the second electronic device to the first electronic device through the loudspeaker and the microphone, and the first electronic device can start detection of the relative position between the second electronic device and the first electronic device; the first electronic device plays the second analog audio signal through the loudspeaker, and the second electronic device collects the second analog audio signal through the microphone, so that the second electronic device can receive the second analog audio signal and determine the relative position between the second electronic device and the first electronic device according to the received second analog audio signal; the second electronic device plays the third analog audio signal through the loudspeaker, and the first electronic device collects the third analog audio signal through the microphone, so that networking authentication of the first electronic device and the second electronic device is not required before transmission, and the relative position between the second electronic device and the first electronic device can be directly transmitted from the second electronic device to the first electronic device through the loudspeaker and the microphone. Therefore, the determination of the spatial position can be directly carried out without networking and authentication.
According to some embodiments of the application, the second electronic device controlling the speaker to play the first analog audio signal includes: and after the second electronic equipment is dormant, if the motion sensor of the second electronic equipment detects that the motion state of the second electronic equipment is motion, stopping, and controlling the loudspeaker to play the first analog audio signal by the second electronic equipment. According to the application, after the second electronic equipment is dormant, the second electronic equipment can control the loudspeaker to play the first analog audio signal according to the motion state of the second electronic equipment detected by the motion sensor, so that the playing of the first analog audio signal can be started when the second electronic equipment is dormant.
According to some embodiments of the application, the second electronic device controlling the speaker to play the first analog audio signal includes: and if the second electronic equipment detects that the target application program is in the running state, the second electronic equipment controls the loudspeaker to play the first analog audio signal. According to the application, the loudspeaker is controlled to play the first analog audio signal through the operation of the target application program of the second electronic equipment, so that the playing of the first analog audio signal can be started when the second electronic equipment is not dormant.
According to some embodiments of the application, before the second electronic device controls the speaker to play the first analog audio signal, the method further comprises: the second electronic device performs binary coding on preset information, and codes the coded binary data into the first analog audio signal, wherein the preset information is used for indicating that the second electronic device is online, the first analog audio signal comprises at least one of a first chirp signal and a second chirp signal, the first chirp signal is used for indicating a binary code 0, and the second chirp signal is used for indicating a binary code 1. The application enables the first analog audio signal to carry preset information through the binary coded codes.
According to some embodiments of the application, the first electronic device includes a first processor, the first processor is in a sleep state, and after the first electronic device acquires a spatial location between the second electronic device and the first electronic device through the third analog audio signal, the method further includes: the first electronic device wakes up the first processor; and the first electronic equipment is used for displaying the icon of the second electronic equipment through the first processor according to the space position between the second electronic equipment and the first electronic equipment. According to the application, after the first processor enters the dormant state, the first electronic equipment can still determine the space position, so that the discovery of the equipment and the transmission of information can be realized under the dormant scene; meanwhile, after the space position is determined, the first processor is awakened to carry out screen quenching to display the icon of the second electronic device, and the user can be prompted in a screen quenching scene.
According to some embodiments of the application, the first electronic device displaying an icon of the second electronic device according to a spatial position between the second electronic device and the first electronic device in a screen-off manner includes: the first electronic device determines a target display position of an icon of the second electronic device according to the space position between the second electronic device and the first electronic device; and the first electronic equipment is in screen-off display at the target display position to display the icon of the second electronic equipment. According to the application, different collaboration modes can be performed subsequently by displaying the icons of the second electronic device at different positions according to the spatial positions between the second electronic device and the first electronic device.
According to some embodiments of the application, before the first electronic device controls the speaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, the method further comprises: before the first processor sleeps, a target application or an operating system of the first electronic device sends a subscription request to the first processor, wherein the subscription request is used for requesting to subscribe to a first type of space position between the electronic devices; the first electronic device generates the subscription information according to the subscription request through the first processor; the first electronic device stores the subscription information. According to the method and the device, the target application program or the operating system subscribes the space positions among the electronic devices to the first electronic device before the first processor sleeps, and stores the space information among the electronic devices, so that the pre-stored subscription information can be stored, and the pre-stored subscription information is directly used after the first processor sleeps.
According to some embodiments of the application, the first analog audio signal is further used to request a determination of a second type of relative position between the electronic devices; the first electronic device responding to the first analog audio signal and controlling the loudspeaker to play a second analog audio signal according to pre-stored subscription information comprises the following steps: and if the first analog audio signal is matched with the pre-stored subscription information, the first electronic device responds to the first analog audio signal and controls the loudspeaker to play the second analog audio signal according to the pre-stored subscription information. According to the application, the loudspeaker is controlled to play the second analog audio signal only when the first analog audio signal is matched with the pre-stored subscription information, so that the waste of determining the space position when the first analog audio signal is not matched with the pre-stored subscription information can be avoided.
According to some embodiments of the application, the type of spatial location between the electronic devices includes relative location between the electronic devices and distance information between the electronic devices. The application can realize the determination of various spatial positions by the types of the spatial positions among the electronic devices, including the relative positions among the electronic devices and the distance information among the electronic devices.
According to some embodiments of the application, after the first electronic device turns off the screen to display the icon of the second electronic device, the method further comprises: the first electronic device cooperates with the second electronic device in response to an operation on an icon of the second electronic device. According to the application, the first electronic equipment and the second electronic equipment are cooperated, so that the cross-equipment resource sharing and the cooperative operation can be realized.
In a second aspect, an embodiment of the present application further provides a spatial location determining method, the method including: the method comprises the steps that a first electronic device controls a microphone to collect a first analog audio signal, and controls a loudspeaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, wherein the first analog audio signal is an audio signal played by the loudspeaker of a second electronic device, the first analog audio signal is used for indicating that the second electronic device is online, and the second analog audio signal is used for requesting to determine the spatial position between the electronic devices; the first electronic device controls the microphone to collect a third analog audio signal, wherein the third analog audio signal is an audio signal played by the loudspeaker of the second electronic device, and the third analog audio signal is used for informing the spatial position between the second electronic device and the first electronic device; the first electronic device obtains the spatial position between the second electronic device and the first electronic device through the third analog audio signal.
According to some embodiments of the application, before the first electronic device controls the speaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, the method further comprises: the first electronic device decodes the first analog audio signal into binary data and decodes the binary data into preset information, wherein the first analog audio signal comprises at least one of a first chirp signal and a second chirp signal, the first chirp signal is used for representing a binary code 0, the second chirp signal is used for representing a binary code 1, and the preset information is used for representing that the second electronic device is online.
According to some embodiments of the application, the first electronic device includes a first processor, the first processor is in a sleep state, and after the first electronic device acquires a spatial location between the second electronic device and the first electronic device through the third analog audio signal, the method further includes: the first electronic device wakes up the first processor; and the first electronic equipment is used for displaying the icon of the second electronic equipment through the first processor according to the space position between the second electronic equipment and the first electronic equipment.
According to some embodiments of the application, the first electronic device displaying an icon of the second electronic device according to a spatial position between the second electronic device and the first electronic device in a screen-off manner includes: the first electronic device determines a target display position of an icon of the second electronic device according to the space position between the second electronic device and the first electronic device; and the first electronic equipment is in screen-off display at the target display position to display the icon of the second electronic equipment.
According to some embodiments of the application, before the first electronic device controls the speaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, the method further comprises: before the first processor sleeps, a target application or an operating system of the first electronic device sends a subscription request to the first processor, wherein the subscription request is used for requesting to subscribe to a first type of space position between the electronic devices; the first electronic device generates the subscription information according to the subscription request through the first processor; the first electronic device stores the subscription information.
According to some embodiments of the application, the first analog audio signal is further used to request a determination of a second type of relative position between the electronic devices; the first electronic device responding to the first analog audio signal and controlling the loudspeaker to play a second analog audio signal according to pre-stored subscription information comprises the following steps: and if the first analog audio signal is matched with the pre-stored subscription information, the first electronic device responds to the first analog audio signal and controls the loudspeaker to play the second analog audio signal according to the pre-stored subscription information.
According to some embodiments of the application, the type of spatial location between the electronic devices includes relative location between the electronic devices and distance information between the electronic devices.
According to some embodiments of the application, after the first electronic device turns off the screen to display the icon of the second electronic device, the method further comprises: the first electronic device cooperates with the second electronic device in response to an operation on an icon of the second electronic device.
In a third aspect, an embodiment of the present application further provides a spatial location determining method, applied to a first electronic device, where the first electronic device includes a first processor and a second processor, where the second processor is connected to the first processor, and an operation power consumption of the second processor is smaller than an operation power consumption of the first processor, and the method includes: the second processor controls the microphone to collect a first analog audio signal, and controls the loudspeaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, wherein the first analog audio signal is an audio signal played by the loudspeaker of the second electronic device, the first analog audio signal is used for indicating that the second electronic device is online, the second analog audio signal is used for requesting to determine the spatial position between the electronic devices, and the pre-stored subscription information comprises a subscriber; the second processor controls the microphone to collect a third analog audio signal, wherein the third analog audio signal is an audio signal played by the loudspeaker of the second electronic device, and the third analog audio signal is used for notifying the spatial position between the second electronic device and the first electronic device; the second processor sends, via the first processor, a spatial location between the second electronic device and the first electronic device in the third analog audio signal to the subscriber.
According to some embodiments of the application, before the second processor controls the microphone to collect the first analog audio signal, the method further comprises: the first processor enters a dormant state; before the second processor sends, via the first processor, the spatial location between the second electronic device and the first electronic device in the third analog audio signal to the subscriber, the method further comprises: the second processor wakes up the first processor.
According to some embodiments of the application, before the first processor enters the sleep state, the method further comprises: the subscriber sends a subscription request to the first processor, wherein the subscription request is used for requesting to subscribe to a first type of space position between electronic devices; the subscriber comprises a target application program or an operating system; the first processor generates the subscription information according to the subscription request; and the first processor sends the subscription information to the second processor for storage.
According to some embodiments of the application, the first processor is an application processor and the second processor is an audio digital signal processor.
According to some embodiments of the application, before the second processor controls the speaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, the method further comprises: the second processor decodes the first analog audio signal into binary data and decodes the binary data into the preset information, wherein the first analog audio signal comprises at least one of a first chirp signal and a second chirp signal, the first chirp signal is used for representing a binary code 0, the second chirp signal is used for representing a binary code 1, and the preset information is used for representing that the second electronic device is online.
According to some embodiments of the application, after the second processor transmits the spatial location between the second electronic device and the first electronic device in the third analog audio signal to the subscriber through the first processor, the method further comprises: the first electronic device cooperates with the second electronic device.
In a fourth aspect, an embodiment of the present application further provides a spatial location determining method, the method including: the second electronic equipment controls a loudspeaker to play a first analog audio signal, and the first analog audio signal is used for indicating that the second electronic equipment is online; the second electronic equipment controls a microphone to collect a second analog audio signal, and determines the space position between the second electronic equipment and the first electronic equipment according to the second analog audio signal, wherein the second analog audio signal is an audio signal played by a loudspeaker of the first electronic equipment, and the second analog audio signal is used for requesting to determine the space position between the electronic equipment; the second electronic device generates a third analog audio signal according to the spatial position between the second electronic device and the first electronic device, and controls the loudspeaker to play the third analog audio signal, wherein the third analog audio signal is used for informing the spatial position between the second electronic device and the first electronic device.
According to some embodiments of the application, the second electronic device controlling the speaker to play the first analog audio signal includes: and after the second electronic equipment is dormant, if the motion sensor of the second electronic equipment detects that the motion state of the second electronic equipment is motion, stopping, and controlling the loudspeaker to play the first analog audio signal by the second electronic equipment.
According to some embodiments of the application, the second electronic device controlling the speaker to play the first analog audio signal includes: and if the second electronic equipment detects that the target application program is in the running state, the second electronic equipment controls the loudspeaker to play the first analog audio signal.
According to some embodiments of the application, before the second electronic device controls the speaker to play the first analog audio signal, the method further comprises: the second electronic device performs binary coding on preset information, and codes the coded binary data into the first analog audio signal, wherein the preset information is used for indicating that the second electronic device is online, the first analog audio signal comprises at least one of a first chirp signal and a second chirp signal, the first chirp signal is used for indicating a binary code 0, and the second chirp signal is used for indicating a binary code 1.
In a fifth aspect, an embodiment of the present application further provides a spatial position determination system, the system comprising a first electronic device for performing the method of the second aspect above, or of any one of the possible embodiments of the third aspect above, and a second electronic device for performing the method of any one of the possible embodiments of the fourth aspect above.
In a sixth aspect, an embodiment of the application also provides an electronic device comprising at least one processor, a memory, a speaker, and a microphone; the at least one processor is coupled with the memory, the speaker, and the microphone; the memory is used for storing instructions, the processor is used for executing the instructions, the loudspeaker is used for playing audio signals, and the microphone is used for collecting audio signals; the instructions, when executed by the at least one processor, cause the at least one processor to perform the method as described above for any one of the possible embodiments of the first aspect, the second aspect, the third aspect, or the fourth aspect.
In a seventh aspect, an embodiment of the present application further provides a computer readable storage medium storing a program for causing a computer device to perform the method of the first aspect above, the second aspect above, the third aspect above, or any one of the possible embodiments of the fourth aspect above.
In an eighth aspect, an embodiment of the present application also provides a computer program product comprising computer-executable instructions stored in a computer-readable storage medium; at least one processor of an electronic device may read the computer-executable instructions from the computer-readable storage medium, the at least one processor executing the computer-executable instructions causing the electronic device to perform the method as described above for any one of the possible embodiments of the first aspect, the second aspect, the third aspect, or the fourth aspect. The advantages of the second to eighth aspects and various implementations of the present application may refer to the first aspect and various implementations thereof, and the analysis of the advantages of the first aspect, which are not described herein.
Drawings
Fig. 1 is a schematic diagram of prior art spatial position determination.
Fig. 2 is a schematic diagram of a spatial position determining system according to an embodiment of the present application.
Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Fig. 4 is a schematic software structure of an electronic device according to an embodiment of the present application.
Fig. 5 is a schematic diagram of a spatial position determining system according to an embodiment of the present application.
Fig. 6 is a schematic diagram of an encoding method according to an embodiment of the present application.
Fig. 7 is a schematic diagram of a spatial location determining method according to an embodiment of the present application.
Fig. 8 is an interface schematic diagram in a scenario in which both the first electronic device and the second electronic device are dormant, provided in the embodiment of the present application.
Fig. 9 is an interface schematic diagram of a screen-off display small bubble icon according to an embodiment of the present application.
Fig. 10 is a schematic diagram of a first electronic device and a second electronic device for collaborative office according to an embodiment of the present application.
Fig. 11 is an interface schematic diagram of a scenario in which a first electronic device is dormant and a second electronic device is not dormant according to an embodiment of the present application.
Fig. 12 is an interface schematic diagram of a scenario in which a first electronic device is not dormant and a second electronic device is dormant according to an embodiment of the present application.
Fig. 13 is an interface schematic diagram in a scenario where a first electronic device is not dormant and a second electronic device is not dormant according to an embodiment of the present application.
Fig. 14 is a flowchart of a spatial location determining method according to an embodiment of the present application.
Fig. 15 is a flowchart of another spatial position determining method according to an embodiment of the present application.
Detailed Description
In describing embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as examples, illustrations, or descriptions. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment should not be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. It should be understood that in the present application, unless otherwise indicated, "a plurality" means two or more than two.
The prior art provides a spatial position determining method, which can determine the relative position between electronic equipment A and electronic equipment B, and control the display interface of the electronic equipment B to serve as an expansion screen of the electronic equipment A according to the relative position. Specifically: as shown in fig. 1, electronic device a may include a first speaker and a second speaker, and electronic device B may include microphones, such as a first microphone and a second microphone. The electronic device a may first send a detection request to the electronic device B, where the detection request is used to request the electronic device a and the electronic device B to complete discovery and networking authentication, and determine a spatial location. Upon detection of the request, electronic device a and electronic device B may complete discovery and networking authentication to establish a wireless or wired communication link. The electronic device a may then transmit ultrasonic signals through the first speaker and the second speaker. The electronic device B may receive the ultrasonic signal through the microphone and determine a relative position between the electronic device a and the electronic device B according to the received ultrasonic signal. It is understood that before determining the relative position between the electronic device a and the electronic device B, the electronic device a may further send the first time, the second time, and the distance between the first speaker and the second speaker to the electronic device B through a wireless or wired communication link; the first moment is the moment when the first loudspeaker of the electronic equipment A sends the ultrasonic signal; the second moment is the moment when the second loudspeaker of the electronic equipment A sends the ultrasonic signal, so that the electronic equipment B determines the relative position between the electronic equipment A and the electronic equipment B according to the received ultrasonic signal, the first moment, the second moment and the distance. The electronic device B may also send the determined relative position between the electronic device a and the electronic device B to the electronic device a through the established wireless or wired communication link to extend the content displayed in the display interface on the electronic device a to the electronic device B for display. However, the spatial location determining method in the prior art relies on a communication unit, such as a soft bus, and needs to complete discovery and networking authentication of the electronic device a and the electronic device B first, which will result in slower establishment of a wireless communication link and higher time delay of spatial location determination.
In view of this, the embodiment of the application provides a spatial position determining method, which can directly determine the spatial position without networking and authentication.
Fig. 2 is a schematic diagram of a spatial location determining system according to an embodiment of the application. The spatial location determination system 2 may include a plurality of electronic devices 200. The electronic device 200 may be a device such as a cell phone, tablet computer, notebook computer, digital camera, personal Digital Assistant (PDA), wearable device, laptop computer (laptop), etc. Each electronic device 200 may include an audio transmitting unit and an audio receiving unit. The audio transmitting unit may transmit an analog audio signal, such as an ultrasonic signal, to the outside. The audio transmission unit may be, for example, a speaker or the like. The audio receiving unit may receive an external analog audio signal, such as an ultrasonic signal. The audio receiving unit may be, for example, a microphone or the like. For convenience of description, the present application will be described below by taking an audio transmitting unit as a speaker and an audio receiving unit as a microphone as an example. Each electronic device 200 may transmit analog audio signals through a speaker. Each electronic device 200 may also receive analog audio signals through a microphone. The plurality of electronic devices 200 may be a first electronic device 201 and a second electronic device 202, respectively. For convenience of description, the present application will be described below taking the number of second electronic devices 202 as one example. It is understood that the number of second electronic devices 202 may also be two or more, as the application is not limited in this regard.
The first electronic device 201 and the second electronic device 202 may each be installed with an application program, such as a WPS (word processing system, text editing system) application, a camera application, or the like, that can make use of spatial location information between the electronic devices for multi-device collaboration. The spatial location information between electronic devices utilized by different applications may be different, and different applications may subscribe to the spatial location information between different electronic devices. For example, if the spatial location information between electronic devices utilized by the WPS application is a relative location between electronic devices, the WPS application may subscribe to the relative location between the electronic devices; the spatial location information between the electronic devices utilized by the camera application is distance information between the electronic devices, and the camera application may subscribe to the distance information between the electronic devices. For convenience of description, the present application will be described below by taking an example in which the WPS application is installed in each of the first electronic device 201 and the second electronic device 202. It is understood that the spatial location information between electronic devices utilized by different applications may be the same, and that different applications may subscribe to the spatial location information between the same electronic devices, which is not limiting to the application.
In one possible implementation, the second electronic device 202 may be dormant, and if a predetermined condition is met, for example, if the second electronic device 202 is detected to stop moving, the second electronic device 202 may periodically send a first analog audio signal through the speaker in response to the predetermined condition being met. In another possible implementation, the second electronic device 202 may send a first analog audio signal periodically through the speaker when the second electronic device 202 is on the screen, if a predetermined condition is met, for example, if the second electronic device 202 is running a WPS application in the foreground, in response to the predetermined condition being met. The first electronic device 201 may receive the first analog audio signal and identify that the second electronic device 202 is online based on the first analog audio signal. The first electronic device 201 also transmits a second analog audio signal over the speaker based on the spatial location information between the subscribed electronic devices. The second electronic device 202 may receive the second analog audio signal and determine a relative position between the corresponding electronic devices based on the second analog audio signal, e.g., determine that the second electronic device 202 is located to the left of the first electronic device 201. The second electronic device 202 may transmit a third analog audio signal based on the determined relative position between the electronic devices. The first electronic device 201 may receive the third analog audio signal. In one possible implementation, the first electronic device 201 may wake up the first processor, e.g., the AP (application processor ), according to the third analog audio signal while dormant, and transmit the determined relative position between the electronic devices to the WPS application via the first processor for extended display by the WPS application. In another possible implementation manner, the first electronic device 201 may directly transmit, when the screen is on, the determined relative position between the electronic devices to the WPS application through the first processor, so that the WPS application may perform extended display.
Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device 200 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
It should be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 200. In other embodiments of the application, electronic device 200 may include more or fewer components than shown, or certain components may be combined, or certain components may be separated, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (IMAGE SIGNAL processor, ISP), a controller, a video codec, a digital signal processor (DIGITAL SIGNAL processor, DSP), a baseband processor, and/or a neural-Network Processor (NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors 110.
The processor 110 may generate operation control signals according to the instruction operation code and the timing signals to complete instruction fetching and instruction execution control.
A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 may be a cache memory. The memory may hold instructions or data that are used or used more frequently by the processor 110. If the processor 110 needs to use the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.
In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-INTEGRATED CIRCUIT, I2C) interface, an integrated circuit built-in audio (inter-INTEGRATED CIRCUIT SOUND, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others. The processor 110 may be connected to the touch sensor, the audio module, the wireless communication module, the display, the camera, etc. module through at least one of the above interfaces.
It should be understood that the connection relationship between the modules illustrated in the embodiment of the present application is only illustrative, and does not limit the structure of the electronic device 200. In other embodiments of the present application, the electronic device 200 may also employ different interfacing manners, or a combination of interfacing manners, as in the above embodiments.
The USB interface 130 is an interface conforming to the USB standard, and may be used to connect a display device and a peripheral device, specifically, a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.
The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 140 may receive a charging input of a wired charger through the USB interface 130. In some wireless charging embodiments, the charge management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 200. The charging management module 140 may also supply power to the electronic device 200 through the power management module 141 while charging the battery 142.
The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 to power the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.
The wireless communication function of the electronic device 200 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 200 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied on the electronic device 200. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.
The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.
The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (WIRELESS FIDELITY, wi-Fi) network), bluetooth (BT), bluetooth low energy (bluetooth low energy, BLE), ultra Wide Band (UWB), global navigation satellite system (global navigation SATELLITE SYSTEM, GNSS), frequency modulation (frequency modulation, FM), near field communication (NEAR FIELD communication, NFC), infrared (IR), etc. applied on the electronic device 200. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.
In some embodiments, antenna 1 and mobile communication module 150 of electronic device 200 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that electronic device 200 may communicate with networks and other electronic devices 200 through wireless communication techniques. The wireless communication techniques can include a global system for mobile communications (global system for mobile communications, GSM), general packet radio service (GENERAL PACKET radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation SATELLITE SYSTEM, GLONASS), a beidou satellite navigation system (beidou navigation SATELLITE SYSTEM, BDS), a quasi zenith satellite system (quasi-zenith SATELLITE SYSTEM, QZSS) and/or a satellite based augmentation system (SATELLITE BASED AUGMENTATION SYSTEMS, SBAS).
The electronic device 200 may implement display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a Liquid Crystal Display (LCD) CRYSTAL DISPLAY, an organic light-emitting diode (OLED), an active-matrix organic LIGHT EMITTING diode (AMOLED), a flexible light-emitting diode (FLED), miniled, microLed, micro-oLed, a quantum dot LIGHT EMITTING diode (QLED), or the like. In some embodiments, the electronic device 200 may include 1 or more display screens 194.
The electronic device 200 may implement camera functions through a camera 193, an isp, a video codec, a GPU, a display screen 194, an application processor AP, a neural network processor NPU, and the like.
The camera 193 may be used to acquire color image data of a photographing object as well as depth data. The ISP may be used to process color image data acquired by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, so that the electrical signal is converted into an image visible to the naked eye. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.
The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 200. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions.
The internal memory 121 may be used to store computer executable program code that includes instructions. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 200 (e.g., digital audio data, phonebook, etc.), and so forth. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like. The processor 110 performs various functional methods or data processing of the electronic device 200 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
The electronic device 200 may implement audio functions through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, and application processor, etc. Such as music playing, recording, etc.
The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.
The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 200 may listen to music through the speaker 170A or output an audio signal for handsfree talk.
A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When the electronic device 200 is answering a telephone call or voice message, the voice can be received by placing the receiver 170B close to the human ear.
Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals.
The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be a USB interface 130 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
The keys 190 may include a power on key, a volume key, etc.
The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration alerting as well as for touch vibration feedback.
The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.
The SIM card interface 195 is used to connect a SIM card.
Fig. 4 is a schematic diagram of a logic structure of an electronic device according to an embodiment of the application.
The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into five layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun rows (Android runtime, ART) and native C/c++ libraries, a hardware abstraction layer (Hardware Abstract Layer, HAL), and a kernel layer, respectively. It will be appreciated that the Android system is illustrated herein, and in other operating systems (e.g., hong-mong system, IOS system, etc.), the scheme of the present application can be implemented as long as the functions implemented by the respective functional modules are similar to those implemented by the embodiments of the present application.
The application layer may include a series of application packages.
As shown in fig. 4, the application package may include applications such as cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, WPS applications, etc.
The application framework layer provides an application programming interface (application programming interface, API) and programming framework for the application of the application layer. The application framework layer includes a number of predefined functions.
As shown in FIG. 4, the application framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, an activity manager, an input manager, and so forth.
The Window manager provides a Window management service (Window MANAGER SERVICE, WMS), and WMS may be used for Window management, window animation management, surface management, and as a transfer station for an input system.
The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.
The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.
The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.
The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.
The activity manager may provide an activity management service (ACTIVITY MANAGER SERVICE, AMS), and the AMS may be used for system component (e.g., activity, service, content provider, broadcast receiver) start-up, handoff, scheduling, and application process management and scheduling tasks.
The Input manager may provide an Input management service (Input MANAGER SERVICE, IMS) and the IMS may be used to manage inputs to the system, such as touch screen inputs, key inputs, sensor inputs, etc. The IMS retrieves events from the input device node and distributes the events to the appropriate windows through interactions with the WMS.
The android runtime includes a core library and An Zhuoyun rows. The android runtime is responsible for converting source code into machine code. Android runtime mainly includes employing Advanced Or Time (AOT) compilation techniques and Just In Time (JIT) compilation techniques.
The core library is mainly used for providing the functions of basic Java class libraries, such as basic data structures, mathematics, IO, tools, databases, networks and the like. The core library provides an API for the user to develop the android application.
The native C/c++ library may include a plurality of functional modules. For example: surface manager (surface manager), media Framework (Media Framework), libc, openGL ES, SQLite, webkit, etc.
The surface manager is used for managing the display subsystem and providing fusion of 2D and 3D layers for a plurality of application programs. Media frames support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc. OpenGL ES provides for drawing and manipulation of 2D graphics and 3D graphics in applications. SQLite provides a lightweight relational database for applications of electronic devices.
The hardware abstraction layer runs in a user space (user space), encapsulates the kernel layer driver, and provides a call interface to the upper layer.
The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.
Referring to fig. 5, a schematic diagram of a spatial position determining system 5 according to an embodiment of the present application is shown. The spatial location determination system 5 comprises a plurality of electronic devices 500. The electronic device 500 may be a device such as a cell phone, tablet, notebook, digital camera, personal Digital Assistant (PDA), wearable device, laptop (laptop), etc. Each electronic device 500 may include a speaker 510, a microphone 520, a target application 530, an SDK (software development kit ) 540, a first processor 550, and a second processor 560. The number of speakers 510 may be one or more. The speaker 510 is used to transmit analog audio signals, such as ultrasonic signals. The number of microphones 520 may be one or more. Microphone 520 is used to receive analog audio signals, such as ultrasonic signals.
The target application 530 may be an application that may utilize spatial location information between electronic devices for multi-device collaboration. Illustratively, the target application 530 may be a WPS application.
The SDK540 may be an SDK of an application program having a spatial location management function. The SDK540 may be loaded into the WPS application in WPS application packaging and may run in the WPS application as the WPS application is launched. The WPS application may call the SDK540 to send a subscription request to an application program having a spatial location management function. The subscription request is used to request spatial location information between subscribing electronic devices, e.g., to request a relative location between subscribing electronic devices. Thus, the application program with the spatial position management function can determine the WPS application as the target application subscribed to the relative position between the electronic devices, and when the application program with the spatial position management function acquires the relative position between the electronic devices, the application program with the spatial position management function can send the relative position between the electronic devices to the target application. When the user closes the WPS application, the SDK540 may be closed as the WPS application is closed. It is to be appreciated that the SDK540 may also be loaded into the WPS application when the WPS application is running, and may be run in the WPS application as the WPS application is running, as the application is not limited in this regard.
The first processor 550 may be used to enable interaction with the target application 530 and the second processor 560, for example, may be used to enable subscription of spatial location information between electronic devices, transfer information to the second processor 560, and receive information transferred by the second processor 560. The first processor 550 may be a stand-alone application processor (Application Processor, AP). The first processor 550 may be used to run system software, for example, the first processor 550 is used to run operating system software. The operating system software may be, for example, at least one of a hong Meng HarmonyOS system, an Android system, an iOS system, or a Linux system; the operating system software may also include other driver software or platform software besides applications, such as open source system software, middleware, or the like. The first processor 550 may also store instructions of some applications, such as applications with spatial location management functions. The first processor 550 may run instructions of an application program having a spatial location management function. The first processor 550 may also run applications, such as the target application 530 and the SDK540, etc., that are disposed outside the first processor 550. These applications may all run on an operating system. Fig. 5 illustrates an example in which the target application 530 and the SDK540 are disposed outside the first processor 550, but it is understood that the target application 530 and the SDK540 may be integrated into the first processor 550, which is not limited thereto by the present application. The first processor 550 may also enter a sleep state when the electronic device 500 is asleep, stopping running operating system software, and applications within and outside the first processor. In some embodiments, subscription management module 551 and HIFI interaction module 552 may be included in first processor 550.
The subscription management module 551 may be configured to receive a subscription request sent by the target application 530 through the SDK 540, for example, receive a subscription request sent by the WPS application through the SDK 540. The subscription management module 551 may also be used to generate subscription information according to subscription requests. It will be appreciated that if multiple different target applications 530 subscribe to spatial location information between the same electronic devices through the SDK 540, the subscription management module 551 may combine multiple subscription requests to generate subscription information, which is not limiting in the present application.
HIFI interaction module 552 is operable to enable interaction of data and control information between first processor 550 and second processor 560, such as for enabling transmission of subscription information to second processor 560, receipt of wake-up signals sent by second processor 560, receipt of spatial location information between electronic devices sent by second processor 560, and the like.
The second processor 560 may be used to implement processing related to interaction with other electronic devices, such as encoding and decoding of transmitted signals, discovery of other electronic devices, determining spatial location information with other electronic devices, and so forth. The second processor 560 may also be used to wake up the first processor 550. The second processor 560 may be a high-fidelity (HIGH FIDELITY, HIFI) device. The second processor 560 may be a separate low power sound processing chip, such as an ADSP (audio DIGITAL SIGNAL processor). The second processor 560 may operate with low power consumption when the electronic device 500 is dormant, which may greatly reduce power consumption. Second processor 560 may receive subscription information sent by first processor 550 via HIFI interaction module 552 and store the subscription information. Thus, even if the first processor 550 is dormant, the second processor 560 may control the speaker 510 to play a corresponding analog audio signal according to the stored subscription information.
The second processor 560 may have stored therein some instructions. The second processor 560 may execute instructions to perform some functions. In some embodiments, a signal codec module 561, a device discovery module 562, and a device ranging module 563 may be included in the second processor 560.
In some embodiments, the device discovery module 562 may be configured to, when the electronic device 500 is on-screen, notify the signal codec module 561 to convert the first information into the first analog audio signal according to the first preset encoding method if the WPS application is detected to be running in the foreground of the electronic device 500.
The device discovery module 562 may be further configured to, when the electronic device 500 is dormant, notify the signal codec module 561 to convert the first information into the first analog audio signal according to the first preset encoding method if the electronic device 500 stops after detecting the movement.
The signal codec module 561 may be configured to convert the first information into a first analog audio signal according to a first preset encoding method for playing by the speaker 510. Specifically, as shown in fig. 6, the signal encoding and decoding module 561 may be used to convert the first information into the first ultrasonic signal according to the first preset encoding method. The first ultrasonic signal may be, for example, a chirp signal or the like. Wherein the first chirp signal may represent a binary code 1 and the second chirp signal may represent a binary code 0. In some embodiments, the frequency of the first chirp signal may increase linearly with time and the frequency of the second chirp signal may decrease linearly with time. It is appreciated that in other embodiments, the frequency of the first chirp signal may decrease linearly with time and the frequency of the second chirp signal may increase linearly with time; the frequency of the first chirp signal and the frequency of the second chirp signal may also be non-linearly increasing and non-linearly decreasing, as the application is not limited in this respect. The first ultrasonic signal may comprise a plurality of chirp signals that are consecutive in time and may represent a segment of binary data. This piece of binary data may be used to represent one or more hexadecimal numbers. The one or more hexadecimal numbers may represent preset information. In fig. 6, the X-axis represents time, the Y-axis represents frequency, and from time t0 to time t8, the ultrasonic signal may include eight chirp signals that are consecutive in time, being "chirp 0", "chirp 1", "chirp 2", "chirp3", "chirp 4", "chirp 5", "chirp 6", "chirp 7". Wherein, "chirp 0", "chirp 1", "chirp 4" are all first chirp signals, "chirp 2", "chirp3", "chirp 5", "chirp 6", "chirp 7" are all second chirp signals. In fig. 6, the time length of each chirp signal is the same, and the frequency of each chirp signal varies between the first frequency F0 and the second frequency F1. The ultrasonic signal in fig. 6 may represent 8-bit binary data "11001000". Wherein every four consecutive digits of binary data in 8-digit binary data may represent a hexadecimal number, the ultrasonic signal in fig. 6 may represent hexadecimal number "C8". In some embodiments, the first ultrasonic signal may also carry a unique identifier of the electronic device 500. The unique identification information of the electronic device 500 may be a unique identifier formed by processing hardware information of the electronic device 500. The unique identifier of the electronic device 500 may also be some hardware information of the electronic device 500, such as a bluetooth MAC address, etc., and the present application is not limited to the unique identifier of the electronic device 500. It is understood that every four consecutive digits of binary data in 8-digit binary data may also represent a decimal number; the preset information can also be other hexadecimal numbers, such as hexadecimal number "A8" and the like; the encoding method may also be other encoding methods, which the present application is not limited to.
The signal codec module 561 may also be used to convert the analog audio signal collected by the microphone 520 into corresponding information. For example, the signal codec module 561 may convert the second analog audio signal collected by the microphone 520 into second information, which is digital audio information. The second information is used to determine a relative position between the electronic devices.
The signal codec module 561 may be further configured to convert the third information into a third analog audio signal according to a third preset encoding method, for example, convert a relative position between electronic devices into a third ultrasonic signal for playing by the speaker 510. The third predetermined encoding method may be different from the first predetermined encoding method. It is understood that the third preset encoding method may be the same as the first preset encoding method, which is not limited by the present application.
The device ranging module 563 may also be configured to determine a relative position between the electronic devices based on the second audio signal converted by the signal codec module 561.
In other embodiments, the signal codec module 561 may also be used to convert the analog audio signal collected by the microphone 520 into a corresponding signal. For example, the signal codec module 561 may convert the first analog audio signal collected by the microphone 520 into preset information and a unique identifier of the electronic device 500; the signal codec module 561 may convert the third analog audio signal collected by the microphone 520 into a relative position between the electronic devices.
The signal codec module 561 may be further configured to convert the second information into a second analog audio signal according to a second preset encoding method, for example, convert the digital audio information into a second ultrasonic signal for playing by the speaker 510. The second predetermined encoding method may be different from the first predetermined encoding method. It is understood that the second preset encoding method may be the same as the first preset encoding method, which is not limited by the present application.
The device discovery module 562 may be configured to discover that other electronic devices are online according to the preset information converted by the signal encoding/decoding module 561. In some embodiments, the device discovery module 562 may be configured to discover that the corresponding electronic device is online according to the preset information converted by the signal codec module 561 and the unique identifier of the electronic device 500.
The device ranging module 563 may be configured to play the second analog audio signal through the speaker 510 according to the stored subscription information when the device discovery module 562 discovers that other electronic devices are online. In some embodiments, the spatial location information between electronic devices subscribed to by the WPS application is a relative location between the electronic devices.
The second processor 560 may also be configured to send a wake-up signal to the HIFI interaction module 552 of the first processor 550 to wake up the first processor 550 when the first processor 550 is asleep. The second processor 560 may also be configured to send the relative location between the electronic devices to the WPS application when the WPS application is in a foreground operating state.
It is understood that the signal codec module 561 may also be a separate audio codec chip, which is not limited in this regard by the present application.
In some embodiments, the plurality of electronic devices 500 may be a first electronic device 501 and a second electronic device 502, respectively. For convenience of description, the present application will be described below by taking the example that the first electronic device 501 is a notebook computer and the second electronic device 502 is a mobile phone.
Fig. 7 is a schematic diagram of a spatial location determining method according to an embodiment of the application. The spatial position determination method is applicable to the spatial position determination system shown in fig. 5. The spatial location determination method can be applied to a scene where both the first electronic device and the second electronic device are dormant. In a scenario where both the first electronic device and the second electronic device are dormant, as shown in fig. 8, both the screen of the first electronic device 801 and the screen of the second electronic device 802 are closed. When the first electronic device and the second electronic device are dormant, the first processor of the first electronic device and the first processor of the second electronic device are in a dormant state and do not operate any more, but the second processor of the first electronic device and the second processor of the second electronic device are not dormant and are in an operating state. In fig. 7, step S701 is performed by the first processor of the first electronic device, steps S702 to S717 are performed by the second processor of the first electronic device or the second processor of the second electronic device, and step S718 is performed by the first processor of the first electronic device.
The spatial position determining method comprises the following steps:
S701: before the first electronic device sleeps, the target application of the first electronic device subscribes to the relative location between the electronic devices.
The target application of the first electronic device subscribes to the relative location between the electronic devices through the SDK to the first processor of the first electronic device. The SDK may be loaded into the target application in the target application package and may run in the target application as the target application is launched. The target application may invoke the SDK to send a subscription request to a first processor including an application having spatial location management functionality. The subscription request is used to request a relative location between subscribing electronic devices. The first processor may receive a subscription request sent by the target application through the SDK and generate subscription information according to the subscription request. The first processor may determine, according to the subscription information, the target application program as a target application subscribed to the relative location between the electronic devices, and when the first processor obtains the relative location between the electronic devices, the first processor may send the relative location between the electronic devices to the target application. When the user closes the target application, the SDK is closed as the target application closes. It will be appreciated that the SDK may also be loaded into the target application program when the target application program is running, and may be run in the target application program as the target application program is running, as the application is not limited in this respect. In some embodiments, the first processor of the first electronic device also sends subscription information to the second processor for saving prior to the first electronic device hibernating. Thus, after the first electronic device sleeps, the first processor of the first electronic device is also in a sleep state and no longer operates, and the target application of the first electronic device and the SDK of the first electronic device are also closed, but the second processor of the first electronic device is not dormant and subscription information is stored.
It will be appreciated that the target application may also unsubscribe the first processor of the first electronic device from the relative location between the subscribing electronic devices, and the first processor of the first electronic device may send deletion information to the second processor to delete the subscription information, as the application is not limited in this respect.
In some embodiments, the steps of generating subscription information and unsubscribing information may be performed by a subscription management module of the first electronic device. The subscription management module of the first electronic device may be the subscription management module of the electronic device of the spatial location determination system shown in fig. 5.
In some embodiments, the steps of sending subscription information and sending deletion information to the second processor may be performed by a HIFI interaction module of the first electronic device. The HIFI interaction module of the first electronic device may be the HIFI interaction module of the electronic device of the spatial location determination system shown in fig. 5.
S702: after the second electronic device sleeps, the second electronic device detects that the second electronic device meets the preset condition.
In some embodiments, the second electronic device may include a motion sensor. The motion sensor may be used to detect a motion state of the second electronic device. The second electronic device can judge whether the second electronic device meets the preset condition according to the motion state of the second electronic device detected by the motion sensor. When the motion state of the second electronic device detected by the motion sensor is that the second electronic device stops after the motion, the second electronic device detects that the second electronic device meets the preset condition. Otherwise, the second electronic device detects that the second electronic device does not meet the preset condition. In some embodiments, the motion state of "stop after motion" may correspond to the following scenario: after the user holds the dormant second electronic device and moves the dormant second electronic device to a position near the dormant first electronic device, the dormant second electronic device is not moved. The second electronic device may be preset with a detection algorithm for detecting whether a motion stop state occurs after motion.
In some embodiments, the motion sensor may be a speed sensor. The speed sensor may be used to detect a speed of movement of the second electronic device. When the movement speed of the second electronic equipment detected by the speed sensor is changed from being greater than the first preset value to 0, the speed sensor stops after detecting that the movement state of the second electronic equipment is movement.
In some embodiments, the motion sensor may be an acceleration sensor. The acceleration sensor may be used to detect the magnitude of acceleration of the second electronic device in various directions, typically three axes. When the acceleration of the second electronic device detected by the acceleration sensor changes from being smaller than a second preset value to 0, the acceleration sensor stops after detecting that the motion state of the second electronic device is motion.
It is understood that the motion sensor may also be other sensors, as the application is not limited in this regard.
In some embodiments, step S702 may be accomplished by a device discovery module of the second electronic device. The device discovery module of the second electronic device may be the device discovery module of the electronic device of the spatial location determination system shown in fig. 5.
S703: the second electronic device converts the first information into a first analog audio signal according to a first preset encoding method.
In some embodiments, the second electronic device may convert the first information into the first ultrasonic signal according to a first preset encoding method. The first information may include preset information. The preset information may be, for example, a hexadecimal number "C8". The first ultrasonic signal may comprise a plurality of chirp signals that are consecutive in time. The frequency of the Chirp signal may increase linearly with time or decrease linearly with time. A plurality of temporally successive chirp signals may represent a segment of binary data that may be used to represent one or more hexadecimal numbers such that the first ultrasonic signal may represent preset information. The preset information may be used to indicate that the device is online. In some embodiments, the preset information may also be used to request a determination of the relative location between the electronic devices. It will be appreciated that, according to the difference of the application program installed by the second electronic device, or according to the negotiation between the second electronic device and the first electronic device, etc., the preset information may be other information, and the spatial location information between the electronic devices that is requested to be determined by the different preset information is different, for example, the hexadecimal number "A8" may be used to request the determination of the distance information between the electronic devices, which is not limited in this aspect of the application.
In some embodiments, the first information may further comprise a unique identifier of the second electronic device, and the first ultrasonic signal may further carry the unique identifier of the second electronic device. The unique identifier of the electronic device may also be some hardware information of the electronic device, such as a bluetooth MAC address or the like. The unique identification information of the electronic equipment can be a unique identifier formed by processing hardware information of the electronic equipment, and the unique identifier of the electronic equipment is not limited by the application. The unique identifier of the second electronic device may be used to identify the second electronic device.
In some embodiments, step S703 may be performed by a signal codec module of the second electronic device. The signal codec module of the second electronic device may be the signal codec module of the electronic device in the spatial location determination system shown in fig. 5. The signal codec module of the second electronic device may also be a separate audio codec chip that the second electronic device is self-contained.
S704: the second electronic device plays the first analog audio signal through the speaker.
The first analog audio signal may be used to indicate that the device is online. In some embodiments, the first analog audio signal may be used to indicate that the second electronic device is online. In some embodiments, the first analog audio signal may also be used to request a determination of a relative location between the electronic devices.
S705: the first electronic device collects first analog audio signals through a microphone.
In some embodiments, the second electronic device plays the first analog audio signal through the speaker, and the first electronic device collects the first analog audio signal through the microphone, so that networking authentication of the first electronic device and the second electronic device is not required before transmission, and preset information can be directly transmitted from the second electronic device to the first electronic device through the speaker and the microphone, so that the subsequent first electronic device can start detection of the relative position between the second electronic device and the first electronic device.
S706: the first electronic device converts the first analog audio signal into first information according to a first preset decoding method.
In some embodiments, the first preset decoding method refers to a decoding method corresponding to the first preset encoding method.
In some embodiments, the first electronic device may convert the first analog audio signal into the first information according to a first preset decoding method. The first information may include preset information. The preset information may be, for example, a hexadecimal number "C8". The preset information may be used to indicate that the device is online. The first information may also include a unique identifier of the second electronic device.
In some embodiments, the preset information may also be used to request a determination of the relative location between the electronic devices.
In some embodiments, step S706 may be accomplished by a signal codec module of the first electronic device. The signal codec module of the first electronic device may be the signal codec module of the electronic device in the spatial location determination system shown in fig. 5. The signal codec module of the first electronic device may also be a separate audio codec chip that is self-contained with the first electronic device.
S707: the first electronic device determines that the second electronic device is online according to the first information.
In some embodiments, the first electronic device may determine that the second electronic device is online based on the preset information in the first information and the unique identifier of the second electronic device. When the first electronic device plays the analog audio signal in the subsequent process, the first electronic device can carry the unique identifier of the second electronic device at the same time, so that the second electronic device processes the analog audio signal after receiving the analog audio signal, and other electronic devices do not process the analog audio signal.
In some embodiments, step S707 may be accomplished by a device discovery module of the first electronic device. The device discovery module of the first electronic device may be the device discovery module of the electronic device of the spatial location determination system shown in fig. 5.
After determining that the second electronic device is online, the first electronic device may begin detection of the relative location between the second electronic device and the first electronic device.
S708: if the first information is matched with the subscription information, the first electronic equipment converts the second information into a second analog audio signal according to a second preset encoding method.
In some embodiments, the second processor of the first electronic device pre-stores subscription information. The first electronic device may determine whether spatial location information between the electronic devices requested to be determined by preset information in the first information matches with subscription information. If the space position information between the electronic devices, which is requested to be determined by the preset information in the first information, is the same as the subscription information, the first electronic device determines that the first information is matched with the subscription information. Wherein the identity may comprise the exact identity, or may comprise the substantial identity. The substantial identity may be determined by a preset rule, for example, the differences in fonts, simplified and traditional forms, etc. are substantially the same, and the substantial identity may be determined by setting fonts, simplified and traditional forms conversion, etc. If the space position information between the electronic devices, which is requested to be determined by the preset information in the first information, is different from the subscription information, the first electronic device determines that the first information is not matched with the subscription information. It can be appreciated that if the first information does not match the subscription information, the process ends.
For example, the preset information in the first information is "C8", the spatial position information between the electronic devices requested to be determined by the "C8" is the relative position between the electronic devices, and the subscription information is the relative position between the electronic devices, and then the first electronic device determines that the first information is matched with the subscription information. For another example, if the preset information in the first information is "A8", the spatial location information between the electronic devices requested to be determined by "A8" is distance information between the electronic devices, and the subscription information is a relative location between the electronic devices, then the first electronic device determines that the first information is not matched with the subscription information.
It will be appreciated that in other embodiments, the first electronic device may omit the process of determining the match, and directly encode according to the subscription information, which is not limited in the present application.
In some embodiments, the step of determining whether the first electronic device matches the second electronic device may be performed by a device ranging module of the first electronic device. The device ranging module of the first electronic device may be the device ranging module of the electronic device in the spatial location determination system shown in fig. 5.
In some embodiments, the second information may include digital audio information. In some embodiments, the second information may also include the first time, the second time, and a distance between the first speaker and the second speaker. The first moment is the moment when the first loudspeaker of the electronic equipment A sends the ultrasonic signal; the second time is the time when the second speaker of the electronic device a transmits the ultrasonic signal. In some embodiments, the step of converting the second information into the second analog audio signal may be performed by a signal codec module of the first electronic device. The signal codec module of the first electronic device may be the signal codec module of the electronic device in the spatial location determination system shown in fig. 5.
S709: the first electronic device plays the second analog audio signal through the speaker.
In some embodiments, the second analog audio signal is used to request a determination of a relative location between the electronic devices.
S710: the second electronic device collects a second analog audio signal through the microphone.
In some embodiments, the first electronic device plays the second analog audio signal through the speaker and the second electronic device collects the second analog audio signal through the microphone, so that the second electronic device may receive the second signal and determine a relative position between the second electronic device and the first electronic device based on the received second signal.
S711: the second electronic device converts the second analog audio signal into second information according to a second preset decoding method.
In some embodiments, step S711 may be completed by the signal codec module of the second electronic device. The signal codec module of the second electronic device may be the signal codec module of the electronic device in the spatial location determination system shown in fig. 5.
S712: the second electronic device determines a relative position between the second electronic device and the first electronic device according to the second information.
In some embodiments, the first electronic device may send at least two second analog audio signals sequentially at intervals through two speakers, the second electronic device may collect at least two second analog audio signals through one microphone and convert the at least two second analog audio signals into at least two second information, and the second electronic device may determine a relative position between the second electronic device and the first electronic device according to the at least two second information.
In other embodiments, the first electronic device may send at least two second analog audio signals sequentially through two speakers at intervals, the second electronic device may collect at least two second analog audio signals through the first microphone and collect at least two second analog audio signals through the second microphone, the second electronic device may further convert the signals collected by the first microphone and the signals collected by the second microphone into second information, and determine a relative position between the second electronic device and the first electronic device according to the second information.
Therefore, networking authentication is not needed between the second electronic device and the first electronic device, the first electronic device can send the digital audio information or can send the first moment, the second moment and the distance to the second electronic device, and then the second electronic device can determine the relative position between the second electronic device and the first electronic device.
In some embodiments, step S712 may be accomplished by a device ranging module of the second electronic device. The device ranging module of the second electronic device may be the device ranging module of the electronic device in the spatial location determination system shown in fig. 5.
S713: the second electronic device converts the relative position between the second electronic device and the first electronic device into a third analog audio signal according to a third preset encoding method.
In some embodiments, the third preset encoding method may be different from the first preset encoding method. It is understood that the third preset encoding method may be the same as the first preset encoding method, which is not limited by the present application.
In some embodiments, the third predetermined encoding method may be different from the second predetermined encoding method. It is understood that the third preset encoding method may be the same as the second preset encoding method, which is not limited by the present application.
In some embodiments, step S713 may be accomplished by a signal codec module of the second electronic device. The signal codec module of the second electronic device may be the signal codec module of the electronic device in the spatial location determination system shown in fig. 5.
S714: the second electronic device plays the third analog audio signal through the speaker.
In some embodiments, the third analog audio signal may be used to inform the relative location between the second electronic device and the first electronic device.
S715: the first electronic device collects a third analog audio signal through the microphone.
In some embodiments, the second electronic device plays the third analog audio signal through the speaker, and the first electronic device collects the third analog audio signal through the microphone, so that networking authentication of the first electronic device and the second electronic device is not required before transmission, and the relative position between the second electronic device and the first electronic device can be directly transmitted from the second electronic device to the first electronic device through the speaker and the microphone, so that the first electronic device can start collaborative office between the second electronic device and the first electronic device.
S716: the first electronic device converts the third analog audio signal into a relative position between the second electronic device and the first electronic device according to a third preset decoding method.
In some embodiments, step S716 may be performed by a signal codec module of the first electronic device. The signal codec module of the first electronic device may be the signal codec module of the electronic device in the spatial location determination system shown in fig. 5.
S717: the first electronic device wakes up a first processor of the first electronic device according to a relative position between the second electronic device and the first electronic device.
In some embodiments, before the first electronic device wakes up the first processor of the first electronic device according to the relative position between the second electronic device and the first electronic device, the first electronic device may further determine whether the relative position between the second electronic device and the first electronic device satisfies a preset positional relationship. The preset positional relationship may be, for example, that the second electronic device is located in a left side area or a right side area of the first electronic device. When the relative position between the second electronic device and the first electronic device meets a preset position relation, the first electronic device wakes up a first processor of the first electronic device according to the relative position between the second electronic device and the first electronic device.
In some embodiments, the first electronic device may wake up the first processor of the first electronic device through a HIFI interaction module in the first processor of the first electronic device. Thus, the first processor of the subsequent first electronic device may display information, run the target application, perform networking authentication with the second electronic device, send information to the second electronic device over a wireless or wired communication link, and so forth.
S718: the first electronic device turns off the screen on the screen of the first electronic device to display the icon of the second electronic device.
In some embodiments, the first electronic device turns off screen display of the small bubble icon 901 on the screen of the first electronic device 900, as shown in fig. 9. It is understood that the icon of the second electronic device may also be other icons, such as a mobile phone icon, etc., which the present application is not limited to.
In some embodiments, the first electronic device may determine a target display position of an icon of the second electronic device on the screen according to a relative position between the second electronic device and the first electronic device, and display the icon of the second electronic device at the target display position of the screen. For example, if the relative position between the second electronic device and the first electronic device is that the second electronic device is located in the left area of the first electronic device, the first electronic device may display an icon of the second electronic device at the lower left corner position of the screen; if the relative position between the second electronic device and the first electronic device is that the second electronic device is located in the right side area of the first electronic device, the first electronic device can display the icon of the second electronic device at the lower right corner position of the screen. It will be appreciated that the icon of the second electronic device may also be displayed in other locations, as the application is not limited in this regard.
It is understood that after step S718, the first electronic device may also run the target application in response to an operation on the icon of the second electronic device. Since the target application has subscribed to the first processor for the relative location between the electronic devices, the first electronic device may also send the relative location between the second electronic device and the first electronic device to the target application through the first processor and the SDK. The first electronic device may also perform networking authentication with the second electronic device, establish a wireless or wired communication link, and notify the second electronic device to wake up the first processor of the second electronic device through the wireless or wired communication link. The first electronic device further sends preset content to be displayed to the second electronic device through the established wireless communication link according to the relative position between the second electronic device and the first electronic device, and the first electronic device and the second electronic device can conduct collaborative office. For example, the relative position between the second electronic device and the first electronic device is that the second electronic device is located at the left side of the first electronic device, then the first electronic device may send the annotation interface of the preset WPS document to the second electronic device through the established wireless communication link, the first electronic device displays the main interface of the preset WPS document, and the second electronic device displays the annotation interface of the preset WPS document, so that the first electronic device and the second electronic device perform collaborative office, as shown in fig. 10. In fig. 10, a first electronic device 1001 and a second electronic device 1002 collectively display a preset WPS document in the first electronic device. It will be appreciated that fig. 10 is an example of a collaborative office, as the application is not limited in this regard. For another example, the relative position between the second electronic device and the first electronic device is that the second electronic device is located on the right side of the first electronic device, and then the first electronic device may send the preset directory interface of the WPS document to the second electronic device through the established wireless communication link, the first electronic device displays the preset main interface of the WPS document, and the second electronic device displays the preset directory interface of the WPS document, so that the first electronic device and the second electronic device may also perform collaborative office.
It may be appreciated that after the first electronic device notifies the second electronic device to wake up the first processor of the second electronic device over a wireless or wired communication link, the first electronic device may expand content displayed on the first electronic device into the second electronic device for display in response to a user dragging the first WPS document. For example, the relative position between the second electronic device and the first electronic device is that the second electronic device is located at the left side of the first electronic device, and then the first electronic device may respond to the operation that the user drags the first WPS document to move leftwards, and extend the content displayed on the first electronic device to the second electronic device for display. For example, if the relative position between the second electronic device and the first electronic device is that the second electronic device is located on the right side of the first electronic device, the first electronic device may expand the content displayed on the first electronic device to the second electronic device for display in response to the operation that the user drags the first WPS document to move to the right.
It is understood that after step S718, the first electronic device may further determine whether an operation of the icon of the second electronic device is received within a preset time. If the operation of the icon of the second electronic device is not received within the preset time, the first electronic device stops displaying the operation of the icon of the second electronic device. If the operation of the icon of the second electronic device is received within the preset time, the first electronic device may also respond to the operation of the icon of the second electronic device to run the target application program.
It can be appreciated that the first electronic device also displays a first preset unlock interface before the first electronic device runs the target application. At least one of password unlocking, face unlocking, fingerprint unlocking, iris unlocking, voice unlocking and sound wave unlocking can be displayed in the first preset unlocking interface. The password unlocking comprises at least one of digital password unlocking, pattern unlocking and PIN unlocking. The first electronic equipment also responds to the operation of inputting the unlocking information in the first preset unlocking interface, and if the input unlocking information is matched with the preset first unlocking information, the screen is unlocked and the target application program is operated. If the input unlocking information is not matched with the preset first unlocking information, continuing to turn off the screen to display the icon of the second electronic device.
It can be understood that, before the first electronic device runs the target application, the first electronic device may omit displaying the first preset unlock interface, and directly display the main interface of the first electronic device. The first electronic device also operates the target application in response to an operation to launch the target application on the host interface. It will be appreciated that the first electronic device may also enter other interfaces in response to an operation on the main interface, and may open the target application after one or more operations, which the present application is not limited to.
It can be understood that before the second electronic device performs collaborative work with the first electronic device, the second electronic device further displays a second preset unlocking interface, the second electronic device further responds to an operation of inputting unlocking information in the second preset unlocking interface, and if the input unlocking information is matched with the preset second unlocking information, the screen is unlocked and the first electronic device performs collaborative work. If the input unlocking information is not matched with the preset second unlocking information, entering a screen locking state.
It may be appreciated that, before the first electronic device sleeps, the operating system of the first electronic device subscribes to the relative position between the electronic devices in step S701, and then after step S718, the first electronic device may further send the relative position between the second electronic device and the first electronic device to the first processor in response to the operation on the icon of the second electronic device, and the first processor of the first electronic device may determine, according to the relative position between the second electronic device and the first electronic device, an application program that may perform multi-device collaboration using the relative position information between the electronic devices, and display the determined application program, such as the icon of the WPS application, the icon of the multi-screen collaboration application, and so on. The first processor of the first electronic device may also run the WPS application in response to an operation to select the target icon, e.g., an operation to select an icon of the WPS application. And then, the first electronic device can send the relative position between the second electronic device and the first electronic device to the WPS application, perform networking authentication with the second electronic device, inform the second electronic device to wake up the first processor of the second electronic device, and execute the collaborative office of the first electronic device and the second electronic device.
It will be appreciated that the application program may also be other applications, such as a camera application, etc., to which the present application is not limited.
It will be appreciated that the analog audio signal broadcast by the loudspeaker may change during propagation due to multipath effects, as the application is not limited in this regard.
It can be appreciated that the spatial location determining method shown in fig. 7 may be applied not only in a scenario where both the first electronic device and the second electronic device are dormant, but also in a scenario where the first electronic device is dormant and the second electronic device is not dormant. In a scenario where the first electronic device 1101 is dormant and the second electronic device 1102 is not dormant, the second electronic device 1102 runs a target application, as shown in fig. 11. In fig. 11, the first electronic device 1101 is dormant, at this time, the screen of the first electronic device 1101 is closed and the operating system and the application program are stopped. In fig. 11, the second electronic device 1102 displays a second WPS document. It will be appreciated that fig. 11 is an example of a scenario in which a first electronic device is dormant and a second electronic device is not dormant, as the application is not limited in this regard.
The spatial position determination method applied to the scene where the first electronic device is dormant and the second electronic device is not dormant is similar to the spatial position determination method applied to the scene where both the first electronic device and the second electronic device are dormant in fig. 7, except that in the scene where the first electronic device is dormant and the second electronic device is not dormant, step S702a replaces step S702 in fig. 7:
In step S702a, the second electronic device may determine whether the second electronic device meets a preset condition according to the state of the target application. When the second electronic equipment detects that the target application program is in the running state, the second electronic equipment detects that the second electronic equipment meets the preset condition. Otherwise, the second electronic device detects that the second electronic device does not meet the preset condition.
In some embodiments, "the target application is in a running state" may correspond to the following scenario: after the first electronic device sleeps, the user opens a second WPS document on the second electronic device, so that the second WPS document is displayed on the second electronic device; or after the user opens the second WPS document on the second electronic device, the first electronic device automatically or manually sleeps, and the second WPS document is displayed on the second electronic device. The second electronic device may be preset with a detection algorithm for detecting whether the target application is in a running state.
The spatial position determination method applied to a scenario in which the first electronic device is dormant and the second electronic device is not dormant is different from the spatial position determination method applied to a scenario in which both the first electronic device and the second electronic device are dormant in fig. 7 in that:
After step S718, and after the first electronic device performs networking authentication with the second electronic device and establishes a wireless or wired communication link, the first electronic device may omit notifying the second electronic device to wake up the first processor of the second electronic device, and directly send the preset content to be displayed to the second electronic device according to the relative position between the second electronic device and the first electronic device through the established wireless communication link, where the first electronic device and the second electronic device directly perform collaborative office, as shown in fig. 10. The process that the first electronic device and the second electronic device directly perform collaborative office is similar to the process that the first electronic device and the second electronic device perform collaborative office under the scene that the first electronic device and the second electronic device are dormant, and details are not repeated here. In fig. 10, a first electronic device 1001 and a second electronic device 1002 collectively display a preset WPS document in the first electronic device. It is to be appreciated that the second electronic device may also concurrently display a second WPS document in the second electronic device, as the application is not limited in this regard.
It is understood that in a scenario where the first electronic device is dormant and the second electronic device is not dormant, the second electronic device may not display the second WPS document, but rather be in a screen-locked state. In some embodiments, "in a lock screen state" may correspond to the following scenario: when the first electronic device is dormant and the second electronic device displays a second WPS document, a user manually locks a screen of the second electronic device, and the second electronic device enters a screen locking state; or when the first electronic device sleeps and the second electronic device displays the second WPS document, the second electronic device automatically locks the screen and enters a screen locking state. In the screen locking state, the second WPS document of the second electronic device is still in an operational state, but is not displayed any more. After step S718, and after the first electronic device performs networking authentication with the second electronic device and establishes a wireless or wired communication link, the first electronic device notifies the second electronic device to display a second preset unlocking interface through the wireless or wired communication link, and determines whether to unlock according to the unlocking information input in the second preset unlocking interface. After the second electronic equipment is unlocked, the first electronic equipment can send preset content to be displayed to the second electronic equipment through the established wireless communication link according to the relative position between the second electronic equipment and the first electronic equipment, and the first electronic equipment and the second electronic equipment directly conduct collaborative office.
It can be appreciated that the spatial location determining method shown in fig. 7 may be applied not only in a scenario in which both the first electronic device and the second electronic device are dormant, but also in a scenario in which the first electronic device is not dormant and the second electronic device is dormant. In a scenario where the first electronic device 1201 is not dormant and the second electronic device 1202 is dormant, the first electronic device runs a target application, as shown in fig. 12. In fig. 12, a first electronic device 1201 displays a first WPS document, a second electronic device 1202 sleeps, at which point the screen of the second electronic device 1101 is closed and the operating system and applications are stopped. It will be appreciated that fig. 12 is one example of a scenario in which a first electronic device is not dormant and a second electronic device is dormant, as the application is not limited in this regard.
The spatial position determination method applied to the scene in which the first electronic device is not dormant and the second electronic device is dormant is similar to the spatial position determination method applied to the scene in which both the first electronic device and the second electronic device are dormant in fig. 7, except that in the scene in which the first electronic device is not dormant and the second electronic device is dormant, step S701b replaces step S701 in fig. 7, step S702b replaces step S702 in fig. 7, and steps S717 to S718 in fig. 7 are omitted.
In step S701b, the target application of the first electronic device subscribes to the relative location between the electronic devices. It is understood that the step S701b may be interchanged with the step S702 or the step S703, which is not limited by the present application.
In step S702b, the motion state of "stop after motion" may correspond to the following scenario: after the user holds the dormant second electronic device and moves the dormant second electronic device to a position near the first electronic device displaying the first WPS document, the dormant second electronic device is not moved.
The spatial position determination method applied to a scenario in which the first electronic device is not dormant and the second electronic device is dormant is different from the spatial position determination method applied to a scenario in which both the first electronic device and the second electronic device are dormant in fig. 7 in that:
After step S716, since the first electronic device displays the first WPS document, the first electronic device may omit running the target application, and directly send the relative position between the second electronic device and the first electronic device to the target application through the first processor and the SDK. Then, the first electronic device can perform networking authentication with the second electronic device, establish a wireless or wired communication link, wake up the first processor of the second electronic device, and send preset content of the first WPS document, and the first electronic device and the second electronic device can perform collaborative office. The process of performing collaborative office of the first electronic device and the second electronic device is similar to the process of performing collaborative office of the first electronic device and the second electronic device in the above-mentioned scene that the first electronic device and the second electronic device are both dormant, and will not be described here again.
It is understood that in a scenario where the first electronic device is not dormant and the second electronic device is dormant, the first electronic device may not display the second WPS document, but rather be in a screen locked state. In some embodiments, "in a lock screen state" may correspond to the following scenario: when the second electronic device is dormant and the first electronic device displays the first WPS document, a user manually locks a screen of the first electronic device, and the first electronic device enters a screen locking state; or when the second electronic device is dormant and the first electronic device displays the first WPS document, the first electronic device automatically locks the screen and enters a screen locking state. In the screen locking state, the first WPS document of the first electronic device is still in an operating state, but is not displayed continuously. After step S716, and before the first electronic device sends the relative position between the second electronic device and the first electronic device to the target application through the first processor and the SDK, the first electronic device displays an icon of the second electronic device on a screen of the first electronic device. The first electronic device may also display a first preset unlocking interface in response to an operation on an icon of the second electronic device, and determine whether to unlock according to unlocking information input in the first preset unlocking interface. After unlocking the screen, the first electronic device may run the target application, and directly send the relative position between the second electronic device and the first electronic device to the target application through the first processor and the SDK.
It can be appreciated that the spatial location determining method shown in fig. 7 may be applied not only in a scenario where both the first electronic device and the second electronic device are dormant, but also in a scenario where the first electronic device is not dormant and the second electronic device is not dormant. In a scenario where the first electronic device 1301 is not dormant and the second electronic device 1302 is not dormant, both the first electronic device 1301 and the second electronic device 1302 run the target application, as shown in fig. 13. In fig. 13, a first electronic device 1301 displays a first WPS document and a second electronic device 1302 displays a second WPS document. It will be appreciated that fig. 13 is one example of a scenario in which a first electronic device is not dormant and a second electronic device is not dormant, as the application is not limited in this regard.
The spatial position determination method applied to the scene where the first electronic device is not dormant and the second electronic device is not dormant is similar to the spatial position determination method applied to the scene where both the first electronic device and the second electronic device are dormant in fig. 7, except that in the scene where the first electronic device is not dormant and the second electronic device is not dormant, step S701c replaces step S701 in fig. 7, step S702c replaces step S702 in fig. 7, and steps S717 to S718 in fig. 7 are omitted.
In step S701c, the target application of the first electronic device subscribes to the relative location between the electronic devices. It is understood that the step S701c may be interchanged with the step S702 or the step S703, which is not limited by the present application.
In step S702c, the second electronic device may determine whether the second electronic device meets a preset condition according to the state of the target application. When the second electronic equipment detects that the target application program is in the running state, the second electronic equipment detects that the second electronic equipment meets the preset condition. Otherwise, the second electronic device detects that the second electronic device does not meet the preset condition.
In some embodiments, "the target application is in a running state" may correspond to the following scenario: after the first WPS document is displayed by the first electronic device, the user opens a second WPS document on the second electronic device, so that the second WPS document is displayed on the second electronic device; or after the user opens the second WPS document on the second electronic device, the first WPS document on the first electronic device is also opened, so that the first WPS document is displayed on the first electronic device and the second WPS document is displayed on the second electronic device. At this time, the first electronic device and the second electronic device each run their own WPS document and do not enter the collaborative office state. The second electronic device may be preset with a detection algorithm for detecting whether the target application is in a running state.
The spatial position determination method applied to a scenario in which the first electronic device is not dormant and the second electronic device is not dormant is different from the spatial position determination method applied to a scenario in which both the first electronic device and the second electronic device are dormant in fig. 7 in that:
After step S716, since the first electronic device displays the first WPS document, the first electronic device may omit running the target application, and directly send the relative position between the second electronic device and the first electronic device to the target application through the first processor and the SDK. The first electronic device may then perform networking authentication with the second electronic device, establish a wireless or wired communication link, and send the preset content of the first WPS document to the second electronic device via the wireless or wired communication link, where the first electronic device and the second electronic device may perform a collaborative office, as shown in fig. 10. The process of performing collaborative office of the first electronic device and the second electronic device is similar to the process of performing collaborative office of the first electronic device and the second electronic device in the above-mentioned scene that the first electronic device and the second electronic device are both dormant, and will not be described here again. In fig. 10, a first electronic device 1001 and a second electronic device 1002 together display a first WPS document in the first electronic device. It is to be appreciated that the second electronic device may also concurrently display a second WPS document in the second electronic device, as the application is not limited in this regard.
It may be appreciated that in a scenario where the first electronic device is not dormant and the second electronic device is not dormant, the first electronic device may not display the first WPS document and the second electronic device does not display the second WPS document, but rather the first electronic device is in a screen locked state and the second electronic device is in a screen locked state. In some embodiments, "the first electronic device is in a locked state and the second electronic device is in a locked state" may correspond to the following scenario: when the first electronic device displays the first WPS document and the second electronic device displays the second WPS document, a user manually locks a screen of the first electronic device or automatically locks the screen of the first electronic device, the user manually locks a screen of the second electronic device or automatically locks the screen of the second electronic device, and the first electronic device and the second electronic device enter a screen locking state. And when the first electronic device is in the screen locking state and the second electronic device is in the screen locking state, the first WPS document of the first electronic device and the second WPS document of the second electronic device are still in the running state, but are not displayed continuously. After step S716, and before the first electronic device sends the relative position between the second electronic device and the first electronic device to the target application through the first processor and the SDK, the first electronic device displays an icon of the second electronic device on a screen of the first electronic device. And responding to the operation of the icon of the second electronic equipment, displaying a first preset unlocking interface by the first electronic equipment, and determining whether to unlock according to the unlocking information input in the first preset unlocking interface. After the first electronic equipment is unlocked, the first electronic equipment sends the relative position between the second electronic equipment and the first electronic equipment to a target application program through the first processor and the SDK, the first electronic equipment can also carry out networking authentication with the second electronic equipment, a wireless or wired communication link is established, the second electronic equipment is informed of displaying a second preset unlocking interface through the wireless or wired communication link, and whether unlocking is carried out is determined according to unlocking information input in the second preset unlocking interface. After the second electronic equipment is unlocked, the first electronic equipment can send preset content to be displayed to the second electronic equipment through the established wireless communication link according to the relative position between the second electronic equipment and the first electronic equipment, and the first electronic equipment and the second electronic equipment directly conduct collaborative office.
It may be appreciated that, in a scenario where the first electronic device is not dormant and the second electronic device is not dormant, the first electronic device may be in a screen locking state or the second electronic device may be in a screen locking state, which is not limited by the present application.
Referring to fig. 14, a flowchart of a spatial location determining method according to an embodiment of the application is provided. The method comprises the following steps:
s1401: the second electronic device controls the loudspeaker to play a first analog audio signal, and the first analog audio signal is used for indicating that the second electronic device is online.
S1402: the first electronic device controls the microphone to collect a first analog audio signal, and controls the loudspeaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, wherein the second analog audio signal is used for requesting to determine the space position between the electronic devices.
S1403: the second electronic device controls the microphone to collect a second analog audio signal and determines a spatial position between the second electronic device and the first electronic device according to the second analog audio signal.
S1404: the second electronic device generates a third analog audio signal according to the spatial position between the second electronic device and the first electronic device, and controls the loudspeaker to play the third analog audio signal, wherein the third analog audio signal is used for informing the spatial position between the second electronic device and the first electronic device.
S1405: the first electronic device controls the microphone to collect a third analog audio signal, and the spatial position between the second electronic device and the first electronic device is obtained through the third analog audio signal.
In some embodiments, the second electronic device controlling the speaker to play the first analog audio signal includes: and after the second electronic equipment is dormant, if the motion sensor of the second electronic equipment detects that the motion state of the second electronic equipment is motion, stopping the second electronic equipment, and controlling the loudspeaker to play the first analog audio signal.
In some embodiments, the second electronic device controlling the speaker to play the first analog audio signal includes: and if the second electronic equipment detects that the target application program is in the running state, the second electronic equipment controls the loudspeaker to play the first analog audio signal.
In some embodiments, before the second electronic device controls the speaker to play the first analog audio signal, the method further comprises: the second electronic device performs binary encoding on preset information, and encodes the encoded binary data into a first analog audio signal, where the preset information is used to indicate that the second electronic device is online, the first analog audio signal includes at least one of a first chirp signal and a second chirp signal, the first chirp signal is used to indicate binary code 0, and the second chirp signal is used to indicate binary code 1.
In some embodiments, the first electronic device includes a first processor, the first processor is in a sleep state, and after the first electronic device acquires a spatial location between the second electronic device and the first electronic device through the third analog audio signal, the method further includes: the first electronic device wakes up the first processor; and the first electronic device displays the icon of the second electronic device by the first processor according to the space position between the second electronic device and the first electronic device.
In some embodiments, the first electronic device displaying an icon of the second electronic device in a screen-off manner according to a spatial position between the second electronic device and the first electronic device comprises: the first electronic device determines a target display position of an icon of the second electronic device according to the space position between the second electronic device and the first electronic device; and the first electronic device is in screen-off display at the target display position to display the icon of the second electronic device.
In some embodiments, before the first electronic device controls the speaker to play the second analog audio signal in response to the first analog audio signal according to the pre-stored subscription information, the method further comprises: before the first processor sleeps, a target application or operating system of the first electronic device sends a subscription request to the first processor, the subscription request being used for requesting to subscribe to a first type of spatial location between the electronic devices; the first electronic device generates subscription information according to the subscription request through the first processor; the first electronic device stores subscription information.
In some embodiments, the first analog audio signal is further used to request a determination of a second type of relative position between the electronic devices; the first electronic device controlling the speaker to play the second analog audio signal according to the pre-stored subscription information in response to the first analog audio signal includes: if the first analog audio signal is matched with the pre-stored subscription information, the first electronic device responds to the first analog audio signal and controls the loudspeaker to play the second analog audio signal according to the pre-stored subscription information.
In some embodiments, the type of spatial location between electronic devices includes relative location between electronic devices and distance information between electronic devices.
In some embodiments, after the first electronic device turns off the screen to display the icon of the second electronic device, the method further comprises: the first electronic device cooperates with the second electronic device in response to an operation on an icon of the second electronic device.
Referring to fig. 15, a flowchart of another spatial location determining method according to an embodiment of the present application is shown. The method is applied to the first electronic device. The first electronic device comprises a first processor and a second processor, and the second processor is connected with the first processor. The second processor has a lower operating power consumption than the first processor. The method comprises the following steps:
S1501: the second processor controls the microphone to collect a first analog audio signal, and controls the loudspeaker to play a second analog audio signal in response to the first analog audio signal according to pre-stored subscription information, wherein the first analog audio signal is an audio signal played by the loudspeaker of the second electronic device, the first analog audio signal is used for indicating that the second electronic device is online, the second analog audio signal is used for requesting to determine the spatial position between the electronic devices, and the pre-stored subscription information comprises a subscriber.
S1502: the second processor controls the microphone to collect a third analog audio signal, the third analog audio signal being an audio signal played by a speaker of the second electronic device, the third analog audio signal being used to inform a spatial location between the second electronic device and the first electronic device.
S1503: the second processor sends, via the first processor, a spatial location between the second electronic device and the first electronic device in the third analog audio signal to the subscriber.
In some embodiments, before the second processor controls the microphone to collect the first analog audio signal, the method further comprises: the first processor enters a dormant state; before the second processor sends the spatial location between the second electronic device and the first electronic device in the third analog audio signal to the subscriber via the first processor, the method further comprises: the second processor wakes up the first processor.
In some embodiments, before the first processor enters the sleep state, the method further comprises: the subscriber sends a subscription request to the first processor, wherein the subscription request is used for requesting to subscribe to a first type of space position between electronic devices; subscribers include target applications or operating systems; the first processor generates subscription information according to the subscription request; the first processor sends the subscription information to the second processor for storage.
In some embodiments, the first processor is an application processor and the second processor is an audio digital signal processor.
In some embodiments, before the second processor controls the speaker to play the second analog audio signal in response to the first analog audio signal according to the pre-stored subscription information, the method further comprises: the second processor decodes the first analog audio signal into binary data, and decodes the binary data into preset information, wherein the first analog audio signal comprises at least one of a first chirp signal and a second chirp signal, the first chirp signal is used for representing a binary code 0, the second chirp signal is used for representing a binary code 1, and the preset information is used for representing that the second electronic device is online.
In some embodiments, after the second processor sends the spatial location between the second electronic device and the first electronic device in the third analog audio signal to the subscriber through the first processor, the method further comprises: the first electronic device cooperates with the second electronic device.
In addition to the above method and the terminal device, the embodiment of the present application further provides a computer-readable storage medium, in which a program is stored, the program causing an electronic device to implement the spatial position determination method shown in fig. 14 or fig. 15.
A computer program product comprising computer-executable instructions stored on a computer-readable storage medium; the at least one processor of the electronic device may read computer-executable instructions from a computer-readable storage medium, the at least one processor executing the computer-executable instructions causing the electronic device to perform the spatial location determination method shown in fig. 14 or 15.
From the above description of the embodiments, it will be apparent to those skilled in the art that the present application may be implemented by means of software plus necessary general purpose hardware, or of course by means of special purpose hardware including application specific integrated circuits, special purpose CPUs, special purpose memories, special purpose components, etc. Generally, functions performed by computer programs can be easily implemented by corresponding hardware, and specific hardware structures for implementing the same functions can be varied, such as analog circuits, digital circuits, or dedicated circuits. But a software program implementation is a preferred embodiment for many more of the cases of the present application. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a readable storage medium, such as a floppy disk, a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk or an optical disk of a computer, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments of the present application.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product.
The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). Computer readable storage media can be any available media that can be stored by a computer or data storage devices such as servers, data centers, etc. that contain an integration of one or more available media. Usable media may be magnetic media (e.g., floppy disk, hard disk, magnetic tape), optical media (e.g., DVD), or semiconductor media (e.g., solid state disk (Solid STATE DISK, SSD)), etc.
Finally, it should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present application and not for limiting the same, and although the present application has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications and equivalents may be made to the technical solution of the present application without departing from the spirit and scope of the technical solution of the present application.
Claims (32)
1. A method for determining a spatial position, applied to a system including a first electronic device and a second electronic device, the method comprising:
the second electronic equipment controls a loudspeaker to play a first analog audio signal, and the first analog audio signal is used for indicating that the second electronic equipment is online;
The first electronic equipment controls a microphone to collect the first analog audio signal, and controls a loudspeaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, wherein the second analog audio signal is used for requesting to determine the space position between electronic equipment;
the second electronic device controls a microphone to collect the second analog audio signal and determines the spatial position between the second electronic device and the first electronic device according to the second analog audio signal;
The second electronic device generates a third analog audio signal according to the spatial position between the second electronic device and the first electronic device, and controls the loudspeaker to play the third analog audio signal, wherein the third analog audio signal is used for informing the spatial position between the second electronic device and the first electronic device;
The first electronic device controls the microphone to collect the third analog audio signal, and the spatial position between the second electronic device and the first electronic device is obtained through the third analog audio signal.
2. The method of claim 1, wherein,
The second electronic device controlling the speaker to play the first analog audio signal includes:
And after the second electronic equipment is dormant, if the motion sensor of the second electronic equipment detects that the motion state of the second electronic equipment is motion, stopping, and controlling the loudspeaker to play the first analog audio signal by the second electronic equipment.
3. The method of claim 1, wherein,
The second electronic device controlling the speaker to play the first analog audio signal includes:
And if the second electronic equipment detects that the target application program is in the running state, the second electronic equipment controls the loudspeaker to play the first analog audio signal.
4. A method according to any one of claim 1 to 3,
Before the second electronic device controls the speaker to play the first analog audio signal, the method further comprises:
the second electronic device performs binary coding on preset information, and codes the coded binary data into the first analog audio signal, wherein the preset information is used for indicating that the second electronic device is online, the first analog audio signal comprises at least one of a first chirp signal and a second chirp signal, the first chirp signal is used for indicating a binary code 0, and the second chirp signal is used for indicating a binary code 1.
5. The method according to claim 1 to 4, wherein,
The first electronic device includes a first processor, the first processor is in a sleep state, and after the first electronic device obtains a spatial position between the second electronic device and the first electronic device through the third analog audio signal, the method further includes:
the first electronic device wakes up the first processor;
And the first electronic equipment is used for displaying the icon of the second electronic equipment through the first processor according to the space position between the second electronic equipment and the first electronic equipment.
6. The method of claim 5, wherein the first electronic device displaying an icon of the second electronic device in an off-screen manner according to a spatial location between the second electronic device and the first electronic device comprises:
The first electronic device determines a target display position of an icon of the second electronic device according to the space position between the second electronic device and the first electronic device;
and the first electronic equipment is in screen-off display at the target display position to display the icon of the second electronic equipment.
7. The method according to claim 5 to 6, wherein,
Before the first electronic device controls the speaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, the method further comprises:
before the first processor sleeps, a target application or an operating system of the first electronic device sends a subscription request to the first processor, wherein the subscription request is used for requesting to subscribe to a first type of space position between the electronic devices;
the first electronic device generates the subscription information according to the subscription request through the first processor;
The first electronic device stores the subscription information.
8. The method of claim 7, wherein,
The first analog audio signal is also used for requesting to determine a second type of relative position between electronic devices;
The first electronic device responding to the first analog audio signal and controlling the loudspeaker to play a second analog audio signal according to pre-stored subscription information comprises the following steps:
and if the first analog audio signal is matched with the pre-stored subscription information, the first electronic device responds to the first analog audio signal and controls the loudspeaker to play the second analog audio signal according to the pre-stored subscription information.
9. The method according to any one of claim 7 to 8,
The type of spatial location between the electronic devices includes relative location between the electronic devices and distance information between the electronic devices.
10. The method according to any one of claim 5 to 9, wherein,
After the first electronic device turns off the screen to display the icon of the second electronic device, the method further comprises:
The first electronic device cooperates with the second electronic device in response to an operation on an icon of the second electronic device.
11. A method of spatial location determination, the method comprising:
The method comprises the steps that a first electronic device controls a microphone to collect a first analog audio signal, and controls a loudspeaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, wherein the first analog audio signal is an audio signal played by the loudspeaker of a second electronic device, the first analog audio signal is used for indicating that the second electronic device is online, and the second analog audio signal is used for requesting to determine the spatial position between the electronic devices;
The first electronic device controls the microphone to collect a third analog audio signal, wherein the third analog audio signal is an audio signal played by the loudspeaker of the second electronic device, and the third analog audio signal is used for informing the spatial position between the second electronic device and the first electronic device;
the first electronic device obtains the spatial position between the second electronic device and the first electronic device through the third analog audio signal.
12. The method of claim 11, wherein,
Before the first electronic device controls the speaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, the method further comprises:
The first electronic device decodes the first analog audio signal into binary data and decodes the binary data into preset information, wherein the first analog audio signal comprises at least one of a first chirp signal and a second chirp signal, the first chirp signal is used for representing a binary code 0, the second chirp signal is used for representing a binary code 1, and the preset information is used for representing that the second electronic device is online.
13. The method according to any one of claim 11 to 12, wherein,
The first electronic device includes a first processor, the first processor is in a sleep state, and after the first electronic device obtains a spatial position between the second electronic device and the first electronic device through the third analog audio signal, the method further includes:
the first electronic device wakes up the first processor;
And the first electronic equipment is used for displaying the icon of the second electronic equipment through the first processor according to the space position between the second electronic equipment and the first electronic equipment.
14. The method of claim 13, wherein the first electronic device displaying an icon of the second electronic device off-screen according to a spatial location between the second electronic device and the first electronic device comprises:
The first electronic device determines a target display position of an icon of the second electronic device according to the space position between the second electronic device and the first electronic device;
and the first electronic equipment is in screen-off display at the target display position to display the icon of the second electronic equipment.
15. The method according to any one of claim 13 to 14, wherein,
Before the first electronic device controls the speaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, the method further comprises:
before the first processor sleeps, a target application or an operating system of the first electronic device sends a subscription request to the first processor, wherein the subscription request is used for requesting to subscribe to a first type of space position between the electronic devices;
the first electronic device generates the subscription information according to the subscription request through the first processor;
The first electronic device stores the subscription information.
16. The method of claim 15, wherein,
The first analog audio signal is also used for requesting to determine a second type of relative position between electronic devices;
The first electronic device responding to the first analog audio signal and controlling the loudspeaker to play a second analog audio signal according to pre-stored subscription information comprises the following steps:
and if the first analog audio signal is matched with the pre-stored subscription information, the first electronic device responds to the first analog audio signal and controls the loudspeaker to play the second analog audio signal according to the pre-stored subscription information.
17. The method according to any one of claim 15 to 16, wherein,
The type of spatial location between the electronic devices includes relative location between the electronic devices and distance information between the electronic devices.
18. The method of any of claims 13 to 17, wherein after the first electronic device turns off screen to display the icon of the second electronic device, the method further comprises:
The first electronic device cooperates with the second electronic device in response to an operation on an icon of the second electronic device.
19. A spatial location determining method applied to a first electronic device, wherein the first electronic device includes a first processor and a second processor, the second processor is connected with the first processor, and the operation power consumption of the second processor is smaller than the operation power consumption of the first processor, the method includes:
the second processor controls the microphone to collect a first analog audio signal, and controls the loudspeaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, wherein the first analog audio signal is an audio signal played by the loudspeaker of the second electronic device, the first analog audio signal is used for indicating that the second electronic device is online, the second analog audio signal is used for requesting to determine the spatial position between the electronic devices, and the pre-stored subscription information comprises a subscriber;
The second processor controls the microphone to collect a third analog audio signal, wherein the third analog audio signal is an audio signal played by the loudspeaker of the second electronic device, and the third analog audio signal is used for notifying the spatial position between the second electronic device and the first electronic device;
the second processor sends, via the first processor, a spatial location between the second electronic device and the first electronic device in the third analog audio signal to the subscriber.
20. The method of claim 19, wherein,
Before the second processor controls the microphone to collect the first analog audio signal, the method further comprises:
The first processor enters a dormant state;
Before the second processor sends, via the first processor, the spatial location between the second electronic device and the first electronic device in the third analog audio signal to the subscriber, the method further comprises:
the second processor wakes up the first processor.
21. The method of claim 20, wherein,
Before the first processor enters the sleep state, the method further comprises:
The subscriber sends a subscription request to the first processor, wherein the subscription request is used for requesting to subscribe to a first type of space position between electronic devices; the subscriber comprises a target application program or an operating system;
The first processor generates the subscription information according to the subscription request;
And the first processor sends the subscription information to the second processor for storage.
22. The method according to any one of claim 19 to 21, wherein,
The first processor is an application processor, and the second processor is an audio digital signal processor.
23. The method of any one of claim 19 to 22,
Before the second processor controls the speaker to play a second analog audio signal according to pre-stored subscription information in response to the first analog audio signal, the method further comprises:
The second processor decodes the first analog audio signal into binary data and decodes the binary data into preset information, wherein the first analog audio signal comprises at least one of a first chirp signal and a second chirp signal, the first chirp signal is used for representing a binary code 0, the second chirp signal is used for representing a binary code 1, and the preset information is used for representing that the second electronic device is online.
24. The method of any one of claim 19 to 23,
After the second processor sends, via the first processor, a spatial location between the second electronic device and the first electronic device in the third analog audio signal to the subscriber, the method further comprises:
The first electronic device cooperates with the second electronic device.
25. A method of spatial location determination, the method comprising:
The second electronic equipment controls a loudspeaker to play a first analog audio signal, and the first analog audio signal is used for indicating that the second electronic equipment is online;
The second electronic equipment controls a microphone to collect a second analog audio signal, and determines the spatial position between the second electronic equipment and the first electronic equipment according to the second analog audio signal, wherein the second analog audio signal is an audio signal played by a loudspeaker of the first electronic equipment, and the second analog audio signal is used for requesting to determine the spatial position between the electronic equipment;
The second electronic device generates a third analog audio signal according to the spatial position between the second electronic device and the first electronic device, and controls the loudspeaker to play the third analog audio signal, wherein the third analog audio signal is used for informing the spatial position between the second electronic device and the first electronic device.
26. The method of claim 25, wherein,
The second electronic device controlling the speaker to play the first analog audio signal includes:
And after the second electronic equipment is dormant, if the motion sensor of the second electronic equipment detects that the motion state of the second electronic equipment is motion, stopping, and controlling the loudspeaker to play the first analog audio signal by the second electronic equipment.
27. The method of claim 25, wherein,
The second electronic device controlling the speaker to play the first analog audio signal includes:
And if the second electronic equipment detects that the target application program is in the running state, the second electronic equipment controls the loudspeaker to play the first analog audio signal.
28. The method of any one of claim 25 to 27,
Before the second electronic device controls the speaker to play the first analog audio signal, the method further comprises:
the second electronic device performs binary coding on preset information, and codes the coded binary data into the first analog audio signal, wherein the preset information is used for indicating that the second electronic device is online, the first analog audio signal comprises at least one of a first chirp signal and a second chirp signal, the first chirp signal is used for indicating a binary code 0, and the second chirp signal is used for indicating a binary code 1.
29. A spatial position determination system comprising a first electronic device for performing the method of any one of claims 11 to 18, or 19 to 24, and a second electronic device for performing the method of any one of claims 25 to 28.
30. An electronic device comprising at least one processor, memory, a speaker, and a microphone;
The at least one processor is coupled with the memory, the speaker, and the microphone;
The memory is used for storing instructions, the processor is used for executing the instructions, the loudspeaker is used for playing audio signals, and the microphone is used for collecting audio signals;
The instructions, when executed by the at least one processor, cause the at least one processor to perform the method of any one of claims 1 to 10, claims 11 to 18, claims 19 to 24, or claims 25 to 28.
31. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a program that causes a computer device to execute the method of any one of claims 1 to 10, claims 11 to 18, claims 19 to 24, or claims 25 to 28.
32. A computer program product, the computer program product comprising computer-executable instructions stored on a computer-readable storage medium; at least one processor of an electronic device may read the computer-executable instructions from the computer-readable storage medium, the at least one processor executing the computer-executable instructions causing the electronic device to perform the method of any one of claims 1 to 10, claims 11 to 18, claims 19 to 24, or claims 25 to 28.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211393980.7A CN118033541A (en) | 2022-11-08 | 2022-11-08 | Spatial position determining method, system and equipment thereof |
| PCT/CN2023/129111 WO2024099212A1 (en) | 2022-11-08 | 2023-11-01 | Spatial position determination method and system, and device therefor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211393980.7A CN118033541A (en) | 2022-11-08 | 2022-11-08 | Spatial position determining method, system and equipment thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118033541A true CN118033541A (en) | 2024-05-14 |
Family
ID=90982807
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211393980.7A Pending CN118033541A (en) | 2022-11-08 | 2022-11-08 | Spatial position determining method, system and equipment thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN118033541A (en) |
| WO (1) | WO2024099212A1 (en) |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101228749B1 (en) * | 2011-08-24 | 2013-01-31 | 한국과학기술원 | Position detecting system and method using audio frequency and and recording medium for the same |
| KR20150130845A (en) * | 2014-05-14 | 2015-11-24 | 삼성전자주식회사 | Apparatus and Device for Position Measuring of Electronic Apparatuses |
| CN113873444B (en) * | 2020-06-30 | 2023-03-10 | 华为技术有限公司 | Positioning method and electronic equipment |
| CN114666736A (en) * | 2020-12-22 | 2022-06-24 | 成都鼎桥通信技术有限公司 | Location subscription method and device |
| CN114690113A (en) * | 2020-12-31 | 2022-07-01 | 华为技术有限公司 | Method and device for determining position of equipment |
| CN114895244A (en) * | 2021-01-25 | 2022-08-12 | 华为技术有限公司 | Device interaction method, position determination method, electronic device and chip system |
| CN113518304A (en) * | 2021-03-18 | 2021-10-19 | 深圳云里物里科技股份有限公司 | Indoor positioning method and device |
| CN114564209A (en) * | 2022-02-08 | 2022-05-31 | 福思(杭州)智能科技有限公司 | Intelligent automobile data processing method, device and equipment and storage medium |
-
2022
- 2022-11-08 CN CN202211393980.7A patent/CN118033541A/en active Pending
-
2023
- 2023-11-01 WO PCT/CN2023/129111 patent/WO2024099212A1/en unknown
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024099212A1 (en) | 2024-05-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11683850B2 (en) | Bluetooth reconnection method and related apparatus | |
| CN111405681B (en) | Wi-Fi Aware link establishment method, wi-Fi Aware link establishment system, electronic equipment and storage medium | |
| CN113923230B (en) | Data synchronization method, electronic device, and computer-readable storage medium | |
| CN111628916B (en) | Method for cooperation of intelligent sound box and electronic equipment | |
| CN110602686B (en) | Method for using remote SIM module and electronic equipment | |
| JP7459438B2 (en) | Method for reducing power consumption of mobile terminals and mobile terminals | |
| CN111382418B (en) | Application program authority management method and device, storage medium and electronic equipment | |
| CN117014859A (en) | Address book-based device discovery method, audio and video communication method and electronic device | |
| CN113873678A (en) | Method and electronic equipment for transmitting data | |
| CN114928898B (en) | Method and device for establishing session based on WiFi direct connection | |
| CN116056050A (en) | Audio playing method, electronic equipment and system | |
| CN118033541A (en) | Spatial position determining method, system and equipment thereof | |
| CN114173317B (en) | Method for transmitting data and electronic equipment | |
| CN115942253B (en) | Prompting method and related device | |
| CN115913600A (en) | Method, apparatus, electronic device and medium for identifying device | |
| CN117917632A (en) | Display method, electronic equipment and system | |
| CN117289807A (en) | Communication method, communication system and mouse | |
| CN115515112A (en) | Bluetooth communication method and system | |
| CN116795197A (en) | Layer processing method and electronic equipment | |
| CN117786260A (en) | Card updating method and related device | |
| CN116567054A (en) | Detection method, related electronic equipment and system | |
| CN116819434A (en) | Distance measurement method and electronic equipment | |
| CN116483227A (en) | Appearance setting method and electronic equipment | |
| CN117666819A (en) | Mouse operation method, electronic device, mouse and computer-readable storage medium | |
| CN115802326A (en) | Bluetooth connection method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |