WO2019077594A1 - Gestion de communication et communication entre un dispositif de communication et un autre dispositif - Google Patents

Gestion de communication et communication entre un dispositif de communication et un autre dispositif Download PDF

Info

Publication number
WO2019077594A1
WO2019077594A1 PCT/IL2017/051141 IL2017051141W WO2019077594A1 WO 2019077594 A1 WO2019077594 A1 WO 2019077594A1 IL 2017051141 W IL2017051141 W IL 2017051141W WO 2019077594 A1 WO2019077594 A1 WO 2019077594A1
Authority
WO
WIPO (PCT)
Prior art keywords
communication
communication device
devices
given
additional
Prior art date
Application number
PCT/IL2017/051141
Other languages
English (en)
Inventor
Johnathan HALAVEE
Uriel Halavee
Original Assignee
Sonular Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sonular Ltd. filed Critical Sonular Ltd.
Priority to PCT/IL2017/051141 priority Critical patent/WO2019077594A1/fr
Priority to EP17929202.4A priority patent/EP3698491A4/fr
Publication of WO2019077594A1 publication Critical patent/WO2019077594A1/fr
Priority to US16/538,470 priority patent/US10735933B2/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B11/00—Transmission systems employing sonic, ultrasonic or infrasonic waves
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W84/00—Network topologies
    • H04W84/18—Self-organising networks, e.g. ad-hoc networks or sensor networks

Definitions

  • radio other electromagnetic such as light, magnetic or electric fields and sound.
  • LTE long term evolution
  • WI-FITM wireless networking
  • NFC near field communication
  • RFID radio frequency identification
  • Wireless communication which can be person-to-person, person to machine, machine to person and machine to machine, requires having the recipient's contact details - (cellular number, BLUETOOTHTM etc.) and is not directional.
  • An aspect of the disclosure relates to a method for a communication device to communicate with a given device that is located at a given direction, the method comprising: transmitting a triggering acoustic signal, by the communication device in the given direction; receiving, by the communication device, one or more responses to the acoustic triggering signal, wherein the one or more responses originate from one or more second communication devices, and wherein each response of the one or more responses comprises an identifier of a device from the one or more second communication devices that transmitted the response; participating in analyzing by the communication device, times of arrival of the one or more responses for determining directions of the one or more second communication devices relatively to the communication device, thereby identifying the given device as a device that is in the given direction relatively to the communication device; transmitting by the communication device, to the given device a request to communicate; and subject to receiving by the communication device, acceptance from the given device, communicating with the given device.
  • the transmitting of the triggering acoustic signal is optionally preceded by determining, by the communication device and in an autonomous manner, to communicate with the given device.
  • the communication device optionally comprises microphones and wherein participating in analyzing is based on one or more comparisons, wherein each comparison includes comparing between amplitudes of signals received by the microphones, of responses from two or more second communication devices.
  • the communication device optionally comprises microphones and participating in analyzing is optionally based on one or more comparisons, wherein each comparison includes comparing between times of receptions of signals received by the microphones, of responses from two or more second communication devices.
  • participating in analyzing optionally comprises sending, by the communication device, to a computer, information about at least one item selected from the group consisting of: (a) the given direction, (b) an orientation of the communication device, (c) time of the transmitting of the triggering acoustic signal, and (d) the one or more responses.
  • participating in analyzing optionally comprises participating, with other communication devices that transmitted triggering signals, in a distributed determination process.
  • the triggering acoustic signal is optionally in a sonic range.
  • the triggering acoustic signal is optionally in a ultra-sonic range.
  • the method can further comprise attempting, by the communication device, to establish long-range communication with the given device.
  • the method can further comprise attempting, by the communication device, to establish short-range communication with the given device.
  • the method can further comprise: transmitting an additional triggering signal, by the communication device; receiving, by the communication device, one or more additional responses to the additional triggering signal, wherein the one or more additional responses originate from one or more additional devices; participating in determining of whether the one or more additional devices comprise an additional device that is positioned at a certain direction or receiving indication about whether the one or more additional devices comprises the additional device; and when the one or more additional devices comprises the additional device then attempting, by the communication device, to establish communication with the additional device.
  • identifying the given device can further comprise receiving information from a complementary information source selected from the group consisting of: Wi-Fi, BluetoothTM, and cellular communication.
  • the given device is optionally a beacon device configured to be attached to a child.
  • the method can further comprise: identifying within an image captured by the communication device, an object being at the given direction relatively to the communication device; associating the object with the identifier of a device associated with the object; and tagging the object within the image in accordance with the identifier.
  • the communication device and the given device are optionally drones, and further comprising coordinating actions between the communication device and the given device.
  • FIG. 1 is an example of a mobile communication device, other devices and a long-range network such as a cellular network that includes a computer, in accordance with some embodiments of the disclosure;
  • FIG. 2 is an example of a method, in accordance with some embodiments of the disclosure.
  • FIG. 3 is an example of a method, in accordance with some embodiments of the disclosure.
  • FIG. 4 is an example of an initiator device that is mobile communication device, in accordance with some embodiments of the disclosure.
  • FIG. 5 is an example of a receiver device, in accordance with some embodiments of the disclosure.
  • FIG. 6 is an example of a method, in accordance with some embodiments of the disclosure.
  • FIG. 7 is an example of three mobile communication devices and ranges of communication, in accordance with some embodiments of the disclosure.
  • FIG. 8 is an example of a method, in accordance with some embodiments of the disclosure.
  • FIG. 9 is an example of a mobile communication device that includes two microphones, in accordance with some embodiments of the disclosure.
  • FIG. 10 is an example of relationships between directions and distances between transmitters and receivers, in accordance with some embodiments of the disclosure.
  • FIG. 11 illustrates an example of different directions and different distances from mobile communication device 10, in accordance with some embodiments of the disclosure.
  • FIG. 12 illustrates an example of various devices, in accordance with some embodiments of the disclosure. DETAILED DESCRIPTION OF THE DRAWINGS
  • mobile device or “mobile communication device” relates to any device that can be operated without having to be connected to a fixed location, and has communication capabilities with other devices. Examples include but are not limited to mobile phones, tablets, lap top computers, drones, robots, or the like.
  • Directional communication is a communication between devices that is based on a direction from one device to another, e.g. utilizing the direction of a straight line connecting the devices.
  • a directional communication link may link between devices based on the direction from one device to another.
  • - directional communication may enable a person to point his device towards another person or an object, and initiate a communication channel with them.
  • the directional wireless communication technologies can be divided into light- based (such as lasers, IR etc.) and non-light-based (such as RF etc.).
  • Light-based communications include visible and invisible light in the frequency range of 400 to 800THz (800 and 375nm), which is unlicensed spectrum worldwide.
  • the smart devices' camera and flash light can also be used for directional light based communication but they also require line of sight between the two sides.
  • Non-light-based communications such as radio-frequency (RF)
  • RF radio-frequency
  • a directional antenna is designed to function more effectively in some directions than in others. The purpose of that directionality is improving transmission and reception of communications and reducing interference.
  • Wi-Fi wireless gigabyte alliance
  • 60 GHz is more directional by nature. Communication in the frequency range of 60 GHz requires line of sight and is directional and secure.
  • BLUETOOTHTM communication is point to point but is not directional as defined herein.
  • Stranger means herein that the recipient's contact details, such as cellular number, social network profile, Bluetooth ID or another identifier are unknown to the initiator.
  • Smart devices and wearables herein are any electronic devices that are able to connect, share and interact with its user and other smart devices.
  • Novel devices can be designed that will enable Directional Communication based on the provided method.
  • the suggested methods, non-transitory computer readable media that stores programs and devices can be applied in many situations, which can be divided generally into two groups: communication between strangers and the detection of the direction and /or distance to a stranger, where a stranger is as defined herein.
  • a stranger can be a person or an object.
  • Various examples are provided. In all of the applications mentioned herein one of the required steps is based on the measurement and analysis of the differences in sound signals time of arrival (TOA).
  • Sound herein means any propagating acoustic wave.
  • Many devices such as smartphones, home appliances and wearable devices, are able to transmit, receive and respond to signals such as sound (sound herein includes ultrasound signals above 20kHz), RF and light (visible and IR). It is possible to locate all these emitters in space by analyzing the signals' times of arrival and performing triangulation or trilateration. However, since the speed of sound is so much slower than the speed of RF and light, it is easier to locate the sound speakers in space than the other emitters. The method, described in this invention to locate the other devices' speakers in space is based upon measuring and analyzing the differences in sound signals TOA as received by the device's microphones.
  • One way to conduct the above-mentioned analysis is correlating the signals received by one microphone to the signals received by the other microphone as a function of time.
  • This data can then be used for various purposes such as Directional Communication, objects locating, indoor navigation and more.
  • Figure 1 illustrates a mobile communication device 10, other devices 21, 22, 23 and 24 - collectively denoted 20 (such as other mobile communication devices and/or one or more fixed communication device), and a long-range network such as cellular network 30 that includes computer 32.
  • a mobile communication device 10 other devices 21, 22, 23 and 24 - collectively denoted 20 (such as other mobile communication devices and/or one or more fixed communication device), and a long-range network such as cellular network 30 that includes computer 32.
  • the user of the mobile communication device 10 may request to communicate over the cellular network 30 with any member of devices 20 - such as device 21 that is located at a direction 41 from the mobile communication device 10. The user may not request to communicate with device 22 of devices 20.
  • Figure 2 illustrates an example of method 100.
  • Method 100 may start by step 110 of receiving, by a mobile communication device, a request from a user or from an object or application, to communicate with a given device that is located at a given direction.
  • the request may be a voice command, a contact between the user and an area of a touch screen or may have any other form.
  • the mobile communication device may display to the user an image of the surrounding of the mobile communication device and the user may select a person or an object that is located at the given direction.
  • Step 110 may be followed by step 120 of transmitting a triggering signal 60, by the mobile communication device
  • the triggering signal may be conveyed over an acoustic carrier, an RF carrier, a light carrier, an infrared carrier, and the like.
  • the triggering signal can comprise light, sound, RF signal, or the like. It will be appreciated that while a light signal requires a line of sight, other signals such as a sound signal do not pose this requirement.
  • Step 120 may be followed by step 130 of receiving, by the mobile communication device, one or more responses to the triggering signal, wherein the one or more responses originate from one or more devices.
  • the triggering signal 60 is received by devices 21 and 22 adapted to receive such signals, for example having an application installed thereon, and responses 61 and 62 are transmitted (by devices 21 and 22 respectively) to the mobile communication device 10.
  • Step 130 may be followed by step 140 of participating in determining by the mobile communication device whether the one or more devices include the given device or receiving indication about whether the one or more devices include the given device.
  • Step 140 may include at least one of the following: a. Determining, by the mobile communication device, whether the one or more devices include the given device. b. Determining of whether the one or more devices include the given device based on one or more comparisons, wherein each comparison includes comparing between receptions, by microphones of the mobile communication device, of a response from a single device of the one or more devices. For example, if device 21 responded, the direction of that device is calculated based on the reception, by the different microphones, of the response. Especially - the determination is based on the TOA differences, by the microphones, of a response from device 21.
  • the direction of each device out of devices 21 and 22 is calculated based on the reception of the response (from each one of devices 21 and 22) by the microphones of the mobile communication device.
  • c Sending, by the mobile communication device, to a computer (such as computer 32), information about at least one item out of (a) the given direction, (b) an orientation of the mobile communication device, (c) time of the transmitting of the triggering signal, and (d) the one or more responses.
  • Participating with other mobile communication devices that transmitted triggering signals for example devices 20
  • method 100 may end and/or having step 140 be followed by sending a failure notification to the user.
  • step 140 may be followed by step 150 of attempting, by the mobile communication device, to establish communication with the given device.
  • Step 150 may use contact information provided in a response (step 130) or may be provided in another manner (for example- from a computer such as computer 32).
  • the communication may be established over a non-directional link such as the cellular network and/or over a short-range link such as RFID and/or NFC.
  • Short-range may include communication over a distance that does not exceed 10-50 meters.
  • Long-range may include communication over a distance that exceeds 10-50 meters.
  • Devices 21 and 22 as well as mobile communication device 10 may register in advance to the directional communication service (for example by registering to a directional communication web site) or may otherwise be configured to detect the triggering device and transmit a response.
  • the response may identify the device that sends the response.
  • the response may be unique, may be unique within a time period, may be unique within a certain area (for example- within a cell of cellular network 30), and the like.
  • figure 2 illustrates a communication between the mobile communication device and a given device - method 100 may be applied for communicating between the mobile communication device and multiple other devices.
  • a single triggering signal can be used for communicating between the mobile communication device and one or more other devices.
  • method 100 may include receiving, by the mobile communication device, a request to communicate with an additional device that is located at a certain direction; transmitting an additional triggering signal, by the mobile communication device; receiving, by the mobile communication device, one or more additional responses to the additional triggering signal, wherein the one or more additional responses originate from one or more additional devices; participating in determining of whether the one or more additional devices comprise the additional device or receiving indication about whether the one or more additional devices include the additional device; and when the one or more additional devices include the additional device then attempting, by the mobile communication device, to establish communication with the additional device.
  • method 100 may include receiving, by the mobile communication device, a request to communicate with a group of devices that are located at different directions; wherein the request to communicate with the group of devices include the request to communicate with the given device; participating in determining of whether the one or more additional devices comprise any member of the group of devices or receiving indication about whether the one or more additional devices comprise any member of the group of devices; and when the one or more additional devices comprise any member of the group of devices then attempting, by the mobile communication device, to establish communication with any member of the group of devices that is included in the or more devices.
  • Figure 3 illustrate a method 180 managing communication, the method may be executed by a computer such as computer 32 of figure 1.
  • the computer may include one or more servers, one or more desktop computers, an array of neural networks, and the like.
  • Method 180 may start by step 182 of receiving by a computer, and from a mobile communication device, information about at least one item out of (a) a given direction between a mobile communication device and a given device, (b) an orientation of the mobile communication device, (c) a time of transmitting of a triggering signal by the mobile communication device and over a local communication link, and (d) one or more responses to the triggering signal, wherein the one or more responses are generated by one or more devices in response to the triggering signal.
  • Step 182 may be followed by step 184 of determining, based on the information, whether the one or more devices include the given device.
  • Step 184 may be followed by step 186 of sending towards the mobile communication device an indication about whether the one or more devices include the given device.
  • the method starts with the initiator (person or an object) aiming (pointing) his device at the designated recipient's device and triggering all compatible pre-registered devices in the initiator vicinity, either directly by sending a signal (RF, Sound or light) or by a server that knows their locations, to respond by transmitting a sound signal which can be matched to their pre-registered profile.
  • Compatible pre-registered devices herein are those devices that have the minimally required hardware and software (such as a dedicated application, that is stored in a non-transitory computer readable medium or a manufacturer pre-installed application/program that is stored in a non-transitory computer readable medium or permit to access via their processing unit).
  • Figure 4 illustrates an initiating device such as mobile communication device 10 as including one or more microphones (such as first microphone 105 and second microphone 106), emitter 101 for emitting the triggering signal, hardware system 102, processing unit 103 and audio subsystem 104.
  • an initiating device such as mobile communication device 10 as including one or more microphones (such as first microphone 105 and second microphone 106), emitter 101 for emitting the triggering signal, hardware system 102, processing unit 103 and audio subsystem 104.
  • Figure 5 illustrates a responding device such as device 22 as including receiver 221 (for receiving the triggering signal), a speaker 225 for transmitting a response to the triggering signal, hardware system 222, processing unit 223 and audio subsystem 224.
  • a responding device such as device 22 as including receiver 221 (for receiving the triggering signal), a speaker 225 for transmitting a response to the triggering signal, hardware system 222, processing unit 223 and audio subsystem 224.
  • a device can be an initiating device as well as a responding device, and in that case may comprise hardware system, a processing unit, audio subsystem, first or second microphone and a speaker.
  • Step 302 may include having the initiator aim the initiator device towards (and in the same plane) the intended recipient (at a given direction) and transmits a triggering signal.
  • Step 304 may include having the triggering signal trigger all compatible devices that receive the triggering signal to send a response.
  • Each response may identify the device that sent the response and may include contact details of the device or a user thereof.
  • a compatible device is a device that is configured to participate in the execution of method 300.
  • Step 306 may include having the initiator device analyze differences in TODA of the responses, determine the direction of the compatible devices and determines which device (if any) of the compatible devices is the intended recipient device (positioned at the given direction). If the intended recipient device has not responded, the method may end.
  • step 306 may be followed by step 308 that may include sending, by the initiator device to the intended recipient device a request to communicate.
  • Step 310 may include checking if the initiator device received an acceptance to communicate from the intended recipient device,. If not- the method may end.
  • step 310 may be followed by step 312 of communication between the initiator device and the intended recipient device.
  • Figure 7 illustrates method 301 for communication.
  • the method includes steps 302, 304, 305, 308, 310 and 312.
  • Method 301 differs from method 300 by including- instead of step 306 of analyzing differences in TODA, determining the direction of the compatible devices and determining which device is positioned at the given direction, step 305 of having a computer that differs from the initiator device determine the direction of the compatible devices and determines which device (if any) of the compatible devices is the intended recipient device (positioned at the given direction). If no device is determined to be the intended recipient device, then the method may end. If the intended recipient device is determined, then step 305 is followed by step 308. [0084] The provided Directional Communication may allow an initiator to distinguish between the desired recipient's signal and all other responding signals.
  • Each responding device may transmit an individual sequence of sound signals that identifies it. These signals may include the user's basic information including its communication ID (as defined by this method). This individual sequence enables to effectively filter desired signals out of all the signals received.
  • the individual sequence of sound signals can be either static, which means it is allocated to the user once he pre- registers, or dynamic, which means that a server allocates ad hoc signals to users based on the number of different devices in a known area, once a user asks to initiate communication or position determination.
  • Another method to identify each of the devices is by the server arranging the devices in a queue and having them respond their sound signals one after the other, once a user initiates communication or position determination.
  • the initiator's device or the server to which the devices are connected to can then analyze the signals received and pair between each device and its pre -registered profile.
  • the initiator's device or the server to which the devices are connected to can then analyze all the signals and compare the time they have arrived to each of the microphones embedded in it, to determine the distance and direction of all the devices that responded. It then uses a dedicated algorithm to identify which of these devices is the desired recipient.
  • the initiator's device or the server to which the devices are connected to identifies the desired target, either for communicating with or for finding its position.
  • the Directional Communication requires using a server (except in the case of one-on-one). Detecting the desired recipient's direction requires additional data, the azimuth formed between a reference direction (The North for example) and the line between the initiator and the desired recipient. Most smart devices include a compass that can provide this azimuth. [0092] The rest of the data required are the possible locations of the desired recipient calculated from imaginary circles drawn around all the participating users, and their crossing points.
  • the radii of these circles are the relative distances from one another, which can be provided by either synchronizing the clocks of all the participating users, or by sharing data regarding the timing of the transmitted signals, and the TOA of the signals and using it for relative distances calculations or for triangulation or trilateration. Crossing of the azimuth with the possible locations gives the desired recipient's position.
  • Figure 8 illustrates mobile communication device 10 that is located at the center of imaginary circles 401 and 402, device 21 that is located at the center of imaginary circles 411 and 412, and device 22 that is located at the center of imaginary circles 421 and 422.
  • Bluetooth Low Energy is a wireless technology for exchanging data, over short distances, and is particularly useful for Internet-of-Things (IoT) technologies.
  • IoT Internet-of-Things
  • BLE is widely supported by wearable devices, and can thus be used for indoor-localization and proximity sensing. Using BLE it is thus possible to evaluate the relative distance between two transmitters. Lower signal strength implies higher and vice versa.
  • the relationship between the relative received signal strength (RSSI) and the distance between two BLE devices can be assessed using a number of models, for example a polynomial model with a mean distance percentage error equal to 25.7% (0.4 m) in the range of 0-3 m. It will be appreciated that other methods Amy use the general principle of a stronger received signal implies a shorter distance.
  • Further methods may be used for evaluating the distance to an intended device and not just the direction. Some of the methods include triangulation between a multiplicity of devices, which requires sharing information between the devices. For example, each device can notify the time at which it received a signal from an initiator, and a server can then compute the distance between the initiator and each such recipient. [0096] In some examples, static dedicated transmitters may be provided in a stadium, hall or another crowded location, such that a user can locate his or her friends, using the direction determined to any such friend, and the distance which may be determined by triangulation with the known device's locations.
  • enhanced triangulation can be performed by a device having multiple speakers.
  • a TV having two or more speakers can locate a smart phone, for example for the purpose of sending content.
  • the location of each such phone relatively to the TV can then be determined using the angle and the known distance between the speakers.
  • a similar approach can be used with other smart devices, with or without smart pods, such as Amazon Echo, Google Home, or other devices comprising two or more speakers.
  • the signal when transmitting an acoustic signal from a mobile device, the signal may be transmitted by main speaker of the device or by the upper speaker of the device, e.g., the speaker which is adjacent to the user's ear when the user is speaking over the phone.
  • a mobile device is usually placed face-up on a table or another plane, thus the upper microphone is pointed upwards, while the main speaker is pointed elsewhere.
  • using the upper speaker usually provides for fewer reflections from objects within the space, however it allows for shorter reception distances due to the lower amplitude.
  • a signal generated by the main speaker is stringer but is more likely to hit various objects, and the reflections can cause higher deviations.
  • transmitted acoustic signals can comprise a frequency which may be unique, or unique within a certain time period or a specific area.
  • the unique frequency can be used for identifying the transmitting device.
  • the frequency can be carried on a carrier wave in the ultra- sonic range, in the near ultrasonic range, or in the sonic range. It will be appreciated that transmitting the frequency over the sonic range significantly increases the range at which it is possible to locate the transmission direction.
  • Table 1 below provides experimental results for using sonic, ultra-sonic and near ultra-sonic signals submitted by the main speaker and the upper speaker.
  • the frequency range of the transmission can be selected by analyzing the background noise and selecting a range that is relatively quiet, such that the transmission is relatively free of interferences.
  • a communication channel between the initiator device and the desired target's device can be established.
  • This communication may include a link between the devices' pre-registered profiles, utilizing previously provided identity information, and/or contact information for sending a message.
  • the message can be a personal advertisement, a request for data, a request for chatting etc.
  • the desired target may provide further contact information such as its cellular number, email address or social network profile.
  • Some of the above contact data may be transferred already in the response to the triggering signal.
  • the suggested method and system may be utilized in various situations such as: [0110] Person to person communication - finding distance and direction.
  • a. In the case that the initiator's device includes only one microphone, using triangulation or trilateration based on synchronized signal transmitting time and time- of-arrival (TOA) data shared between the various devices.
  • TOA time- of-arrival
  • Pre-positioning an object with known location (or using an already existing object) as a fixed recipient facilitates the analysis.
  • recipients' devices can facilitate the analysis by sharing their indoor coordinates with the initiator's device.
  • iii. Repeating the process after the initiator' s device is moved by known distance and direction facilitates the analysis.
  • TOA time- of-arrival
  • the initiator' s device includes two microphones, using TOA data is sufficient to find the direction, as is later demonstrated.
  • c In the case that the initiator's device includes more than two microphones, using TOA data is sufficient to find both the direction and the distance by using triangulation. Comparing the direction found by each pair of microphones enables to find the crossing point which indicates the exact relative location.
  • d Using two initiating devices both having two microphones, when the distance between these devices is known, enables to find the relative position of a recipient by triangulation.
  • synchronizing their device's clocks enables to find their distances by analyzing their sound signal time of flight (TOF).
  • TOF sound signal time of flight
  • Sharing the data between various devices will enable cross-triangulation or trilateration which can create a network of positions of the various devices. Such a network can improve the accuracy of the positioning process.
  • FIG. 9 illustrates a mobile communication device 10 that include two microphones 105 and 106 that are spaced apart from each other by about 10 centimeters.
  • audio ADC sampling rate can be 48 kHz or even higher, which means that it is possible to measure time-of-arrival differences of about 0.02 millisecond.
  • This location of each emitting device can then be used for various purposes such as Directional Communication, objects and person locating, indoor navigation and more.
  • the minimal required hardware for this method in the initiator's device includes at least two separate microphones connected to audio subsystem and signal processing capabilities.
  • the recipient's device must include a speaker that is capable of generating a detectable sound signal at the initiator's device.
  • the initiator must be able to communicate with the recipient/recipients in order to trigger them to transmit the sound signal.
  • This primary initiation can be conducted by a variety of methods, including sound, RF or light signals, which the recipient device can detect or by sending command through a server which the devices are connected to.
  • the status of at least one recipient device which can be either turned on, in standby mode, in sleep mode or in other modes, also affects the required methods to trigger the recipients' response: a. If the at least one recipient device is turned on, any of the above mentioned communication methods can be used to trigger them to respond. b. If their devices are on other modes, the methods that can be used must comply with the manufacturer's design. For example, some current devices have an 'Always- On' voice system that can wake up the device by a specific voice activity feature which enables them to react to voice commands. The method described in this case will use a pre-determined sound trigger signal that will be recognized by the device's 'Always- On (or Voice Trigger) subsystem and will activate their speakers. c.
  • the method provided holds also for devices that their 'always on' feature can be triggered by RF and/or light. d. Sending command from the server, based on known location (either GPS based or other) to trigger recipients' response is not dependent on the status of their devices.
  • the initiator aims its device towards and approximately in the same plane of the intended recipient's device. A clear or free line of sight is not mandatory.
  • the initiator device then triggers all the compatible pre-registered devices in the initiator vicinity, either directly by sending a signal (RF, Sound or light) or by a server that knows their positions, to send a sound signal.
  • the sound signals which the initiator's device receives are then analyzed either by it or by a server which it is connected to, in order to match them to their pre- registered profiles.
  • Each responding device may transmit a unique individual sequence of sound signals that identifies itself by providing its basic information including its communication ID (as defined by this method). This individual unique sequence enables to filter out effectively desired signals out of all the signals received.
  • Another method to identify each of the devices is by analyzing their data in a server and pairing between them based on their personal profile.
  • the analysis algorithm will look for the maximal TOA differences. If the line between the initiator's device microphones will be perpendicular to the recipient's direction a minimal TOA differences will be looked for.
  • the analysis is based on matching the TOA difference from each of the responders to the initiator's microphones.
  • the right difference in arrival times between the two microphones is pre-defined according to the initiator device model (depends on the exact distance between the microphones in each model).
  • the initiator's device will receive a pair of signals, one to each of its microphones, from each responder.
  • the device or the server then calculates the time-of-arrival difference between each pair and compares it to the pre-defined time difference to check if it matches the algorithm.
  • the initiator can include in its request to communicate his device's azimuth when directed at the recipient.
  • the recipient can use this azimuth to direct his device towards the initiator and identify him.
  • any of the mentioned above methods may use triangle basic rules (such as Law of Sines and the Law of Cosines).
  • This additional analysis may enable to detect the exact distance between each of the recipients' devices in the vicinity and their position.
  • Example see also sketch 510 of figure 10. If there are two emitters, one is the intended recipient (Emitter I) and the other is not (emitter II), the following data is known: d (distance between the receivers of the initiator's device) b (distance of Emitter I from Receiver I) b+d (distance of Emitter I from Receiver II) c (distance of Emitter II from Receiver I) e (distance of Emitter II from Receiver II.
  • Figure 11 illustrates different directions and different distances from mobile communication device 10.
  • the method described herein can be applied in many situations, which can be generally either communication between strangers (either of which can be a person or an object) or the detection of the direction and /or distance to strangers (either a person or an object).
  • One-to-one a. Person-to-person. b. People in a coffee shop, in a pub, etc. c. Between drivers.
  • Person-to-object a. Window display of objects, museum displaying objects, person to clothing object dressed or carried or worn by another person. b. Finding lost car in parking lot, lost keys.
  • Remote controls for the house or industry [0149]
  • Object-to-person a. Window display as above but initiated by the object. b. Same but inside store. c. Security Alerts such as the detection of line crossing or perimeter crossing by a person. d.
  • a transmitting device either an existing smart-device or a novel dedicated device, that sends sound waves that indicates its position and assist individuals who hold a smart- devices to navigate to it. This can be useful for office or apartments buildings, shopping malls, airports, hospitals, conventions etc.
  • Object-to-object a. Security Alerts as above. b. Organizing objects on a line, at a given distance from each other or at another geometry. c. Distance to wallet checked by smartphone or other device. d. Between cars or between cars and traffic lights. [0151] One-to-many: a. One is a person or a shop or a business sending a message to persons or objects in a specific sector (defined by a range of distances and a range of angles).
  • the receiver device has been positioned in a fixed location in which the line that connects its 2 microphones was perpendicular to the line of sight referred to as 0 degrees.
  • Any of the above mentioned methods may be used for determining location (direction and/or range) between two or more devices.
  • At least one of devices mentioned above may be a mobile communication device, a fixed device, a mobile phone, a smart phone, a wearable device, and the like.
  • the determination regarding the spatial relationship (relative direction and/or range) between devices may be calculated by the initiator device, by a computer that differs from the initiator device, in a centralized manner or in a distributed manner.
  • Any of the above mentioned devices may be operated by a human user and/or may be operated without human intervention.
  • Any of the methods may be used for communicating between devices of users that are known to each other or unknown to each other before the communication begins.
  • Any of the methods may be used for communicating between two persons who are strangers to each other, for example one person communicates with another in a bar.
  • the person who initiates the communication can thus contact the other person even if the other person is in the vicinity of other people, and can establish communication with that person only.
  • the glasses may be equipped with components as detailed in association with Figs. 4 and 5 above. Such components can be operative in determining the relative location, e.g. distance and direction between any two players, thus making the game more accurate and enjoyable.
  • VR virtual reality
  • a static dedicated device may be provided within the game area, using which the users can determine their relative distance and not only the direction, similarly to the friends finding system in stadiums described above.
  • specific or dedicated components or devices may be used by one side in order to detect the direction and/or distance between an initiator and an intended recipient, or to form communication therebetween.
  • a dedicated acoustic or another beacon device comprising the components as shown in Fig. 5 above may be attached to a child, such that a parent or another guardian can locate the child in a crowd, using the guardian's mobile device.
  • Any of the methods may be used for allowing a user to receive data about an object by pointing at it, for example a person aiming his smart device at a picture in a museum or at an object in a display window and receiving data transmitted by it
  • Any of the methods may be used for allowing an object to communicate with a user who's positioned in a specific direction relatively to it, for example a location related advertisement.
  • Any of the methods may be used for allowing a user to communicate with a group of people located within a pre-defined span, for example sending data only to people located on one side of a meeting room.
  • Any of the methods may be used for allowing an object to communicate with a group of people located in a specific space, for example a business sends advertisements or special offers to all customers located within it.
  • Any of the methods may be used for allowing an object to communicate with a part of a group of people located in a specific space, based on the profiles as known by their pre-registry.
  • Any of the methods may be used for providing content such as advertisements or music to the relevant crowd profile.
  • Any of the methods may be used for providing direction information for a meeting between two persons, for example in a conference hall or in an airport.
  • Any of the methods may be used for directing an object for example a drone towards a person.
  • Any of the methods may be used for guiding a person to a specific location, for example indoor navigation in an office building, airport, hospital etc.
  • Any of the methods may be used for guiding an object to the location of another object, for example guiding a robot to its docking station
  • Any of the methods may be used for guiding a group of people to arrive to a person's location, for example a tour guide who gathers his group.
  • Any one of method 100, 300 and 301 may be initiated by an initiator device (such as a mobile communication device or any other wireless communication device) - even without human intervention.
  • an initiator device such as a mobile communication device or any other wireless communication device
  • forming directional communication can be used for enhancing applications. For example, if a user is taking a group photo of a number of people using his mobile device, the user's mobile device can form directional communication with any one or more of them, retrieve their identity and automatically tag them in the picture, using the direction between the user and the identified person as reflected in the photo.
  • Another application may relate to a swarm of independent devices, such as robots or drones. By using acoustic signals and microphones, the relative location between any two drones can be determined, and their actions, such as capturing images can be coordinated. [0184] Any reference to the term “comprising” or “having” should be interpreted also as referring to “consisting” of "essentially consisting of. For example - a method that comprises certain steps can include additional steps, can be limited to the certain steps or may include additional steps that do not materially affect the basic and novel characteristics of the method - respectively.
  • the invention may also be implemented in a computer program for running on a computer system, at least including code portions for performing steps of a method according to the invention when run on a programmable apparatus, such as a computer system or enabling a programmable apparatus to perform functions of a device or system according to the invention.
  • the computer program may cause the storage system to allocate disk drives to disk drive groups.
  • a computer program is a list of instructions such as a particular application program and/or an operating system.
  • the computer program may for instance include one or more of: a subroutine, a function, a procedure, an object method, an object implementation, an executable application, an applet, a servlet, a source code, an object code, a shared library/dynamic load library and/or other sequence of instructions designed for execution on a computer system.
  • the computer program may be stored internally on a non-transitory computer readable medium. All or some of the computer program may be provided on computer readable media permanently, removably or remotely coupled to an information processing system.
  • the computer readable media may include, for example and without limitation, any number of the following: magnetic storage media including disk and tape storage media; optical storage media such as compact disk media (e.g., CD-ROM, CD-R, etc.) and digital video disk storage media; nonvolatile memory storage media including semiconductor-based memory units such as FLASH memory, EEPROM, EPROM, ROM; ferromagnetic digital memories; MRAM; volatile storage media including registers, buffers or caches, main memory, RAM, etc.
  • a computer process typically includes an executing (running) program or portion of a program, current program values and state information, and the resources used by the operating system to manage the execution of the process.
  • An operating system is the software that manages the sharing of the resources of a computer and provides programmers with an interface used to access those resources.
  • An operating system processes system data and user input, and responds by allocating and managing tasks and internal system resources as a service to users and programs of the system.
  • the computer system may for instance include at least one processing unit, associated memory and a number of input/output (I/O) devices.
  • I/O input/output
  • any arrangement of components to achieve the same functionality is effectively “associated” such that the desired functionality is achieved.
  • any two components herein combined to achieve a particular functionality may be seen as “associated with” each other such that the desired functionality is achieved, irrespective of architectures or intermedial components.
  • any two components so associated can also be viewed as being “operably connected,” or “operably coupled,” to each other to achieve the desired functionality.
  • the illustrated examples may be implemented as circuitry located on a single integrated circuit or within a same device.
  • the examples may be implemented as any number of separate integrated circuits or separate devices interconnected with each other in a suitable manner.
  • the examples, or portions thereof may implemented as soft or code representations of physical circuitry or of logical representations convertible into physical circuitry, such as in a hardware description language of any appropriate type.
  • the invention is not limited to physical devices or units implemented in non-programmable hardware but can also be applied in programmable devices or units able to perform the desired device functions by operating in accordance with suitable program code, such as mainframes, minicomputers, servers, workstations, personal computers, notepads, personal digital assistants, electronic games, automotive and other embedded systems, cell phones and various other wireless devices, commonly denoted in this application as 'computer systems' .
  • suitable program code such as mainframes, minicomputers, servers, workstations, personal computers, notepads, personal digital assistants, electronic games, automotive and other embedded systems, cell phones and various other wireless devices, commonly denoted in this application as 'computer systems' .
  • any reference signs placed between parentheses shall not be construed as limiting the claim.
  • the word 'comprising' does not exclude the presence of other elements or steps then those listed in a claim.
  • the terms "a” or "an,” as used herein, are defined as one or more than one.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

L'invention concerne un procédé pour un dispositif de communication pour communiquer avec un dispositif donné situé dans une direction donnée, comprenant : la transmission d'un signal acoustique de déclenchement, dans la direction donnée; la réception d'une ou plusieurs réponses au signal de déclenchement acoustique, le ou les réponses provenant d'un ou de plusieurs seconds dispositifs de communication, et chaque réponse parmi le ou les réponses comprenant un identifiant d'un dispositif parmi le ou les seconds dispositifs de communication qui ont transmis la réponse; la participation à l'analyse des temps d'arrivée de la réponse ou des réponses pour déterminer des directions du ou des seconds dispositifs de communication par rapport au dispositif de communication, ce qui permet d'identifier le dispositif donné en tant que dispositif se trouvant dans la direction donnée par rapport au dispositif de communication; la transmission au dispositif donné d'une demande de communication; et la réception d'une acceptation en provenance du dispositif donné, communiquant avec le dispositif donné.
PCT/IL2017/051141 2016-04-17 2017-10-16 Gestion de communication et communication entre un dispositif de communication et un autre dispositif WO2019077594A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/IL2017/051141 WO2019077594A1 (fr) 2017-10-16 2017-10-16 Gestion de communication et communication entre un dispositif de communication et un autre dispositif
EP17929202.4A EP3698491A4 (fr) 2017-10-16 2017-10-16 Gestion de communication et communication entre un dispositif de communication et un autre dispositif
US16/538,470 US10735933B2 (en) 2016-04-17 2019-08-12 Communication management and communicating between a mobile communication device and another device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IL2017/051141 WO2019077594A1 (fr) 2017-10-16 2017-10-16 Gestion de communication et communication entre un dispositif de communication et un autre dispositif

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US15/488,516 Continuation US10382929B2 (en) 2016-04-17 2017-04-17 Communication management and communicating between a mobile communication device and another device

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US15/488,516 Continuation US10382929B2 (en) 2016-04-17 2017-04-17 Communication management and communicating between a mobile communication device and another device
US16/538,470 Continuation US10735933B2 (en) 2016-04-17 2019-08-12 Communication management and communicating between a mobile communication device and another device

Publications (1)

Publication Number Publication Date
WO2019077594A1 true WO2019077594A1 (fr) 2019-04-25

Family

ID=66174397

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2017/051141 WO2019077594A1 (fr) 2016-04-17 2017-10-16 Gestion de communication et communication entre un dispositif de communication et un autre dispositif

Country Status (2)

Country Link
EP (1) EP3698491A4 (fr)
WO (1) WO2019077594A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4020850A1 (fr) * 2020-12-22 2022-06-29 Suzuki Motor Corporation Commande à distance, dispositif d'envoi d'environnement de communication, et procédé de vérification d'environnement de communication

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003100452A1 (fr) 2002-05-29 2003-12-04 Lior Baussi Telephones cellulaires radiogoniometriques
US20110182445A1 (en) 1998-10-02 2011-07-28 Beepcard Inc. Computer communications using acoustic signals
US20150171973A1 (en) * 2013-03-13 2015-06-18 Aliphcom Proximity-based and acoustic control of media devices for media presentations
US20150348403A1 (en) * 2014-05-30 2015-12-03 Qualcomm Incorporated Methods, Smart Objects, and Systems for Naming and Interacting with Smart Objects
WO2017011672A1 (fr) 2015-07-14 2017-01-19 Driving Management Systems, Inc. Détection de l'emplacement d'un téléphone à l'aide de signaux ultrasonores et sans fil rf
EP3189643A1 (fr) * 2014-09-02 2017-07-12 Qualcomm Incorporated Découverte d'application de proximité et approvisionnement

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9130664B2 (en) * 2012-10-17 2015-09-08 Qualcomm Incorporated Wireless communications using a sound signal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110182445A1 (en) 1998-10-02 2011-07-28 Beepcard Inc. Computer communications using acoustic signals
WO2003100452A1 (fr) 2002-05-29 2003-12-04 Lior Baussi Telephones cellulaires radiogoniometriques
US20150171973A1 (en) * 2013-03-13 2015-06-18 Aliphcom Proximity-based and acoustic control of media devices for media presentations
US20150348403A1 (en) * 2014-05-30 2015-12-03 Qualcomm Incorporated Methods, Smart Objects, and Systems for Naming and Interacting with Smart Objects
EP3149895A1 (fr) * 2014-05-30 2017-04-05 Qualcomm Incorporated Procédés, objets intelligents, et systèmes permettant de nommer et d'interagir avec des objets intelligents
EP3189643A1 (fr) * 2014-09-02 2017-07-12 Qualcomm Incorporated Découverte d'application de proximité et approvisionnement
WO2017011672A1 (fr) 2015-07-14 2017-01-19 Driving Management Systems, Inc. Détection de l'emplacement d'un téléphone à l'aide de signaux ultrasonores et sans fil rf

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3698491A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4020850A1 (fr) * 2020-12-22 2022-06-29 Suzuki Motor Corporation Commande à distance, dispositif d'envoi d'environnement de communication, et procédé de vérification d'environnement de communication

Also Published As

Publication number Publication date
EP3698491A4 (fr) 2021-06-02
EP3698491A1 (fr) 2020-08-26

Similar Documents

Publication Publication Date Title
Zafari et al. A survey of indoor localization systems and technologies
AU2022205199B2 (en) Controlling electronic devices and displaying information based on wireless ranging
Brena et al. Evolution of indoor positioning technologies: A survey
US9554091B1 (en) Identifying conference participants and active talkers at a video conference endpoint using user devices
US20150142891A1 (en) Anticipatory Environment for Collaboration and Data Sharing
US11294025B2 (en) Ultrasound position-determination system
US11030835B2 (en) Frictionless access control system providing ultrasonic user location
US10149098B2 (en) Location tracking
KR101680667B1 (ko) 이동 단말기 및 이동 단말기의 제어방법
US20240152663A1 (en) Acoustic positioning transmitter and receiver system and method
US10735933B2 (en) Communication management and communicating between a mobile communication device and another device
EP3698491A1 (fr) Gestion de communication et communication entre un dispositif de communication et un autre dispositif
KR20220124259A (ko) 우도 기반 음향 포지셔닝
CN112100527B (zh) 一种展示智能设备的方法和装置
CN112100526B (zh) 一种标识智能设备的方法和装置
Moutinho Indoor sound based localization
Krohn Relative Positioning

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17929202

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017929202

Country of ref document: EP

Effective date: 20200518