WO2019077594A1 - Communication management and communicating between a communication device and another device - Google Patents

Abstract

A method for a communication device to communicate with a given device located at a given direction, comprising: transmitting a triggering acoustic signal, in the given direction; receiving one or more responses to the acoustic triggering signal, wherein the one or more responses originate from one or more second communication devices, and wherein each response of the one or more responses comprises an identifier of a device from the one or more second communication devices that transmitted the response; participating in analyzing, times of arrival of the one or more responses for determining directions of the one or more second communication devices relatively to the communication device, thereby identifying the given device as a device that is in the given direction relatively to the communication device; transmitting to the given device a request to communicate; and subject to receiving acceptance from the given device, communicating with the given device.

Description

COMMUNICATION MANAGEMENT AND COMMUNICATING BETWEEN A COMMUNICATION DEVICE AND ANOTHER DEVICE

BACKGROUND

[0001] Modern life exposes people to many different wireless devices that transfer data and/or control such as cellular phones, remote controls for home and toys, satellite television, and computer keyboards and mice.

[0002] Three technologies are employed for all wireless applications: radio, other electromagnetic such as light, magnetic or electric fields and sound.

[0003] Current devices use a wide range of different wireless methods, systems and protocols, such as: long term evolution (LTE), wireless networking WI-FI™, BLUETOOTH™, near field communication (NFC) and radio frequency identification (RFID).

[0004] Wireless communication, which can be person-to-person, person to machine, machine to person and machine to machine, requires having the recipient's contact details - (cellular number, BLUETOOTH™ etc.) and is not directional.

SUMMARY

[0005] An aspect of the disclosure relates to a method for a communication device to communicate with a given device that is located at a given direction, the method comprising: transmitting a triggering acoustic signal, by the communication device in the given direction; receiving, by the communication device, one or more responses to the acoustic triggering signal, wherein the one or more responses originate from one or more second communication devices, and wherein each response of the one or more responses comprises an identifier of a device from the one or more second communication devices that transmitted the response; participating in analyzing by the communication device, times of arrival of the one or more responses for determining directions of the one or more second communication devices relatively to the communication device, thereby identifying the given device as a device that is in the given direction relatively to the communication device; transmitting by the communication device, to the given device a request to communicate; and subject to receiving by the communication device, acceptance from the given device, communicating with the given device. Within the method, the transmitting of the triggering acoustic signal is optionally preceded by determining, by the communication device and in an autonomous manner, to communicate with the given device. Within the method, the communication device optionally comprises microphones and wherein participating in analyzing is based on one or more comparisons, wherein each comparison includes comparing between amplitudes of signals received by the microphones, of responses from two or more second communication devices. Within the method, the communication device optionally comprises microphones and participating in analyzing is optionally based on one or more comparisons, wherein each comparison includes comparing between times of receptions of signals received by the microphones, of responses from two or more second communication devices. Within the method, participating in analyzing optionally comprises sending, by the communication device, to a computer, information about at least one item selected from the group consisting of: (a) the given direction, (b) an orientation of the communication device, (c) time of the transmitting of the triggering acoustic signal, and (d) the one or more responses. Within the method, participating in analyzing optionally comprises participating, with other communication devices that transmitted triggering signals, in a distributed determination process. Within the method, the triggering acoustic signal is optionally in a sonic range. Within the method, the triggering acoustic signal is optionally in a ultra-sonic range. The method can further comprise attempting, by the communication device, to establish long-range communication with the given device. The method can further comprise attempting, by the communication device, to establish short-range communication with the given device. The method can further comprise: transmitting an additional triggering signal, by the communication device; receiving, by the communication device, one or more additional responses to the additional triggering signal, wherein the one or more additional responses originate from one or more additional devices; participating in determining of whether the one or more additional devices comprise an additional device that is positioned at a certain direction or receiving indication about whether the one or more additional devices comprises the additional device; and when the one or more additional devices comprises the additional device then attempting, by the communication device, to establish communication with the additional device. Within the method identifying the given device can further comprise receiving information from a complementary information source selected from the group consisting of: Wi-Fi, Bluetooth™, and cellular communication. Within the method, the given device is optionally a beacon device configured to be attached to a child. The method can further comprise: identifying within an image captured by the communication device, an object being at the given direction relatively to the communication device; associating the object with the identifier of a device associated with the object; and tagging the object within the image in accordance with the identifier. Within the method, the communication device and the given device are optionally drones, and further comprising coordinating actions between the communication device and the given device.

BRIEF DESCRIPTION OF THE DRAWINGS

[0006] The subject matter regarded as the invention is particularly pointed out and distinctly claimed in the concluding portion of the specification. The invention, however, both as to organization and method of operation, together with objects, features, and advantages thereof, may best be understood by reference to the following detailed description when read with the accompanying drawings: [0007] FIG. 1 is an example of a mobile communication device, other devices and a long-range network such as a cellular network that includes a computer, in accordance with some embodiments of the disclosure;

[0008] FIG. 2 is an example of a method, in accordance with some embodiments of the disclosure;

[0009] FIG. 3 is an example of a method, in accordance with some embodiments of the disclosure;

[0010] FIG. 4 is an example of an initiator device that is mobile communication device, in accordance with some embodiments of the disclosure;

[0011] FIG. 5 is an example of a receiver device, in accordance with some embodiments of the disclosure;

[0012] FIG. 6 is an example of a method, in accordance with some embodiments of the disclosure;

[0013] FIG. 7 is an example of three mobile communication devices and ranges of communication, in accordance with some embodiments of the disclosure;

[0014] FIG. 8 is an example of a method, in accordance with some embodiments of the disclosure;

[0015] FIG. 9 is an example of a mobile communication device that includes two microphones, in accordance with some embodiments of the disclosure;

[0016] FIG. 10 is an example of relationships between directions and distances between transmitters and receivers, in accordance with some embodiments of the disclosure;

[0017] FIG. 11 illustrates an example of different directions and different distances from mobile communication device 10, in accordance with some embodiments of the disclosure; and

[0018] FIG. 12 illustrates an example of various devices, in accordance with some embodiments of the disclosure. DETAILED DESCRIPTION OF THE DRAWINGS

[0019] It will be appreciated that for simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements.

[0020] In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the invention. However, it will be understood by those skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the present invention.

[0021] The subject matter regarded as the invention is particularly pointed out and distinctly claimed in the concluding portion of the specification. The invention, however, both as to organization and method of operation, together with objects, features, and advantages thereof, may best be understood by reference to the following detailed description when read with the accompanying drawings.

[0022] Any reference in the specification to a system should be applied mutatis mutandis to a method that can be executed by the system.

[0023] Because the illustrated embodiments of the present invention may for the most part, be implemented using electronic components and circuits known to those skilled in the art, details will not be explained in any greater extent than that considered necessary as illustrated above, for the understanding and appreciation of the underlying concepts of the present invention and in order not to obfuscate or distract from the teachings of the present invention.

[0024] Any reference in the specification to a method should be applied mutatis mutandis to a system capable of executing the method.

[0025] The term "mobile device" or "mobile communication device" relates to any device that can be operated without having to be connected to a fixed location, and has communication capabilities with other devices. Examples include but are not limited to mobile phones, tablets, lap top computers, drones, robots, or the like. [0026] Directional communication is a communication between devices that is based on a direction from one device to another, e.g. utilizing the direction of a straight line connecting the devices. A directional communication link may link between devices based on the direction from one device to another.

[0027] For example - directional communication may enable a person to point his device towards another person or an object, and initiate a communication channel with them.

[0028] Most of the existing wireless technologies don't enable the conduction of directional communication, and those who do enable it, such as IR based remote controls, require line-of- sight between the initiator's emitter and the target's receiver or large directional antennas such as RF antennas or directional microphones array.

[0029] The directional wireless communication technologies can be divided into light- based (such as lasers, IR etc.) and non-light-based (such as RF etc.).

[0030] Light-based communications include visible and invisible light in the frequency range of 400 to 800THz (800 and 375nm), which is unlicensed spectrum worldwide.

[0031] The smart devices' camera and flash light (LED) can also be used for directional light based communication but they also require line of sight between the two sides.

[0032] Non-light-based communications, such as radio-frequency (RF), require directional antennas if one wants a Directional Communication. A directional antenna is designed to function more effectively in some directions than in others. The purpose of that directionality is improving transmission and reception of communications and reducing interference.

[0033] Regular WI-FI™ communication is done via a base-station and therefore cannot be point to point - which means no direction. Direct WI-FI™ does not require a base- station, and can be point to point, but is also not directional as defined herein.

[0034] New emerging standard the wireless gigabyte alliance (WIGIG™) is using 60 GHz which is more directional by nature. Communication in the frequency range of 60 GHz requires line of sight and is directional and secure.

[0035] BLUETOOTH™ communication is point to point but is not directional as defined herein. [0036] There is an unmet need to enable wireless communication between two sides, an initiator and a recipient, where at least the recipient is a stranger to the initiator, and they are located at a distance of between tens of centimeters and few hundreds of meters apart. This includes person to person, person to object, object to person and object to object communication, using a mobile phone, a wearable or any other such device, which incorporates multiple microphones. Communication herein means the transfer of text, voice, image or other data.

[0037] Stranger means herein that the recipient's contact details, such as cellular number, social network profile, Bluetooth ID or another identifier are unknown to the initiator.

[0038] There is provided a Directional Communication method and system, which for current and future smart devices and wearables (or any other device that has the minimal hardware described below) does not require any additional hardware, namely it is using hardware that already exists in these devices.

[0039] Smart devices and wearables herein are any electronic devices that are able to connect, share and interact with its user and other smart devices.

[0040] Novel devices can be designed that will enable Directional Communication based on the provided method.

[0041] The suggested methods, non-transitory computer readable media that stores programs and devices can be applied in many situations, which can be divided generally into two groups: communication between strangers and the detection of the direction and /or distance to a stranger, where a stranger is as defined herein.

[0042] A stranger can be a person or an object. Various examples are provided. In all of the applications mentioned herein one of the required steps is based on the measurement and analysis of the differences in sound signals time of arrival (TOA).

[0043] Sound herein means any propagating acoustic wave.

[0044] Many devices, such as smartphones, home appliances and wearable devices, are able to transmit, receive and respond to signals such as sound (sound herein includes ultrasound signals above 20kHz), RF and light (visible and IR). It is possible to locate all these emitters in space by analyzing the signals' times of arrival and performing triangulation or trilateration. However, since the speed of sound is so much slower than the speed of RF and light, it is easier to locate the sound speakers in space than the other emitters. The method, described in this invention to locate the other devices' speakers in space is based upon measuring and analyzing the differences in sound signals TOA as received by the device's microphones.

[0045] One way to conduct the above-mentioned analysis is correlating the signals received by one microphone to the signals received by the other microphone as a function of time.

[0046] This data can then be used for various purposes such as Directional Communication, objects locating, indoor navigation and more.

[0047] Figure 1 illustrates a mobile communication device 10, other devices 21, 22, 23 and 24 - collectively denoted 20 (such as other mobile communication devices and/or one or more fixed communication device), and a long-range network such as cellular network 30 that includes computer 32.

[0048] The user of the mobile communication device 10 may request to communicate over the cellular network 30 with any member of devices 20 - such as device 21 that is located at a direction 41 from the mobile communication device 10. The user may not request to communicate with device 22 of devices 20.

[0049] Figure 2 illustrates an example of method 100.

[0050] Method 100 may start by step 110 of receiving, by a mobile communication device, a request from a user or from an object or application, to communicate with a given device that is located at a given direction. The request may be a voice command, a contact between the user and an area of a touch screen or may have any other form. The mobile communication device may display to the user an image of the surrounding of the mobile communication device and the user may select a person or an object that is located at the given direction.

[0051] Step 110 may be followed by step 120 of transmitting a triggering signal 60, by the mobile communication device

[0052] The triggering signal may be conveyed over an acoustic carrier, an RF carrier, a light carrier, an infrared carrier, and the like. For example, the triggering signal can comprise light, sound, RF signal, or the like. It will be appreciated that while a light signal requires a line of sight, other signals such as a sound signal do not pose this requirement.

[0053] Step 120 may be followed by step 130 of receiving, by the mobile communication device, one or more responses to the triggering signal, wherein the one or more responses originate from one or more devices. For example, the triggering signal 60 is received by devices 21 and 22 adapted to receive such signals, for example having an application installed thereon, and responses 61 and 62 are transmitted (by devices 21 and 22 respectively) to the mobile communication device 10.

[0054] Step 130 may be followed by step 140 of participating in determining by the mobile communication device whether the one or more devices include the given device or receiving indication about whether the one or more devices include the given device.

[0055] Step 140 may include at least one of the following: a. Determining, by the mobile communication device, whether the one or more devices include the given device. b. Determining of whether the one or more devices include the given device based on one or more comparisons, wherein each comparison includes comparing between receptions, by microphones of the mobile communication device, of a response from a single device of the one or more devices. For example, if device 21 responded, the direction of that device is calculated based on the reception, by the different microphones, of the response. Especially - the determination is based on the TOA differences, by the microphones, of a response from device 21. If devices 21 and 22 responded, the direction of each device out of devices 21 and 22 is calculated based on the reception of the response (from each one of devices 21 and 22) by the microphones of the mobile communication device. c. Sending, by the mobile communication device, to a computer (such as computer 32), information about at least one item out of (a) the given direction, (b) an orientation of the mobile communication device, (c) time of the transmitting of the triggering signal, and (d) the one or more responses. d. Participating with other mobile communication devices that transmitted triggering signals (for example devices 20), in a distributed determination process. [0056] If the one or more devices do not include the given device, then method 100 may end and/or having step 140 be followed by sending a failure notification to the user.

[0057] If the one or more devices do include the given device, then step 140 may be followed by step 150 of attempting, by the mobile communication device, to establish communication with the given device. Step 150 may use contact information provided in a response (step 130) or may be provided in another manner (for example- from a computer such as computer 32).

[0058] The communication may be established over a non-directional link such as the cellular network and/or over a short-range link such as RFID and/or NFC.

[0059] Short-range may include communication over a distance that does not exceed 10-50 meters.

[0060] Long-range may include communication over a distance that exceeds 10-50 meters.

[0061] Devices 21 and 22 as well as mobile communication device 10 may register in advance to the directional communication service (for example by registering to a directional communication web site) or may otherwise be configured to detect the triggering device and transmit a response. The response may identify the device that sends the response. The response may be unique, may be unique within a time period, may be unique within a certain area (for example- within a cell of cellular network 30), and the like.

[0062] Although figure 2 illustrates a communication between the mobile communication device and a given device - method 100 may be applied for communicating between the mobile communication device and multiple other devices.

[0063] A single triggering signal can be used for communicating between the mobile communication device and one or more other devices.

[0064] Thus, method 100 may include receiving, by the mobile communication device, a request to communicate with an additional device that is located at a certain direction; transmitting an additional triggering signal, by the mobile communication device; receiving, by the mobile communication device, one or more additional responses to the additional triggering signal, wherein the one or more additional responses originate from one or more additional devices; participating in determining of whether the one or more additional devices comprise the additional device or receiving indication about whether the one or more additional devices include the additional device; and when the one or more additional devices include the additional device then attempting, by the mobile communication device, to establish communication with the additional device.

[0065] Additionally or alternatively, method 100 may include receiving, by the mobile communication device, a request to communicate with a group of devices that are located at different directions; wherein the request to communicate with the group of devices include the request to communicate with the given device; participating in determining of whether the one or more additional devices comprise any member of the group of devices or receiving indication about whether the one or more additional devices comprise any member of the group of devices; and when the one or more additional devices comprise any member of the group of devices then attempting, by the mobile communication device, to establish communication with any member of the group of devices that is included in the or more devices.

[0066] Figure 3 illustrate a method 180 managing communication, the method may be executed by a computer such as computer 32 of figure 1. The computer may include one or more servers, one or more desktop computers, an array of neural networks, and the like.

[0067] Method 180 may start by step 182 of receiving by a computer, and from a mobile communication device, information about at least one item out of (a) a given direction between a mobile communication device and a given device, (b) an orientation of the mobile communication device, (c) a time of transmitting of a triggering signal by the mobile communication device and over a local communication link, and (d) one or more responses to the triggering signal, wherein the one or more responses are generated by one or more devices in response to the triggering signal.

[0068] Step 182 may be followed by step 184 of determining, based on the information, whether the one or more devices include the given device.

[0069] Step 184 may be followed by step 186 of sending towards the mobile communication device an indication about whether the one or more devices include the given device.

[0070] There may be provided a method that may include: a. A user asks to initiate communication or position determination b. He/it requests a response. c. Recipients respond. d. Signals are received by the initiator. e. Signals are distinguished. f. Signals are directionally analyzed. g. Communication established or position determined.

[0071] The method starts with the initiator (person or an object) aiming (pointing) his device at the designated recipient's device and triggering all compatible pre-registered devices in the initiator vicinity, either directly by sending a signal (RF, Sound or light) or by a server that knows their locations, to respond by transmitting a sound signal which can be matched to their pre-registered profile. Compatible pre-registered devices herein are those devices that have the minimally required hardware and software (such as a dedicated application, that is stored in a non-transitory computer readable medium or a manufacturer pre-installed application/program that is stored in a non-transitory computer readable medium or permit to access via their processing unit).

[0072] Figure 4 illustrates an initiating device such as mobile communication device 10 as including one or more microphones (such as first microphone 105 and second microphone 106), emitter 101 for emitting the triggering signal, hardware system 102, processing unit 103 and audio subsystem 104.

[0073] Figure 5 illustrates a responding device such as device 22 as including receiver 221 (for receiving the triggering signal), a speaker 225 for transmitting a response to the triggering signal, hardware system 222, processing unit 223 and audio subsystem 224.

[0074] It will be appreciated that a device can be an initiating device as well as a responding device, and in that case may comprise hardware system, a processing unit, audio subsystem, first or second microphone and a speaker.

[0075] Figure 6 illustrates method 300 for communication. The method includes steps 302, 304, 306, 308, 310 and 312. [0076] Step 302 may include having the initiator aim the initiator device towards (and in the same plane) the intended recipient (at a given direction) and transmits a triggering signal.

[0077] Step 304 may include having the triggering signal trigger all compatible devices that receive the triggering signal to send a response. Each response may identify the device that sent the response and may include contact details of the device or a user thereof. A compatible device is a device that is configured to participate in the execution of method 300.

[0078] Step 306 may include having the initiator device analyze differences in TODA of the responses, determine the direction of the compatible devices and determines which device (if any) of the compatible devices is the intended recipient device (positioned at the given direction). If the intended recipient device has not responded, the method may end.

[0079] If the intended recipient device has responded, step 306 may be followed by step 308 that may include sending, by the initiator device to the intended recipient device a request to communicate.

[0080] Step 310 may include checking if the initiator device received an acceptance to communicate from the intended recipient device,. If not- the method may end.

[0081] If acceptance has been received, then step 310 may be followed by step 312 of communication between the initiator device and the intended recipient device.

[0082] Figure 7 illustrates method 301 for communication. The method includes steps 302, 304, 305, 308, 310 and 312.

[0083] Method 301 differs from method 300 by including- instead of step 306 of analyzing differences in TODA, determining the direction of the compatible devices and determining which device is positioned at the given direction, step 305 of having a computer that differs from the initiator device determine the direction of the compatible devices and determines which device (if any) of the compatible devices is the intended recipient device (positioned at the given direction). If no device is determined to be the intended recipient device, then the method may end. If the intended recipient device is determined, then step 305 is followed by step 308. [0084] The provided Directional Communication may allow an initiator to distinguish between the desired recipient's signal and all other responding signals.

[0085] Each responding device may transmit an individual sequence of sound signals that identifies it. These signals may include the user's basic information including its communication ID (as defined by this method). This individual sequence enables to effectively filter desired signals out of all the signals received. The individual sequence of sound signals can be either static, which means it is allocated to the user once he pre- registers, or dynamic, which means that a server allocates ad hoc signals to users based on the number of different devices in a known area, once a user asks to initiate communication or position determination.

[0086] Another method to identify each of the devices is by the server arranging the devices in a queue and having them respond their sound signals one after the other, once a user initiates communication or position determination.

[0087] The initiator's device or the server to which the devices are connected to, can then analyze the signals received and pair between each device and its pre -registered profile.

[0088] The initiator's device or the server to which the devices are connected to, can then analyze all the signals and compare the time they have arrived to each of the microphones embedded in it, to determine the distance and direction of all the devices that responded. It then uses a dedicated algorithm to identify which of these devices is the desired recipient.

[0089] After all signals are analyzed and their originated direction is found, the initiator's device or the server to which the devices are connected to, identifies the desired target, either for communicating with or for finding its position.

[0090] As demonstrated below this is sufficient for detecting the desired recipient in the case that the initiator's device includes two or more microphones.

[0091] However, if the initiator's device includes only one microphone, the Directional Communication requires using a server (except in the case of one-on-one). Detecting the desired recipient's direction requires additional data, the azimuth formed between a reference direction (The North for example) and the line between the initiator and the desired recipient. Most smart devices include a compass that can provide this azimuth. [0092] The rest of the data required are the possible locations of the desired recipient calculated from imaginary circles drawn around all the participating users, and their crossing points. The radii of these circles are the relative distances from one another, which can be provided by either synchronizing the clocks of all the participating users, or by sharing data regarding the timing of the transmitted signals, and the TOA of the signals and using it for relative distances calculations or for triangulation or trilateration. Crossing of the azimuth with the possible locations gives the desired recipient's position.

[0093] Figure 8 illustrates mobile communication device 10 that is located at the center of imaginary circles 401 and 402, device 21 that is located at the center of imaginary circles 411 and 412, and device 22 that is located at the center of imaginary circles 421 and 422.

[0094] It will be appreciated that the goals of communication between strangers or the detection of the direction and /or distance to strangers can also be reached, and possibly with higher accuracy, using complementary information source, and in particular wireless communication such as Wi-Fi, Bluetooth™, light, or cellular communication. For example, Bluetooth Low Energy (BLE) is a wireless technology for exchanging data, over short distances, and is particularly useful for Internet-of-Things (IoT) technologies. BLE is widely supported by wearable devices, and can thus be used for indoor-localization and proximity sensing. Using BLE it is thus possible to evaluate the relative distance between two transmitters. Lower signal strength implies higher and vice versa. The relationship between the relative received signal strength (RSSI) and the distance between two BLE devices can be assessed using a number of models, for example a polynomial model with a mean distance percentage error equal to 25.7% (0.4 m) in the range of 0-3 m. It will be appreciated that other methods Amy use the general principle of a stronger received signal implies a shorter distance.

[0095] Further methods may be used for evaluating the distance to an intended device and not just the direction. Some of the methods include triangulation between a multiplicity of devices, which requires sharing information between the devices. For example, each device can notify the time at which it received a signal from an initiator, and a server can then compute the distance between the initiator and each such recipient. [0096] In some examples, static dedicated transmitters may be provided in a stadium, hall or another crowded location, such that a user can locate his or her friends, using the direction determined to any such friend, and the distance which may be determined by triangulation with the known device's locations.

[0097] In another example, enhanced triangulation can be performed by a device having multiple speakers. For example, a TV having two or more speakers can locate a smart phone, for example for the purpose of sending content. By transmitting an acoustic signal from each speaker separately, and receiving the signals by the same phone at time differences, enables to determine the angle to each smart phone that received the signals. The location of each such phone relatively to the TV can then be determined using the angle and the known distance between the speakers.

[0098] A similar approach can be used with other smart devices, with or without smart pods, such as Amazon Echo, Google Home, or other devices comprising two or more speakers.

[0099] It will be appreciated that the reverse operation, of detecting the location of a device relatively to a smart phone, can be performed with such devices having two microphones, in which case signals are transmitted by the smart phone and received by the devices.

[0100] In some embodiments, when transmitting an acoustic signal from a mobile device, the signal may be transmitted by main speaker of the device or by the upper speaker of the device, e.g., the speaker which is adjacent to the user's ear when the user is speaking over the phone. A mobile device is usually placed face-up on a table or another plane, thus the upper microphone is pointed upwards, while the main speaker is pointed elsewhere. Thus, using the upper speaker usually provides for fewer reflections from objects within the space, however it allows for shorter reception distances due to the lower amplitude. A signal generated by the main speaker is stringer but is more likely to hit various objects, and the reflections can cause higher deviations.

[0101] It will be appreciated that transmitted acoustic signals can comprise a frequency which may be unique, or unique within a certain time period or a specific area. The unique frequency can be used for identifying the transmitting device. The frequency can be carried on a carrier wave in the ultra- sonic range, in the near ultrasonic range, or in the sonic range. It will be appreciated that transmitting the frequency over the sonic range significantly increases the range at which it is possible to locate the transmission direction.

[0102] Table 1 below provides experimental results for using sonic, ultra-sonic and near ultra-sonic signals submitted by the main speaker and the upper speaker.

Table 1

[0103] It is seen that indeed the main speaker using provides for longer range and larger deviation than the upper speaker, and that sonic signal provide longer range and similar or slightly larger deviation than ultrasound and near-ultrasound Signal.

[0104] In some embodiments, the frequency range of the transmission can be selected by analyzing the background noise and selecting a range that is relatively quiet, such that the transmission is relatively free of interferences.

[0105] After the desired target is identified, either by the initiator's device or by the server to which the devices are connected, a communication channel between the initiator device and the desired target's device can be established. This communication may include a link between the devices' pre-registered profiles, utilizing previously provided identity information, and/or contact information for sending a message. The message can be a personal advertisement, a request for data, a request for chatting etc.

[0106] If the desired target agrees to communicate they may continue to chat, either through the server or through an existing instant messaging application.

[0107] The desired target may provide further contact information such as its cellular number, email address or social network profile.

[0108] Some of the above contact data may be transferred already in the response to the triggering signal.

[0109] The suggested method and system may be utilized in various situations such as: [0110] Person to person communication - finding distance and direction. a. In the case that the initiator's device includes only one microphone, using triangulation or trilateration based on synchronized signal transmitting time and time- of-arrival (TOA) data shared between the various devices. i. Pre-positioning an object with known location (or using an already existing object) as a fixed recipient facilitates the analysis. ii. In spaces where indoor navigation exists, recipients' devices can facilitate the analysis by sharing their indoor coordinates with the initiator's device. iii. Repeating the process after the initiator' s device is moved by known distance and direction facilitates the analysis. b. In the case that the initiator' s device includes two microphones, using TOA data is sufficient to find the direction, as is later demonstrated. c. In the case that the initiator's device includes more than two microphones, using TOA data is sufficient to find both the direction and the distance by using triangulation. Comparing the direction found by each pair of microphones enables to find the crossing point which indicates the exact relative location. d. Using two initiating devices both having two microphones, when the distance between these devices is known, enables to find the relative position of a recipient by triangulation. e. When the recipients are pre-registered in a server, synchronizing their device's clocks enables to find their distances by analyzing their sound signal time of flight (TOF).

[0111] Person to person communication - Initiating communication with a specific recipient. a. In the case that the initiator's device includes only one microphone, using triangulation or trilateration based on synchronized time-of-arrival data (TOA) shared between the various devices and the individual unique sequence of sound signals which includes sufficient contact details of the recipient. b. In the case that the initiator's device includes two or more microphones, using TOA data and the individual unique sequence of sound signals which includes sufficient contact details of the recipient

[0112] Person to object - Calculating distance and direction. c. In the case that the initiator's device includes only one microphone, as illustrated above. d. In the case that the initiator's device includes two or more microphones, as illustrated above.

[0113] Person to object - Initiating communication with specific object. a. In the case that the initiator's device includes only one microphone, as illustrated above. b. In the case that all that is needed is to get data from the object it is possible to conduct the whole communication cycle by sound signals.

[0114] Object to person - as illustrated above.

[0115] Object to object - as illustrated above.

[0116] Sharing the data between various devices, as mentioned above, will enable cross-triangulation or trilateration which can create a network of positions of the various devices. Such a network can improve the accuracy of the positioning process.

[0117] Knowing the positions of all pre-registered users has a merit for advertisement, gaming and other applications.

[0118] Since the speed of sound, which is about 340m/sec at sea level at room temperature, is relatively slow (radio, IR, and visible light speed is 300,000,000 m/sec) it is easier to use sound signal to measure distances between a sound emitter and a sound receiver as the time it propagates is longer.

[0119] It takes about 2.9 milli-second for sound to pass 1 meter, 0.29 milli-second to pass 10 cm (about the distance between two microphones in a smartphone) and 0.1 milli-second to pass 3 cm (about the distance between two microphones in a smartwatch). The two microphones are synchronized and the processors can measure these times. Figure 9 illustrates a mobile communication device 10 that include two microphones 105 and 106 that are spaced apart from each other by about 10 centimeters. [0120] For example, audio ADC sampling rate can be 48 kHz or even higher, which means that it is possible to measure time-of-arrival differences of about 0.02 millisecond.

[0121] By interchanging signals between time synchronized speakers and microphones, measuring the times of arrivals and employing a geometric algorithm, the location of each emitter in space is found.

[0122] This location of each emitting device can then be used for various purposes such as Directional Communication, objects and person locating, indoor navigation and more.

[0123] The minimal required hardware for this method in the initiator's device includes at least two separate microphones connected to audio subsystem and signal processing capabilities. The recipient's device must include a speaker that is capable of generating a detectable sound signal at the initiator's device.

[0124] In addition, the initiator must be able to communicate with the recipient/recipients in order to trigger them to transmit the sound signal. This primary initiation can be conducted by a variety of methods, including sound, RF or light signals, which the recipient device can detect or by sending command through a server which the devices are connected to.

[0125] The status of at least one recipient device, which can be either turned on, in standby mode, in sleep mode or in other modes, also affects the required methods to trigger the recipients' response: a. If the at least one recipient device is turned on, any of the above mentioned communication methods can be used to trigger them to respond. b. If their devices are on other modes, the methods that can be used must comply with the manufacturer's design. For example, some current devices have an 'Always- On' voice system that can wake up the device by a specific voice activity feature which enables them to react to voice commands. The method described in this case will use a pre-determined sound trigger signal that will be recognized by the device's 'Always- On (or Voice Trigger) subsystem and will activate their speakers. c. The method provided holds also for devices that their 'always on' feature can be triggered by RF and/or light. d. Sending command from the server, based on known location (either GPS based or other) to trigger recipients' response is not dependent on the status of their devices.

[0126] The method and procedure are described herein for the case of "Directional Communication" between two persons, the initiator and the recipient, and can be the same for the person to a group of persons, person to object, object to person and object to object, once the objects are provided with the minimal required hardware and software mentioned above, including sound and/or Wi-Fi, and/or BlueTooth™ and/or light.

[0127] The following description holds for the case that the two microphones of the initiator's device are located one on the top and one on the bottom of the device:

[0128] The initiator aims its device towards and approximately in the same plane of the intended recipient's device. A clear or free line of sight is not mandatory. The initiator device then triggers all the compatible pre-registered devices in the initiator vicinity, either directly by sending a signal (RF, Sound or light) or by a server that knows their positions, to send a sound signal.

[0129] The sound signals which the initiator's device receives are then analyzed either by it or by a server which it is connected to, in order to match them to their pre- registered profiles. Each responding device may transmit a unique individual sequence of sound signals that identifies itself by providing its basic information including its communication ID (as defined by this method). This individual unique sequence enables to filter out effectively desired signals out of all the signals received.

[0130] Another method to identify each of the devices is by analyzing their data in a server and pairing between them based on their personal profile.

[0131] If the initiator's device is aligned such that the line between its microphones points toward the recipient, then the analysis algorithm will look for the maximal TOA differences. If the line between the initiator's device microphones will be perpendicular to the recipient's direction a minimal TOA differences will be looked for.

[0132] The analysis is based on matching the TOA difference from each of the responders to the initiator's microphones. The right difference in arrival times between the two microphones is pre-defined according to the initiator device model (depends on the exact distance between the microphones in each model). The initiator's device will receive a pair of signals, one to each of its microphones, from each responder. The device or the server then calculates the time-of-arrival difference between each pair and compares it to the pre-defined time difference to check if it matches the algorithm. Only a device that is located exactly where the initiator's device is aimed at will match the required algorithm pre-defined time-of-arrival difference formula (the longest or shortest time-of-arrival difference, depends on the initiator's device alignment) and therefore could be identified out of all other devices in the area.

[0133] If it finds a match the recipient will receive a request to communicate. If he approves, a communication channel is established. This is illustrated in figure 6.

[0134] The initiator can include in its request to communicate his device's azimuth when directed at the recipient.

[0135] The recipient can use this azimuth to direct his device towards the initiator and identify him.

[0136] For finding the distances and directions of strangers, any of the mentioned above methods may use triangle basic rules (such as Law of Sines and the Law of Cosines).

[0137] This additional analysis may enable to detect the exact distance between each of the recipients' devices in the vicinity and their position.

[0138] Example (see also sketch 510 of figure 10): If there are two emitters, one is the intended recipient (Emitter I) and the other is not (emitter II), the following data is known: d (distance between the receivers of the initiator's device) b (distance of Emitter I from Receiver I) b+d (distance of Emitter I from Receiver II) c (distance of Emitter II from Receiver I) e (distance of Emitter II from Receiver II.

Then, according to law of cosines: e²= b²+d² -2bd cos y

_TEmitterI _ _ b _TEmitterI _ b + d

1 Rec I — y ^l Rec U ^— y •iEmitterll _ ^Emitterll

l Rec I — y ^l Rec II e c b+d b

V V V V

[0139] No matter what the distance of Emitter I and Emitter II from the initiator is, the exact TOA difference between each of their signals to the initiator's two receivers will only match the pre-defined time-of-arrival difference to the emitter towards which the initiator's device is pointed at.

[0140] The following table presents the influence of the emitter angle in relation to the initiator's device in terms of TOA difference in milli-seconds between two microphones which are located 15 cm from each other for assumed sound speed of 340.29 m/s:

[0141] Figure 11 illustrates different directions and different distances from mobile communication device 10.

[0142] The TOA differences given in the table above will be similar for smart glasses with two microphones located at the frame edges, shorter by about 5 times for a smart watch device with two microphones located about 3 cm from each other, and can be significantly longer for a wearable device embedded in clothing.

[0143] The technology described in this patent can also be used in the automotive industry where it can be utilized for communication or command and control between objects (car to car or other object) and for communication between person to person or person to car. [0144] Sonic transmitters and receivers used in cars to measure distances from objects can be integrated with the applications described above (i.e. communication).

[0145] Non-limiting Examples of Use

[0146] The method described herein can be applied in many situations, which can be generally either communication between strangers (either of which can be a person or an object) or the detection of the direction and /or distance to strangers (either a person or an object).

[0147] One-to-one: a. Person-to-person. b. People in a coffee shop, in a pub, etc. c. Between drivers. [0148] Person-to-object a. Window display of objects, museum displaying objects, person to clothing object dressed or carried or wore by another person. b. Finding lost car in parking lot, lost keys. c. Remote controls for the house or industry. [0149] Object-to-person a. Window display as above but initiated by the object. b. Same but inside store. c. Security Alerts such as the detection of line crossing or perimeter crossing by a person. d. Directional guidance inside buildings or outdoor using a transmitting device, either an existing smart-device or a novel dedicated device, that sends sound waves that indicates its position and assist individuals who hold a smart- devices to navigate to it. This can be useful for office or apartments buildings, shopping malls, airports, hospitals, conventions etc.

[0150] Object-to-object a. Security Alerts as above. b. Organizing objects on a line, at a given distance from each other or at another geometry. c. Distance to wallet checked by smartphone or other device. d. Between cars or between cars and traffic lights. [0151] One-to-many: a. One is a person or a shop or a business sending a message to persons or objects in a specific sector (defined by a range of distances and a range of angles).

[0152] Examples of experiments conducted:

[0153] Various existing smartphone models have been used to transmit and receive different series of pre-defined sound signals composed of frequencies between 16 and 19 kHz. All were tested in ranges between 2 and 9 meters and in angles between -45 degrees to +45 degrees relative to the line of sight as shown in figure 12.

[0154] The receiver device has been positioned in a fixed location in which the line that connects its 2 microphones was perpendicular to the line of sight referred to as 0 degrees.

[0155] Various alignments of the transmitting device speaker relatively to the receiving device direction have been tested. The signals received by the receiver device have been recorded and then analyzed using a dedicated algorithm written in MATLABTM software installed on a laptop computer.

[0156] The following average results were received:

6.5 -5 -2.9 7.675

7 0 3.5 7.5

8 0 -3.1 9.6

9 0 5.4 6.9

[0157] Two different transmitters Another experiment was conducted in order to try to identify the directions of. Two smart-phones were transmitting simultaneously each a different series of pre-defined sound signals.

[0158] The signals that were recorded by the receiving smart-phone were then analyzed by a dedicated algorithm and the following results were obtained:

[0159] Any of the above mentioned methods may be used for one-to-one communication and/or one-to-many communication.

[0160] Any of the above mentioned methods may be used for determining location (direction and/or range) between two or more devices.

[0161] At least one of devices mentioned above may be a mobile communication device, a fixed device, a mobile phone, a smart phone, a wearable device, and the like.

[0162] The determination regarding the spatial relationship (relative direction and/or range) between devices (such as the initiator device and a responding device) may be calculated by the initiator device, by a computer that differs from the initiator device, in a centralized manner or in a distributed manner.

[0163] Any of the above mentioned devices may be operated by a human user and/or may be operated without human intervention. [0164] Any of the methods may be used for communicating between devices of users that are known to each other or unknown to each other before the communication begins.

[0165] Any of the methods may be used for communicating between two persons who are strangers to each other, for example one person communicates with another in a bar. The person who initiates the communication can thus contact the other person even if the other person is in the vicinity of other people, and can establish communication with that person only.

[0166] In a similar manner, in a multi-player gear in which the players wear virtual reality (VR) glasses, the glasses may be equipped with components as detailed in association with Figs. 4 and 5 above. Such components can be operative in determining the relative location, e.g. distance and direction between any two players, thus making the game more accurate and enjoyable.

[0167] In alternative embodiments, a static dedicated device may be provided within the game area, using which the users can determine their relative distance and not only the direction, similarly to the friends finding system in stadiums described above.

[0168] In some embodiments, specific or dedicated components or devices may be used by one side in order to detect the direction and/or distance between an initiator and an intended recipient, or to form communication therebetween.

[0169] For example, a dedicated acoustic or another beacon device, comprising the components as shown in Fig. 5 above may be attached to a child, such that a parent or another guardian can locate the child in a crowd, using the guardian's mobile device.

[0170] Any of the methods may be used for allowing a user to receive data about an object by pointing at it, for example a person aiming his smart device at a picture in a museum or at an object in a display window and receiving data transmitted by it

[0171] Any of the methods may be used for allowing an object to communicate with a user who's positioned in a specific direction relatively to it, for example a location related advertisement.

[0172] Any of the methods may be used for allowing a user to communicate with a group of people located within a pre-defined span, for example sending data only to people located on one side of a meeting room. [0173] Any of the methods may be used for allowing an object to communicate with a group of people located in a specific space, for example a business sends advertisements or special offers to all customers located within it.

[0174] Any of the methods may be used for allowing an object to communicate with a part of a group of people located in a specific space, based on the profiles as known by their pre-registry.

[0175] Any of the methods may be used for providing content such as advertisements or music to the relevant crowd profile.

[0176] Any of the methods may be used for providing direction information for a meeting between two persons, for example in a conference hall or in an airport.

[0177] Any of the methods may be used for directing an object for example a drone towards a person.

[0178] Any of the methods may be used for guiding a person to a specific location, for example indoor navigation in an office building, airport, hospital etc.

[0179] Any of the methods may be used for guiding an object to the location of another object, for example guiding a robot to its docking station

[0180] Any of the methods may be used for guiding a group of people to arrive to a person's location, for example a tour guide who gathers his group.

[0181] Any one of method 100, 300 and 301 may be initiated by an initiator device (such as a mobile communication device or any other wireless communication device) - even without human intervention.

[0182] In some embodiments, forming directional communication can be used for enhancing applications. For example, if a user is taking a group photo of a number of people using his mobile device, the user's mobile device can form directional communication with any one or more of them, retrieve their identity and automatically tag them in the picture, using the direction between the user and the identified person as reflected in the photo.

[0183] Another application may relate to a swarm of independent devices, such as robots or drones. By using acoustic signals and microphones, the relative location between any two drones can be determined, and their actions, such as capturing images can be coordinated. [0184] Any reference to the term "comprising" or "having" should be interpreted also as referring to "consisting" of "essentially consisting of. For example - a method that comprises certain steps can include additional steps, can be limited to the certain steps or may include additional steps that do not materially affect the basic and novel characteristics of the method - respectively.

[0185] The invention may also be implemented in a computer program for running on a computer system, at least including code portions for performing steps of a method according to the invention when run on a programmable apparatus, such as a computer system or enabling a programmable apparatus to perform functions of a device or system according to the invention. The computer program may cause the storage system to allocate disk drives to disk drive groups.

[0186] A computer program is a list of instructions such as a particular application program and/or an operating system. The computer program may for instance include one or more of: a subroutine, a function, a procedure, an object method, an object implementation, an executable application, an applet, a servlet, a source code, an object code, a shared library/dynamic load library and/or other sequence of instructions designed for execution on a computer system.

[0187] The computer program may be stored internally on a non-transitory computer readable medium. All or some of the computer program may be provided on computer readable media permanently, removably or remotely coupled to an information processing system. The computer readable media may include, for example and without limitation, any number of the following: magnetic storage media including disk and tape storage media; optical storage media such as compact disk media (e.g., CD-ROM, CD-R, etc.) and digital video disk storage media; nonvolatile memory storage media including semiconductor-based memory units such as FLASH memory, EEPROM, EPROM, ROM; ferromagnetic digital memories; MRAM; volatile storage media including registers, buffers or caches, main memory, RAM, etc. A computer process typically includes an executing (running) program or portion of a program, current program values and state information, and the resources used by the operating system to manage the execution of the process. An operating system (OS) is the software that manages the sharing of the resources of a computer and provides programmers with an interface used to access those resources. An operating system processes system data and user input, and responds by allocating and managing tasks and internal system resources as a service to users and programs of the system. The computer system may for instance include at least one processing unit, associated memory and a number of input/output (I/O) devices. When executing the computer program, the computer system processes information according to the computer program and produces resultant output information via I/O devices.

[0188] In the foregoing specification, the invention has been described with reference to specific examples of embodiments of the invention. It will, however, be evident that various modifications and changes may be made therein without departing from the broader spirit and scope of the invention as set forth in the appended claims.

[0189] Moreover, the terms "front," "back," "top," "bottom," "over," "under" and the like in the description and in the claims, if any, are used for descriptive purposes and not necessarily for describing permanent relative positions. It is understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of operation in other orientations than those illustrated or otherwise described herein.

[0190] Those skilled in the art will recognize that the boundaries between logic blocks are merely illustrative and that alternative embodiments may merge logic blocks or circuit elements or impose an alternate decomposition of functionality upon various logic blocks or circuit elements. Thus, it is to be understood that the architectures depicted herein are merely exemplary, and that in fact many other architectures may be implemented which achieve the same functionality.

[0191] Any arrangement of components to achieve the same functionality is effectively "associated" such that the desired functionality is achieved. Hence, any two components herein combined to achieve a particular functionality may be seen as "associated with" each other such that the desired functionality is achieved, irrespective of architectures or intermedial components. Likewise, any two components so associated can also be viewed as being "operably connected," or "operably coupled," to each other to achieve the desired functionality.

[0192] Furthermore, those skilled in the art will recognize that boundaries between the above described operations merely illustrative. The multiple operations may be combined into a single operation, a single operation may be distributed in additional operations and operations may be executed at least partially overlapping in time. Moreover, alternative embodiments may include multiple instances of a particular operation, and the order of operations may be altered in various other embodiments.

[0193] Also for example, in one embodiment, the illustrated examples may be implemented as circuitry located on a single integrated circuit or within a same device. Alternatively, the examples may be implemented as any number of separate integrated circuits or separate devices interconnected with each other in a suitable manner.

[0194] Also for example, the examples, or portions thereof, may implemented as soft or code representations of physical circuitry or of logical representations convertible into physical circuitry, such as in a hardware description language of any appropriate type.

[0195] Also, the invention is not limited to physical devices or units implemented in non-programmable hardware but can also be applied in programmable devices or units able to perform the desired device functions by operating in accordance with suitable program code, such as mainframes, minicomputers, servers, workstations, personal computers, notepads, personal digital assistants, electronic games, automotive and other embedded systems, cell phones and various other wireless devices, commonly denoted in this application as 'computer systems' .

[0196] However, other modifications, variations and alternatives are also possible. The specifications and drawings are, accordingly, to be regarded in an illustrative rather than in a restrictive sense.

[0197] In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word 'comprising' does not exclude the presence of other elements or steps then those listed in a claim. Furthermore, the terms "a" or "an," as used herein, are defined as one or more than one. Also, the use of introductory phrases such as "at least one" and "one or more" in the claims should not be construed to imply that the introduction of another claim element by the indefinite articles "a" or "an" limits any particular claim containing such introduced claim element to inventions containing only one such element, even when the same claim includes the introductory phrases "one or more" or "at least one" and indefinite articles such as "a" or "an." The same holds true for the use of definite articles. Unless stated otherwise, terms such as "first" and "second" are used to arbitrarily distinguish between the elements such terms describe. Thus, these terms are not necessarily intended to indicate temporal or other prioritization of such elements. The mere fact that certain measures are recited in mutually different claims does not indicate that a combination of these measures cannot be used to advantage.

[0198] While certain features of the invention have been illustrated and described herein, many modifications, substitutions, changes, and equivalents will now occur to those of ordinary skill in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.

Claims

CLAIMS I/we claim:

1. A method for a communication device to communicate with a given device that is located at a given direction, the method comprises: transmitting a triggering acoustic signal, by the communication device in the given direction; receiving, by the communication device, one or more responses to the acoustic triggering signal, wherein the one or more responses originate from one or more second communication devices, and wherein each response of the one or more responses comprises an identifier of a device from the one or more second communication devices that transmitted the response; participating in analyzing by the communication device, times of arrival of the one or more responses for determining directions of the one or more second communication devices relatively to the communication device, thereby identifying the given device as a device that is in the given direction relatively to the communication device; transmitting by the communication device, to the given device a request to communicate; and subject to receiving by the communication device, acceptance from the given device, communicating with the given device.

2. The method according to claim 1 wherein the transmitting of the acoustic triggering signal is preceded by determining, by the communication device and in an autonomous manner, to communicate with the given device.

3. The method according to claim 1 wherein the communication device comprises microphones and wherein participating in analyzing is based on one or more comparisons, wherein each comparison includes comparing between amplitudes of signals received by the microphones, of responses from two or more second communication devices.

4. The method according to claim 1 wherein the communication device comprises microphones and wherein participating in analyzing is based on one or more comparisons, wherein each comparison includes comparing between times of receptions of signals received by the microphones, of responses from two or more second communication devices.

5. The method according to claim 1 wherein participating in analyzing comprises sending, by the communication device, to a computer, information about at least one item selected from the group consisting of: (a) the given direction, (b) an orientation of the communication device, (c) time of the transmitting of the triggering acoustic signal, and (d) the one or more responses.

6. The method according to claim 1 wherein participating in analyzing comprises participating, with other communication devices that transmitted triggering signals, in a distributed determination process.

7. The method according to claim 1 wherein the triggering acoustic signal is in a sonic range.

8. The method according to claim 1 wherein the triggering acoustic signal is in an ultra- sonic range.

9. The method according to claim 1 further comprising attempting, by the communication device, to establish long-range communication with the given device.

10. The method according to claim 1 comprising attempting, by the communication device, to establish short-range communication with the given device.

11. The method according to claim 1, comprising: transmitting an additional triggering signal, by the communication device; receiving, by the communication device, one or more additional responses to the additional triggering signal, wherein the one or more additional responses originate from one or more additional devices; participating in determining of whether the one or more additional devices comprise an additional device that is positioned at a certain direction or receiving indication about whether the one or more additional devices comprises the additional device; and when the one or more additional devices comprises the additional device then attempting, by the communication device, to establish communication with the additional device.

12. The method according to claim 1, wherein identifying the given device further comprises receiving information from a complementary information source selected from the group consisting of: Wi-Fi, Bluetooth™, light, and cellular communication.

13. The method according to claim 1, wherein the given device is a beacon device configured to be attached to a child.

14. The method according to claim 1, further comprising: identifying within an image captured by the communication device, an object being at the given direction relatively to the communication device; associating the object with the identifier of a device associated with the object; and tagging the object within the image in accordance with the identifier.

15. The method according to claim 1, wherein the communication device and the given device are drones, and further comprising coordinating actions between the communication device and the given device.