US9007416B1 - Local social conference calling - Google Patents
Local social conference calling Download PDFInfo
- Publication number
- US9007416B1 US9007416B1 US13/415,535 US201213415535A US9007416B1 US 9007416 B1 US9007416 B1 US 9007416B1 US 201213415535 A US201213415535 A US 201213415535A US 9007416 B1 US9007416 B1 US 9007416B1
- Authority
- US
- United States
- Prior art keywords
- mobile devices
- mobile
- mobile device
- devices
- network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related, expires
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
Definitions
- This application relates generally to communicating between multiple mobile devices and more specifically to establishing a communication session between such mobile devices using a local communication network and transmitting a data stream from one mobile device to all other mobile devices using this network.
- Teleconferencing is an essential and indispensable part of today's world. It is a cost effective alternative to face-to-face meetings and allows bringing together people throughout the world to exchange ideas in a real time, interactive manner.
- a teleconference may be defined as a live exchange and mass articulation of information among two or more people who are remote from one another but linked by a telecommunication system.
- Other terms that are sometimes used include audio conferencing, telephone conferencing, and phone conferencing.
- Teleconferencing may be used as a part of video conferencing, audio streaming, and other types of interactive exchanges that include an audio component.
- Teleconferencing may be used as a part of video conferencing, audio streaming, and other types of interactive exchanges that include an audio component.
- a group of participants sharing video and/or audio with each other do not have access to telephone systems.
- a group of bicyclists may be interested in chatting with each other and listening to the same music while riding.
- a ride may go through locations with limited cell phone connectivity.
- calling a conference number may not be an option.
- all members may be sufficiently close to each other to establish a direct communication with each other through a local network.
- Such methods involve establishing a communication session between the mobile devices using a local communication network, such as a Wi-Fi network.
- the methods also involve transmitting data streams from one mobile device in the group to all other mobile devices using this local network.
- the data streams may include audio and/or video data generated and/or provided by the mobile devices.
- mobile device users may conduct a teleconference and/or share media through the local network.
- the devices may be interconnected using a star topology or a ring topology, which may depend on the distances between participants and/or alarm features that reflect connection losses between the devices.
- Each mobile device may be equipped with one or more microphones for collecting audio signals from its user.
- a mobile device may also include an audio processing system for noise suppression and/or echo cancellation.
- a method for communicating between mobile devices in a plurality of mobile devices involves establishing a communication session between mobile devices in the plurality of mobile devices using a local communication network and transmitting the data stream from one mobile device to the remaining mobile devices using the local communication network.
- Each mobile device in the plurality of mobile devices may include a communication link for connecting to one or more other devices in the plurality of mobile devices.
- Each mobile device in the plurality of mobile devices may also include at least one microphone and an audio processing system configured to perform noise suppression and/or echo cancellation.
- each mobile device in the plurality of mobile devices may be configured to produce a data stream for communicating to one or more other devices in the plurality of devices.
- a local communication network which may be used to interconnect multiple mobile devices, is a Wi-Fi network.
- mobile devices in the plurality of mobile devices are interconnected according to a ring topology. In other embodiments, mobile devices in the plurality of mobile devices are interconnected according to a star topology. In these embodiments, establishing the communication session between mobile devices using the local communication network may involve selecting a master device from the plurality of mobile devices to establish the star topology. This selection may be performed by a user of the master device.
- the method involves verifying connections between mobile devices in the plurality of mobile devices. If any mobile device in the plurality of mobile devices is found to be disconnected, the method may proceed with sending an alarm to the plurality of mobile devices. Any device in the local network may perform connectivity verification and may generate and transmit an alarm. The connection verification operation may be repeated at predetermined intervals, such as certain time intervals.
- mobile devices includes mobile phones. However, any devices capable of connecting and/or establishing a local network may be used.
- the mobile devices typically include microphones.
- each mobile device in the plurality of mobile devices is connected to at least two other mobile devices.
- one of more mobile devices in the plurality of mobile devices each includes two microphones.
- one or more mobile devices in the plurality of mobile devices may perform both noise suppression and echo cancellation.
- a data stream transmitted from one mobile device to the remaining mobile devices in the plurality of mobile devices includes data packets generated by a microphone and an audio processing system of the one mobile device.
- transmitted data packets are generated by a media player of the one mobile device.
- the data stream may correspond to an audio signal and/or to a video signal.
- the method involves communicating physical locations of mobile devices to all mobile devices in the plurality of mobile devices and, in further specific embodiments, rearranging the communication session based on the physical locations of mobile devices in the plurality of mobile devices.
- FIG. 1 is a schematic representation of an example system including multiple mobile devices connected according to one topology, in accordance with certain embodiments.
- FIG. 2 is a schematic representation of an example system including multiple mobile devices connected according to another topology, in accordance with certain embodiments.
- FIG. 3 is a schematic representation of various components of the mobile device, in accordance with certain embodiments.
- FIG. 4 is a process flow chart corresponding to a method for communicating between multiple mobile devices, in accordance with certain embodiments.
- FIG. 5 is a diagrammatic representation of an example machine in the form of a computer system, within which a set of instructions for causing the machine to perform any one or more of the methodologies discussed herein may be executed.
- the methods and systems described herein allow communication between multiple mobile devices using a local network.
- a communication session may be established between two or more devices using a Wi-Fi, Bluetooth, Near Field Communication (NFC), or some other local network protocols.
- Usage of local networks restricts how far mobile devices can be positioned from each other.
- establishing local networks using mobile devices themselves eliminates the need for and reliance on external infrastructures, which are often not available in remote locations or in some geographically dynamic systems, such as moving users.
- Such local network communication may be used for conferencing, sharing media files, and other purposes.
- a group of people that need to share audio and video information are located close to each (i.e., in the same geographic location).
- Some examples include doctors in the same hospital facility, security personnel in the same shopping mall, or even a peloton of bicyclists.
- These groups do not always have access to global communication networks, such as the Internet or phone lines, because of their location or mobility.
- bicyclists may train in remote areas that do not have access to common communication networks. Even if this access is available, it may not be stable or economical.
- a peloton may include 20-30 bicyclists who train together for a few hours each day. Even relatively inexpensive mobile phone services may become prohibitively expensive in such scenarios.
- One application for such communication through a local network is conducting teleconference equivalents among multiple local users.
- Most people are equipped with mobile devices, such as mobile phones, music players, and/or portable game consoles that have both audio inputs and outputs and local network interfaces.
- Multiple users may easily establish a communication session between mobile devices using a local network, such as a Wi-Fi network connection. This eliminates a need for a wireless cellular network, the Internet, or other forms of global networks.
- the mobile devices may transmit data streams among themselves or, in more specific embodiments, from one mobile device in that network to the remaining mobile devices.
- the conference participants may talk to each other (i.e., participate in a local social conference) using a local network connection (e.g., a Wi-Fi connection) and communicate as a group without the need of cellular wireless network or any other global networks.
- a local network connection e.g., a Wi-Fi connection
- the functionality of noise suppression, noise cancellation, echo cancellation, and other noise reduction technology provided by hardware and software, including noise reduction chipsets, may insure high quality communication in noisy environments.
- a noise component which includes all undesirable audio signals, such as environment noise, echo, and other types, can make telecommunication between participants difficult or even impossible.
- the poor audio quality transmitted by one participant can affect the user experience of the group.
- an echo transmitted by one participant can affect the user experience of the group, and can be improved with echo cancellation.
- the present technology may utilize Wi-Fi or other wireless connectivity to verify the group coherence control and alert the group members when one of the participants is isolated from the group.
- the group coherence is verified by each participant mobile device, such as a mobile phone, as it attempts to connect to the mobile device of the next participant in a radio-link chain. If the next mobile device cannot be found in a proximity radius around the current mobile device, then the notification of which participant is not connected to the radio-chain and the current mobile device is passed to the previous mobile device in the chain. The procedure is repeated until all participant mobile devices have been notified.
- the mobile device users can be notified with audio, visual, and/or other alarms.
- the audio sharing feature may allow the users to share music, other played-back audio, or other audio content when participating in group activities, such as biking.
- the audio and/or video data available on one mobile device may be broadcast to the audio devices of the group.
- a proximity warning feature may set an alarm if one of the participant device's signal fades away, thereby indicating that the user was left behind (e.g., proximity not detected). This local network approach to connectivity allows participants to have a conference call even in remote areas where global networks are not accessible or are cost prohibitive.
- FIG. 1 is a schematic representation of an example system 100 including multiple mobile devices 102 a - 102 e connected according to a star topology, in accordance with certain embodiments.
- mobile device 102 a represent a central hub
- mobile devices 102 b - 102 e are each independently connected to mobile device 102 a using separate point-to-point connections.
- the main feature of this type of local network is that all of the nodes on the network may be connected to one central hub. All traffic that traverses the network passes through that central hub.
- the hub may also act as a signal repeater. This is the easiest topology to design and implement, and adding additional nodes may be relatively simple.
- a central hub represented by mobile device 102 a may be selected by its location (e.g., a central location), capabilities of mobile device 102 a (e.g., the device with the most processing power), or some other features.
- the communication may be maintained as long as mobile devices 102 b - 102 e are within the range 106 of mobile device 102 a .
- a new device When a new device enters the range 106 , it may register with mobile device 102 a and participate in the communication session. In certain embodiments, adding new devices to the local network and dropping existing devices from the network may be performed without interfering with an existing communication session.
- mobile device 102 a may generate an alarm.
- mobile device 102 a may generate notices to other devices present in the network when new devices are added or existing devices are dropped from the network. This feature may be useful to maintain group coherency.
- the star topology is more efficient when most of the data streams are generated by mobile device 102 a .
- mobile device 102 a may have a media player to play media files and produce an audio output. These media files may be converted into corresponding data streams and sent by mobile device 102 a to all other mobile devices in the network. These data streams may also include a component corresponding to speech of the user of mobile device 102 a . This approach may be useful in a situation when a coach or an instructor is assigned as a user of mobile device 102 a .
- the data streams sent by mobile device 102 a to all other mobile devices in the network may include components corresponding to speech or media files for the other users of the other mobile devices connected to mobile device 102 a (e.g., the central hub in this star topology example).
- the star network may provide substantial advantages when most of the data streams are generated centrally.
- failure of mobile device 102 a will also cause the failure of the overall network.
- mobile device 102 a may lose power or get out of range, thereby causing the entire network to shut down.
- Other network topologies may be used to address this problem.
- FIG. 2 is a schematic representation of a system 200 including multiple mobile devices 202 a - 202 e connected according to a ring topology, in accordance with certain embodiments.
- a ring network topology is set up in a circular fashion in which data travels around the ring in one direction and each mobile device on one side acts as a repeater with respect to the signal sent from another side in order to keep the signal strong as it travels.
- Each device incorporates a receiver for the incoming signal and a transmitter to send the data on to the next device in the ring. This type of network is dependent on the ability of the signal to travel around the ring.
- mobile device 202 a may be connected with mobile device 202 e and mobile device 202 d . These two connections may be maintained as long as mobile device 202 a is operational and stays within range 206 e of mobile device 202 e and within range 206 d of mobile device 202 d (or, from another perspective, as long as mobile devices 202 e and 202 d stay within range 206 a of mobile device 202 a ). Of course, this assumes all three devices remain operational. It is important to note that proximity of the remaining two mobile devices 202 b and 202 c in this example with respect to mobile device 202 a is irrelevant to the two network connections described above. As such, assuming the same range of mobile devices 202 a - 202 e , a local network that has a ring topology may be spatially larger than a network that has a star topology.
- mobile device 202 b is connected with mobile device 202 e and mobile device 202 c . These two connections may be maintained as long as, mobile device 202 b is operational and stays within range 206 c of mobile device 202 c and within range 206 e of mobile device 202 c (or, from another perspective, as long as mobile devices 202 e and 202 c stay within range 206 b or mobile device 202 b ).
- Another connection in this ring type network may be between mobile devices 202 c and 202 d , which are also shown positioned within ranges 206 d and 206 c , respectively.
- mobile devices 202 a - 202 e may be interconnected using five connections, and each device may have two connections.
- Other types of networking schemes that may be used for local communication networks include mesh networking, fully connected and partially connected implementations.
- FIG. 3 is a schematic representation of various components of mobile device 102 , in accordance with certain embodiments.
- mobile device 102 is a device that includes communication link 300 , processor 302 , primary microphone 304 , secondary microphone 306 , audio processing system 308 , output device 310 , media player 312 , and/or media storage 314 . Not all of these components need to be present in mobile device 102 . Furthermore, other components may be used as well.
- mobile device 102 includes one microphone (e.g., primary microphone 304 ) and communication link 300 . Audio signals received by the microphone 304 may be sent in a raw format to other devices using communication link 300 .
- communication link 300 may support Wi-Fi, Bluetooth, and/or some other local communication protocol.
- mobile device 102 also includes audio processing system 308 , which in certain embodiments may be physically integrated into the microphone. Audio processing system 308 may be used to perform noise suppression and/or echo cancellation right at mobile device 102 before the corresponding data stream is sent to other devices.
- Communication link 300 may be configured to send and receive signals to other devices through a local network.
- communication link 300 includes an antenna or some other type of transmitter.
- Processor 302 may include hardware and/or software configured to perform local processing, such as performing local noise suppression or, more specifically, stationary noise suppression.
- Processor 302 may also control operations of various other devices.
- Audio processing system 308 may be configured to receive the acoustic signals from an acoustic source via primary and secondary microphones 304 and 306 and process these acoustic signals in addition to or instead of processor 302 .
- Primary and secondary microphones 304 and 306 may be spaced a distance apart in order to allow for energy level differences between them.
- the acoustic signals may be converted into electrical signals (i.e., a primary electrical signal and a secondary electrical signal).
- the electrical signals may themselves be converted by an analog-to-digital converter (not shown) into digital signals for processing, in accordance with some embodiments.
- the acoustic signal received by primary microphone 304 is herein referred to as the primary acoustic signal
- the acoustic signal received by secondary microphone 306 is herein referred to as the secondary acoustic signal. It should be noted that embodiments of the present invention may be practiced utilizing any plurality of microphones.
- the acoustic signals from output device 310 may be included as part of the (primary or secondary) acoustic signal.
- the primary acoustic signal and the secondary acoustic signal may be processed by audio processing system 308 to produce a signal with an improved signal to noise ratio for transmission across a communications network and/or routing to the output device.
- Output device 310 is any device which provides an audio output to a listener (e.g., an acoustic source).
- output device 310 may comprise a speaker, an earpiece of a headset, or a handset on mobile device 102 .
- a beamforming technique may be used to simulate a forward-facing and backward-facing directional microphone response.
- a level difference may be obtained using the simulated forward-facing and backward-facing directional microphone.
- the level difference may be used to discriminate speech and noise in, for example, the time-frequency domain, which can be used in noise and/or echo reduction/suppression.
- Embodiments of the present invention may be practiced on any device that is configured to receive and/or provide audio such as, but not limited to, cellular phones, phone handsets, headsets, and systems for teleconferencing applications.
- modules can be comprised of instructions that are stored on storage media.
- the instructions can be retrieved and executed by processor 302 .
- Some examples of instructions include software, program code, and firmware.
- Some examples of storage media comprise memory devices and integrated circuits. The instructions are operational when executed by processor 302 to direct processor 302 to operate in accordance with embodiments of the present invention. Those skilled in the art are familiar with instructions, processor(s), and (computer readable) storage media.
- mobile device 102 may also include media player 312 and media storage 314 . These components may be used to generate audio and video output on mobile devices 102 , and users may choose to share this output to other devices in the local network.
- FIG. 4 is a process flow chart corresponding to method 400 for communicating between multiple mobile devices, in accordance with certain embodiments.
- the method 400 may commence with establishing a communication session between multiple mobile devices using a local communication network during operation 402 .
- a Wi-Fi network is used to interconnect multiple mobile devices.
- mobile devices are mobile phones.
- other devices having a local network interface can be used as well.
- each mobile device in the plurality of mobile devices interconnected by the local network includes a corresponding communication link.
- the mobile devices may be interconnected according to various networking topologies.
- the mobile devices are interconnected according to a ring topology, in which each device is connected to two other devices.
- An example of the ring topology is explained above with reference to FIG. 2 .
- the mobile devices may be interconnected according to a star topology, in which one device is a master device.
- a star topology An example of the ring topology is explained above with reference to FIG. 1 .
- the master device is connected individually to all other devices. These other devices are connected only to the master device and may not have any other connections.
- one of the users may select or otherwise designate his or her mobile device as a master device. This selection may be based on geographic location of the mobile devices, data flows, and other considerations.
- a local network may designate one device as a master based on one of more of these criteria.
- a number of devices and even a network scheme may be changed after establishing an initial communication session.
- a mobile device may be added to the local network or dropped from the network after the teleconference commences.
- one or more devices may activate an alarm to inform other devices about participation changes or other changes.
- Each mobile device in the plurality of interconnected mobile devices includes at least one microphone and an audio processing system configured to perform noise suppression and/or echo cancellation.
- the audio processing system performs both of these functions. Additional features of the audio processing system are described above with reference to FIG. 3 .
- one or more mobile devices may each include multiple microphones, such as a primary microphone and secondary microphone as explained above.
- Each mobile device in the plurality of interconnected mobile devices is configured to produce a data stream for communicating with one or more other devices in the plurality of mobile devices.
- the number of communication links depends on the communication scheme and type of the device.
- the data stream may be produced by a microphone, processor, audio processing system, or some other component of the mobile device.
- the data stream is transmitted and received by the communication link of the mobile device as explained above with reference to FIG. 3 .
- the method 400 may proceed with transmitting the data stream from one mobile device to all remaining mobile devices during operation 404 .
- the user of the transmitting mobile device may be talking to an audio input of that device to produce the data stream and/or may activate a media file for transmission over the local network to all other devices.
- the local network may employ various techniques for resolving the conflict and determining which data stream/data packets should be dropped.
- the method 400 may proceed with verifying connections between mobile devices in the local networks and sending alarms during operation 406 .
- some devices may be dropped from the network because their users choose to do so and/or because the mobile devices left the communication range, or there may be some radio signal interference. Regardless of the cause, other devices may be informed that one or more devices are not part of the network. For example, during a teleconference, participants may need to know who is present at any particular time. This notification may involve visual and/or audio signals.
- the method involves sending an alarm to the remaining mobile devices if any mobile device is found to be disconnected from the local network.
- any mobile device in the network is capable of determining this loss of connection and sending the corresponding alarm.
- Operation 406 may be repeated at predetermined intervals to ensure proper updates to the devices of the network. Similar to situations when mobile devices are dropped from the network, alarms may be generated when new devices are added to the network.
- the method 400 may involve communicating physical locations of mobile devices to other mobile devices during optional operation 408 .
- mobile devices connected to the local network share their locations with each other.
- the shared location may be relative (e.g., relative to the other devices in the network).
- the relative location may be determined based on the devices' ability to connect to other devices.
- the shared location may be an absolute map location and may be determined by a Global Positioning System (GPS) or other systems and methods.
- GPS Global Positioning System
- the method may proceed with rearranging the communication session based on the physical locations of the mobile devices. For example, a new master device may be identified for a star topography.
- the method 400 may involve various data processing operations implemented on mobile devices. These data processing operations may be performed prior to transmitting the data from one device to another.
- the data processing operations may be performed in stages.
- the first stage of processing is the transform stage.
- the transform stage uses a Fast Cochlea Transform (FCT) to convert the time-domain signal into a set of band-passed cochlear signals or Analytic Cochlea Samples (ACSs).
- FCT Fast Cochlea Transform
- ACSs Analytic Cochlea Samples
- the FCT implements a series of cascaded, complex-valued, first-order Infinite Filter Response (IIR) filters.
- IIR Infinite Filter Response
- the subband center frequencies may be spread logarithmically in frequency over roughly five octaves for the narrowband configuration and seven octaves for the wideband configuration, and the bandwidths of the subbands correspond roughly to the critical bandwidths in the human auditory system. Further details regarding the first stage are described in U.S. patent application Ser. No. 11/441,675, incorporated by reference herein in its entirety.
- the second stage of processing is the cancellation stage.
- the cancellation stage may use a beamformer to subtract from the primary microphone signal noise and/or echo components that are correlated with the other microphone signal(s).
- An example of a beamformer is Null-Processing Noise Subtraction (NPNS). Further details regarding NPNS are described in U.S. patent application Ser. No. 12/422,917, incorporated by reference herein in its entirety.
- the third stage of processing is the post-filter stage.
- a time-frequency mask may be applied to the output ACS of the cancellation stage to produce the modified ACS, thereby achieving additional noise and/or echo reduction.
- the time-frequency mask may be determined using an analysis path sub-system that may include feature extraction modules, source inference modules, and mask generation modules.
- Feature extraction may include frame energy estimation, Inter-microphone Level Difference (ILD) computation, and pitch estimation.
- Source inference may include noise estimation and/or noise and speech modeling.
- Mask generation may include a Wiener filter and Voice Quality Optimized Suppression (VQOS). The VQOS is described in further detail in U.S. patent application Ser. No. 12/832,901, incorporated by reference herein in its entirety.
- the fourth stage of processing is the reconstruction stage.
- the modified ACS may be added and delayed in each subband to obtain a time-domain modified noise and/or echo suppressed signal.
- the present technology provides improved noise cancellation and may be applied to both close-talk as well as hand-held speakerphone use cases. Further details regarding the fourth and other stages is described in U.S. patent application Ser. No. 11/343,524, incorporated by reference herein in its entirety
- the present system may transform acoustic time domain signals to the cochlea domain as subband signals, extract features from the subband signals, cancel noise in the subband signals via noise subtraction techniques, generate a multiplicative mask and apply the multiplicative mask to the noise-subtracted subband signals via a noise suppression or echo-cancellation process, transform the noise suppressed cochlea subband signals back to the time domain, and perform post processing to the signals.
- a highly directional response of a device may indicate that a beamformer is used. If a device suppresses noise by a greater amount than the theoretical limit for noise cancellation in diffuse noise based upon the microphone spacing, this may indicate that a post-filter is used. If the amount of suppression being applied varies across frequencies (e.g., voice harmonics are not attenuated, but the noise between the harmonics is attenuated) or the latency of their system can be measured and is greater than ⁇ 5 ms, these may indicate that a subband analysis using a transform stage and reconstruction stage is used.
- FIG. 5 is a diagrammatic representation of an example machine in the form of a computer system 500 , within which a set of instructions for causing the machine to perform any one or more of the methodologies discussed herein may be executed.
- the machine operates as a standalone device or may be connected (e.g., networked) to other machines.
- the machine may operate in the capacity of a server or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment.
- the machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a portable music player (e.g., a portable hard drive audio device such as an Moving Picture Experts Group Audio Layer 3 (MP3) player), a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
- PC personal computer
- PDA Personal Digital Assistant
- MP3 Moving Picture Experts Group Audio Layer 3
- MP3 Moving Picture Experts Group Audio Layer 3
- web appliance e.g., a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
- MP3 Moving Picture Experts Group Audio Layer 3
- machine shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or
- the example computer system 500 includes a processor or multiple processors 502 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), or both), and a main memory 508 and static memory 514 , which communicate with each other via a bus 528 .
- the computer system 500 may further include a video display unit 506 (e.g., a liquid crystal display (LCD)).
- the computer system 500 may also include an alpha-numeric input device 512 (e.g., a keyboard), a cursor control device 516 (e.g., a mouse), a voice recognition or biometric verification unit, a disk drive unit 520 , a signal generation device 526 (e.g., a speaker), and a network interface device 518 .
- the computer system 500 may further include a data encryption module (not shown) to encrypt data.
- the disk drive unit 520 includes a computer-readable medium 522 on which is stored one or more sets of instructions and data structures (e.g., instructions 510 ) embodying or utilizing any one or more of the methodologies or functions described herein.
- the instructions 510 may also reside, completely or at least partially, within the main memory 508 and/or within the processors 502 during execution thereof by the computer system 500 .
- the main memory 508 and the processors 502 may also constitute machine-readable media.
- the instructions 510 may further be transmitted or received over a network 524 via the network interface device 518 utilizing any one of a number of well-known transfer protocols (e.g., Hyper Text Transfer Protocol (HTTP)).
- HTTP Hyper Text Transfer Protocol
- While the computer-readable medium 522 is shown in an example embodiment to be a single medium, the term “computer-readable medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database and/or associated caches and servers) that store the one or more sets of instructions.
- the term “computer-readable medium” shall also be taken to include any medium that is capable of storing, encoding, or carrying a set of instructions for execution by the machine and that causes the machine to perform any one or more of the methodologies of the present application, or that is capable of storing, encoding, or carrying data structures utilized by or associated with such a set of instructions.
- the term “computer-readable medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical and magnetic media. Such media may also include, without limitation, hard disks, floppy disks, flash memory cards, digital video disks, random access memory (RAM), read only memory (ROM), and the like.
- the example embodiments described herein may be implemented in an operating environment comprising software installed on a computer, in hardware, or in a combination of software and hardware.
Abstract
Description
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/415,535 US9007416B1 (en) | 2011-03-08 | 2012-03-08 | Local social conference calling |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201161450500P | 2011-03-08 | 2011-03-08 | |
US13/415,535 US9007416B1 (en) | 2011-03-08 | 2012-03-08 | Local social conference calling |
Publications (1)
Publication Number | Publication Date |
---|---|
US9007416B1 true US9007416B1 (en) | 2015-04-14 |
Family
ID=52782250
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/415,535 Expired - Fee Related US9007416B1 (en) | 2011-03-08 | 2012-03-08 | Local social conference calling |
Country Status (1)
Country | Link |
---|---|
US (1) | US9007416B1 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9558755B1 (en) | 2010-05-20 | 2017-01-31 | Knowles Electronics, Llc | Noise suppression assisted automatic speech recognition |
US9668048B2 (en) | 2015-01-30 | 2017-05-30 | Knowles Electronics, Llc | Contextual switching of microphones |
EP3185627A1 (en) * | 2015-12-22 | 2017-06-28 | Televic Conference NV | Method and system for determining a spatial topology of a wireless conferencing network |
US9699554B1 (en) | 2010-04-21 | 2017-07-04 | Knowles Electronics, Llc | Adaptive signal equalization |
US9712915B2 (en) | 2014-11-25 | 2017-07-18 | Knowles Electronics, Llc | Reference microphone for non-linear and time variant echo cancellation |
US9838784B2 (en) | 2009-12-02 | 2017-12-05 | Knowles Electronics, Llc | Directional audio capture |
US9978388B2 (en) | 2014-09-12 | 2018-05-22 | Knowles Electronics, Llc | Systems and methods for restoration of speech components |
US10237706B2 (en) | 2014-11-10 | 2019-03-19 | Alibaba Group Holding Limited | Method and apparatus for establishing communication between mobile terminals, incoming communication control and outgoing communication control and system by use thereof |
WO2019143759A1 (en) | 2018-01-18 | 2019-07-25 | Knowles Electronics, Llc | Data driven echo cancellation and suppression |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070081075A1 (en) * | 2002-01-29 | 2007-04-12 | Palm, Inc. | Videoconferencing bandwidth management for a handheld computer system and method |
US20090323655A1 (en) * | 2008-03-31 | 2009-12-31 | Cozybit, Inc. | System and method for inviting and sharing conversations between cellphones |
US7685132B2 (en) * | 2006-03-15 | 2010-03-23 | Mog, Inc | Automatic meta-data sharing of existing media through social networking |
US20100217837A1 (en) * | 2006-12-29 | 2010-08-26 | Prodea Systems , Inc. | Multi-services application gateway and system employing the same |
US20110173542A1 (en) * | 2009-08-21 | 2011-07-14 | Imes Kevin R | Mobile energy management system |
US20110280154A1 (en) * | 2006-12-07 | 2011-11-17 | Silverstrim James E | Method and Apparatus for Management of a Global Wireless Sensor Network |
US20120202458A1 (en) * | 2009-08-19 | 2012-08-09 | Deutsche Telekom Ag | Mobile radio access network, mobility control unit, method for charging in a mobile radio access network, and program |
US20120231778A1 (en) * | 2008-09-30 | 2012-09-13 | Apple Inc. | Microphone proximity detection |
US20120250882A1 (en) * | 2011-04-04 | 2012-10-04 | Qualcomm Incorporated | Integrated echo cancellation and noise suppression |
-
2012
- 2012-03-08 US US13/415,535 patent/US9007416B1/en not_active Expired - Fee Related
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070081075A1 (en) * | 2002-01-29 | 2007-04-12 | Palm, Inc. | Videoconferencing bandwidth management for a handheld computer system and method |
US7685132B2 (en) * | 2006-03-15 | 2010-03-23 | Mog, Inc | Automatic meta-data sharing of existing media through social networking |
US20110280154A1 (en) * | 2006-12-07 | 2011-11-17 | Silverstrim James E | Method and Apparatus for Management of a Global Wireless Sensor Network |
US20100217837A1 (en) * | 2006-12-29 | 2010-08-26 | Prodea Systems , Inc. | Multi-services application gateway and system employing the same |
US20090323655A1 (en) * | 2008-03-31 | 2009-12-31 | Cozybit, Inc. | System and method for inviting and sharing conversations between cellphones |
US20120231778A1 (en) * | 2008-09-30 | 2012-09-13 | Apple Inc. | Microphone proximity detection |
US20120202458A1 (en) * | 2009-08-19 | 2012-08-09 | Deutsche Telekom Ag | Mobile radio access network, mobility control unit, method for charging in a mobile radio access network, and program |
US20110173542A1 (en) * | 2009-08-21 | 2011-07-14 | Imes Kevin R | Mobile energy management system |
US20120250882A1 (en) * | 2011-04-04 | 2012-10-04 | Qualcomm Incorporated | Integrated echo cancellation and noise suppression |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9838784B2 (en) | 2009-12-02 | 2017-12-05 | Knowles Electronics, Llc | Directional audio capture |
US9699554B1 (en) | 2010-04-21 | 2017-07-04 | Knowles Electronics, Llc | Adaptive signal equalization |
US9558755B1 (en) | 2010-05-20 | 2017-01-31 | Knowles Electronics, Llc | Noise suppression assisted automatic speech recognition |
US9978388B2 (en) | 2014-09-12 | 2018-05-22 | Knowles Electronics, Llc | Systems and methods for restoration of speech components |
US10237706B2 (en) | 2014-11-10 | 2019-03-19 | Alibaba Group Holding Limited | Method and apparatus for establishing communication between mobile terminals, incoming communication control and outgoing communication control and system by use thereof |
US9712915B2 (en) | 2014-11-25 | 2017-07-18 | Knowles Electronics, Llc | Reference microphone for non-linear and time variant echo cancellation |
US9668048B2 (en) | 2015-01-30 | 2017-05-30 | Knowles Electronics, Llc | Contextual switching of microphones |
EP3185627A1 (en) * | 2015-12-22 | 2017-06-28 | Televic Conference NV | Method and system for determining a spatial topology of a wireless conferencing network |
WO2017109021A1 (en) * | 2015-12-22 | 2017-06-29 | Televic Conference Nv | Method and system for determining a spatial topology of a wireless conferencing network |
WO2019143759A1 (en) | 2018-01-18 | 2019-07-25 | Knowles Electronics, Llc | Data driven echo cancellation and suppression |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9007416B1 (en) | Local social conference calling | |
US8606249B1 (en) | Methods and systems for enhancing audio quality during teleconferencing | |
US10542136B2 (en) | Transcribing audio communication sessions | |
US9183845B1 (en) | Adjusting audio signals based on a specific frequency range associated with environmental noise characteristics | |
US8965005B1 (en) | Transmission of noise compensation information between devices | |
JP2015506126A (en) | Method and configuration for echo cancellation in a conference system | |
US20140329511A1 (en) | Audio conferencing | |
CN106656276A (en) | Bluetooth audio based karaoke method | |
US20210250391A1 (en) | System and method for multi-party communication of trending topics | |
WO2023125350A1 (en) | Audio data pushing method, apparatus and system, and electronic device and storage medium | |
US11521636B1 (en) | Method and apparatus for using a test audio pattern to generate an audio signal transform for use in performing acoustic echo cancellation | |
CN111863011B (en) | Audio processing method and electronic equipment | |
US9235552B1 (en) | Collaborative audio recording of an event by multiple mobile devices | |
JP2013198066A (en) | Server, control method and control program for server, information processing system, information processing method, portable terminal, control method and control program for portable terminal | |
JP2009509387A (en) | A method for synchronizing playback of audio broadcasts on a plurality of network output devices | |
WO2010118790A1 (en) | Spatial conferencing system and method | |
CN111628992B (en) | Multi-person call control method and device, electronic equipment and storage medium | |
JP6580362B2 (en) | CONFERENCE DETERMINING METHOD AND SERVER DEVICE | |
EP2974224A2 (en) | System and method for multi-party communication | |
JP2004274147A (en) | Sound field fixed multi-point talking system | |
Aguilera et al. | An immersive multi-party conferencing system for mobile devices using binaural audio | |
Härmä | Ambient telephony: Scenarios and research challenges | |
JP2007325201A (en) | Sound source separation method | |
JP6392161B2 (en) | Audio conference system, audio conference apparatus, method and program thereof | |
Aguilera et al. | Spatial audio for audioconferencing in mobile devices: Investigating the importance of virtual mobility and private communication and optimizations |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: PAT HOLDER NO LONGER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: STOL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: AUDIENCE, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MURGIA, CARLO;SKUP, ERIC;REEL/FRAME:034909/0730 Effective date: 20111007 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: KNOWLES ELECTRONICS, LLC, ILLINOIS Free format text: MERGER;ASSIGNOR:AUDIENCE LLC;REEL/FRAME:037927/0435 Effective date: 20151221 Owner name: AUDIENCE LLC, CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:AUDIENCE, INC.;REEL/FRAME:037927/0424 Effective date: 20151217 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20230414 |