WO2014017860A1 - Système électronique avec mécanisme de détection de surface et son procédé de fonctionnement - Google Patents

Système électronique avec mécanisme de détection de surface et son procédé de fonctionnement Download PDF

Info

Publication number
WO2014017860A1
WO2014017860A1 PCT/KR2013/006697 KR2013006697W WO2014017860A1 WO 2014017860 A1 WO2014017860 A1 WO 2014017860A1 KR 2013006697 W KR2013006697 W KR 2013006697W WO 2014017860 A1 WO2014017860 A1 WO 2014017860A1
Authority
WO
WIPO (PCT)
Prior art keywords
vibration
module
sensor
pattern
electronic system
Prior art date
Application number
PCT/KR2013/006697
Other languages
English (en)
Inventor
Mayank Goel
Stacie HIBINO
James Begole
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/935,855 external-priority patent/US20140260642A1/en
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Priority to KR1020137030439A priority Critical patent/KR20150037456A/ko
Priority to IN2565MUN2014 priority patent/IN2014MN02565A/en
Priority to EP13823272.3A priority patent/EP2877908A4/fr
Priority to CN201380039571.XA priority patent/CN104487917A/zh
Publication of WO2014017860A1 publication Critical patent/WO2014017860A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion

Definitions

  • An embodiment of the present invention relates generally to an electronic system, and more particularly to a system for networking electronic devices.
  • Portable devices such as cellular telephones, have become smaller and lighter while also becoming more capable of performing tasks that far exceed a traditional voice call.
  • An increasing number of portable devices are small computing devices that are capable of running a variety of applications and providing a user with a display on which they may watch video, view web pages, play interactive games, or read text.
  • Modern consumer and industrial electronics especially devices such as graphical display systems, televisions, projectors, cellular phones, portable digital assistants, and combination devices, are providing increasing levels of functionality to support modern life including image display.
  • Research and development in the existing technologies can take a myriad of different directions.
  • Detecting devices can assist in the facilitation of communication.
  • the devices can be detected by sensors and actuators and acoustic sensors can be leveraged to facilitate touch interactions.
  • An electronic system includes: a vibration broadcast module configured to provide a vibration; a sensor query module, coupled to the vibration broadcast module, with a motion sensor and a sound sensor configured to detect the vibration; and an operation module, coupled to the sensor query module, configured to invoke an operation based on the vibration detected.
  • Ubiquity of portable devices leads to multiple devices in the same environment. There is value in facilitating communication between all or a subset of these devices. Detecting devices can assist in the facilitation of communication.
  • FIG. 1 is an electronic system with surface detection mechanism in an embodiment of the present invention.
  • FIG. 2 is an exemplary block diagram of the electronic system.
  • FIG. 3 is a control flow of the electronic system with surface detection mechanism.
  • FIG. 4 is an example of a detection pattern of the electronic system.
  • FIG. 5 is an example of a detection pattern of the electronic system.
  • FIG. 6 is an example of a detection pattern of the electronic system.
  • FIG. 7 is a flow chart of a method of operation of an electronic system in a further embodiment of the present invention.
  • An embodiment of the present invention provides an electronic system including: a vibration broadcast module configured to provide a vibration; a sensor query module, coupled to the vibration broadcast module, with a motion sensor and a sound sensor configured to detect the vibration; and an operation module, coupled to the sensor query module, configured to invoke an operation based on the vibration detected.
  • An embodiment of the present invention provides an electronic system including: a vibration broadcast module configured to provide a vibration pattern; a sensor query module, coupled to the vibration broadcast module, configured to use results of a motion sensor and a sound sensor detecting the vibration pattern; and an operation module, coupled to the sensor query module, configured to invoke an operation based on the vibration.
  • An embodiment of the present invention provides method of operation of an electronic system including: providing a vibration; using a motion sensor and a sound sensor to detect the vibration; and invoking an operation based on the vibration detected.
  • An embodiment of the present invention provides method of operation of an electronic system including: providing the vibration with a vibration pattern; determining detection results configured to use results of a motion sensor and a sound sensor detecting the vibration pattern to invoke an operation based on the vibration pattern.
  • the ubiquity of mobile devices leads to multiple devices in the same environment. There is value in facilitating communication between all or a subset of these devices.
  • One such subset can be devices on the same table (e.g. identifying devices on the same table in a crowded restaurant). It can be difficult to differentiate between devices on the same table or devices near each other using existing state-of-the-art proximity technologies.
  • Photo sensors and actuators like light-emitting diodes (LEDs), photoresistors, etc. can detect placement of device, such as in bag, pocket, or on a table, etc. Also acoustic sensors can be leveraged to facilitate touch interactions on a flat surface. Embodiments of the present invention determine whether multiple devices reside on the same specific surface.
  • the amount of pressure applied on a device can be inferred.
  • the device can be in a user’s hand or on a surface.
  • the dampening of vibrations induced by the on-device motor to infer pressure can be measured. It has been found that the dampening of vibrations can be directly proportional to the amount of pressure applied.
  • Embodiments of the present invention include a system that at least detects networkable electronic devices on the same or common surface using existing on-device sensors and actuators.
  • An option to achieve this uses the concept of hard, flat surfaces including materials’ vibration or conduction properties.
  • Devices can emit a pattern of vibrations onto the surface at least through on-device motors. These patterns of vibrations can be detected through inertial sensors such as gyroscope and accelerometer, and microphones. The devices, which are not on the same surface, will not be able to detect these subtle vibration patterns.
  • a local communication network is established between the devices that are detected on the same flat surface.
  • This network can be used by the devices in a number of scenarios such as sharing of bill in restaurants, sharing documents in a business meeting, interaction for board games, or combination thereof.
  • the relative distances can also be detected between devices to regulate transmission strengths of appropriate radios used for inter-device communication, for example: Bluetooth, WiFi, other communication protocols, or combination thereof.
  • Embodiments of the present invention can measure an emitted pattern of vibrations to infer different user behaviors and scenarios for detecting devices present on the same flat surface.
  • module can include software, hardware, or a combination thereof in the present invention in accordance with the context in which the term is used.
  • the software can be machine code, firmware, embedded code, and application software.
  • the hardware can be circuitry, processor, computer, integrated circuit, integrated circuit cores, a pressure sensor, an inertial sensor, a microelectromechanical system (MEMS), passive devices, or a combination thereof.
  • MEMS microelectromechanical system
  • the electronic system 100 includes a first device 102, such as a client, host, or a server, connected to a second device 106, such as a client, host, or server.
  • the first device 102 can communicate with the second device 106 with a communication path 104, such as a wireless or wired network.
  • the first device 102 can be of any of a variety of display devices, such as a cellular phone, personal digital assistant, a notebook computer, a liquid crystal display (LCD) system, a light emitting diode (LED) system, or other multi-functional display or entertainment device.
  • the first device 102 can couple, either directly or indirectly, to the communication path 104 to communicate with the second device 106 or can be a stand-alone device.
  • the electronic system 100 is described with the first device 102 as a display device, although it is understood that the first device 102 can be different types of devices.
  • the first device 102 can also be a device for presenting images or a multi-media presentation.
  • a multi-media presentation can be a presentation including sound, a sequence of streaming images or a video feed, or a combination thereof.
  • the first device 102 can be a high definition television, a three dimensional television, a computer monitor, a personal digital assistant, a cellular phone, or a multi-media set.
  • the second device 106 can be any of a variety of centralized or decentralized computing devices, or video transmission devices.
  • the second device 106 can be a multimedia computer, a laptop computer, a desktop computer, a video game console, grid-computing resources, a virtualized computer resource, cloud computing resource, routers, switches, peer-to-peer distributed computing devices, a media playback device, a Digital Video Disk (DVD) player, a three-dimension enabled DVD player, a recording device, such as a camera or video camera, or a combination thereof.
  • the second device 106 can be a signal receiver for receiving broadcast or live stream signals, such as a television receiver, a cable box, a satellite dish receiver, or a web enabled device.
  • the second device 106 can be centralized in a single room, distributed across different rooms, distributed across different geographical locations, embedded within a telecommunications network.
  • the second device 106 can couple with the communication path 104 to communicate with the first device 102.
  • the electronic system 100 is described with the second device 106 as a computing device, although it is understood that the second device 106 can be different types of devices. Also for illustrative purposes, the electronic system 100 is shown with the second device 106 and the first device 102 as end points of the communication path 104, although it is understood that the electronic system 100 can have a different partition between the first device 102, the second device 106, and the communication path 104. For example, the first device 102, the second device 106, or a combination thereof can also function as part of the communication path 104.
  • the communication path 104 can span and represent a variety of networks.
  • the communication path 104 can include wireless communication, wired communication, optical, ultrasonic, or the combination thereof.
  • Satellite communication, cellular communication, Bluetooth, Infrared Data Association standard (lrDA), wireless fidelity (WiFi), and worldwide interoperability for microwave access (WiMAX) are examples of wireless communication that can be included in the communication path 104.
  • Ethernet, digital subscriber line (DSL), fiber to the home (FTTH), and plain old telephone service (POTS) are examples of wired communication that can be included in the communication path 104.
  • the communication path 104 can traverse a number of network topologies and distances.
  • the communication path 104 can include direct connection, personal area network (PAN), local area network (LAN), metropolitan area network (MAN), wide area network (WAN), or a combination thereof.
  • PAN personal area network
  • LAN local area network
  • MAN metropolitan area network
  • WAN wide area network
  • the electronic system 100 can include the first device 102, the communication path 104, and the second device 106.
  • the first device 102 can send information in a first device transmission 208 over the communication path 104 to the second device 106.
  • the second device 106 can send information in a second device transmission 210 over the communication path 104 to the first device 102.
  • the electronic system 100 is shown with the first device 102 as a client device, although it is understood that the electronic system 100 can have the first device 102 as a different type of device.
  • the first device 102 can be a server having a display interface and a display.
  • the electronic system 100 is shown with the second device 106 as a server, although it is understood that the electronic system 100 can have the second device 106 as a different type of device.
  • the second device 106 can be a client device.
  • the first device 102 will be described as a client device and the second device 106 will be described as a server device.
  • the present invention is not limited to this selection for the type of devices. The selection is an example of the present invention.
  • the first device 102 can include a first control unit 212, a first storage unit 214, a first communication unit 216, and a first user interface 218.
  • the first control unit 212 can include a first control interface 222.
  • the first control unit 212 can execute a first software 226 to provide the intelligence of the electronic system 100.
  • the first control unit 212 can be implemented in a number of different manners.
  • the first control unit 212 can be a processor, an application specific integrated circuit (ASIC), an embedded processor, a microprocessor, a hardware control logic, a hardware finite state machine (FSM), a digital signal processor (DSP), or a combination thereof.
  • the first control interface 222 can be used for communication between the first control unit 212 and other functional units in the first device 102.
  • the first control interface 222 can also be used for communication that is external to the first device 102.
  • the first control interface 222 can receive information from the other functional units or from external sources, or can transmit information to the other functional units or to external destinations.
  • the external sources and the external destinations refer to sources and destinations external to the first device 102.
  • the first control interface 222 can be implemented in different ways and can include different implementations depending on which functional units or external units are being interfaced with the first control interface 222.
  • the first control interface 222 can be implemented with a pressure sensor, an inertial sensor, a microelectromechanical system (MEMS), optical circuitry, waveguides, wireless circuitry, wireline circuitry, or a combination thereof.
  • MEMS microelectromechanical system
  • the first storage unit 214 can store the first software 226.
  • the first storage unit 214 can also store the relevant information, such as data representing incoming images, data representing previously presented image, sound files, or a combination thereof.
  • the first storage unit 214 can be a volatile memory, a nonvolatile memory, an internal memory, an external memory, or a combination thereof.
  • the first storage unit 214 can be a nonvolatile storage such as non-volatile random access memory (NVRAM), Flash memory, disk storage, or a volatile storage such as static random access memory (SRAM).
  • NVRAM non-volatile random access memory
  • SRAM static random access memory
  • the first storage unit 214 can include a first storage interface 224.
  • the first storage interface 224 can be used for communication between the first storage unit 214 and other functional units in the first device 102.
  • the first storage interface 224 can also be used for communication that is external to the first device 102.
  • the first storage interface 224 can receive information from the other functional units or from external sources, or can transmit information to the other functional units or to external destinations.
  • the external sources and the external destinations refer to sources and destinations external to the first device 102.
  • the first storage interface 224 can include different implementations depending on which functional units or external units are being interfaced with the first storage unit 214.
  • the first storage interface 224 can be implemented with technologies and techniques similar to the implementation of the first control interface 222.
  • the first communication unit 216 can enable external communication to and from the first device 102.
  • the first communication unit 216 can permit the first device 102 to communicate with the second device 106 of FIG. 1, an attachment, such as a peripheral device or a desktop computer, and the communication path 104.
  • the first communication unit 216 can also function as a communication hub allowing the first device 102 to function as part of the communication path 104 and not limited to be an end point or terminal unit to the communication path 104.
  • the first communication unit 216 can include active and passive components, such as microelectronics or an antenna, for interaction with the communication path 104.
  • the first communication unit 216 can include a first communication interface 228.
  • the first communication interface 228 can be used for communication between the first communication unit 216 and other functional units in the first device 102.
  • the first communication interface 228 can receive information from the other functional units or can transmit information to the other functional units.
  • the first communication interface 228 can include different implementations depending on which functional units are being interfaced with the first communication unit 216.
  • the first communication interface 228 can be implemented with technologies and techniques similar to the implementation of the first control interface 222.
  • the first user interface 218 allows a user (not shown) to interface and interact with the first device 102.
  • the first user interface 218 can include an input device and an output device. Examples of the input device of the first user interface 218 can include a keypad, a touchpad, soft-keys, a keyboard, a microphone, an infrared sensor for receiving remote signals, or any combination thereof to provide data and communication inputs.
  • the first user interface 218 can include a first display interface 230 as an output device.
  • the first display interface 230 can output to a first display, such as a projector, a video screen, a speaker, or any combination thereof.
  • the first control unit 212 can operate the first user interface 218 to display information generated by the electronic system 100.
  • the first control unit 212 can also execute the first software 226 for the other functions of the electronic system 100.
  • the first control unit 212 can further execute the first software 226 for interaction with the communication path 104 via the first communication unit 216.
  • the second device 106 can be used for implementing the present invention in a multiple device embodiment with the first device 102.
  • the second device 106 can provide the additional or higher performance processing power compared to the first device 102.
  • the second device 106 can include a second control unit 234, a second communication unit 236, a second user interface 238, and a second storage unit 246.
  • the second user interface 238 allows a user (not shown) to interface and interact with the second device 106.
  • the second user interface 238 can include an input device and an output device.
  • Examples of the input device of the second user interface 238 can include a keypad, a touchpad, soft-keys, a keyboard, a microphone, or any combination thereof to provide data and communication inputs.
  • Examples of the output device of the second user interface 238 can include a second display interface 240.
  • the second display interface 240 can output to a second display 212 of FIG. 2, such as a projector, a video screen, a speaker, or any combination thereof.
  • the second control unit 234 can execute a second software 242 to provide the intelligence to the second device 106 of the electronic system 100.
  • the second software 242 can operate in conjunction with the first software 226.
  • the second control unit 234 can provide additional performance compared to the first control unit 212.
  • the second control unit 234 can operate the second user interface 238 to display information.
  • the second control unit 234 can also execute the second software 242 for the other functions of the electronic system 100, including operating the second communication unit 236 to communicate with the first device 102 over the communication path 104.
  • the second control unit 234 can be implemented in a number of different manners.
  • the second control unit 234 can be a processor, an embedded processor, a microprocessor, hardware control logic, a hardware finite state machine (FSM), a digital signal processor (DSP), or a combination thereof.
  • FSM hardware finite state machine
  • DSP digital signal processor
  • the second control unit 234 can include a second control interface 244.
  • the second control interface 244 can be used for communication between the second control unit 234 and other functional units in the second device 106.
  • the second control interface 244 can also be used for communication that is external to the second device 106.
  • the second control interface 244 can receive information from the other functional units or from external sources, or can transmit information to the other functional units or to external destinations.
  • the external sources and the external destinations refer to sources and destinations external to the second device 106.
  • the second control interface 244 can be implemented in different ways and can include different implementations depending on which functional units or external units are being interfaced with the second control interface 244.
  • the second control interface 244 can be implemented with a pressure sensor, an inertial sensor, a microelectromechanical system (MEMS), optical circuitry, waveguides, wireless circuitry, wireline circuitry, or a combination thereof.
  • MEMS microelectromechanical system
  • a second storage unit 246 can store the second software 242.
  • the second storage unit 246 can also store the information, such as data representing incoming images, data representing previously presented image, sound files, or a combination thereof.
  • the second storage unit 246 can be sized to provide the additional storage capacity to supplement the first storage unit 214.
  • the second storage unit 246 is shown as a single element, although it is understood that the second storage unit 246 can be a distribution of storage elements.
  • the electronic system 100 is shown with the second storage unit 246 as a single hierarchy storage system, although it is understood that the electronic system 100 can have the second storage unit 246 in a different configuration.
  • the second storage unit 246 can be formed with different storage technologies forming a memory hierarchal system including different levels of caching, main memory, rotating media, or off-line storage.
  • the second storage unit 246 can be a volatile memory, a nonvolatile memory, an internal memory, an external memory, or a combination thereof.
  • the second storage unit 246 can be a nonvolatile storage such as non-volatile random access memory (NVRAM), Flash memory, disk storage, or a volatile storage such as static random access memory (SRAM).
  • NVRAM non-volatile random access memory
  • SRAM static random access memory
  • the second storage unit 246 can include a second storage interface 248.
  • the second storage interface 248 can be used for communication between the second storage unit 246 and other functional units in the second device 106.
  • the second storage interface 248 can also be used for communication that is external to the second device 106.
  • the second storage interface 248 can receive information from the other functional units or from external sources, or can transmit information to the other functional units or to external destinations.
  • the external sources and the external destinations refer to sources and destinations external to the second device 106.
  • the second storage interface 248 can include different implementations depending on which functional units or external units are being interfaced with the second storage unit 246.
  • the second storage interface 248 can be implemented with technologies and techniques similar to the implementation of the second control interface 244.
  • the second communication unit 236 can enable external communication to and from the second device 106.
  • the second communication unit 236 can permit the second device 106 to communicate with the first device 102 over the communication path 104.
  • the second communication unit 236 can also function as a communication hub allowing the second device 106 to function as part of the communication path 104 and not limited to be an end point or terminal unit to the communication path 104.
  • the second communication unit 236 can include active and passive components, such as microelectronics or an antenna, for interaction with the communication path 104.
  • the second communication unit 236 can include a second communication interface 250.
  • the second communication interface 250 can be used for communication between the second communication unit 236 and other functional units in the second device 106.
  • the second communication interface 250 can receive information from the other functional units or can transmit information to the other functional units.
  • the second communication interface 250 can include different implementations depending on which functional units are being interfaced with the second communication unit 236.
  • the second communication interface 250 can be implemented with technologies and techniques similar to the implementation of the second control interface 244.
  • the first communication unit 216 can couple with the communication path 104 to send information (e.g. a known test sample) to the second device 106 in the first device transmission 208.
  • the second device 106 can receive information in the second communication unit 236 from the first device transmission 208 of the communication path 104.
  • the second communication unit 236 can couple with the communication path 104 to send information to the first device 102 in the second device transmission 210.
  • the first device 102 can receive (or retrieve) information in the first communication unit 216 from the second device transmission 210 of the communication path 104.
  • the electronic system 100 can be executed by the first control unit 212, the second control unit 234, or a combination thereof.
  • the second device 106 is shown with the partition having the second user interface 238, the second storage unit 246, the second control unit 234, and the second communication unit 236, although it is understood that the second device 106 can have a different partition.
  • the second software 242 can be partitioned differently such that some or all of its function can be included in the second control unit 234 and the second communication unit 236.
  • the second device 106 can include other functional units not shown in FIG. 2 for clarity.
  • the functional units in the first device 102 can work individually and independently of the other functional units.
  • the first device 102 can work individually and independently from the second device 106 and the communication path 104.
  • the functional units in the second device 106 can work individually and independently of the other functional units.
  • the second device 106 can work individually and independently from the first device 102 and the communication path 104.
  • the electronic system 100 is described by operation of the first device 102 and the second device 106. It is understood that the first device 102 and the second device 106 can operate any of the modules and functions of the electronic system 100.
  • the electronic system 100 can preferably include a position detection module 302, a broadcast notification module 304, a vibration broadcast module 306, a sensor query module 308, an audio sensor module 310, a motion sensor module 312, an on-surface detection module 314, an off-surface detection module 316, and an operation module 318.
  • One of the first device 102 or the second device 106 can operate the position detection module 302 such as a GPS detection module configured to receive location information of or locate any of the first device 102 such as portable electronic devices.
  • the position detection module 302 provides a first device 102 of FIG. 1 such as a host or host device and identification of another of the first device 102 such as a client or client device, which are located within a predetermined distance such as in a geographical vicinity.
  • the one of the first device 102 such as a host device leverages GPS data to detect devices in geographical vicinity.
  • Others of the first device 102 such as devices using this service can be connected to the second device 106 such as a central server and report their GPS location to the central server.
  • the central server returns the devices in a specific radius of the host, for example 100 meters. While it is impractical for 2 devices to be 100 meters apart from each other and still be on the same surface a large radius can be used as an initial filtering heuristic because GPS data can be inaccurate when the devices are indoors.
  • the one of the first device 102 such as a host can operate the broadcast notification module 304.
  • the broadcast notification module 304 can provide a vibration pattern at a specified time or a notification of a time for broadcasting the vibration pattern.
  • the one of the first device 102 such as a host preferably sends to a list of the devices nearby a schedule or an exact time for a broadcast of the vibration pattern such as emitting vibration “beeps”.
  • the one of the first device 102 such as a host can operate the vibration broadcast module 306.
  • the vibration broadcast module 306 can preferably broadcast or send a vibration pattern from the one of the first device 102 such as a host.
  • the vibration pattern is preferably sent by the host such as a host vibration.
  • a “daisy chain” detection can be implemented.
  • the host can be far from a number of the potential clients or devices, for example on a large conference table. This, often, leads to situations where the clients or devices are unable to reliably detect the vibration patterns broadcast from the host. In such a situation, some clients or devices might be far from the host, but these clients or devices are relatively near some of the other clients or devices. This leads to possibility of a “vibration daisy chain” where identified of the clients become “quasi-host” and broadcast a vibration pattern from the client. This vibration pattern can be identical to the vibration pattern broadcast by the host.
  • some of the one of the first device 102 such as a host lack a vibration motor or the vibration motor is not powerful enough, and hence vibration patterns broadcast or emitted from such devices cannot be detected, recorded, or “picked up” by others of the first device 102 such as clients or proximal devices. If such vibration patterns are not feasible to be detected, recorded, or “picked up”, the host can provide an instruction to a user to physically create a user vibration pattern such as knocking on the surface or table in a pre-defined pattern.
  • the user can be instructed to knock three times on the table with roughly a one second interval between knocks as this can produces a strong enough vibration that permeates through the surface and can be detected, recorded, or “picked up” by the motion or inertial sensors of the devices on the same surface although it is understood that any pattern may be used. Detection of these user vibration patterns from the knocks can be detected in a manner similar to the vibration patterns broadcast by the host.
  • the one of the first device 102 such as a host or the second device 106 such as a server can operate the sensor query module 308.
  • the sensor query module 308 provides sending a request or a query for detection of a motion sensor, such as a gyroscope or other motion sensing device, and a sound sensor, such as a microphone or other audio device based on the vibration patterns from the host.
  • a motion sensor such as a gyroscope or other motion sensing device
  • a sound sensor such as a microphone or other audio device based on the vibration patterns from the host.
  • the others of the first device 102 such as clients or devices nearby start sampling with motion or inertial sensors and sound sensors prior to the time set by the host, for example sampling can start one second before the schedule or the exact time.
  • the host preferably uses a pre-defined pattern of pulsing and silence.
  • the vibration pattern used by the host includes a one second vibration followed by a one second silence, followed by another one second vibration although it is understood that any pattern may be used.
  • the one of the first device 102 such as a host, the another of the first device 102 such as a client, or the second device 106 such as a server can operate the audio sensor module 310.
  • the audio sensor module 310 provides determination of detection results of the audio sensor.
  • the determination of the results of the audio sensor includes detection of a sound pattern correlated to the vibration pattern sent by the host.
  • the host and client sample sound sensors such as microphones at eight kilohertz (8kHz) although it is understood that any sampling frequency may be used.
  • the one of the first device 102 such as a host, the another of the first device 102 such as a client, or the second device 106 such as a server can operate the motion sensor module 312.
  • the motion sensor module 312 provides determination of detection results of the motion sensors.
  • the determination of the results of the motion sensor includes detection of a motion pattern correlated to the vibration pattern sent by the host.
  • the host and client sample motion or inertial sensors such as gyroscopes and accelerometers at one hundred hertz (100 Hz) although it is understood that any sampling frequency may be used.
  • the sensor query module 308, the audio sensor module 310, the motion sensor module 312, or combination thereof can preferably track ambient, background, or local vibration patterns and optionally, wait to broadcast or trigger the vibration pattern, or provide the local vibration patterns to the clients.
  • the waiting to broadcast or the providing the local vibration patterns can address inadvertent vibrations to avoid degradation in performance of surface detection.
  • the providing the local vibration patterns to the clients includes the clients comparing the local vibration patterns with the vibration pattern sent by the host.
  • the one of the first device 102 such as a host or the second device 106 such as a server can operate the on-surface detection module 314.
  • the on-surface detection module 314 can preferably determine which of the others of the first device 102 such as clients share or on the same or common surface with the host based on the results from the sensor query module 308, the audio sensor module 310, the motion sensor module 312, or combination thereof.
  • the on-surface detection module 314 can also determine a relative distance from each of host or clients to determine the order in which clients perform a certain action.
  • this relative distance can be used to determine an order for play or “turn” in a multi-user application such as board games.
  • Heuristics can be implemented individually or in combination to infer the relative distance. Firstly, the clients can report timestamps for recording the vibration pattern. A simple, linear comparison of these reported timestamps can determine the relative distance of the host or clients. Secondly, the clients can report an amplitude of a dominant frequency of the audio signal recorded. This amplitude can provide directly proportional distances between the client and the host.
  • a more complex analysis scheme of the reported timestamps for recorded vibrations can be implemented to accurately trilaterate relative locations of the devices on the surface such as a table.
  • the trilateration can preferably identify two-dimensional locations of the devices and implement more complex interactions.
  • devices on opposite sides of a surface from each other can be teamed as a same team.
  • the one of the first device 102 such as a host or the second device 106 such as a server can operate the off-surface detection module 316.
  • the off-surface detection module 316 can preferably determine which of the others of the first device 102 such as clients do not share or are not on the same or common surface with the host based on the results from the sensor query module 308, the audio sensor module 310, the motion sensor module 312, or combination thereof.
  • the one of the first device 102 such as a host, the another of the first device 102 such as a client, or the second device 106 such as a server can operate the operation module 318.
  • the operation module 318 can execute or invoke an operation such as a command for the one of the first device 102 such as a host and the another of the first device 102 such as a client based on the results from the sensor query module 308, the audio sensor module 310, the motion sensor module 312, the on-surface detection module 314, or combination thereof.
  • the operation or command of the operation module can include take a photograph, record audio, increase volume, operate other device functions, or combination thereof.
  • Executing or invoking the operation or command can provide connecting a network for the one of the first device 102 such as a host and the another of the first device 102 such as a client.
  • the network connectivity can include peer to peer (P2P) network communication over any one or combination of protocols supported by the clients and host.
  • P2P peer to peer
  • the operation module 318 provides connecting a network for the one of the first device 102 such as a host and the another of the first device 102 such as a client that shares or is on the same or common surface with the host based on the results from the audio sensor module 310, the motion sensor module 312, the on-surface detection module 314, or combination thereof.
  • the position detection module 302, the broadcast notification module 304, the vibration broadcast module 306, the sensor query module 308, the audio sensor module 310, the motion sensor module 312, the on-surface detection module 314, the off-surface detection module 316, and the operation module 318 of the electronic system 100 provides secure network connectivity for the host, clients, and server.
  • the network connectivity is secure based on a physical presence and physical detection of the vibration patterns on the same surface, thus limiting distance and proximity such as to a room or more specifically to a surface or table in the room.
  • the modules 304, 306, 308, 310, 312, 314, 316, and 318 of the electronic system 100 provide a well-defined proximity.
  • the proximity includes physical presence and physical detection of the vibration patterns on the same surface.
  • modules 304, 306, 308, 310, 312, 314, 316, and 318 of the electronic system 100 provide collaboration between devices or users seated or present in close and well-defined proximity based on physical presence and physical detection of the vibration patterns on the same surface.
  • modules 304, 306, 308, 310, 312, 314, 316, and 318 of the electronic system 100 provide automatic sharing of a check for users sitting on the same table in a restaurant based on physical presence and physical detection of the vibration patterns on the same surface.
  • modules 304, 306, 308, 310, 312, 314, 316, and 318 of the electronic system 100 provide seamless document sharing between business meeting attendees at same conference room table based on physical presence and physical detection of the vibration patterns on the same surface.
  • modules 304, 306, 308, 310, 312, 314, 316, and 318 of the electronic system 100 provide better interaction between board game users based on physical presence and physical detection of the vibration patterns on the same surface.
  • the electronic system 100 has been described with module functions or order as an example.
  • the electronic system 100 can partition the modules differently or order the modules differently.
  • the audio sensor module 310 on the one of the first device 102 such as a host, the another of the first device 102 such as a client, or the second device 106 such as a server may be implemented after motion sensor module 312 on the another of the first device 102 such as a client, or the second device 106 such as a server.
  • the modules described in this application can be hardware implementation or hardware accelerators in the first control unit 312 of FIG. 3 or in the second control unit 334 of FIG. 3.
  • the modules can also be hardware implementation or hardware accelerators within the first device 102 or the second device 106 but outside of the first control unit 312 or the second control unit 334, respectively.
  • the physical transformation from the vibration broadcast module 306 results in the movement in the physical world, such as detection of the vibration patterns in the on-surface detection module 314, the off-surface detection module 316, the operation module 318, or combination thereof. Movement in the physical world results in changes in displays on the host, client, server, or combination thereof based on providing network connectivity resulting from detection of the physical vibration patterns.
  • the detection pattern 400 can preferably include sound data represented by a sound waveform 402.
  • the electronic system 100 with surface detection mechanism preferably captures at least the sound data represented by the sound waveform 402 for one or more of the first device 102 of FIG. 1.
  • the sound waveform 402 can include a frequency 404 and a time 406.
  • the frequency 404 of the sound waveform 402 can be grouped in a bin such as a low frequency bin of less than one kilohertz (1kHz).
  • the time 406 of the sound waveform 402 can indicate duration, patterns, correlation to known events, any other time function, or combination thereof.
  • a low frequency group 408 of the frequency 404 with a time correlated to the first device 102 vibrated to provide a vibration pattern can indicate that the first device 102 vibrated to source the vibration pattern is in close proximity to or on the same surface as an another of the first device 102 receiving a waveform 402 indicative of the vibration pattern or correlated to the vibration pattern.
  • the first control unit 212 of FIG. 2 or the second control unit 234 of FIG. 2, the first storage unit 214 of FIG. 2 or the second storage unit 248 of FIG. 2, a display of the first display interface 230 of FIG. 2 of the first user interface 218 of FIG. 2 or a display of the second display interface 240 of FIG. 2 of the second user interface 238 of FIG. 2, can be configured individually or in combination to any of: vibrate the first device 102 vibrated, receive the waveform 402 by another of the first device 102, group the sound waveform 402, display the sound waveform 402, or combination thereof.
  • the first device 102 such as a host or host device vibrated providing a vibration pattern and another of the first device 102 such as a client or a client device recorded a sound waveform 402 correlated to the vibration pattern 402 such as distinct low frequency peaks.
  • the correlation of the vibration pattern and the sound waveform 402 indicates close proximity or “near enough to be on a same surface” of the first device 102 such as the host and the another of the first device 102 such as the client.
  • the detection pattern 500 can preferably include motion data represented by a motion waveform 502.
  • the electronic system 100 with surface detection mechanism preferably captures at least the motion data represented by the motion waveform 402 sourced by one of the first device 102 of FIG. 1.
  • the motion data represented by the motion waveform 502 can be received by another of the first device 102 such as a client including a gyroscope or other motion sensing apparatus. Correlating the motion waveform 502 received by the another of the first device 102 such as a client to a vibration pattern of the one of the first device 102 such as a host vibrated to source the motion data can indicate close proximity or co-location on a same surface.
  • the motion waveform 502 can include an angular velocity 504 and a time 506.
  • the angular velocity 504 of the motion waveform 502 can represent motion or movement with higher frequency than vibrations of a busy environment that can include a motor.
  • the motion waveform 502 can include motion or movement data passed through a high pass filter to distinguish and indicate the motion waveform 502 for a vibration pattern sourced by vibrating the first device 102 such as a host.
  • the first control unit 212 of FIG. 2 or the second control unit 234 of FIG. 2, the first storage unit 214 of FIG. 2 or the second storage unit 248 of FIG. 2, a display of the first display interface 230 of FIG. 2 of the first user interface 218 of FIG. 2 or a display of the second display interface 240 of FIG. 2 of the second user interface 238 of FIG. 2, can be configured individually or in combination to any of: capture the motion data represented by the motion waveform 402 by the another of the first device 102, provide a vibration pattern of the one of the first device 102, correlate the motion waveform 502 to the vibration pattern, display the motion waveform 502, or combination thereof.
  • the motion data can be passed through a filter providing the motion waveform 502 indicating that the first device 102 such as a host sourcing a vibration pattern correlated to the motion waveform 502 is in close proximity to or on a same surface as another of the first device 102 such as a client receiving the motion data.
  • the detection pattern 600 can preferably include motion data represented by a motion plot 602.
  • the electronic system 100 with surface detection mechanism preferably captures at least the motion data represented by the motion plot 602 for one or more of the first device 102 of FIG. 1.
  • the motion plot 602 can include quantized data 604 based on a binary quantization of the motion data represented by the motion waveform 502 of FIG. 5.
  • the quantized data 604 can preferably be computed by the control unit 334 or the control unit 312 of FIG. 3 based on a threshold initially set without vibrating one of the first device 102 such as a host.
  • the motion data sourced by vibrating the one of the first device 102 such as a host and represented by the motion waveform 502 can be received by another of the first device 102 such as a client including a gyroscope or other motion sensing apparatus.
  • one of the angular velocity 504 detected as larger than the seventy-fifth (75th) percentile of another of the angular velocity 504 detected at rest can be indicated by a bit set to one “1” of the quantized data 604.
  • the angular velocity 504 set to 1 can indicate a potential beginning of a vibration pattern.
  • the first control unit 212 of FIG. 2 or the second control unit 234 of FIG. 2, the first storage unit 214 of FIG. 2 or the second storage unit 248 of FIG. 2, a display of the first display interface 230 of FIG. 2 of the first user interface 218 of FIG. 2 or a display of the second display interface 240 of FIG. 2 of the second user interface 238 of FIG. 2, can be configured individually or in combination to any of: capture at least the motion data represented by the motion plot 602 by another of the first device 102, vibrate the one of the first device 102 for receipt by another of the first device 102, provide binary quantization of the motion data represented by the motion waveform 502 of FIG. 5, indicate the angular velocity 504 detected as larger than a predetermined value by a bit set to one of the quantized data 604, display the quantized data 604, or combination thereof.
  • the quantized data 604 passed through a low pass filter identifies distinct phases of vibration and quietness.
  • the electronic system 100 computes an estimate of durations of these phases. These durations and associated start times are compared with those recorded on the host. If the durations match within a predetermined margin such as half a second, then the one of the first device 102 such as a host and the another of the first device 102 such as a client are given, considered, or inferred to be present on the same table.
  • the method 700 includes: providing a vibration in a block 702; using a motion sensor and a sound sensor to detect the vibration in a block 704; and invoking an operation based on the vibration detected in a block 706.
  • the resulting method, process, apparatus, device, product, and/or system is straightforward, cost-effective, uncomplicated, highly versatile, accurate, sensitive, and effective, and can be implemented by adapting known components for ready, efficient, and economical manufacturing, application, and utilization.
  • Another important aspect of the present invention is that it valuably supports and services the historical trend of reducing costs, simplifying systems, and increasing performance of information technology and consumer electronic products.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
  • Telephone Function (AREA)

Abstract

L'invention porte sur un système électronique, qui comprend : un module de diffusion de vibration configuré de façon à délivrer une vibration ; un module de demande à capteurs, couplé au module de diffusion de vibration, avec un capteur de mouvement et un capteur de son configurés de façon à détecter la vibration ; et un module d'actionnement, couplé au module de demande à capteurs, configuré de façon à demander une opération sur la base de la vibration détectée.
PCT/KR2013/006697 2012-07-26 2013-07-26 Système électronique avec mécanisme de détection de surface et son procédé de fonctionnement WO2014017860A1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
KR1020137030439A KR20150037456A (ko) 2012-07-26 2013-07-26 표면감지 메커니즘을 갖춘 전자 시스템과 그 작동 방법
IN2565MUN2014 IN2014MN02565A (fr) 2012-07-26 2013-07-26
EP13823272.3A EP2877908A4 (fr) 2012-07-26 2013-07-26 Système électronique avec mécanisme de détection de surface et son procédé de fonctionnement
CN201380039571.XA CN104487917A (zh) 2012-07-26 2013-07-26 具有表面检测机制的电子系统及其操作方法

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201261676241P 2012-07-26 2012-07-26
US61/676,241 2012-07-26
US201361788018P 2013-03-15 2013-03-15
US61/788,018 2013-03-15
US13/935,855 2013-07-05
US13/935,855 US20140260642A1 (en) 2013-03-15 2013-07-05 Electronic system with surface detection mechanism and method of operation thereof

Publications (1)

Publication Number Publication Date
WO2014017860A1 true WO2014017860A1 (fr) 2014-01-30

Family

ID=52761433

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2013/006697 WO2014017860A1 (fr) 2012-07-26 2013-07-26 Système électronique avec mécanisme de détection de surface et son procédé de fonctionnement

Country Status (5)

Country Link
EP (1) EP2877908A4 (fr)
KR (1) KR20150037456A (fr)
CN (1) CN104487917A (fr)
IN (1) IN2014MN02565A (fr)
WO (1) WO2014017860A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1750423A1 (fr) 2005-08-02 2007-02-07 Research In Motion Limited Communication de données entre dispositifs au moyen de vibrations
US20080108343A1 (en) * 2006-11-03 2008-05-08 Lg Electronics Inc. Broadcasting terminal and method of controlling vibration of a mobile terminal
US20080132196A1 (en) * 2006-12-01 2008-06-05 Samsung Electronics Co., Ltd. Method and medium for analyzing environment of device and device using the same
US20080153554A1 (en) * 2006-12-21 2008-06-26 Samsung Electronics Co., Ltd. Haptic generation method and system for mobile phone
EP2302884A1 (fr) * 2009-09-24 2011-03-30 Research In Motion Limited Dispositif mobile de communications sans fil, procédé et système utilisant un capteur magnétique et un circuit NFC activé pour établir des communications entre des dispositifs mobiles de communications sans fil
WO2012033243A1 (fr) * 2010-09-08 2012-03-15 엘지전자 주식회사 Terminal mobile et procédé de communication de groupe l'utilisant
EP2479965A1 (fr) 2011-01-25 2012-07-25 Sony Mobile Communications Japan, Inc. Procédé de connexion pour communication de champ proche

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070032270A1 (en) * 2005-08-02 2007-02-08 Research In Motion Limited Vibratory data communication between devices
KR101402243B1 (ko) * 2006-12-21 2014-06-02 삼성전자주식회사 촉각 서비스를 제공하는 휴대단말기 및 그 방법

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1750423A1 (fr) 2005-08-02 2007-02-07 Research In Motion Limited Communication de données entre dispositifs au moyen de vibrations
US20080108343A1 (en) * 2006-11-03 2008-05-08 Lg Electronics Inc. Broadcasting terminal and method of controlling vibration of a mobile terminal
US20080132196A1 (en) * 2006-12-01 2008-06-05 Samsung Electronics Co., Ltd. Method and medium for analyzing environment of device and device using the same
US20080153554A1 (en) * 2006-12-21 2008-06-26 Samsung Electronics Co., Ltd. Haptic generation method and system for mobile phone
EP2302884A1 (fr) * 2009-09-24 2011-03-30 Research In Motion Limited Dispositif mobile de communications sans fil, procédé et système utilisant un capteur magnétique et un circuit NFC activé pour établir des communications entre des dispositifs mobiles de communications sans fil
WO2012033243A1 (fr) * 2010-09-08 2012-03-15 엘지전자 주식회사 Terminal mobile et procédé de communication de groupe l'utilisant
EP2479965A1 (fr) 2011-01-25 2012-07-25 Sony Mobile Communications Japan, Inc. Procédé de connexion pour communication de champ proche

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2877908A4

Also Published As

Publication number Publication date
IN2014MN02565A (fr) 2015-07-24
EP2877908A1 (fr) 2015-06-03
EP2877908A4 (fr) 2016-04-27
CN104487917A (zh) 2015-04-01
KR20150037456A (ko) 2015-04-08

Similar Documents

Publication Publication Date Title
US20140260642A1 (en) Electronic system with surface detection mechanism and method of operation thereof
WO2013141630A1 (fr) Terminal de communication mobile et procédé de recommandation d'une application ou d'un contenu
WO2020116928A1 (fr) Procédé et appareil de gestion de fonctions de traitement multimédia en réseau dans un système de communication sans fil
WO2015030364A1 (fr) Procédé pour partager des données multimédias et dispositif électronique associé
WO2011013945A2 (fr) Terminal mobile et procédé opérationnel pour ce dernier
JP2022543005A (ja) 距離測定方法、ユーザ機器およびコンピュータ可読記憶媒体
WO2012128500A1 (fr) Système d'appel et procédé de service dans un rayon de portée
WO2017104919A1 (fr) Gestion d'images basée sur un événement à l'aide d'un regroupement
WO2014112754A1 (fr) Procédé de pousser de service web, serveur de pousser de service web et serveur de fourniture de service web l'exécutant
WO2020192674A1 (fr) Appareil et procédé de configuration d'espace de recherche, et dispositif de communication
WO2015093893A1 (fr) Procédé et dispositif de notification d'événement dans un système de réseau domestique
EP2810375A1 (fr) Appareil et procédé d'information de dispositifs disponibles dans un réseau de partage de contenus
WO2015034315A1 (fr) Système informatique ayant un mécanisme de détection et son procédé de fonctionnement
WO2022147401A1 (fr) Système de détermination de sortie audio et vidéo associée à un dispositif de test
WO2014107021A1 (fr) Système d'affichage à mécanisme de commande simultanée de modes multiples et son procédé de fonctionnement
WO2014017860A1 (fr) Système électronique avec mécanisme de détection de surface et son procédé de fonctionnement
WO2015093754A1 (fr) Procédé et dispositif de partage d'informations de connexion dans un dispositif électronique
WO2018032580A1 (fr) Procédé et appareil d'affichage de messages de notification
WO2020045712A1 (fr) Dispositif, procédé et support d'enregistrement lisible par ordinateur de fourniture de service de messagerie instantanée asynchrone
US7454607B2 (en) Techniques for managing applications in a portable communication device
TWI738909B (zh) 通訊方法及裝置
JP2008060785A (ja) Ｉｐ電話通話録音システム
WO2014182073A1 (fr) Procédé de commande d'un message vocal d'un terminal portable
WO2014104579A1 (fr) Procédé de contrôle de nom de fichier et dispositif électronique associé
WO2018169364A1 (fr) Dispositif électronique et procédé permettant de fournir un appel d'urgence, et serveur s'y rapportant

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 20137030439

Country of ref document: KR

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13823272

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2013823272

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE