WO2017079407A2 - Dispositif de sécurité bimode activé par logiciel - Google Patents

Dispositif de sécurité bimode activé par logiciel Download PDF

Info

Publication number
WO2017079407A2
WO2017079407A2 PCT/US2016/060280 US2016060280W WO2017079407A2 WO 2017079407 A2 WO2017079407 A2 WO 2017079407A2 US 2016060280 W US2016060280 W US 2016060280W WO 2017079407 A2 WO2017079407 A2 WO 2017079407A2
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
monitoring
viewing
mode
images
Prior art date
Application number
PCT/US2016/060280
Other languages
English (en)
Other versions
WO2017079407A3 (fr
Inventor
Adam M. GETTINGS
Tianren Wang
Yi Zheng
Weiyang YU
Brian Christensen
Ellis Garai
Steven Sensarn
Andrew G. Stevens
Original Assignee
Leeo, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/935,288 external-priority patent/US9801013B2/en
Priority claimed from US14/935,287 external-priority patent/US20170131758A1/en
Priority claimed from US14/935,283 external-priority patent/US20170134653A1/en
Application filed by Leeo, Inc. filed Critical Leeo, Inc.
Publication of WO2017079407A2 publication Critical patent/WO2017079407A2/fr
Publication of WO2017079407A3 publication Critical patent/WO2017079407A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/65—Control of camera operation in relation to power supply
    • H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2227/00—Details of public address [PA] systems covered by H04R27/00 but not provided for in any of its subgroups
    • H04R2227/003—Digital PA systems using, e.g. LAN or internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Definitions

  • the described embodiments relate to techniques for monitoring and sharing information about environments.
  • the described embodiments relate to techniques for monitoring an environment using an electronic device operating in a monitoring mode and for viewing monitored content associated with an environment using the electronic device operating in a viewing mode.
  • the new versions of the operating system typically consume additional resources in the portable electronic devices.
  • a new version of the operating system may require more memory and processor computational capability.
  • the new version of the operating system may increase power consumption and, thus, may reduce battery life. Consequently, software updates often cause users to consider older models of portable electronic devices obsolete, which can lead users to replace them with newer models.
  • the users may consider the older models of the portable electronic devices as unsuitable for their original intended purpose, many users do not discard the older models of the portable electronic devices.
  • the resources in the older models of the portable electronic devices are often unable to support the latest versions of the operating system, their remaining capabilities are typically unused, which constitutes a significant waste and an opportunity cost for the users.
  • a group of embodiments relates to an electronic device.
  • This electronic device includes: an imaging sensor that, during operation, captures images of an environment that includes the electronic device; an audio sensor that, during operation, measures acoustic information corresponding to sound in the environment; and an interface circuit that, during operation, communicates with a second electronic device.
  • the electronic device includes: a display that, during operation, presents visual information; an acoustic transducer that, during operation, outputs additional sound; and a memory that stores a program module.
  • the electronic device includes a processor that, during operation, executes the program module. In particular, during operation, the processor sets an operating mode of the electronic device as a monitoring mode or a viewing mode.
  • the processor When the electronic device is in the monitoring mode, the processor at least selectively captures the images and measures the acoustic information, and communicates the images and the acoustic information to the second electronic device.
  • the processor at least selectively receives the visual information and additional acoustic information from the second electronic device, presents the visual information on the display, and outputs the additional sound corresponding to the additional acoustic information using the acoustic transducer.
  • the memory stores a version of an operating system that, during operation, is executed by the processor.
  • This version of the operating system may be other than a subsequent version of the operating system because, during operation: an operating life of a power source in the electronic device when the processor executes the subsequent version of the operating system is less than a predefined value; an execution speed of a program module in the electronic device when the processor executes the subsequent version of the operating system is less than a second predefined value; an amount of the memory available to the program module in the electronic device when the processor executes the subsequent version of the operating system is less than a third predefined value; and/or an amount of non-volatile storage available to the program module in the electronic device when the processor executes the subsequent version of the operating system is less than a fourth predefined value.
  • the sound may be associated with an acoustic event.
  • the acoustic event may include: insertion of a key into a lock; a sound exceeding a threshold level; a type of sound; and/or activation of acoustic sources in the environment having a predetermined phase relationship.
  • the capturing of the images and measuring the acoustic information may be based on an occurrence of the acoustic event and a history of acoustic events in the environment.
  • the electronic device may include a motion sensor that detects motion in the environment, and the selective capturing of the images and measuring the acoustic information may be based on the detection of motion and a history of motion events in the environment.
  • the processor may detect motion in the environment based on the images captured by the imaging sensor, and the selective capturing of the images and measuring the acoustic information may be based on the detection of motion and the history of motion events in the environment.
  • the electronic device includes a rotatable base.
  • the rotatable base may change an angular orientation of the electronic device in the environment.
  • the electronic device may include a second imaging sensor that has a different field of view in the environment than the imaging sensor. While selectively capturing the images, the processor may switch between the imaging sensor and the second imaging sensor based on motion in the environment and the measured acoustic information.
  • the operating mode may be set based on a location of the electronic device.
  • the display may present a user interface with virtual command icons.
  • the operating mode may be set based on activation of one of the virtual command icons.
  • the electronic device may establish a peer-to-peer connection with the second electronic device.
  • the second electronic device includes cloud-based storage for a third electronic device that monitors another environment.
  • the processor may receive a proof-of-life request from the second electronic device, and may provide a response to the proof-of-life request. This response may indicate that the electronic device remains in the monitoring mode and has power.
  • the processor may disable one or more other functions of the electronic device.
  • the at least selectively capturing the images and measuring the acoustic information, and communicating the images and the acoustic information to the second electronic device may be based on an alert about an occurrence of an event in the environment that is received, via the interface circuit, from a governmental organization.
  • the processor may adjust an exposure time of the imaging sensor based on: a time of day, ambient lighting conditions and/or a quality metric for the images.
  • the electronic device includes an orientation sensor that, during operation, determines an orientation of the electronic device and the second imaging sensor that, during operation, captures second images of an external environment proximate to the electronic device.
  • the processor may identify the second images based on the orientation of the electronic device and may provide authorization to access the second images to additional electronic devices executing additional instances of the program module in the viewing mode.
  • Another embodiment provides a computer-program product for use in conjunction with the electronic device.
  • This computer-program product may include instructions for at least some of the aforementioned operations performed by the electronic device.
  • Another embodiment provides a method for facilitating environmental monitoring. This method may include at least some of the aforementioned operations performed by the electronic device.
  • a group of embodiments relates to an electronic device.
  • This electronic device includes: a power supply; an imaging sensor that, during operation, captures images of an environment that includes the electronic device; and an audio sensor that, during operation, measures acoustic information corresponding to sound in the environment.
  • the electronic device includes: an interface circuit that, during operation, communicates with a second electronic device; a memory that stores a program module; and a processor that, during operation, executes the program module.
  • the processor determines whether the power supply provides power from an external power source or an internal power source.
  • the processor remains in a monitoring mode without transitioning to a power-saving mode when the electronic device is inactive.
  • the electronic device at least selectively captures the images and measures the acoustic information, and communicates the images and the acoustic information to the second electronic device.
  • the processor selectively provides an activity signal that keeps the electronic device in the monitoring mode without transitioning to the power-saving mode when the electronic device is inactive.
  • the processor may remain in the monitoring mode without transitioning to the power-saving mode by disabling a timer in the electronic device that is used to transition the electronic device to the power-saving mode.
  • the memory may store a version of an operating system that, during operation, is executed by the processor.
  • This version of the operating system may be other than a subsequent version of the operating system because, during operation: an operating life of a power source in the electronic device when the processor executes the subsequent version of the operating system is less than a predefined value; an execution speed of a program module in the electronic device when the processor executes the subsequent version of the operating system is less than a second predefined value; an amount of the memory available to the program module in the electronic device when the processor executes the subsequent version of the operating system is less than a third predefined value; and/or an amount of non-volatile storage available to the program module in the electronic device when the processor executes the subsequent version of the operating system is less than a fourth predefined value.
  • the sound may be associated with an acoustic event.
  • the acoustic event may include: insertion of a key into a lock; a sound exceeding a threshold level; a type of sound; and/or activation of acoustic sources in the environment having a predetermined phase relationship.
  • the capturing of the images and measuring the acoustic information may be based on an occurrence of the acoustic event and a history of acoustic events in the environment.
  • the processor may selectively allow, based on a configuration setting, the electronic device to transition to the power-saving mode when the electronic device is inactive and to transition back to the monitoring mode when the acoustic event occurs.
  • the electronic device includes a motion sensor that detects motion in the environment, and the selective capturing of the images and measuring the acoustic information may be based on the detection of motion and a history of motion events in the environment.
  • the processor may detect motion in the environment based on the images captured by the imaging sensor, and the selective capturing of the images and measuring the acoustic information may be based on the detection of motion and the history of motion events in the environment.
  • the electronic device may include a rotatable base.
  • the rotatable base may change an angular orientation of the electronic device in the environment.
  • the electronic device may communicate with the second electronic device via a peer-to-peer connection.
  • the second electronic device may include cloud-based storage for a third electronic device that: remotely accesses the images and the acoustic information; and/or remotely receives the images and the acoustic information.
  • the processor may receive a proof-of-life request from the second electronic device and may provide a response to the proof-of-life request. The response may indicate that the electronic device remains in the monitoring mode and has power.
  • Another embodiment provides a computer-program product for use in conjunction with the electronic device. This computer-program product may include instructions for at least some of the aforementioned operations performed by the electronic device.
  • Another embodiment provides a method for facilitating environmental monitoring. This method may include at least some of the aforementioned operations performed by the electronic device.
  • a group of embodiments relates to a controller electronic device.
  • This controller electronic device includes an interface circuit that, during operation, communicates with a viewing electronic device that operates in a viewing mode in an environment, a monitoring electronic device associated with the viewing electronic device that operates in a monitoring mode, and second monitoring electronic devices that operate in the monitoring mode in second environments.
  • the controller electronic device includes: a memory that stores a program module; and a processor that, during operation, executes the program module.
  • the processor receives messages that include timestamps and current locations of the monitoring electronic device. Then, the processor associates the viewing electronic device with a subset of the second monitoring electronic devices based on a duration of time that the monitoring electronic device is approximately at a fixed location.
  • a size of the subset increases as the duration of time increases, and the associations allow the viewing electronic device to selectively access content, including acoustic information corresponding to sound and images for the second environments, from the subset of the second monitoring electronic devices. Furthermore, the processor removes the associations when a difference between a current location of the monitoring electronic device and the fixed location exceeds a predefined value.
  • the subset of the second monitoring electronic devices may be located within a distance from the fixed location, and the distance may increase as the duration of time increases.
  • the subset of the second monitoring electronic devices may be located within an adjacency value from the fixed location, and the adjacency value may increase as the duration of time increases.
  • the processor may receive credentials from the viewing electronic device and the subset of the second monitoring electronic devices, and associating the viewing electronic device and the subset of the second monitoring electronic devices may involve providing the credentials to the viewing electronic device and the subset of the second monitoring electronic devices. Additionally, the processor may receive encryption keys from the viewing electronic device and the subset of the second monitoring electronic devices, and associating the viewing electronic device and the subset of the second monitoring electronic devices may involve providing the encryption keys to the viewing electronic device and the subset of the second monitoring electronic devices.
  • the processor generates the encryption keys for the viewing electronic device and the subset of the second monitoring electronic devices, and associating the viewing electronic device and the subset of the second monitoring electronic devices may involve providing the encryption keys to the viewing electronic device and the subset of the second monitoring electronic devices.
  • the processor may associate the monitoring electronic device with a second viewing electronic device that is associated with one of the second monitoring electronic devices.
  • the association between the monitoring electronic device with the second viewing electronic device may allow the second viewing electronic device to selectively access content, including images and acoustic information corresponding to sound, for the environment.
  • the processor may receive credentials from the monitoring electronic device and the second viewing electronic device, and associating the monitoring electronic device and the second viewing electronic device may involve providing the credentials to the monitoring electronic device and the second viewing electronic device.
  • the processor may receive encryption keys from the monitoring electronic device and the second viewing electronic device, and associating the monitoring electronic device and the second viewing electronic device may involve providing the encryption keys to the monitoring electronic device and the second viewing electronic device.
  • the processor generates the encryption keys for the monitoring electronic device and the second viewing electronic devices, and associating the monitoring electronic device and the second viewing electronic device involves providing the encryption keys to the monitoring electronic device and the second viewing electronic device.
  • the controller electronic device may establish selective access to the content when the viewing electronic device is outside of communication range with the subset of the monitoring electronic devices.
  • Another embodiment provides a computer-program product for use in conjunction with the electronic device. This computer-program product may include instructions for at least some of the aforementioned operations performed by the electronic device.
  • Another embodiment provides a method for facilitating environmental monitoring. This method may include at least some of the aforementioned operations performed by the electronic device.
  • FIG. 1 is a block diagram illustrating electronic devices communicating in accordance with an embodiment of the present disclosure.
  • FIG. 2 is a flow diagram illustrating a method for facilitating environmental monitoring in FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 3 is a drawing illustrating communication among at least some of the electronic devices of FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 4 is a drawing illustrating a user interface in an electronic device in FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 5 is a drawing illustrating an electronic device in FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 6 is a drawing illustrating a top view of an electronic device in FIG. 5 in accordance with an embodiment of the present disclosure.
  • FIG. 7 is a flow diagram illustrating a method for facilitating environmental monitoring in FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 8 is a drawing illustrating communication among at least some of the electronic devices of FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 9 is a flow diagram illustrating a method for facilitating environmental monitoring in FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 10 is a drawing illustrating communication among at least some of the electronic devices of FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 11 is a drawing illustrating association of at least some of the electronic devices of FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 12 is a flow diagram illustrating a method for facilitating environmental monitoring in FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 13 is a drawing illustrating communication among at least some of the electronic devices of FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 14 is a drawing illustrating requesting shared access to content between at least some of the electronic devices of FIG. 1 in accordance with an embodiment of the present disclosure.
  • FIG. 15 is a block diagram illustrating an electronic device in FIG. 1 in accordance with an embodiment of the present disclosure.
  • Table 1 provides pseudo-code for use with one of the electronic devices of FIG. 1 in accordance with an embodiment of the present disclosure.
  • Table 2 provides pseudo-code for use with one of the electronic devices of FIG. 1 in accordance with an embodiment of the present disclosure.
  • an electronic device executes a program module that sets an operating mode of the electronic device as a monitoring mode or a viewing mode.
  • the electronic device When the electronic device is in the monitoring mode, the electronic device at least selectively captures images and measures the acoustic information corresponding to sound in an environment, and then communicates the images and the acoustic information to a second electronic device.
  • the electronic device when the electronic device is in the viewing mode, the electronic device at least selectively receives visual information and additional acoustic information from the second electronic device, presents the visual information on a display, and outputs additional sound corresponding to the additional acoustic information using an acoustic transducer.
  • the electronic device may be a previous or an older model and/or may execute a previous version of an operating system because of limited system resources (such as battery life).
  • at least some functions of the electronic device may be disabled.
  • the program module may allow the electronic device (which is sometimes referred to as a 'legacy electronic device') to be used to monitor an environment or to view a monitored environment.
  • the program module may allow the capabilities of the electronic device to be used, even when the electronic device is no longer considered suitable for its original task, such as a cellular telephone. Consequently, this environmental monitoring technique may allow users to avoid waste and the opportunity cost of unused legacy electronic devices, which may increase user satisfaction.
  • Communication between electronic devices may utilize wired, optical and/or wireless communication.
  • the wireless communication may involve communicating packets or frames that are transmitted and received by radios in the electronic devices in accordance with a communication protocol, such as: Bluetooth ® (from the Bluetooth Special Interest Group of Kirkland, Washington), an Institute of
  • IEEE 802.15 such as ZigBee ® from the ZigBee ® Alliance of San Ramon, California
  • IEEE 802.11 Standard for Mobile Communications
  • Z-Wave a power-line communication standard
  • an infrared communication standard a universal serial bus (USB) communication standard
  • USB universal serial bus
  • the communication protocol may be compatible with a 2 nd generation or mobile telecommunication technology, a 3 generation of mobile
  • telecommunications technology such as a communication protocol that complies with the International Mobile Telecommunications-2000 specifications by the International
  • the communication protocol may include Long Term Evolution or LTE.
  • the communication may occur via a wide variety of frequency bands, including frequencies associated with the so-called 'white space' in frequencies bands associated with analog television broadcasting.
  • FIG. 1 presents a block diagram illustrating communication among optional base station 108, monitoring electronic devices 110, viewing electronic devices 112, optional access point 114, one or more optional storage electronic devices (such as optional storage electronic device 116), and/or one or more controller electronic devices (such as controller electronic device 118) via network 120 (such as a cellular-telephone network, the Internet, a wireless local area network, an Ethernet network, an intra-net, an optical network, etc.).
  • network 120 such as a cellular-telephone network, the Internet, a wireless local area network, an Ethernet network, an intra-net, an optical network, etc.
  • the communication in FIG. 1 may involve the exchange of packets. These packets may be included in frames in one or more channels.
  • monitoring electronic devices 110, viewing electronic devices 112, optional access point 114, optional storage electronic device 116, and/or controller electronic device 118 may include subsystems, such as: a networking subsystem, a memory subsystem, a processing subsystem, an optional user-interface subsystem, and an optional sensor subsystem. In addition, these electronic devices may include radios 122 in the networking subsystems. More generally, monitoring electronic devices 110, viewing electronic devices 112, optional access point 114, optional storage electronic device 116, and/or controller electronic device 118 can include (or can be included within) any electronic devices with networking subsystems that enable wirelessly or wired communication with another electronic device.
  • This can comprise transmitting frames on wireless channels to enable the electronic devices to make initial contact, followed by exchanging subsequent data/management frames (such as connect requests or petitions to establish a connection or link), configuring security options ⁇ e.g., encryption on a link or in a mesh network), transmitting and receiving packets or frames, etc.
  • data/management frames such as connect requests or petitions to establish a connection or link
  • security options e.g., encryption on a link or in a mesh network
  • wireless signals 124 are transmitted from/received by radios (such as radios 122) in optional base station 108, monitoring electronic devices 110, viewing electronic devices 112 and/or optional access point 114 (which may allow monitoring electronic device 110-2 and/or viewing electronic device 112-3 to wirelessly access network 120 via a wireless local area network).
  • radios such as radios 122
  • wireless communication among these electronic devices may or may not involve a
  • connection being established among the electronic devices may or may not involve communication via a wireless network.
  • the communication with optional storage electronic device 116, and/or controller electronic device 118 may occur via network 120, which may involve wired or optical communication with a different communication protocol than wireless signals 124.
  • the processing of a packet or frame in an electronic device may include: receiving wireless signals 124 with the packet or frame; decoding/extracting the packet or frame from received wireless signals 124 to acquire the packet or frame; and processing the packet or frame to determine information contained in the packet or frame (such as at least a portion of a data packet).
  • monitoring electronic devices 110 and viewing electronic devices 112 may be arranged into at least pairs.
  • one of viewing electronic devices 112 (such as viewing electronic device 112- 1) may be paired with or associated with one or more of monitoring electronic devices 110 (such as monitoring electronic device 110-1).
  • a given user may own or may be associated with a given pairing.
  • monitoring electronic devices 110 and viewing electronic devices 112 may execute instances of a program module. This program module may allow monitoring electronic devices 110 and viewing electronic devices 112 to be operated in a monitoring mode or a viewing mode.
  • an electronic device executing an instance of the program module When an electronic device executing an instance of the program module is operated in the monitoring mode, it is referred to as a 'monitoring electronic device' (such as one of monitoring electronic devices 110). Similarly, when an electronic device executing an instance of the program module is operated in the viewing mode, it is referred to as a 'viewing electronic device' (such as one of viewing electronic devices 112).
  • a user may select the monitoring mode or the viewing mode for a given electronic device (e.g., using a user interface, as described further below with reference to FIG. 4). Alternatively, the given electronic device may select the monitoring mode or the viewing mode based on its location (such as whether it is at the same location for an extended time interval, e.g., several hours, one or more days, etc.).
  • monitoring electronic devices 110 may monitor an environment that includes monitoring electronic device 110-1 or that is proximate to the environment that includes monitoring electronic device 1 10-1 (which is sometimes referred to as an 'external environment').
  • monitoring electronic device 1 10-1 may monitor the environment within a building (such as a region, a room, etc.), an object (such as a car, a truck, a container, a package, etc.), etc.
  • monitoring electronic device 1 10-1 may monitor the external environment outside of the building (such as a region adjacent to the building, the outside of the building, etc.), the object, etc.
  • monitoring electronic device 1 10-1 may include at least two imaging sensors (such as two cameras), one of which monitors an interior of an environment (such as a room in a house) and the other monitors a region outside of the environment (such as a region outside of a house).
  • at least the two imaging sensors may have different fields of view.
  • monitoring electronic devices 1 10 may include sensors that at least selectively capture images and/or measure acoustic information corresponding to sound that characterize events (and, more generally, conditions, such as environmental conditions, e.g., temperature, humidity, air quality, etc.).
  • an acoustic sensor in monitoring electronic device 1 10-1 may detect an acoustic event, such as: insertion of a key into a lock, a sound exceeding a threshold level (e.g., 60-80 dB), a type of sound (e.g., a fire alarm, breaking glass, a moving car, yelling or shouting, cursing, a cry for help, a gunshot, etc.) and/or activation of acoustic sources in the environment having a predefined or a predetermined phase relationship (e.g., smoke and/or carbon-monoxide detectors at different locations in a building, which have different acoustic latencies to a location of monitoring electronic device 1 10-1.
  • a threshold level e.g. 60-80 dB
  • a type of sound e.g., a fire alarm, breaking glass, a moving car, yelling or shouting, cursing, a cry for help, a gunshot, etc.
  • monitoring electronic device 1 10-1 may capture the images and measure the acoustic information corresponding to or that represents sound. (although images and/or acoustic information are used as illustrations of the type of information selectively captured or measured by monitoring electronic devices 1 10, in some embodiments additional types of measures are performed by at least some of monitoring electronic devices 1 10 when these monitoring electronic devices include additional sensors.)
  • monitoring electronic device 1 10-1 may detect motion in the environment and/or the external environment (e.g., using a motion detector and/or by comparing images acquired at different times using an imaging sensor), and in response monitoring electronic device 1 10-1 may capture additional images and/or may measure the acoustic information.
  • an occurrence of an event is determined based on a history of events for an environment and/or the external environment, such as by comparing the measured acoustic information with a history of acoustic events and/or by comparing a captured image (or difference of two images) with historical motion events to determine if something anomalous or usual is occurring.
  • monitoring electronic device 110-1 may at least selectively capture the images and measure the acoustic information based on an alert about an occurrence of an event in the environment that is received from a governmental organization.
  • a municipality such as a city government
  • a police department may provide the alert in response to a burglary or criminal activity nearby, and in response monitoring electronic device 110-1 may captures images and/or acoustic information. This content may be subsequently shared or provided to the governmental organization.
  • a rotatable base may change an angular orientation during the selective capture of the images and measurement of the acoustic information.
  • monitoring electronic device 110-1 may analyze the measured acoustic information from multiple microphones (or acoustic transducers) to determine a location of a source or to track movement of the source, and then, via the rotatable base, may change the angular orientation so that the imaging sensor faces the source or keeps the source centered in a field of view of the imaging sensor (which may involve dynamically rotating the rotatable base to follow the motion of the source).
  • a voice or sound recognition technique may be used to identify a particular source (such as a person) in a crowded acoustic environment and, then, monitoring electronic device 110-1 may be rotated to follow this source as it moves in the environment.
  • monitoring electronic device 110-1 may compute analysis results based on the captured images and/or the measured acoustic information.
  • the analysis results may indicate safety conditions, activities, environmental conditions and, more generally, events in the
  • an alarm such as a smoke detector, a carbon- monoxide detector, a dual smoke detector and carbon-monoxide detector, a car alarm, a burglar alarm and/or another alarm
  • fire flooding, carbon monoxide, a power outage, a chemical contaminant, an infestation, opening of a door, an individual entering or leaving a room, an individual getting out of bed, an individual waking up, an individual crying, an individual tossing and turning in bed, an individual shivering, a change in health condition of an individual (such as an illness, a chronic disease, etc.), a crime in progress, unusual activity or other irregular occurrences (such as a unusual vehicle driving down the street), delivery of the mail or a package, etc.
  • an alarm such as a smoke detector, a carbon- monoxide detector, a dual smoke detector and carbon-monoxide detector, a car alarm, a burglar alarm and/or another alarm
  • flooding carbon monoxide
  • a power outage such as a smoke detector, a power outage
  • monitoring electronic device 110-1 detects an audible acoustic alert or alarm based on sound intensity, time-domain information and/or or frequency-domain information in temporal audio samples of the sound received by a microphone.
  • the sound may include a temporal 3 acoustic pattern, with a beep, pause and an alarm pattern or signal, which is compatible with an American National Standards Institute standard S3.42 1990.
  • monitoring electronic device 110-1 may be calibrated to: confirm that the alarm can be heard or detected by monitoring electronic device 110-1, identify the alarm device (such as a smoke detector), determine the location of the alarm device, and/or determine an acoustic characteristic of the environment (e.g., based on sound output by monitoring electronic device 110-1 and/or from another acoustic source). This calibration may occur when: monitoring electronic device 110-1 is first installed or used, after a time interval (such as every 3 or 6 months) and/or when the environment is changed (such as when one or more objects in the environment are moved, when monitoring electronic device 110-1 is moved, etc.).
  • a time interval such as every 3 or 6 months
  • the acoustic characteristic may include: a location of the alarm device (such as a location of the alarm device relative to monitoring electronic device 110-1); a detection threshold for monitoring electronic device 110-1 at its current location to use when determining if the alarm device is activated; and/or an acoustic transfer function (such as an amplitude and/or phase as a function of frequency) or an acoustic profile (such as an acoustic latency or a delay of an echo) of the environment proximate to the alarm device and monitoring electronic device 110-1.
  • a location of the alarm device such as a location of the alarm device relative to monitoring electronic device 110-1
  • a detection threshold for monitoring electronic device 110-1 at its current location to use when determining if the alarm device is activated and/or an acoustic transfer function (such as an amplitude and/or phase as a function of frequency) or an acoustic profile (such as an acoustic latency or a delay of an echo) of the environment proximate
  • the location of the alarm device may be specified by or determined from: an image of the environment, a positioning system (such as the Global Positioning System or GPS), a communication network (such as a cellular-telephone network), and/or an acoustic latency in the environment.
  • a positioning system such as the Global Positioning System or GPS
  • a communication network such as a cellular-telephone network
  • an acoustic latency in the environment In some embodiments, the location is determined by trilateration, tri angulation, and/or the acoustic characteristic of the environment.
  • the location may be determined using multiple microphones.
  • the location may be absolute or relative (such as a position in the environment relative to monitoring electronic device 110-
  • monitoring electronic device 110-1 may share this content (as well as analysis results) with one or more of the other electronic devices in FIG. 1.
  • monitoring electronic device 110-1 may provide the content or an alert or notification indicating that such content is available to at least viewing electronic device 112-1 (i.e., one or more other electronic devices with which monitoring electronic device 110-1 is paired).
  • monitoring electronic device 110-1 and at least viewing electronic device 112-1 have or establish a peer-to-peer connection, which allows them to communicate via peer-to-peer communication.
  • the peer-to-peer connection may allow one-to-one or one-to-many communication (such as with a group of paired or associated electronic devices).
  • viewing electronic device 112-1 may access and then may display at least some of the images and/or may output the sound, thereby allowing a user to remotely monitor the event(s) in the environment and/or the external environment.
  • viewing electronic device 112-1 may present the alert to the user, which may allow the user to decide whether to selectively access the content.
  • the alert may be presented to the user in a user interface.
  • This user interface may include or specify a notification about the environmental and/or the external environment, such as an alarm sounding, and may include one or more icons that allow the individual to: listen to an audio recording of the measured sounds associated with an event, contact emergency services, and/or indicate that the event is a false positive.
  • monitoring electronic device 110-1 may share the content and/or the alert with one or more additional viewing electronic devices in viewing electronic device 112 that are paired or associated with monitoring electronic device 110-1, and that are used by other users.
  • the other users may include: an emergency contact specified by a user or an owner of viewing electronic device 112-1; users that the user or the owner of viewing electronic device 112-1 has allowed to access the content and/or the alert; representatives of an insurance company (who may provide a discount on the user's homeowner's insurance in exchange for the monitoring); and/or an owner of a building that includes the environment.
  • monitoring electronic device 110-1 provides the content and/or the alert to optional storage electronic device 116, where it may be subsequently accessed by viewing electronic device 112-1 and/or the one or more additional viewing electronic devices.
  • optional storage electronic device 116 stores the content in a secure, certified historical record or log of the conditions of the environment and/or the external environment (such as a time record of the safety conditions, the activities, the environmental conditions and, more generally, the events). Note that optional storage electronic device 116 may analyze the content, and thus may store and provide analysis results to viewing electronic device 112-1 and/or the one or more additional viewing electronic devices.
  • monitoring electronic device 110-1 may restrict the type of content that is shared with the one or more additional viewing electronic devices. For example, monitoring electronic device 110-1 may only share content (such as images and/or acoustic information) for the external environment with the one or more additional viewing electronic devices.
  • monitoring electronic device 110-1 may include an orientation sensor that allows monitoring electronic device 110-1 to determine an orientation of monitoring electronic device 110-1, so that monitoring electronic device 110-1 can identify and only share images of the external environment with the one or more additional viewing electronic devices, thereby enabling collective monitoring (such as a virtual 'neighborhood watch') of a street or an outside region by multiple users, while protecting the privacy of the users.
  • the content provided by monitoring electronic device 110-1 and/or optional storage electronic device 116 may be protected. This may involve encryption using an encryption key (such as an encryption key associated with monitoring electronic device 110-1).
  • the encryption key may use symmetric or asymmetric encryption techniques.
  • a secure or one-way cryptographic hash function such as SHA- 256 may be used.
  • associations are established between at least pairs of monitoring electronic devices 110 and viewing electronic devices 112, credentials used to access content, encryption keys and/or information specifying cryptographic hash functions may be exchanged to facilitate controlled and secure sharing of the content.
  • monitoring electronic devices 110 and viewing electronic devices 112 are cellular telephones. At least monitoring electronic devices 110 may be one or more Older' models (i.e., legacy electronic devices). In particular, monitoring electronic devices 110 and/or viewing electronic devices 112 may execute one or more older or previous versions of operating systems that current or latest versions of the one or more operating systems. This may be the case because a current or latest version of an operating system may exceed the hardware capabilities of monitoring electronic devices 110 and/or viewing electronic devices 112.
  • an operating life of a power source (such as a battery) may be less than a predefined value (such as several hours); an execution speed of a program module may be less than a second predefined value (e.g., there may be delays of 0.5-10 s that are noticeable to the user or that may prevent events from being captured); an amount of the memory available to the program module may be less than a third predefined value (such as the minimum of amount of memory needed to execute the program module); and/or an amount of non-volatile storage available to the program module may be less than a fourth predefined value (such as the minimum of amount of non-volatile storage to store the content).
  • a predefined value such as several hours
  • an execution speed of a program module may be less than a second predefined value (e.g., there may be delays of 0.5-10 s that are noticeable to the user or that may prevent events from being captured)
  • an amount of the memory available to the program module may be less than a third predefined value (such as the minimum of amount of memory
  • the program module may include features that allow monitoring electronic devices 110 and/or viewing electronic devices 112 to be repurposed to perform the preceding operations. For example, in the monitoring mode, the program module may disable one or more features of monitoring electronic devices 110 to conserve system resources, such as processor speed, memory, battery life, etc. Alternatively or additionally, monitoring electronic devices 110 may adjust an exposure time of one or more imaging sensors based on one of: a time of day, ambient lighting conditions and a quality metric for the images (such as signal-to-noise ratio).
  • the program module may ensure that monitoring electronic device 110- 1 remains in the monitoring mode and does not transitions to a power-saving mode when monitoring electronic device 110-1 is inactive. For example, the program mode may disable a timer in monitoring electronic device 110-1 that is used to transition monitoring electronic device 110-1 to the power-saving mode.
  • the program module may selectively provide an activity signal that keeps monitoring electronic device 1 10-1 remains in the monitoring mode and does not transitions to a power-saving mode when monitoring electronic device 1 10-1 is inactive. This capability may ensure that monitoring electronic device 1 10-1 continues to monitor the environment and/or the external environment.
  • the program module may selectively allow, based on a configuration setting, monitoring electronic device 1 10-1 to transition to the power-saving mode when monitoring electronic device 1 10-1 is inactive and to transition back to the monitoring mode when the acoustic event occurs.
  • the program module may receive a proof-of-life request from another electronic device (such as one of viewing electronic devices 1 12) and may provide a response to the proof-of-life request.
  • the response may indicate that monitoring electronic device 1 10-1 remains in the monitoring mode and has power.
  • an insurance carrier that provides insurance coverage for the environment or one or more objects in the environment
  • monitoring electronic devices 1 10 may be associated or paired with additional viewing electronic devices.
  • users may register their monitoring electronic devices and viewing electronic devices with one or more controller electronic devices, such as controller electronic device 1 18.
  • controller electronic device 1 18 For example, the registration may occur when a user installs the program module on an electronic device.
  • the user may define a minimal pairing or association, such as a designated monitoring electronic device and its associated viewing electronic device (e.g., monitoring electronic device 1 10-1 and viewing electronic device 1 12-1).
  • credentials, encryption keys and/or secure hash functions may be specified and/or exchanged between monitoring electronic device 1 10-1 and viewing electronic device 1 12-1 when the pairing or association is defined, and the credentials, the encryption keys and/or the secure hash functions may be specified or provided to controller electronic device 1 18.
  • controller electronic device 1 18 may specify or provide the credentials, the encryption keys and/or the secure hash functions to monitoring electronic device 1 10-1 and viewing electronic device 1 12-1.
  • controller electronic device 118 generates the encryption keys for monitoring electronic device 110-1 and viewing electronic device 112-1.
  • controller electronic device 118 may keep track of the locations of monitoring electronic devices 110 as a function of time.
  • monitoring electronic device 110-1 may provide to controller electronic device 118 messages with times stamps and information that specifies the location of monitoring electronic device 110-1 (such as a GPS information or coordinates, cellular-telephone information, wireless-network information, etc.). These messages may be provided by monitoring electronic device 110-1 periodically, after a time interval at a fixed location and/or in response to a request from controller electronic device 118.
  • controller electronic device 118 may associate viewing electronic device 112-1 with one or more additional monitoring electronic devices that are proximate to monitoring electronic device 110-1 (including providing or specifying credentials, encryption keys and/or secure hash functions).
  • This may allow a user of viewing electronic device 112-1 to selectively access content acquired by the one or more additional monitoring electronic devices, such as images and/or acoustic information corresponding to sound in at least external environments that are proximate to the one or more additional monitoring electronic devices (and, if allowed during registration by users of the one or more additional monitoring electronic devices, images and/or acoustic information corresponding to sound in environments that include the one or more additional monitoring electronic devices).
  • the spatial extent of the associations may increase the longer monitoring electronic device 110-1 is at the fixed location.
  • controller electronic device 118 may associate monitoring electronic device 110-1 with one or more additional viewing electronic devices that are already associated or paired with the one or more additional monitoring electronic devices, so that users of the one or more additional viewing electronic devices can selectively access content acquired by monitoring electronic device 1 10-1.
  • controller electronic device 1 18 may discontinue the associations with the one or more additional monitoring electronic devices.
  • This association technique may allow networks of electronic devices to be securely and dynamically assembled even when monitoring electronic device 1 10-1 and/or viewing electronic device 1 12-1 are outside of communication range (such as wireless communication range) with the one or more additional monitoring electronic devices.
  • networks of electronic devices may be securely and dynamically assembled based on the pattern of locations of viewing electronic device 1 12-1 as a function of time.
  • viewing electronic device 1 12-1 may receive messages from another electronic device that executes an instance of the program module, such as one of monitoring electronic devices 1 10 (e.g., monitoring electronic device 1 10-2) or one of viewing electronic devices 1 12. These messages may advertise availability of content for an environment at a location associated with monitoring electronic device 1 10-2.
  • viewing electronic device 1 12-1 determines whether to request shared access to the content based on the location and locations of one or more of monitoring electronic devices 1 10 executing additional instances of the program module in a monitoring mode for which viewing electronic device 1 12-1 already has shared access. For example, the location may be different from the locations. Moreover, viewing electronic device 1 12-1 may determine whether to request shared access to the content based on a history of locations of viewing electronic device 1 12-1, which may indicate that viewing electronic device 1 12-1 was proximate to the location for more than: a predefined number of occasions (such as at least 2-10 times); and/or a predefined time duration (such as at least 5-60 min).
  • a predefined number of occasions such as at least 2-10 times
  • a predefined time duration such as at least 5-60 min.
  • viewing electronic device 1 12-1 may provide a request for shared access to monitoring electronic device 1 10-2 based on the determination. Furthermore, viewing electronic device 1 12-1 may receive an acceptance message from monitoring electronic device 1 10-2 in response to the request, and viewing electronic device 1 12-1 may selectively accesses the content based on the acceptance message. [093] Similarly, once paired or associated, monitoring electronic device 110-1 (or another monitoring electronic device previously paired or associated with viewing electronic device 112-1) may share access to content it acquires with viewing electronic device 112-2.
  • viewing electronic device 112-1 may pair or associate with monitoring electronic device 110-2 based on regular proximity to the location of monitoring electronic device 110-2 (or, alternatively or additionally, of viewing electronic device 112-2). In particular, as the user moves around with viewing electronic device 112-1, their information network may be dynamically increased.
  • monitoring electronic devices 110, viewing electronic devices 112, optional storage electronic device 116, and/or controller electronic device 118 may be used to: implement an information network that monitors the environments and/or the external environments; and/or aggregate and selectively disseminate content about events in the environments and/or the external environments.
  • FIG. 1 Although we describe the environment shown in FIG. 1 as an example, in alternative embodiments, different numbers or types of electronic devices may be present. For example, some embodiments comprise more or fewer electronic devices.
  • FIG. 2 presents a flow diagram illustrating a method 200 for facilitating environmental monitoring, which may be performed by an electronic device (such as one of monitoring electronic devices 110 or one of viewing electronic devices 112 in FIG. 1).
  • the electronic device sets an operating mode (operation 210) of the electronic device as a monitoring mode or a viewing mode.
  • the electronic device may execute a version of an operating system that is other than or different from a subsequent version of the operating system (i.e., an older version of the operating system).
  • the electronic device may be an older model and hardware limitations (such as an operating life of a power source, an execution speed of a program module, available memory when executing the subsequent version of the operating system, an amount of non-volatile storage available to the program module when executing the subsequent version of the operating system, etc.) may restrict its ability to execute the subsequent or newer version of the operating system.
  • hardware limitations such as an operating life of a power source, an execution speed of a program module, available memory when executing the subsequent version of the operating system, an amount of non-volatile storage available to the program module when executing the subsequent version of the operating system, etc.
  • the electronic device When the electronic device is in the monitoring mode (operation 212), the electronic device at least selectively captures images and measures acoustic information (operation 214) corresponding to sound of an environment that includes the electronic device, and communicates the images and the acoustic information (operation 216) to a second electronic device (such as a paired or associated viewing electronic device or a storage electronic device).
  • a second electronic device such as a paired or associated viewing electronic device or a storage electronic device.
  • the images may be captured and the acoustic information may be measured based on the occurrence of an event, such as an acoustic event.
  • the acoustic event may include: insertion of a key into a lock; a sound exceeding a threshold level; a type of sound; and/or activation of acoustic sources in the environment having a predetermined phase relationship (such as a latency of sound associated with the acoustic sources).
  • the electronic device may determine whether to capture the images and to measure the acoustic information based on the occurrence of the acoustic event and a history of acoustic events in the environment (e.g., by comparing the acoustic event with the history of acoustic events to determine if it is anomalous).
  • the electronic device may detect motion in the environment, and the selective capturing of the images and measuring the acoustic information may be based on the detection of motion and a history of motion events in the environment (which may be used to determine if the detected motion is anomalous or unusual). For example, the electronic device may routinely capture images (such as every 10 s), and may detect motion based on differences between captured images. Then, when motion is detected, the electronic device may capture images more often (such as at a frame rate of an imaging sensor).
  • the electronic device may use histories of events at one or more locations (i.e., from one or more monitoring electronic devices) when determining whether a particular event is anomalous or unusual (and, thus, worth of being presented to a user on an associated or paired viewing electronic device).
  • the at least selectively capturing the images and measuring the acoustic information, and communicating the images and the acoustic information to the second electronic device may be based on an alert about an occurrence of an event in the environment (such as possible criminal activity, a natural disaster, an emergency, etc.) that is received from a governmental organization (such as a police department, a fire department, local government, e.g., a municipality, etc.) or an insurance carrier.
  • a governmental organization such as a police department, a fire department, local government, e.g., a municipality, etc.
  • an insurance carrier such as a police department, a fire department, local government, e.g., a municipality, etc.
  • the electronic device may perform one or more optional operations (operation 218).
  • the electronic device may receive a proof-of-life request from the second electronic device, and may provide a response to the proof-of-life request. This response may indicate that the electronic device remains in the monitoring mode and has power.
  • the electronic device may disable one or more other functions of the electronic device. For example, functions other than those needed to perform the monitoring and to
  • communicate the content may be disabled.
  • the electronic device when the electronic device is in the monitoring mode, the electronic device adjusts an exposure time of the imaging sensor based on: a time of day, ambient lighting conditions and/or a quality metric for the images. For example, the exposure time may be increased at times of day when there is less light, when the ambient lighting is below a threshold value (such as an illumination of less than 10-100 lux or lumens/m 2 ), and/or when a signal-to-noise ratio in the images is less than a second threshold value (such as 20-30 dB).
  • a threshold value such as an illumination of less than 10-100 lux or lumens/m 2
  • a second threshold value such as 20-30 dB
  • the electronic device when the electronic device is in the viewing mode (operation 212), the electronic device at least selectively receives visual information (such as images, text, graphics, etc.) and additional acoustic information (operation 220) from the second electronic device, presents the visual information (operation 222) on the display, and outputs additional sound (operation 222) corresponding to the additional acoustic information using the acoustic transducer. Furthermore, when the electronic device is in the viewing mode, the electronic device may perform one or more optional operations (operation 224). For example, the electronic device may establish a peer-to-peer connection with the second electronic device.
  • visual information such as images, text, graphics, etc.
  • additional acoustic information operation 220
  • additional acoustic information operation 220
  • the electronic device may perform one or more optional operations (operation 224). For example, the electronic device may establish a peer-to-peer connection with the second electronic device.
  • the second electronic device includes cloud-based storage for a third electronic device that monitors another environment (such as a data repository for the other environment that maintains a record of all events that occur in the other environment).
  • a third electronic device that monitors another environment (such as a data repository for the other environment that maintains a record of all events that occur in the other environment).
  • the electronic device may selectively access the visual information and the additional audio information from the cloud- based storage.
  • the electronic device when the electronic device is in the monitoring mode, it may provide the images and the acoustic information to the cloud-based storage, where it is subsequently selectively accessed by the third electronic device.
  • the electronic device may selectively access content (such as images and/or audio information) for an environment based on events that occur in or proximate to the environment, in some embodiments the selective access is based on a location of the environment. For example, the electronic device may selectively access the content based on interests of a user. These interests may be predefined by the user (such as in a user profile) and/or may be based on user behaviors (such as web pages or websites visited by the user, search queries provided by the user, products purchased by the user, etc.). In some embodiments, the electronic device selectively access the content for the user (i.e., without an explicit request from the user).
  • content such as images and/or audio information
  • the selective access is based on a location of the environment.
  • the electronic device may selectively access the content based on interests of a user. These interests may be predefined by the user (such as in a user profile) and/or may be based on user behaviors (such as web pages or websites visited by the user, search queries provided by the
  • the electronic device may selectively access content from monitoring electronic devices at or proximate to the location.
  • the user can access live streams via a network (such as the Internet), such as a web camera for Lake Tahoe or a volcano.
  • a network such as the Internet
  • Such web-camera access may be used as marketing lead information for travel services that market travel and lodging to or near a location that the user views repeatedly.
  • FIG. 3 presents a drawing illustrating communication between monitoring electronic device 110-1 and viewing electronic device 112-1.
  • processor 310 executing an instance of a program module in viewing electronic device 112-1 may display user interface 316 on display 318 based on user-interface information 314, which is accessed in memory 312.
  • processor 310 may receive a user-interface selection 320 (such as when the user clicks on or touches an icon in user interface 316) to select a particular operating mode of viewing electronic device 112-1 (i.e., the viewing mode).
  • processor 322 executing another instance of the program module in monitoring electronic device 110-1 may display user interface 328 on display 330 based on user-interface information 324, which is accessed in memory 326. Furthermore, processor 322 may receive a user-interface selection 332 (such as when the user clicks on or touches an icon in user interface 328) to select a particular operating mode of monitoring electronic device 110-1 (i.e., the monitoring mode). In some embodiments, either or both the operating modes are predefined, e.g., based on settings stored in memories 312 and 326. [0109] Subsequently, sensor(s) 334 in monitoring electronic device 110-1 may capture content 336 (such as one or more images and/or audio information corresponding to sound).
  • content 336 such as one or more images and/or audio information corresponding to sound.
  • content 336 may be captured when an event occurs, such as a loud sound or motion is detected. Alternatively or additionally, content 336 may be captured based on an alert or a notification received from a third party, such as an insurance carrier or a governmental organization.
  • Sensor(s) 334 may provide content 336 to processor 322, which provides it to interface circuit 338. Then, interface circuit 338 may communicate content 336 to interface circuit 340, which provides it to processor 322.
  • processor 310 may present content 336 on display 310 and/or speakers (not shown).
  • the environmental monitoring technique may allow electronic devices (including legacy electronic devices) to be dynamically repurposed for use in monitoring the environment and/or presenting images and/or audio information to users. Consequently, the improved functionality and services facilitated by the environmental monitoring technique may increase the use of the electronic devices (and, more generally, commercial activity) and may enhance customer satisfaction with the electronic device.
  • paired or associated electronic devices such as a monitoring electronic device and a viewing electronic device
  • FIG. 4 presents a drawing illustrating a user interface 400 in an electronic device in FIG. 1 (such as a user's cellular telephone).
  • user interface 400 may be presented on a touch-sensitive display and may include virtual command icons 410 that correspond to the monitoring mode and the viewing mode.
  • virtual command icons 410 that correspond to the monitoring mode and the viewing mode.
  • user interface 400 may be generated by a program module executing on the electronic device based on user-interface information.
  • the electronic device includes a rotatable base.
  • FIG. 5 presents a drawing illustrating electronic device 500 (such as one of the electronic devices in FIG. 1).
  • rotatable base 510 may change an angular orientation 512 of electronic device 500 in the environment.
  • rotatable base 510 may rotate electronic device 500 about an axis 514 so that electronic device 500 tracks sound or a moving object in the environment.
  • sensor(s) such as an imaging sensor, in electronic device 500 may keep an object of interest centered in its field of view.
  • a rotatable base 510 may rotate electronic device 500 about an axis 514 so that the electronic device 500 sweeps an area in response to a sound or detected motion (e.g., if the sound or motion is complicated or difficult to track, the rotatable base 510 can perform one or more sweeps with the field of view of a sensor, such as an imaging sensor in the electronic device 500, in order to have a better chance of capturing video of the source of the sound).
  • the sweep can be left and right, up or down, or any other suitable combination, can vary from -90 0 to +90°, and/or can be performed multiple times in response to a triggering event (such as motion or a sound above a threshold).
  • the electronic device may include multiple imaging sensors with different fields of view, such as on opposite sides of the electronic device.
  • FIG. 6 presents a drawing illustrating a top view of electronic device 500 (such as one of the electronic devices in FIG. 1) with imaging sensors 610. While selectively capturing the images, electronic device 500 may switch between imaging sensor 610-1 and imaging sensor 610-2 based on motion in the environment and the measured acoustic information. In this way, electronic device 500 may track an object of interest in the environment so one of imaging sensors 610 has the object in its field of view at a particular time.
  • electronic device 500 includes an orientation sensor 612 (such as a compass, an accelerometer, etc.) that, during operation, determines an orientation of electronic device 500.
  • imaging sensor 610-1 may face an interior of a building or a room, while imaging sensor 610-2 may face an external environment (such as the exterior of the building or room). Note that images acquired using imaging sensor 610-1 may include sensitive or personal information about a user.
  • electronic device 500 may use the determined orientation to identify images acquired or captured using imaging sensor 610-2, and may provide authorization to at least selectively access these images to one or more additional electronic devices, such as an electronic device executing an instance of the program module in the viewing mode.
  • the authorization may include credentials and/or an encryption key that facilitates the selective access.
  • the authorization is provided to one or more additional electronic devices that are paired or associated with electronic device 500.
  • the images captured by imaging sensor 610-2 are considered public and, therefore, may be shared with one or more additional electronic devices that are not associated or paired with electronic device 500.
  • the user may be willing to share images acquired using imaging sensor 610-2 with arbitrary users (such as their neighbors), but may not be willing to share images acquired using imaging sensor 610-1 with these users. (In some embodiments the user is willing to share video acquired using imaging sensor 610-2, but is only willing to share still images acquired using imaging sensor 610-1.)
  • a virtual 'neighborhood watch' may be assembled to allow activities on a street or in a neighborhood to be monitored. For example, by combining the acquired content with the locations of monitoring electronic devices (such as GPS
  • the program module is an application that can be used to retrofit an older cellular telephone and convert it into a security device that records video, detects loud noises, detects smoke-detector and carbon-monoxide alarms using the microphones, etc.
  • a user may use the application on their current cellular telephone in the viewing mode, and may use the application on their older cellular telephone in the monitoring mode (i.e., as a surveillance telephone).
  • updates to the older cellular telephone may no longer be supported by the manufacturer. Therefore, the older cellular telephone may be at end of life or at the end of a support contract, and this may not be able to upgrade to the latest version of the operating system. While such as older cellular telephone may not have the latest features or capabilities, it may retain limited functionality that can be harnessed or used by the application.
  • the user may select the monitoring mode and the various monitoring techniques (such as acoustic monitoring, video, etc.) on the older cellular telephone, and may specify communication to a cloud-based storage device and/or the user's current cellular telephone. Then, the user may mount the older cellular telephone in a window (such as using two-sided tape, a suction-cup mount, a magnetic mount, etc.). One camera in the older cellular telephone may face out towards the street and another camera in the older cellular telephone may face inside of the home. Images acquired using the outward facing camera may be shared with the public or a subset of all users (e.g., the other houses in the neighborhood). However, if a camera is facing inside of the house, the garage, or the backyard, a user may choose not to share those images with the public.
  • a window such as using two-sided tape, a suction-cup mount, a magnetic mount, etc.
  • the direction that a camera is facing can be determined using a compass.
  • the location of the older cellular telephone may be determined using GPS and/or a local positioning system (such as a positioning system associated with a wireless local area network).
  • the location and the direction of a camera can be used specify a portion of a 'live street view' or a 'live neighborhood watch.
  • other users can use the location and the direction to identify content that augments or fills in holes in their 'map' of the neighborhood, and thus can be used to determine associations or pairings that would be beneficial to these users, so that they can request to associate or pair with these monitoring electronic devices.
  • the environmental monitoring is facilitated by: placing the older cellular telephone on a rotatable base; adding a fisheye (or wide-angle) lens over the built-in camera; and plugging the older cellular telephone into its charger.
  • the rotatable base may have a Bluetooth-controlled motor that allows the application and/or the user (e.g., remotely via their current cellular telephone) to pivot the older cellular telephone for additional viewing angles.
  • the rotatable based may facilitate a motion-detection sweep.
  • a motor in the rotatable base may swivel the older cellular telephone to scan or sweep the area one or more times using a spatial pattern (such as a 120° or 360° swivel), which may be specified or defined by the user.
  • This capability may also allow the user to manually control orientation of the older cellular telephone from a remote location via their current cellular telephone.
  • the monitoring electronic device may provide real-time feeds that can use machine vision to track: pets, weather, cars, pedestrians, routines of individuals in a neighborhood (such as when neighbors get home), mail or product delivery, when trash or recycling is picked up, etc.
  • the history of these events may be used to classify an event and/or to determine if the event is unusual. For example, cars that drive by without abnormal acoustic sound (such as screeching tires or a blaring radio) may be deemed
  • This capability may be used to filter the content, either locally (such as on the monitoring electronic device) and/or remotely (such as on the cloud-based storage system or the viewing electronic device).
  • the older cellular telephone may report power outages, Internet outages, etc.
  • the older cellular telephone may communicate with other Bluetooth devices (such as a whistle dog collar), so that user can be informed if their pet dog or cat has escaped the range of the older cellular telephone (a so-called 'dog is out' alert).
  • the content is stored on a cloud-based storage device, such as a server.
  • the content may be stored: on a per-event basis (which may allow users to pay for the storage service as they go), differentially (relative to previously stored content), during a time interval and/or continuously.
  • the content may be stored on the cloud-based storage device with user approval.
  • the content may be captured collaboratively (such as based on an alert from the police about possible criminal activity in a neighborhood) and/or the content may be reviewed collaboratively by a group of users that has shared access to the content to identify a subset of the content that is of interest.
  • the content may be communicated from a monitoring electronic device to a viewing electronic device using email, a Short Message Service, etc. This may allow the monitoring electronic device to send pictures or video summaries (e.g., low- framerate video, low-resolution video, animation, photographs, etc.) to the viewing electronic device.
  • pictures or video summaries e.g., low- framerate video, low-resolution video, animation, photographs, etc.
  • At least some of the content may be shared publically, such as with neighbors or with other interested parties. This may facilitate public views, such as of a beach, at a mountain, weather monitoring, etc. In this way, this subset of the content may be accessible and may be promoted in the application (e.g., conditions nearby, view all public monitoring electronic devices, etc.).
  • FIG. 7 presents a flow diagram illustrating a method 700 for facilitating environmental monitoring in FIG. 1, which may be performed by an electronic device (such as one of monitoring electronic devices 1 10 in FIG. 1).
  • the electronic device determines whether a power supply in the electronic device provides power from an external power source or an internal power source (such as a battery) (operation 710).
  • the electronic device remains in a monitoring mode (operation 712) without transitioning to a power-saving mode when the electronic device is inactive.
  • the electronic device In the monitoring mode, the electronic device at least selectively captures images and measures acoustic information corresponding to sound (operation 214) in an environment that includes the electronic device, and communicates the images and the acoustic information to a second electronic device (operation 216) (such as a paired or associated viewing electronic device or a storage electronic device).
  • a second electronic device such as a paired or associated viewing electronic device or a storage electronic device.
  • the electronic device may remain in the monitoring mode without transitioning to the power-saving mode by disabling a timer in the electronic device that is used to transition the electronic device to the power-saving mode.
  • the electronic device may remain in the monitoring mode without transitioning to the power- saving mode by providing an activity signal that keeps the electronic device in the monitoring mode without transitioning to the power-saving mode when the electronic device is inactive.
  • the electronic device selectively provides the activity signal
  • the activity signal may be provided periodically, after a time interval (such as 1-5 min) and/or as needed.
  • the electronic device may remain in the monitoring mode without transitioning to the power-saving mode by disabling the timer in the electronic device that is used to transition the electronic device to the power-saving mode.
  • the electronic device when the power supply provides power from the internal power source (operation 710), the electronic device may optionally perform one or more additional operations (operation 716). For example, the electronic device may selectively allow, based on a configuration setting, the electronic device to transition to the power-saving mode when the electronic device is inactive and to transition back to the monitoring mode when the acoustic event occurs. This capability may allow the electronic device to transition to the power-saving mode during a power outage to conserve the internal power source. In particular, the electronic device may transition to the power-saving mode for image capture, but may maintain acoustic monitoring in an active mode so that acoustic events can still be detected and used to gate transitioning image capture back to the active mode so that images can be selectively captured.
  • the electronic device may receive a proof-of-life request (operation 718) from the second electronic device and may provide a response (operation 720) to the proof-of-life request.
  • the response may indicate that the electronic device remains in the monitoring mode and has power.
  • FIG. 8 presents a drawing illustrating communication among monitoring electronic device 110-1 and viewing electronic device 112-1.
  • processor 322 executing an instance of a program module in monitoring mode may disable or restrict functions of monitoring electronic device 110-1.
  • power supply 810 may provide information 812 specifying this to processor 322.
  • processor 322 may disable 814 a timer 816 that is used to transition monitoring electronic device 110-1 to the power-saving mode when monitoring electronic device 110-1 is inactive.
  • power supply 810 may provide information 820 specifying this to processor 322.
  • processor 322 may one or more provide activity signals 822 that keep monitoring electronic device 110-1 in the monitoring mode without transitioning to the power-saving mode when monitoring electronic device 110-1 is inactive.
  • sensor(s) 334 in monitoring electronic device 110-1 may capture content 336 (such as one or more images and/or audio information corresponding to sound).
  • content 336 may be captured when an event occurs, such as a loud sound or motion is detected.
  • content 336 may be captured based on an alert or a notification received from a third party, such as an insurance carrier or a governmental organization.
  • Sensor(s) 334 may provide content 336 to processor 322, which provides it to interface circuit 338.
  • interface circuit 338 may communicate content 336 to interface circuit 340, which provides it to processor 310.
  • processor 310 may present content 336 on display 318 and/or speakers (not shown).
  • the environmental monitoring technique may allow electronic devices (including legacy electronic devices) to provide continuous monitoring of the environment without transitioning to the power-saving mode. This may allow users to find new uses for older models of electronic devices and to obtain credit (for example, from insurance carriers) for the monitoring. Consequently, the improved functionality and services facilitated by the environmental monitoring technique may increase the use of the electronic devices (and, more generally, commercial activity) and may enhance customer satisfaction with the electronic device.
  • an electronic device avoids transitioning to a power-saving mode even when the electronic device is inactive by disabling an idle timer and/or by providing activity signals (such as after a time interval, periodically, etc.).
  • This capability may prevent the electronic device from going to sleep when it is publishing content (i.e., it is a monitoring electronic device) or subscribing or accessing content (i.e., it is a viewing electronic device).
  • the disabling of the idle timer or the providing of the activity signals may be restricted to these operations, because otherwise the battery or the internal power source in the electronic device may be drained too quickly.
  • Table 1 presents pseudo-code for use with an electronic device that uses an iOS operating system (from Apple, Inc., Cupertino, California)
  • Table 2 presents pseudocode for use with an electronic device that uses an Android operating system (from Alphabet, Inc., Mountain View, California).
  • Wake Lock provides the ability for an application to control the power state of the electronic device. In order to utilize the Wake_Lock capabilities the Wake_Lock
  • the application when the application is turned on, standby mode is disabled so the monitoring electronic device does not lock and sleep mode is disabled so the screen or display does not turn off. (Note that, because sleep mode can disable the application functionality until the electronic device is awakened or unlocked, it may be useful to disable sleep mode or automatic locking modes on the electronic device.) Then, while the application is running or executing, if the monitoring electronic device is unplugged from an external power source, the screen may be dimmed to the lowest possible setting to conserve power and/or the sleep mode may be re-enabled.
  • a series of subroutines may execute.
  • a face-recognition technique does not identify anyone for a second period of time and/or the monitoring electronic device is unplugged from an external power source, then the screen may be dimmed to the lowest possible setting to conserve power and/or the sleep mode may be re-enabled.
  • video conferencing between paired electronic devices has concluded, then the screen may be dimmed to the lowest possible setting to conserve power and/or the sleep mode may be re-enabled.
  • the screen may be turned on, sleep mode may be disabled, and/or standby mode may be disabled.
  • the application when the application is running, if no motion is detected, no action may be taken. However, if motion is detected, a face-recognition technique may be used to determine if a familiar or known face is detected. If yes, the user of the viewing electronic device may be notified about who has entered the environment. Alternatively, if a familiar face is not detected, the user of the viewing electronic device may be notified that motion was detected in the environment.
  • the monitoring electronic device may be panned or scanned from an initial position over a counterclockwise arc of 180°, and then may be panned or scanned from the initial position over a clockwise arc of 180°. Afterwards, the monitoring electronic device may be restored to the initial position. Furthermore, the captured video may be saved or stored on the monitoring electronic device, and then may be communicated to the user of the viewing electronic device (e.g., using email).
  • the application may stream both videos
  • streaming video from both cameras may be enabled. This feature may be used when the monitoring electronic device is placed in a dock and/or when the dock pans or scans the camera(s) by rotating about an axis.
  • a multiplexing technique (or one or more in a set of multiplexing techniques) may be used. For example, every other frame of video may be captured with a particular camera (such as a first frame from the front camera, then a second frame from the back camera, etc.). Alternatively, every N frames of video may be captured with a particular camera (such as ten frames from the front camera, then ten frames from the back camera, etc.). In some embodiments, M frames of video may be captured with one camera, and the N frames of video may be captured with the other camera, where Mis less than N. Thus, five frames may be captured from the front camera, then ten frames may be captured from the back camera, etc. This multiplexing technique may be useful when one camera has a higher frame rate than the other (in which case, the higher frame-rate camera may be used to capture the M frames).
  • FIG. 9 presents a flow diagram illustrating a method 900 for facilitating environmental monitoring in FIG. 1, which may be performed by a controller electronic device (such as controller electronic device 118 in FIG. 1).
  • the controller electronic device receives messages (operation 912) that include timestamps and current locations of a monitoring electronic device.
  • monitoring electronic device may periodically or after a time interval transmit the messages (which function as beacons).
  • the controller electronic device associates a viewing electronic device (which is paired with or associated with the monitoring electronic device) with a subset of second monitoring electronic devices (operation 916) based on a duration of time that the monitoring electronic device is approximately at a fixed location (such as within 1-100 m of a previous location for at least 1-72 hours). Note that a size of the subset increases as the duration of time increases, and the associations allow the viewing electronic device to selectively access content, including acoustic information and images for second
  • the subset of the second monitoring electronic devices may be located within a distance from the fixed location, and the distance may increase as the duration of time increases.
  • the electronic device may be associated with the subset of the second monitoring electronic devices those that are within 50 m, after two days, the electronic device may be associated with the subset of the second monitoring electronic devices that are within 100 m, etc.
  • the subset of the second monitoring electronic devices may be located within an adjacency value from the fixed location (such as nearest neighbors, next-nearest neighbors, etc.), and the adjacency value may increase as the duration of time increases.
  • the controller electronic device optionally receives credentials (such as a username, a password and/or an identifier) (operation 910) from the viewing electronic device and the subset of the second monitoring electronic devices, and associating the viewing electronic device and the subset of the second monitoring electronic devices (operation 916) may involve providing the credentials to the viewing electronic device and the subset of the second monitoring electronic devices. Additionally, the controller electronic device may optionally receive encryption keys (operation 910) from the viewing electronic device and the subset of the second monitoring electronic devices, and associating the viewing electronic device and the subset of the second monitoring electronic devices (operation 916) may involve providing the encryption keys to the viewing electronic device and the subset of the second monitoring electronic devices.
  • credentials such as a username, a password and/or an identifier
  • the controller electronic device optionally generates the encryption keys (operation 914) for the viewing electronic device and the subset of the second monitoring electronic devices, and associating the viewing electronic device and the subset of the second monitoring electronic devices (operation 916) may involve providing the encryption keys to the viewing electronic device and the subset of the second monitoring electronic devices.
  • the credentials and the encryption keys may be used by viewing electronic devices to selectively access content, such as from a monitoring electronic device and/or from a cloud-based storage device.
  • the controller electronic device may optionally associate the monitoring electronic device with a second viewing electronic device (operation 918) that is associated with one of the second monitoring electronic devices.
  • the association between the monitoring electronic device with the second viewing electronic device may allow the second viewing electronic device to selectively access content, including images and acoustic information corresponding to sound, for the environment.
  • the controller electronic device may optionally receive credentials (operation 910) from the monitoring electronic device and the second viewing electronic device, and associating the monitoring electronic device and the second viewing electronic device (operation 918) may involve providing the credentials to the monitoring electronic device and the second viewing electronic device.
  • controller electronic device may optionally receive encryption keys (operation 910) from the monitoring electronic device and the second viewing electronic device, and associating the monitoring electronic device and the second viewing electronic device (operation 918) may involve providing the encryption keys to the monitoring electronic device and the second viewing electronic device.
  • the controller electronic device optionally generates the encryption keys (operation 914) for the monitoring electronic device and the second viewing electronic devices, and associating the monitoring electronic device and the second viewing electronic device involves providing the encryption keys (operation 918) to the monitoring electronic device and the second viewing electronic device.
  • the controller electronic device may establish selective access to the content when the viewing electronic device is outside of communication range with the subset of the monitoring electronic devices. For example, this association technique may allow the viewing electronic device to selectively access content even when the viewing electronic device is outside of direct, wireless communication range with the subset of the monitoring electronic devices.
  • FIG. 10 presents a drawing illustrating communication among monitoring electronic device 110-1, monitoring electronic devices 1010, viewing electronic device 112-1 and controller electronic device 118.
  • a user of viewing electronic device 112-1 may set up or define an association 1012 (or pairing) in controller electronic device 118 between monitoring electronic device 110-1 and viewing electronic device 112-1.
  • controller electronic device 118 may confirm the association based on a predefined list of electronic devices associated with or used by the user.
  • credentials 1014 and/or encryption keys 1016 may be exchanged between controller electronic device 118, monitoring electronic device 110-1 and viewing electronic device 112- 1.
  • controller electronic device 118 generates encryption keys 1016.
  • monitoring electronic device 110-1 may provide messages 1018 with timestamps and locations of monitoring electronic device 110-1. If controller electronic device 118 determines 1020 that monitoring electronic device 110-1 has remained at location for a time interval, controller electronic device 118 may define associations 1022 between viewing electronic device 112-1 and a subset of monitoring electronic devices 1010 (which are at locations other than the location). This may optionally include providing messages to viewing electronic device 112-1 and the subset of monitoring electronic devices 1010 informing these electronic devices of the association or pairing. When the associations are defined, credentials 1014 and/or encryption keys 1016 may be exchanged between controller electronic device 118, the subset of monitoring electronic devices 1010 and viewing electronic device 112-1. Moreover, as the time interval monitoring electronic device 110-1 remains at the location increases, the spatial extent of the subset of monitoring electronic devices 1010 may increase.
  • viewing electronic device 112-1 may be able to selectively access content (such as images and/or audio information) from an ever increasing number of monitoring electronic devices having an ever increasing spatial extent.
  • controller electronic device 118 may discontinue 1020 associations 1022 between viewing electronic device 112-1 and the subset of monitoring electronic devices 1010 (but the association between monitoring electronic device 110-1 and viewing electronic device 112-1 may be maintained).
  • the dynamic associations are shown in FIG. 11, which presents a drawing illustrating association of viewing electronic device 112-1 and monitoring electronic devices 1010 as a function of time.
  • viewing electronic device 112-1 may be associated with monitoring electronic devices 1010-1 and 1010-2.
  • monitoring electronic devices 1010-1 and 1010-2 which are within 50 m of location 1110).
  • the associations may include nearest neighbors of monitoring electronic device 110-1, and after the associations may include nearest neighbors and next-nearest neighbors of monitoring electronic device 110-1.
  • viewing electronic device 112-1 may be associated with monitoring electronic devices 1010-1, 1010-2, 1010-3 and 1010-4. For example, if monitoring electronic device 110-1 remains within 10 m of location 1110 for 24 hours, viewing electronic device 112-1 may be associated with monitoring electronic devices 1010-1 and 1010-2 (which are within 50 m of location 1110) and monitoring electronic devices 1010-3 and 1010-4 (which are within 50 m of location 1110).
  • the size of the subset may increase as the duration of the time interval increases, and the associations may allow viewing electronic device 112-1 to selectively access content from the subset of monitoring electronic devices 1010 (including acoustic information corresponding to sound and images for environments that include the subset of monitoring electronic devices 1010). Consequently, the longer a cellular telephone executing the program module in the monitoring mode is at a particular location and active, the wider the information network that is shared with the user of this cellular telephone. In an exemplary embodiment, after a day the user can selectively access content from their neighbors, after a week the user can selectively access content from their entire
  • the associations may reset.
  • This dynamic-association feature may prevent or make it more difficult for someone briefly visiting a neighborhood in an attempt to establish associations or pairings for illicit purposes. Instead, a user may be rewarded with an ever-expanded information network based on stability of the geolocation of their monitoring electronic device and/or their viewing electronic device. Moreover, by using one or more controller electronic devices to facilitate the dynamic associations, this association technique may provide a low-friction (i.e., low user effort) approach for building an information network for a user, and such a low- friction approach can make it easier for a user to use and enjoy the information network.
  • a low-friction i.e., low user effort
  • FIG. 12 presents a flow diagram illustrating a method 1200 for facilitating environmental monitoring in FIG. 1, which may be performed by an electronic device (such as one of viewing electronic devices 112 in FIG. 1).
  • the electronic device which may execute an instance of a program module in a viewing mode, and thus may be referred to as a 'viewing electronic device'
  • receives messages (operation 1210) from a second electronic device executing another instance of the program module.
  • These messages advertise availability of content for an environment at a location associated with the second electronic device (e.g., the messages may indicate that the second electronic device is executing the other instance of the program module), and the content includes images of the environment and acoustic information corresponding to sound in the environment.
  • the environment may include the second electronic device and the second electronic device may execute the instance of the program module in a monitoring mode (and thus may be referred to as a 'monitoring electronic device') to collect the content.
  • the second electronic device may execute an instance of the program module in the viewing mode and the content may be collected by a monitoring electronic device at the location that executes an instance of the program module in the monitoring mode, and which is paired or associated with the second electronic device.
  • the electronic device determines whether to request shared access to the content (operation 1212) based on the location and locations of one or more monitoring electronic devices executing additional instances of the program module in a monitoring mode for which the electronic device already has shared access.
  • the location may be different than any of the locations.
  • the determination may be based on a history of locations of the electronic device.
  • the history of the locations may indicate that the electronic device was proximate to the location for more than: a predefined number of occasions (such as at least 2-10 times); and/or a predefined time duration (such as at least 5-60 min).
  • the electronic device provides, to the second electronic device, a request for shared access (operation 1214) based on the determination. Furthermore, the electronic device receives an acceptance message (operation 1216) from the second electronic device in response to the request, and the electronic device selectively accesses the content (operation 1218) based on the acceptance message.
  • the acceptance message may include credentials and/or an encryption key that facilitate the selective access.
  • the electronic device optionally performs one or more additional operations (operation 1220). For example, while in the viewing mode, the electronic device may selectively access second content for a second environment at one of the locations that is collected by a monitoring electronic device executing an instance of the program module in the monitoring mode and that is associated or paired with the electronic device.
  • the second content may include images of the second environment and acoustic information corresponding to sound in the second environment.
  • the electronic device may provide, to the second electronic device, access to the second content in response to the acceptance message. Note that providing access to the second content may involve providing, to the second electronic device, credentials and/or an encryption key that facilitate the selective access.
  • the electronic device may establish selective access to the content when the electronic device is outside of communication range with the monitoring electronic device at the location. For example, the electronic device may establish selective access to the content when the electronic device is outside of direct, wireless communication range with the monitoring electronic device at the location.
  • the instances of the program module executed by the electronic device and the second electronic device may help authenticate or facilitate recognition of suitable electronic devices with which to associate.
  • FIG. 13 presents a drawing illustrating communication among viewing electronic device 110-1 and monitoring electronic device 110-2.
  • viewing electronic device 110-1 may receive one or more messages 1310 from monitoring electronic device 110-2. These messages may advertise the availability of content 1318 for an environment at a location associated with monitoring electronic device 110-2.
  • viewing electronic device 110-1 may determine 1312 whether to request shared access to content 1318.
  • viewing electronic device 110-1 may request 1314 shared access to content 1318.
  • monitoring electronic device 110-2 may provide an acceptance message 1316.
  • This acceptance message may include credentials and/or an encryption key that facilitates the shared access to content 1318.
  • viewing electronic device 110-1 may selectively access content 1318.
  • viewing electronic device 112-1 may be able to selectively access content (such as images and/or audio information) from monitoring electronic devices that are of interest to a user of viewing electronic device 112-1, e.g., based on the history of locations of viewing electronic device 112-1 and, in particular, how often and how long viewing electronic device 112-1 is at or proximate to the location of monitoring electronic device 110-2.
  • content such as images and/or audio information
  • FIG. 14 presents a drawing illustrating requesting shared access to content between viewing electronic device 110-1 and monitoring electronic device 110-2.
  • history of locations 1410 of viewing electronic device 110-1 as a function of time 1412 shows that viewing electronic device 110-1 repeatedly visits location 1414 of monitoring electronic device 110-2 and that the duration or sum of time intervals 1416 during which viewing electronic device 110-1 is proximate to location 1414 exceeds a predefined value.
  • viewing electronic device 110-1 may be at or proximate to location 1414 at least 2-10 times and/or may have a predefined time duration at or proximate to location 1414 of at least 5-60 min.
  • viewing electronic device 110-1 may request to associate or pair with monitoring electronic device 110-2 so that it can selectively access the content. This approach may help ensure that there are only associations that are of interest to the user of viewing electronic device 110-1. It may also allow the user to auto-complete an emergency list or a contact list based on their activities (such as the locations they visit), which may indicate the individuals that are most important to them.
  • FIG. 15 presents a block diagram illustrating an electronic device 1500, such as one of monitoring electronic devices 110, one of viewing electronic devices 112, optional access point 114, optional storage electronic device 116 or controller electronic device 118 in FIG. 1. (In the discussion that follows, the functionality of one of monitoring electronic devices 110 or one of viewing electronic devices 112 is used as an illustration.
  • This electronic device includes processing subsystem 1510 (and, more generally, an integrated circuit or a control mechanism), memory subsystem 1512, networking subsystem 1514, power subsystem 1516, optional sensor subsystem 1520 (i.e., a data-collection subsystem and, more generally, a sensor mechanism) and optional sensory-output subsystem 1534.
  • Processing subsystem 1510 includes one or more devices configured to perform computational operations (such as executing techniques to process captured images, measured acoustic information and, more generally, sensor data).
  • processing subsystem 1510 can include one or more microprocessors, application-specific integrated circuits (ASICs), microcontrollers, programmable-logic devices, and/or one or more digital signal processors (DSPs).
  • ASICs application-specific integrated circuits
  • DSPs digital signal processors
  • Memory subsystem 1512 includes one or more devices for storing data and/or instructions for processing subsystem 1510, networking subsystem 1514 and/or optional sensor subsystem 1520.
  • memory subsystem 1512 can include dynamic random access memory (DRAM), static random access memory (SRAM), and/or other types of memory.
  • instructions for processing subsystem 1510 in memory subsystem 1512 include: one or more program modules or sets of instructions (such as one or more program modules 1528), which may be executed in an operating environment (such as operating system 1530) by processing subsystem 1510.
  • a given one of the one or more program modules 1528 may be embedded in a web page that is provided by a remote server or computer via a network, and which is rendered by a web browser on electronic device 1500.
  • the given program module may be an application tool that is embedded in the web page, and which executes in a virtual environment of the web browser.
  • the application tool may be provided to electronic device 1500 via a client-server architecture.
  • the one or more computer programs may constitute a computer-program mechanism.
  • instructions in the various modules in memory subsystem 1512 may be implemented in: a high-level procedural language, an object-oriented programming language, and/or in an assembly or machine language.
  • the programming language may be compiled or interpreted, e.g., configurable or configured (which may be used interchangeably in this discussion), to be executed by processing subsystem 1510.
  • memory subsystem 1512 can include mechanisms for controlling access to the memory.
  • memory subsystem 1512 includes a memory hierarchy that comprises one or more caches coupled to a memory in electronic device 1500. In some of these embodiments, one or more of the caches is located in processing subsystem 1510.
  • memory subsystem 1512 is coupled to one or more high-capacity mass-storage devices (not shown).
  • memory subsystem 1512 can be coupled to a magnetic or optical drive, a solid-state drive, or another type of mass-storage device.
  • memory subsystem 1512 can be used by electronic device 1500 as fast-access storage for often-used data, while the mass-storage device is used to store less frequently used data.
  • Networking subsystem 1514 includes one or more devices configured to couple to and communicate on a wired and/or wireless network (i.e., to perform network operations and, more generally, communication), including: interface circuit 1524 and one or more associated antennas 1526.
  • FIG. 15 includes one or more antennas 1526
  • electronic device 1500 includes one or more nodes on interface circuit 1524, e.g., pads, which can be coupled to one or more antennas 1526.
  • networking subsystem 1514 can include: a ZigBee ® networking subsystem, a Bluetooth networking system (such as Bluetooth Low Energy), a cellular networking system (e.g., a 3G/4G network such as UMTS, LTE, etc.), a universal serial bus (USB) networking system, a networking system based on the standards described in IEEE 802.11 (e.g., a Wi-Fi networking system), an Ethernet networking system, an infra-red communication system, a power-line
  • interface circuit 1524 and at least one of one or more antennas 1526 may constitute a radio.
  • networking subsystem 1514 includes processors, controllers, radios/antennas, sockets/plugs, and/or other devices used for coupling to, communicating on, and handling data and events for each supported networking system.
  • mechanisms used for coupling to, communicating on, and handling data and events on the network for each network system are sometimes collectively referred to as a 'network interface' for the network system.
  • a 'network' between the electronic devices does not yet exist. Therefore, electronic device 1500 may use the mechanisms in networking subsystem 1514 for performing simple wireless communication between the electronic devices, e.g., transmitting advertising or beacon frames and/or scanning for advertising frames transmitted by other electronic devices.
  • electronic device 1500 may include power subsystem 1516 with one or more power sources 1518.
  • power sources 1518 may include: a battery (such as a rechargeable or a non-rechargeable battery), a DC power supply, a transformer, and/or a switched-mode power supply.
  • the one or more power sources 1518 may operate in a voltage-limited mode or a current-limited mode.
  • these power sources may be mechanically and electrically coupled by a male or female adaptor to: a wall or electrical- outlet socket or plug (such as a two or three-pronged electrical-outlet plug, which may be collapsible or retractable), a light socket (or light-bulb socket), electrical wiring (such as a multi-wire electrical terminal), a generator, a USB port or connector, a JJC-power plug or socket, a cellular-telephone charger cable, a photodiode, a photovoltaic cell, etc.
  • This mechanical and electrical coupling may be rigid or may be remateable.
  • the one or more power sources 1518 may be mechanically and electrically coupled to an external power source or another electronic device.
  • optional sensor subsystem 1520 may include one or more sensor devices 1522 (or a sensor array), which may include one or more processors and memory.
  • the one or more sensor devices 1522 may include: a thermal sensor (such as a thermometer), a humidity sensor, a barometer, a camera or video recorder (such as a CCD or CMOS imaging sensor), a flash or an optical or infra-red light source, one or more microphones or acoustic transducers (which may be able to record sound, including acoustic information in a band of frequencies, in mono or stereo), a load-monitoring sensor or an electrical-characteristic detector (and, more generally, a sensor that monitors one or more electrical characteristics), an infrared sensor (which may be active or passive), a microscope, a particle detector (such as a detector of dander, pollen, dust, exhaust, etc.), an air-quality sensor, a particle sensor, an optical particle sensor, an ionization particle sensor,
  • a thermal sensor
  • optional sensory-output subsystem 1534 may include one or more output devices 1536, such as a display and/or one or more speakers (or acoustic transducers).
  • One or more output devices 1536 may be used to display images and/or to output sound.
  • processing subsystem 1510 may execute one or more program modules 1528, such as an environmental-monitoring application to perform the environmental monitoring technique and/or the association technique.
  • the one or more program modules 1528 may use one or more sensor devices 1522 to monitor one or more environmental conditions in an environment that includes electronic device 1500.
  • the resulting sensor data (or content) may be shared with one or more other electronic devices (such as another electronic device executing instances of the one or more program modules 1528) via networking subsystem 2014.
  • processing subsystem 1510, memory subsystem 1512, networking subsystem 1514, power subsystem 1516, optional sensor subsystem 1520 and/or optional sensory-output subsystem 1534 may be coupled using one or more interconnects, such as bus 1532.
  • interconnects may include an electrical, optical, and/or electro-optical connection that the subsystems can use to communicate commands and data among one another.
  • bus 1532 Although only one bus 1532 is shown for clarity, different embodiments can include a different number or configuration of electrical, optical, and/or electro-optical connections among the subsystems.
  • Electronic device 1500 can be (or can be included in) a wide variety of electronic devices, such as an electronic device with at least one network interface.
  • electronic device 1500 can be (or can be included in): a sensor (such as a smart sensor), a tablet computer, a smartphone or a cellular telephone, an appliance, a regulator device, a consumer-electronic device (such as a baby monitor), a portable computing device, an access point, a router, a switch, communication equipment, test equipment, a digital signal processor, a controller, a personal digital assistant, a laser printer (or other office equipment such as a photocopier), a personal organizer, a toy, a set-top box, a computing device (such as a laptop computer, a desktop computer, a server, and/or a subnotebook/netbook), a light (such as a nightlight), a space heater, an alarm, a smoke detector, a carbon-monoxide detector, an environmental monitoring device (which monitors an environmental condition in
  • electronic device 1500 may include one or more additional processing subsystems, memory subsystems, networking subsystems, power subsystems, sensor subsystems and/or sensory-output subsystems. Moreover, one or more of the subsystems may not be present in electronic device 1500. Furthermore, in some embodiments, electronic device 1500 may include one or more additional subsystems that are not shown in FIG. 15 such as a user-interface subsystem, a display subsystem, and/or a feedback subsystem (which may include speakers and/or an optical source).
  • additional subsystems that are not shown in FIG. 15 such as a user-interface subsystem, a display subsystem, and/or a feedback subsystem (which may include speakers and/or an optical source).
  • program module 1528 is included in operating system 1530.
  • a component in a given subsystem is included in a different subsystem.
  • circuits and components in electronic device 1500 may be implemented using any combination of analog and/or digital circuitry, including: bipolar, PMOS and/or NMOS gates or transistors.
  • signals in these embodiments may include digital signals that have approximately discrete values and/or analog signals that have continuous values.
  • components and circuits may be single-ended or differential, and power supplies may be unipolar or bipolar.
  • An integrated circuit may implement some or all of the functionality of networking subsystem 1514, such as one or more radios. Moreover, the integrated circuit may include hardware and/or software mechanisms that are used for transmitting wireless signals from electronic device 1500 and receiving signals at electronic device 1500 from other electronic devices. Aside from the mechanisms herein described, radios are generally known in the art and hence are not described in detail. In general, networking subsystem 1514 and/or the integrated circuit can include any number of radios. Note that the radios in multiple-radio embodiments function in a similar way to the radios described in single-radio embodiments.
  • networking subsystem 1514 and/or the integrated circuit include a configuration mechanism (such as one or more hardware and/or software mechanisms) that configures the radios to transmit and/or receive on a given channel ⁇ e.g., at a given carrier frequency).
  • the configuration mechanism can be used to switch the radio from monitoring and/or transmitting on a given channel to monitoring and/or transmitting on a different channel.
  • 'monitoring' as used herein comprises receiving signals from other electronic devices and possibly performing one or more processing operations on the received signals, e.g., determining if the received signal comprises an advertising frame, calculating a performance metric, etc.
  • the described embodiments of the environmental monitoring technique and the association technique may be used in a variety of network interfaces. Furthermore, while some of the operations in the preceding embodiments were implemented in hardware or software, in general the operations in the preceding embodiments can be implemented in a wide variety of configurations and architectures. Therefore, some or all of the operations in the preceding embodiments may be performed in hardware, in software or both. For example, at least some of the operations in the environmental monitoring technique and the association technique may be implemented using program module 1528, operating system 1530 (such as drivers for interface circuit 1524) and/or in firmware in interface circuit 1524. Alternatively or additionally, at least some of the operations in the environmental monitoring technique and the association technique may be implemented in a physical layer, such as hardware in interface circuit 1524.
  • electronic device 1500 may be distributed over a large number of servers or computers, with various groups of the servers or computers performing particular subsets of the functions. These servers or computers may be at one or more locations. Thus, in some embodiments electronic device 1500 includes a computer system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Burglar Alarm Systems (AREA)
  • Telephone Function (AREA)

Abstract

Cette invention concerne un dispositif électronique qui exécute un module de programme qui règle un mode de fonctionnement du dispositif électronique en mode de surveillance ou un mode de visualisation. Lorsque le dispositif électronique est en mode de surveillance, le dispositif électronique capture au moins sélectivement des images et mesure des informations acoustiques correspondant à un son dans un environnement, puis il transmet les images et les informations acoustiques à un second dispositif électronique. En variante, lorsque le dispositif électronique est en mode de visualisation, le dispositif électronique reçoit au moins sélectivement des informations visuelles et des informations acoustiques supplémentaires provenant du second dispositif électronique, il présente les informations visuelles sur un écran, et émet un son supplémentaire correspondant aux informations acoustiques supplémentaires au moyen d'un transducteur acoustique. Par exemple, le dispositif électronique peut être un modèle antérieur et/ou il peut exécuter une version antérieure d'un système d'exploitation.
PCT/US2016/060280 2015-11-06 2016-11-03 Dispositif de sécurité bimode activé par logiciel WO2017079407A2 (fr)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US14/935,288 2015-11-06
US14/935,288 US9801013B2 (en) 2015-11-06 2015-11-06 Electronic-device association based on location duration
US14/935,287 2015-11-06
US14/935,287 US20170131758A1 (en) 2015-11-06 2015-11-06 Security device without power-saving transitions
US14/935,283 2015-11-06
US14/935,283 US20170134653A1 (en) 2015-11-06 2015-11-06 Software-enabled dual-mode security device

Publications (2)

Publication Number Publication Date
WO2017079407A2 true WO2017079407A2 (fr) 2017-05-11
WO2017079407A3 WO2017079407A3 (fr) 2017-07-06

Family

ID=58662819

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2016/060280 WO2017079407A2 (fr) 2015-11-06 2016-11-03 Dispositif de sécurité bimode activé par logiciel

Country Status (1)

Country Link
WO (1) WO2017079407A2 (fr)

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200952473A (en) * 2008-05-19 2009-12-16 Camdeor Technology Co Ltd Linking type infrared monitor
US9071626B2 (en) * 2008-10-03 2015-06-30 Vidsys, Inc. Method and apparatus for surveillance system peering
US8886252B2 (en) * 2008-12-22 2014-11-11 Htc Corporation Method and apparatus for automatically changing operating modes in a mobile device
US20120276954A1 (en) * 2009-04-29 2012-11-01 Jerry Kowalsky Portable camera and surveillance device
US9269249B2 (en) * 2009-08-24 2016-02-23 David Amis Systems and methods utilizing variable tempo sensory overload to deter, delay, distract or disrupt a perpetrator and decrease an intensity of a potential criminal act
US8537236B2 (en) * 2010-10-07 2013-09-17 Hewlett-Packard Development Company, L.P. Automatic adjustment of capture parameters based on reference data
US20130054750A1 (en) * 2011-08-23 2013-02-28 Vlognow, Inc. System and method for requesting media coverage of an event
US8973019B1 (en) * 2012-11-09 2015-03-03 Parallels IP Holdings GmbH Method and system for emulation of super speed devices in virtual machines
US9306992B2 (en) * 2013-06-07 2016-04-05 Qualcomm Incorporated Method and system for using Wi-Fi display transport mechanisms to accomplish voice and data communications

Also Published As

Publication number Publication date
WO2017079407A3 (fr) 2017-07-06

Similar Documents

Publication Publication Date Title
US11375349B2 (en) Electronic-device detection and activity association
US10139897B2 (en) Power-optimized image capture and push
US20160110085A1 (en) Presenting environmental conditions using visual perception information
US20160269533A1 (en) Notifications with embedded playback capability
US10026304B2 (en) Calibrating an environmental monitoring device
US9942840B2 (en) Networked security system
US9843566B2 (en) Networked security system
JP7142698B2 (ja) 環境における事象をモニタ及び制御するためのモノのインターネット（ＩｏＴ）に基づく統合デバイス
US9679454B2 (en) Systems, methods, and devices for managing coexistence of multiple transceiver devices using control signals
US9543998B2 (en) Systems, methods, and devices for managing coexistence of multiple transceiver devices using bypass circuitry
JP2024075609A (ja) スマートデバイスでレーダを利用するためのシステム、方法およびデバイス
US9396633B1 (en) Systems, methods, and devices for managing coexistence of multiple transceiver devices by optimizing component layout
EP3167296B1 (fr) Diagnostic de défaillance basé sur la surveillance de connexion
US11026082B1 (en) Electronic device identification system, apparatuses, and methods
US9801013B2 (en) Electronic-device association based on location duration
US10453328B2 (en) Systems and methods for crowdsourcing detected events
US20170134653A1 (en) Software-enabled dual-mode security device
US20170131758A1 (en) Security device without power-saving transitions
CN102598076B (zh) 用于识别和传达特定于周围环境和设备的状态的警报装置
WO2017079407A2 (fr) Dispositif de sécurité bimode activé par logiciel
US20170162032A1 (en) Personal security
WO2020110568A1 (fr) Système de commande, programme et procédé de commande
TWI586166B (zh) Mobile indoor monitoring device
JP2024534737A (ja) 静電気放電保護付きカメラモジュール
JP2015153018A (ja) イベント情報通知システム及びイベント情報通知方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16862946

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 04/09/2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16862946

Country of ref document: EP

Kind code of ref document: A2