US20140171132A1

US20140171132A1 - Method and Apparatus for Automatically Repeating Alarms and Notifications in Response to Device Motion

Info

Publication number: US20140171132A1
Application number: US13/715,096
Authority: US
Inventors: Natalia Ziemianska; Devrim Varoglu
Original assignee: Apple Inc
Current assignee: Apple Inc
Priority date: 2012-12-14
Filing date: 2012-12-14
Publication date: 2014-06-19
Also published as: US9641669B2; US20160241706A1

Abstract

A processor-based personal electronic device (such as a smartphone) is programmed to automatically respond to data sent by various sensors from which the user's activity may be inferred. When one or more alarms on the device are temporarily disabled or ignored, they may be automatically restored when sensor data indicates a change in the user's activity. The restoration of alarm functionality may be accompanied by a repeat of notifications missed or not responded to during a certain period prior to the sensed change in user activity.

Description

BACKGROUND OF THE INVENTION

This invention relates to personal electronic devices. More particularly, it relates to the alarm and notification functions of smartphones.
A smartphone is a mobile phone built on a mobile operating system and having advanced computing capability and connectivity. The first smartphones combined the functions of a personal digital assistant (PDA) with a mobile phone. Later models added the functionality of portable media players, compact digital cameras, pocket video cameras, and GPS navigation units to form one multi-use device. Many current smartphones also include high-resolution touchscreens for input and web browsers that display standard web pages as well as mobile-optimized sites. High-speed data access may be provided by Wi-Fi and/or Mobile Broadband.
Wi-Fi is a widely-used technology that allows an electronic device to exchange data wirelessly (using radio waves) over a computer network, including high-speed Internet connections. The Wi-Fi Alliance defines Wi-Fi as any “wireless local area network (WLAN) products that are based on the Institute of Electrical and Electronics Engineers' (IEEE) 802.11 standards”. However, since most modern WLANs are based on these standards, the term “Wi-Fi” is used in general English as a synonym for “WLAN”.
A device that can use Wi-Fi (such as a personal computer, video-game console, smartphone, tablet, or digital audio player) can connect to a network resource such as the Internet via a wireless network access point. Such an access point (or “hotspot”) typically has a range of about 65 feet (20 meters) indoors and a greater range outdoors. Hotspot coverage can comprise an area as small as a single room with walls that block radio waves or as large as many square miles—this may be achieved by using multiple overlapping access points.
Mobile broadband is the term used for wireless Internet access through a portable modem, mobile phone, USB wireless modem, or other mobile devices. A smartphone is basically a cellular telephone with built-in applications and Internet access. In addition to digital voice service, current smartphones provide text messaging, e-mail, Web browsing, and video playback and calling. In addition to their built-in functions, smartphones can run myriad free and paid applications, turning the cellphone into a mobile personal computer.
In addition to radio transmitters and receivers for interacting with cellular telecommunications systems, many smartphones have additional sensors that provide input to their various systems. For example, Apple Inc.'s iPhone® 5 smartphone includes at three-axis gyro, an accelerometer, a proximity sensor and an ambient light sensor.
The iPhone display may respond to a number of sensors. A proximity sensor deactivates the display and touchscreen when the device is brought near the face during a call. This is done to save battery power and to prevent inadvertent inputs from contact with the user's face and ears. An ambient light sensor adjusts the display brightness which in turn saves battery power. A 3-axis accelerometer senses the orientation of the phone and changes the screen accordingly, allowing the user to easily switch between portrait and landscape mode. Photo browsing, web browsing, and music playing support both upright and left or right widescreen orientations.
Certain smartphones have a “do not disturb” mode. When the “do not disturb” mode is activated (e.g., via a Settings menu), the phone suppresses most forms of communication—phone calls, text messages, alarms, social media notifications, and the like. When this mode is enabled, the phone will not light up or vibrate at all, so the user can get through a meeting or go to bed without being disturbed by the outside world. However, all of those notifications may get captured and appear in a “Notification Center” when the phone's display is turned on by the user.
The user may configure the “Do not disturb” feature to function on a predefined schedule, or may simply turn it on and off as needed. The user may also specify certain contacts—sometime designated as “VIPs”—who are allowed to get through to the user even if the phone is in “do not disturb” mode.
In certain implementations, when a call comes in, the user can choose to answer or ignore it, as usual, or may immediately reply with a text message. The user may also set the smartphone to remind him or her about the call later—either at a specific time, or when leaving the current location (as determined from the phone's location sensors).
Various options may allow the Do Not Disturb settings on a smartphone to be further customized. For example, an option for “Repeated Calls” may allow activation of a mode wherein whenever someone calls back a second time from the same number within a certain time interval, the second call will not be silenced.

BRIEF SUMMARY OF THE INVENTION

A processor-based personal electronic device (such as a smartphone) is programmed to automatically respond to data sent by various sensors from which the user's activity may be inferred. One or more of the sensors may be worn by the user and remote from the device. A wireless communication link may be used by the device to obtain remote sensor data. In certain embodiments, data from on-board sensors in the device—such as motion sensors, location sensors, ambient light sensors, and the like—may also be used to deduce the user's current activity.
Various embodiments allow a processor-based personal electronic device (such as a smartphone) to dynamically institute or cancel notifications (e.g., reminders and alarms) based on device motion. One exemplary use scenario is when a number of messages (e-mail, SMS, phone, or the like) are received during the time a user is away from their phone (inferred from a sensed lack of motion by the smartphone). When the smartphone is picked-up (as may be inferred from sensor data), reminders may be generated so that the user will see all the notification activity during the time they were away from the device.
In certain embodiments, a change in motion state of a device triggers certain actions by the device. By way of example, a first motion state wherein the device rhythmically moves up and down in small displacements (such as might be sensed by a device stored in the pocket or purse of a user who is walking) may change to a second motion state wherein the device is picked up by a user and moved in a substantially single motion of greater displacement. The change of state from first motion state to second motion state may be used to automatically retrigger unacknowledged notifications generated during the period of time the device was in the first motion state.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING(S)

FIG. 1 is a block diagram of a processor-based device

FIG. 2A is the first portion of a flowchart of a process according to one embodiment of the invention. FIG. 2B is the second portion of the flowchart shown in FIG. 2A.

DETAILED DESCRIPTION OF THE INVENTION

Referring to FIG. 1, a simplified functional block diagram of illustrative electronic device 100 is shown according to one embodiment. Electronic device 100 could, for example, be a smartphone, personal media device, portable camera, or a tablet, notebook or desktop computer system. As shown, electronic device 100 may include processor 105, display 110, user interface 115, graphics hardware 120, device sensors 125 (e.g., proximity sensor/ambient light sensor, accelerometer and/or gyroscope), microphone 130, audio codec(s) 135, speaker(s) 140, communications circuitry 145, image capture circuit or unit 150, video codec(s) 155, memory 160, storage 165, and communications bus 170.
Processor 105 may execute instructions necessary to carry out or control the operation of many functions performed by device 100 (e.g., such as the processing of data obtained from device sensors 125). Processor 105 may, for instance, drive display 110 and receive user input from user interface 115. User interface 115 can take a variety of forms, such as a button, keypad, dial, a click wheel, keyboard, display screen and/or a touch screen. Processor 105 may be a system-on-chip such as those found in mobile devices and include one or more dedicated graphics processing units (GPUs). Processor 105 may be based on reduced instruction-set computer (RISC) or complex instruction-set computer (CISC) architectures or any other suitable architecture and may include one or more processing cores. Graphics hardware 120 may be special purpose computational hardware for processing graphics and/or assisting processor 105 perform computational tasks. In one embodiment, graphics hardware 120 may include one or more programmable graphics processing units (GPUs).
Image capture circuitry 150 may capture still and video images that may be processed to generate images. Output from image capture circuitry 150 may be processed, at least in part, by video codec(s) 155 and/or processor 105 and/or graphics hardware 120, and/or a dedicated image processing unit incorporated within circuitry 150. Images so captured may be stored in memory 160 and/or storage 165. Memory 160 may include one or more different types of media used by processor 105, graphics hardware 120, and image capture circuitry 150 to perform device functions. For example, memory 160 may include memory cache, read-only memory (ROM), and/or random access memory (RAM). Storage 165 may store media (e.g., audio, image and video files), computer program instructions or software, preference information, device profile information, and any other suitable data. Storage 165 may include one more non-transitory storage mediums including, for example, magnetic disks (fixed, floppy, and removable) and tape, optical media such as CD-ROMs and digital video disks (DVDs), and semiconductor memory devices such as Electrically Programmable Read-Only Memory (EPROM), and Electrically Erasable Programmable Read-Only Memory (EEPROM). Memory 160 and storage 165 may be used to retain computer program instructions or code organized into one or more modules and written in any desired computer programming language. When executed by, for example, processor 105 such computer program code may implement one or more of the methods described herein.
An electronic device such as device 100 may receive inputs from on-board device sensors 125 which sensors may be of the types described, above—i.e., proximity sensors, accelerometers, gyroscopes, ambient light sensors and location sensors. In addition, it may receive signals and/or data from remote sensors via communication circuitry 145. Such remote sensors may be worn by the user of the device—e.g., wrist motion sensors, pulse rate sensors, breathing rate sensors, and the like. It will be appreciated by those skilled in the art that processor 105 of system 100 may be programmed to receive input data from the sensors and deduce from that data the current activity of the user. The activity of the user may be used to automatically select one or more states (or “settings”) of the device.

EXAMPLE 1

Referring now to FIG. 2, a process according to one particular embodiment is shown in the form of a flowchart wherein a user of device 100 (which may be a smartphone) activates the Do Not Disturb function (or state) of the device prior to taking a 45-minute nap.
The process may begin at 200 with the device displaying a Do Not Disturb (DND) activation dialog box requesting a desired duration of the DND state. At process box 210, the user selects the DND state “on” for a duration of X minutes (X=45 in this example). The device enters the DND state by suppressing alarms and notifications which would otherwise activate during the 45-minute period and starts a 45-minute timer. The alarms and/or notifications may be audible and/or tactile. At diamond 212, the device monitors its built-in motion sensors to determine whether it is motionless (as might be expected if it were placed on a nightstand, headboard, bedside table or the like near a sleeping user). If no motion is detected (“No” branch at 212), the device checks the DND period timer at 214 to determine whether the DND duration set by the user has been reached. If the duration period has concluded (“Yes” branch at 214), the process continues to box 228 (see FIG. 2B) at which point the DND state is deselected and, any notifications received during the DND period are resent (at 230) to alert the user of the suppressed notifications. The process may then conclude at 232 with a reversion to the normal state of the device.
By way of example, consider a situation wherein a user sets the DND state for a 45-minute nap, but awakens after sleeping for 30 minutes and picks up device 100 (e.g., his or her smartphone) from a bedside table to determine the time of day from the built-in clock function of device 100. In this scenario, motion of the device would be detected at diamond 212 whereupon a first timer (“TIMER1”) would be automatically started (at 216) and a second timer (“TIMER2”) would also be automatically started (at 218). The purpose of TIMER1 and TIMER2 is to determine the duration of the detected motion. In this example, the user is merely checking the time of day and may return the device to its resting position on the bedside table after realizing that he or she may go back to sleep for an additional 15 minutes. In such a case, the period of motion may be expected to be relatively short. By way of example only, the illustrated process uses a 3-minute period to determine whether the device is being actively used by the user or has merely been (briefly) checked by the user.
After initially detecting motion (at 212) and starting TIMER1 and TIMER2 the device again checks for motion at 220. If no additional (or continuing) motion is detected (“No” branch) at 220, a determination is made a 222 whether TIMER2 has reached the 3-minute mark. If not (T2<3; “No” branch at 222), the device returns to monitoring for motion at 220). If, on the other hand, TIMER2 exceeds 3 minutes—i.e., the device has not been further moved for 3 minutes—(“Yes” branch at 222), the process may return to decision diamond 214 for a determination of whether the DND period has expired. If not (“No” branch at 214) the process repeats. If the DND period is up (“Yes” branch) at 214, the process continues to box 228 (see FIG. 2B) at which point the DND state is deselected and, any notifications received during the DND period are resent (at 230) to alert the user of the suppressed notifications. The process may then conclude at 232 with a reversion to the normal state of the device.
In another scenario, the user awakens after sleeping for 30 minutes and picks up his or her device from the bedside table and begins actively using the device—i.e., does not return the device to its resting place on the bedside table but continues to hold and manipulate the device. In this case, the additional (or continuing) motion of the device may be detected (“Yes” branch at 220) which leads, at process box 224, to a restart of TIMER2—i.e., TIMER2 is reset to zero. At 226, the device may determine whether TIMER1 has reached the 3-minute mark. If not (T1<3; “No” branch at 226), the process returns to monitoring for additional motion at 220. If, however, the device has been in motion for more than 3 minutes—i.e., is being actively used—TIMER1 will exceed 3 minutes (“Yes” branch at 226) and the process may continue to box 228 (see FIG. 2B) at which point the DND state is automatically deselected and, any notifications received during the DND period are automatically resent (at 230) to alert the user of any suppressed notifications. The process may then conclude at 232 with a reversion to the normal state of the device.
The above-described process permits a user to briefly pick up his or her smartphone to check the time of day (or other indications) without triggering notifications. However, more prolonged use of the device automatically returns it to an active state (DND off) and triggers notifications.
In yet other embodiments, the device may (additionally) monitor for user inputs to detect active use of the device, and, in response, automatically deselect the DND state or remind the user that the DND state is active and present the user with the option of deselecting the DND state.

EXAMPLE 2

In certain embodiments, a device may use data from on-board motion sensors to detect that it has been stationary for a period of time and re-trigger notifications sent during that period when the motion sensors detect motion—such as a user picking up the device.
In this way, a user might put down his or her smartphone on a dresser and take a lengthy shower or bath. During this time, one or more messages, e-mails, and other electronic messaging and wireless digital messaging services with attendant notifications (audible and/or tactile) are received (and may be repeated). However, the user does not hear the notifications (or repeats). The user then gets dressed quickly and puts the smartphone in his or her pocket without realizing that message notifications were missed. By using one or more built-in motion sensors, the device may re-trigger the notifications first made during the period of inactivity when the user picks up the device.

EXAMPLE 3

As discussed above, sensor data (motion, orientation, acceleration, and the like) may be used by a processor-based device to infer the activity of the user. A change in activity may be used as a criterion for re-triggering notifications and reminders.
An exemplary scenario for such an embodiment may be a message received while the device is in a motion corresponding to walking—e.g., in a purse or backpack. When the device is later lifted by the user (a detectably different motion than walking), reminders and notifications announced during the walking period may automatically be regenerated and announced (sounded, displayed or the like). In certain embodiments, repeated notifications may be limited to unacknowledged notifications.
Although particular embodiments of the present invention have been shown and described, they are not intended to limit what this patent covers. One skilled in the art will understand that various changes and modifications may be made without departing from the scope of the present invention as literally and equivalently covered by the following claims.

Claims

What is claimed is:

1. A non-transitory program storage device comprising instructions stored thereon to cause one or more processors to:

receive a telecommunications message in a wireless communications device while the device is in a first physical activity state;

detect a change to a second physical activity state; and,

provide a notification of message receipt subsequent to detection of the change to the second physical activity state.

2. A program storage device as recited in claim 1 wherein detecting a change to a second physical activity state comprises receiving data from at least one sensor selected from the group consisting of motion sensors, orientation sensors, proximity sensors and location sensors.

3. A program storage device as recited in claim 1 wherein the first physical activity state is substantially no motion.

4. A program storage device as recited in claim 1 wherein the first physical activity state is substantially repetitive motion.

5. A program storage device as recited in claim 1 wherein the second physical activity state is translational motion.

6. A program storage device as recited in claim 5 wherein the second physical activity state is translational motion in a substantially upward direction.

7. A program storage device as recited in claim 1 wherein providing a notification of message receipt comprises an audible alarm.

8. A program storage device as recited in claim 1 wherein providing a notification of message receipt comprises a tactile alarm.

9. A program storage device as recited in claim 1 wherein providing a notification of message receipt comprises displaying a message on a display.

10. A program storage device as recited in claim 1 wherein the notification of message receipt is only provided if the message received is not acknowledged by a user of the device.

11. A program storage device as recited in claim 8 wherein the notification of message receipt is only provided if the message received is not acknowledged by a user of the device within a preselected period of time.

12. A non-transitory program storage device comprising instructions stored thereon to cause one or more processors to:

provide a first notification of a time dependent event in a personal electronic device while the device is in a first physical activity state;

detect a change to a second physical activity state; and,

provide a second notification of the time dependent event subsequent to detection of the change to the second physical activity state.

13. A non-transitory program storage device comprising instructions stored thereon to cause one or more processors to:

suppress alarms in a personal electronic device for a certain period of time selected by a user of the device;

determine a first physical activity state of the device;

detect a change to a second physical activity state;

time the duration of the second physical activity state; and,

reactivate alarms in the personal electronic device if the duration of the second physical activity state exceeds a preselected length.

14. A program storage device as recited in claim 13 further comprising instructions to provide at least one notification of an alarm event that occurred prior to the detection of a change to a second physical activity state subsequent to the detection of a change to a second physical activity state.

15. A processor-based system comprising:

a processor;

at least one sensor responsive to the motion of a device containing the processor and in data communication with the processor; and,

a memory storing instructions for causing the processor to

receive a telecommunications message in the device while the device is in a first physical activity state;

detect a change to a second physical activity state; and,

16. A processor-based system as recited in claim 15 wherein detecting a change to a second physical activity state comprises receiving data from at least one sensor selected from the group consisting of motion sensors, orientation sensors, proximity sensors and location sensors.

17. A processor-based system as recited in claim 15 wherein the first physical activity state is substantially no motion.

18. A processor-based system as recited in claim 15 wherein the first physical activity state is substantially repetitive motion.

19. A processor-based system as recited in claim 15 wherein the second physical activity state is translational motion.

20. A processor-based system as recited in claim 19 wherein the second physical activity state is translational motion in a substantially upward direction.

21. A processor-based system as recited in claim 15 wherein providing a notification of message receipt comprises an audible alarm.

22. A processor-based system as recited in claim 15 wherein providing a notification of message receipt comprises a tactile alarm.

23. A processor-based system as recited in claim 15 wherein providing a notification of message receipt comprises displaying a message on a display.

24. A processor-based system as recited in claim 15 wherein the notification of message receipt is only provided if the message received is not acknowledged by a user of the device.

25. A processor-based system as recited in claim 24 wherein the notification of message receipt is only provided if the message received is not acknowledged by a user of the device within a preselected period of time.

26. A processor-based system comprising:

a processor;

at least one sensor responsive to the motion of a personal electronic device containing the processor and in data communication with the processor; and,

a memory storing instructions for causing the processor to

provide a first notification of a time dependent event in the personal electronic device while the device is in a first physical activity state;

detect a change to a second physical activity state; and,

27. A processor-based system comprising:

a processor;

a memory storing instructions for causing the processor to

suppress alarms in the personal electronic device for a certain period of time selected by a user of the device;

determine a first physical activity state of the device;

detect a change to a second physical activity state;

time the duration of the second physical activity state; and,