US20150215753A1 - System and method for remote care and monitoring using a mobile device - Google Patents
System and method for remote care and monitoring using a mobile device Download PDFInfo
- Publication number
- US20150215753A1 US20150215753A1 US14/675,097 US201514675097A US2015215753A1 US 20150215753 A1 US20150215753 A1 US 20150215753A1 US 201514675097 A US201514675097 A US 201514675097A US 2015215753 A1 US2015215753 A1 US 2015215753A1
- Authority
- US
- United States
- Prior art keywords
- user
- application
- primary
- monitoring
- mobile device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/16—Communication-related supplementary services, e.g. call-transfer or call-hold
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
- A61B5/0022—Monitoring a patient using a global network, e.g. telephone networks, internet
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/7465—Arrangements for interactive communication between patient and care services, e.g. by using a telephone network
- A61B5/747—Arrangements for interactive communication between patient and care services, e.g. by using a telephone network in case of emergency, i.e. alerting emergency services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/453—Help systems
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5061—Network service management, e.g. ensuring proper service fulfilment according to agreements characterised by the interaction between service providers and their network customers, e.g. customer relationship management
- H04L41/5064—Customer relationship management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72418—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting emergency services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72475—User interfaces specially adapted for cordless or mobile telephones specially adapted for disabled users
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/50—Service provisioning or reconfiguring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W8/00—Network data management
- H04W8/22—Processing or transfer of terminal data, e.g. status or physical capabilities
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1112—Global tracking of patients, e.g. by using GPS
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1116—Determining posture transitions
- A61B5/1117—Fall detection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6898—Portable consumer electronic devices, e.g. music players, telephones, tablet computers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0876—Aspects of the degree of configuration automation
- H04L41/0879—Manual configuration through operator
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/535—Tracking the activity of the user
Definitions
- the present invention relates generally to remote care and monitoring and, more particularly, to a system and method for remote care and monitoring of the user of a mobile device, such as a smartphone, and for simplifying use of the mobile device by the user.
- This invention provides a unique software solution and method for facilitating the use of a mobile smartphone device while also enabling authorized users (e.g. care providers, concerned family members) to remotely interact with the mobile user, provide them medical care information, daily care instruction, alerts and reminders, general assistance, immediately connect to the mobile user's phone without them answering, provide the authorized users remote mobile phone control and tracking functions as well as remotely updating and maintaining the mobile user's mobile device.
- authorized users e.g. care providers, concerned family members
- Mobile phones historically developed for use by elderly, children or special needs groups have consisted of traditional push button cell phones modified in certain ways—via some combination of a simplified digital menu, amplified speaker, enlarged and/or paired down buttons and sometimes the addition of an urgent call and/or specialized operator button.
- GPS or other locating device technologies has also been incorporated into some of these traditional phones for informational or emergency location purposes.
- smartphones mobile phones offering PC-like capabilities with technologies such as contextually changing touch screens, email, Internet browsing, Wi-Fi, GPS, an accelerometer, a magnetometer/compass, a graphical user interface operating system, a camera and the capability to run a variety of software applications—offer this potential.
- smartphones are generally feature-heavy and complicated to use, even with the most basic configurations. While these smartphones may have some of the technology capabilities mentioned available—such as software that provides location alerts or determines phone location—or the capabilities to provide the features mentioned above, the complexity and general feature-rich design of the smartphone has made it difficult for elderly, young children or people with special needs to adopt.
- the present invention comprises a system and method for remote care and monitoring of the user of a mobile device, such as a smartphone, and for simplifying use of the mobile device by the user.
- a “smartphone” or “mobile device” should be construed to include a smartphone (sometimes referred to herein as a “mobile phone” or a “primary” mobile phone or device), a mobile tablet, and other similar portable computing devices which are able to communicate electronically (through means of cellular, wireless and/or radio communication) for which the invention could be deployed.
- the system and method of the present invention comprises several components, including software operable on the mobile device and/or a remote device (such as another smartphone, a computer (including, for example, a web-based application system) or other device, sometimes referred to herein as a “secondary” device). More specifically, the present invention comprises:
- FIG. 1 is a series of screen shots illustrating exemplary interfaces in accordance with the principles of the system and method of the present invention
- FIG. 2 is a flowchart illustrating initiation and creation of a live phone (cellular) and/or Internet connection to a primary mobile phone where the primary mobile phone user does not actively answer the phone, click any button, or initiate any other kind of activity in accordance with the principles of the system and method of the present invention
- FIG. 3 is a series of screen shots illustrating exemplary “Urgent Connect Now” (on the web application) or “Direct Connect” (on the secondary mobile application) buttons/interfaces in accordance with the principles of the system and method of the present invention
- FIG. 4 illustrates an exemplary direct connect call in accordance with the principles of the system and method of the present invention
- FIG. 5 depicts exemplary information provided to the web portal application and/or to the secondary mobile application in conjunction with a direct connect call in accordance with the principles of the system and method of the present invention
- FIG. 6 is a flowchart showing the monitoring and notification processes in accordance with the principles of the system and method of the present invention.
- FIG. 7 is a flowchart showing further detail of the monitoring processes and event notification process of FIG. 6 in accordance with the principles of the system and method of the present invention.
- FIG. 8 is a flowchart showing exemplary notification triggers used by the monitoring processes in accordance with the principles of the system and method of the present invention.
- FIG. 9 depicts an example of a fall detected by the primary smartphone application that then triggers an automatic check-in in accordance with the principles of the system and method of the present invention
- FIG. 10 depicts exemplary interfaces of the primary smartphone application and the secondary smartphone application for purposes of establishing a conference call with authorized third party based on a call by the primary smartphone application to a predetermined phone number in accordance with the principles of the system and method of the present invention
- FIG. 11 depicts an exemplary automated wellness check question in accordance with the principles of the system and method of the present invention.
- FIG. 12 depicts a series of exemplary interfaces on the primary smartphone application for a plurality of the caregiving features in accordance with the principles of the system and method of the present invention
- FIG. 13 depicts a front view of an exemplary radio alert connectivity device in accordance with the principles of the system and method of the present invention
- FIG. 14 depicts a series of exemplary interfaces on the primary smartphone application for medical profile in accordance with the principles of the system and method of the present invention
- FIG. 15 is a flowchart illustrating the overall operation of the primary smartphone application in accordance with the principles of the system and method of the present invention.
- FIG. 16 is a flowchart illustrating the process by which a direct connect call may be initiated in accordance with the principles of the system and method of the present invention
- FIG. 17 is a flowchart illustrating the monitoring process for determining whether the user/primary smart phone device has fallen in accordance with the principles of the system and method of the present invention
- FIG. 18 is a flowchart illustrating the monitoring process for assessing and evaluating a potential “idleness” event and follow-up actions as a result in accordance with the principles of the system and method of the present invention
- FIG. 19 is a flowchart illustrating the process followed to execute, collect and log answers for a safety or wellness check in accordance with the principles of the system and method of the present invention
- FIG. 20 is a flowchart illustrating the notification process flow for dispensing notifications in accordance with the principles of the system and method of the present invention
- FIG. 21 is a flowchart illustrating the logging process in accordance with the principles of the system and method of the present invention.
- FIG. 22 a is a flowchart illustrating the process for switching from a standard telephonic, cellular-based audio phone call to an Internet-based, VOIP connection that allows both audio and/or video connectivity while a standard, telephonic, cellular-based audio phone call is underway within the application system in accordance with the principles of the system and method of the present invention.
- FIG. 22 b is a flowchart illustrating the process of switching from an Internet-based/VOIP connection to a standard telephonic, cellular-based audio phone call while an Internet-based/VOIP connection is underway within the application system in accordance with the principles of the system and method of the present invention.
- system and method of the present invention comprises the individual and aggregated feature set and/or subsets of the capabilities and features described in the instant application, for use in connecting primary users 750 and authorized remote parties 760 (e.g., caregivers) with one another for urgent and non-urgent situations.
- authorized remote parties 760 e.g., caregivers
- the feature set includes but is not limited to audio and/or video direct connect, automated remote connectivity, automated call conferencing based on predetermined phone numbers, location tracking, automated picture and/or video sending/remote camera monitoring, automated location tracking with photo and/or video logging, intelligent monitoring of urgent and non-urgent situations, including but not limited to lack of movement with the primary mobile phone 206 , lack of reaching a location by the primary mobile phone 206 , automated fall detection, automated wellness checks/custom actionable surveys, as well as remotely updating and customizing the primary mobile phone 206 application (it will be appreciated that reference numeral 206 refers to the primary mobile phone with software installed thereon, sometimes referred to herein as the “application,” for causing the primary mobile phone to operate in accordance with the principles of the system and method of the present invention) in from a secure Internet application 202 and/or secondary mobile applications 204 and a specialized user interface that compels the primary application user 750 to utilize their phone 206 though it is not required to make use of the application features described herein.
- the system and method of the present invention is designed, in part, to interact with some of the innate programmed features of the mobile phone but mask the phone's standard user interface and navigation so that those innate features (such as the dialer, the user phone book, the web browser, the camera, battery indicator, and menu options) are accessible to the user in a simplified, easier-to-use interface presented to the primary mobile application user.
- innate features such as the dialer, the user phone book, the web browser, the camera, battery indicator, and menu options
- Developing an interface that overlays an existing interface is a well-documented process and is known to those skilled in the art. It is accomplished through basic level application programming interface (API) and/or other coding utilized by the manufacturer and/or operating system provider of the smartphone to connect and interact with the phone's hardware and operating system features.
- API application programming interface
- the application interface is built through a series of screens that contain a combination of buttons, text information, graphics and/or interactive objects that are part of the interface API functions of a smartphone.
- Examples of interactive objects include virtual graphic buttons, physical buttons that are part of the phone itself, text boxes, selection lists, radio buttons, check boxes and other objects as are known to those skilled in the art.
- Interactive objects leverage user feedback in order to take action and are generally part of the smartphone's operating system API.
- the inclusion of the interface as a part of the instant invention is necessary not for the novelty of creating an interface but for the novelty of the interface itself and also for the novelty in how the interface is being applied to the utilization of the various embodiments of the invention described herein.
- system and method of the instant invention may be adapted to operate with any number of mobile device operating systems (including without limitation iOS, Android, etc.), mobile devices (including without limitation iPhones, iPads, etc.) and desktop operating systems (Mac OS, Windows, etc.). All such mobile operating systems, devices and desktop operating systems are included with the scope of the instant disclosure.
- mobile device operating systems including without limitation iOS, Android, etc.
- mobile devices including without limitation iPhones, iPads, etc.
- desktop operating systems Mac OS, Windows, etc.
- the system and method of the present invention provides a simplified mobile device interface.
- the exemplary interfaces illustrate simplified mobile device navigation and provide:
- Some of the novel features of the interface, also shown in FIG. 1 . include:
- the interface of the primary smartphone application 206 can be customized to hide and/or to turn on and off other applications, phone features and buttons (such as the search button, home button, or the camera or web browser).
- the software of the system and method of the present invention can run in the background to provide the powerful caregiving connectivity features that assist with both resolving urgent situations and enhancing daily interactions even if the simplified interface is turned off.
- the interface helps facilitate the navigation and use of the monitoring and caregiving features described herein through direct access to many of those features and the configuration of those features.
- many of those would-be primary mobile application users are not able and/or willing to use the smartphone in its native form because of any combination of issues, such as: over complexity of the phone including features and functions that are foreign and wouldn't be utilized by the user; small or difficult to read fonts and font size; lack of enough contrast among graphics and text that make it difficult to see and/or read; difficulty configuring the phone with the functions desired; difficulty navigating the phone because of concepts and features not found in traditional phones; etc.
- the primary mobile application 206 interface With the primary mobile application 206 interface, many of these users would now be able to successfully use a smartphone to make calls and then leverage the smartphone to interact with loved ones and caregivers because the interface provides an easy, intuitive way for them to use a smartphone and a direct, easy and intuitive way to perform the many helpful caregiving functions of the primary mobile application 206 described in this document. If enabled, the primary mobile application interface will run as soon as the smartphone itself is booted up as part of the start sequence in order to mask other smart phone functions via the interface.
- the primary mobile application 206 functions by resting in a home state and then being triggered to change states based on a variety of internal and/or external triggers. The application 206 then takes action in those different states, sometimes switching among the states, until completing the series of tasks and returning to the home state configuration.
- FIG. 15 illustrates the core process functioning of the primary mobile application 206 by detailing some of the major different states and state changes that the phone goes through when the primary smartphone application 206 (with or without the interface enabled) is running.
- the home state is the default starting point for the system.
- the application displays a simplified interface for the user 750 to interact with the primary smartphone 206 unless the user has turned off the interface as described above. If the interface is disabled, the user 750 interacts with the mobile phone operating system regularly while the primary application core activities run in the background.
- the smartphone's 206 operating system API allows users to create activities/processes and have them run in the background. Either way (interface enabled or disabled), in the home state, some core activities run in the background, idle until they are triggered. Examples include: (a) logging, (b) fall detection, (c) idleness checks, (d) wellness/safety checks, (e) other monitoring and notification functions, and (f) direct connect receiver that are described herein.
- These background activities of the primary mobile application system 206 may or may not prompt user interaction at different points. When invoked, these background activities may change the state of the phone to require an interaction either from the primary mobile user 750 or remotely from an authorized remote user 760 .
- the states displayed in FIG. 15 and shown below illustrate a sampling of changes from the home state that may prompt a user interaction:
- FIG. 2 illustrates the system and method of the present invention used to remotely initiate and create a live phone (cellular) and/or Internet audio and/or video connection to a primary mobile phone 206 where the primary mobile phone user 750 does not actively answer the phone, click any button, or initiate any other kind of activity.
- This process may collectively be referred to herein as a “direct connect” or “direct connection.”
- the purpose of a direct connection is to allow an authorized remote user 760 the ability to see, hear and interact with the primary mobile application user 750 at the authorized remote user's discretion, and to connect with the primary application user 750 (which may be a care recipient) for primarily concerning, urgent or potentially urgent situations.
- the authorized remote user 760 might also leverage the information gathered through the monitoring processes and logged from the primary smartphone application 206 in order to help illustrate what may have transpired recently with the primary mobile application user 750 .
- the primary mobile application user 750 responds negatively to a wellness check survey from the primary mobile application 206 , perhaps indicating they aren't feeling well.
- the primary mobile application 206 recognizes the input response as a negative response because response options are pre-configured in the primary mobile application 206 as positive, negative or neutral.
- the application 206 may respond to the primary application user 760 with a follow-up question based on the logic tree of the wellness check or perhaps it may recommend calling a doctor or 911.
- the primary user 750 may choose to take action or may choose not to call or take action.
- the primary mobile application 206 may send an electronic notification (email, SMS and/or securely through the web portal application 204 and/or the secondary mobile application 206 to inform the remote authorized user(s) 760 of wellness check outcome and subsequent activities of the primary mobile application and primary mobile phone 206 including but not limited to: any calls made; date/time-stamped history of location(s) to which the phone traveled tagged with (or without) pictures and/or video taken at those periodic intervals throughout the day; and/or any relevant urgent- or non-urgent producing notifications.
- the remote authorized user 760 may then have called the primary application user 750 with no response.
- the remote authorized user 760 having special permission in the primary mobile application 206 configuration, may then initiate a direct connect to turn on the primary authorized user's phone to try and interact with them to make sure they are alright and taking the appropriate actions.
- the steps for a direct connection in one embodiment of the system and method of the present invention comprise:
- Step 1 Initiation
- a remote authorized user 760 presses a button to initiate a direct connection from either a web application 202 or a secondary mobile phone application 204 .
- “Urgent Connect Now” 302 on the web application 202 and “Direct Connect” 304 on the secondary mobile application 204 are exemplary buttons.
- the option to press the button is available only to pre-authorized users 760 whose electronic profile has been specially flagged in the primary application system 208 data store (stored on a suitable computer system) and/or communicated to the primary smartphone application 206 data store during either the application setup or configuration processes and stored in the configuration data 660 that is shared among the primary application system 208 , the primary smartphone 206 and the web portal application 202 and secondary mobile phone application 204 as being allowed to initiate a direct connection.
- Step 2 Notification of Direct Connect Intention
- the system and method of the present invention will initiate an Internet-based Voice-Over-IP (VOIP) call, cellular call and/or hybrid VOIP-cellular call to the primary mobile smartphone 206 through the primary application system 208 or another method.
- VOIP Voice-Over-IP
- the smartphone has video conference capabilities
- the web-portal application 202 via the primary application system 208 will initiate a video conference call instead.
- the primary system application 208 will recognize video conference capabilities through configured settings in the primary application system 208 data store that maintain status of whether the primary smartphone 206 has the hardware and software capability for video conferencing.
- such information is linked and stored during the setup and/or configuration process and stored in the configuration data 660 that is shared among the primary application system 208 , the primary smartphone 206 and the web portal application 202 and secondary mobile phone application 204 .
- the system and method of the present invention will directly call the primary mobile phone 206 through a cellular network, VOIP and/or hybrid VOIP-cellular call or indirectly call the primary mobile phone 206 via the primary application system 208 using cellular network, VOIP and/or hybrid VOIP-cellular call.
- the secondary mobile (or smartphone) application 204 will initiate a video conference call instead that may go directly to the primary mobile phone 206 or indirectly through the primary application system 208 .
- the primary smartphone application 206 and/or the primary application system 208 will recognize video conference capabilities through configured settings in the primary application system 208 data store that maintain status of whether the primary smartphone 206 has the hardware and software capability for video conferencing.
- the clicking of the direct connect button in web portal application 202 and secondary mobile application 204 will also notify the primary application system 208 that a direct connect call is being placed as well as set specialized flags in the primary application system 208 and/or the secondary mobile application system 204 that a direct connect call is being requested.
- the web portal application 202 and/or the secondary mobile phone application 204 of the system and method of the present invention will electronically notify the primary application system 208 that a direct connection call is being requested as well as set specialized flags in the primary application system 208 and/or the secondary mobile application system 204 that a direct connect call is being requested.
- Step 3 Authentication & Validation
- Step 2 There are two major alternatives based on the process followed in Step 2 :
- the primary mobile smartphone application 206 will recognize the caller or the source of the call (audio and/or video call) as it is pre-configured with authorized user 760 identifiable information and/or secondary mobile phone 204 identifiable information.
- the primary mobile smartphone application 206 will pick up any combination of the source phone number, source IP address, and/or other user identifiable information associated with the person initiating the direct connection as obtained by logging into the web portal application 202 and/or the secondary mobile application 204 .
- the primary mobile smartphone application 206 recognizes the source as having permission to direct connect and automatically causes the primary smartphone itself 206 to connect/pick up the direct call and/or video conference call (if video conferencing is available and enabled). If video conferencing is not enabled, then the primary mobile phone 206 may enable it and then connect or respond video conference dial to the initiating web portal 202 and/or secondary mobile phone application 204 .
- the primary mobile smartphone 206 makes an electronic authorization and validation request of the primary application system 208 to ensure:
- That the requesting source is an authorized source, and/or
- the primary mobile smartphone application 206 Upon authorizing and validating, the primary mobile smartphone application 206 causes the primary smartphone to pick up the call or call back the source through cellular, VOIP and/or hybrid cellular-VOIP means. If video conferencing is not enabled, then the primary mobile phone 206 may enable it and then connect or respond with video conference dial to the initiating web portal 202 and/or secondary mobile phone application 204 .
- the primary application system 208 will electronically notify the primary mobile smartphone 206 that an authorized direct connection is being requested (via a web-based/Internet application data transfer, text message, email or other electronic means).
- the primary smartphone application 206 will automatically call the requesting web portal 202 user 760 and/or secondary mobile phone 204 user 760 through cellular, VOIP and/or hybrid cellular-VOIP means. If video conferencing is requested then, if it is not enabled, then the primary mobile phone 206 may enable it and then connect or respond with video conference dial to the initiating web portal 202 and/or secondary mobile phone application 204 .
- the web portal application 202 (as linked with the primary application system 208 ) and/or the secondary mobile phone application 204 will have had a flag set to automatically pick up call from the primary smartphone 206 and/or the primary application system 208 from Step 1 .
- the primary mobile smartphone application 206 will (with reference to FIG. 6 ) turn on the speakerphone(s) 608 , microphone 606 , turn up the volume 630 , identify primary smartphone location (turning on location identification features if they are disabled 610 , 612 , 616 ), turn on camera 604 and snap pictures (not snapping pictures if video conferencing is selected) via the phone's API, group & link the information together and send it to the primary application server 208 via the notification system 670 .
- Step 4 Call Pickup and Information Viewing
- Step 3 There are three optional paths that stem from the two major alternatives from Step 3 :
- Primary smartphone application 206 automatically picks up phone call. For video conference viewing, primary smartphone application enables camera module 604 and automatically connects via video conference.
- Secondary mobile application 204 and/or web portal interface 202 automatically picks up phone call.
- primary smartphone application 206 automatically connects via video conference.
- An indicator flag in the secondary mobile application 204 and/or web portal interface 202 informs the respective application to automatically pickup/connect.
- Secondary mobile application 204 and/or web portal interface 202 automatically picks up phone call.
- primary smartphone application 206 automatically connects via video conference.
- An indicator flag in the secondary mobile application 204 and/or web portal interface 202 informs the respective application to automatically pickup/connect.
- the primary application system 208 will package up all the information gathered and sent from the primary smartphone 206 in Step 3 and make it available to authorized users 760 for viewing via the web portal interface 202 and/or the secondary mobile application 204 .
- the information can be viewed simultaneously, before and/or after the call and/or video call is made.
- the primary smartphone application 206 may also cause a loud ring and/or automated voice to inform user 750 that a direct connect is underway and also may cause the primary smartphone 206 to visually cue the user 750 through changes in color, text, vibration and/or possibly other cues.
- FIG. 16 shows the process flow from initiation to connection, specifically illustrating how particular connectivity options for a direct connect described above may be selected by the collective system of the invention.
- the direct connection request has been received by the primary mobile application 206 , perhaps through SMS or email electronic communication.
- the request may have come directly from the remote authorized user's 760 phone via the secondary mobile application 204 or through the primary application system 208 via the secondary mobile application 204 or from the web portal application interface 202 .
- the monitoring process 650 of the primary mobile application 206 recognizes the direct connection request and triggers the intelligent event identification engine 710 to collect phone data around whether the primary phone 206 can connect to the Internet and if the connection is strong and fast enough.
- the monitoring process 650 would trigger the mobile application 206 to look up the phone number of the authorized remote caregiver 760 in the primary application data storage/database and initiate an audio/cellular call back to that phone number.
- the requestor application i.e., the secondary mobile application 204 and/or the web portal application 202
- the requestor application having flagged itself as attempting to direct connect to a particular phone in its own configuration, would identify the incoming phone number as belonging to the primary mobile application 206 , recognizing it as pre-authorized, automatically answer the call.
- the phone could ring until the remote authorized user 760 picked up the auto-returned phone call.
- the primary mobile application 206 may dial a bridge number into the primary application system 208 , which may then bridge dial the remote authorized user's phone through telephonic bridging/PBX (private branch exchange)/conferencing technology.
- PBX private branch exchange
- the remote authorized user's phone 204 may already have dialed into the primary application system's 208 PBX/conferencing technology and be conferenced with the primary mobile phone 206 .
- the primary application 206 may recognize Internet access as existent and sufficient, however the initiating secondary mobile application 204 may detect lack of Internet connectivity or sufficient Internet bandwidth/speed. In such an instance, the secondary mobile application 204 may initiate a cellular/audio-only direct connect to the primary mobile application 206 with a special flag indicating that an Internet connection will not suffice. The primary mobile application 206 will interpret the flag and not attempt an Internet, video and/or VOIP connection but only an audio/cellular direct connection as previously described.
- Internet connectivity from both the initiating phone 204 or web application 202 , as well as from the primary mobile application 206 is existent and sufficient.
- a call back is initiated by the primary mobile application 206 via its VOIP (voice over IP) client that connects to a VOIP server as part of the primary application system 208 .
- the VOIP server also connects to the secondary mobile application 204 and/or the web application 202 in advance of notifying the primary mobile application 206 , or after notifying, or after the primary mobile application 206 has a VOIP connection with the VOIP server.
- the VOIP server therefore bridges/creates the connection then between the primary mobile application 206 and the initiating secondary mobile application 204 and/or web application interface 202 .
- a direct connect call results in creating a live phone call 514 and/or live video conference 504 without the user 750 of the primary mobile phone 206 taking action.
- the type of call possible will depend on the quality of connection—if the cellular/internet connectivity is fast enough to support video calling that would take preference over or audio calling. In that case, as a backup, the system and method of the present invention uses a cellular audio call.
- Internet existence and sufficiency is determined through API calls checking signal existence and strength of cellular Internet networks and wireless network detections. Pinging certain websites and/or servers using internet protocol calls and timing and comparing response rates is another method that may be used. Such checks are performed on both sides of the connection (the secondary mobile application 204 or web application 202 and the primary mobile application 206 ). Notifications are sent among systems using electronic communication—usually some/any combination of SMS texting, email and/or Internet protocol though also possibly via modem or other electronic communication methods that basic operating systems (and possibly their APIs) interact with. Audio calls and call answering are triggered through the device's APIs. VOIP/video conference connections may be established over Internet protocol through interfacing with VOIP clients and server APIs.
- FIG. 4 provides an illustration of an instance of a direct connect call in place.
- a direct connect call has been initiated and is in session.
- the initiating user through their web portal interface 202 and/or secondary mobile application 204 can see what the primary phone owner 406 is doing through the camera module 604 on the primary smartphone 206 .
- the initiating user 760 is conversing 404 through the direct connection via the speakerphone 608 and microphone 606 on the primary smartphone 206 to the primary owner 406 .
- FIG. 5 provides an illustration of exemplary information provided to the web portal application 202 and/or to the secondary mobile application 204 in conjunction with a direct connect call in one embodiment of the system and method of the present invention. This information is generally available to authorized remote users 760 who are logged into the web application interface 202 and/or secondary mobile application 204 at any time, including when the urgent notifications have been issued and otherwise.
- the purpose of the information made available is to provide a broad and deep picture of what has been and is going on with the primary mobile phone application 206 and the primary mobile user 750 and to also help manage the daily caregiving features, urgent connectivity features, interface features and general phone features of the primary mobile application and primary mobile phone 206 .
- the information can help determine the primary user's 750 whereabouts, their well being status (in part through status of status and/or wellness checks), indicate whether any (alarming) incidents occurred (such as dialing 911 and/or a fall detection) and related details; indicate whether they have been following certain patterns of behavior; and, indicating whether the phone 206 (and the user 750 ) have not moved for a period of time and/or that the phone 206 (and the user 750 ) did not reach an intended destination.
- any (alarming) incidents such as dialing 911 and/or a fall detection
- the information can also indicate whether the user 750 has indicated that they have been taking medication; whether the user 750 confirmed certain alarm reminders; whether the user 750 has been making phone calls—and to when and to whom they have been calling; whether or not the user 750 have been sending and/or receiving messages; and/or whether the phone battery died or the phone is not in signal range (cellular and/or internet cellular and/or Wi-Fi).
- the information may also prompt the remote authorized user 760 to take action(s), which may include among the many actions described in the present invention: editing, altering, adding or removing reminders including medication reminders (such as taking, refilling and/or renewing medication), updating medical profile information, editing, altering, adding or removing particular automated wellness checks, setting location reminders, sending messages or information; updating or changing the primary mobile application 206 user interface, updating numbers for auto-conferencing on the primary mobile application 206 , updating caregiver notification settings and so on.
- action(s) may include among the many actions described in the present invention: editing, altering, adding or removing reminders including medication reminders (such as taking, refilling and/or renewing medication), updating medical profile information, editing, altering, adding or removing particular automated wellness checks, setting location reminders, sending messages or information; updating or changing the primary mobile application 206 user interface, updating numbers for auto-conferencing on the primary mobile application 206 , updating caregiver notification settings and so on.
- This sample information is provided and accessible to the user 760 (e.g. caregiver or authorized user) who may be initiating a direct connect call on either the web portal application 202 and the secondary mobile application 204 and also to the primary smartphone user 750 on the web portal application 202 and the primary mobile application 206 .
- the method and process of the invention calls for any and all of the information illustrated in FIG. 5 to be available.
- the sample information should not be construed as exhaustively conveying all possible relevant information being made available and those skilled in the art will recognize that other types of information may be shared without departing for the scope of the instant disclosure.
- sample information may include in one embodiment of the system and method of the present invention (with reference to FIGS. 5 and 6 ):
- the current and historical location and movement history 502 as determined through GPS 610 , wireless 614 , and/or cellular 616 location determination systems and accelerometer 612 logged with primary phone 206 date and time from internal clock 622 as periodically checked through the monitoring processes 650 and configured through the configuration processes 660 of the primary smartphone application 206 . Additionally, location and movement history 502 may have photo and/or video snippets 504 tagged from the camera module 604 being engaged periodically by the monitoring processes 650 and configuration processes 660 that can be viewed. Location and movement history may be displayed in a textual format and/or via one or more markings or images of locations overlaid upon one or more map images.
- clicking on a particular location via a map or link or inputting a particular location into input fields on the primary web interface 202 and/or secondary mobile application 204 can search the historical logs/database 720 for other instances of the primary mobile application recording being at or around (within a predetermined distance radius) that location and return a listing of those instances with date/times, duration, and potential pictures and/or videos that may have been tagged and logged.
- the process flow for the logging process itself for most types of logging is shown and described in FIG. 21 .
- the phone call history log 506 of inbound, outbound, missed and connected calls may also be available for view. Those calls that were auto third party conferenced via the primary mobile application 206 may also be specially marked. Furthermore, clicking on a particular phone number or inputting a particular phone number into input field(s) on the primary web interface 202 and/or secondary mobile application 204 can search the historical logs/database 720 for other instances of the primary mobile application and or phone 206 recording making those phone calls and return a listing of those instances with date/times, duration, and potential location information that may have been tagged and logged. The logging process flow for most types of logging is shown and described in FIG. 21 .
- the current and historical phone status 508 of the primary smartphone application 206 may also be available.
- the basic logging process is shown and described in FIG. 21 .
- the FEATURES logged may include current and historical information on the primary smartphone's 206 battery life, charging history, when the phone's signal status has been strong, weak or non-existent, availability of 3G and/or 4G networks, location date/time stamping as well as the current status of key phone features 602 which includes enabled or disabled status of camera module 604 , microphone 606 , speakerphones 608 , GPS 610 , accelerometer 612 , wireless radio/LAN 614 , cellular system 616 , Bluetooth radio 618 , touch screen 620 , internal clock 622 and other relevant phone features 630 .
- the user 760 may be able to enable or disable any of these phone features remotely through the web portal application 204 and/or the secondary mobile application 204 . Doing so consists of changes to the configuration files that get pushed to the primary smartphone 206 from the secondary mobile application 204 and/or the web portal application 202 and pushed through directly or via the primary application system 208 .
- a history of the outcome status of status and/or wellness check-ins 516 as well as a log of the status and wellness check-ins 518 , including the questions, user responses and phone actions and corresponding notifications may also be available for view.
- Status and wellness checks are performed via the process shown and described in FIG. 19 . As well, the information and status around any fall detection, phone shaking and/or 911 calls by the primary smartphone application 206 may be made available.
- Urgent notifications In the case of a fall/shaking, the primary smartphone fall detection process would be triggered. The process indicating how this is done is shown and described in FIG. 17 . For example, if the phone 206 fell or was shaken, the phone 206 would recognize this event, and trigger a check to see if the user 750 has indeed fallen. The user 750 can indicate to the primary smartphone application 206 that they were alright, causing the alert to be dropped, but the event would still be logged in the system.
- a history of alerts and reminders 520 for the primary smartphone user 750 as well as medication reminders 522 , the primary smartphone user's 750 responses and any notification(s) and/or subsequent action(s) that the primary smartphone application 206 may have taken based on user responses may also be available.
- the primary smartphone application's 206 medical profile 524 and history of changes to the medical profile 524 as well as any medication reminder history 522 and changes may be made available.
- the current configuration 526 of the primary smartphone application 206 which includes settings around the user interface, settings for urgent connectivity and monitoring as well as settings for non-urgent, daily interactions may also be available for viewing and altering. Any changes made on the web portal application 202 and/or secondary mobile application 204 are saved as configuration file changes and pushed out to the primary mobile application 206 to incorporate the new configuration changes either directly or through the primary application system 208 .
- a novel portion of the system and method of the present invention are the monitoring processes that look, listen for and act on a series of triggers, including but not limited to: primary phone/application usage 206 , remote authorized user interactions 760 , and location-based and other situational triggers, including potentially urgent situations. These triggers, in combination with the monitoring processes allow for the unique and high level of caregiving interactivity described. Below is further detail around the monitoring processes.
- FIG. 6 illustrates the monitoring and notification process components and steps. Illustrative flows for sample monitoring processes are shown in FIG. 17 and FIG. 18 .
- FIG. 7 further illustrates the internal detail of the monitoring processes and event notification process.
- FIG. 8 illustrates examples of notification triggers used by the monitoring processes.
- FIG. 20 shows the notification process.
- the monitoring processes 650 digests the data collected 702 from the various described phone features 602 and other relevant phone features 630 .
- This data collected 702 includes current and historical status of the various monitoring processes 650 as they are configured 660 .
- An intelligent event identification engine (IEIE) 710 looks for pattern matches against predetermined scenarios and rules set in the configuration 660 and monitoring processes 650 engines.
- the IEIE 710 may be setup to utilize various rules and analysis to help in capturing events.
- the IEIE 710 can compare a series of readings collected from the location sensor to identify locations visited in the day. In another example, the IEIE 710 can evaluate data from accelerometers to identify movement (e.g., is the user moving?). That information is then processed for appropriate event notification 670 based on notification configuration 730 .
- the intelligent inferences themselves 512 as well as the notification events 670 that occurred based on the inferences 512 may be made available.
- the intelligent inferences themselves 512 may also be used as triggers to create notification or other events 670 , including initiate a direct connection to authorized remote users 760 or other relevant parties, including 911 or urgent call centers, and/or to trigger some other monitoring process 650 , logging event 720 and/or trigger some other action within the primary smartphone application 206 , primary application system 208 , the web portal application 202 , and/or the secondary mobile application 204 .
- the primary phone 206 hasn't moved for several hours during the day—this is called an “idleness” situation.
- the monitoring process 650 records movement at several intervals and compares each as shown and described in FIG. 18 .
- the idle behavior is identified by comparing the location of the primary smartphone with previous location readings. Location readings are taken according to a polling frequency for collecting location data (here PFREQ) and stores those location readings in a log, via the process identified in FIG. 21 .
- PFREQ polling frequency for collecting location data
- the system identifies this as an “idle situation.” Otherwise, if distance is not within the LOCATION_RANGE, the phone is considered to have moved and the process is reset for the next PFREQ. If the distance is within the LOCATION_RANGE but the TGT_PERIOD has not been reached, the monitoring process will wait for further data points.
- the information is logged as an idle event in the primary mobile application system.
- the information is logged in the system log, potentially transmitted as an event notification to the primary application system 208 and an idle status check is initiated.
- the idle check is an interactive messaging to the user 750 and may involve validating with the user their status (asking if they are alright, indicating that the phone hasn't moved in TGT_PERIOD) and creating notifications for the appropriate recipients. If the user indicates they are ok and/or have moved in the TGT_PERIOD, the system goes back to waiting for the next reading according to PFREQ. If the user does not indicate that they are alright or indicates a negative response, then the system may perform other notification events to authorized users 760 and/or 911 based on the primary smartphone application's 206 configuration.
- the monitoring process 650 recognizes that both location and phone position haven't moved. It also may recognize that there has not been user activity on the phone 260 in the form of moving or carrying the phone 260 , making phone calls, or navigating in the phone in any way. Other data points may also be considered into the idleness assessment.
- the monitoring process 650 also may recognize that on that particular day or date during that particular time period, the phone 260 is normally at or near a different location (perhaps at a particular address). This is done by the IEIE 710 through a comparison of historical data—dates, times and locations and looking for patterns in movement to the same locations and deviations from those patterns. It may also recognize that an authorized remote user 760 (e.g. caregiver) has specified that if the phone 260 doesn't move during that period of time then to notify specified contacts registered in the configuration 660 and in the primary smartphone application 206 . Examples of contacts—authorized remote users 760 —include, but are not limited too, that remote user 760 , other remote users, family, friends, professional caregivers, medical providers, medical centers, specialized living facilities and/or urgent call centers.
- the intelligent event identification engine 710 recognizes these patterns and makes inferences that lead to notification of specified contacts and/or a wellness/status check-in, direct connection, and or other action of the primary smartphone application 206 to the primary smartphone application user 750 .
- the responses of that user 750 are processed and may lead to a notification of specified contacts, logging to be made available for further monitoring processes 650 to leverage the intelligent event identification engine 710 , direct connection and/or other actions specified in the primary smartphone application 206 .
- the primary smartphone application 206 monitoring processes 650 recognizes that the phone 260 hasn't reached a destination that it regularly does during that date, day and/or time period or a location that was specified by an authorized remote user 760 in the configuration 660 .
- the monitoring processes 650 may also record lack of movement and/or other indicators that a problem may exist.
- the intelligent event identification engine 710 will identify pattern matches of problems and/or look for specific problems and take appropriate actions and notifications as specified in the primary smartphone application 206 , possibly including but not limited to wellness/status check-ins and/or creating a direct connection.
- the monitoring processes 650 record movement of the phone 260 over time. Based on the frequency and pattern of location and/or accelerometer (positioning) movement, the intelligent event identification engine 710 may infer that the user 750 is walking versus driving or vice versa. That information may then be recorded for further inferences by the intelligent event identification engine 710 or used to notify authorized parties, direct connect, automated check-in and/or take some other action of the primary smartphone application 206 .
- the monitoring processes 650 record movement of the phone 260 over time.
- the monitoring processes 650 may also cause the phone's camera module 604 to record one or more photographs and/or video.
- the primary smartphone application 206 may recognize the photo as dark, and the intelligent event identification engine 710 may recognize that a dark picture along with the frequency and positioning of the primary smartphone as determined by the GPS 610 , accelerometer 612 , wireless radio/WAN 614 and cellular system 616 imply that the primary smartphone application user 750 is a walking and may be carrying the primary smartphone in a bag or purse.
- camera module 604 is used to take a picture of a prescription, perhaps on a prescription bottle or carton or any other medium.
- the monitoring processes 650 and specifically the intelligent event identification engine 710 can use image character recognition and determine that the contents of the image are, indeed a prescription based on characteristics common to all prescriptions (such as medication name, dosage, frequency, number of refills, prescribing physician, etc.).
- the primary smartphone application 206 will then automatically directly through notification to the primary application system 208 may electronically contact the pharmacy and/or medical practice to request a refill and/or renewal.
- the prescription information could also be redirected to create medication reminder alerts to take and/or to refill that particular medication using the alerts capabilities of the primary smartphone application 206 and/or to update the medical profile on the primary smartphone application 206 and/or other third party software.
- the monitoring processes 650 may monitor the primary smartphone's battery for dissipation status and patterns of dissipation that may correlate with various dates, days and/or times. Similarly, the monitoring processes 650 may monitor the primary smartphone's signal strength for patterns of signal strength and loss based on location pattern and/or date, day and/or time. In both situations, the intelligent event identification engine 710 may look for patterns to anticipate for the primary smartphone application 206 user when the battery might run low and/or signal strength might dissipate.
- an event notification 670 may be triggered to notify the primary smartphone application user 750 and/or authorized external parties 760 and may direct specific action (such as ringing the primary smartphone application user and telling user visually and/or audibly to plug in the phone and/or to make any necessary calls now perhaps with reasons as to anticipated future phone status—depending on the situation).
- monitoring process 650 and intelligent event identification engine 710 are also used in several of the features of the invention described in the instant application.
- cellular and Internet connectivity to a mobile phone can be established automatically and/or remotely when the mobile phone has been idle, not having had a cellular and/or Internet connection for some period.
- a primary application system 208 will send an electronic notification to the primary mobile smartphone 206 via one or a combination of methods such as SMS text message, cellular call, VOIP call, email or Internet connection.
- the primary mobile smartphone application 206 will recognize the source of the call as being from the primary application system 208 , as pre-configured in the software and will immediately initiate Internet protocol communication to the primary application system 208 and/or cellular communication to the phone's cellular network. If a connection cannot be made immediately, the primary smartphone application 206 + can be configured to periodically re-attempt both connection types (Internet and/or cellular connection) until contact is made.
- the system and method of the present invention is configured to periodically and/or through a series of predetermined times and/or via a pre-determined trigger(s) 802 (as identified in the monitoring processes 650 ) automatically turn on the mobile phone's location positioning features (e.g., such as GPS, multilateration of radio signals, and/or other mobile positioning technologies) if location positioning features had been off, then, once on, log the phone's location position with a date/time stamp, optionally automatically snap picture(s) and/or video(s) and send all that linked data/information via Internet, cellular or other remote electronic connection to another user via an Internet website, an email, text message and/or other form of electronic message.
- location positioning features e.g., such as GPS, multilateration of radio signals, and/or other mobile positioning technologies
- the system and method of the present invention is configured to automatically send an event notification 670 (in the form of a call, electronic and/or otherwise or subsequent notification, action and/or trigger) to the primary smartphone application 206 , the primary smartphone application user 750 , the primary application system 208 , the secondary smartphone application 204 , the web portal interface 202 and/or to an authorized external party 760 (e.g., 911, an urgent call center and/or authorized care providers and/or an Internet site) if the mobile phone 260 is dropped, has not been moved or moved from a geographical location for a predetermined amount of time, if the phone has not reached a predetermined geographical destination by a certain date and time, if the mobile user 750 has not “checked in” by pressing a special button on the phone 260 , by not satisfactorily answering a wellness check or mobile medical survey on the mobile phone 260 and/or by pressing a button on a separate wireless device linked/connected with the mobile phone 260 .
- an authorized external party 760 e.g.
- All of these notification triggers 802 are recognized through the intelligent event identification engine 710 and processed accordingly.
- the monitoring process 650 will recognize if any kind of action or notification event required, partly based on the notification configuration 730 . If so, an event notification 670 may be triggered.
- the primary smartphone mobile application 206 can be configured to remain in a listening status via its monitoring processes 650 to automatically take action (as defined above) upon one or more of the following occurring:
- the mobile application system 206 can be configured to immediately notify user(s) 750 , 760 and/or primary application system 208 immediately upon one of the foregoing events occurring and/or initiate an inquiry to the mobile user 750 and/or remote user 760 to check on the primary mobile application user's 750 status.
- the mobile application can ask the user 750 if they are alright visually and/or audibly through texts, pictures, voice and/or rings/alarms and then listen for a response via a button press and/or audio response (possibly using voice recognition) input of the monitoring processes 650 .
- the application system can then notify the authorized user(s) 750 and/or 760 and/or primary application systems 206 and/or 208 for further action. Notification can be in any combination of the forms described above as well as logged 720 for future access by authorized user(s) 750 , 760 .
- the notification process flow for the primary smartphone/application is shown and described in FIG. 20 .
- Notifications can be automated, periodic events or asynchronous events caused by the primary smartphone application 206 monitoring processes or through interactions or physical requests from primary mobile application users 750 and/or remote authorized users 760 as described in this document and in the description of log triggering events in FIG. 21 .
- a notification event is triggered.
- the monitoring processes will first identify recipients that are flagged to be notified for that particular notification event based on the primary smartphone application's configuration.
- the monitoring process will then determine if the notification is flagged as a critical event notification. If it is, the notification will be sent to the predetermined recipients 750 , 760 either directly and/or through the primary application server 208 . It will then return to the home or previous state.
- the monitoring process will check if the SYNC_PERIOD time interval has been reached. If not, the monitoring process will wait until the SYNC_PERIOD time interval has been reached. Once the SYNC_PERIOD time interval has been has been reached, the monitoring process will check the battery status. If the battery power is below a minimum threshold, BATT_MIN, the notification event will be logged and queued for the monitoring process to attempt at the next SYNC_PERIOD time interval. If the battery power is sufficient (at or greater than BATT_MIN), then the monitoring process will confirm whether any kind of call (regular or direct connect) is in session with the primary smartphone. If the primary smartphone application 206 is unable to send the notification event while a call is in session, it will log the event and queue it to send either when the call is completed or at the next SYNC_PERIOD.
- BATT_MIN a minimum threshold
- the notification will be sent to the identified recipients 750 , 760 either directly and/or through the primary application server 208 and the phone will then return to the home or previous state.
- FIG. 21 is a flowchart illustrating the logging process in accordance with the principles of the system and method of the present invention.
- the flowchart illustrates the process for how the system and method of the present invention determines the timing and actions of a logging event. As illustrated, there are three main triggers that cause a logging event:
- a predetermined time schedule determines periodic logging.
- LOGPERIOD denotes the time between logging runs as stored in the primary smartphone application 206 database.
- the monitoring processes described in FIG. 7 recognize when a scheduled logging is going to occur. For example, LOGPERIOD could be set at every hour, at which time, the data called for to be logged in that log type is pooled together.
- Option B A change or event-driven log. Examples include but are not limited to logging the responses of a wellness check, logging if a user shakes the primary mobile smartphone 206 to indicate an urgent 911 dial or dials 911 directly or through hot button, logging a fall detection and user responses, and/or logging reminders and user responses.
- An authorized remote user 750 can request a log of certain data related to the primary smartphone application 206 —including, but not limited to: phone movement history (such as GPS/location movement), phone logging, data around delivery and responses to wellness checks and/or reminders (including medication-related reminders), phone idleness, any alerts, etc.
- phone movement history such as GPS/location movement
- phone logging such as GPS/location movement
- data around delivery and responses to wellness checks and/or reminders including medication-related reminders
- phone idleness any alerts, etc.
- the caregiver could press a button on their secondary mobile application 204 or the Internet portal application 202 and trigger a collection of data to be logged and sent to the primary application system 208 to be viewed on either system ( 202 , 204 ).
- Each notification trigger of any notification trigger type will have FEATURES of data and information to be collected and logged.
- the monitoring processes include preconfigured definitions of these triggers and the data to be collected in regard to each. For example, a periodic log may track location movement (e.g. GPS or other location-determining system), phone movement (even if in same location), capture photos and/or video to link with the location and phone movement and a date/time stamp.
- location movement e.g. GPS or other location-determining system
- phone movement even if in same location
- capture photos and/or video to link with the location and phone movement and a date/time stamp.
- the monitoring processes recognize the different data requirements of that log (as determined in the configuration.
- the monitoring processes will then look at the status of the battery life of the primary smartphone to see if the battery life is greater than a minimum power requirement, BATT_MIN. If the battery is below the BATT_MIN level, the primary smartphone application 206 will add a local log on the primary smartphone application database indicating battery is too low to send the pooled data to the primary application server 208 . It will abort the log attempt. However, in a slightly altered version, if the primary smartphone application determines that the primary smartphone has enough battery to send a basic message around the battery log but not enough battery to send the larger pooled data collection, it may send a notification message to the primary application server 208 indicating as such.
- BATT_MIN a minimum power requirement
- the monitoring processes will then determine whether the primary smartphone is on a call—cellular or Internet/VOIP-based, including whether it is a standard, typical phone call or a direct-connect call as described in this application. If any call type is in session, the primary smartphone application 206 will wait for a period of time to re-attempt the call logging action, as defined in LOG_REATTEMPT. This assumes that the primary smartphone application 206 is unable to log data at the same time a call is in session. If the smartphone allows the data to be logged while a call is in session and/or if the mobile carrier allows for data to be separately sent while in a call, then this step can be bypassed.
- the monitoring processes of the primary smartphone application 206 will then collect the data regarding the identified FEATURES.
- the monitoring processes will turn on (if necessary) any primary smartphone hardware or software component such as those identified in 602 or primary smartphone application feature necessary to collect that data and then collect the data. Otherwise, the data will simply be collected from the data store in the primary mobile application 206 .
- the data will then be written to the system log of the primary mobile application 206 . It may also be sent to the primary application server 208 as a notification event. The primary application will then return to the previous state of the application prior to the logging event.
- the monitoring process for identifying a fall is illustrated in FIG. 17 .
- the primary smartphone application 206 is actively listening and collecting the phone's accelerometer/orientation/positioning information according to a predefined interval, PFREQ, and storing the data in a log for comparison on the primary smartphone application 206 .
- the application 206 is then comparing the log of the data (accelerometer/orientation/positioning data) and determining whether the difference in the movement data points over a predetermined period of time PREQ is equal to or greater than ACCEL_MAX, indicating a high acceleration to warrant a consideration of a falling event.
- the application 206 is then comparing the log of the data (accelerometer/orientation/positioning data) and determining whether the vertical height location difference is equal to or greater than HGHT_MAX, indicating that the fall was from a large enough height to consider it a falling event for the purposes of checking-in with the phone user 750 .
- the monitoring processes continue to listen for further events. However, if both criteria as described are met, then a falling event is stored in the log on the primary mobile application 206 and potentially sent to the Primary Application System (PAS) 208 . The user 750 is then prompted to see if they are alright. If the user responds they are alright, then the monitoring process resets and waits for the next event. If the user indicates they are not alright or does not respond at all, the monitoring process logs event locally and may create a notification event to inform the PAS 208 , authorized remote user(s) 760 and/or 911.
- PAS Primary Application System
- the system and method of the present invention is configured to automatically notify specified users 760 (e.g., care providers) via web portal application 202 and secondary mobile application 204 if calls are made to a predetermined list of phone number(s). For example, automatically notify authorized users 760 (via call, electronic message or otherwise) when the mobile user's doctors, nurses, therapists, etc. are dialed and called—and then log 720 and/or send that information with date/time stamp via Internet and/or cellular network using email, SMS, Internet upload or other electronic connectivity.
- specified users 760 e.g., care providers
- web portal application 202 and secondary mobile application 204 if calls are made to a predetermined list of phone number(s). For example, automatically notify authorized users 760 (via call, electronic message or otherwise) when the mobile user's doctors, nurses, therapists, etc. are dialed and called—and then log 720 and/or send that information with date/time stamp via Internet and/or cellular network using email, SMS, Internet upload or other electronic connectivity.
- the smartphone application software 206 can be configured to take specialized action based on a user making calls to certain phone numbers and/or specified users.
- the actions can include notification events 670 (e.g. call, electronic message or otherwise) to authorized user(s) 750 , 760 , as well as logging of information in the primary system for later access by authorized user(s).
- the monitoring processes 650 check call attempts against the configuration setup 660 and matching numbers result in an event notification 670 to corresponding systems and parties 202 , 204 , 206 , 208 , 760 based on notification configuration 730 .
- the system and method of the present invention is configured to automatically party conference the mobile phone 206 with pre-determined specified user(s)/care provider(s) 760 via telephonic and or Internet connectivity (cellular, VOIP, hybrid cellular-VOIP, PBX and/or other call conferencing technology) when calls are made to specific, predetermined phone number(s).
- the smartphone application system 206 can be pre-configured and/or updated through the configuration process 660 with specific phone numbers that when dialed from the primary smartphone 206 result in a party-line conference call to pre-determined specified user(s) 760 via telephonic and/or Internet connectivity.
- FIG. 10 illustrates an example of the interactivity between the primary smartphone application 206 and the secondary smartphone application 204 of the invention for purposes of establishing a conference call with authorized third party 760 based on a call by the primary smartphone application 206 to a predetermined phone number.
- a call to predetermined phone number results in a notification to an authorized third party 760 via SMS, email or secondary mobile application 204 .
- the secondary mobile application will receive a notification with optional response button(s) 1002 .
- Clicking the response buttons 1002 results in either direct notification to the primary smartphone application 206 via electronic communication (SMS, internet, or other) causing the primary smartphone 206 to auto conference the secondary mobile application's 204 phone number or indirect notification to the primary smartphone application 206 via electronic communication (SMS, internet or other) to the primary application system 208 that notifies the primary smartphone application 206 to initiate a conference call inclusive of the secondary smartphone/application 204 and the intended phone number.
- the primary application system 208 may initiate the party conference to the primary smartphone/application 206 , the secondary smartphone/application 204 and the intended phone number.
- all embodiments of the method and system descried in the instant application related to auto conferencing should be construed to include conferencing in pre-authorized users 760 on any phone in addition or substitution to a secondary mobile application 204 phone and/or to the pre-authorized user's 760 web portal application 202 .
- the secondary mobile application 204 and the web portal application 202 allows for the interactivity of response 1002 , including but not limited to prompting the pre-authorized user to be conference called by the system 206 , 208 or possibly to have the primary smartphone application 206 or primary application system 208 record the phone call or simply ignore the call.
- This type of interactive response may also be achieved by other phones not running the secondary smartphone application software 204 through either specific text/SMS interaction and responses and/or audio request with voice recognition and/or number responses on the phone keypad that are interpreted by the primary smartphone application 206 and/or primary application system 208 to take one or any of the actions described above.
- the conferencing process of the system may work as described above and/or in one or a combination of the following three methods:
- the primary smartphone application system 206 uses the cellular network's party conference capability to automatically dial the number being called as well as the pre-authorized user(s) 760 .
- the primary smartphone application 206 does not actually dial the number specified but alternatively dials a different phone number that connects with a remote application system 208 (via cellular, Internet and/or hybrid cellular-Internet method or other).
- the remote application system 208 creates a party conference with the primary smartphone 206 user 750 , the originally intended phone number and the pre-authorized user(s) 760 .
- the primary smartphone application 206 will send an electronic notification to the remote application system 208 either before making the call (as in Option 1) or upon pressing the dial button (as in Option 2).
- the remote application system 208 via monitoring processes 650 will then recognize the call as a party conference call, log the action request 720 , optionally notify pre-authorized users 760 via electronic application notification, text and/or email and/or other notification event 670 and initiate the telephone calls.
- the initiating primary smartphone application 206 Upon pressing the dial button, the initiating primary smartphone application 206 first sends a notification to pre-configured authorized user(s) 760 phones (which as previously described may or may not use a secondary mobile application 204 or web portal application 202 ) as well as to a remote application system 208 via electronic data and/or telephonic means (including using cellular, Internet, and/or hybrid cellular-Internet means).
- the authorized user(s) 760 may see the action being initiated through a secondary remote application 204 on their mobile phone and/or via a text message, email, Internet web portal 202 and/or other electronic and/or telephonic notification.
- the authorized user(s) 760 can then respond to the notification to:
- the call is not placed and the original user 750 may be notified via the primary smartphone application 206 , the remote application system 208 and/or directly via an electronic and/or telephonic means to the initiating primary smartphone 206 .
- the electronic and/or telephone response is sent either directly to the initiating primary smartphone 206 or indirectly via the remote application system 208 .
- the party conference can be created either directly from the initiating primary smartphone 206 (as described in Option 1) or from the remote application system 208 (as described in Option 2).
- the smartphone application 206 can be set to automatically record the conversation via the primary smartphone application 206 or the primary application system 208 .
- Either system can also be set to automatically send notification 670 using the same means as described herein.
- the system and method of the present invention is configured to allow the primary mobile user 750 or an authorized user/care provider 760 to create custom, automated wellness checks or surveys that the mobile user 750 responds to once or periodically and which can have custom actions associated with particular responses and/or results based on software customization.
- FIG. 11 illustrates an example of an automated wellness check question according to the principles of the system and method of the present invention.
- Examples of particular automated notification events 670 by the software would be electronic notification to authorized caregivers and/or notification to urgent response center and/or 911 760 containing or providing access to survey results, medical or other information, including software-triggered recommendations, mobile phone location tracking information, pictures, audio and/or video captured from the mobile phone 206 .
- the system and method of the present invention is configured such that a user 750 , 760 can create a series of questions/surveys 1102 for the primary mobile smartphone application 206 that have pre-configured response actions 1104 .
- the response inputs 1104 can vary in number and type—such as a button selection, menu list selection and/or text input.
- the user 750 can input information via touch and/or voice response recognition.
- the primary smartphone application 206 will record and log the responses along with a date/time stamp and electronically send the information for data collection 702 to a remote application system 208 to be monitored 550 by the intelligent event identification engine 710 and for access via a web portal 202 and/or secondary remote mobile application 204 by authorized user(s) 750 , 760 .
- Certain specific responses 1104 and/or response patterns recognized by the intelligent event identification engine 710 can be set 730 to initiate selective actions/event notifications 670 , such as urgent notification to 911 and/or an urgent response center and/or authorized user(s) 760 .
- Other actions include special instructions provided to the primary smartphone user 750 , location tracking initiated and information sent to pre-authorized user(s) 760 , camera enabled and pictures to be automatically taken via camera module 604 and sent or live video conference initiated to pre-authorized user(s) 760 and/or direct connect capabilities initiated (as described herein).
- the survey(s) can be created on the primary smartphone 206 itself and/or on a remote application system 202 , 204 by an authorized user(s) 760 that then gets uploaded electronically to the primary smartphone application 206 .
- the survey(s) can be configured 660 to be asked at a particular date/time and/or periodically via preset days, times and/or periods of time that authorized user(s) 750 , 760 configure.
- the survey(s) can be saved on the remote application system 208 where they can be enabled and/or disabled, saved for later use, and/or reconfigured or re-customized.
- FIG. 19 is a flowchart illustrating the process followed to execute, collect and log answers for a safety or wellness check in accordance with the principles of the system and method of the present invention.
- SFREQ and/or WFREQ a particular safety and/or wellness check is initiated according to the monitoring processes.
- the primary smartphone application user 750 will responds to the series of questions as described, with each question and answer being logged accordingly in the primary application system 206 .
- individual and/or collective answers options can be preconfigured to trigger a notification event, including to authorized remote users 760 .
- an event notification is created and triggered to notify the primary application system 208 , authorized remote users 750 and/or possibly 911.
- the responses are logged and the system either continues to ask further questions of the safety/wellness check or completes the status/wellness check and logs the response locally on the primary smartphone application 206 and may send information to primary application system 208 .
- the system and method of the present invention is configured to provide caregiving features to a primary smartphone application user 750 through a primary mobile smartphone 206 and/or remote Internet application 202 , 208 and/or secondary mobile application 204 , including but not limited to those mentioned elsewhere in the application as well as those mentioned below.
- FIG. 12 illustrates exemplary interfaces on the primary smartphone application 206 for some of the caregiving features described according to the principles of the system and method of the present invention.
- FIG. 12 specifically illustrates examples of medically-related instructions, specialized alarms, medication tracking & renewal/refill reminders and potential actions/hot buttons that can be defined and used according to the principles of the system and method of the present invention.
- Medically-related instructions including therapy and medication instructions or other information, news and/or instructions 1208 relevant to the primary smartphone user 750 sent to mobile user 750 by authorized remote user/caregiver or authorized medical provider 760 .
- Examples of other kinds of information 1208 include addresses, driving directions and/or other instructions.
- Specialized alarms, alerts and schedules 1202 , 1204 , 1206 that notify the primary smartphone user 750 of appointments and provide related, relevant information.
- an appointment reminder 1206 that also includes instructions on diet and driving directions linked together and then logged on the primary mobile phone application 206 and primary application system 208 and via Internet with date/time stamp, the type of alert or alarm, the information linked with alarm and the mobile user's response (such as acknowledgement of the alarm).
- alarms, alerts & schedules are specialized notification objects that may contain the standard event information (such as date/time, subject, description, alarm repeat information & duration) as well as having an active status (active or inactive), specialized system messages and trigger links Some of the trigger links may be tied to the user interface, such as with action buttons beyond the usual confirmation, snooze and cancel buttons.
- These notification objects are incorporated into the monitoring processes 650 and intelligent event identification engine 710 and could be linked with actions/notification events 670 that can be taken. Examples include a medication refill alert that prompts the user 750 to push a button to directly call the user's preferred pharmacy, the phone number of which is stored and specially flagged in the database by the primary mobile application 206 .
- a medication renewal alert may prompt a button that directly calls the prescribing physician, whose information is stored and linked with the medication in the medical profile data of the primary mobile application 206 . It could be that the phone number for that physician is also, separately, flagged for auto third party conferencing of a specified remote authorized user 760 . Upon pressing the call button, the primary mobile application 206 will call the physician and go through the auto third party notification and conferencing process described previously in this application.
- a medication, refill or renewal reminder will have an option for the user 750 to select that they no longer take that medication. Doing so may stop any further alarm reminders that the system was configured to deliver by removing the alert, causing it to be inactive or removing any future repeat configurations on the alert.
- alarms, alerts and schedules can be setup on the primary mobile phone 206 itself or remotely through a cellular and/or Internet connection by the user 750 and/or by an authorized user/caregiver 750 .
- Medication tracking features that notify primary application user 750 when time to take a medication, and/or when a medication refill and/or medication renewal is approaching 1204 and whether a refill is available. These medication tracking features are incorporated into the monitoring processes 650 and intelligent event identification engine 710 and can be linked with actions/notification events 670 that can be taken.
- the primary mobile application 206 and/or the primary application system 208 can automatically request a refill and/or renewal on medications or can prompt the mobile user 750 to have the system 206 , 208 automatically request a refill and/or renewal to the physician(s) and/or preferred pharmacy via pressing an action button 1210 or through voice recognition on the primary smartphone application 206 according to profile as stored in the primary user's configuration 660 .
- the system and method of the present invention is configured to log the events, information and associated actions via the data collection process 702 for reference by the primary user 750 and/or by an authorized user/caregiver 760 .
- These medication tracking features and actions can be setup directly on the primary mobile phone application 206 or remotely through a cellular and/or Internet connection by an authorized user/caregiver 750 using the web portal 202 and/or the secondary smartphone application 204 .
- buttons dialers for initiating calls to urgent calls to 911 and/or urgent response centers, different operators, concierge service and/or other service providers. Once pressed, these buttons not only connect user 750 to 911 and/or urgent response centers (or other intended receiver), it also causes notification 670 to authorized users/caregiver(s) 760 and a logging of event 720 for view by primary smartphone user 750 and/or authorized remote users 760 .
- These button(s) can be graphical action buttons on the primary mobile phone screen similar to those in 1210 or buttons located outside the screen on the primary mobile phone 206 itself.
- These pre-customized texts can be customized on the primary mobile phone application 206 or remotely on the web portal interface 202 and/or secondary mobile phone 204 by an authorized user/caregiver 760 and electronically sent through the configuration process 660 back to the primary mobile phone application 206 for use with text, email and/or other messaging features utilized by the primary mobile phone application 206 .
- Specialized web/Internet 202 and mobile phone portals 204 for administrative and caregiving access and interaction with the primary mobile smartphone application 206 and among authorized remote users 760 by a primary mobile user's 750 medical providers, living facility administration, urgent response centers, other lifestyle and/or application providers and authorized caregivers 760 .
- Different kinds of authorized remote users 760 may have their own specialized interface to those applications 202 , 204 .
- FIG. 5 illustrates exemplary features that a specialized caregiving Internet portal 202 and secondary caregiver mobile phone application 204 has in the disclosed embodiment of the system and method of the present invention.
- a portal 202 and/or mobile phone application 204 preferably are accessible through both secure Internet and mobile applications, allowing authorized users/caregivers 760 to interact with the primary smartphone user 750 via the primary smartphone application 206 .
- authorized users/caregivers 760 are allowed to update the primary smartphone application settings remotely—such as the phone book 526 , medical profile 524 , calendar appointments 520 , 522 , location tracking interval settings 502 , 504 , call recording and notification settings 504 , 512 , 516 , 518 , 520 , 522 , 526 , urgent notification settings 502 , 512 , 516 , 518 , 520 , 522 , 524 , 526 and usability settings 526 such as changing colors, font size, ring and volume options or others described in the other claims of this application. It could also be used to send information to the primary smartphone application 206 —such as instructions for taking medication or driving directions.
- Examples of remote authorized users 760 might include, but are not limited to: family, volunteer caregivers, occupational therapists, medical providers, and/or independent living facility staff.
- the remote application system 208 , caregiver portal 202 and/or the secondary mobile applications 204 allow the primary mobile user 750 and remote authorized users 760 to also get in touch with the larger caregiver community.
- Authorized users/caregivers 760 can interact with one another, sharing advice or tips. Such users can also find technical assistance.
- the secondary mobile application 204 can co-exist on the primary mobile phone 206 and be used in conjunction with the primary mobile phone application 206 .
- a primary mobile phone user 750 can also serve the role of an authorized remote user 760 and vice versa in various situations.
- a spouse can act as both a care receiver 750 and a caregiver 760 .
- system and method of the present invention is configured such that web portal 202 and the secondary smartphone application 204 provides access to a storefront for obtaining the system software solutions and related cellular hardware, services and accessories.
- One embodiment of the system and method of the present invention further comprises a radio alert connectivity device 1302 that, when activated, sends a signal to its host radio-enabled mobile phone 206 (e.g., via Bluetooth 618 or other radio 616 , 630 ) to dial a predetermined number and/or connect via secure Internet connection to a predetermined application and/or call center and/or other authorized user 760 .
- a radio alert connectivity device 1302 that, when activated, sends a signal to its host radio-enabled mobile phone 206 (e.g., via Bluetooth 618 or other radio 616 , 630 ) to dial a predetermined number and/or connect via secure Internet connection to a predetermined application and/or call center and/or other authorized user 760 .
- FIG. 13 illustrates an example of a radio alert connectivity device according to the principles of the system and method of the present invention.
- the alert connectivity device 1302 also contains a microphone 1306 and speakerphone 1304 that can be used to listen and speak with primary phone user 750 as well as the remotely authorized person/call center 760 to whom the primary smartphone application and phone 206 are connected.
- the device 1302 also initiates location tracking of the primary smartphone device 206 , message notifications 670 (via text, email or Internet) to authorized third parties 760 and picture and/or video capture & send notifications 670 .
- the device 1320 turns the primary smartphone 206 into a mobile Personal Emergency Response System (PERS).
- PES Personal Emergency Response System
- the system and method of the present invention comprises software among the primary system application 208 , the web application 202 and the secondary mobile application 204 configured to remotely customize the primary mobile phone application 206 —including font size, screen colors, volume, creating and setting custom alarms with calling actions, creating and setting custom surveys with calling actions, editing/updating phone contact information, medical profile, turning on/off certain features as well as interacting with the primary smartphone 206 via the methods described in all the claims in this application. Configuration changes and setup are made via the interfaces of the web portal application 202 and/or the secondary mobile application 204 .
- the information is captured and pushed either directly to the primary mobile application 206 or indirectly to the primary application system 208 which may either push the changes through to the primary mobile application 206 real time and/or wait for a synchronization event between the primary mobile application 206 and the primary application system 208 to occur.
- the primary application system 208 will treat the setup and configuration changes as data collected 702 and log the information in the logging database 720 for the monitoring processes 650 , for viewing by primary users 750 and authorized remote users 760 and to eventually push to and synchronize with the primary smartphone application 206 any changes made directly on the primary smartphone application 206 itself.
- the system and method of the present invention is configured to maintain a medical profile of the primary mobile user 750 on the primary mobile phone application 206 that can be accessed and/or updated on the mobile phone 206 itself or remotely via cellular and/or Internet connection by authorized users for use by the primary mobile application 206 .
- FIG. 14 illustrates an exemplary interface showing how a medical profile might function on the primary smartphone application 206 .
- a sticker on the back of the phone 206 provides easy instructions for quick access to the medical profile.
- a medical profile can include, but is not limited to, information such as medical conditions, allergies and/or drug sensitivities, reactions, medical devices, medications, blood type and/or other relevant patient information for reference in urgent and non-urgent medical situations.
- the profile can be updated by authorized users 750 , 760 on the primary smartphone application 206 or remotely through the secure remote application system 208 including an Internet web portal 202 and/or secondary mobile application 204 . Certain parts of the medical profile can be flagged in the application's database by the user to be shown on the home screen and/or locked screen of the primary mobile application 206 .
- the system and method of the present invention is configured to recognize a shaking pattern and/or a voice (through voice recognition) that results in the primary mobile phone 206 answering the phone and/or resulting in taking other pre-determined actions 670 (instead of pushing a button to answer the phone or take an action).
- a predefined physical shaking pattern is into the primary mobile smartphone application 206 , which then senses changes in movement based on the accelerometer/gyroscopic technology 612 embedded in the phone.
- the primary mobile smartphone application 206 can recognize the pattern via the monitoring processes 650 and the intelligent event identification engine 710 and take predetermined actions 670 , such as answering an incoming call and/or taking the response to mean an answer to a question such as “yes” or “no” to a phone survey (as described elsewhere in the instant application) or to initiate a call to a phone number (such as 911 or an urgent call
- the primary mobile smartphone application 206 can prompt the mobile user 750 for whether they would like to answer the phone, dial a user and/or take similar action and then utilize established voice recognition (VR) technology via APIs into that VR software to await a predetermined voice response (such as “Yes” or “Answer”).
- VR voice recognition
- the intelligent event identification engine 710 can recognize and match the pattern it sees, consult the configuration 660 and create appropriate event notifications 670 .
- the primary mobile smartphone application 206 and/or the secondary mobile application 204 is configured to allow the mobile user ( 750 , 760 ) to switch back-and-forth between standard telephonic, cellular-based audio phone connectivity and a VOIP/Internet-based audio and/or video connection, including while a phone call is underway or while it may appear to the user that the phone call is underway.
- FIG. 1 shows an example of this functionality
- FIG. 22 a illustrates the process of the system and method of the present invention for switching from a standard telephonic, cellular-based audio phone call to an Internet-based, VOIP connection that allows both audio and/or video connectivity while a standard, telephonic, cellular-based audio phone call is underway within the application system.
- FIG. 22 b illustrates the process of the system and method of the present invention for switching from an Internet-based/VOIP connection to a standard telephonic, cellular-based audio phone call while an Internet-based/VOIP connection is underway within the application system.
- the user 750 , 760 can switch among a standard telephonic, cellular-based audio call, a VOIP-based audio call and a VOIP-based audio/video call. This is initiated by either the primary mobile user 750 pressing a button to switch (as illustrated in FIG.
- connection switch between audio and/or video and audio may be accomplished as follows:
- the initiating user When the initiating user is in a standard telephonic, cellular-based audio call, they will have the option to select a button that indicates they can switch to a VOIP call (and possibly given choice whether to maintain audio only or go to video and audio VOIP call).
- the VOIP call button is only active if the local application (which could be 204 or 206 ) of the initiating user has that particular contact in the phonebook flagged in the local database as having VOIP access.
- the local application can check that the remote application has VOIP connectivity after the initiating user clicks on the switch button. Upon clicking, the switch button, the application may confirm intentions with the initiating user.
- a positive response results in the initiating application 204 , 206 showing a message to initiating user to wait while the VOIP connection is established.
- the initiating application's 204 or 206 VOIP client will then initiate a VOIP connection to the same contact as the telephonic phone number as linked in the local application 204 or 206 database. This will be accomplished through the primary application server's (PAS) 208 VOIP server.
- the PAS 208 will electronically confirm the “recipient” mobile application's status of its VOIP client to confirm that it exists, is enabled and possibly that it is connected to the Internet and possibly the strength of connection.
- the PAS 208 will send an electronic message to the initiating mobile application 204 , 206 that the other party does not have VOIP available and the standard, telephonic audio call will continue. If the call has already been dropped for any reason (including dropped by the initiating application 204 , 206 in order to attempt a VOIP connection), then the message from the PAS will trigger the initiating application 204 , 206 to auto-dial the original contact phone number and the recipient mobile application 204 , 206 will recognize the phone number and may automatically pick-up the standard, telephonic phone call.
- the PAS 208 is able to confirm that the recipient mobile application's 204 , 206 VOIP client's status (i.e., that it exists, is enabled and possibly that it is connected to the Internet and possibly connection strength) then the PAS's 208 VOIP server will reach out to the recipient application's 204 , 206 VOIP client and establish a bridge connection with the initiating application's 204 , 206 VOIP client.
- either the initiating mobile application 204 , 206 or the PAS 208 will have notified the recipient remote application 204 , 206 to disconnect the standard telephonic audio call and enable, if disabled, the recipient mobile application's 204 , 206 VOIP client. If the notification came from the initiating mobile application 204 , 206 , then the initiating mobile application 204 , 206 will also disconnect the audio call on its own phone. If the notification came from the PAS 208 , the PAS 208 will also notify the initiating mobile application 204 , 206 to disconnect from the standard telephonic call, likely after confirming that a VOIP connection could be established.
- the VOIP connection will toggle back and forth in what is an established process for the VOIP connection.
- the initiating user clicks on a button to switch during the call and the process of the system and method of the present invention, as illustrated in FIG. 22 b , is as follows:
- the initiating user When the initiating user is in a VOIP-based audio or audio/video call, they will have the option to select a button that indicates they can switch to a standard telephonic, audio-based cellular call. Upon clicking, the switch button, the application may confirm intentions with the initiating user. A positive response will cause the initiating application 204 , 206 to then check whether a cellular signal is available (and possibly strong enough). If not, a message will indicate this to the user and the existing VOIP-based call will continue. Alternatively, initiating application 204 , 206 could continuously check status of cellular signal and disable switch when cellular signal is not available.
- the initiating application 204 , 206 will message the initiating user to wait while a standard call is established. The initiating application will then initiate a cellular call to the recipient application's 204 , 206 phone.
- both initiating and recipient application's 204 , 206 are able to maintain both a VOIP connection and standard cellular connection simultaneously, then the recipient application 204 , 206 will recognize the phone number via the contact link in the application's 204 , 206 database and automatically pick up the phone. At that point, the VOIP connection could be dropped by the initiating application, the receiving application 204 , 206 or the PAS's 208 VOIP server.
- either the initiating or recipient application's 204 , 206 phone (or both) are unable to simultaneously maintain a VOIP connection and standard cellular connection simultaneously, then either the initiating application 204 , 206 , the recipient application 204 , 206 or the PAS 208 will cause the VOIP client to drop the connection prior to initiating the cellular call.
- the initiating mobile application 204 , 206 would have electronically communicated the intention of the connection switch to both the PAS 208 and recipient application 204 , 206 via electronic communication methods, possibly including via VOIP connection, other internet connection or SMS.
- VOIP calls can be made from the outset (not only switched during calls) via the primary mobile application 206 , the secondary mobile application 204 and/or the web application system 202 .
- the local phonebook database within all those applications is configured to register whether a contact has registered a compatible VOIP client with the PAS 208 .
- system and method of the present invention comprises the aggregated feature set and/or subsets of the capabilities and features described in this application, for use in connecting primary users 750 and authorized remote parties 760 (e.g. caregivers) with one another for urgent and non-urgent situations.
- the feature set includes but is not limited to audio and/or video direct connect, automated remote connectivity, automated call conferencing based on predetermined phone numbers, location tracking, automated picture and/or video sending/remote camera monitoring, automated location tracking with photo and/or video logging, intelligent monitoring of urgent and non-urgent situations, including but not limited to lack of movement with the primary mobile phone 206 , lack of reaching a location by the primary mobile phone 206 , automated fall detection, automated wellness checks/custom actionable surveys, as well as remotely updating and customizing the primary mobile phone application 206 from a secure Internet application 202 and/or secondary mobile applications 204 and a specialized user interface that compels the primary application user 750 to utilize their smartphone 206 though it is not required to make use of the application features described herein.
- the system and method of the present invention further comprises a unique purchase and installation process.
- those wishing to purchase the software and/or devices compatible with the system and method of the instant invention can either call or visit a predetermined website 202 .
- the website makes recommendations for specific smartphones that have been thoroughly tested to be compatible with the system and method of the present invention.
- a secondary mobile application 204 can also be separately purchased and/or downloaded.
- the secondary mobile application 204 is not necessary for receiving text messages or calls on their cell phones.
- Electronic disclaimers and authorization forms for primary users 750 and authorized user(s)/caregiver(s) 760 If the primary user 750 is not the purchaser or present on the phone when purchasing, they will need to authorize usage on their phone 206 when it is received.
- the primary mobile application 206 will be configured and customized so that the phone 206 is ready to go when the user 750 receives it. After a user 750 , 760 has completed the order, they are presented with an optional online tutorial.
- the primary smartphone application 206 will automatically run and initiate a “startup” process to activate the phone, provide electronic disclaimer/authorization, and to provide an optional tutorial to demonstrate how the phone works.
- the user 750 , 760 may connect to a system operator for a talk-through demonstration and to answer any questions.
- the primary smartphone application 206 will have pre-installed all of the preference settings provided during the purchase process, which then can be adjusted at any time on the phone 206 or remotely by an authorized user/caregiver and/or company authorized operator 760 .
- the primary user 750 already has a smartphone that is compatible with the primary smartphone application 206 , they can go to an authorized marketplace to purchase and download the primary smartphone application software 206 to their smartphones. They then can visit a specific website 202 to provide additional user information, setup authorized user(s)/caregiver(s) 760 , customize other user settings and purchase any additional hardware or accessories (as described above). Alternatively, the user can open the newly downloaded primary smartphone application 206 and/or secondary mobile phone application 204 which will also walk them through the setup process on the phone itself as well as provide the appropriate electronic disclaimer(s).
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Life Sciences & Earth Sciences (AREA)
- Business, Economics & Management (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Public Health (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Pathology (AREA)
- Biophysics (AREA)
- Veterinary Medicine (AREA)
- Animal Behavior & Ethology (AREA)
- Surgery (AREA)
- Molecular Biology (AREA)
- Heart & Thoracic Surgery (AREA)
- Emergency Management (AREA)
- Theoretical Computer Science (AREA)
- Nursing (AREA)
- Emergency Medicine (AREA)
- Critical Care (AREA)
- Computing Systems (AREA)
- Epidemiology (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Primary Health Care (AREA)
- Databases & Information Systems (AREA)
- Telephone Function (AREA)
- Telephonic Communication Services (AREA)
Abstract
A system and method for remote care and monitoring of the user of a mobile device, such as a smartphone, and for simplifying use of the mobile device by the user. The system and method comprises software, operable on the mobile device and/or a remote device (such as another smartphone, a computer (including, for example, a web-based application system) or other device), for facilitating the use of a mobile smartphone device while also enabling authorized users (e.g. care providers) to remotely interact with the mobile user, provide them medical care information, daily care instruction, immediate connectivity, mobile phone control and tracking functions, general assistance as well as remotely updating and maintaining the mobile user's mobile device.
Description
- This application is a continuation of U.S. application Ser. No. 13/612,368, filed Sep. 12, 2012, which claims benefit of U.S. Provisional Patent Application Ser. No. 61/533,600, filed on Sep. 12, 2011, the disclosure of each of which is incorporated herein by reference.
- The present invention relates generally to remote care and monitoring and, more particularly, to a system and method for remote care and monitoring of the user of a mobile device, such as a smartphone, and for simplifying use of the mobile device by the user.
- This invention provides a unique software solution and method for facilitating the use of a mobile smartphone device while also enabling authorized users (e.g. care providers, concerned family members) to remotely interact with the mobile user, provide them medical care information, daily care instruction, alerts and reminders, general assistance, immediately connect to the mobile user's phone without them answering, provide the authorized users remote mobile phone control and tracking functions as well as remotely updating and maintaining the mobile user's mobile device.
- Mobile phones historically developed for use by elderly, children or special needs groups have consisted of traditional push button cell phones modified in certain ways—via some combination of a simplified digital menu, amplified speaker, enlarged and/or paired down buttons and sometimes the addition of an urgent call and/or specialized operator button. The use of GPS or other locating device technologies has also been incorporated into some of these traditional phones for informational or emergency location purposes.
- These traditional mobile phones, however, have not had the capabilities to facilitate a higher level of interaction between a mobile user and their care provider(s). While some have had features for remotely updating contact information, sending text messages or having an operator assist with dialing, there are many features and capabilities that these telephones do not have. For example, these traditional mobile phones do not have the following capabilities:
-
- a. Allow for remotely initiating and creating a live phone (cellular) and/or Internet connection to a primary mobile phone where the primary mobile phone user does not actively answer the phone, click any button, or initiate any other kind of activity in order to do the following:
- i. Remotely enable the mobile phone's speakerphone, turn up the speaker volume and turn on the microphone in order to hear and speak with whoever or whatever is near the mobile phone itself from a secure Internet application and/or a secondary phone (land or mobile).
- ii. Remotely turn on the mobile phone's camera, automatically snap pictures and/or videos, and send them via cellular network and/or Internet using Internet upload, email or text methods to an authorized Internet site and/or specified mobile phone(s).
- iii. Remotely turn on the mobile phone's video conferencing and connect over cellular network or Internet with an authorized user via an Internet portal or specified secondary mobile phone(s).
- iv. Remotely turn on the mobile phone's location capabilities (GPS and cellular-network-based location positioning) and send those coordinates via Internet and/or cellular network using Internet upload, email or text methods to an authorized Internet site and/or specified mobile phone(s).
- b. Periodically and/or through a series of predetermined times and/or via a pre-determined trigger(s) (such as those described in the instant application) automatically turn on the mobile phone's location positioning features (e.g., such as GPS, multilateration of radio signals, and/or other mobile positioning technologies) if location positioning features are off, then log the phone's location position along with a date/time stamp, possibly automatically snap picture(s) and/or video(s) (where it could be accessed on the phone) and send all that data/information via Internet or cellular connection to another user via an Internet site, email or text.
- c. Automatically send a notification (call, electronic and/or otherwise) to 911, an urgent call center and/or authorized care providers and/or an Internet site if the phone is dropped, has not been moved or moved from a geographical location in a predetermined time, if the mobile user has not “checked in” by pressing a special button on the phone, by not satisfactorily answering a wellness check or mobile medical survey on the mobile phone and/or by pressing a button on a separate wireless device linked/connected with that mobile phone.
- d. Automatically notify authorized users (care providers) and/or Internet site if calls are made to a predetermined list of phone number(s). For example, automatically notify (via call, electronic message or otherwise) when the mobile user's doctors, nurses, therapists, etc. are called—and then log and/or send that information with date/time stamp via Internet and/or cellular network using email, SMS, Internet upload or other electronic connectivity.
- e. Automatically third party conference in pre-determined authorized user(s)/care provider(s) when calls are made to specific, predetermined phone number(s) using telephonic and/or Internet connectivity.
- f. Connect wirelessly to a Personal Emergency Response System.
- g. Automatically call the mobile user and/or create specialized rings/and or audio notification for when the phone battery is low and requires plugging in and/or if there is no cellular signal and also automatically notify pre-determined authorized user(s) and/or Internet site of the low battery.
- h. Maintain mobile user's medical profile and/or other key care information on the phone for use by physicians, nurses, therapists, emergency personnel or other medical providers. This information can be accessed and maintained locally on the phone and/or remotely via a cellular network, Internet or other electronic remote connection.
- i. Maintain an automated medication alarm & schedule that can be updated remotely by an authorized user/care provider via electronic connection.
- j. Allow the user to request medication refills via the mobile device that automatically send a request to the user's corresponding physician.
- k. Allow an authorized user/care provider to locally and remotely maintain the mobile user's phone calendar/alarm with appointment information, date & times.
- l. Allow others to send the mobile user information from a file such as Microsoft Word, Adobe Acrobat or web file (HTML-based) or a variety of image files.
- m. Allow an authorized user/care provider to create custom “quick texts” for the mobile phone that allow the mobile user to text message people/contacts/phone numbers without having to type out the text messages themselves.
- n. Allow an authorized user/care provider to create custom, automated wellness checks or surveys that the user responds to once or periodically and which can have custom actions associated with particular responses and/or results based on software customization. Examples of particular automated actions by the software would be electronic notification to authorized caregivers and/or notification to urgent response center and/or 911.
- o. Allow an authorized user/care provider to view the message logs of the mobile phone (such as text messages, calendar and alarm notifications, and other notifications, including those automatically created).
- p. Allow an authorized user/care provider to turn on and off different functions and features on the phone remotely via Internet or their own mobile phone.
- q. Create hot-button dialers for different operators, concierge service, urgent care or other service providers.
- r. Create a platform by which other medical/lifestyle/other application providers can interact with the mobile phone.
- s. Provide a navigational interface on the phone that interacts with the user to facilitate cellular phone navigation, including hiding and/or turning on and off certain features and buttons;
- t. Allow for voice-recognition-based dialing and phone navigation.
- u. Alter visual and audio notifications to align with user's needs.
- v. Customize the level of sophistication/complexity of the interface itself, including menu options available, applications available on the phone, ring settings and visual settings—on the phone itself and/or remotely by an authorized person.
- a. Allow for remotely initiating and creating a live phone (cellular) and/or Internet connection to a primary mobile phone where the primary mobile phone user does not actively answer the phone, click any button, or initiate any other kind of activity in order to do the following:
- The introduction of smartphones—mobile phones offering PC-like capabilities with technologies such as contextually changing touch screens, email, Internet browsing, Wi-Fi, GPS, an accelerometer, a magnetometer/compass, a graphical user interface operating system, a camera and the capability to run a variety of software applications—offer this potential. However, smartphones are generally feature-heavy and complicated to use, even with the most basic configurations. While these smartphones may have some of the technology capabilities mentioned available—such as software that provides location alerts or determines phone location—or the capabilities to provide the features mentioned above, the complexity and general feature-rich design of the smartphone has made it difficult for elderly, young children or people with special needs to adopt.
- What is needed, therefore, is a system and method that can provide the aforementioned functionality through smartphone technology. The present invention satisfies this need.
- The present invention comprises a system and method for remote care and monitoring of the user of a mobile device, such as a smartphone, and for simplifying use of the mobile device by the user. As used herein, a “smartphone” or “mobile device” should be construed to include a smartphone (sometimes referred to herein as a “mobile phone” or a “primary” mobile phone or device), a mobile tablet, and other similar portable computing devices which are able to communicate electronically (through means of cellular, wireless and/or radio communication) for which the invention could be deployed.
- In the disclosed embodiment, the system and method of the present invention comprises several components, including software operable on the mobile device and/or a remote device (such as another smartphone, a computer (including, for example, a web-based application system) or other device, sometimes referred to herein as a “secondary” device). More specifically, the present invention comprises:
-
- a. A system and method comprising software, operable on a mobile device, such as a smartphone, that, in part, simplifies the use of a smartphone by acting as an interface between the user and the smartphone features and functions. The software runs on a smartphone's operating system and behaves as a new interface to the end user, altering the phone's user interface, creating new navigation features and hiding access to other features and functions.
- i. The interface and its functions can be customized on the mobile phone itself or remotely via cellular and/or Internet connectivity by authorized users/caregivers. Examples include but are not limited to:
- 1. Creating a larger dial-pad via larger graphics on the touchscreen.
- 2. Simplifying menu items available and providing the ability to turn on and off functions not helpful or too complex to the end user.
- 3. Turning on and off specialized functions that are helpful to the end user and may specifically assist with the user's medical or lifestyle care.
- 4. Enabling a variety of audible and visual ringing/notification and interface options.
- 5. Automatically calling the mobile user and/or creating specialized rings and/or audio notification for when the phone battery is low and requires plugging in and/or if there is no cellular signal. The system and method will also automatically notify authorized users/caregivers when such instances occur, including detailing a log of the situation with location coordinates and date/time stamp.
- 6. Allowing for the creation of graphical emergency/urgent call buttons that provide immediate connection to an operator, 911 and/or urgent care response centers.
- 7. Allowing for voice-recognition-based dialing and phone navigation.
- 8. Allowing for a simpler interface to read and navigate custom news, Internet information and other messages.
- i. The interface and its functions can be customized on the mobile phone itself or remotely via cellular and/or Internet connectivity by authorized users/caregivers. Examples include but are not limited to:
- b. A system and method comprising smartphone connectivity application software, operable on the remote device, that interacts with the smartphone remotely in order to remotely customize the interface software as well as to provide many of the functions and features described in the instant patent application.
- c. A system and method comprising software, operable on the mobile device and/or the remote device, to remotely initiate and create a live phone (cellular) and/or Internet connection to a primary mobile phone when the primary mobile phone user does not actively answer the phone, click any button, or initiate any other kind of activity in order to do any combination or all of the following:
- i. Remotely enable the mobile phone's speakerphone, turn up the speaker volume and turn on the microphone in order to hear and speak with whoever or whatever is near the mobile phone itself from a secure Internet application and/or a secondary phone (land or mobile).
- ii. Remotely turn on the mobile phone's camera, automatically snap pictures and/or videos, and send them via cellular network and/or Internet using Internet upload, email or text methods to an authorized Internet site and/or specified mobile phone(s).
- iii. Remotely turn on the mobile phone's video conferencing and connect over cellular network or Internet with an authorized user via an Internet portal or specified secondary mobile phone(s).
- iv. Remotely turn on the mobile phone's location capabilities (GPS and cellular-network-based location positioning) and send those coordinates via Internet and/or cellular network using Internet upload, email or text methods to an authorized Internet site and/or specified mobile phone(s).
- d. A system and method comprising software, operable on the mobile device and/or the remote device, to establish cellular and Internet connectivity to a mobile phone automatically and/or remotely when that mobile device has been idle, not having had a cellular and/or Internet connection for some period.
- e. A system and method comprising software, operable on the mobile device and/or the remote device, to periodically and/or through a series of predetermined times and/or via a pre-determined trigger(s) (such as those described in the instant application) automatically turn on the mobile phone's location positioning features (e.g., such as GPS, multilateration of radio signals, and/or other mobile positioning technologies) if location positioning features are off, then log the phone's location position with a date/time stamp, possibly automatically snap picture(s) and/or video(s) and send all that linked data/information via Internet, cellular or other remote electronic connection to another user via an Internet website, an email, text message and/or other form of electronic message.
- f. A system and method comprising software, operable on the mobile device and/or the remote device, to automatically send a notification (in the form of a call, electronic and/or otherwise) to 911, an urgent call center and/or authorized care providers and/or an Internet site if the mobile phone is dropped, has not been moved or moved from a geographical location for a predetermined amount of time, if the mobile user has not “checked in” by pressing a special button on the phone, by not satisfactorily answering a wellness check or mobile medical survey on the mobile phone and/or by pressing a button on a separate wireless device linked/connected with that mobile phone.
- g. A system and method comprising software, operable on the mobile device and/or the remote device, to automatically notify specified users (e.g., care providers) and/or an Internet site if calls are made to a predetermined list of phone number(s). For example, automatically notify (via call, electronic message or otherwise) when the mobile user's doctors, nurses, therapists, etc. are called—and then log and/or send that information with date/time stamp via Internet and/or cellular network using email, SMS (short message service), Internet upload or other electronic connectivity.
- h. A system and method comprising software, operable on the mobile device and/or the remote device, to automatically party conference a mobile phone with pre-determined specified user(s)/care provider(s) via telephonic and or Internet connectivity when calls are made to specific, predetermined phone number(s).
- i. A system and method comprising software, operable on the mobile device and/or the remote device, to allow an authorized user/care provider to create custom, automated wellness checks or surveys that the mobile user responds to once or periodically and which can have custom actions associated with particular responses and/or results based on software customization. Examples of particular automated actions by the software include without limitation electronic notification to authorized caregivers and/or notification to urgent response center and/or 911 containing or providing access to survey results, medical or other information, including software-triggered recommendations, mobile phone location tracking information, pictures, audio and/or video captured from the mobile phone.
- j. A system and method comprising software, operable on the mobile device and/or the remote device, for providing caregiving features to a user through a mobile smartphone and/or remote Internet-based application, including without limitation the features discussed above and the following additional features:
- i. Medically-related instructions including therapy and medication instructions sent to mobile user by authorized remote user/caregiver or authorized medical provider
- ii. Specialized alarms, alerts and schedules that notify the user of appointments and provide related, relevant information. For example, a doctor appointment reminder that also includes instructions on diet and driving directions linked together and then logged on the mobile phone and via Internet with date/time stamp, the type of alert or alarm, the information linked with alarm and the mobile user's response (such as acknowledgement of the alarm). These alarms, alerts & schedules could also be linked with actions that the mobile user can take—such as responding with text communication or phone call to relevant parties to the alarm or automatically refilling medication. These alarms, alerts and schedules can be setup on the mobile phone itself or remotely through a cellular and/or Internet connection by an authorized user/caregiver.
- iii. Medication tracking features that notify user when the time for a refill is approaching and whether a refill is available. The system and method can automatically request a refill and/or renewal on medications or can prompt the mobile user to have the system and method automatically request a refill and/or renewal to the physician(s) and/or the user's choice pharmacy. The system and method also logs the events, information and associated actions for reference by an authorized user/caregiver. These medication tracking features and actions can be setup on the mobile phone itself or remotely through a cellular and/or Internet connection by an authorized user/caregiver.
- iv. Specialized hot buttons dialers for initiating urgent calls to 911 and/or urgent response centers, different operators, concierge service and/or other service providers. Once pressed, these buttons not only connect user to 911 and/or urgent response centers (or other intended receiver), they also cause notification to authorized users/caregiver(s) and a logging of event for view by and notification to authorized users/caregiver(s). These button(s) can be graphical action buttons on the mobile phone screen or buttons located outside the screen on the mobile phone itself.
- v. A series of pre-customized texts that the mobile user can use to communicate to authorized users/caregivers and/or medical providers without having to type an entire or portion of a text notification. These pre-customized texts can be customized on the mobile phone or remotely by an authorized user/caregiver.
- vi. Specialized Internet and mobile phone portals for administrative and caregiving access and interaction with the mobile user and among one another by a mobile user's medical providers, living facility administration, urgent response centers, other lifestyle and/or application providers and authorized caregivers.
- k. A radio alert connectivity device that, when activated, sends a signal to its host radio-enabled mobile phone (ex. via Bluetooth) to dial a predetermined number and/or connect via secure Internet connection to a predetermined application (call center or authorized user). The alert connectivity device also contains a microphone and speakerphone that can be used to listen and speak with the person/call center to which the phone connected. The device also initiates location tracking of the smartphone device, message notifications (via text, email or Internet) to authorized third parties and picture capture & send. This functionality essentially turns phone into a mobile Personal Emergency Response System (PERS).
- l. A system and method comprising software, operable on the mobile device and/or the remote device, for remotely customizing mobile phone—including font size, screen colors, volume, creating and setting custom alarms with calling actions, creating and setting custom surveys with calling actions, editing/updating phone contact information, medical profile, turning on/off certain features as well as interacting via the various methods and features discussed herein.
- m. A system and method comprising software, operable on the mobile device and/or the remote device, for maintaining a medical profile of the mobile user on the mobile phone that can be accessed and/or updated on the mobile phone itself or remotely via cellular and/or Internet connection by authorized users.
- n. A system and method comprising software, operable on the mobile device and/or the remote device, for identifying a shaking pattern and/or voice recognition process that results in the mobile phone answering the phone and/or taking other pre-determined actions (instead of pushing a button to answer the phone or take an action).
- o. A system and method comprising software, operable on the mobile device and/or the remote device, to provide the aggregated feature set or subsets of the capabilities and features described herein, for use in connecting users and caregivers with elderly and/or children and/or special needs for urgent and non-urgent situations. The feature set includes without limitation direct connect, automated remote connectivity, location tracking, automated picture sending/remote camera monitoring, automated fall detection, automated wellness checks/custom actionable surveys, remotely updating and customizing mobile phone from secure Internet application/mobile applications).
- p. A unique purchase and installation process.
- a. A system and method comprising software, operable on a mobile device, such as a smartphone, that, in part, simplifies the use of a smartphone by acting as an interface between the user and the smartphone features and functions. The software runs on a smartphone's operating system and behaves as a new interface to the end user, altering the phone's user interface, creating new navigation features and hiding access to other features and functions.
- These and other features and advantages of the present invention will be apparent from the following detailed description, in conjunction with the appended claims.
- The benefits and advantages of the present invention will become more readily apparent to those of ordinary skill in the relevant art after reviewing the following detailed description and accompanying drawings, wherein:
-
FIG. 1 is a series of screen shots illustrating exemplary interfaces in accordance with the principles of the system and method of the present invention; -
FIG. 2 is a flowchart illustrating initiation and creation of a live phone (cellular) and/or Internet connection to a primary mobile phone where the primary mobile phone user does not actively answer the phone, click any button, or initiate any other kind of activity in accordance with the principles of the system and method of the present invention; -
FIG. 3 is a series of screen shots illustrating exemplary “Urgent Connect Now” (on the web application) or “Direct Connect” (on the secondary mobile application) buttons/interfaces in accordance with the principles of the system and method of the present invention; -
FIG. 4 illustrates an exemplary direct connect call in accordance with the principles of the system and method of the present invention; -
FIG. 5 depicts exemplary information provided to the web portal application and/or to the secondary mobile application in conjunction with a direct connect call in accordance with the principles of the system and method of the present invention; -
FIG. 6 is a flowchart showing the monitoring and notification processes in accordance with the principles of the system and method of the present invention; -
FIG. 7 is a flowchart showing further detail of the monitoring processes and event notification process ofFIG. 6 in accordance with the principles of the system and method of the present invention; -
FIG. 8 is a flowchart showing exemplary notification triggers used by the monitoring processes in accordance with the principles of the system and method of the present invention; -
FIG. 9 depicts an example of a fall detected by the primary smartphone application that then triggers an automatic check-in in accordance with the principles of the system and method of the present invention; -
FIG. 10 depicts exemplary interfaces of the primary smartphone application and the secondary smartphone application for purposes of establishing a conference call with authorized third party based on a call by the primary smartphone application to a predetermined phone number in accordance with the principles of the system and method of the present invention; -
FIG. 11 depicts an exemplary automated wellness check question in accordance with the principles of the system and method of the present invention; -
FIG. 12 depicts a series of exemplary interfaces on the primary smartphone application for a plurality of the caregiving features in accordance with the principles of the system and method of the present invention; -
FIG. 13 depicts a front view of an exemplary radio alert connectivity device in accordance with the principles of the system and method of the present invention; -
FIG. 14 depicts a series of exemplary interfaces on the primary smartphone application for medical profile in accordance with the principles of the system and method of the present invention; -
FIG. 15 is a flowchart illustrating the overall operation of the primary smartphone application in accordance with the principles of the system and method of the present invention; -
FIG. 16 is a flowchart illustrating the process by which a direct connect call may be initiated in accordance with the principles of the system and method of the present invention; -
FIG. 17 is a flowchart illustrating the monitoring process for determining whether the user/primary smart phone device has fallen in accordance with the principles of the system and method of the present invention; -
FIG. 18 is a flowchart illustrating the monitoring process for assessing and evaluating a potential “idleness” event and follow-up actions as a result in accordance with the principles of the system and method of the present invention; -
FIG. 19 is a flowchart illustrating the process followed to execute, collect and log answers for a safety or wellness check in accordance with the principles of the system and method of the present invention; -
FIG. 20 is a flowchart illustrating the notification process flow for dispensing notifications in accordance with the principles of the system and method of the present invention; -
FIG. 21 is a flowchart illustrating the logging process in accordance with the principles of the system and method of the present invention; -
FIG. 22 a is a flowchart illustrating the process for switching from a standard telephonic, cellular-based audio phone call to an Internet-based, VOIP connection that allows both audio and/or video connectivity while a standard, telephonic, cellular-based audio phone call is underway within the application system in accordance with the principles of the system and method of the present invention; and, -
FIG. 22 b is a flowchart illustrating the process of switching from an Internet-based/VOIP connection to a standard telephonic, cellular-based audio phone call while an Internet-based/VOIP connection is underway within the application system in accordance with the principles of the system and method of the present invention. - The benefits and advantages of the present invention will become more readily apparent to those of ordinary skill in the relevant art after reviewing the following detailed description and accompanying drawings.
- While the present invention is susceptible of embodiment in various forms, there is shown in the drawings and will hereinafter be described a presently preferred embodiment with the understanding that the present disclosure is to be considered an exemplification of the invention and is not intended to limit the invention to the specific embodiment illustrated.
- It should be further understood that the title of this section of this specification does not imply, nor should be inferred to limit, the subject matter disclosed herein.
- In a disclosed embodiment, the system and method of the present invention comprises the individual and aggregated feature set and/or subsets of the capabilities and features described in the instant application, for use in connecting
primary users 750 and authorized remote parties 760 (e.g., caregivers) with one another for urgent and non-urgent situations. - The feature set includes but is not limited to audio and/or video direct connect, automated remote connectivity, automated call conferencing based on predetermined phone numbers, location tracking, automated picture and/or video sending/remote camera monitoring, automated location tracking with photo and/or video logging, intelligent monitoring of urgent and non-urgent situations, including but not limited to lack of movement with the primary
mobile phone 206, lack of reaching a location by the primarymobile phone 206, automated fall detection, automated wellness checks/custom actionable surveys, as well as remotely updating and customizing the primarymobile phone 206 application (it will be appreciated thatreference numeral 206 refers to the primary mobile phone with software installed thereon, sometimes referred to herein as the “application,” for causing the primary mobile phone to operate in accordance with the principles of the system and method of the present invention) in from asecure Internet application 202 and/or secondarymobile applications 204 and a specialized user interface that compels theprimary application user 750 to utilize theirphone 206 though it is not required to make use of the application features described herein. - The system and method of the present invention is designed, in part, to interact with some of the innate programmed features of the mobile phone but mask the phone's standard user interface and navigation so that those innate features (such as the dialer, the user phone book, the web browser, the camera, battery indicator, and menu options) are accessible to the user in a simplified, easier-to-use interface presented to the primary mobile application user. Developing an interface that overlays an existing interface is a well-documented process and is known to those skilled in the art. It is accomplished through basic level application programming interface (API) and/or other coding utilized by the manufacturer and/or operating system provider of the smartphone to connect and interact with the phone's hardware and operating system features.
- The application interface is built through a series of screens that contain a combination of buttons, text information, graphics and/or interactive objects that are part of the interface API functions of a smartphone. Examples of interactive objects include virtual graphic buttons, physical buttons that are part of the phone itself, text boxes, selection lists, radio buttons, check boxes and other objects as are known to those skilled in the art. Interactive objects leverage user feedback in order to take action and are generally part of the smartphone's operating system API. The inclusion of the interface as a part of the instant invention is necessary not for the novelty of creating an interface but for the novelty of the interface itself and also for the novelty in how the interface is being applied to the utilization of the various embodiments of the invention described herein.
- It will be appreciated by those skilled in the art that the system and method of the instant invention may be adapted to operate with any number of mobile device operating systems (including without limitation iOS, Android, etc.), mobile devices (including without limitation iPhones, iPads, etc.) and desktop operating systems (Mac OS, Windows, etc.). All such mobile operating systems, devices and desktop operating systems are included with the scope of the instant disclosure.
- As seen in
FIG. 1 , the system and method of the present invention provides a simplified mobile device interface. The exemplary interfaces illustrate simplified mobile device navigation and provide: -
- A simple, uncluttered design
- Large, easy-to-read, high-contrast text and buttons
- Intuitive to use, haptic (sensory) feedback that simulates pressing of buttons
- Loud, flashing ring tones
- Voice recognition dialing and navigation integrated
- Video conference capabilities where available
- Clear, easy to read and understand instructions
- A simplified way to read news and information
- Some of the novel features of the interface, also shown in
FIG. 1 . include: -
- Phonebook and other configurable features of the phone and of the primary
mobile application 206 described can be remotely updated by an authorizeduser 760 such as a caregiver or service operator - An alert in the form of a pretend phone call that mimics a real call by alerting the primary
mobile user 750 with a telephone ring and then promptinguser 750 audibly and visually that the battery is low and/or that they are out of cell range - Physical shaking of phone to prompt phone to ask primary
mobile user 750 if they intend to dial 911 or other urgent call center and then do so uponuser 750 confirmation - Allowing the primary
mobile user 750 to make VOIP calls directly from theapplication 206 and/or to switch back-and-forth between standard telephonic, cellular-based audio phone connectivity and/or a VOIP audio connectivity and a VOIP/Internet-based audio and video connection via the interface, including while a phone call is underway in the application system or a while a phone call may appear to be underway in the application system. - Allowing the primary
mobile application user 750 to switch among prebuilt interface designs to accommodate their needs or preferences around font size, color contrast, sound and volume features. - Allowing the primary
mobile user 750 to access features of the primarymobile application 206 described in detail in the instant application, including, but not limited to:- Ability to receive and respond to primary mobile application alerts, status check-ins that are launched by the application, mobile wellness checks, medication and other reminders, electronic messages; these alerts are not simply calendar alerts but also have actionable response options such as allowing the user to alter prescription information on the user's medical profile of the primary
mobile application 206 - Configuring the primary mobile application itself, including enabling and/or disabling certain application features such as direct connect, fall detections, electronic PERS radio receiver connectivity, configuring authorized remote users such as caregivers, wellness checks and/or any of the other primary application configuration options described herein.
- Ability to receive and respond to primary mobile application alerts, status check-ins that are launched by the application, mobile wellness checks, medication and other reminders, electronic messages; these alerts are not simply calendar alerts but also have actionable response options such as allowing the user to alter prescription information on the user's medical profile of the primary
- Allowing the primary mobile user to press a button that launches the secondary mobile application 204 (it will be appreciated that
reference numeral 204 refers to the secondary mobile phone or device with software installed thereon, sometimes referred to herein as the “application,” for causing the secondary mobile phone or device to operate in accordance with the principles of the system and method of the present invention) of the invention described here and/or integrates the features of the secondarymobile application 204 described herein.
- Phonebook and other configurable features of the phone and of the primary
- The details for the novel implementation of the collection of these features are further discussed in the instant application. For those comfortable with navigating a modern smartphone, the interface of the
primary smartphone application 206 can be customized to hide and/or to turn on and off other applications, phone features and buttons (such as the search button, home button, or the camera or web browser). The software of the system and method of the present invention can run in the background to provide the powerful caregiving connectivity features that assist with both resolving urgent situations and enhancing daily interactions even if the simplified interface is turned off. - If the interface is turned on, it helps facilitate the navigation and use of the monitoring and caregiving features described herein through direct access to many of those features and the configuration of those features. Furthermore, many of those would-be primary mobile application users are not able and/or willing to use the smartphone in its native form because of any combination of issues, such as: over complexity of the phone including features and functions that are foreign and wouldn't be utilized by the user; small or difficult to read fonts and font size; lack of enough contrast among graphics and text that make it difficult to see and/or read; difficulty configuring the phone with the functions desired; difficulty navigating the phone because of concepts and features not found in traditional phones; etc.
- With the primary
mobile application 206 interface, many of these users would now be able to successfully use a smartphone to make calls and then leverage the smartphone to interact with loved ones and caregivers because the interface provides an easy, intuitive way for them to use a smartphone and a direct, easy and intuitive way to perform the many helpful caregiving functions of the primarymobile application 206 described in this document. If enabled, the primary mobile application interface will run as soon as the smartphone itself is booted up as part of the start sequence in order to mask other smart phone functions via the interface. - The primary
mobile application 206 functions by resting in a home state and then being triggered to change states based on a variety of internal and/or external triggers. Theapplication 206 then takes action in those different states, sometimes switching among the states, until completing the series of tasks and returning to the home state configuration. -
FIG. 15 illustrates the core process functioning of the primarymobile application 206 by detailing some of the major different states and state changes that the phone goes through when the primary smartphone application 206 (with or without the interface enabled) is running. - The home state is the default starting point for the system. In the home state, the application displays a simplified interface for the
user 750 to interact with theprimary smartphone 206 unless the user has turned off the interface as described above. If the interface is disabled, theuser 750 interacts with the mobile phone operating system regularly while the primary application core activities run in the background. The smartphone's 206 operating system API allows users to create activities/processes and have them run in the background. Either way (interface enabled or disabled), in the home state, some core activities run in the background, idle until they are triggered. Examples include: (a) logging, (b) fall detection, (c) idleness checks, (d) wellness/safety checks, (e) other monitoring and notification functions, and (f) direct connect receiver that are described herein. - These background activities of the primary
mobile application system 206, each described briefly below and then in further detail later in the instant application, may or may not prompt user interaction at different points. When invoked, these background activities may change the state of the phone to require an interaction either from the primarymobile user 750 or remotely from an authorizedremote user 760. - The states displayed in
FIG. 15 and shown below illustrate a sampling of changes from the home state that may prompt a user interaction: -
- a. Monitoring notifications: The primary
mobile application 206 will display monitoring-related notifications tousers 750 to acknowledge. These are asynchronous, and may pop-up any time amonitoring process 650 indicates an event. Monitoring tasks run in the background, unless user input is required per Notification Triggers 802. Examples include, but are not limited to: monitoring for a phone shake which prompts the user if they want to dial 911 or other urgent facility and waits for user response; monitoring to detect a fall, which when detected prompts user with a status check; monitoring phone movement through GPS (global positioning system) and accelerometer hardware for lack of movement, for not reaching a particular destination and/or to infer location destinations and/or speed of movement; monitoring responses to alarms, reminders, wellness and safety check-ins. Monitoring notifications may also prompt remote authorized user(s) 760 to be notified of primarymobile application 206/primarymobile application user 750 status and/or to login to the secondarymobile application 204 orweb application interface 202 to obtain more detail and/or take some action based on notification. For example, a monitoring notification may prompt the primarymobile application user 750 to take a medication at a specified time as setup in their medical profile of the primarymobile application 206. The primarymobile user 750 can respond to the notification by clicking a button that says something to the effect of “I no longer take that medication”. That response may prompt a removal in the monitoring notifications of any further similar reminders. It may also send notification to remote authorized caregiver(s) 760 indicating theprimary application user 750 has indicated they no longer take the medicine and asking the remote authorizeduser 760 if they would like to confirm the stopping of the medication or re-enable the medication reminder and potentially alter or update it with relevant information and possibly message theprimary application user 750 that they were re-enabling the reminder and the reason for it. In such a case, theprimary application 206 would receive a second notification with the remote authorized user's 760 actions and message. - b. Incoming or outgoing calls including direct connect requests: The system and method of the present invention may receive or place a call (including direct connect call) requiring the switch from the home state to the call or direct connect interface. The process and methods by which a remotely authorized
user 760 can initiate and create a live phone (cellular) and/or Internet audio and/or video connection to a primarymobile phone 206 where the primarymobile phone user 750 does not actively answer the phone, click any button or initiate any other kind of activity is collectively referred to herein as a “direct connect” or “direct connection.” - c. Wellness & safety checks: These run at prescheduled times per the configuration. The system and method of the present invention interacts with the users to collect information on specific wellness and safety related checks. These checks may further trigger notifications to either or both the
primary application user 750 and/or the remote authorizeduser 760. Such notifications may then prompt further monitoring processes that await further user action such as those described in monitoring notifications above. - d. Phone configuration: The user may choose to change how the primary mobile application or phone 260 is setup, changing application parameters or phone behavior. The changes to the configuration may require further synchronization, access to phone memory and notifications.
- e. Logging: The system and method of the present invention logs features that may require the phone to switch out of the home state to collect data, such as camera pictures. The system and method of the present invention collects information, as appropriate and configured and then returns to the home state or current state that smartphone was in prior to logging initiation.
- f. Primary mobile application user interaction: The user may choose to interact with other features of the interface and go into customized interfaces to explore content such as communities, billing, administration, getting help from the helpdesk etc.
- a. Monitoring notifications: The primary
-
FIG. 2 illustrates the system and method of the present invention used to remotely initiate and create a live phone (cellular) and/or Internet audio and/or video connection to a primarymobile phone 206 where the primarymobile phone user 750 does not actively answer the phone, click any button, or initiate any other kind of activity. This process may collectively be referred to herein as a “direct connect” or “direct connection.” - The purpose of a direct connection is to allow an authorized
remote user 760 the ability to see, hear and interact with the primarymobile application user 750 at the authorized remote user's discretion, and to connect with the primary application user 750 (which may be a care recipient) for primarily concerning, urgent or potentially urgent situations. The authorizedremote user 760 might also leverage the information gathered through the monitoring processes and logged from theprimary smartphone application 206 in order to help illustrate what may have transpired recently with the primarymobile application user 750. - In just one example of a direct connection in accordance with the principles of the system and method of the instant invention, the primary
mobile application user 750 responds negatively to a wellness check survey from the primarymobile application 206, perhaps indicating they aren't feeling well. The primarymobile application 206 recognizes the input response as a negative response because response options are pre-configured in the primarymobile application 206 as positive, negative or neutral. Theapplication 206 may respond to theprimary application user 760 with a follow-up question based on the logic tree of the wellness check or perhaps it may recommend calling a doctor or 911. Theprimary user 750 may choose to take action or may choose not to call or take action. - Regardless, the primary
mobile application 206 may send an electronic notification (email, SMS and/or securely through theweb portal application 204 and/or the secondarymobile application 206 to inform the remote authorized user(s) 760 of wellness check outcome and subsequent activities of the primary mobile application and primarymobile phone 206 including but not limited to: any calls made; date/time-stamped history of location(s) to which the phone traveled tagged with (or without) pictures and/or video taken at those periodic intervals throughout the day; and/or any relevant urgent- or non-urgent producing notifications. The remote authorizeduser 760 may then have called theprimary application user 750 with no response. The remote authorizeduser 760, having special permission in the primarymobile application 206 configuration, may then initiate a direct connect to turn on the primary authorized user's phone to try and interact with them to make sure they are alright and taking the appropriate actions. - As shown in
FIG. 2 , the steps for a direct connection in one embodiment of the system and method of the present invention comprise: - Step 1: Initiation
- A remote authorized
user 760 presses a button to initiate a direct connection from either aweb application 202 or a secondarymobile phone application 204. As shown inFIG. 3 , “Urgent Connect Now” 302 on theweb application 202 and “Direct Connect” 304 on the secondarymobile application 204 are exemplary buttons. In one embodiment of the system and method of the present invention, the option to press the button is available only topre-authorized users 760 whose electronic profile has been specially flagged in theprimary application system 208 data store (stored on a suitable computer system) and/or communicated to theprimary smartphone application 206 data store during either the application setup or configuration processes and stored in theconfiguration data 660 that is shared among theprimary application system 208, theprimary smartphone 206 and theweb portal application 202 and secondarymobile phone application 204 as being allowed to initiate a direct connection. - Step 2: Notification of Direct Connect Intention
- There are two alternatives for how this process may occur:
- Alternative 1: Immediately Call
- If the direct connection was initiated through a web-
portal application interface 202, the system and method of the present invention will initiate an Internet-based Voice-Over-IP (VOIP) call, cellular call and/or hybrid VOIP-cellular call to the primarymobile smartphone 206 through theprimary application system 208 or another method. If the smartphone has video conference capabilities, then the web-portal application 202 via theprimary application system 208 will initiate a video conference call instead. Theprimary system application 208 will recognize video conference capabilities through configured settings in theprimary application system 208 data store that maintain status of whether theprimary smartphone 206 has the hardware and software capability for video conferencing. In one embodiment of the invention, such information is linked and stored during the setup and/or configuration process and stored in theconfiguration data 660 that is shared among theprimary application system 208, theprimary smartphone 206 and theweb portal application 202 and secondarymobile phone application 204. - If the direct connect was initiated through a secondary
mobile phone 204, the system and method of the present invention will directly call the primarymobile phone 206 through a cellular network, VOIP and/or hybrid VOIP-cellular call or indirectly call the primarymobile phone 206 via theprimary application system 208 using cellular network, VOIP and/or hybrid VOIP-cellular call. If the system and method of the present invention both the primary smartphone 26 and the secondarymobile phone 204 have video conference capabilities, then the secondary mobile (or smartphone)application 204 will initiate a video conference call instead that may go directly to the primarymobile phone 206 or indirectly through theprimary application system 208. Theprimary smartphone application 206 and/or theprimary application system 208 will recognize video conference capabilities through configured settings in theprimary application system 208 data store that maintain status of whether theprimary smartphone 206 has the hardware and software capability for video conferencing. - In parallel, the clicking of the direct connect button in
web portal application 202 and secondarymobile application 204 will also notify theprimary application system 208 that a direct connect call is being placed as well as set specialized flags in theprimary application system 208 and/or the secondarymobile application system 204 that a direct connect call is being requested. - Alternative 2: Notify the
Primary Application System 208 to Request a Direct Connect - The
web portal application 202 and/or the secondarymobile phone application 204 of the system and method of the present invention will electronically notify theprimary application system 208 that a direct connection call is being requested as well as set specialized flags in theprimary application system 208 and/or the secondarymobile application system 204 that a direct connect call is being requested. - Step 3: Authentication & Validation
- There are two major alternatives based on the process followed in Step 2:
- Alternative 1: Incoming Calls
- The primary
mobile smartphone application 206 will recognize the caller or the source of the call (audio and/or video call) as it is pre-configured withauthorized user 760 identifiable information and/or secondarymobile phone 204 identifiable information. The primarymobile smartphone application 206 will pick up any combination of the source phone number, source IP address, and/or other user identifiable information associated with the person initiating the direct connection as obtained by logging into theweb portal application 202 and/or the secondarymobile application 204. There are two primary options based on this alternative: - Option 1: The primary
mobile smartphone application 206 recognizes the source as having permission to direct connect and automatically causes the primary smartphone itself 206 to connect/pick up the direct call and/or video conference call (if video conferencing is available and enabled). If video conferencing is not enabled, then the primarymobile phone 206 may enable it and then connect or respond video conference dial to the initiatingweb portal 202 and/or secondarymobile phone application 204. - Option 2: The primary
mobile smartphone 206 makes an electronic authorization and validation request of theprimary application system 208 to ensure: - A. That the requesting source is an authorized source, and/or
- B. To validate that the requesting source is not only authorized but actually requesting a direct connection (as opposed to simply requesting a “regular” call/video conference connection).
- Upon authorizing and validating, the primary
mobile smartphone application 206 causes the primary smartphone to pick up the call or call back the source through cellular, VOIP and/or hybrid cellular-VOIP means. If video conferencing is not enabled, then the primarymobile phone 206 may enable it and then connect or respond with video conference dial to the initiatingweb portal 202 and/or secondarymobile phone application 204. - Alternative 2: Incoming Request for a Direct Connect
- The
primary application system 208 will electronically notify the primarymobile smartphone 206 that an authorized direct connection is being requested (via a web-based/Internet application data transfer, text message, email or other electronic means). - At that point, the
primary smartphone application 206 will automatically call the requestingweb portal 202user 760 and/or secondarymobile phone 204user 760 through cellular, VOIP and/or hybrid cellular-VOIP means. If video conferencing is requested then, if it is not enabled, then the primarymobile phone 206 may enable it and then connect or respond with video conference dial to the initiatingweb portal 202 and/or secondarymobile phone application 204. The web portal application 202 (as linked with the primary application system 208) and/or the secondarymobile phone application 204 will have had a flag set to automatically pick up call from theprimary smartphone 206 and/or theprimary application system 208 fromStep 1. - In both alternatives, the primary
mobile smartphone application 206 will (with reference toFIG. 6 ) turn on the speakerphone(s) 608,microphone 606, turn up thevolume 630, identify primary smartphone location (turning on location identification features if they are disabled 610, 612, 616), turn on camera 604 and snap pictures (not snapping pictures if video conferencing is selected) via the phone's API, group & link the information together and send it to theprimary application server 208 via thenotification system 670. - Step 4: Call Pickup and Information Viewing
- There are three optional paths that stem from the two major alternatives from Step 3:
- Alternative 1—Option 1:
Primary smartphone application 206 automatically picks up phone call. For video conference viewing, primary smartphone application enables camera module 604 and automatically connects via video conference. - Alternative 1—Option 2: Secondary
mobile application 204 and/orweb portal interface 202 automatically picks up phone call. For video conference viewing,primary smartphone application 206 automatically connects via video conference. An indicator flag in the secondarymobile application 204 and/orweb portal interface 202 informs the respective application to automatically pickup/connect. - Alternative 2: Secondary
mobile application 204 and/orweb portal interface 202 automatically picks up phone call. For video conference viewing,primary smartphone application 206 automatically connects via video conference. An indicator flag in the secondarymobile application 204 and/orweb portal interface 202 informs the respective application to automatically pickup/connect. - In all three paths, the
primary application system 208 will package up all the information gathered and sent from theprimary smartphone 206 inStep 3 and make it available to authorizedusers 760 for viewing via theweb portal interface 202 and/or the secondarymobile application 204. The information can be viewed simultaneously, before and/or after the call and/or video call is made. - In all three paths, the
primary smartphone application 206 may also cause a loud ring and/or automated voice to informuser 750 that a direct connect is underway and also may cause theprimary smartphone 206 to visually cue theuser 750 through changes in color, text, vibration and/or possibly other cues. -
FIG. 16 shows the process flow from initiation to connection, specifically illustrating how particular connectivity options for a direct connect described above may be selected by the collective system of the invention. - For example, the direct connection request has been received by the primary
mobile application 206, perhaps through SMS or email electronic communication. The request may have come directly from the remote authorized user's 760 phone via the secondarymobile application 204 or through theprimary application system 208 via the secondarymobile application 204 or from the webportal application interface 202. Themonitoring process 650 of the primarymobile application 206 recognizes the direct connection request and triggers the intelligentevent identification engine 710 to collect phone data around whether theprimary phone 206 can connect to the Internet and if the connection is strong and fast enough. - If not able to connect or if connection is not sufficient, the
monitoring process 650 would trigger themobile application 206 to look up the phone number of the authorizedremote caregiver 760 in the primary application data storage/database and initiate an audio/cellular call back to that phone number. In one instance, the requestor application (i.e., the secondarymobile application 204 and/or the web portal application 202), having flagged itself as attempting to direct connect to a particular phone in its own configuration, would identify the incoming phone number as belonging to the primarymobile application 206, recognizing it as pre-authorized, automatically answer the call. In another example, the phone could ring until the remote authorizeduser 760 picked up the auto-returned phone call. - In a separate example of a direct connection with an audio/cellular call back (as described above), instead of dialing the initiating remote authorized caregiver's
phone 760, the primarymobile application 206 may dial a bridge number into theprimary application system 208, which may then bridge dial the remote authorized user's phone through telephonic bridging/PBX (private branch exchange)/conferencing technology. Alternatively, the remote authorized user'sphone 204 may already have dialed into the primary application system's 208 PBX/conferencing technology and be conferenced with the primarymobile phone 206. - In a different example, the
primary application 206 may recognize Internet access as existent and sufficient, however the initiating secondarymobile application 204 may detect lack of Internet connectivity or sufficient Internet bandwidth/speed. In such an instance, the secondarymobile application 204 may initiate a cellular/audio-only direct connect to the primarymobile application 206 with a special flag indicating that an Internet connection will not suffice. The primarymobile application 206 will interpret the flag and not attempt an Internet, video and/or VOIP connection but only an audio/cellular direct connection as previously described. - In another example, Internet connectivity from both the initiating
phone 204 orweb application 202, as well as from the primarymobile application 206, is existent and sufficient. In this case, a call back is initiated by the primarymobile application 206 via its VOIP (voice over IP) client that connects to a VOIP server as part of theprimary application system 208. The VOIP server also connects to the secondarymobile application 204 and/or theweb application 202 in advance of notifying the primarymobile application 206, or after notifying, or after the primarymobile application 206 has a VOIP connection with the VOIP server. The VOIP server therefore bridges/creates the connection then between the primarymobile application 206 and the initiating secondarymobile application 204 and/orweb application interface 202. - As described, a direct connect call results in creating a
live phone call 514 and/orlive video conference 504 without theuser 750 of the primarymobile phone 206 taking action. As shown inFIG. 16 , the type of call possible will depend on the quality of connection—if the cellular/internet connectivity is fast enough to support video calling that would take preference over or audio calling. In that case, as a backup, the system and method of the present invention uses a cellular audio call. - Internet existence and sufficiency is determined through API calls checking signal existence and strength of cellular Internet networks and wireless network detections. Pinging certain websites and/or servers using internet protocol calls and timing and comparing response rates is another method that may be used. Such checks are performed on both sides of the connection (the secondary
mobile application 204 orweb application 202 and the primary mobile application 206). Notifications are sent among systems using electronic communication—usually some/any combination of SMS texting, email and/or Internet protocol though also possibly via modem or other electronic communication methods that basic operating systems (and possibly their APIs) interact with. Audio calls and call answering are triggered through the device's APIs. VOIP/video conference connections may be established over Internet protocol through interfacing with VOIP clients and server APIs. -
FIG. 4 provides an illustration of an instance of a direct connect call in place. In this example, a direct connect call has been initiated and is in session. The initiating user, through theirweb portal interface 202 and/or secondarymobile application 204 can see what the primary phone owner 406 is doing through the camera module 604 on theprimary smartphone 206. The initiatinguser 760 is conversing 404 through the direct connection via thespeakerphone 608 andmicrophone 606 on theprimary smartphone 206 to the primary owner 406. -
FIG. 5 provides an illustration of exemplary information provided to theweb portal application 202 and/or to the secondarymobile application 204 in conjunction with a direct connect call in one embodiment of the system and method of the present invention. This information is generally available to authorizedremote users 760 who are logged into theweb application interface 202 and/or secondarymobile application 204 at any time, including when the urgent notifications have been issued and otherwise. - The purpose of the information made available is to provide a broad and deep picture of what has been and is going on with the primary
mobile phone application 206 and the primarymobile user 750 and to also help manage the daily caregiving features, urgent connectivity features, interface features and general phone features of the primary mobile application and primarymobile phone 206. The information can help determine the primary user's 750 whereabouts, their well being status (in part through status of status and/or wellness checks), indicate whether any (alarming) incidents occurred (such as dialing 911 and/or a fall detection) and related details; indicate whether they have been following certain patterns of behavior; and, indicating whether the phone 206 (and the user 750) have not moved for a period of time and/or that the phone 206 (and the user 750) did not reach an intended destination. - The information can also indicate whether the
user 750 has indicated that they have been taking medication; whether theuser 750 confirmed certain alarm reminders; whether theuser 750 has been making phone calls—and to when and to whom they have been calling; whether or not theuser 750 have been sending and/or receiving messages; and/or whether the phone battery died or the phone is not in signal range (cellular and/or internet cellular and/or Wi-Fi). - The information may also prompt the remote authorized
user 760 to take action(s), which may include among the many actions described in the present invention: editing, altering, adding or removing reminders including medication reminders (such as taking, refilling and/or renewing medication), updating medical profile information, editing, altering, adding or removing particular automated wellness checks, setting location reminders, sending messages or information; updating or changing the primarymobile application 206 user interface, updating numbers for auto-conferencing on the primarymobile application 206, updating caregiver notification settings and so on. - This sample information, also illustrated in
FIG. 5 , is provided and accessible to the user 760 (e.g. caregiver or authorized user) who may be initiating a direct connect call on either theweb portal application 202 and the secondarymobile application 204 and also to theprimary smartphone user 750 on theweb portal application 202 and the primarymobile application 206. The method and process of the invention calls for any and all of the information illustrated inFIG. 5 to be available. The sample information should not be construed as exhaustively conveying all possible relevant information being made available and those skilled in the art will recognize that other types of information may be shared without departing for the scope of the instant disclosure. - In further detail, the sample information may include in one embodiment of the system and method of the present invention (with reference to
FIGS. 5 and 6 ): - a. The current and historical location and
movement history 502 as determined throughGPS 610,wireless 614, and/or cellular 616 location determination systems andaccelerometer 612 logged withprimary phone 206 date and time frominternal clock 622 as periodically checked through the monitoring processes 650 and configured through the configuration processes 660 of theprimary smartphone application 206. Additionally, location andmovement history 502 may have photo and/orvideo snippets 504 tagged from the camera module 604 being engaged periodically by the monitoring processes 650 andconfiguration processes 660 that can be viewed. Location and movement history may be displayed in a textual format and/or via one or more markings or images of locations overlaid upon one or more map images. Furthermore, clicking on a particular location via a map or link or inputting a particular location into input fields on theprimary web interface 202 and/or secondarymobile application 204 can search the historical logs/database 720 for other instances of the primary mobile application recording being at or around (within a predetermined distance radius) that location and return a listing of those instances with date/times, duration, and potential pictures and/or videos that may have been tagged and logged. The process flow for the logging process itself for most types of logging is shown and described inFIG. 21 . - b. The phone call history log 506 of inbound, outbound, missed and connected calls may also be available for view. Those calls that were auto third party conferenced via the primary
mobile application 206 may also be specially marked. Furthermore, clicking on a particular phone number or inputting a particular phone number into input field(s) on theprimary web interface 202 and/or secondarymobile application 204 can search the historical logs/database 720 for other instances of the primary mobile application and orphone 206 recording making those phone calls and return a listing of those instances with date/times, duration, and potential location information that may have been tagged and logged. The logging process flow for most types of logging is shown and described inFIG. 21 . - c. The current and
historical phone status 508 of theprimary smartphone application 206 may also be available. The basic logging process is shown and described inFIG. 21 . The FEATURES logged may include current and historical information on the primary smartphone's 206 battery life, charging history, when the phone's signal status has been strong, weak or non-existent, availability of 3G and/or 4G networks, location date/time stamping as well as the current status of key phone features 602 which includes enabled or disabled status of camera module 604,microphone 606,speakerphones 608,GPS 610,accelerometer 612, wireless radio/LAN 614,cellular system 616,Bluetooth radio 618,touch screen 620,internal clock 622 and other relevant phone features 630. - The
user 760 may be able to enable or disable any of these phone features remotely through theweb portal application 204 and/or the secondarymobile application 204. Doing so consists of changes to the configuration files that get pushed to theprimary smartphone 206 from the secondarymobile application 204 and/or theweb portal application 202 and pushed through directly or via theprimary application system 208. - d. A history of the outcome status of status and/or wellness check-ins 516 as well as a log of the status and wellness check-
ins 518, including the questions, user responses and phone actions and corresponding notifications may also be available for view. Status and wellness checks are performed via the process shown and described inFIG. 19 . As well, the information and status around any fall detection, phone shaking and/or 911 calls by theprimary smartphone application 206 may be made available. - e. Urgent notifications. In the case of a fall/shaking, the primary smartphone fall detection process would be triggered. The process indicating how this is done is shown and described in
FIG. 17 . For example, if thephone 206 fell or was shaken, thephone 206 would recognize this event, and trigger a check to see if theuser 750 has indeed fallen. Theuser 750 can indicate to theprimary smartphone application 206 that they were alright, causing the alert to be dropped, but the event would still be logged in the system. In a different scenario, if thephone 206 fell or was shaken and theuser 750 did not respond or did respond but responded negatively, that response information as well as the details around the phone calls and/or notification(s) initiated by theprimary smartphone application 206 would also be made available. - f. A history of alerts and
reminders 520 for theprimary smartphone user 750 as well as medication reminders 522, the primary smartphone user's 750 responses and any notification(s) and/or subsequent action(s) that theprimary smartphone application 206 may have taken based on user responses may also be available. - g. The primary smartphone application's 206
medical profile 524 and history of changes to themedical profile 524 as well as any medication reminder history 522 and changes may be made available. - h. The
current configuration 526 of theprimary smartphone application 206, which includes settings around the user interface, settings for urgent connectivity and monitoring as well as settings for non-urgent, daily interactions may also be available for viewing and altering. Any changes made on theweb portal application 202 and/or secondarymobile application 204 are saved as configuration file changes and pushed out to the primarymobile application 206 to incorporate the new configuration changes either directly or through theprimary application system 208. - A novel portion of the system and method of the present invention are the monitoring processes that look, listen for and act on a series of triggers, including but not limited to: primary phone/
application usage 206, remote authorizeduser interactions 760, and location-based and other situational triggers, including potentially urgent situations. These triggers, in combination with the monitoring processes allow for the unique and high level of caregiving interactivity described. Below is further detail around the monitoring processes. -
FIG. 6 illustrates the monitoring and notification process components and steps. Illustrative flows for sample monitoring processes are shown inFIG. 17 andFIG. 18 . -
FIG. 7 further illustrates the internal detail of the monitoring processes and event notification process. -
FIG. 8 illustrates examples of notification triggers used by the monitoring processes.FIG. 20 shows the notification process. - The monitoring processes 650 digests the data collected 702 from the various described phone features 602 and other relevant phone features 630. This data collected 702 includes current and historical status of the
various monitoring processes 650 as they are configured 660. An intelligent event identification engine (IEIE) 710 looks for pattern matches against predetermined scenarios and rules set in theconfiguration 660 andmonitoring processes 650 engines. TheIEIE 710 may be setup to utilize various rules and analysis to help in capturing events. - For example, the
IEIE 710 can compare a series of readings collected from the location sensor to identify locations visited in the day. In another example, theIEIE 710 can evaluate data from accelerometers to identify movement (e.g., is the user moving?). That information is then processed forappropriate event notification 670 based on notification configuration 730. The intelligent inferences themselves 512 as well as thenotification events 670 that occurred based on theinferences 512 may be made available. - The intelligent inferences themselves 512 may also be used as triggers to create notification or
other events 670, including initiate a direct connection to authorizedremote users 760 or other relevant parties, including 911 or urgent call centers, and/or to trigger someother monitoring process 650,logging event 720 and/or trigger some other action within theprimary smartphone application 206,primary application system 208, theweb portal application 202, and/or the secondarymobile application 204. - Included here are a series of disclosed embodiments of the invention that utilize the
specialized monitoring processes 650 and the intelligentevent identification engine 710. These embodiments are not exhaustive, but are a sampling of the kind of unique capabilities of the system and methods described here. - In the disclosed embodiment of the invention, the
primary phone 206 hasn't moved for several hours during the day—this is called an “idleness” situation. Themonitoring process 650 records movement at several intervals and compares each as shown and described inFIG. 18 . The idle behavior is identified by comparing the location of the primary smartphone with previous location readings. Location readings are taken according to a polling frequency for collecting location data (here PFREQ) and stores those location readings in a log, via the process identified inFIG. 21 . If the location has been the same or within a proximate distance defined as within LOCATION_RANGE and a time period equal or greater than that defined in TGT_PERIOD has elapsed, the system identifies this as an “idle situation.” Otherwise, if distance is not within the LOCATION_RANGE, the phone is considered to have moved and the process is reset for the next PFREQ. If the distance is within the LOCATION_RANGE but the TGT_PERIOD has not been reached, the monitoring process will wait for further data points. - Once an “idle situation” is determined, the information is logged as an idle event in the primary mobile application system. The information is logged in the system log, potentially transmitted as an event notification to the
primary application system 208 and an idle status check is initiated. The idle check is an interactive messaging to theuser 750 and may involve validating with the user their status (asking if they are alright, indicating that the phone hasn't moved in TGT_PERIOD) and creating notifications for the appropriate recipients. If the user indicates they are ok and/or have moved in the TGT_PERIOD, the system goes back to waiting for the next reading according to PFREQ. If the user does not indicate that they are alright or indicates a negative response, then the system may perform other notification events to authorizedusers 760 and/or 911 based on the primary smartphone application's 206 configuration. - In this example, the
monitoring process 650 recognizes that both location and phone position haven't moved. It also may recognize that there has not been user activity on the phone 260 in the form of moving or carrying the phone 260, making phone calls, or navigating in the phone in any way. Other data points may also be considered into the idleness assessment. - For example, the
monitoring process 650 also may recognize that on that particular day or date during that particular time period, the phone 260 is normally at or near a different location (perhaps at a particular address). This is done by theIEIE 710 through a comparison of historical data—dates, times and locations and looking for patterns in movement to the same locations and deviations from those patterns. It may also recognize that an authorized remote user 760 (e.g. caregiver) has specified that if the phone 260 doesn't move during that period of time then to notify specified contacts registered in theconfiguration 660 and in theprimary smartphone application 206. Examples of contacts—authorizedremote users 760—include, but are not limited too, thatremote user 760, other remote users, family, friends, professional caregivers, medical providers, medical centers, specialized living facilities and/or urgent call centers. - The intelligent
event identification engine 710 recognizes these patterns and makes inferences that lead to notification of specified contacts and/or a wellness/status check-in, direct connection, and or other action of theprimary smartphone application 206 to the primarysmartphone application user 750. The responses of thatuser 750 are processed and may lead to a notification of specified contacts, logging to be made available forfurther monitoring processes 650 to leverage the intelligentevent identification engine 710, direct connection and/or other actions specified in theprimary smartphone application 206. - In the disclosed embodiment of the invention, the
primary smartphone application 206monitoring processes 650 recognizes that the phone 260 hasn't reached a destination that it regularly does during that date, day and/or time period or a location that was specified by an authorizedremote user 760 in theconfiguration 660. The monitoring processes 650 may also record lack of movement and/or other indicators that a problem may exist. The intelligentevent identification engine 710 will identify pattern matches of problems and/or look for specific problems and take appropriate actions and notifications as specified in theprimary smartphone application 206, possibly including but not limited to wellness/status check-ins and/or creating a direct connection. - In the disclosed embodiment of the system and method of the present invention, the monitoring processes 650 record movement of the phone 260 over time. Based on the frequency and pattern of location and/or accelerometer (positioning) movement, the intelligent
event identification engine 710 may infer that theuser 750 is walking versus driving or vice versa. That information may then be recorded for further inferences by the intelligentevent identification engine 710 or used to notify authorized parties, direct connect, automated check-in and/or take some other action of theprimary smartphone application 206. - In the disclosed embodiment of the system and method of the present invention, the monitoring processes 650 record movement of the phone 260 over time. The monitoring processes 650 may also cause the phone's camera module 604 to record one or more photographs and/or video. The
primary smartphone application 206 may recognize the photo as dark, and the intelligentevent identification engine 710 may recognize that a dark picture along with the frequency and positioning of the primary smartphone as determined by theGPS 610,accelerometer 612, wireless radio/WAN 614 andcellular system 616 imply that the primarysmartphone application user 750 is a walking and may be carrying the primary smartphone in a bag or purse. - In the disclosed embodiment of the system and method of the present invention, camera module 604 is used to take a picture of a prescription, perhaps on a prescription bottle or carton or any other medium. The monitoring processes 650 and specifically the intelligent
event identification engine 710 can use image character recognition and determine that the contents of the image are, indeed a prescription based on characteristics common to all prescriptions (such as medication name, dosage, frequency, number of refills, prescribing physician, etc.). Theprimary smartphone application 206 will then automatically directly through notification to theprimary application system 208 may electronically contact the pharmacy and/or medical practice to request a refill and/or renewal. The prescription information could also be redirected to create medication reminder alerts to take and/or to refill that particular medication using the alerts capabilities of theprimary smartphone application 206 and/or to update the medical profile on theprimary smartphone application 206 and/or other third party software. - In the disclosed embodiment of the system and method of the present invention, the monitoring processes 650 may monitor the primary smartphone's battery for dissipation status and patterns of dissipation that may correlate with various dates, days and/or times. Similarly, the monitoring processes 650 may monitor the primary smartphone's signal strength for patterns of signal strength and loss based on location pattern and/or date, day and/or time. In both situations, the intelligent
event identification engine 710 may look for patterns to anticipate for theprimary smartphone application 206 user when the battery might run low and/or signal strength might dissipate. In anticipating such an event, anevent notification 670 may be triggered to notify the primarysmartphone application user 750 and/or authorizedexternal parties 760 and may direct specific action (such as ringing the primary smartphone application user and telling user visually and/or audibly to plug in the phone and/or to make any necessary calls now perhaps with reasons as to anticipated future phone status—depending on the situation). - The
same monitoring process 650 and intelligentevent identification engine 710 are also used in several of the features of the invention described in the instant application. - In the disclosed embodiment of the system and method of the present invention, cellular and Internet connectivity to a mobile phone can be established automatically and/or remotely when the mobile phone has been idle, not having had a cellular and/or Internet connection for some period.
- In such instances a
primary application system 208 will send an electronic notification to the primarymobile smartphone 206 via one or a combination of methods such as SMS text message, cellular call, VOIP call, email or Internet connection. The primarymobile smartphone application 206 will recognize the source of the call as being from theprimary application system 208, as pre-configured in the software and will immediately initiate Internet protocol communication to theprimary application system 208 and/or cellular communication to the phone's cellular network. If a connection cannot be made immediately, the primary smartphone application 206+ can be configured to periodically re-attempt both connection types (Internet and/or cellular connection) until contact is made. - In the disclosed embodiment of the system and method of the present invention, the system and method of the present invention is configured to periodically and/or through a series of predetermined times and/or via a pre-determined trigger(s) 802 (as identified in the monitoring processes 650) automatically turn on the mobile phone's location positioning features (e.g., such as GPS, multilateration of radio signals, and/or other mobile positioning technologies) if location positioning features had been off, then, once on, log the phone's location position with a date/time stamp, optionally automatically snap picture(s) and/or video(s) and send all that linked data/information via Internet, cellular or other remote electronic connection to another user via an Internet website, an email, text message and/or other form of electronic message.
- In the disclosed embodiment of the system and method of the present invention, the system and method of the present invention is configured to automatically send an event notification 670 (in the form of a call, electronic and/or otherwise or subsequent notification, action and/or trigger) to the
primary smartphone application 206, the primarysmartphone application user 750, theprimary application system 208, thesecondary smartphone application 204, theweb portal interface 202 and/or to an authorized external party 760 (e.g., 911, an urgent call center and/or authorized care providers and/or an Internet site) if the mobile phone 260 is dropped, has not been moved or moved from a geographical location for a predetermined amount of time, if the phone has not reached a predetermined geographical destination by a certain date and time, if themobile user 750 has not “checked in” by pressing a special button on the phone 260, by not satisfactorily answering a wellness check or mobile medical survey on the mobile phone 260 and/or by pressing a button on a separate wireless device linked/connected with the mobile phone 260. All of these notification triggers 802 are recognized through the intelligentevent identification engine 710 and processed accordingly. Themonitoring process 650 will recognize if any kind of action or notification event required, partly based on the notification configuration 730. If so, anevent notification 670 may be triggered. - The primary smartphone
mobile application 206 can be configured to remain in a listening status via itsmonitoring processes 650 to automatically take action (as defined above) upon one or more of the following occurring: -
- A drop in altitude that meets “falling” criteria. The primary smartphone
mobile application 206 can be configured to sense a drop in altitude using the smartphone's accelerometer/gyroscopic technologies 612. Falling criteria can be defined to include the rate of drop, the estimated distance dropped and positioning change parameters of the primary smartphone as determined by the phone'saccelerometer 612. The detailed process for identifying a fall is shown and described inFIG. 17 . As shown inFIG. 9 , a fall is detected by thesmartphone application 206 and it initiates an automatic check-in 902 which has both a visual/interactive component 906 and an audio/voice recognition component 904. Themonitoring process 650 listens for both physical responses to the touchscreen in 906, audio responses viavoice recognition 904 as well as complete lack of response. In any or all of these cases, a negative and/or lack of response may result in an automatic dial to an urgent response center or 911 as well as an automatic notification to authorized user(s). - Idleness. The
primary smartphone application 206 can also be configured using the smartphone'slocation positioning technologies gyroscopic capabilities 612 to sense whether the phone 260 has been moved. Thesmartphone application 206 can also be set with criteria for determining whether an alert should be made based on the amount of time the phone has been idle and/or the location of the phone's idleness. - Location alerts. The
smartphone application 206 can be configured to alert for notification if thesmartphone 206 is moved from a particular geographic location/locations and/or too a particular geographic location/locations. - Lack of check-in/button press. The primary
smartphone application system 206 can require auser 750 to press a pre-determined button within a pre-set time parameter. If theuser 750 does not press/click the button (physical and/or virtual button), the application alerts fornotification events 670. The process followed in this case mirrors the process for idleness check as shown and described inFIG. 18 . - Specific responses to wellness checks/surveys. The
smartphone application system 206 can provide a survey of questions to theuser 750. Based on preset criteria, specific responses (in the form of button presses and/or clicks and/or input information) or lack of response to the system can cause an alert for notification. The wellness check is a time-based user configurable event executed as shown inFIG. 19 .
- A drop in altitude that meets “falling” criteria. The primary smartphone
- The
mobile application system 206 can be configured to immediately notify user(s) 750, 760 and/orprimary application system 208 immediately upon one of the foregoing events occurring and/or initiate an inquiry to themobile user 750 and/orremote user 760 to check on the primary mobile application user's 750 status. For example, the mobile application can ask theuser 750 if they are alright visually and/or audibly through texts, pictures, voice and/or rings/alarms and then listen for a response via a button press and/or audio response (possibly using voice recognition) input of the monitoring processes 650. If the inquiry response is negative or there is no response, the application system can then notify the authorized user(s) 750 and/or 760 and/orprimary application systems 206 and/or 208 for further action. Notification can be in any combination of the forms described above as well as logged 720 for future access by authorized user(s) 750, 760. The notification process flow for the primary smartphone/application is shown and described inFIG. 20 . - Notifications can be automated, periodic events or asynchronous events caused by the
primary smartphone application 206 monitoring processes or through interactions or physical requests from primarymobile application users 750 and/or remote authorizedusers 760 as described in this document and in the description of log triggering events inFIG. 21 . As illustrated inFIG. 20 , a notification event is triggered. The monitoring processes will first identify recipients that are flagged to be notified for that particular notification event based on the primary smartphone application's configuration. The monitoring process will then determine if the notification is flagged as a critical event notification. If it is, the notification will be sent to thepredetermined recipients primary application server 208. It will then return to the home or previous state. - If the notification event is not flagged as a critical notification, then the monitoring process will check if the SYNC_PERIOD time interval has been reached. If not, the monitoring process will wait until the SYNC_PERIOD time interval has been reached. Once the SYNC_PERIOD time interval has been has been reached, the monitoring process will check the battery status. If the battery power is below a minimum threshold, BATT_MIN, the notification event will be logged and queued for the monitoring process to attempt at the next SYNC_PERIOD time interval. If the battery power is sufficient (at or greater than BATT_MIN), then the monitoring process will confirm whether any kind of call (regular or direct connect) is in session with the primary smartphone. If the
primary smartphone application 206 is unable to send the notification event while a call is in session, it will log the event and queue it to send either when the call is completed or at the next SYNC_PERIOD. - If the
primary smartphone application 206 can send during a call or if theprimary smartphone 206 is not in a call, then the notification will be sent to the identifiedrecipients primary application server 208 and the phone will then return to the home or previous state. -
FIG. 21 is a flowchart illustrating the logging process in accordance with the principles of the system and method of the present invention. The flowchart illustrates the process for how the system and method of the present invention determines the timing and actions of a logging event. As illustrated, there are three main triggers that cause a logging event: - Option A. A predetermined time schedule determines periodic logging. LOGPERIOD denotes the time between logging runs as stored in the
primary smartphone application 206 database. The monitoring processes described inFIG. 7 recognize when a scheduled logging is going to occur. For example, LOGPERIOD could be set at every hour, at which time, the data called for to be logged in that log type is pooled together. - Option B. A change or event-driven log. Examples include but are not limited to logging the responses of a wellness check, logging if a user shakes the primary
mobile smartphone 206 to indicate an urgent 911 dial or dials 911 directly or through hot button, logging a fall detection and user responses, and/or logging reminders and user responses. - Option C. An authorized
remote user 750, such as a caregiver, can request a log of certain data related to theprimary smartphone application 206—including, but not limited to: phone movement history (such as GPS/location movement), phone logging, data around delivery and responses to wellness checks and/or reminders (including medication-related reminders), phone idleness, any alerts, etc. An example of when this might be attempted if a caregiver was concerned about the primarysmartphone application user 750 and the data visible, as illustrated inFIG. 5 , was not as recent as the caregiver would like. In this case, the caregiver could press a button on their secondarymobile application 204 or theInternet portal application 202 and trigger a collection of data to be logged and sent to theprimary application system 208 to be viewed on either system (202, 204). - Each notification trigger of any notification trigger type will have FEATURES of data and information to be collected and logged. The monitoring processes include preconfigured definitions of these triggers and the data to be collected in regard to each. For example, a periodic log may track location movement (e.g. GPS or other location-determining system), phone movement (even if in same location), capture photos and/or video to link with the location and phone movement and a date/time stamp. The monitoring processes recognize the different data requirements of that log (as determined in the configuration.
- The monitoring processes will then look at the status of the battery life of the primary smartphone to see if the battery life is greater than a minimum power requirement, BATT_MIN. If the battery is below the BATT_MIN level, the
primary smartphone application 206 will add a local log on the primary smartphone application database indicating battery is too low to send the pooled data to theprimary application server 208. It will abort the log attempt. However, in a slightly altered version, if the primary smartphone application determines that the primary smartphone has enough battery to send a basic message around the battery log but not enough battery to send the larger pooled data collection, it may send a notification message to theprimary application server 208 indicating as such. - If there is enough battery power, the monitoring processes will then determine whether the primary smartphone is on a call—cellular or Internet/VOIP-based, including whether it is a standard, typical phone call or a direct-connect call as described in this application. If any call type is in session, the
primary smartphone application 206 will wait for a period of time to re-attempt the call logging action, as defined in LOG_REATTEMPT. This assumes that theprimary smartphone application 206 is unable to log data at the same time a call is in session. If the smartphone allows the data to be logged while a call is in session and/or if the mobile carrier allows for data to be separately sent while in a call, then this step can be bypassed. - The monitoring processes of the
primary smartphone application 206 will then collect the data regarding the identified FEATURES. The monitoring processes will turn on (if necessary) any primary smartphone hardware or software component such as those identified in 602 or primary smartphone application feature necessary to collect that data and then collect the data. Otherwise, the data will simply be collected from the data store in the primarymobile application 206. - The data will then be written to the system log of the primary
mobile application 206. It may also be sent to theprimary application server 208 as a notification event. The primary application will then return to the previous state of the application prior to the logging event. - The monitoring process for identifying a fall is illustrated in
FIG. 17 . In this example, theprimary smartphone application 206 is actively listening and collecting the phone's accelerometer/orientation/positioning information according to a predefined interval, PFREQ, and storing the data in a log for comparison on theprimary smartphone application 206. Theapplication 206 is then comparing the log of the data (accelerometer/orientation/positioning data) and determining whether the difference in the movement data points over a predetermined period of time PREQ is equal to or greater than ACCEL_MAX, indicating a high acceleration to warrant a consideration of a falling event. - Similarly, the
application 206 is then comparing the log of the data (accelerometer/orientation/positioning data) and determining whether the vertical height location difference is equal to or greater than HGHT_MAX, indicating that the fall was from a large enough height to consider it a falling event for the purposes of checking-in with thephone user 750. - If neither ACCEL_MAX or HGHT_MAX criteria are met, the monitoring processes continue to listen for further events. However, if both criteria as described are met, then a falling event is stored in the log on the primary
mobile application 206 and potentially sent to the Primary Application System (PAS) 208. Theuser 750 is then prompted to see if they are alright. If the user responds they are alright, then the monitoring process resets and waits for the next event. If the user indicates they are not alright or does not respond at all, the monitoring process logs event locally and may create a notification event to inform thePAS 208, authorized remote user(s) 760 and/or 911. - In the disclosed embodiment of the system and method of the present invention, the system and method of the present invention is configured to automatically notify specified users 760 (e.g., care providers) via
web portal application 202 and secondarymobile application 204 if calls are made to a predetermined list of phone number(s). For example, automatically notify authorized users 760 (via call, electronic message or otherwise) when the mobile user's doctors, nurses, therapists, etc. are dialed and called—and then log 720 and/or send that information with date/time stamp via Internet and/or cellular network using email, SMS, Internet upload or other electronic connectivity. - The
smartphone application software 206 can be configured to take specialized action based on a user making calls to certain phone numbers and/or specified users. The actions can include notification events 670 (e.g. call, electronic message or otherwise) to authorized user(s) 750, 760, as well as logging of information in the primary system for later access by authorized user(s). To initiate a third party conference or to take other kinds of actions described here, the monitoring processes 650 check call attempts against theconfiguration setup 660 and matching numbers result in anevent notification 670 to corresponding systems andparties - In the disclosed embodiment of the system and method of the present invention, the system and method of the present invention is configured to automatically party conference the
mobile phone 206 with pre-determined specified user(s)/care provider(s) 760 via telephonic and or Internet connectivity (cellular, VOIP, hybrid cellular-VOIP, PBX and/or other call conferencing technology) when calls are made to specific, predetermined phone number(s). Thesmartphone application system 206 can be pre-configured and/or updated through theconfiguration process 660 with specific phone numbers that when dialed from theprimary smartphone 206 result in a party-line conference call to pre-determined specified user(s) 760 via telephonic and/or Internet connectivity. -
FIG. 10 illustrates an example of the interactivity between theprimary smartphone application 206 and thesecondary smartphone application 204 of the invention for purposes of establishing a conference call with authorizedthird party 760 based on a call by theprimary smartphone application 206 to a predetermined phone number. - In one example, a call to predetermined phone number results in a notification to an authorized
third party 760 via SMS, email or secondarymobile application 204. The secondary mobile application will receive a notification with optional response button(s) 1002. Clicking theresponse buttons 1002 results in either direct notification to theprimary smartphone application 206 via electronic communication (SMS, internet, or other) causing theprimary smartphone 206 to auto conference the secondary mobile application's 204 phone number or indirect notification to theprimary smartphone application 206 via electronic communication (SMS, internet or other) to theprimary application system 208 that notifies theprimary smartphone application 206 to initiate a conference call inclusive of the secondary smartphone/application 204 and the intended phone number. Alternatively, theprimary application system 208 may initiate the party conference to the primary smartphone/application 206, the secondary smartphone/application 204 and the intended phone number. - It should be noted that all embodiments of the method and system descried in the instant application related to auto conferencing should be construed to include conferencing in
pre-authorized users 760 on any phone in addition or substitution to a secondarymobile application 204 phone and/or to the pre-authorized user's 760web portal application 202. However, the secondarymobile application 204 and theweb portal application 202 allows for the interactivity ofresponse 1002, including but not limited to prompting the pre-authorized user to be conference called by thesystem primary smartphone application 206 orprimary application system 208 record the phone call or simply ignore the call. This type of interactive response may also be achieved by other phones not running the secondarysmartphone application software 204 through either specific text/SMS interaction and responses and/or audio request with voice recognition and/or number responses on the phone keypad that are interpreted by theprimary smartphone application 206 and/orprimary application system 208 to take one or any of the actions described above. - The conferencing process of the system may work as described above and/or in one or a combination of the following three methods:
- Option 1: The primary
smartphone application system 206 uses the cellular network's party conference capability to automatically dial the number being called as well as the pre-authorized user(s) 760. - Option 2: The
primary smartphone application 206 does not actually dial the number specified but alternatively dials a different phone number that connects with a remote application system 208 (via cellular, Internet and/or hybrid cellular-Internet method or other). Theremote application system 208 creates a party conference with theprimary smartphone 206user 750, the originally intended phone number and the pre-authorized user(s) 760. - In either process, the
primary smartphone application 206 will send an electronic notification to theremote application system 208 either before making the call (as in Option 1) or upon pressing the dial button (as in Option 2). Theremote application system 208 via monitoring processes 650 will then recognize the call as a party conference call, log theaction request 720, optionally notifypre-authorized users 760 via electronic application notification, text and/or email and/orother notification event 670 and initiate the telephone calls. - Option 3: Upon pressing the dial button, the initiating
primary smartphone application 206 first sends a notification to pre-configured authorized user(s) 760 phones (which as previously described may or may not use a secondarymobile application 204 or web portal application 202) as well as to aremote application system 208 via electronic data and/or telephonic means (including using cellular, Internet, and/or hybrid cellular-Internet means). The authorized user(s) 760 may see the action being initiated through a secondaryremote application 204 on their mobile phone and/or via a text message, email,Internet web portal 202 and/or other electronic and/or telephonic notification. The authorized user(s) 760 can then respond to the notification to: - A. Allow or not allow the original intended call to be placed, and/or
- B. Participate or not participate via party conference in the original call to be placed and/or
- C. Have the
primary smartphone application 206 or theprimary application system 208 record the call for future reference. - If the authorized
user 760 responds that they would not like the call to be placed, the call is not placed and theoriginal user 750 may be notified via theprimary smartphone application 206, theremote application system 208 and/or directly via an electronic and/or telephonic means to the initiatingprimary smartphone 206. - If the authorized
user 760 responds that they would like to participate in the call, the electronic and/or telephone response is sent either directly to the initiatingprimary smartphone 206 or indirectly via theremote application system 208. At that point, the party conference can be created either directly from the initiating primary smartphone 206 (as described in Option 1) or from the remote application system 208 (as described in Option 2). - Using either process, the
smartphone application 206 can be set to automatically record the conversation via theprimary smartphone application 206 or theprimary application system 208. Either system can also be set to automatically sendnotification 670 using the same means as described herein. - In the disclosed embodiment of the system and method of the present invention, the system and method of the present invention is configured to allow the primary
mobile user 750 or an authorized user/care provider 760 to create custom, automated wellness checks or surveys that themobile user 750 responds to once or periodically and which can have custom actions associated with particular responses and/or results based on software customization.FIG. 11 illustrates an example of an automated wellness check question according to the principles of the system and method of the present invention. - Examples of particular
automated notification events 670 by the software would be electronic notification to authorized caregivers and/or notification to urgent response center and/or 911 760 containing or providing access to survey results, medical or other information, including software-triggered recommendations, mobile phone location tracking information, pictures, audio and/or video captured from themobile phone 206. - The system and method of the present invention is configured such that a
user surveys 1102 for the primarymobile smartphone application 206 that have pre-configuredresponse actions 1104. Theresponse inputs 1104 can vary in number and type—such as a button selection, menu list selection and/or text input. Theuser 750 can input information via touch and/or voice response recognition. Theprimary smartphone application 206 will record and log the responses along with a date/time stamp and electronically send the information fordata collection 702 to aremote application system 208 to be monitored 550 by the intelligentevent identification engine 710 and for access via aweb portal 202 and/or secondary remotemobile application 204 by authorized user(s) 750, 760. - Certain
specific responses 1104 and/or response patterns recognized by the intelligentevent identification engine 710 can be set 730 to initiate selective actions/event notifications 670, such as urgent notification to 911 and/or an urgent response center and/or authorized user(s) 760. Other actions include special instructions provided to theprimary smartphone user 750, location tracking initiated and information sent to pre-authorized user(s) 760, camera enabled and pictures to be automatically taken via camera module 604 and sent or live video conference initiated to pre-authorized user(s) 760 and/or direct connect capabilities initiated (as described herein). - It will be appreciated by those skilled in the art that the survey(s) can be created on the
primary smartphone 206 itself and/or on aremote application system primary smartphone application 206. The survey(s) can be configured 660 to be asked at a particular date/time and/or periodically via preset days, times and/or periods of time that authorized user(s) 750, 760 configure. The survey(s) can be saved on theremote application system 208 where they can be enabled and/or disabled, saved for later use, and/or reconfigured or re-customized. -
FIG. 19 is a flowchart illustrating the process followed to execute, collect and log answers for a safety or wellness check in accordance with the principles of the system and method of the present invention. According to a predefined time periods SFREQ and/or WFREQ, a particular safety and/or wellness check is initiated according to the monitoring processes. The primarysmartphone application user 750 will responds to the series of questions as described, with each question and answer being logged accordingly in theprimary application system 206. As described individual and/or collective answers options can be preconfigured to trigger a notification event, including to authorizedremote users 760. If the user responds to a question or series of questions that trigger notification (possibly a “negative response” indicating they do not feel alright) then an event notification is created and triggered to notify theprimary application system 208, authorizedremote users 750 and/or possibly 911. However if the response(s) do not trigger a notification event, then the responses are logged and the system either continues to ask further questions of the safety/wellness check or completes the status/wellness check and logs the response locally on theprimary smartphone application 206 and may send information toprimary application system 208. - In the disclosed embodiment of the system and method of the present invention, the system and method of the present invention is configured to provide caregiving features to a primary
smartphone application user 750 through a primarymobile smartphone 206 and/orremote Internet application mobile application 204, including but not limited to those mentioned elsewhere in the application as well as those mentioned below.FIG. 12 illustrates exemplary interfaces on theprimary smartphone application 206 for some of the caregiving features described according to the principles of the system and method of the present invention.FIG. 12 specifically illustrates examples of medically-related instructions, specialized alarms, medication tracking & renewal/refill reminders and potential actions/hot buttons that can be defined and used according to the principles of the system and method of the present invention. - a. Medically-related instructions including therapy and medication instructions or other information, news and/or
instructions 1208 relevant to theprimary smartphone user 750 sent tomobile user 750 by authorized remote user/caregiver or authorizedmedical provider 760. Examples of other kinds ofinformation 1208 include addresses, driving directions and/or other instructions. - b. Specialized alarms, alerts and
schedules primary smartphone user 750 of appointments and provide related, relevant information. For example, anappointment reminder 1206 that also includes instructions on diet and driving directions linked together and then logged on the primarymobile phone application 206 andprimary application system 208 and via Internet with date/time stamp, the type of alert or alarm, the information linked with alarm and the mobile user's response (such as acknowledgement of the alarm). These alarms, alerts & schedules are specialized notification objects that may contain the standard event information (such as date/time, subject, description, alarm repeat information & duration) as well as having an active status (active or inactive), specialized system messages and trigger links Some of the trigger links may be tied to the user interface, such as with action buttons beyond the usual confirmation, snooze and cancel buttons. These notification objects are incorporated into the monitoring processes 650 and intelligentevent identification engine 710 and could be linked with actions/notification events 670 that can be taken. Examples include a medication refill alert that prompts theuser 750 to push a button to directly call the user's preferred pharmacy, the phone number of which is stored and specially flagged in the database by the primarymobile application 206. In another similar example, a medication renewal alert may prompt a button that directly calls the prescribing physician, whose information is stored and linked with the medication in the medical profile data of the primarymobile application 206. It could be that the phone number for that physician is also, separately, flagged for auto third party conferencing of a specified remote authorizeduser 760. Upon pressing the call button, the primarymobile application 206 will call the physician and go through the auto third party notification and conferencing process described previously in this application. In another example, a medication, refill or renewal reminder will have an option for theuser 750 to select that they no longer take that medication. Doing so may stop any further alarm reminders that the system was configured to deliver by removing the alert, causing it to be inactive or removing any future repeat configurations on the alert. It may also cause notification to remote authorizedcaregivers 760 as previously described. These alarms, alerts and schedules can be setup on the primarymobile phone 206 itself or remotely through a cellular and/or Internet connection by theuser 750 and/or by an authorized user/caregiver 750. - c. Medication tracking features that notify
primary application user 750 when time to take a medication, and/or when a medication refill and/or medication renewal is approaching 1204 and whether a refill is available. These medication tracking features are incorporated into the monitoring processes 650 and intelligentevent identification engine 710 and can be linked with actions/notification events 670 that can be taken. For example, the primarymobile application 206 and/or theprimary application system 208 can automatically request a refill and/or renewal on medications or can prompt themobile user 750 to have thesystem action button 1210 or through voice recognition on theprimary smartphone application 206 according to profile as stored in the primary user'sconfiguration 660. The system and method of the present invention is configured to log the events, information and associated actions via thedata collection process 702 for reference by theprimary user 750 and/or by an authorized user/caregiver 760. These medication tracking features and actions can be setup directly on the primarymobile phone application 206 or remotely through a cellular and/or Internet connection by an authorized user/caregiver 750 using theweb portal 202 and/or thesecondary smartphone application 204. - d. Specialized hot buttons dialers for initiating calls to urgent calls to 911 and/or urgent response centers, different operators, concierge service and/or other service providers. Once pressed, these buttons not only connect
user 750 to 911 and/or urgent response centers (or other intended receiver), it also causesnotification 670 to authorized users/caregiver(s) 760 and a logging ofevent 720 for view byprimary smartphone user 750 and/or authorizedremote users 760. These button(s) can be graphical action buttons on the primary mobile phone screen similar to those in 1210 or buttons located outside the screen on the primarymobile phone 206 itself. - e. A series of pre-customized texts that the primary
mobile user 750 can use to communicate with authorized users/caregivers and/ormedical providers 760 without having to type an entire or portion of a text notification. These pre-customized texts can be customized on the primarymobile phone application 206 or remotely on theweb portal interface 202 and/or secondarymobile phone 204 by an authorized user/caregiver 760 and electronically sent through theconfiguration process 660 back to the primarymobile phone application 206 for use with text, email and/or other messaging features utilized by the primarymobile phone application 206. - f. Specialized web/
Internet 202 andmobile phone portals 204 for administrative and caregiving access and interaction with the primarymobile smartphone application 206 and among authorizedremote users 760 by a primary mobile user's 750 medical providers, living facility administration, urgent response centers, other lifestyle and/or application providers and authorizedcaregivers 760. Different kinds of authorizedremote users 760 may have their own specialized interface to thoseapplications - As mentioned above,
FIG. 5 illustrates exemplary features that a specializedcaregiving Internet portal 202 and secondary caregivermobile phone application 204 has in the disclosed embodiment of the system and method of the present invention. Such a portal 202 and/ormobile phone application 204 preferably are accessible through both secure Internet and mobile applications, allowing authorized users/caregivers 760 to interact with theprimary smartphone user 750 via theprimary smartphone application 206. Preferably, authorized users/caregivers 760 are allowed to update the primary smartphone application settings remotely—such as thephone book 526,medical profile 524,calendar appointments 520, 522, location trackinginterval settings notification settings urgent notification settings usability settings 526 such as changing colors, font size, ring and volume options or others described in the other claims of this application. It could also be used to send information to theprimary smartphone application 206—such as instructions for taking medication or driving directions. - Examples of remote authorized
users 760 might include, but are not limited to: family, volunteer caregivers, occupational therapists, medical providers, and/or independent living facility staff. - The
remote application system 208,caregiver portal 202 and/or the secondarymobile applications 204 allow the primarymobile user 750 and remote authorizedusers 760 to also get in touch with the larger caregiver community. Authorized users/caregivers 760 can interact with one another, sharing advice or tips. Such users can also find technical assistance. - In one embodiment of the system and method of the present invention, the secondary
mobile application 204, with some and/or all of its described functionality, can co-exist on the primarymobile phone 206 and be used in conjunction with the primarymobile phone application 206. Similarly, a primarymobile phone user 750 can also serve the role of an authorizedremote user 760 and vice versa in various situations. For example, a spouse can act as both acare receiver 750 and acaregiver 760. Those skilled in the art will appreciate that all embodiments, methods, systems and/or processes described in the instant application should be construed also incorporating the possibility of this dual role. - In the disclosed embodiment of the system and method of the present invention, the system and method of the present invention is configured such that
web portal 202 and thesecondary smartphone application 204 provides access to a storefront for obtaining the system software solutions and related cellular hardware, services and accessories. - One embodiment of the system and method of the present invention further comprises a radio
alert connectivity device 1302 that, when activated, sends a signal to its host radio-enabled mobile phone 206 (e.g., viaBluetooth 618 orother radio 616, 630) to dial a predetermined number and/or connect via secure Internet connection to a predetermined application and/or call center and/or other authorizeduser 760. -
FIG. 13 illustrates an example of a radio alert connectivity device according to the principles of the system and method of the present invention. In addition to containing aradio 1308 for communicating with theprimary smartphone application 206, thealert connectivity device 1302 also contains amicrophone 1306 andspeakerphone 1304 that can be used to listen and speak withprimary phone user 750 as well as the remotely authorized person/call center 760 to whom the primary smartphone application andphone 206 are connected. Thedevice 1302 also initiates location tracking of theprimary smartphone device 206, message notifications 670 (via text, email or Internet) to authorizedthird parties 760 and picture and/or video capture & sendnotifications 670. Essentially, the device 1320 turns theprimary smartphone 206 into a mobile Personal Emergency Response System (PERS). - As discussed above, the system and method of the present invention comprises software among the
primary system application 208, theweb application 202 and the secondarymobile application 204 configured to remotely customize the primarymobile phone application 206—including font size, screen colors, volume, creating and setting custom alarms with calling actions, creating and setting custom surveys with calling actions, editing/updating phone contact information, medical profile, turning on/off certain features as well as interacting with theprimary smartphone 206 via the methods described in all the claims in this application. Configuration changes and setup are made via the interfaces of theweb portal application 202 and/or the secondarymobile application 204. The information is captured and pushed either directly to the primarymobile application 206 or indirectly to theprimary application system 208 which may either push the changes through to the primarymobile application 206 real time and/or wait for a synchronization event between the primarymobile application 206 and theprimary application system 208 to occur. Theprimary application system 208 will treat the setup and configuration changes as data collected 702 and log the information in thelogging database 720 for the monitoring processes 650, for viewing byprimary users 750 and authorizedremote users 760 and to eventually push to and synchronize with theprimary smartphone application 206 any changes made directly on theprimary smartphone application 206 itself. - In the disclosed embodiment of the system and method of the present invention, the system and method of the present invention is configured to maintain a medical profile of the primary
mobile user 750 on the primarymobile phone application 206 that can be accessed and/or updated on themobile phone 206 itself or remotely via cellular and/or Internet connection by authorized users for use by the primarymobile application 206.FIG. 14 illustrates an exemplary interface showing how a medical profile might function on theprimary smartphone application 206. In one embodiment, a sticker on the back of thephone 206 provides easy instructions for quick access to the medical profile. - A medical profile can include, but is not limited to, information such as medical conditions, allergies and/or drug sensitivities, reactions, medical devices, medications, blood type and/or other relevant patient information for reference in urgent and non-urgent medical situations. The profile can be updated by authorized
users primary smartphone application 206 or remotely through the secureremote application system 208 including anInternet web portal 202 and/or secondarymobile application 204. Certain parts of the medical profile can be flagged in the application's database by the user to be shown on the home screen and/or locked screen of the primarymobile application 206. - In the disclosed embodiment of the system and method of the present invention, the system and method of the present invention is configured to recognize a shaking pattern and/or a voice (through voice recognition) that results in the primary
mobile phone 206 answering the phone and/or resulting in taking other pre-determined actions 670 (instead of pushing a button to answer the phone or take an action). - A predefined physical shaking pattern is into the primary
mobile smartphone application 206, which then senses changes in movement based on the accelerometer/gyroscopic technology 612 embedded in the phone. In a process similar to the fall detection monitoring process shown and described inFIG. 17 , if the primarymobile user 750 shakes thephone 206 in a manner consistent with a predefined pattern in which acceleration timing is greater than a minimum, pre-defined value and direction change indicates a pattern of movement over a short distance (less than a pre-defined value), followed abruptly by inverted movement over a similar short distance, and then repeated at minimum a number of predefined number of times, the primarymobile smartphone application 206 can recognize the pattern via the monitoring processes 650 and the intelligentevent identification engine 710 and takepredetermined actions 670, such as answering an incoming call and/or taking the response to mean an answer to a question such as “yes” or “no” to a phone survey (as described elsewhere in the instant application) or to initiate a call to a phone number (such as 911 or an urgent call center) that has been pre-linked to a particular pattern. - In the disclosed embodiment of the invention, the primary
mobile smartphone application 206 can prompt themobile user 750 for whether they would like to answer the phone, dial a user and/or take similar action and then utilize established voice recognition (VR) technology via APIs into that VR software to await a predetermined voice response (such as “Yes” or “Answer”). Using the monitoring processes 650 previously described, the intelligentevent identification engine 710 can recognize and match the pattern it sees, consult theconfiguration 660 and createappropriate event notifications 670. - In the disclosed embodiment of the invention, the primary
mobile smartphone application 206 and/or the secondarymobile application 204 is configured to allow the mobile user (750,760) to switch back-and-forth between standard telephonic, cellular-based audio phone connectivity and a VOIP/Internet-based audio and/or video connection, including while a phone call is underway or while it may appear to the user that the phone call is underway. -
FIG. 1 shows an example of this functionality andFIG. 22 a illustrates the process of the system and method of the present invention for switching from a standard telephonic, cellular-based audio phone call to an Internet-based, VOIP connection that allows both audio and/or video connectivity while a standard, telephonic, cellular-based audio phone call is underway within the application system. -
FIG. 22 b illustrates the process of the system and method of the present invention for switching from an Internet-based/VOIP connection to a standard telephonic, cellular-based audio phone call while an Internet-based/VOIP connection is underway within the application system. - While a call is underway, the
user mobile user 750 pressing a button to switch (as illustrated inFIG. 1 ) on the primarymobile application 206 in-call screen or by a remote user, such as a remote authorizeduser 760, pressing a similar button on their in-call screen of the secondarymobile application 204, the webportal application interface 202, and/or a special version of a secondarymobile application 204 that is designed specifically for (possibly non-authorized) remote users in order to leverage the video streaming/VOIP client that theprimary application system 208 utilizes and requires to make a video/VOIP call. Such as connection switch between audio and/or video and audio may be accomplished as follows: - When the existing call is standard telephonic, cellular-based audio call and the “initiating” user clicks to switch to either a VOIP-based audio or audio/video call, the process of the system and method of the present invention, as illustrated in
FIG. 22 a is as follows: - When the initiating user is in a standard telephonic, cellular-based audio call, they will have the option to select a button that indicates they can switch to a VOIP call (and possibly given choice whether to maintain audio only or go to video and audio VOIP call). The VOIP call button is only active if the local application (which could be 204 or 206) of the initiating user has that particular contact in the phonebook flagged in the local database as having VOIP access. Alternatively, the local application can check that the remote application has VOIP connectivity after the initiating user clicks on the switch button. Upon clicking, the switch button, the application may confirm intentions with the initiating user. A positive response results in the initiating
application local application PAS 208 will electronically confirm the “recipient” mobile application's status of its VOIP client to confirm that it exists, is enabled and possibly that it is connected to the Internet and possibly the strength of connection. - If unable to confirm these facets, the
PAS 208 will send an electronic message to the initiatingmobile application application application mobile application - If the
PAS 208 is able to confirm that the recipient mobile application's 204, 206 VOIP client's status (i.e., that it exists, is enabled and possibly that it is connected to the Internet and possibly connection strength) then the PAS's 208 VOIP server will reach out to the recipient application's 204, 206 VOIP client and establish a bridge connection with the initiating application's 204, 206 VOIP client. - At any point after initiating the switch, either the initiating
mobile application PAS 208 will have notified the recipientremote application mobile application mobile application PAS 208, thePAS 208 will also notify the initiatingmobile application - When the existing call is a VOIP-based audio or audio/video call and the initiating user wants to switch between VOIP-based audio and audio/video, the VOIP connection will toggle back and forth in what is an established process for the VOIP connection.
- When the existing call is a VOIP-based audio or audio/video call and the initiating user wants to switch to a standard telephonic, cellular-based audio call (perhaps because the Internet connection is not strong at the moment and the initiating
mobile application FIG. 22 b, is as follows: - When the initiating user is in a VOIP-based audio or audio/video call, they will have the option to select a button that indicates they can switch to a standard telephonic, audio-based cellular call. Upon clicking, the switch button, the application may confirm intentions with the initiating user. A positive response will cause the initiating
application application - Assuming the cellular signal is present (and possibly strong enough), the initiating
application - If both initiating and recipient application's 204,206 are able to maintain both a VOIP connection and standard cellular connection simultaneously, then the
recipient application application - If either the initiating or recipient application's 204,206 phone (or both) are unable to simultaneously maintain a VOIP connection and standard cellular connection simultaneously, then either the initiating
application recipient application PAS 208 will cause the VOIP client to drop the connection prior to initiating the cellular call. The initiatingmobile application PAS 208 andrecipient application - In the disclosed embodiment of the invention, VOIP calls can be made from the outset (not only switched during calls) via the primary
mobile application 206, the secondarymobile application 204 and/or theweb application system 202. The local phonebook database within all those applications is configured to register whether a contact has registered a compatible VOIP client with thePAS 208. - In the disclosed embodiment, the system and method of the present invention comprises the aggregated feature set and/or subsets of the capabilities and features described in this application, for use in connecting
primary users 750 and authorized remote parties 760 (e.g. caregivers) with one another for urgent and non-urgent situations. The feature set includes but is not limited to audio and/or video direct connect, automated remote connectivity, automated call conferencing based on predetermined phone numbers, location tracking, automated picture and/or video sending/remote camera monitoring, automated location tracking with photo and/or video logging, intelligent monitoring of urgent and non-urgent situations, including but not limited to lack of movement with the primarymobile phone 206, lack of reaching a location by the primarymobile phone 206, automated fall detection, automated wellness checks/custom actionable surveys, as well as remotely updating and customizing the primarymobile phone application 206 from asecure Internet application 202 and/or secondarymobile applications 204 and a specialized user interface that compels theprimary application user 750 to utilize theirsmartphone 206 though it is not required to make use of the application features described herein. - In the disclosed embodiment, the system and method of the present invention further comprises a unique purchase and installation process. In the disclosed embodiment, those wishing to purchase the software and/or devices compatible with the system and method of the instant invention can either call or visit a
predetermined website 202. In the disclosed embodiment, there are two different paths depending on whether theuser - For
users - 1. Smartphone and cellular plan selection.
- The website makes recommendations for specific smartphones that have been thoroughly tested to be compatible with the system and method of the present invention.
- A secondary
mobile application 204 can also be separately purchased and/or downloaded. The secondarymobile application 204 is not necessary for receiving text messages or calls on their cell phones. - 2. User information gathering
- Information gathered includes:
-
- a.
Primary User 750 contact information - b. Authorized user(s)/Caregiver(s) 760 contact information (primary administrator and/or others)
- c. Preferences for
customization 660 ofprimary smartphone application 206 information, including but not limited to: medical profile (if desired), any initial phonebook entries (doctors, caregivers, living facility, etc.), any automated reminders, automated wellness checks and wellness check content, caregiver notification options, phone tracking options for urgent situations (location tracking on/off, tracking intervals, call logging, camera picture snapping on/off, video conference options, simplified interface on/off, etc.). - Emails may be sent to the authorized remote user(s) 760 if provided in the setup process as well as possibly a unique code or series of codes via SMS or by calling the authorized remote user(s) 760 phone that will be required to be entered and match in order to help confirm their identification from two separate sources.
- a.
- 3. Consent and authorization forms
- Electronic disclaimers and authorization forms for
primary users 750 and authorized user(s)/caregiver(s) 760. If theprimary user 750 is not the purchaser or present on the phone when purchasing, they will need to authorize usage on theirphone 206 when it is received. - 4. Shipping & payment for any purchases, including but not limited to: primary smartphone and
primary smartphone application 206 and/or secondary mobile smartphone andapplication 204. - For new primary
mobile phone 206 purchases, the primarymobile application 206 will be configured and customized so that thephone 206 is ready to go when theuser 750 receives it. After auser - 5. Phone arrival
- Once the primary smartphone with
primary smartphone application 206 has arrived and theuser primary smartphone application 206 will automatically run and initiate a “startup” process to activate the phone, provide electronic disclaimer/authorization, and to provide an optional tutorial to demonstrate how the phone works. Alternatively, theuser primary smartphone application 206 will have pre-installed all of the preference settings provided during the purchase process, which then can be adjusted at any time on thephone 206 or remotely by an authorized user/caregiver and/or company authorizedoperator 760. - If the
primary user 750 already has a smartphone that is compatible with theprimary smartphone application 206, they can go to an authorized marketplace to purchase and download the primarysmartphone application software 206 to their smartphones. They then can visit aspecific website 202 to provide additional user information, setup authorized user(s)/caregiver(s) 760, customize other user settings and purchase any additional hardware or accessories (as described above). Alternatively, the user can open the newly downloadedprimary smartphone application 206 and/or secondarymobile phone application 204 which will also walk them through the setup process on the phone itself as well as provide the appropriate electronic disclaimer(s). - All patents referred to herein, are hereby incorporated herein by reference, whether or not specifically done so within the text of this disclosure.
- In the present disclosure, the words “a” or “an” are to be taken to include both the singular and the plural. Conversely, any reference to plural items shall, where appropriate, include the singular.
- From the foregoing it will be observed that numerous modifications and variations can be effectuated without departing from the true spirit and scope of the novel concepts of the present invention. It is to be understood that no limitation with respect to the specific embodiments illustrated is intended or should be inferred. The disclosure is intended to cover by the appended claims all such modifications as fall within the scope of the claims.
Claims (18)
1. A system for remote care and monitoring, comprising:
a first mobile device for use by a first user;
a second device for use by a second user; and
a server, the server configured to communicate with the first mobile device and the second device;
wherein the first mobile device further comprises: a monitoring processes engine, the monitoring processes engine configured to monitor the first user and the first mobile device; and, an intelligent event identification engine in communication with the monitoring processes engine, the intelligent event identification engine configured to automatically activate at least one feature of the first mobile device based on information received from the monitoring processes engine and/or automatically generate at least one notification based on the information received from the monitoring processes engine.
2. The system for remote care and monitoring of claim 1 wherein the monitoring processes engine is further configured to detect and log information about the activity and inactivity of the first user, the activity and inactivity of the first user being determined by at least one of: at least one location of the first mobile device, at least one movement of the first mobile device, at least one picture automatically captured by the first mobile device, at least one video automatically captured by the first mobile device, at least one intended destination of the first mobile device, at least one response by the first user to at least one wellness check-in, at least one call of the first mobile device, at least one response by the first user to at least one medication reminder, at least one response by the first user to at least one alert, at least one fall detection of the first device, at least one idleness check of the first device, or at least one violation of a medical profile of the first user.
3. The system for remote care and monitoring of claim 1 wherein the first mobile device is configured to automatically establish a live telephonic and/or voice-over-IP (VOIP) call comprising audio and/or video communications between the first user and the second user, the call being initiated by the second user through the second device and/or the server, and the call being automatically established without interaction by the first user with the first mobile device after the first mobile device authenticates the second user and validates that the second user has initiated the call.
4. The system for remote care and monitoring of claim 1 wherein the at least one feature comprises generating a recording of video and/or audio.
5. The system for remote care and monitoring of claim 4 wherein the first mobile device is configured to transmit the recording to the second user after the first mobile device authenticates the second user.
6. The system for remote care and monitoring of claim 1 wherein the first mobile device is a smartphone.
7. The system for remote care and monitoring of claim 1 wherein the second device is a smartphone.
8. The system for remote care and monitoring of claim 1 wherein the second device is a computer.
9. The system for remote care and monitoring of claim 1 wherein the at least one notification comprises a notification sent to the second user.
10. The system for remote care and monitoring of claim 1 wherein the at least one notification comprises a notification sent to a third party.
11. The system for remote care and monitoring of claim 1 wherein the at least one feature of the mobile device comprises a camera, a microphone, a speakerphone, a global positioning system, an accelerometer, a magnetometer, a wireless radio, a cellular system, a Bluetooth radio, a touch screen, an internal clock, a messaging system, or a calendar system
12. The system for remote care and monitoring of claim 1 wherein the monitoring processes engine is further configured to monitor an operational status of the first mobile device.
13. The system for remote care and monitoring of claim 1 wherein the intelligent event identification engine is further configured to recognize patterns in the information received from the monitoring processes engine and make inferences based on the information.
14. The system for remote care and monitoring of claim 1 wherein the first mobile device and the second device are configured to switch between cellular-based audio-only communications between the first user and the second user and Internet-based audio or audio-visual communications between the first user and the second user, the switch occurring during an existing call between the first user and the second user.
15. The system for remote care and monitoring of claim 1 wherein the second device is configured to communicate with the first mobile device to allow the second user to customize a user interface for the first user on the first mobile device.
16. The system for remote care and monitoring of claim 1 wherein the information received from the monitoring processes engine comprises at least one of: data received from sensors of the first mobile device, a time, a result of a wellness check on the first user, a result of a safety check on the first user, or a configuration change of the first mobile device.
17. The system for remote care and monitoring of claim 1 further comprising a radio alert connectivity device configured to communicate with the first mobile device.
18. A system for remote care and monitoring, comprising:
a first mobile device for use by a first user;
a second device for use by a second user; and
a server, the server configured to communicate with the first mobile device and the second device;
wherein the first mobile device is configured to automatically establish a live telephonic and/or voice-over-IP (VOIP) call comprising audio and/or video communications between the first user and the second user, the call being initiated by the second user through the second device and/or the server, and the call being automatically established without interaction by the first user with the first mobile device after the first mobile device authenticates the second user and validates that the second user has initiated the call.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/675,097 US20150215753A1 (en) | 2011-09-12 | 2015-03-31 | System and method for remote care and monitoring using a mobile device |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201161533600P | 2011-09-12 | 2011-09-12 | |
US13/612,368 US9020476B2 (en) | 2011-09-12 | 2012-09-12 | System and method for remote care and monitoring using a mobile device |
US14/675,097 US20150215753A1 (en) | 2011-09-12 | 2015-03-31 | System and method for remote care and monitoring using a mobile device |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/612,368 Continuation US9020476B2 (en) | 2011-09-12 | 2012-09-12 | System and method for remote care and monitoring using a mobile device |
Publications (1)
Publication Number | Publication Date |
---|---|
US20150215753A1 true US20150215753A1 (en) | 2015-07-30 |
Family
ID=47830298
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/612,368 Active 2033-02-08 US9020476B2 (en) | 2011-09-12 | 2012-09-12 | System and method for remote care and monitoring using a mobile device |
US14/675,097 Abandoned US20150215753A1 (en) | 2011-09-12 | 2015-03-31 | System and method for remote care and monitoring using a mobile device |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/612,368 Active 2033-02-08 US9020476B2 (en) | 2011-09-12 | 2012-09-12 | System and method for remote care and monitoring using a mobile device |
Country Status (1)
Country | Link |
---|---|
US (2) | US9020476B2 (en) |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150112883A1 (en) * | 2013-10-17 | 2015-04-23 | Adt Us Holdings, Inc. | Portable system for managing events |
US20150312533A1 (en) * | 2014-04-29 | 2015-10-29 | Vik Moharir | Method, system and apparatus for transcribing information using wearable technology |
US20160337518A1 (en) * | 2015-05-13 | 2016-11-17 | Interactive Intelligence, Inc. | Determining an active station based on movement data |
US9524530B2 (en) | 2014-04-29 | 2016-12-20 | Vik Moharir | Method, system and apparatus for transcribing information using wearable technology |
CN107613214A (en) * | 2017-10-25 | 2018-01-19 | 广东工业大学 | A kind of camera interface access method, apparatus and system |
US10423760B2 (en) | 2014-04-29 | 2019-09-24 | Vik Moharir | Methods, system and apparatus for transcribing information using wearable technology |
US10424405B2 (en) | 2014-04-29 | 2019-09-24 | Vik Moharir | Method, system and apparatus for transcribing information using wearable technology |
US11016792B1 (en) | 2019-03-07 | 2021-05-25 | Amazon Technologies, Inc. | Remote seamless windows |
US11245772B1 (en) * | 2019-03-29 | 2022-02-08 | Amazon Technologies, Inc. | Dynamic representation of remote computing environment |
US11252097B2 (en) | 2018-12-13 | 2022-02-15 | Amazon Technologies, Inc. | Continuous calibration of network metrics |
US11336954B1 (en) | 2018-12-12 | 2022-05-17 | Amazon Technologies, Inc. | Method to determine the FPS on a client without instrumenting rendering layer |
US11356326B2 (en) | 2018-12-13 | 2022-06-07 | Amazon Technologies, Inc. | Continuously calibrated network system |
US11368400B2 (en) | 2018-12-13 | 2022-06-21 | Amazon Technologies, Inc. | Continuously calibrated network system |
US11461168B1 (en) | 2019-03-29 | 2022-10-04 | Amazon Technologies, Inc. | Data loss protection with continuity |
WO2022216830A1 (en) * | 2021-04-09 | 2022-10-13 | Doximity, Inc. | Phone call to patient from within video call |
US20230114515A1 (en) * | 2015-10-29 | 2023-04-13 | Lai King Tee | System and Method for Mobile Platform Designed for Digital Health Management and Support for Remote Patient Monitoring |
US11929181B2 (en) | 2021-04-09 | 2024-03-12 | Doximity, Inc. | Phone call to patient from within video call |
Families Citing this family (112)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2957808B1 (en) * | 2010-03-29 | 2012-11-02 | Heart Dream Diffusion Concept | DEVICE FOR ACCESSING ASSISTANCE AND RELIEF EQUIPMENT, AND A SYSTEM IMPLEMENTING SUCH DEVICES. |
US9318129B2 (en) * | 2011-07-18 | 2016-04-19 | At&T Intellectual Property I, Lp | System and method for enhancing speech activity detection using facial feature detection |
US8965347B1 (en) * | 2011-10-24 | 2015-02-24 | West Corporation | Method and apparatus of providing a mobile phone notification service |
US8667072B1 (en) | 2011-10-24 | 2014-03-04 | West Corporation | Method and apparatus of providing live support service in a notification system |
US9860365B2 (en) * | 2012-03-23 | 2018-01-02 | Fujitsu Limited | Providing setting adjustments to a communication device |
USD731528S1 (en) * | 2012-05-15 | 2015-06-09 | Fujitsu Limited | Display with a graphical user interface |
JP5666646B2 (en) * | 2012-06-21 | 2015-02-12 | シャープ株式会社 | User situation confirmation system, user situation confirmation method, server apparatus, communication terminal apparatus, server computer program, and terminal computer program |
US20140081683A1 (en) * | 2012-09-14 | 2014-03-20 | Sap Ag | Business process management for mobile portal clients |
CN103685712A (en) * | 2012-09-25 | 2014-03-26 | 腾讯科技(深圳)有限公司 | A method for refreshing a browser page of a mobile terminal and a mobile terminal |
US9378238B2 (en) | 2012-09-27 | 2016-06-28 | Aetherpal, Inc. | Method and system for collection of device logs during a remote control session |
US9280637B2 (en) | 2012-10-05 | 2016-03-08 | Cerner Innovation, Inc. | Multi-action button for mobile devices |
US20140143729A1 (en) * | 2012-11-19 | 2014-05-22 | Frank Myers | Emergency contact system |
US9185202B2 (en) | 2012-12-31 | 2015-11-10 | Cerner Innovation, Inc. | Alert management utilizing mobile devices |
US10275570B2 (en) | 2012-12-31 | 2019-04-30 | Cerner Innovation, Inc. | Closed loop alert management |
US20140266702A1 (en) * | 2013-03-15 | 2014-09-18 | South East Water Corporation | Safety Monitor Application |
WO2014155426A1 (en) * | 2013-03-29 | 2014-10-02 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ | Device control method and program |
ITAN20130088A1 (en) * | 2013-05-09 | 2014-11-10 | Sauro Bianchelli | METHOD OF PROCESSING AND CONTROL FOR INTELLIGENT SMARTPHONE OR SIMILAR TYPES |
US9426638B1 (en) | 2013-05-14 | 2016-08-23 | Tapshield Protection, LLC | System and method for signaling and responding to an emergency situation |
US10218582B2 (en) * | 2013-09-26 | 2019-02-26 | Apple Inc. | Notifications with input-based completion |
CN103581852B (en) * | 2013-09-30 | 2018-03-06 | 吴家宝 | The method, device and mobile terminal system of falling over of human body detection |
US20150111187A1 (en) * | 2013-10-19 | 2015-04-23 | Peter K. Loeb, JR. | System and method for providing a client engagement platform to assist a client in the compliance of addiction treatment |
US9232373B1 (en) * | 2013-10-21 | 2016-01-05 | West Corporation | Providing data messaging support by intercepting and processing received short message service (SMS) messages at a customer support service |
WO2015065361A1 (en) * | 2013-10-30 | 2015-05-07 | Aetherpal Inc. | Method and system for collection of device logs during a remote control session |
CN104679313A (en) * | 2013-11-30 | 2015-06-03 | 深圳富泰宏精密工业有限公司 | Touch panel initialization system and method and touch device |
US9226109B2 (en) | 2013-12-31 | 2015-12-29 | Ping4 Inc. | System and method for anonymous delivery of geographically specific rich media information |
KR102102647B1 (en) * | 2014-02-21 | 2020-04-21 | 엘지전자 주식회사 | Wireless receiver and method for controlling the same |
US20150244855A1 (en) * | 2014-02-27 | 2015-08-27 | True-Kare, Serviços e Equipamentos, Lda | Providing Assistance to Special Needs Users |
US8990359B1 (en) * | 2014-05-19 | 2015-03-24 | Parrable, Inc. | Methods and apparatus for pixel encoded web page |
US9628416B2 (en) * | 2014-05-30 | 2017-04-18 | Cisco Technology, Inc. | Photo avatars |
WO2016001165A2 (en) * | 2014-07-02 | 2016-01-07 | Doro AB | Improved communication |
US9838858B2 (en) | 2014-07-08 | 2017-12-05 | Rapidsos, Inc. | System and method for call management |
US11545251B2 (en) * | 2014-08-04 | 2023-01-03 | Caregem Health Inc. | Patient-centered mobile communication system and method |
US10573412B2 (en) * | 2014-08-04 | 2020-02-25 | Sanjeev Rastogi | Patient-centered mobile communication system and method |
US9942739B2 (en) | 2014-09-19 | 2018-04-10 | Rapidsos, Inc. | Method and system for emergency call management |
CN105635423A (en) * | 2014-11-07 | 2016-06-01 | 青岛海信移动通信技术股份有限公司 | Electronic device and telephone number calling method thereof |
US9799206B1 (en) * | 2015-01-05 | 2017-10-24 | Brenda Michelle Wilson Van Horn | Method for automating emergency distress signals from a networked peripheral device |
US10347108B2 (en) * | 2015-01-16 | 2019-07-09 | City University Of Hong Kong | Monitoring user activity using wearable motion sensing device |
US10540875B2 (en) * | 2015-02-10 | 2020-01-21 | Allwater Marine Group, LLC | Emergency response system |
US10902946B2 (en) * | 2015-05-20 | 2021-01-26 | Watchrx, Inc. | Medication adherence device and coordinated care platform |
US20160350511A1 (en) * | 2015-05-27 | 2016-12-01 | Elliot Roger Franz | Method of Improving Patient Medication Compliance |
US20160307436A1 (en) * | 2015-07-30 | 2016-10-20 | Monty Nixon | Emergency Safety Monitoring System and Method |
US20170235907A1 (en) * | 2015-09-16 | 2017-08-17 | Kersti A. Peter | Remote healthcare system for family care |
US10667257B2 (en) | 2015-09-29 | 2020-05-26 | Koninklijke Philips N.V. | Remote initiation of tasks on idle wireless computing devices |
US10607728B2 (en) | 2015-10-06 | 2020-03-31 | Cerner Innovation, Inc. | Alert optimizer |
JP2018538645A (en) | 2015-11-02 | 2018-12-27 | ラピッドエスオーエス,インク. | Method and system for situational awareness for emergency response |
US11568426B2 (en) * | 2015-11-24 | 2023-01-31 | Avaya Inc. | Sharing virtual business venues and feedback with social connections |
US20170156018A1 (en) * | 2015-11-30 | 2017-06-01 | Le Holdings (Beijing) Co., Ltd. | Method And Electronic Device For Online Tuning Application |
US10665079B2 (en) * | 2015-12-15 | 2020-05-26 | Tracfone Wireless, Inc. | Device, system, and process for automatic fall detection analysis |
MX2018007509A (en) | 2015-12-17 | 2018-11-29 | Rapidsos Inc | Devices and methods for efficient emergency calling. |
US10037411B2 (en) | 2015-12-30 | 2018-07-31 | Cerner Innovation, Inc. | Intelligent alert suppression |
US10963279B2 (en) * | 2015-12-31 | 2021-03-30 | International Business Machines Corporation | Host-subordinate computing device administration and control using a host virtual machine manager |
US9986404B2 (en) | 2016-02-26 | 2018-05-29 | Rapidsos, Inc. | Systems and methods for emergency communications amongst groups of devices based on shared data |
CA3023982A1 (en) | 2016-05-09 | 2017-11-16 | Rapidsos, Inc. | Systems and methods for emergency communications |
RU2018144262A (en) | 2016-05-13 | 2020-06-15 | Конинклейке Филипс Н.В. | SYSTEM AND METHOD FOR TRAINING BY CAREERS OF UNOFFICIAL OBSERVATIONS OF CAREER |
US10795570B2 (en) * | 2016-05-23 | 2020-10-06 | Prepare Protect Defend, LLC | Device and system having a user interface for emergency communications |
US11680948B2 (en) | 2016-08-12 | 2023-06-20 | Abreos Biosciences, Inc. | Detection and quantification of natalizumab |
US10298747B2 (en) * | 2016-10-17 | 2019-05-21 | Richard Clark | Smart phone platform for kids |
US11450433B2 (en) * | 2017-02-02 | 2022-09-20 | Becare Link, Llc | System and method for remote diagnosis of disease progression |
EP3579750A1 (en) | 2017-02-13 | 2019-12-18 | Starkey Laboratories, Inc. | Fall prediction system including an accessory and method of using same |
CN114579774A (en) * | 2017-03-03 | 2022-06-03 | 谷歌有限责任公司 | System and method for detecting that an application improperly implements presentation of a content item |
US20200069223A1 (en) * | 2017-03-14 | 2020-03-05 | Connectus Life Pty Ltd | System for detection of falls |
US10642812B1 (en) * | 2017-03-24 | 2020-05-05 | Mckesson Corporation | Database system, computing device and method for message construction, processing and storage dependent upon satisfaction of predefined requirements |
US10845955B2 (en) | 2017-05-15 | 2020-11-24 | Apple Inc. | Displaying a scrollable list of affordances associated with physical activities |
US11330418B2 (en) * | 2017-06-20 | 2022-05-10 | Otis Elevator Company | Lone worker safely check |
US10957445B2 (en) | 2017-10-05 | 2021-03-23 | Hill-Rom Services, Inc. | Caregiver and staff information system |
US11153156B2 (en) * | 2017-11-03 | 2021-10-19 | Vignet Incorporated | Achieving personalized outcomes with digital therapeutic applications |
WO2019113129A1 (en) | 2017-12-05 | 2019-06-13 | Rapidsos, Inc. | Social media content for emergency management |
US11444943B1 (en) * | 2017-12-27 | 2022-09-13 | Meta Platforms, Inc. | Exchange content between client devices when a client device determines a user is within a field of view of an image capture device of the client device and authorized to exchange content |
US10820181B2 (en) | 2018-02-09 | 2020-10-27 | Rapidsos, Inc. | Emergency location analysis system |
DK180241B1 (en) | 2018-03-12 | 2020-09-08 | Apple Inc | User interfaces for health monitoring |
US20190320310A1 (en) | 2018-04-16 | 2019-10-17 | Rapidsos, Inc. | Emergency data management and access system |
DK179992B1 (en) | 2018-05-07 | 2020-01-14 | Apple Inc. | Visning af brugergrænseflader associeret med fysiske aktiviteter |
US11317833B2 (en) | 2018-05-07 | 2022-05-03 | Apple Inc. | Displaying user interfaces associated with physical activities |
CN108833820B (en) * | 2018-05-29 | 2021-03-12 | Oppo广东移动通信有限公司 | Video call method and related product |
EP3803774A4 (en) | 2018-06-11 | 2022-03-09 | Rapidsos, Inc. | Systems and user interfaces for emergency data integration |
US11917514B2 (en) | 2018-08-14 | 2024-02-27 | Rapidsos, Inc. | Systems and methods for intelligently managing multimedia for emergency response |
US20200168317A1 (en) | 2018-08-22 | 2020-05-28 | Centre For Addiction And Mental Health | Tool for assisting individuals experiencing auditory hallucinations to differentiate between hallucinations and ambient sounds |
US11100918B2 (en) * | 2018-08-27 | 2021-08-24 | American Family Mutual Insurance Company, S.I. | Event sensing system |
CH715444A1 (en) * | 2018-10-11 | 2020-04-15 | Herrli Peter | Device for determining the well-being of a person. |
US11728031B2 (en) | 2018-10-12 | 2023-08-15 | Bfc Med Llc | Software application for patient care and related device, system, and method |
US10977927B2 (en) | 2018-10-24 | 2021-04-13 | Rapidsos, Inc. | Emergency communication flow management and notification system |
US11243688B1 (en) * | 2018-12-05 | 2022-02-08 | Mobile Heartbeat, Llc | Bi-directional application switching with contextual awareness |
EP3895141B1 (en) | 2018-12-15 | 2024-01-24 | Starkey Laboratories, Inc. | Hearing assistance system with enhanced fall detection features |
US11638563B2 (en) | 2018-12-27 | 2023-05-02 | Starkey Laboratories, Inc. | Predictive fall event management system and method of using same |
US11218584B2 (en) | 2019-02-22 | 2022-01-04 | Rapidsos, Inc. | Systems and methods for automated emergency response |
US10964189B2 (en) | 2019-03-15 | 2021-03-30 | K4Connect Inc. | Home automation system determining deviated operation device pattern and related methods |
US11082248B2 (en) | 2019-03-15 | 2021-08-03 | K4Connect Inc. | Home automation system including changed current usage notification and related methods |
US11573027B2 (en) | 2019-03-15 | 2023-02-07 | K4Connect Inc. | Home automation (HA) system for identifying a health condition based upon user thermostat setting data and related methods |
US11146680B2 (en) | 2019-03-29 | 2021-10-12 | Rapidsos, Inc. | Systems and methods for emergency data integration |
US10911926B2 (en) * | 2019-03-29 | 2021-02-02 | Rapidsos, Inc. | Systems and methods for emergency data integration |
EP3953919A4 (en) * | 2019-04-12 | 2023-01-04 | Aloe Care Health, Inc. | Emergency event detection and response system |
USD928176S1 (en) | 2019-04-17 | 2021-08-17 | Aloe Care Health, Inc. | Display panel of a programmed computer system with a graphical user interface |
DK201970534A1 (en) | 2019-06-01 | 2021-02-16 | Apple Inc | User interfaces for monitoring noise exposure levels |
US11209957B2 (en) | 2019-06-01 | 2021-12-28 | Apple Inc. | User interfaces for cycle tracking |
US11234077B2 (en) | 2019-06-01 | 2022-01-25 | Apple Inc. | User interfaces for managing audio exposure |
US11152100B2 (en) | 2019-06-01 | 2021-10-19 | Apple Inc. | Health application user interfaces |
US11228835B2 (en) | 2019-06-01 | 2022-01-18 | Apple Inc. | User interfaces for managing audio exposure |
US11228891B2 (en) | 2019-07-03 | 2022-01-18 | Rapidsos, Inc. | Systems and methods for emergency medical communications |
US11894129B1 (en) | 2019-07-03 | 2024-02-06 | State Farm Mutual Automobile Insurance Company | Senior living care coordination platforms |
US12002588B2 (en) | 2019-07-17 | 2024-06-04 | Apple Inc. | Health event logging and coaching user interfaces |
US11367527B1 (en) | 2019-08-19 | 2022-06-21 | State Farm Mutual Automobile Insurance Company | Senior living engagement and care support platforms |
EP4004702A1 (en) | 2019-09-09 | 2022-06-01 | Apple Inc. | Research study user interfaces |
US11393359B2 (en) | 2020-04-16 | 2022-07-19 | Make Music Count Llc | System to teach mathematics using virtual musical instruments and associated methods |
DK181037B1 (en) | 2020-06-02 | 2022-10-10 | Apple Inc | User interfaces for health applications |
IT202000015697A1 (en) * | 2020-06-30 | 2021-12-30 | Pam Mobility Srl | VIDEO CALLING SYSTEM, PARTICULARLY FOR HEALTHCARE AND/OR ASSISTANCE FACILITIES. |
US11698710B2 (en) | 2020-08-31 | 2023-07-11 | Apple Inc. | User interfaces for logging user activities |
US11330664B1 (en) | 2020-12-31 | 2022-05-10 | Rapidsos, Inc. | Apparatus and method for obtaining emergency data and providing a map view |
US11935651B2 (en) | 2021-01-19 | 2024-03-19 | State Farm Mutual Automobile Insurance Company | Alert systems for senior living engagement and care support platforms |
US11729234B2 (en) * | 2021-03-01 | 2023-08-15 | Daniel Goddard | Augmented reality positioning and matching system |
US11706262B2 (en) * | 2021-04-24 | 2023-07-18 | Qiong Li | System and method for group communication and information sharing |
US11599923B2 (en) | 2021-05-28 | 2023-03-07 | Jimmy Villaverde Calva | System and method for ordering of goods or services via video conference with establishment attendant or virtual avatar |
AT525729B1 (en) * | 2022-05-27 | 2023-07-15 | Farhad Pezeshki | Asymmetric communication system |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3373568A3 (en) * | 2000-05-23 | 2018-11-07 | IoT IP GmbH | Programmable communicator |
US20100029261A1 (en) * | 2001-06-27 | 2010-02-04 | John Mikkelsen | Virtual wireless data cable method, apparatus and system |
US7257387B2 (en) * | 2004-06-30 | 2007-08-14 | At&T Intellectual Property, Inc. | Method and system for emergency control of a voice/data communications device |
US7565132B2 (en) * | 2005-08-17 | 2009-07-21 | Mourad Ben Ayed | Portable health monitoring system |
US8490176B2 (en) * | 2009-04-07 | 2013-07-16 | Juniper Networks, Inc. | System and method for controlling a mobile device |
US8467779B2 (en) * | 2010-12-10 | 2013-06-18 | Blueforce Development Corporation | Decision support |
US8571538B2 (en) * | 2011-08-10 | 2013-10-29 | Qualcomm Incorporated | Web-based parental controls for wireless devices |
-
2012
- 2012-09-12 US US13/612,368 patent/US9020476B2/en active Active
-
2015
- 2015-03-31 US US14/675,097 patent/US20150215753A1/en not_active Abandoned
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150112883A1 (en) * | 2013-10-17 | 2015-04-23 | Adt Us Holdings, Inc. | Portable system for managing events |
US10055803B2 (en) * | 2013-10-17 | 2018-08-21 | Adt Us Holdings, Inc. | Portable system for managing events |
US10354351B2 (en) * | 2013-10-17 | 2019-07-16 | The Adt Security Corporation | Portable system for managing events |
US20150312533A1 (en) * | 2014-04-29 | 2015-10-29 | Vik Moharir | Method, system and apparatus for transcribing information using wearable technology |
US9344686B2 (en) * | 2014-04-29 | 2016-05-17 | Vik Moharir | Method, system and apparatus for transcribing information using wearable technology |
US9524530B2 (en) | 2014-04-29 | 2016-12-20 | Vik Moharir | Method, system and apparatus for transcribing information using wearable technology |
US10423760B2 (en) | 2014-04-29 | 2019-09-24 | Vik Moharir | Methods, system and apparatus for transcribing information using wearable technology |
US10424405B2 (en) | 2014-04-29 | 2019-09-24 | Vik Moharir | Method, system and apparatus for transcribing information using wearable technology |
US20160337518A1 (en) * | 2015-05-13 | 2016-11-17 | Interactive Intelligence, Inc. | Determining an active station based on movement data |
US10116794B2 (en) * | 2015-05-13 | 2018-10-30 | Interactive Intelligence Group, Inc. | Determining an active station based on movement data |
US20230114515A1 (en) * | 2015-10-29 | 2023-04-13 | Lai King Tee | System and Method for Mobile Platform Designed for Digital Health Management and Support for Remote Patient Monitoring |
CN107613214A (en) * | 2017-10-25 | 2018-01-19 | 广东工业大学 | A kind of camera interface access method, apparatus and system |
US11336954B1 (en) | 2018-12-12 | 2022-05-17 | Amazon Technologies, Inc. | Method to determine the FPS on a client without instrumenting rendering layer |
US11252097B2 (en) | 2018-12-13 | 2022-02-15 | Amazon Technologies, Inc. | Continuous calibration of network metrics |
US11356326B2 (en) | 2018-12-13 | 2022-06-07 | Amazon Technologies, Inc. | Continuously calibrated network system |
US11368400B2 (en) | 2018-12-13 | 2022-06-21 | Amazon Technologies, Inc. | Continuously calibrated network system |
US11016792B1 (en) | 2019-03-07 | 2021-05-25 | Amazon Technologies, Inc. | Remote seamless windows |
US11245772B1 (en) * | 2019-03-29 | 2022-02-08 | Amazon Technologies, Inc. | Dynamic representation of remote computing environment |
US11461168B1 (en) | 2019-03-29 | 2022-10-04 | Amazon Technologies, Inc. | Data loss protection with continuity |
WO2022216830A1 (en) * | 2021-04-09 | 2022-10-13 | Doximity, Inc. | Phone call to patient from within video call |
US11929181B2 (en) | 2021-04-09 | 2024-03-12 | Doximity, Inc. | Phone call to patient from within video call |
Also Published As
Publication number | Publication date |
---|---|
US20130065569A1 (en) | 2013-03-14 |
US9020476B2 (en) | 2015-04-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9020476B2 (en) | System and method for remote care and monitoring using a mobile device | |
US20200236325A1 (en) | Simple video communication platform | |
US9990836B2 (en) | Systems and methods for automated personal emergency responses | |
US9547977B2 (en) | Systems and methods for automated personal emergency responses | |
US8538374B1 (en) | Emergency communications mobile application | |
US9014657B2 (en) | Method and apparatus for creating emergency social network | |
CN113785295A (en) | Configuring context-based restrictions for computing devices | |
US8588733B2 (en) | Wireless device emergency services connection and panic button, with crime and safety information system | |
US20170163781A1 (en) | User interface for contacts management and communication | |
WO2015145401A1 (en) | Simple video communication platform | |
US20120329529A1 (en) | Gesture activate help process and system | |
US20080005301A1 (en) | Handheld device for elderly people | |
WO2014013275A2 (en) | Personal safety communication system | |
CN103733185A (en) | Multi-data type communications system | |
CN102812733A (en) | Wireless Device Emergency Services Connection And Panic Button, With Crime And Safety Information System | |
AU2021209354B2 (en) | Fall detection - audio looping | |
US11605274B2 (en) | Fall detection—audio looping | |
US20120214436A1 (en) | Mobile safety devices and methods | |
CN107479838A (en) | The information output processing method and terminal of terminal | |
EP3244596B1 (en) | A multipurpose communication and control system with a tangible user interface | |
AU2020102378A4 (en) | MT-Family Member Activities and Location: FAMILY MEMBER ACTIVITIES AND LOCATION MANAGEMENT TECHNOLOGY | |
US9961708B1 (en) | Wireless network connection management | |
CA3052732C (en) | Workflow engine for healthcare management of a patient | |
WO2023035017A1 (en) | Personal observer system | |
FR2947368A1 (en) | User i.e. patient, alerting method, involves transmitting alert to user and/or predetermined destination in case of detection of incoherence between current geographical position and location indicated in schedule |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: LEIPZIG TECHNOLOGY, LLC, ILLINOIS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEIPZIG, GORDON I.;SRIVASTAVA, PRANAV U.;REEL/FRAME:035307/0508 Effective date: 20120912 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |