WO2016147202A1 - System and method for implementing emergency response platform - Google Patents

System and method for implementing emergency response platform Download PDF

Info

Publication number
WO2016147202A1
WO2016147202A1 PCT/IN2016/000066 IN2016000066W WO2016147202A1 WO 2016147202 A1 WO2016147202 A1 WO 2016147202A1 IN 2016000066 W IN2016000066 W IN 2016000066W WO 2016147202 A1 WO2016147202 A1 WO 2016147202A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
event
occurrence
module
response
Prior art date
Application number
PCT/IN2016/000066
Other languages
French (fr)
Inventor
Kumaravelu Varadharajan
Zhou Chongyu
Balakrishnan Raja
Rajinish Menon Kattayil
Original Assignee
Kumaravelu Varadharajan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kumaravelu Varadharajan filed Critical Kumaravelu Varadharajan
Publication of WO2016147202A1 publication Critical patent/WO2016147202A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/50Centralised arrangements for answering calls; Centralised arrangements for recording messages for absent or busy subscribers ; Centralised arrangements for recording messages
    • H04M3/51Centralised call answering arrangements requiring operator intervention, e.g. call or contact centers for telemarketing
    • H04M3/5116Centralised call answering arrangements requiring operator intervention, e.g. call or contact centers for telemarketing for emergency applications
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/016Personal emergency signalling and security systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2203/00Aspects of automatic or semi-automatic exchanges
    • H04M2203/55Aspects of automatic or semi-automatic exchanges related to network data storage and management
    • H04M2203/553Data upload

Definitions

  • This invention relates to the field of telecommunications and computer engineering.
  • the present invention generally relates to an emergency response platform, and is more particularly directed to providing a rescue support system to accurately detect, handle, and report emergency situations.
  • this invention relates to a system and method for implementing an emergency response platform.
  • An "emergency situation” or “emergency” as described herein refers to any situation that poses an immediate threat to life, health, or property. Examples of emergencies include natural disasters, medical emergencies, and crime. Emergencies can arise in variety of scenarios, for example at home, in an automobile, and at public places. Emergency management and response are an important aspect of managing emergency situations.
  • Emergency services are organizations, which ensure public safety and health by addressing different emergencies. Some of these agencies exist solely for
  • emergency services may include the police department, the fire department, and medical emergency services.
  • emergency call numbers or emergency services number
  • emergency response systems which require an individual to call emergency services, are usually inadequate. This is because an emergency is typically a stressful situation, and an individual might not be in the physical or mental condition to recollect important details about the crisis, for example the nature of the crisis or geographical location, in timely, effective and precise manner.
  • panic triggers Another approach to emergency response systems is via physical or software implemented panic triggers, which allows individuals to press the trigger in case of an emergency.
  • the system then sends a signal to a receiver that is connected to the home telephone line or some other communication device and a staff member at a call center evaluates the situation, deciding whether to call an ambulance or a designated friend or family member.
  • the software implemented panic triggers typically expose the users to complex interfaces and maybe difficult to use during an emergency. Physical triggers are also unreliable as they may be lost, misplaced, or difficult to reach in an emergency situation.
  • the call centers associated with such trigger based response systems may also be unresponsive and therefore such systems are unreliable.
  • panic trigger based systems require a large, well-trained support staff that needs to respond quickly 'and efficiently to different types of emergency while filtering out false alarms.
  • An object of the invention is to provide a system and method in order to trigger an emergency response system based on audible parameters.
  • Another object of the invention is to provide a system and method in order to trigger an emergency response system based on visual parameters.
  • An additional object of the invention is to provide a system and method in order to evoke a human response in order to positively trigger an emergency response system based on a variety of parameters.
  • a system for implementing an emergency response platform said system comprises:
  • - at least a data collection module configured to collect data
  • a detection module configured to detect an occurrence of an event based on pre-defined criteria and in correlation with said collected data
  • a trigger module configured to be activated in response to detection of an event, in order to transmit data in order to trigger a response
  • At least an analysis server configured to analyse said data in order to confirm occurrence of an event as an event
  • said data collection module is configured to collect data selected from a group of data items consisting of audio data, video data, ' image data, location data, speed data, and multimedia data.
  • said data collection module is communicably coupled to a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in correlation with ambient sound.
  • said data collection module is communicably coupled to a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in correlation with ambient sound, further characterised in that, said module comprising at least a first filter configured to filter out human voice from ambient sound and at least a second filter configured to filter out human voice which breaches pre-determined thresholds of parameters relating to verbal cues in order to determine an event.
  • said data collection module is communicably coupled to a camera, characterised in that, said camera being activated to capture at least a snap or at least a video once a first breach is detected.
  • said data collection module is communicably coupled to a camera, characterised in that, said camera being activated to capture at least a snap or at least a video, continuously or in discretely timed manner.
  • said data collection module is communicably coupled to a camera, characterised in that, said camera being further communicably coupled to image processing analytics' mechanism in order to an event.
  • said data collection module is communicably coupled to a thermal sensor, characterised in that, data from said thermal sensor being analysed to determine occurrence of an event.
  • said data collection module is communicably coupled to an infrared sensor, characterised in that, data from said infrared sensor being analysed to determine occurrence of an event.
  • said data collection module is communicably coupled to a sensor selected from a group of sensors, characterised in that, data from each sensor being analysed to determine occurrence of an event.
  • said data collection module is communicably coupled to a locating mechanism, characterised in that, data from said locating mechanism being analysed to determine occurrence of an event.
  • said detection module comprises a verbal detection module configured to detect occurrence of an event based on pre-defined thresholds of parameters relating to verbal cues, said parameters comprising a predefined threshold value selected from a group of pre-defined threshold values consisting of audio volume threshold value, audio pitch threshold value, audio amplitude threshold value, and audio frequency threshold value.
  • said detection module comprises a non-verbal detection module configured to detect occurrence of an event based on non-verbal cues, said non-verbal cues comprising video or image.
  • said at least a customer care center is provided which is based on user-defined preferences.
  • said data collection module comprises a set of items selected from a group of items consisting of a microphone, cameras, multiple sensors, accelerometers, gyroscopes, infra-red sensors, speakers, locating mechanisms, GPS, heart rate sensors, motion sensors, body sensors, stress sensors, heat sensors, wearable devices, receivers, transmitters, input devices, output devices, random access memory, read only memory, and a database.
  • said analytic server is configured to analyse data from said detection module in an iterative fashion, once a first breach is detected, in order to conclusively determine an emergency event / occurrence.
  • said trigger module is configured to be activated in response to data from said detection module, said trigger module being configured to trigger activation of at least an item from said data collection module in response to pre-determined conditions.
  • said analytic server is configured to analyse audio data using techniques selected from a group of techniques consisting of amplitude detection technique, and loudness detection technique, contextual speech processing technique, and speech recognition technique.
  • said system comprises at least a customer care center configured to respond to an event in accordance with pre-determined configurations of response.
  • said panic switch comprises human mediation capability in order to activate said panic switch upon determination of an event.
  • said analytic module comprises an automatic mode of determination of an event.
  • said analytic module comprises a manual mode of determination of an event.
  • a method for implementing an emergency response platform comprises the steps of:
  • panic switch upon determination of an event, said panic switch being configured with emergency response actions such as calls to pre-defined contacts, messages, notifications, audible and / or visual alarms to be activated in response to determination of an event.
  • said step of collecting data comprises a step of collecting data from a group of data items consisting of audio data, video data, image data, location data, speed data, and multimedia data.
  • said step of collecting data comprises a step of collecting data from a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in correlation with ambient sound.
  • said step of collecting data comprises a step of collecting data from a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in con-elation with ambient sound, further characterised in that, said step comprising a step of filtering out human voice from ambient sound and a further step of filtering out human voice which breaches pre-determined thresholds of parameters relating to verbal cues in order to determine an event.
  • said step of collecting data comprises a step of collecting data from a camera, characterised in that, said camera being activated to capture at least a snap or at least a video once a first breach is detected.
  • said step of collecting data comprises a step of collecting data from a camera, characterised in that, said camera being activated to capture at least a snap or at least a video, continuously or in discretely timed manner.
  • said step of said step of collecting data comprises a step of collecting data from a camera, characterised in that, said camera being further communicably coupled to image processing analytics' mechanism in order to an event.
  • said step of collecting data comprises a step of collecting data from a thermal sensor, characterised in that, data from said thermal sensor being analysed to determine occurrence of an event.
  • said step of collecting data comprises a step of collecting data from an infrared sensor, characterised in that, data from said infrared sensor being analysed to determine occurrence of an event.
  • said step of collecting data comprises a step of collecting data from a group of sensors, characterised in that, data from each sensor being analysed to determine occurrence of an event.
  • said step of collecting data comprises a step of collecting data from a locating mechanism, characterised in that, data from said locating mechanism being analysed to determine occurrence of an event.
  • said step of collecting data comprises a step of collecting data from a verbal detection module configured to detect occurrence of an event based on pre-defined thresholds of parameters relating to verbal cues, said parameters comprising a pre-defined threshold value selected from a group of pre-defined threshold values consisting of audio volume threshold value, audio pitch threshold value, audio amplitude threshold value, and audio frequency threshold value.
  • said step of said step of collecting data comprises a step of collecting data from a non-verbal detection module configured to detect occurrence of an event based on non-verbal cues, said non-verbal cues comprising video or image.
  • said method comprises a step of providing at least a customer care center based on user-defined preferences.
  • said step of collecting data comprises a step of collecting data comprising a set of items selected from a group of items consisting of a microphone, cameras, multiple sensors, accelerometers, gyroscopes, infrared sensors, speakers, locating mechanisms, GPS, heart rate sensors, motion sensors, body sensors, stress sensors, heat sensors, wearable devices, receivers, transmitters, input devices, output devices, random access memory; read only memory, and a database.
  • said step of analysing said data comprises a step of analysing said data from said detection module in an iterative fashion, once a first breach is detected, in order to conclusively determine an emergency event / occurrence.
  • said step of activating at least a trigger module comprises a step of activating said trigger module in response to data from said detection module, said trigger module being configured to trigger activation of at least an item from said data collection module in response to pre-determined conditions.
  • said step of analysing said data comprises a step of analysing audio data using techniques selected from a group of techniques consisting of amplitude detection technique, and loudness detection technique, contextual speech processing technique, and speech recognition technique.
  • said method comprises at least a step of providing a customer care center configured, to respond to an event in accordance with pre-determined configurations of response.
  • said step of activating or allowing to be activated, at least a panic switch comprises human mediation capability in order to activate said panic switch upon determination of an event.
  • said step of analysing said data comprises an automated step of analysing in order to determine an event.
  • said step of analysing said data is a manual step of analysing said data in order to determine an event.
  • Figure 1 illustrates a schematic block diagram of the system of this invention.
  • FIG. 2 illustrates a schematic flowchart of the method of this invention.
  • Figure 1 illustrates a schematic block diagram of the system of this invention.
  • FIG. 2 illustrates a schematic flowchart of the method of this invention.
  • a data collection module is configured to collect data within a defined environment.
  • this defined environment is a vehicle.
  • a detection module detects an occurrence such as a loud, panicked, or stressed utterance, or other verbal or non-verbal cues from a user or the environment indicating an emergency.
  • the detection module then activates a trigger module that initiates data collection related to the occurrence.
  • the trigger module then transmits the collected data, for example, audio or video cliques, to an analysis server, which analyses the data to determine whether the occurrence was related to an emergency.
  • Real-time signal processing technical are running in the analysis server to determine whether the occurrence is related to an emergency, which act as a soft filer to filter out the false alarms.
  • the analysis server determines that the occurrence / event is not an emergency, data is discarded and if its determined that the occurrence / event is an emergency, then the analysis server transmits the data related to the event to a customer care center, where a customer care executive responds to the emergency in an appropriate manner based on the data collected by the analysis server and -the user's preferences.
  • the decision of the customer care executive is used to train the analysis server in order to improve the performance of the analysis server.
  • the weightage of the authority will depend on the real application situation where the emergency response platform is used. For example, when the emergency response platform is applied in public transportation systems, the decision will be dominated by the government authorities. When the emergency response platform is applied in private transportation systems, such as Uber etc., the decision will be dominated by the respective operating companies. When the emergency response platform is applied in residential areas, the decision will be dominated by the civil defense department.
  • the emergency response platform comprises a communication device, a detection module, a trigger module, an analysis server, and a customer care center.
  • the emergency response platform may be implemented as a software application executing on the communication device.
  • the various modules comprising the emergency response platform may be implemented as standalone hardware and/or software components.
  • the emergency response platform is implemented in means of transportation for example trucks, cars, buses, taxis, trains, planes, ships, and boats.
  • the emergency response platform isimplemented in residential areas for example houses, apartments, and condominiums and nonresidential places such as offices and workspaces.
  • the emergency response platform is implemented in public places for example places of worship, schools, theatres, restaurants, and on street corners.
  • the communication device may be a computing device that is structured as the example computing device described herein in the "Hardware Overview" section.
  • the communication device may be a specialized computing device.
  • the communication device may be video infrastructure and/ or audio infrastructure device that is optimized for services such as video conferencing, digital telephony, and/or telepresence.
  • the communication device represents network end stations such as laptop computers, server computers, mobile computers, tablet computers, or smartphones, or may represent software components executing on one or more computing systems.
  • the communication device may be a pager or a short-wave radio.
  • a communication device is wirelessly connected to a network.
  • the communication devices comprises a microphone, a cameras, multiple sensors for example accelerometers or infra-red sensors, speakers, a GPS, a receiver, a transmitter, an input device, an output device for example touch display, random access memory, read only memory and a database.
  • the detection module may be implemented as hardware and/or software components to capture an occurrence relating to an emergency.
  • the detection module may use hardware components of the communication device, for example the microphone, voice sensor, camera, motion sensor, or infrared sensor, to detect an occurrence related to an emergency.
  • the detection module may be or may additional comprise a physical or software implemented panic button that a user may press to indicate an occurrence related to an emergency.
  • the voice detection module may be a standalone specialized device or combination of specialized devices or sensors that are distinct from the communication device for example a standalone microphone or a combination of a microphone and infrared heart rate sensor.
  • the trigger module may be implemented as hardware and/or software components that initiate data collection related to the occurrence.
  • the trigger module is activated by the detection module in response to the occurrence.
  • the trigger module may be a standalone specialized device or combination of specialized devices or sensors that are distinct from the communication , device for example a standalone microphone or a combination of a microphone and infrared heart rate sensor.
  • the data collected comprises multimedia images, GPS positional or locational data (for example latitude, longitude, terrain, and major landmarks), body temperature, stress levels, and motion detection.
  • the analysis server is a remote cloud server may be a computing device that is structured as the example computing device described herein in the "Hardware Overview" section.
  • the analysis server may be a specialized computing device.
  • the analysis server may be mainframe computing or supercomputing device.
  • the analysis server represents network end stations such as laptop computers, server computers, mobile computers, tablet computers, or smartphones, or may represent software components executing on one or more computing systems.
  • the analysis server is software or hardware components executing on the communicating device.
  • the analysis server is a part of a distributed computing system.
  • the customer care center is a centralized office used for receiving or transmitting a large volume of occurrence related data collected by the analysis server.
  • the customer care center is an Interactive Voice Response (IVR) system that automatically responds to the occurrence related data.
  • the customer care center comprises customer care executive that perform a second-level analysis of the occurrence related data.
  • FIGURE 1 illustrates an example process for responding to an emergency related occurrence.
  • the detection module detects an occurrence.
  • An occurrence may be verbal such as a loud, panicked, or stressed utterance, or non-verbal for example motion indicating that an individual is cowering, or retreating, or defending themselves, heat signatures, and stress levels.
  • the process then moves to block 104.
  • the detection module 102 is communicably coupled to a microphone. Data from the microphone is continuously monitored and recorded. This data is continuously analysed for detecting deviations in sound in correlation with ambient sound / noise.
  • a first filter is configured to filter out human voice from ambient sound / noise.
  • a second filter is configured to filter out human voice which breach predetermined thresholds of parameters relating to verbal cues in order to determine an emergency event / occurrence.
  • the data collection module is communicably coupled to a camera.
  • this camera of the detection module 102 is configured to capture at least a snap once a first breach is detected.
  • this camera of the detection module 102 is configured to capture at least a snap, continuously or in discretely timed manner.
  • Image processing analytics may be employed in order to detect an emergency event / occurrence.
  • the data .collection module is communicably coupled to a thermal sensor. Pre-defined thresholds of thermal sensors are stored and a breach of these thresholds, alone or in combination with other breaches / triggers, trigger further modules of this system and method. In at least yet one more embodiment, the data collection module is communicably coupled to an infrared sensor. Pre-defined thresholds of infrared sensors are stored and a breach of these thresholds, alone or in combination with other breaches / triggers, trigger further modules of this system and method.
  • the data collection module is communicably coupled to a sensor selected from a group of sensors. Predefined thresholds of each of these sensors are stored and a breach of these thresholds, alone or in combination with other breaches / triggers, trigger further modules of this system and method.
  • the data collection module is communicably coupled to a locating mechanism such as a GPS.
  • a locating mechanism such as a GPS.
  • Pre-defined thresholds of locating mechanisms are stored, for a given path, and a breach of these thresholds, alone or in combination with other breaches / triggers, trigger further modules of this system and method.
  • the detection module turns on trigger module which in turn initiates data collection relating to the occurrence through the various devices and sensors available to the trigger module.
  • the camera starts recording pictures and/or videos automatically
  • the microphone starts recording voice/sound automatically
  • the GPS gathers the current geo- location parameters like latitude and longitude of the communication device or user.
  • the data is a collected for determined duration. For example, 1 minute, 5 minute, or 30 seconds. In another embodiment, the data is collected for the duration' of the occurrence.
  • the collected data related to the occurrence is transmitted to the analytic server by the communication device.
  • any combination of the data collected may be sent to the analytic server.
  • only sound and geo-location data may be sent to the analytic server.
  • the collected data is transmitted to the analytic server by the communication device via a wireless network.
  • the wireless network may be GPRS, 3G, Wi-Fi, Wi-max, LTE or 4G or may be other latter or previous wireless technologies.
  • the analytic server is configured to analyse data from the detection module 102 in an iterative fashion, once a first breach is detected, in order to conclusively determine an emergency event / occurrence.
  • the collected data is received and analyzed by the analytic server.
  • the analytic server analyses the collected data to determine if the occurrence is related to an actual emergency or is a false alarm.
  • the analytic server may comprise hardware or software components that process audio data to differentiate human generated sounds from background or ambient noises/sounds.
  • audio data can be subject to amplitude detection technique, and loudness detection technique, contextual speech processing, and speech recognition among other techniques to distinguish a car horn from a shriek.
  • the analytic server may comprise hardware or software components that process image data to differentiate human images from other images via techniques such as color detection, hue detection, motion and detection. If the analytic server determines that the occurrence is related to a genuine emergency then the process moves to block 108.
  • the data collected is passed on to the customer care center.
  • the collected data is re-evaluated at the customer care center to ensure that the occurrence is related to a genuine emergency.
  • a customer care executive may look at the collected audio and image data to determine that the sounds and images belong to a human being in an emergency situation and are not the result of a false alarm.
  • the collected data may be re-evaluated automatically.
  • the customer care executive may resolve the emergency by initiating a call to the user.
  • the customer care executive may direct a call to the appropriate emergency service to for the user's emergency, for example, police, fire department, medical emergency service.
  • an automated system for example an IVR system, automatically directs a call to an appropriate emergency service to handle the user's emergency.
  • the customer care executive may initiate a call to an emergency contact as determined by the user. In an embodiment, the customer care executive may initiate a call to the user to handle the emergency or handle it while the appropriate emergency service responds. If the data collected at block 108 indicates that the occurrence is a false alarm then the process moves to lock 112. In a scenario, where an emergency feature is precisely defined, for example, whether the temperature is higher than a specified threshold at a specific location, the automated / manual processing of data can be optional, since in such cases sensors at pre-defined locations sense and pass on sensed data for processing to that an alarm may or may not be triggered in determination of an emergency event.
  • the automated / manual processing of data is mandatory.
  • an emergency situation within a taxi on a trip there can be a variety of emergency situations, whose symptoms or features cannot be precisely defined.
  • the automated / manual processing of data is mandatory.
  • the data collected is discarded.
  • a panic switch is activated or allowed to be activated upon determination of an emergency event / occurrence.
  • This panic switch is configured with emergency response actions such as calls to pre-defined contacts, messages, notifications, audible and / or visual alarms of the vehicle to be activated, pre-defined audible and / or visual alarms of the system to be activated in response to determination of an emergency event / occurrence. Human mediation to activate such a panic switch may or may not be provided.
  • ⁇ n exemplary implementation * of - the emergency response platform is iescribed herein. A passenger travelling in a taxi is assaulted by a co- Dassenger or the taxi driver.
  • the taxi has the emergency response platform nstalled as an application on a tablet that is attached to the back of the iriver's seat.
  • the passenger attempts to fend off the attacker and in the effort hrieks or screams loudly.
  • the shrieks and screams along with the passenger's motion are detected by the tablet's microphone which is always listening for occurrence related input.
  • the detection module then activates the emergency response system's trigger module.
  • the trigger module then activates sensors and other hardware components like camera, microphone, GPS etc. of the tablet to collect data related.
  • the camera starts recording images of the taxi, the GPS detects the taxi's location, other components of the tablet record other data for example the time of the day.
  • analytic server After a predetermined amount of data is collected, it is then transmitted to an analytic server via a wireless network for example a 3G network.
  • the audio files, image files and other data are processed and the analytic server determines that the shrieks/screams and image data is related to an emergency and not a false alarm.
  • the data is then transmitted by the analytic server to a customer care center.
  • a customer care executive reevaluates the data, determines that an assault is taking place and alerts the police giving them details like last known location of taxi, time of day, speed (if moving), description of victim and any other pertinent information.
  • the techniques described herein are implemented by one or more special-purpose computing devices.
  • the special-purpose computing devices may be hard-wired to perform the techniques, or may include digital electronic devices such as one or more application-specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs) that are persistently programmed to perform the techniques, or may include one or more general purpose hardware processors programmed to perform the techniques pursuant to program instructions in firmware, memory, other storage, or a combination.
  • ASICs application-specific integrated circuits
  • FPGAs field programmable gate arrays
  • Such special-purpose computing devices may also combine custom hard-wired logic, ASICs, or FPGAs with custom programming to accomplish the techniques.
  • the special-purpose computing devices may be desktop computer systems, portable computer systems, handheld devices, networking devices or any other device that incorporates hard-wired and/or program logic to implement the techniques.
  • a computer system may include a bus or other communication mechanism for communicating information, and a hardware processor coupled with bus for processing information.
  • Hardware processor may be, for example, a general purpose microprocessor.
  • Computer system also may include a main memory such as a random access memory (RAM) or other dynamic storage device, coupled to bus for storing information and instructions to be executed by processor
  • Main memory also may be used for storing temporary variables or other intermediate informatio during execution of instructions to be executed by processor
  • Such instructions when stored in non-transitory storage media accessible to processor render computer system into a special-purpose machine that is customized to perform the operations specified in the instructions.
  • Computer system further may include a read only memory (ROM) or other static storage device coupled to bus for storing static information and instructions for processor
  • ROM read only memory
  • a storage device such as a magnetic disk, optical disk, or solid-state drive is provided and coupled to bus for storing information and instructions.
  • Computer system may be coupled via bus to a display such as a cathode ray tube (CRT), for displaying information to a computer user.
  • a display such as a cathode ray tube (CRT)
  • An input device including alphanumeric and other keys, is coupled to bus for communicating information and command selections to processor
  • cursor control such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor and for controlling cursor movement on display
  • This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
  • Computer system may implement the techniques described herein using customized hard- wired logic, one or more ASICs or FPGAs, firmware and/or program logic which in combination with the computer system causes or programs computer system to be a special-purpose machine.
  • the techniques herein are performed by computer system in response to processor executing one or more sequences of one or more instructions contained in main memory. Such instructions may be read into main memory from another storage medium, such as storage device. Execution of the sequences of instructions contained in main memory causes processor to perform the process steps described herein.
  • hard-wired circuitry may be used in place of or in combination with software instructions.
  • Non- volatile media may include, for example, optical disks, magnetic disks, or solid-state drives, such as storage device
  • Volatile media may include dynamic memory, such as main memory
  • Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid-state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
  • Storage media is distinct from but may be used in conjunction with transmission media.
  • Transmission media participates in transferring information between storage media.
  • transmission media may include coaxial cables, copper wire and fiber optics, including the wires that comprise bus
  • Transmission media can also take the form of acoustic or light waves, such as those generated during radio- wave and infra-red data communications.
  • the instructions may initially be carried on a magnetic disk or solid-state drive of a remote computer.
  • the remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem.
  • a modem local to computer system can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infrared signal.
  • An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus.
  • the bus carries the data to main memory from which processor retrieves and executes the instructions.
  • main memory may optionally be stored on storage device either before or after execution by processor system also may include a communication interface coupled to bus Communication interface provides a two-way data communication coupling to a network link that is connected to a local network
  • communication interface may be an integrated services digital network (ISDN) card, cable modem, satellite modem, or a modem to provide a data communication connection to a corresponding type of telephone line.
  • ISDN integrated services digital network
  • communication interface may be a local area network (LAN) card to provide a data communication connection to a compatible LAN.
  • LAN local area network
  • Wireless links may also be implemented.
  • communication interface sends and receives electrical, electromagnetic or optical signals that carry digital data"streams representing various types of information.
  • Network link typically provides data communication through one or more networks to other data devices.
  • network link may provide a connection through local network to a host computer or to data equipment operated by an Internet Service Provider (ISP) ISP in turn provides data communication services through the world wide packet data communication network now commonly referred to as the "Internet" Local network and Internet both use electrical, electromagnetic or optical signals that carry digital data streams.
  • ISP Internet Service Provider
  • the signals through the various networks and the signals on network link and through communication interface which carry the digital data to and from computer system are example forms of transmission media.
  • Computer system can send messages and receive data, including program code, through the network(s), network link and communication interface
  • a server might transmit a requested code for an application program through Internet ISP local network and communication interface.
  • the received code may be executed by processor as it is received, and/or stored in storage device or other non-volatile storage for later execution.
  • the INVENTIVE STEP of this invention lies in providing a system and method which automates an emergency response system to a point where a human intervention is required to make a decision to make a panic call. Basically, it puts an eye and an ear in a defined environment.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Emergency Management (AREA)
  • Computer Security & Cryptography (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Marketing (AREA)
  • Signal Processing (AREA)
  • Alarm Systems (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

A system for implementing an emergency response platform, said system comprising: at least a data collection module configured to collect data; at least a detection module configured to detect an occurrence of an event based on pre-defined criteria and in correlation with said collected data; at least a trigger module, configured to be activated in response to detection of an event, in order to transmit data in order to trigger a response; at least an analysis server configured to analyse said data in order to confirm occurrence of an event as an event; and at least a panic switch being activated in order to be activated or allowed to be activated upon determination of an event, said panic switch being configured with emergency response actions such as calls to pre-defined contacts, messages, notifications, audible and / or visual alarms to be activated in response to determination of an event.

Description

SYSTEM AND METHOD FOR IMPLEMENTING EMERGENCY RESPONSE
PLATFORM
FIELD OF INVENTION:
This invention relates to the field of telecommunications and computer engineering.
The present invention generally relates to an emergency response platform, and is more particularly directed to providing a rescue support system to accurately detect, handle, and report emergency situations.
Specifically, this invention relates to a system and method for implementing an emergency response platform.
BACKGROUND OF THE INVENTION:
Millions of people face emergency situations. An "emergency situation" or "emergency" as described herein refers to any situation that poses an immediate threat to life, health, or property. Examples of emergencies include natural disasters, medical emergencies, and crime. Emergencies can arise in variety of scenarios, for example at home, in an automobile, and at public places. Emergency management and response are an important aspect of managing emergency situations.
Typically, emergencies are handled by emergency services. Emergency services are organizations, which ensure public safety and health by addressing different emergencies. Some of these agencies exist solely for
l addressing certain types of emergencies whilst others deal with ad hoc emergencies as part of their normal responsibilities. For example; emergency services may include the police department, the fire department, and medical emergency services. Traditionally, emergencies are reported to and handled by emergency services via emergency call numbers (or emergency services number) that allows a caller to contact local emergency services for assistance. However, such emergency response systems, which require an individual to call emergency services, are usually inadequate. This is because an emergency is typically a stressful situation, and an individual might not be in the physical or mental condition to recollect important details about the crisis, for example the nature of the crisis or geographical location, in timely, effective and precise manner.
Another approach to emergency response systems is via physical or software implemented panic triggers, which allows individuals to press the trigger in case of an emergency. The system then sends a signal to a receiver that is connected to the home telephone line or some other communication device and a staff member at a call center evaluates the situation, deciding whether to call an ambulance or a designated friend or family member. These systems also have significant shortcomings. The software implemented panic triggers typically expose the users to complex interfaces and maybe difficult to use during an emergency. Physical triggers are also unreliable as they may be lost, misplaced, or difficult to reach in an emergency situation. The call centers associated with such trigger based response systems may also be unresponsive and therefore such systems are unreliable. Furthermore, just like traditional emergency response services, such panic trigger based systems require a large, well-trained support staff that needs to respond quickly 'and efficiently to different types of emergency while filtering out false alarms.
In light of the challenges above, there is a need for an integrated emergency response platform that automatically filters out false alarms, is efficient, reliable, and cost-effective.
The approaches described in this section are approaches that could be pursued, but not necessarily approaches that have been previously conceived or pursued. Therefore, unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section.
OBJECTS OF THE INVENTION:
An object of the invention is to provide a system and method in order to trigger an emergency response system based on audible parameters.
Another object of the invention is to provide a system and method in order to trigger an emergency response system based on visual parameters.
Yet another object of the invention is to provide a system and method in order to trigger an emergency response system based on audible in combination with visual parameters. Still another object of the invention is to provide a system and method in order to trigger an emergency response system based on combination of parameters derived from a plurality of sensors.
An additional object of the invention is to provide a system and method in order to evoke a human response in order to positively trigger an emergency response system based on a variety of parameters.
SUMMARY OF THE INVENTION:
According to this invention, there is provided a system for implementing an emergency response platform, said system comprises:
- at least a data collection module configured to collect data;
- at least a detection module configured to detect an occurrence of an event based on pre-defined criteria and in correlation with said collected data;
- at least a trigger module, configured to be activated in response to detection of an event, in order to transmit data in order to trigger a response;
- at least an analysis server configured to analyse said data in order to confirm occurrence of an event as an event; and
- at least a panic switch being activated in order to be activated or allowed to be activated upon determination of an event, said panic switch being configured with emergency response actions such as calls to pre-defined contacts, messages, notifications, audible and / or visual alarms to be activated in response to determination of an event. Typically, said data collection module is configured to collect data selected from a group of data items consisting of audio data, video data,' image data, location data, speed data, and multimedia data.
Typically, said data collection module is communicably coupled to a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in correlation with ambient sound.
Typically, said data collection module is communicably coupled to a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in correlation with ambient sound, further characterised in that, said module comprising at least a first filter configured to filter out human voice from ambient sound and at least a second filter configured to filter out human voice which breaches pre-determined thresholds of parameters relating to verbal cues in order to determine an event.
Typically, said data collection module is communicably coupled to a camera, characterised in that, said camera being activated to capture at least a snap or at least a video once a first breach is detected.
Typically, said data collection module is communicably coupled to a camera, characterised in that, said camera being activated to capture at least a snap or at least a video, continuously or in discretely timed manner. Typically, said data collection module is communicably coupled to a camera, characterised in that, said camera being further communicably coupled to image processing analytics' mechanism in order to an event.
Typically, said data collection module is communicably coupled to a thermal sensor, characterised in that, data from said thermal sensor being analysed to determine occurrence of an event.
Typically, said data collection module is communicably coupled to an infrared sensor, characterised in that, data from said infrared sensor being analysed to determine occurrence of an event.
Typically, said data collection module is communicably coupled to a sensor selected from a group of sensors, characterised in that, data from each sensor being analysed to determine occurrence of an event.
Typically, said data collection module is communicably coupled to a locating mechanism, characterised in that, data from said locating mechanism being analysed to determine occurrence of an event.
Typically, said detection module comprises a verbal detection module configured to detect occurrence of an event based on pre-defined thresholds of parameters relating to verbal cues, said parameters comprising a predefined threshold value selected from a group of pre-defined threshold values consisting of audio volume threshold value, audio pitch threshold value, audio amplitude threshold value, and audio frequency threshold value. Typically, said detection module comprises a non-verbal detection module configured to detect occurrence of an event based on non-verbal cues, said non-verbal cues comprising video or image.
Typically, said at least a customer care center is provided which is based on user-defined preferences.
Typically, said data collection module comprises a set of items selected from a group of items consisting of a microphone, cameras, multiple sensors, accelerometers, gyroscopes, infra-red sensors, speakers, locating mechanisms, GPS, heart rate sensors, motion sensors, body sensors, stress sensors, heat sensors, wearable devices, receivers, transmitters, input devices, output devices, random access memory, read only memory, and a database.
Typically, said analytic server is configured to analyse data from said detection module in an iterative fashion, once a first breach is detected, in order to conclusively determine an emergency event / occurrence.
Typically, said trigger module is configured to be activated in response to data from said detection module, said trigger module being configured to trigger activation of at least an item from said data collection module in response to pre-determined conditions. Typically, said analytic server is configured to analyse audio data using techniques selected from a group of techniques consisting of amplitude detection technique, and loudness detection technique, contextual speech processing technique, and speech recognition technique.
Typically, said system comprises at least a customer care center configured to respond to an event in accordance with pre-determined configurations of response.
Typically, said panic switch comprises human mediation capability in order to activate said panic switch upon determination of an event.
Typically, said analytic module comprises an automatic mode of determination of an event.
Typically, said analytic module comprises a manual mode of determination of an event.
According to this invention, there is provided a method for implementing an emergency response platform, said method comprises the steps of:
- collecting data, using at least a data collection module;
- detecting an occurrence of an event based on pre-defined criteria and in correlation with said collected data, using at least a detection module;
- activating , at least a trigger module,in response to detection of an event, in order to transmit data in order to trigger a response, ; - analysing said data in order to confirm occurrence of an event as an event, using" at least an analysis server; and
- activating or allowing to be activated, at least a panic switch, upon determination of an event, said panic switch being configured with emergency response actions such as calls to pre-defined contacts, messages, notifications, audible and / or visual alarms to be activated in response to determination of an event.
Typically, said step of collecting data comprises a step of collecting data from a group of data items consisting of audio data, video data, image data, location data, speed data, and multimedia data.
Typically, said step of collecting data comprises a step of collecting data from a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in correlation with ambient sound.
Typically, said step of collecting data comprises a step of collecting data from a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in con-elation with ambient sound, further characterised in that, said step comprising a step of filtering out human voice from ambient sound and a further step of filtering out human voice which breaches pre-determined thresholds of parameters relating to verbal cues in order to determine an event. Typically, said step of collecting data comprises a step of collecting data from a camera, characterised in that, said camera being activated to capture at least a snap or at least a video once a first breach is detected.
Typically, said step of collecting data comprises a step of collecting data from a camera, characterised in that, said camera being activated to capture at least a snap or at least a video, continuously or in discretely timed manner.
Typically, said step of said step of collecting data comprises a step of collecting data from a camera, characterised in that, said camera being further communicably coupled to image processing analytics' mechanism in order to an event.
Typically, said step of collecting data comprises a step of collecting data from a thermal sensor, characterised in that, data from said thermal sensor being analysed to determine occurrence of an event.
Typically, said step of collecting data comprises a step of collecting data from an infrared sensor, characterised in that, data from said infrared sensor being analysed to determine occurrence of an event.
Typically, said step of collecting data comprises a step of collecting data from a group of sensors, characterised in that, data from each sensor being analysed to determine occurrence of an event. Typically, said step of collecting data comprises a step of collecting data from a locating mechanism, characterised in that, data from said locating mechanism being analysed to determine occurrence of an event.
Typically, said step of collecting data comprises a step of collecting data from a verbal detection module configured to detect occurrence of an event based on pre-defined thresholds of parameters relating to verbal cues, said parameters comprising a pre-defined threshold value selected from a group of pre-defined threshold values consisting of audio volume threshold value, audio pitch threshold value, audio amplitude threshold value, and audio frequency threshold value.
Typically, said step of said step of collecting data comprises a step of collecting data from a non-verbal detection module configured to detect occurrence of an event based on non-verbal cues, said non-verbal cues comprising video or image.
Typically, said method comprises a step of providing at least a customer care center based on user-defined preferences.
Typically, said step of collecting data comprises a step of collecting data comprising a set of items selected from a group of items consisting of a microphone, cameras, multiple sensors, accelerometers, gyroscopes, infrared sensors, speakers, locating mechanisms, GPS, heart rate sensors, motion sensors, body sensors, stress sensors, heat sensors, wearable devices, receivers, transmitters, input devices, output devices, random access memory; read only memory, and a database.
Typically, said step of analysing said data comprises a step of analysing said data from said detection module in an iterative fashion, once a first breach is detected, in order to conclusively determine an emergency event / occurrence.
Typically, said step of activating at least a trigger module comprises a step of activating said trigger module in response to data from said detection module, said trigger module being configured to trigger activation of at least an item from said data collection module in response to pre-determined conditions.
Typically, said step of analysing said data comprises a step of analysing audio data using techniques selected from a group of techniques consisting of amplitude detection technique, and loudness detection technique, contextual speech processing technique, and speech recognition technique.
Typically, said method comprises at least a step of providing a customer care center configured, to respond to an event in accordance with pre-determined configurations of response.
Typically, said step of activating or allowing to be activated, at least a panic switch comprises human mediation capability in order to activate said panic switch upon determination of an event. Typically, said step of analysing said data comprises an automated step of analysing in order to determine an event.
Typically, said step of analysing said data is a manual step of analysing said data in order to determine an event.
BRIEF DESCRIPTION OF THE ACCOMPANYING DRAWINGS:
The invention will now be described in relation to the accompanying drawings, in which:
Figure 1 illustrates a schematic block diagram of the system of this invention; and
Figure 2 illustrates a schematic flowchart of the method of this invention.
DETAILED DESCRIPTION OF THE ACCOMPANYING DRAWINGS:
In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, that the present invention may be practiced without these specific details.
Figure 1 illustrates a schematic block diagram of the system of this invention.
Figure 2 illustrates a schematic flowchart of the method of this invention.
Several features are described hereafter that can each be used independently of one another or with any combination of other features. However, an individual feature might only address one of the problems discussed above. Some of the problems discussed above might not be fully addressed by any of the features described herein. Although headings are provided, information related to a particular heading, but not found in the section having that heading, may also be found elsewhere in the specification.
Techniques are described for implementing an emergency response system.
The following steps are performed in accordance with one embodiment.
A data collection module is configured to collect data within a defined environment. In at least one embodiment, this defined environment is a vehicle.
A detection module detects an occurrence such as a loud, panicked, or stressed utterance, or other verbal or non-verbal cues from a user or the environment indicating an emergency. The detection module then activates a trigger module that initiates data collection related to the occurrence. The trigger module then transmits the collected data, for example, audio or video cliques, to an analysis server, which analyses the data to determine whether the occurrence was related to an emergency. Real-time signal processing technical are running in the analysis server to determine whether the occurrence is related to an emergency, which act as a soft filer to filter out the false alarms. Based on the decision and determination, if the analysis server determines that the occurrence / event is not an emergency, data is discarded and if its determined that the occurrence / event is an emergency, then the analysis server transmits the data related to the event to a customer care center, where a customer care executive responds to the emergency in an appropriate manner based on the data collected by the analysis server and -the user's preferences. The decision of the customer care executive is used to train the analysis server in order to improve the performance of the analysis server.
If there is discrepancy in the decisions of the analysis server and the customer care executive, the decision will be always dominated by the customer care executive.
In the case when multiple customer care centres (authorities) exist, the weightage of the authority will depend on the real application situation where the emergency response platform is used. For example, when the emergency response platform is applied in public transportation systems, the decision will be dominated by the government authorities. When the emergency response platform is applied in private transportation systems, such as Uber etc., the decision will be dominated by the respective operating companies. When the emergency response platform is applied in residential areas, the decision will be dominated by the civil defense department.
In an embodiment, the emergency response platform comprises a communication device, a detection module, a trigger module, an analysis server, and a customer care center. In an embodiment, the emergency response platform may be implemented as a software application executing on the communication device. In an embodiment, the various modules comprising the emergency response platform may be implemented as standalone hardware and/or software components. In an embodiment, the emergency response platform is implemented in means of transportation for example trucks, cars, buses, taxis, trains, planes, ships, and boats. In another embodiment, the emergency response platform isimplemented in residential areas for example houses, apartments, and condominiums and nonresidential places such as offices and workspaces. In another embodiment, the emergency response platform is implemented in public places for example places of worship, schools, theatres, restaurants, and on street corners.
In an embodiment, the communication device may be a computing device that is structured as the example computing device described herein in the "Hardware Overview" section. In another embodiment, the communication device may be a specialized computing device. For example, the communication device may be video infrastructure and/ or audio infrastructure device that is optimized for services such as video conferencing, digital telephony, and/or telepresence. In still other embodiments, the communication device represents network end stations such as laptop computers, server computers, mobile computers, tablet computers, or smartphones, or may represent software components executing on one or more computing systems. In an embodiment, the communication device may be a pager or a short-wave radio. In an embodiment, a communication device is wirelessly connected to a network. In an embodiment the communication devices comprises a microphone, a cameras, multiple sensors for example accelerometers or infra-red sensors, speakers, a GPS, a receiver, a transmitter, an input device, an output device for example touch display, random access memory, read only memory and a database. In an embodiment, the detection module may be implemented as hardware and/or software components to capture an occurrence relating to an emergency. In an embodiment, the detection module may use hardware components of the communication device, for example the microphone, voice sensor, camera, motion sensor, or infrared sensor, to detect an occurrence related to an emergency. In another embodiment, the detection module may be or may additional comprise a physical or software implemented panic button that a user may press to indicate an occurrence related to an emergency. In an embodiment, the voice detection module may be a standalone specialized device or combination of specialized devices or sensors that are distinct from the communication device for example a standalone microphone or a combination of a microphone and infrared heart rate sensor.
In an embodiment, the trigger module may be implemented as hardware and/or software components that initiate data collection related to the occurrence. In an embodiment, the trigger module is activated by the detection module in response to the occurrence. In an embodiment, the trigger module may be a standalone specialized device or combination of specialized devices or sensors that are distinct from the communication , device for example a standalone microphone or a combination of a microphone and infrared heart rate sensor. In an embodiment, the data collected comprises multimedia images, GPS positional or locational data (for example latitude, longitude, terrain, and major landmarks), body temperature, stress levels, and motion detection. In an embodiment, the analysis server is a remote cloud server may be a computing device that is structured as the example computing device described herein in the "Hardware Overview" section. In another embodiment, the analysis server may be a specialized computing device. For example, the analysis server may be mainframe computing or supercomputing device. In still other embodiments, the analysis server represents network end stations such as laptop computers, server computers, mobile computers, tablet computers, or smartphones, or may represent software components executing on one or more computing systems. In yet another embodiment, the analysis server is software or hardware components executing on the communicating device. In an embodiment, the analysis server is a part of a distributed computing system.
In an embodiment, the customer care center is a centralized office used for receiving or transmitting a large volume of occurrence related data collected by the analysis server. In an embodiment, the customer care center is an Interactive Voice Response (IVR) system that automatically responds to the occurrence related data. In an embodiment, the customer care center comprises customer care executive that perform a second-level analysis of the occurrence related data.
FIGURE 1 illustrates an example process for responding to an emergency related occurrence. At block 102, the detection module detects an occurrence. An occurrence may be verbal such as a loud, panicked, or stressed utterance, or non-verbal for example motion indicating that an individual is cowering, or retreating, or defending themselves, heat signatures, and stress levels. The process then moves to block 104.
In at least one embodiment, the detection module 102 is communicably coupled to a microphone. Data from the microphone is continuously monitored and recorded. This data is continuously analysed for detecting deviations in sound in correlation with ambient sound / noise. A first filter is configured to filter out human voice from ambient sound / noise. A second filter is configured to filter out human voice which breach predetermined thresholds of parameters relating to verbal cues in order to determine an emergency event / occurrence.
In at least one other embodiment, the data collection module is communicably coupled to a camera. In at least one embodiment, this camera of the detection module 102 is configured to capture at least a snap once a first breach is detected. In at least an alternative embodiment, this camera of the detection module 102 is configured to capture at least a snap, continuously or in discretely timed manner. Image processing analytics may be employed in order to detect an emergency event / occurrence.
In at least one more embodiment, the data .collection module is communicably coupled to a thermal sensor. Pre-defined thresholds of thermal sensors are stored and a breach of these thresholds, alone or in combination with other breaches / triggers, trigger further modules of this system and method In at least yet one more embodiment, the data collection module is communicably coupled to an infrared sensor. Pre-defined thresholds of infrared sensors are stored and a breach of these thresholds, alone or in combination with other breaches / triggers, trigger further modules of this system and method.
In at least still one more embodiment, the data collection module is communicably coupled to a sensor selected from a group of sensors. Predefined thresholds of each of these sensors are stored and a breach of these thresholds, alone or in combination with other breaches / triggers, trigger further modules of this system and method.
In at least one more embodiment, the data collection module is communicably coupled to a locating mechanism such as a GPS. Pre-defined thresholds of locating mechanisms are stored, for a given path, and a breach of these thresholds, alone or in combination with other breaches / triggers, trigger further modules of this system and method.
At block 104, the detection module turns on trigger module which in turn initiates data collection relating to the occurrence through the various devices and sensors available to the trigger module. For example, the camera starts recording pictures and/or videos automatically, the microphone starts recording voice/sound automatically, the GPS gathers the current geo- location parameters like latitude and longitude of the communication device or user. In an embodiment, the data is a collected for determined duration. For example, 1 minute, 5 minute, or 30 seconds. In another embodiment, the data is collected for the duration' of the occurrence.
At block 106, the collected data related to the occurrence is transmitted to the analytic server by the communication device. In an embodiment, any combination of the data collected may be sent to the analytic server. For example, only sound and geo-location data may be sent to the analytic server. In an embodiment, the collected data is transmitted to the analytic server by the communication device via a wireless network. For example, the wireless network may be GPRS, 3G, Wi-Fi, Wi-max, LTE or 4G or may be other latter or previous wireless technologies.
In at least one embodiment, the analytic server is configured to analyse data from the detection module 102 in an iterative fashion, once a first breach is detected, in order to conclusively determine an emergency event / occurrence.
At block 108, the collected data is received and analyzed by the analytic server. In an embodiment, the analytic server analyses the collected data to determine if the occurrence is related to an actual emergency or is a false alarm. For example, the analytic server may comprise hardware or software components that process audio data to differentiate human generated sounds from background or ambient noises/sounds. Thus, audio data can be subject to amplitude detection technique, and loudness detection technique, contextual speech processing, and speech recognition among other techniques to distinguish a car horn from a shriek. Similarly, in another example the analytic server may comprise hardware or software components that process image data to differentiate human images from other images via techniques such as color detection, hue detection, motion and detection. If the analytic server determines that the occurrence is related to a genuine emergency then the process moves to block 108.
At block 110, the data collected is passed on to the customer care center.
In an embodiment, the collected data is re-evaluated at the customer care center to ensure that the occurrence is related to a genuine emergency. For example, a customer care executive may look at the collected audio and image data to determine that the sounds and images belong to a human being in an emergency situation and are not the result of a false alarm. In another embodiment, the collected data may be re-evaluated automatically. In an embodiment, the customer care executive may resolve the emergency by initiating a call to the user. In another embodiment, the customer care executive may direct a call to the appropriate emergency service to for the user's emergency, for example, police, fire department, medical emergency service. In another embodiment, an automated system, for example an IVR system, automatically directs a call to an appropriate emergency service to handle the user's emergency. In an embodiment, the customer care executive may initiate a call to an emergency contact as determined by the user. In an embodiment, the customer care executive may initiate a call to the user to handle the emergency or handle it while the appropriate emergency service responds. If the data collected at block 108 indicates that the occurrence is a false alarm then the process moves to lock 112. In a scenario, where an emergency feature is precisely defined, for example, whether the temperature is higher than a specified threshold at a specific location, the automated / manual processing of data can be optional, since in such cases sensors at pre-defined locations sense and pass on sensed data for processing to that an alarm may or may not be triggered in determination of an emergency event.
On the other hand, in a scenario, where an emergency feature cannot be precisely defined or the situation is too complicated for sensors to sense, the automated / manual processing of data is mandatory. For example, for an emergency situation within a taxi on a trip, there can be a variety of emergency situations, whose symptoms or features cannot be precisely defined. Furthermore, it is not easy for sensors to sense an emergency situation. In such cases, the automated / manual processing of data is mandatory.
At block 112, the data collected is discarded.
In at least an additional embodiment, a panic switch is activated or allowed to be activated upon determination of an emergency event / occurrence. This panic switch is configured with emergency response actions such as calls to pre-defined contacts, messages, notifications, audible and / or visual alarms of the vehicle to be activated, pre-defined audible and / or visual alarms of the system to be activated in response to determination of an emergency event / occurrence. Human mediation to activate such a panic switch may or may not be provided. \n exemplary implementation* of - the emergency response platform is iescribed herein. A passenger travelling in a taxi is assaulted by a co- Dassenger or the taxi driver. The taxi has the emergency response platform nstalled as an application on a tablet that is attached to the back of the iriver's seat. The passenger attempts to fend off the attacker and in the effort hrieks or screams loudly. The shrieks and screams along with the passenger's motion are detected by the tablet's microphone which is always listening for occurrence related input. The detection module then activates the emergency response system's trigger module. The trigger module then activates sensors and other hardware components like camera, microphone, GPS etc. of the tablet to collect data related. The camera starts recording images of the taxi, the GPS detects the taxi's location, other components of the tablet record other data for example the time of the day. After a predetermined amount of data is collected, it is then transmitted to an analytic server via a wireless network for example a 3G network. At the analytic server, the audio files, image files and other data are processed and the analytic server determines that the shrieks/screams and image data is related to an emergency and not a false alarm. The data is then transmitted by the analytic server to a customer care center. At the customer care center, a customer care executive reevaluates the data, determines that an assault is taking place and alerts the police giving them details like last known location of taxi, time of day, speed (if moving), description of victim and any other pertinent information. Those skilled in the art should further appreciate that programs defining the functions of the disclosed system and method can be implemented in software and delivered to a system for execution in many forms. According to one embodiment, the techniques described herein are implemented by one or more special-purpose computing devices. The special-purpose computing devices may be hard-wired to perform the techniques, or may include digital electronic devices such as one or more application-specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs) that are persistently programmed to perform the techniques, or may include one or more general purpose hardware processors programmed to perform the techniques pursuant to program instructions in firmware, memory, other storage, or a combination. Such special-purpose computing devices may also combine custom hard-wired logic, ASICs, or FPGAs with custom programming to accomplish the techniques. The special-purpose computing devices may be desktop computer systems, portable computer systems, handheld devices, networking devices or any other device that incorporates hard-wired and/or program logic to implement the techniques.
For example, a computer system may include a bus or other communication mechanism for communicating information, and a hardware processor coupled with bus for processing information. Hardware processor may be, for example, a general purpose microprocessor.
Computer system also may include a main memory such as a random access memory (RAM) or other dynamic storage device, coupled to bus for storing information and instructions to be executed by processor Main memory also may be used for storing temporary variables or other intermediate informatio during execution of instructions to be executed by processor Such instructions, when stored in non-transitory storage media accessible to processor render computer system into a special-purpose machine that is customized to perform the operations specified in the instructions.
Computer system further may include a read only memory (ROM) or other static storage device coupled to bus for storing static information and instructions for processor A storage device such as a magnetic disk, optical disk, or solid-state drive is provided and coupled to bus for storing information and instructions.
Computer system may be coupled via bus to a display such as a cathode ray tube (CRT), for displaying information to a computer user. An input device including alphanumeric and other keys, is coupled to bus for communicating information and command selections to processor Another type of user input device is cursor control such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor and for controlling cursor movement on display This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
Computer system may implement the techniques described herein using customized hard- wired logic, one or more ASICs or FPGAs, firmware and/or program logic which in combination with the computer system causes or programs computer system to be a special-purpose machine. According to one embodiment,- the techniques herein are performed by computer system in response to processor executing one or more sequences of one or more instructions contained in main memory. Such instructions may be read into main memory from another storage medium, such as storage device. Execution of the sequences of instructions contained in main memory causes processor to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions.
The term "storage media" as used herein refers to any non-transitory media that store data and/or instructions that cause a machine to operate in a specific fashion. Such storage media may comprise non-volatile media and/or volatile media. Non- volatile media may include, for example, optical disks, magnetic disks, or solid-state drives, such as storage device Volatile media may include dynamic memory, such as main memory Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid-state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
Storage media is distinct from but may be used in conjunction with transmission media. Transmission media participates in transferring information between storage media. For example, transmission media may include coaxial cables, copper wire and fiber optics, including the wires that comprise bus Transmission media can also take the form of acoustic or light waves, such as those generated during radio- wave and infra-red data communications.
Various forms of media may be involved in carrying one or more sequences of one or more instructions to processor for execution. For example, the instructions may initially be carried on a magnetic disk or solid-state drive of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local to computer system can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infrared signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus. The bus carries the data to main memory from which processor retrieves and executes the instructions. The instructions received by main memory may optionally be stored on storage device either before or after execution by processor system also may include a communication interface coupled to bus Communication interface provides a two-way data communication coupling to a network link that is connected to a local network For example, communication interface may be an integrated services digital network (ISDN) card, cable modem, satellite modem, or a modem to provide a data communication connection to a corresponding type of telephone line. As another example, communication interface may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation, communication interface sends and receives electrical, electromagnetic or optical signals that carry digital data"streams representing various types of information.
Network link typically provides data communication through one or more networks to other data devices. For example, network link may provide a connection through local network to a host computer or to data equipment operated by an Internet Service Provider (ISP) ISP in turn provides data communication services through the world wide packet data communication network now commonly referred to as the "Internet" Local network and Internet both use electrical, electromagnetic or optical signals that carry digital data streams. The signals through the various networks and the signals on network link and through communication interface which carry the digital data to and from computer system are example forms of transmission media.
Computer system can send messages and receive data, including program code, through the network(s), network link and communication interface In the Internet example, a server might transmit a requested code for an application program through Internet ISP local network and communication interface.
The received code may be executed by processor as it is received, and/or stored in storage device or other non-volatile storage for later execution.
The INVENTIVE STEP of this invention lies in providing a system and method which automates an emergency response system to a point where a human intervention is required to make a decision to make a panic call. Basically, it puts an eye and an ear in a defined environment.
Although the present invention has been described in considerable detail with reference to certain preferred embodiments and examples thereof, other embodiments and equivalents are possible. Even though numerous characteristics and advantages of the present invention have been set forth in the foregoing description, together with functional and procedural details, the disclosure is illustrative only, and changes may be made in detail, especially in terms of the procedural steps within the principles of the invention to the full extent indicated by the broad general meaning of the terms. Thus various modifications are possible of the presently disclosed system and process without deviating from the intended scope and spirit of the present invention. Accordingly, in one embodiment, such modifications of the presently disclosed system and method are included in the scope of the present invention.

Claims

Claims,
1. A system for implementing an emergency response platform, said system comprising:
- at least a data collection module configured to collect data;
- at least a detection module configured to detect an occurrence of an event based on pre-defined criteria and in correlation with said collected data;
- at least a trigger module, configured to be activated in response to detection of an event, in order to transmit data in order to trigger a response;
- at least an analysis server configured to analyse said data in order to confirm occurrence of an event as an event; and
- at least a panic switch being activated in order to be activated or allowed to be activated upon determination of an event, said panic switch being configured with emergency response actions such as calls to pre-defined contacts, messages, notifications, audible and / or visual alarms to be activated in response to determination of an event.
2. A system as claimed in claim 1 wherein, said data collection module being configured to collect data selected from a group of data items consisting of audio data, video data, image data, location data, speed data, and multimedia data.
3. A system as claimed in claim 1 wherein, said data collection module is communicably coupled to a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in correlation with ambient sound.
4. A system as claimed in claim 1 wherein, said data collection module is communicably coupled to a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in correlation with ambient sound, further characterised in that, said module comprising at least a first filter configured to filter out human voice from ambient sound and at least a second filter configured to filter out human voice which breaches pre-determined thresholds of parameters relating to verbal cues in order to determine an event.
5. A system as claimed in claim 1 wherein, said data collection module being communicably coupled to a camera, characterised in that, said camera being activated to capture at least a snap or at least a video once a first breach is detected.
6. A system as claimed in claim 1 wherein, said data collection module being communicably coupled to a camera, characterised in that, said camera being activated to capture at least a snap or at least a video, continuously or in discretely timed manner.
7. A system as claimed in claim 1 wherein, said data collection module being communicably coupled to a camera, characterised in that, said camera being further communicably coupled to image processing analytics' mechanism in order to an event.
8. A system as claimed in claim 1 wherein, said data collection module being communicably coupled to a thermal sensor, characterised in that, data from said thermal sensor being analysed to determine occurrence of an event.
9. A system as claimed in claim 1 wherein, said data collection module being communicably coupled to an infrared sensor, characterised in that, data from said infrared sensor being analysed to determine occurrence of an event.
10. A system as claimed in claim 1 wherein, said data collection module being communicably coupled to a sensor selected from a group of sensors, characterised in that, data from each sensor being analysed to determine occurrence of an event.
1 1. A system as claimed in claim 1 wherein, said data collection module being communicably coupled to a locating mechanism, characterised in that, data from said locating mechanism being analysed to determine occurrence of an event.
12. A system as claimed in claim 1 wherein, said detection module comprising a verbal detection module configured to detect occurrence of an event based on pre-defined thresholds of parameters relating to verbal cues, said parameters comprising a pre-defined threshold value selected from a group of pre-defined threshold values consisting of audio volume threshold value, audio pitch threshold value, audio amplitude threshold value, and audio frequency threshold value.
13. A system as claimed in claim 1 wherein, said detection module comprising a non-verbal detection module configured to detect occurrence of an event based on non-verbal cues, said non-verbal cues comprising video or image.
14. A system as claimed in claim 1 wherein, said at least a customer care center based on user-defined preferences.
15. A system as claimed in claim 1 wherein, said data collection module comprising a set of items selected from a group of items consisting of a microphone, cameras, multiple sensors, accelerometers, gyroscopes, infra-red sensors, speakers, locating mechanisms, GPS, heart rate sensors, motion sensors, body sensors, stress sensors, heat sensors, wearable devices, receivers, transmitters, input devices, output devices, random access memory, read only memory, and a database.
16. A system as claimed in claim 1 wherein, said analytic server being configured to analyse data from said detection module in an iterative fashion, once a first breach is detected, in order to conclusively determine an emergency event / occurrence.
17. A system as claimed in claim 1 wherein, said trigger module being configured to be activated in response to data from said detection module, said trigger module being configured to trigger activation of at least an item from said data collection module in response to predetermined conditions.
18. A system as claimed in claim 1 wherein, said analytic server being configured to analyse audio data using techniques selected from a group of techniques consisting of amplitude detection technique, and loudness detection technique, contextual speech processing technique, and speech recognition technique.
19. A system as claimed in claim 1 wherein, said system comprising at least a customer care center configured to respond to an event in accordance with pre-determined configurations of response.
20. A system as claimed in claim 1 wherein, said panic switch comprising human mediation capability in order to activate said panic switch upon determination of an event.
2 LA system as claimed in claim 1 wherein, said analytic module comprising an automatic mode of determination of an event.
22. A system as claimed in claim 1 wherein, said analytic module comprising a manual mode of determination of an event.
23. A method for implementing a emergency response platform, said method comprising the steps of:
- collecting data, using at least a data collection module;
- detecting an occurrence of an event based on pre-defined criteria and in correlation with said collected data, using at least a detection module;
- activating , at least a trigger module, in response to detection of an event, in order to transmit data in order to trigger a response, ;
- analysing said data in order to confirm occurrence of an event as an event, using at least an analysis server; and
- activating or allowing to be activated, at least a panic switch, upon determination of an event, said panic switch being configured with emergency response actions such as calls to pre-defined contacts, messages, notifications, audible and / or visual alarms to be activated in response to determination of an event.
24. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data from a group of data items consisting of audio data, video data, image data, location data, speed data, and multimedia data.
25. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data from a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in correlation with ambient sound.
26. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data from a microphone, characterised in that, data from said microphone being analysed for detecting deviations in sound in correlation with ambient sound, further characterised in that, said step comprising a step of filtering out human voice from ambient sound and a further step of filtering out human voice which breaches pre-determined thresholds of parameters relating to verbal cues in order to determine an event.
27. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data from a camera, characterised in that, said camera being activated to capture at least a snap or at least a video once a first breach is detected.
28. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data from a camera, characterised in that, said camera being activated to capture at least a snap or at least a video, continuously or in discretely timed manner.
29. A method as claimed in claim 23 wherein, said step of said step of collecting data comprising a step of collecting data from a camera, characterised in that, said camera being further communicably coupled to image processing analytics' mechanism in order to an event.
30. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data from a thermal sensor, characterised in that, data from said thermal sensor being analysed to determine occurrence of an event.
31. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data from an infrared sensor, characterised in that, data from said infrared sensor being analysed to determine occurrence of an event.
32. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data from a group of sensors, characterised in that, data from each sensor being analysed to determine occurrence of an event.
33. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data from a locating mechanism, characterised in that, data from said locating mechanism being analysed to determine occurrence of an event.
34. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data from a verbal detection module configured to detect occurrence of an event based on pre-defined thresholds of parameters relating to verbal cues, said parameters comprising a pre-defined threshold value selected from a group of predefined threshold values consisting of audio volume threshold value, audio pitch threshold value, audio amplitude threshold value, and audio frequency threshold value.
35. A method as claimed in claim 23 wherein, said step of said step of collecting data comprising a step of collecting data from a non-verbal detection module configured to detect occurrence of an event based on non-verbal cues, said non-verbal cues comprising video or image.
36. A method as claimed in claim 23 wherein, said method comprising a step of providing at least a customer care center based on user-defined preferences.
37. A method as claimed in claim 23 wherein, said step of collecting data comprising a step of collecting data comprising a set of items selected from a group of items consisting of a microphone, cameras, multiple sensors, accelerometers, gyroscopes, infra-red sensors, speakers, locating mechanisms, GPS, heart rate sensors, motion sensors, body sensors, stress sensors, heat sensors, wearable devices, receivers, transmitters, input devices, output devices, random access memory, read only memory, and a database.
38. A method as claimed in claim 23 wherein, said step of analysing said data comprising a step of analysing said data from said detection module in an iterative fashion, once a first breach is detected, in order to conclusively determine an emergency event / occurrence.
=39. A method as claimed in claim 23 wherein, said step of activating , at least a trigger module comprising a step of activating said trigger module in response to data from said detection module, said trigger module being configured to trigger activation of at least an item from said data collection module in response to pre-determined conditions.
40. A method as claimed in claim 23 wherein, said step of analysing said data comprising a step of analysing audio data using techniques selected from a group of techniques consisting of amplitude detection technique, and loudness detection technique, contextual speech processing technique, and speech recognition technique.
41. A method as claimed in claim 23 wherein, said method comprising at least a step of providing a customer care center configured to respond to an event in accordance with pre-determined configurations of response.
42. A method as claimed in claim 23 wherein, said step of activating or allowing to be activated, at least a panic switch comprising human mediation capability in order to activate said panic switch upon determination of an event.
43. A method as claimed in claim 23 wherein, said step of analysing said data comprising an automated step of analysing in order to determine an event.
44. A method as claimed in claim 23 wherein, said step of analysing said data being a manual step of analysing said data in order to determine an event.
PCT/IN2016/000066 2015-03-13 2016-03-14 System and method for implementing emergency response platform WO2016147202A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN1239/CHE/2015 2015-03-13
IN1239CH2015 2015-03-13

Publications (1)

Publication Number Publication Date
WO2016147202A1 true WO2016147202A1 (en) 2016-09-22

Family

ID=56918468

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IN2016/000066 WO2016147202A1 (en) 2015-03-13 2016-03-14 System and method for implementing emergency response platform

Country Status (1)

Country Link
WO (1) WO2016147202A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114237388A (en) * 2021-12-01 2022-03-25 辽宁科技大学 Brain-computer interface method based on multi-mode signal recognition
US11682094B2 (en) 2020-01-13 2023-06-20 Florida Power & Light Company Public reporting of power line-down conditions

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1417065A (en) * 2002-12-09 2003-05-14 陈涛 Anti-hijack and-theft networked alarm method and system for taxi
CN101391589A (en) * 2008-10-30 2009-03-25 上海大学 Vehicle intelligent alarming method and device
CN101607668A (en) * 2008-06-17 2009-12-23 上海阿艾依智控系统有限公司 Embedded computer vision escalator pedestrian flow supervision and alarm device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1417065A (en) * 2002-12-09 2003-05-14 陈涛 Anti-hijack and-theft networked alarm method and system for taxi
CN101607668A (en) * 2008-06-17 2009-12-23 上海阿艾依智控系统有限公司 Embedded computer vision escalator pedestrian flow supervision and alarm device
CN101391589A (en) * 2008-10-30 2009-03-25 上海大学 Vehicle intelligent alarming method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11682094B2 (en) 2020-01-13 2023-06-20 Florida Power & Light Company Public reporting of power line-down conditions
CN114237388A (en) * 2021-12-01 2022-03-25 辽宁科技大学 Brain-computer interface method based on multi-mode signal recognition
CN114237388B (en) * 2021-12-01 2023-08-08 辽宁科技大学 Brain-computer interface method based on multi-mode signal identification

Similar Documents

Publication Publication Date Title
US11638124B2 (en) Event-based responder dispatch
US10656905B2 (en) Automatic and selective context-based gating of a speech-output function of an electronic digital assistant
US20200346751A1 (en) Unmanned aerial vehicle emergency dispatch and diagnostics data apparatus, systems and methods
US11423764B2 (en) Emergency communications using client devices that are associated with audio/video recording and communication devices
US8630820B2 (en) Methods and systems for threat assessment, safety management, and monitoring of individuals and groups
US8368754B2 (en) Video pattern recognition for automating emergency service incident awareness and response
US20140118140A1 (en) Methods and systems for requesting the aid of security volunteers using a security network
US20140120977A1 (en) Methods and systems for providing multiple coordinated safety responses
US20190373219A1 (en) Methods, systems, apparatuses and devices for facilitating management of emergency situations
US11749094B2 (en) Apparatus, systems and methods for providing alarm and sensor data to emergency networks
US11704995B2 (en) Systems and methods for emergency event capture
US11233901B2 (en) Call management system including a call transcription supervisory monitoring interactive dashboard at a command center
WO2016147202A1 (en) System and method for implementing emergency response platform
US10721579B2 (en) Correlated cross-feed of audio and video
US20220414377A1 (en) System and method for presenting statements captured at an incident scene
CA3037619C (en) Event-based responder dispatch
US20230401850A1 (en) Indicating that captured data is associated with an uncompleted task of an incident
US20230319537A1 (en) Systems And Methods For Emergency Event Capture
US20230102182A1 (en) Incident Management System
US20230089720A1 (en) Systems and methods for providing assistance in an emergency

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16764355

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16764355

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26.03.2018)