EP2983148A1 - Voice-sensitive emergency alert system - Google Patents
Voice-sensitive emergency alert system Download PDFInfo
- Publication number
- EP2983148A1 EP2983148A1 EP14382309.4A EP14382309A EP2983148A1 EP 2983148 A1 EP2983148 A1 EP 2983148A1 EP 14382309 A EP14382309 A EP 14382309A EP 2983148 A1 EP2983148 A1 EP 2983148A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- sound
- acoustic
- alert
- emergency
- alarm module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000004044 response Effects 0.000 claims abstract description 31
- 230000000007 visual effect Effects 0.000 claims abstract description 19
- 230000001755 vocal effect Effects 0.000 claims description 33
- 238000000034 method Methods 0.000 claims description 11
- 238000001514 detection method Methods 0.000 claims description 9
- 230000009471 action Effects 0.000 claims description 3
- 239000000779 smoke Substances 0.000 claims description 3
- UGFAIRIUMAVXCW-UHFFFAOYSA-N Carbon monoxide Chemical compound [O+]#[C-] UGFAIRIUMAVXCW-UHFFFAOYSA-N 0.000 claims description 2
- 229910002091 carbon monoxide Inorganic materials 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 claims 1
- 230000001020 rhythmical effect Effects 0.000 claims 1
- 241001465754 Metazoa Species 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 7
- 230000002452 interceptive effect Effects 0.000 description 4
- 230000003247 decreasing effect Effects 0.000 description 3
- 230000004075 alteration Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000005352 clarification Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B1/00—Systems for signalling characterised solely by the form of transmission of the signal
- G08B1/08—Systems for signalling characterised solely by the form of transmission of the signal using electric transmission ; transformation of alarm signals to electrical signals from a different medium, e.g. transmission of an electric alarm signal upon detection of an audible alarm signal
-
- A—HUMAN NECESSITIES
- A62—LIFE-SAVING; FIRE-FIGHTING
- A62B—DEVICES, APPARATUS OR METHODS FOR LIFE-SAVING
- A62B3/00—Devices or single parts for facilitating escape from buildings or the like, e.g. protection shields, protection screens; Portable devices for preventing smoke penetrating into distinct parts of buildings
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B7/00—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00
- G08B7/06—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources
- G08B7/066—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources guiding along a path, e.g. evacuation path lighting strip
Definitions
- the present invention is generally related to emergency alert systems, and more specifically, to fire emergency systems.
- Fire emergency systems typically include one or more alarms located at various locations such as hallways and/or individual rooms.
- the alarms can include an audio alert and/or a visual alert that is sensed by one or more persons located in the vicinity of the alarm system. In this manner, the alarm system only output alerts without taking into consideration the actions of one or more persons located in proximity -of the alarm.
- a sound-sensitive emergency alert system comprises at least one electronic alarm module disposed at a predetermined location in a building.
- the at least one electronic alarm module is configured to perform at least one of output at least one alert, detect at least one acoustic sound, and adjust the output of the at least one alert based on the detected at least one acoustic sound.
- the at least one electronic alarm module is further configured to transmit information about the detected at least one acoustic sound to components in communication with the emergency alert system.
- a method of alerting an emergency event comprises outputting at least one alert in response to detecting an emergency event.
- the method further includes detecting at least one acoustic sound following detection of the emergency event and detecting a location of the at least one acoustic sound.
- the method further includes adjusting the output of the at least one alert in response to detecting the at least one detected acoustic sound.
- the method further includes transmitting information indicating the location of the at least one acoustic sound to an electronic control module remotely located from the location of the at least one acoustic sound.
- the voice-sensitive emergency system can dynamically adjust operation in response to detecting one or more acoustic sounds such as voices, for example, during an emergency event.
- An emergency event can include various non-limiting events including, but not limited to, a fire, detected smoke detected carbon monoxide gas, a security breach of a building, and structural damage of a building.
- the acoustic voices include vocal requests for help during the emergency event.
- the voice-sensitive emergency alert system is configured to determine and display the location of the acoustic voice.
- the voice-sensitive emergency alert system is also configured to dynamically change operation of an individual alarm module in response to detecting the acoustic voice. For example, a volume of an emitted audio alert can be decreased to facilitate search/rescue and reduce discomfort of one or more persons in the vicinity of the alarm module.
- the audio alert and/or visual alert may also be output differently at the location where the acoustic voice is detected to guide the emergency personnel towards the locality of the acoustic voices (e.g., the help requests).
- the voice-sensitive emergency alert system can interact with persons requesting for help and can ask for clarification on their location and/or needs of the user such as, for example, the nature of the situation or amount of people located in a confined area. While various features of the invention have been described, it is to be understood that various embodiments of the invention may include only some or a combination of the inventive features.
- the sound-sensitive emergency alert system 100 includes an electronic alarm module 102, an electronic control unit 104 and an electronic graphic user interface (GUI) 106.
- the alarm module 102 is disposed at one or more predetermined locations and is configured to detect one or more acoustic sounds 108 at a respective location.
- the electronic control unit 104 is in electrical communication with each alarm module 102 and is programmed with the location of each respective alarm module 102. In this manner, the electronic control unit 104 is configured to receive one or more sound detection signals from a respective alarm module 102, and determine the location of the respective alarm module 102 which detects the acoustic signal 108. Accordingly, the electronic control unit 104 can determine the location of one or more persons 110 based on the locality of the detected acoustic signal 108.
- the GUI 106 is in communication with the electronic control unit 104 and outputs information indicating the location of one or more detected acoustic signals 108 to emergency personnel 112, as discussed in greater detail below.
- the alarm module 102 includes an acoustic sensor 114, an acoustic output device 116, a visual output device 118, an electronic alert communication and control module 120, an electronic sound recognition module 122, and an electronic communication and control module 124. According to an embodiment, for example, all the sensing, recognition, control and notification functions are implemented in the electronic alarm module, which in turn interfaces with pre-existing emergency systems like pre-existing alarm units to allow installation within legacy systems.
- the acoustic sensor 114 includes, for example a microphone, and is configured to detect various acoustic sounds, including human voices 108. In this manner, the acoustic sensor 114 may sense one or more acoustic voices 108 and convert the acoustic voices 108 into a sound detection signal. Although acoustic voices are described, the acoustic sensor 114 may also be configured to detect other acoustic sounds such as animal response (e.g., dog barks) or hand clapping (useful for voice impaired individuals or individuals wearing gas masks).
- animal response e.g., dog barks
- hand clapping useful for voice impaired individuals or individuals wearing gas masks.
- the acoustic output device 116 and the visual output device 118 are each configured to output an audio alert 117 and a visual alert 119, respectively.
- the acoustic output device 116 may include a speaker, for example, and the audio alert 117 may include various selectable tones and/or voice messages and/or volume levels (i.e., decibels) output from the acoustic output device 116.
- the visual output device 118 may include a lamp, for example, and the visual alert 119 may include a light emitted at various selectable frequencies and/or colors (i.e., wavelengths).
- the alert communication and control module 120 is in electrical communication with the acoustic sensor 114, the acoustic output device 116 and the visual output device 118.
- the alert communication and control module 120 is configured to control the output of the acoustic output device 116 and/or the visual output device 118 in response to detecting the acoustic voice 108 via the acoustic sensor 114.
- the alert communication and control module 120 is configured to control the acoustic output device 116 to selectively output the audio alert 117 at different decibel levels in response to detecting the acoustic voice 108.
- the alert communication and control module 120 controls the acoustic output device 116 to output the audio alert 117 at a first decibel level when the sound-sensitive emergency alert system 100 detects an emergency event, and at a second level less than the first decibel level in response to detecting an acoustic voice 108.
- the requests for help are not masked during an emergency event such as, for example, a fire.
- the decreased volume reduces discomfort of one or more persons 110 located near the alarm module 102.
- the alert communication and control module 120 is also configured to control the visual output device 118 to output light at a first wavelength (i.e., a first color) and/or first frequency when the sound-sensitive emergency alert system 100 detects the emergency event.
- a first wavelength i.e., a first color
- first frequency i.e., a first frequency
- the alert communication and control module controls 120 the visual output device 118 to output the light at a second wavelength (i.e., second color) different from the first wavelength and/or a second frequency different from the first frequency.
- a white light is output at locations where no acoustic voices are detected whereas a red light is output at locations where a respective alarm module 102 detects acoustic voices.
- the second color (e.g., red light) may also be pulsed at a faster/slower frequency than the frequency of the white light.
- the locations of detected acoustic voices 108 can be visually distinguished from other locations to indicate the locality of one or more persons 110 requesting help, which aids emergency personnel in quickly finding and providing assistance to those persons 110.
- the sound recognition module 122 is in electrical communication with the acoustic sensor 114 and is configured to convert the acoustic voices 108 into a sound detection signal. Although acoustic voices are described, the sound recognition module 122 may also identify other acoustic sounds such as animal response including, but not limited to, dog barks. In addition to detecting an acoustic voice, the sound recognition module 122 may also determine specific vocal statements of one or more persons 110. The statements may include, for example, names of one or more persons requesting help, a number of people in an area near the alarm module 102, the verbal location of one or more persons, etc. The sound recognition module 122 may utilize various well-known acoustic and language models and speech recognition algorithms for determining and recognizing human speech and verbal statements including, but not limited to a hidden Markov model (HMM).
- HMM hidden Markov model
- the sound recognition module 122 can recognize one or more vocal statements and can determine a vocal alert response message in response to receiving a vocal statement from one or more persons 110.
- the sound recognition module can store a plurality of vocal alert responses/messages, and select a particular vocal alert response among the plurality of vocal alert responses based on the vocal statement received from one or more persons 110.
- the vocal alert responses include, but are not limited to, a vocal inquiry, a vocal answer, and a vocal recommended course of action based on the recognized voice signal, e.g., the recognized human speech.
- the selected vocal alert response/message is then communicated to the alert communication and control module 120 such that the corresponding vocal alert response 117 is output to nearby persons via the acoustic output device 116, as illustrated in FIGS.
- the vocal alert/response messages include, for example, information on the location of one or more exits and precise instructions that direct persons in the vicinity to an exit route leading to the exits. Accordingly, the vocal alert/response messages can instruct people in the vicinity of the electronic alarm module about how and when to use the sound recognition feature of this system.
- the communication and control module 124 is in electrical communication with the sound recognition module 122, the alert communication and control module 120, and the electronic control unit 104.
- the connection between the sound recognition module 122, the communication and control module 124 and the alert communication and control module 120 forms a feedback loop that controls operation of the acoustic output device 116 and/or the visual output device 118 in response to detecting an acoustic voice.
- the alarm module 102 can operate dynamically based on the acoustic responses and requests of one or more persons 110 located in the vicinity.
- the electronic control unit 104 is located remotely from the alarm modules 102 included in the emergency alert system 100 and may operate as an electronic main control and indicating panel. According to an embodiment, a location signal indicating the predetermined location of one or more alarm modules 102 may be communicated from the communication and control module 124 to the electronic control unit 104. The electronic control unit 104 may also be programmed with the location of each respective alarm module 102. In a system where the electronic control unit 104 is connected to the alarm module 102 using wires or radio protocols (See FIG. 3 ), the electronic control unit 104 may determine which connection delivered the sound detection signal to determine the respective alarm module 102 that detected the acoustic voice 108.
- the sound detection signals may also include data indicating which particular alarm module 102 generated the respective voice signal.
- the electronic control unit 104 is configured to receive one or more sound detection signals from a respective alarm module 102, and can determine the location of the respective alarm module 102 that detected the acoustic voice 108. In either case described above, the electronic control unit 104 can determine the location of one or more persons 110 based on the locality of the detected acoustic voice 108.
- the GUI 106 is in communication with the electronic control unit 104 to input and/or output information corresponding to the emergency alert system 100 as discussed in greater detail below.
- the GUI 106 may be integrated with the electronic control unit 104 and/or may be located remotely from the electronic control unit 104.
- a graphical representation of the sound-sensitive emergency alert system 100 shown in FIG. 3 is displayed by the GUI 106. More specifically, the GUI 106 displays the predetermined locations (e.g., Units 1-9) containing a respective alarm module 102. The predetermined locations may also include, but are not limited to, hallways, stairwells, etc. When an acoustic voice 108 is detected by one or more alarm units 102, an alert indicator 126 is displayed at the respective location (e.g., unit 6 and unit 7) of the detected acoustic voice. Accordingly, emergency personnel 112 can quickly and easily ascertain the location of one or more persons 110 in need of assistance during an emergency event. The GUI 106 may also display additional information about each predetermined location including the number of persons, the name of the persons, etc.
- the GUI 106 may also display additional information about each predetermined location including the number of persons, the name of the persons, etc.
- a flow diagram illustrates a method of detecting the locality of acoustic voices during an emergency event according to an exemplary embodiment.
- the method begins at operation 500, and at operation 502 an emergency event is detected.
- the emergency event includes, for example, a fire emergency.
- the fire emergency may be detected in various manners including, but not limited to, smoke/fire/heat detectors, emergency exit usage, and manual detection.
- audio alerts and/or visual alerts are output from respective audio output devices and visual output devices.
- an acoustic sound such as a voice, for example, is detected by one or more respective alarm modules.
- the location of the acoustic sound is determined.
- the location of the acoustic sound may be determined based on the location of the respective alarm module and/or based on a verbal statement provided by a person in proximity of the respective alarm module.
- the locality of the detected acoustic sound is displayed with respect to the predetermined locations of each alarm unit.
- the audio alert and/or the visual output from one or more alarm modules that detected a respective acoustic sound is adjusted. For example, the volume of the acoustic alert may be decreased and the color of the visual alert may be changed.
- a vocal alert message is output from one or more of the audio output devices that detected the respective acoustic sound, and the method ends at operation 516.
- one or more embodiments provide a two-way interactive voice-sensitive emergency alert system that can dynamically adjust operation in response to detecting one or more acoustic voices during an emergency event such as, for example, a fire.
- the voice-sensitive emergency system therefore is capable of enhancing search/rescue of individual while reducing discomfort in the vicinity of the alarm module.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Alarm Systems (AREA)
Abstract
Description
- The present invention is generally related to emergency alert systems, and more specifically, to fire emergency systems.
- Conventional emergency alert systems are configured as non-interactive, one-way alert systems. Fire emergency systems, for example, typically include one or more alarms located at various locations such as hallways and/or individual rooms. The alarms can include an audio alert and/or a visual alert that is sensed by one or more persons located in the vicinity of the alarm system. In this manner, the alarm system only output alerts without taking into consideration the actions of one or more persons located in proximity -of the alarm.
- During a fire emergency, it may be imperative that emergency officials evacuate all persons from the vicinity of the fire. However, the exact location of any person located in the vicinity of the fire is often difficult to ascertain. In addition, the alarms are conventionally designed to output a high decibel (dB) sound at fixed volume to ensure persons in the vicinity are notified of the emergency. High decibel sound further increases the difficulty of ascertaining a person's location.
- According to at least one exemplary embodiment, a sound-sensitive emergency alert system comprises at least one electronic alarm module disposed at a predetermined location in a building. The at least one electronic alarm module is configured to perform at least one of output at least one alert, detect at least one acoustic sound, and adjust the output of the at least one alert based on the detected at least one acoustic sound. The at least one electronic alarm module is further configured to transmit information about the detected at least one acoustic sound to components in communication with the emergency alert system.
- According to yet another embodiment, a method of alerting an emergency event comprises outputting at least one alert in response to detecting an emergency event. The method further includes detecting at least one acoustic sound following detection of the emergency event and detecting a location of the at least one acoustic sound. The method further includes adjusting the output of the at least one alert in response to detecting the at least one detected acoustic sound. The method further includes transmitting information indicating the location of the at least one acoustic sound to an electronic control module remotely located from the location of the at least one acoustic sound.
- The subject matter which is regarded as the invention is particularly pointed out and distinctly claimed in the claims at the conclusion of the specification. The foregoing and other features of the invention are apparent from the following detailed description taken in conjunction with the accompanying drawings in which:
-
FIG. 1 is a block diagram of a voice-sensitive emergency alert system according to an exemplary embodiment; -
FIG. 2A is a diagram illustrating operation of a voice-sensitive emergency alert system according to an exemplary embodiment; -
FIG. 2B is a diagram illustrating operation of a voice-sensitive emergency alert system according to another exemplary embodiment; -
FIG. 3 is a diagram illustrating a plurality of electronic alarm modules disposed at a predetermined locations to detect the locality of acoustic voices sensed by a respective alarm module according to an exemplary embodiment; -
FIG. 4 is a diagram illustrating a display provided by a graphic user interface (GUI) according to an exemplary embodiment; and -
FIG. 5 is a flow diagram illustrating a method of detecting the locality of acoustic voices during an emergency event according to an exemplary embodiment. - Unlike conventional non-interactive one-way emergency alert systems, at least one embodiment of the present disclosure provides a two-way interactive voice-sensitive emergency alert system. The voice-sensitive emergency system can dynamically adjust operation in response to detecting one or more acoustic sounds such as voices, for example, during an emergency event. An emergency event can include various non-limiting events including, but not limited to, a fire, detected smoke detected carbon monoxide gas, a security breach of a building, and structural damage of a building. The acoustic voices include vocal requests for help during the emergency event. In response to detecting an acoustic voice, the voice-sensitive emergency alert system is configured to determine and display the location of the acoustic voice. The voice-sensitive emergency alert system is also configured to dynamically change operation of an individual alarm module in response to detecting the acoustic voice. For example, a volume of an emitted audio alert can be decreased to facilitate search/rescue and reduce discomfort of one or more persons in the vicinity of the alarm module. The audio alert and/or visual alert may also be output differently at the location where the acoustic voice is detected to guide the emergency personnel towards the locality of the acoustic voices (e.g., the help requests). In addition, the voice-sensitive emergency alert system can interact with persons requesting for help and can ask for clarification on their location and/or needs of the user such as, for example, the nature of the situation or amount of people located in a confined area. While various features of the invention have been described, it is to be understood that various embodiments of the invention may include only some or a combination of the inventive features.
- Turning now to
FIG. 1 , a sound-sensitiveemergency alert system 100 is illustrated according to an exemplary embodiment. The sound-sensitiveemergency alert system 100 includes anelectronic alarm module 102, anelectronic control unit 104 and an electronic graphic user interface (GUI) 106. Thealarm module 102 is disposed at one or more predetermined locations and is configured to detect one or moreacoustic sounds 108 at a respective location. - The
electronic control unit 104 is in electrical communication with eachalarm module 102 and is programmed with the location of eachrespective alarm module 102. In this manner, theelectronic control unit 104 is configured to receive one or more sound detection signals from arespective alarm module 102, and determine the location of therespective alarm module 102 which detects theacoustic signal 108. Accordingly, theelectronic control unit 104 can determine the location of one ormore persons 110 based on the locality of the detectedacoustic signal 108. The GUI 106 is in communication with theelectronic control unit 104 and outputs information indicating the location of one or more detectedacoustic signals 108 toemergency personnel 112, as discussed in greater detail below. - The
alarm module 102 includes anacoustic sensor 114, anacoustic output device 116, avisual output device 118, an electronic alert communication andcontrol module 120, an electronicsound recognition module 122, and an electronic communication andcontrol module 124. According to an embodiment, for example, all the sensing, recognition, control and notification functions are implemented in the electronic alarm module, which in turn interfaces with pre-existing emergency systems like pre-existing alarm units to allow installation within legacy systems. - The
acoustic sensor 114 includes, for example a microphone, and is configured to detect various acoustic sounds, includinghuman voices 108. In this manner, theacoustic sensor 114 may sense one or moreacoustic voices 108 and convert theacoustic voices 108 into a sound detection signal. Although acoustic voices are described, theacoustic sensor 114 may also be configured to detect other acoustic sounds such as animal response (e.g., dog barks) or hand clapping (useful for voice impaired individuals or individuals wearing gas masks). - The
acoustic output device 116 and thevisual output device 118 are each configured to output anaudio alert 117 and avisual alert 119, respectively. Theacoustic output device 116 may include a speaker, for example, and theaudio alert 117 may include various selectable tones and/or voice messages and/or volume levels (i.e., decibels) output from theacoustic output device 116. Thevisual output device 118 may include a lamp, for example, and thevisual alert 119 may include a light emitted at various selectable frequencies and/or colors (i.e., wavelengths). - The alert communication and
control module 120 is in electrical communication with theacoustic sensor 114, theacoustic output device 116 and thevisual output device 118. The alert communication andcontrol module 120 is configured to control the output of theacoustic output device 116 and/or thevisual output device 118 in response to detecting theacoustic voice 108 via theacoustic sensor 114. According to an embodiment, the alert communication andcontrol module 120 is configured to control theacoustic output device 116 to selectively output theaudio alert 117 at different decibel levels in response to detecting theacoustic voice 108. For example, the alert communication andcontrol module 120 controls theacoustic output device 116 to output theaudio alert 117 at a first decibel level when the sound-sensitiveemergency alert system 100 detects an emergency event, and at a second level less than the first decibel level in response to detecting anacoustic voice 108. In this manner, the requests for help are not masked during an emergency event such as, for example, a fire. In addition, the decreased volume reduces discomfort of one ormore persons 110 located near thealarm module 102. - The alert communication and
control module 120 is also configured to control thevisual output device 118 to output light at a first wavelength (i.e., a first color) and/or first frequency when the sound-sensitiveemergency alert system 100 detects the emergency event. When, however, theacoustic sensor 114 detects anacoustic voice 108, the alert communication and control module controls 120 thevisual output device 118 to output the light at a second wavelength (i.e., second color) different from the first wavelength and/or a second frequency different from the first frequency. For example, a white light is output at locations where no acoustic voices are detected whereas a red light is output at locations where arespective alarm module 102 detects acoustic voices. The second color (e.g., red light) may also be pulsed at a faster/slower frequency than the frequency of the white light. In this manner, the locations of detectedacoustic voices 108 can be visually distinguished from other locations to indicate the locality of one ormore persons 110 requesting help, which aids emergency personnel in quickly finding and providing assistance to thosepersons 110. - The
sound recognition module 122 is in electrical communication with theacoustic sensor 114 and is configured to convert theacoustic voices 108 into a sound detection signal. Although acoustic voices are described, thesound recognition module 122 may also identify other acoustic sounds such as animal response including, but not limited to, dog barks. In addition to detecting an acoustic voice, thesound recognition module 122 may also determine specific vocal statements of one ormore persons 110. The statements may include, for example, names of one or more persons requesting help, a number of people in an area near thealarm module 102, the verbal location of one or more persons, etc. Thesound recognition module 122 may utilize various well-known acoustic and language models and speech recognition algorithms for determining and recognizing human speech and verbal statements including, but not limited to a hidden Markov model (HMM). - The
sound recognition module 122 can recognize one or more vocal statements and can determine a vocal alert response message in response to receiving a vocal statement from one ormore persons 110. For example, the sound recognition module can store a plurality of vocal alert responses/messages, and select a particular vocal alert response among the plurality of vocal alert responses based on the vocal statement received from one ormore persons 110. The vocal alert responses include, but are not limited to, a vocal inquiry, a vocal answer, and a vocal recommended course of action based on the recognized voice signal, e.g., the recognized human speech. The selected vocal alert response/message is then communicated to the alert communication andcontrol module 120 such that the corresponding vocalalert response 117 is output to nearby persons via theacoustic output device 116, as illustrated inFIGS. 2A-2B . The vocal alert/response messages include, for example, information on the location of one or more exits and precise instructions that direct persons in the vicinity to an exit route leading to the exits. Accordingly, the vocal alert/response messages can instruct people in the vicinity of the electronic alarm module about how and when to use the sound recognition feature of this system. - Turning back to
FIG. 1 , the communication andcontrol module 124 is in electrical communication with thesound recognition module 122, the alert communication andcontrol module 120, and theelectronic control unit 104. The connection between thesound recognition module 122, the communication andcontrol module 124 and the alert communication andcontrol module 120 forms a feedback loop that controls operation of theacoustic output device 116 and/or thevisual output device 118 in response to detecting an acoustic voice. In this manner, thealarm module 102 can operate dynamically based on the acoustic responses and requests of one ormore persons 110 located in the vicinity. - The
electronic control unit 104 is located remotely from thealarm modules 102 included in theemergency alert system 100 and may operate as an electronic main control and indicating panel. According to an embodiment, a location signal indicating the predetermined location of one ormore alarm modules 102 may be communicated from the communication andcontrol module 124 to theelectronic control unit 104. Theelectronic control unit 104 may also be programmed with the location of eachrespective alarm module 102. In a system where theelectronic control unit 104 is connected to thealarm module 102 using wires or radio protocols (SeeFIG. 3 ), theelectronic control unit 104 may determine which connection delivered the sound detection signal to determine therespective alarm module 102 that detected theacoustic voice 108. - In a system where the
alarm modules 102 are in wireless communication with theelectronic control unit 104 or any other third party equipment with similar purpose, the sound detection signals may also include data indicating whichparticular alarm module 102 generated the respective voice signal. In this manner, theelectronic control unit 104 is configured to receive one or more sound detection signals from arespective alarm module 102, and can determine the location of therespective alarm module 102 that detected theacoustic voice 108. In either case described above, theelectronic control unit 104 can determine the location of one ormore persons 110 based on the locality of the detectedacoustic voice 108. - The
GUI 106 is in communication with theelectronic control unit 104 to input and/or output information corresponding to theemergency alert system 100 as discussed in greater detail below. TheGUI 106 may be integrated with theelectronic control unit 104 and/or may be located remotely from theelectronic control unit 104. - Turning to
FIG. 4 , for example, a graphical representation of the sound-sensitiveemergency alert system 100 shown inFIG. 3 is displayed by theGUI 106. More specifically, theGUI 106 displays the predetermined locations (e.g., Units 1-9) containing arespective alarm module 102. The predetermined locations may also include, but are not limited to, hallways, stairwells, etc. When anacoustic voice 108 is detected by one ormore alarm units 102, analert indicator 126 is displayed at the respective location (e.g.,unit 6 and unit 7) of the detected acoustic voice. Accordingly,emergency personnel 112 can quickly and easily ascertain the location of one ormore persons 110 in need of assistance during an emergency event. TheGUI 106 may also display additional information about each predetermined location including the number of persons, the name of the persons, etc. - Referring now to
FIG. 5 , a flow diagram illustrates a method of detecting the locality of acoustic voices during an emergency event according to an exemplary embodiment. The method begins atoperation 500, and atoperation 502 an emergency event is detected. The emergency event includes, for example, a fire emergency. The fire emergency may be detected in various manners including, but not limited to, smoke/fire/heat detectors, emergency exit usage, and manual detection. Atoperation 504, audio alerts and/or visual alerts are output from respective audio output devices and visual output devices. Atoperation 506, an acoustic sound such as a voice, for example, is detected by one or more respective alarm modules. Atoperation 508, the location of the acoustic sound is determined. The location of the acoustic sound may be determined based on the location of the respective alarm module and/or based on a verbal statement provided by a person in proximity of the respective alarm module. Atoperation 510, the locality of the detected acoustic sound is displayed with respect to the predetermined locations of each alarm unit. Atoperation 512, the audio alert and/or the visual output from one or more alarm modules that detected a respective acoustic sound is adjusted. For example, the volume of the acoustic alert may be decreased and the color of the visual alert may be changed. Atoperation 514, a vocal alert message is output from one or more of the audio output devices that detected the respective acoustic sound, and the method ends atoperation 516. - As described in detail above, one or more embodiments provide a two-way interactive voice-sensitive emergency alert system that can dynamically adjust operation in response to detecting one or more acoustic voices during an emergency event such as, for example, a fire. The voice-sensitive emergency system therefore is capable of enhancing search/rescue of individual while reducing discomfort in the vicinity of the alarm module.
- While the invention has been described in detail in connection with only a limited number of embodiments, it should be readily understood that the invention is not limited to such disclosed embodiments. Rather, the invention can be modified to incorporate any number of variations, alterations, substitutions or equivalent arrangements not heretofore described, but which are commensurate with the spirit and scope of the invention. Additionally, while various embodiments of the invention have been described, it is to be understood that aspects of the invention may include only some of the described embodiments. Accordingly, the invention is not to be seen as limited by the foregoing description, but is only limited by the scope of the appended claims.
Claims (15)
- A sound-sensitive emergency alert system, comprising:at least one electronic alarm module disposed at a predetermined location in a building, the at least one electronic alarm module configured to perform at least one of:output at least one alert;detect at least one acoustic sound;adjust the output of the at least one alert based on the detected at least one acoustic sound; andtransmit information about the detected at least one acoustic sound to components in communication with the emergency alert system.
- The sound-sensitive emergency alert system of claim 1, wherein the system comprises:an electronic control unit remotely located from the at least one electronic alarm module, the electronic control unit configured to receive at least one acoustic signal from the at least one electronic alarm module corresponding to the at least one acoustic sound detected by the at least one electronic alarm module, and to determine a location of the at least one acoustic sound based on the at least one acoustic signal and the predetermined location of the at least one electronic alarm module.
- The sound-sensitive emergency alert system of claim 1, wherein the at least one electronic alarm module comprises:an acoustic sensor configured to detect at least one acoustic sound in the building and to output at least one acoustic signal corresponding to the at least one acoustic sound detected;an acoustic output device configured to output an audio alert; andan alert communication and control module in electrical communication with the acoustic sensor and the acoustic output device, the alert communication and control module configured to control the acoustic output device to adjust the output of the audio alert in response to the detected at least one acoustic sound.
- The sound-sensitive emergency alert system of claim 3, wherein the at least one electronic alarm module is configured to detect at least one emergency event, and wherein adjusting the output of the audio alert includes outputting the audio alert at a first decibel level when the sound-sensitive emergency alert system detects the at least one emergency event, and outputting the audio alert at a second decibel level less than the first decibel level in response to the acoustic sensor detecting at least one acoustic sound.
- The sound-sensitive emergency alert system of claim 3, wherein the at least one electronic alarm module further comprises:a sound recognition module in electrical communication with the acoustic sensor, the sound recognition module configured to convert the at least one acoustic sound detected by the acoustic sensor into an electronic voice signal; anda communication module in electrical communication with the sound recognition module, the communication module configured to electrically communicate the electronic voice signal to the electronic control unit for further processing, storage or transmission.
- The sound-sensitive emergency alert system of claim 5, wherein the sound recognition module recognizes the electronic voice signal as human speech based on at least one sound recognition algorithm, and outputs a vocal alert message based on the recognized human speech.
- The sound-sensitive emergency alert system of claim 6, wherein the sound recognition module stores a plurality of vocal alert messages and selects a particular vocal alert message among the plurality of vocal alert messages based on at least one of the detected acoustic sound, the recognized human speech, and an input received from the electronic alarm module.
- The sound-sensitive emergency alert system of claim7, wherein the plurality of vocal alert messages includes at least one of a vocal inquiry, a vocal answer, and a vocal recommended course of action based on at least one of the detected acoustic sound, the recognized human speech, and the input received from the electronic alarm module.
- The sound-sensitive emergency alert system of claim 3, wherein the sound-sensitive emergency alert system is configured to detect an emergency event, and wherein the alert communication and control module further comprises:a visual output device configured to output light having at least one of a selected frequency and a selected wavelength,wherein the alert communications and control module controls the visual output device to output the light at a first selected wavelength and frequency when the sound-sensitive emergency alert system detects an emergency event, and at a second selected wavelength or frequency different from the first wavelength or frequency in response to the acoustic sensor detecting the acoustic sound to indicate the location of at least one individual.
- The sound-sensitive emergency alert system of claim 2, further comprising a graphical user interface (GUI) in electrical communication with the electronic control unit, the GUI configured to display the predetermined locations of each alarm module and the locality of each detected acoustic sound with respect to the predetermined locations.
- The sound-sensitive emergency alert system of claim 5, wherein the sound recognition module is configured to detect predefined sounds, the predefined sound including at least one of yelling, hand clapping rhythmic knocking on furniture, footsteps, and dog barking.
- The sound-sensitive emergency alert system of any of claims 4-11, wherein the emergency event includes the presence of at least one of smoke, heat and carbon monoxide.
- A method of alerting an emergency event, comprising:outputting at least one alert in response to detecting an emergency event;detecting at least one acoustic sound following detection of the emergency event and detecting a location of the at least one acoustic sound;adjusting the output of the at least one alert in response to detecting the at least one detected acoustic sound; andtransmitting information indicating the location of the at least one acoustic sound to an electronic control module remotely located from the location of the at least one acoustic sound.
- The method of claim 13, wherein the outputted alert is an audio alert, and wherein the audio alert is adjusted in response to detecting the at least one acoustic sound.
- The method of claim 13, further comprising recognizing the at least one acoustic sound as an acoustic voice and outputting a vocal alert message in response to recognizing the acoustic voice, wherein outputting the vocal alert message includes selecting a particular vocal alert message from among a plurality of stored vocal alert messages based on the recognized acoustic voice.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP14382309.4A EP2983148B1 (en) | 2014-08-06 | 2014-08-06 | Voice-sensitive emergency alert system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP14382309.4A EP2983148B1 (en) | 2014-08-06 | 2014-08-06 | Voice-sensitive emergency alert system |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2983148A1 true EP2983148A1 (en) | 2016-02-10 |
EP2983148B1 EP2983148B1 (en) | 2018-12-19 |
Family
ID=51429237
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14382309.4A Not-in-force EP2983148B1 (en) | 2014-08-06 | 2014-08-06 | Voice-sensitive emergency alert system |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP2983148B1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3401888A1 (en) * | 2017-05-12 | 2018-11-14 | Senso2me NV. | Method and system for validating an alarm situation |
LU100813B1 (en) * | 2018-06-05 | 2019-12-05 | Essence Smartcare Ltd | Identifying a location of a person |
WO2023239771A1 (en) * | 2022-06-10 | 2023-12-14 | Ademco Inc. | Method for improving responsiveness of a security system |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6263311B1 (en) * | 1999-01-11 | 2001-07-17 | Advanced Micro Devices, Inc. | Method and system for providing security using voice recognition |
US20040036579A1 (en) * | 2002-08-21 | 2004-02-26 | Megerle Clifford A. | Adaptive escape routing system |
US20070202927A1 (en) * | 2006-02-28 | 2007-08-30 | Pfleging Gerald W | Automated search and rescue call generation to mobile phones in a defined geographic disaster area |
-
2014
- 2014-08-06 EP EP14382309.4A patent/EP2983148B1/en not_active Not-in-force
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6263311B1 (en) * | 1999-01-11 | 2001-07-17 | Advanced Micro Devices, Inc. | Method and system for providing security using voice recognition |
US20040036579A1 (en) * | 2002-08-21 | 2004-02-26 | Megerle Clifford A. | Adaptive escape routing system |
US20070202927A1 (en) * | 2006-02-28 | 2007-08-30 | Pfleging Gerald W | Automated search and rescue call generation to mobile phones in a defined geographic disaster area |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3401888A1 (en) * | 2017-05-12 | 2018-11-14 | Senso2me NV. | Method and system for validating an alarm situation |
BE1025213B1 (en) * | 2017-05-12 | 2018-12-11 | Senso2Me Nv | Method and System for validating an alarm situation |
US10327643B2 (en) | 2017-05-12 | 2019-06-25 | Senso2Me Nv | Method and system for validating an alarm situation |
LU100813B1 (en) * | 2018-06-05 | 2019-12-05 | Essence Smartcare Ltd | Identifying a location of a person |
EP3588455A3 (en) * | 2018-06-05 | 2020-03-18 | Essence Smartcare Ltd | Identifying a location of a person |
US11765565B2 (en) | 2018-06-05 | 2023-09-19 | Essence Smartcare Ltd | Identifying a location of a person |
WO2023239771A1 (en) * | 2022-06-10 | 2023-12-14 | Ademco Inc. | Method for improving responsiveness of a security system |
Also Published As
Publication number | Publication date |
---|---|
EP2983148B1 (en) | 2018-12-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20210287522A1 (en) | Systems and methods for managing an emergency situation | |
CA3036826C (en) | Visually-impaired-accessible building safety system | |
US20190124207A1 (en) | Systems and methods for monitoring sound during an in-building emergency | |
EP1713044A2 (en) | Method and apparatus for providing information to a user of a security system | |
KR102086564B1 (en) | Intelligent evacuation guidance system based on internet of things | |
KR101328865B1 (en) | Wrist watch for deaf and its control method | |
EP2983148B1 (en) | Voice-sensitive emergency alert system | |
KR20170037753A (en) | Notification device for the deaf person | |
KR101102752B1 (en) | An artificial intelligence type sound apparatus for fire alarm | |
JP4910649B2 (en) | Notification device and masking device | |
KR20190107346A (en) | Bidirectional voice information exchange broadcasting system | |
AU2006273887B2 (en) | Locatable and information sound device and method | |
WO2017190803A1 (en) | Ambient sound monitoring and visualizing system for hearing impaired persons | |
JP2014086759A (en) | Voice information display device, voice information display method, and program | |
JP7162470B2 (en) | CONVERSATION SOUND LEVEL NOTIFICATION SYSTEM AND CONVERSATION SOUND LEVEL NOTIFICATION METHOD | |
KR20170000530A (en) | Alarm and display device based on fire sensing signal received wirelessly | |
US7764165B2 (en) | Locatable information sound device and method | |
KR20190096611A (en) | System of crime prevention | |
JP2014085386A (en) | Voice information display device, voice information display method and program | |
WO2019034244A1 (en) | Image display device provided with sound prioritization function | |
KR200491194Y1 (en) | Device for guiding fine dust information | |
KR101817189B1 (en) | An apparatus for generating an emergency signal through a voice signal | |
KR20150097064A (en) | Intelligent Call Service System and the Service Method thereof | |
JP2024036981A (en) | Lighting control system, alarm system and lighting control device | |
JP2023033841A (en) | Automatic fire warning facility and disaster prevention system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
17P | Request for examination filed |
Effective date: 20160810 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20180119 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20180828 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602014038134 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1079515 Country of ref document: AT Kind code of ref document: T Effective date: 20190115 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20181219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190319 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190319 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1079515 Country of ref document: AT Kind code of ref document: T Effective date: 20181219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190419 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190419 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602014038134 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
26N | No opposition filed |
Effective date: 20190920 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602014038134 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190806 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190831 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190831 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20190831 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200303 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190831 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190806 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190831 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20140806 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181219 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20220721 Year of fee payment: 9 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20230806 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230806 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230806 |