KR101598466B1 - safety assistance system for auditory disabled - Google Patents

Abstract

The present invention can effectively prevent a safety accident of a hearing impaired person by performing an emergency situation judgment twice in a safety assisting device and a smart phone and can effectively prevent a dangerous sound signal to be compared, The data amount of the dangerous acoustic signal, which is a criterion for judging whether or not the hearing impaired person is in an emergency, can be diversified and increased at the same time, so that the accuracy of the judgment on the emergency situation can be drastically improved, The present invention relates to a safety assisting system for a hearing impaired person who can prevent a safety accident of the hearing impaired person more effectively by allowing the information to be recognized in advance.

Description

[0001] The present invention relates to a safety assistance system for auditory disabilities,

The present invention relates to a safety assisting system for a hearing impaired person. More particularly, the present invention relates to a safety assisting system for a hearing impaired person. More particularly, the present invention relates to a safety assisting system for a hearing impaired person by analyzing collected sound information, The present invention relates to a safety assisting system for the hearing impaired person.

Hearing impaired people are born or acquainted with hearing problems and are unable to hear voice and sound, and are exposed to many inconveniences and risks during their daily lives due to hearing problems. For example, a hearing-impaired person can not hear basic sounds frequently occurring in everyday life such as telephone rings, doorbells, and emergency bells in the room. In addition, hearing-impaired people can enjoy sound services such as public places and public transportation, It can not hear sounds such as horns (crunches), and therefore, all dangerous situations and information must be recognized only by sight, so I am living with myriad inconveniences and risks.

In other words, the hearing-impaired person can not recognize the situation occurring out of sight because he or she can only recognize all the information through vision, and even if an unexpected situation occurs within the scope of vision, the perceived speed and accuracy It has a falling limit.

Especially, as the number of hearing-impaired people increases and the interest in the socially weak including the hearing-impaired person increases rapidly, various studies are being conducted on the safety assisting device and system for reducing the inconvenience of the hearing impaired person and increasing the convenience.

Conventional hearing aid assisted safety devices generally collect sound and analyze the frequency of the collected sound. If the analyzed frequency exceeds the predetermined threshold, it is judged as a sound representing a dangerous situation. If the collected sound is a dangerous situation When it is judged to be a sound to be represented, a method of causing a hearing-impaired person to perceive a dangerous situation by using a vibration element and a light source is widely used.

However, this conventional method has a limitation that it can not recognize a sound representing various dangerous situations below a threshold value because it judges the risk of sound depending on whether the decibel of the frequency exceeds the limit value or not.

In Korean Patent Laid-Open No. 10-2001-0111223 (entitled " Hearing Impaired Speech Recognition Device "), sound data is collected through a microphone and then amplified and boosted. Then, The sound recognition apparatus is configured to vibrate the collected sound data through the piezoelectric element without filtering the sound data. Therefore, the sound recognition apparatus can perform various voice and sound The vibration of the piezoelectric element is constantly maintained regardless of a dangerous situation and thus the desired purpose for providing convenience of living to the hearing impaired person can not be expected Lt; / RTI >

In order to overcome this problem, the hearing-impaired glove disclosed in Korean Patent No. 10-1310082 (invention: Glove for the hearing impaired), which has been patented by the present applicant, analyzes the sound received through the sound receiver, A portable terminal for comparing a sound signal included in a signal of a predetermined type and outputting a control signal when the analyzed sound signal is included in a predetermined type; The glove is configured to vibrate when the dangerous sound data, which is sound data that can be determined as dangerous, is detected, so that the sound recognition apparatus vibrates according to all the collected sounds, The problem that can not be solved can be solved.

Typically, the dangerous sound data is classified into various categories such as automobile accidents, dogs, doorbells, human screams, emergency bell, etc. Even if the same category of dangerous sound data has various frequencies and characteristics, It is practically impossible to store all the sound data which can indicate that the sound data is dangerous to the portable terminal and store it in the portable terminal because the range of the sound data is too wide.

In other words, the glove for the hearing impaired has a limitation that it can not recognize various dangerous sound data because the dangerous sound data is stored in the initial setting and stored.

In addition, the glove for the hearing impaired may include a step of collecting dangerous sound data newly generated by the manager and storing the collected dangerous sound data in the management server in order to register various dangerous sound data newly generated according to new products and equipment, It is troublesome to perform a separate upgrade for accessing and registering the dangerous sound data.

In addition, if a person with a hearing impairment is located in a place where dangerous sound data is frequently output, that is, where a person with a hearing impairment is frequently present, he / she should be aware of this fact in advance to prevent a safety accident , The glove for hearing-impaired people does not disclose any method and means for providing such a service, so that a safety accident can not be prevented in advance.

That is, 1) the emergency sound situation is determined in response to the collected sound data so that the hearing impaired person immediately recognizes the emergency situation, and 2) the dangerous sound data, which is a comparison target for judging whether or not the collected sound data is in an emergency, 3) To provide hearing-impaired people with this information in advance when a hearing-impaired person enters the place where frequent emergencies occur. This will drastically reduce safety accidents. This is an urgent need to study safety assist devices and systems for the hearing impaired.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide an audible and / The auxiliary device and the collected acoustic signal and the pre-registered dangerous sound signal, it is judged that the situation is an emergency when the similarity is over the limit value, and when the emergency situation is judged, the vibration device of the safety assisting device is vibrated through the wireless communication network The present invention is intended to provide a safety assisting system for the hearing impaired person who can effectively prevent the safety accident of the hearing impaired person by preliminarily judging the emergency situation by including the application program of the smart phone transmitting the control signal.

In addition, another problem of the present invention is to provide a method of detecting a dangerous sound signal, which is a new type of dangerous sound signal that is not registered as a dangerous sound signal among collected acoustic signals of a user who is a hearing impaired user, A new danger sound signal is registered, thereby storing various data on a dangerous sound signal, which is a criterion for judging whether or not the hearing impaired person is in an emergency, and accordingly, the hearing impaired person To provide a safety assisting system for a vehicle.

In another aspect of the present invention, a smartphone periodically transmits position information detected by a GPS module to a management server through an application, and the management server transmits a dangerous sound signal detected when a dangerous sound signal is detected, And sets a boundary cell, which is an area in which the emergency situation of the hearing impaired person frequently occurs, to enter the boundary cell set by the hearing impaired person The present invention provides a safety assisting system for a hearing impaired person who can more effectively prevent a safety accident of the hearing impaired person by transmitting entry information that the hearing impaired person has entered the boundary cell by the application.

According to another aspect of the present invention, there is provided a safety assisting system for recognizing a dangerous sound signal to a hearing impaired person upon occurrence of a dangerous sound signal, which is an acoustic signal to be recognized by a hearing impaired person, And a first control unit for detecting the frequency of the collected acoustic signal by collecting the acoustic signal and determining that the dangerous acoustic signal is generated when the detected frequency decibel is equal to or greater than a predetermined first threshold value to vibrate the vibration element A safety assisting device installed in contact with the body of the deaf; And a first sound collecting unit for collecting sound signals, and a portable terminal that is provided to a hearing impaired person and performs near-field data communication with the safety assisting apparatus, wherein the portable terminal is provided with a safety assisting application, The safety assistant application may further include a memory for storing the predetermined dangerous sound signals, a frequency detector for detecting a frequency by analyzing the collected acoustic signals inputted from the portable terminal, a frequency detector for detecting the frequency detected by the frequency detector, A determination unit for determining the collected acoustic signal as a dangerous acoustic signal when a dangerous acoustic signal having an error less than a predetermined second threshold value is detected by comparing the frequency of the stored dangerous acoustic signals with the frequencies of the stored dangerous acoustic signals, Is judged as a dangerous acoustic signal, And a second controller for controlling the portable terminal to transmit the control signal generated by the control signal generator to the safety assisting device through the portable terminal Wherein the second control unit transmits the control signal to the safety assisting device when a control signal is generated, and vibrates the vibration device when the safety assisting device receives the control signal from the portable terminal, Further comprising a management server connected to the portable terminal through a communication network to manage and control the safety assisting application, wherein the portable terminal further includes a GPS module for receiving position information from a GPS satellite, The location information is input in real time to the safety assisting application, The safety assisting application may further include a data matching unit operable when the acoustic signal collected by the determining unit is determined to be a dangerous acoustic signal to match position information received from the portable terminal and the collected acoustic signal, Transmits the matched data to the management server through the portable terminal when the data is matched by the data matching unit and transmits the position information received from the portable terminal to the management server in real time, A database unit for storing location information of each of the cells, which is a predetermined area obtained by dividing an actual ground, and a frequency of occurrence of a dangerous acoustic signal in each of the cells, a communication interface unit for performing data communication with the portable terminal, To the mobile terminal A cell detector for detecting a cell including location information of the matched data by searching for location information of each cell of the database unit, the cell detector being driven when data is received; (TH), if the frequency of occurrence of the cell is equal to or greater than the set value (TH), comparing the frequency of occurrence of the cell summed and accumulated by the frequency summation unit with a predetermined set value (TH) A boundary cell setting unit for setting the boundary cell as a border cell in which a dangerous acoustic signal is frequently generated, a movement path tracking unit for tracking the position information transmitted from the safety assist application through the communication interface unit, When the position information tracked by the boundary cell setting unit is included in the boundary cell set by the boundary cell setting unit And a third controller for generating entry information indicating that the current location is a location where the dangerous acoustic signal frequently occurs and transmitting the generated entry information to the safety assistant application, wherein the safety assistant application receives the entry information from the management server Transmits the control signal to the safety assisting device and displays the entering information on the monitor of the portable terminal.
Also, in the present invention, the management server may store a virtual map, which is a linear numeric map corresponding to the actual ground shape and divided into the cells, and stores the virtual map in the database unit, a mark symbol indicating the frequency of each cell, Further comprising a virtual map generation unit for generating a frequency virtual map by mapping a landmark representing the location information of the virtual map to the virtual map, wherein the safety auxiliary application requests the management server to access the frequency map It is preferable that a frequency virtual map generated by the virtual map generation unit is received from the management server and a frequency virtual map transmitted from the management server is displayed on the monitor of the portable terminal.

delete

delete

delete

Also, in the present invention, when the collected sound signal is not included in the dangerous sound signals but is requested by the user to be registered as a dangerous sound signal, the safety aiding application registers a new dangerous sound signal including the sound signal collected by the management server And the management server stores the dangerous sound signals in the database unit and, when receiving the dangerous sound signal registration request from the safety assisting application, adds the collected sound signals to the dangerous sound signals stored in the database unit The security assistant application updates and stores the dangerous sound signals, and the safety assistant application accesses the management server according to the initial operation or the user's request to update the dangerous sound signals stored therein.

Further, in the present invention, the safety assisting system may further include a smart doorbell installed in a room and performing near-field wireless communication with the safety assisting device, wherein the smart doorbell includes an acoustic collecting means for collecting sounds, A fourth controller for generating a control signal for oscillating the vibration element by the safety assisting device when the frequency decibel of the acoustic signal is equal to or greater than a predetermined threshold value and transmitting the generated control signal to the safety assisting device, And a display unit which is driven and outputs a light or a guidance message if it is determined that an acoustic signal is generated.

Further, in the present invention, the smart doorbell further includes a setting button for setting any one of a vibration frequency, a microphone sensitivity and a display time of the safety assisting device, and the fourth control unit sets a driving value set by the setting button To the safety assisting device.

Also, in the present invention, the portable terminal may be a smart phone, and the safety assisting device may be formed in a clock or bracelet shape.

According to the present invention having the above-described solution, the emergency situation determination can be performed twice in the applications of the safety assisting device and the smartphone, thereby effectively preventing the safety accident of the hearing impaired person.

According to the present invention, since the dangerous acoustic signal to be compared for judging the emergency situation is newly registered by the user at any time, the data amount of the dangerous acoustic signal, which is a reference object for judging whether or not the hearing impaired person is in an emergency, It is possible to dramatically increase the accuracy of the judgment on the emergency situation.

In addition, according to the present invention, when a hearing impaired person enters the boundary cell, which is an area where an emergency occurs frequently, he / she can recognize such information in advance, thereby effectively preventing a safety accident of the hearing impaired person.

1 is a block diagram illustrating a safety assisting system for a hearing impaired person according to an embodiment of the present invention.
2 is a perspective view showing the safety assisting apparatus of FIG.
Figure 3 is a side view of Figure 2;
4 is a block diagram showing the control unit of Fig.
Fig. 5 is a perspective view showing the second embodiment of Fig. 2. Fig.
Figure 6 is a block diagram illustrating the smartphone of Figure 1;
7 is a block diagram illustrating the safety assistance application of FIG.
8 is a block diagram showing the interface management unit of FIG.
FIG. 9 is an exemplary diagram illustrating a first graphical user interface controlled by the interface manager of FIG. 8. FIG.
FIG. 10 is an exemplary diagram illustrating a frequency virtual map displayed in the third graphical user interface of FIG. 8. FIG.
11 is a perspective view showing the smart doorbell of Fig.
12 is a block diagram showing the management server of FIG.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

1 is a block diagram illustrating a safety assisting system for a hearing impaired person according to an embodiment of the present invention.

The safety assisting system 1 for a hearing impaired person of FIG. 1 comprises a safety assisting device 3 mounted in contact with the body of a hearing impaired person and vibrated when an acoustic signal (hereinafter referred to as a dangerous sound signal) A smartphone 5 that is provided to the hearing impaired person and wirelessly communicates with the safety assisting device 3 and collects a sound signal and a graphic user interface installed in the smart phone 5, (Hereinafter referred to as a safety assisting application) (hereinafter referred to as a security assistant application) for detecting a dangerous sound signal by analyzing an acoustic signal collected by the smartphone 5 and connecting to a management server 7 6 and the safety assisting application 6 and processes the operation according to the request of the connected safety assisting application 6 to transmit the result of the arithmetic processing to the safety assisting application 6 A smart doorbell 9 installed in the room to display sound signal generation information through a display means provided when a dangerous sound signal is generated and to vibrate the safety assisting device 3, A data communication network 10 for providing a data movement path between the security server 5 and the management server 7 and a data communication path for providing a data movement path between the safety assisting device 3, And a short-range wireless communication network 11.

In the present invention, for the sake of convenience, the hearing-impaired person carries out communications with the safety assisting device 3 via the short-range wireless communication network 11, and the safety assisting application 6 is installed, The portable terminal is not limited to the smart phone 5 and may be a display device such as a notebook computer, a personal digital assistant (PDA) And supports various types of data communication, and various terminals equipped with a GPS module can be applied.

The local area wireless communication network 11 shown in FIG. 1 may be a known field communication (NFC), a Zigbee, a Wireless Broadband (WiBro), or the like, which can support wireless data communication between the safety assisting device 3 and the smartphone 5 (Bluetooth), which is interworked with the smartphone 5 in recent years, is preferable as the radio frequency identification (RFID), the Internet, the UWB (Ultra Wideband), the WiFi Do.

The data communication network 10 is preferably a wired or wireless network such as a local area network (LAN) and a wide area network (WAN) capable of supporting data communication between the smart phone 5 and the management server 7.

The safety assisting device 3 is detachably attached to the body of the hearing impaired person so that a dangerous acoustic signal which is an acoustic signal to be perceived by the hearing impaired person is detected or the vibration element is vibrated according to a control signal transmitted from the smart phone 5 A device for vibrating the body of a person with hearing impairment, and more particularly, a bracelet or a watch that is detachably attached to the wrist of a person with hearing impairment.

In addition, the safety assisting device 3 may include display means for displaying a warning message or the like when the dangerous acoustic signal is detected, or display means for outputting light composed of a light source, a vibration element for generating a vibration motion, And a control unit for analyzing the sound signal recorded (collected) by the sound collecting unit to determine an emergency situation.

Further, the control unit of the safety assisting device 3 detects the frequency of the acoustic signal collected by the sound collecting unit and analyzes it to analyze the decibel. If the detected frequency decibel is above the threshold value, By transmitting signals to control the vibration element to vibrate, a person with a hearing impairment can recognize a dangerous acoustic signal when a safety assisting device 3 is attached, thereby preventing a safety accident in advance.

In addition, the control unit of the safety assisting device 3 receives the control signal from the smartphone 5 according to the control of the safety assisting application 6 through the short distance communication module including the short distance communication module, It is possible to more effectively prevent a safety accident by recognizing the dangerous acoustic signals by the safety assisting application 6 as well as the safety assisting device 3 when various dangerous acoustic signals are generated.

Smart phones (5) are digital devices that are paid to the deaf or hearing-impaired.

The smart phone 5 includes a communication interface module corresponding to the system of the data communication network 10 and connects to the management server 7 through the data communication network 10 to communicate with the management server 7 And performs communication with the safety assisting device 3 connected via the local area wireless communication network 11 including the local communication interface module corresponding to the scheme of the local area wireless communication network 11. [

Also, since the smartphone 5 is supported by an interlocking program (web browser, Netscape, etc.) so that the smart phone 5 can access the management server 7 as a web server, the hearing impaired person can access the management server 7 through the interlocking program.

The smartphone 5 is also provided with a safety assisting application 6. At this time, the smartphone 5 accesses the management server 7 under the control of the safety assisting application 6 and requests information from the management server 7 or receives data corresponding to the request information.

The smartphone 5 also includes a GPS module that receives GPS position information from GPS satellites in real time, and acoustic collection means that collects acoustic signals. The smartphone 5 includes position information detected by the GPS module and sound collected by the sound collector Signal to the safety assisting application 6 periodically.

The safety assisting application 6 is installed in the smart phone 5 and is an application program for accessing the management server 7 through the smart phone 5 and performing data communication with the management server 7. [

In addition, the safety assisting application 6 stores graphical user interfaces of various graphics and applications manufactured and displays corresponding graphic user interfaces on the monitor of the smart phone 5 according to a result of a user's request and operation processing.

In addition, the safety assisting application 6 stores a dangerous sound signal, which is a sound signal to be perceived by the hearing impaired person, in advance, and when the sound signal collected by the sound collecting unit is input by the smartphone 5, Is compared with a preset dangerous sound signal, and if the similarity is equal to or greater than the threshold value, the sound signal is determined as a dangerous sound signal.

In addition, the safety assisting application 6 accesses the management server 7 at the request of the user at the time of initial operation to request the data updating of the dangerous sound signal, and transmits the dangerous sound signal stored in the safety assisting application 6 to the management server 7, The control unit 7 receives the dangerous sound signal newly added from the management server 7 and updates the data.

In addition, the safety assisting application 6 generates a control signal for vibrating the vibration element of the safety assisting device 3 when the acoustic signal collected by the smartphone < RTI ID = 0.0 > To the safety assisting device (3) connected to the local area wireless communication network (11). At this time, when the safety assisting device 3 receives the control signal from the smartphone 5, it vibrates the vibration element as described above.

In addition, when the collected sound signal is not registered as a dangerous sound signal but is received from a user to be registered as a new dangerous sound signal, which is a new dangerous sound signal to be perceived by the hearing-impaired person, To the management server 7, a new signal registration including the acoustic signal collected through the signal processing unit 7. At this time, when the management server 7 receives a new signal registration request from the safety assisting application 6, the management server 7 adds the sound signal included therein to the previously registered dangerous sound signals and stores the added signals.

If it is determined that the collected sound signal is a dangerous sound signal, the safety assisting application 6 matches the position information and the sound signal determined to be a dangerous sound signal, and then transmits the matched data to the management server 7 through the smart phone 5. [ Lt; / RTI > At this time, if the dangerous sound signal having the matched position information is received, the management server 7 searches for which cell among the cells having the predetermined positional region the position information is included, adds '1' to the frequency information of the corresponding cell do.

The safety assisting application 6 periodically transmits position information inputted from the smart phone 5 to the management server 7 and receives a signal indicating that the frequency of occurrence of the dangerous sound signal among the cells having the hearing impaired person Upon receipt of the entry information indicating that the mobile terminal has entered the boundary cell, which is an area exceeding the limit value, the contents are displayed on the display means of the smartphone 5 and the control signal is transmitted to the safety assisting device 3, It is possible to recognize in advance that the position has entered the boundary cell, which is an area where the dangerous acoustic signal frequently occurs.

The management server 7 is a web server that manages and controls the safety assisting applications 6 and transmits and receives data to and from the smartphones 5 in which the safety assisting applications 6 are installed via the data communication network 10. [

In addition, the management server 7 stores a predetermined dangerous sound signal, and when receiving the data update request from the connected safety assistant application 6, the dangerous sound signal stored in the safety assisting application 6 is different from the stored dangerous sound signal The dangerous sound signal of the safety assisting application 6 is updated by transmitting the updated dangerous sound signal data to the smartphone 5 of the corresponding safety assisting application 6. [

The management server 7 also stores a virtual map, which is a linear digital map divided into a predetermined area (hereinafter, referred to as a cell) corresponding to the actual ground surface shape, When the signal and position information are input, the location areas of the virtual map are searched to read the cell corresponding to the position information, '1' is added to the current frequency of the read cell, and the location area and the current frequency are matched and stored. In this case, the frequency is defined as a cumulative total number in which a dangerous acoustic signal is generated in a corresponding cell during a predetermined period.

Also, the management server 7 periodically compares the frequency per cell with a preset threshold value (TH), and if the current frequency is equal to or greater than the set value TH, Cell.

In addition, when the location information is received from the safety assisting application 6 in real time, the management server 7 transmits entry information indicating that the hearing impaired person enters the boundary cell when the received location information enters the set boundary cell, To the application (6).

In addition, the management server 7 maps and stores a number indicating the frequency of the corresponding location area in the virtual map divided into cells, and when the virtual map is requested from the safety assisting application 6, Referred to as a frequency map) to the safety assisting application 6. At this time, the safety assisting application 6 displays the frequency virtual map transmitted from the management server 7 on the monitor of the smart phone 5 so that the hearing impaired person recognizes the occurrence frequency of the emergency situation in the area included in the path .

The smart doorbell 9 is installed in a fixture such as a wall of a room such as a house or a building, and has a short-range communication module to perform data communication with the safety assisting device 3. [

The smart doorbell 9 includes acoustic collection means such as a microphone for collecting acoustic signals, decibel detection means for detecting the frequency decibel of the acoustic signal collected by the acoustic collection means, And a display means. When the frequency decibel detected by the decibel detecting means is above the threshold value, it is determined that a dangerous acoustic signal is generated, and the control signal is transmitted to the safety assisting device 3 located in the room Information indicating that a dangerous acoustic signal has been detected is displayed through the lighting means and the display means. At this time, when the safety assisting device 3 receives the control signal from the smart doorbell 9, the vibration device vibrates, so that the hearing impaired person can immediately react to the sounds of the doorbell, emergency bell and telephone in the room.

Since the safety assisting device 3 is in contact with the body of the hearing impaired person, it is preferable that the safety assisting device 3 is made small in order to reduce the inconvenience of the hearing impaired person. Accordingly, the number of vibration of the vibration means of the small safety assisting device 3, , Display time, and the like.

In order to solve this problem, in the present invention, the smart doorbell 9 has input buttons for setting driving values such as vibration frequency, microphone sensitivity, display time, etc. of the safety assisting device 3, The driving value of the safety assisting device 3 can be easily set. At this time, when the driving value is set, the smart doorbell 9 transmits driving value data set through short-range wireless communication to the safety assisting device 3, and the safety assisting device 3 transmits driving value data As shown in FIG. For example, if the hearing-impaired person is located in a sleeping or noisy environment, the microphone sensitivity of the safety assisting device 3 should be reduced in order not to be disturbed by the vibration, Since it is very inconvenient to control the microphone sensitivity by hand, the hearing impaired set the driving value of the microphone sensitivity through the smart doorbell (9), and the smart doorbell (9) It is possible to easily set the driving value of the safety assisting device 3 by transmitting it to the device 3.

2 is a perspective view of the safety assisting apparatus of FIG. 1, FIG. 3 is a side view of FIG. 2, FIG. 4 is a block diagram showing the control unit of FIG. 2, and FIG. 5 is a perspective view of the second embodiment of FIG. 2 .

The safety assisting apparatus 3 of FIGS. 2 and 3 includes a body 31 on which a display unit 311 is formed on one side and a control unit 313 and a power supply unit (not shown) A sound collecting unit 32 installed on one side of the body 31 for collecting sound signals and a speaker 31 installed on the other side of the body 31 opposite to the display unit 311 and vibrating And vibration members 39 and connection portions 33 and 35 which are formed at opposite ends of the body 31 and are joined to each other by coupling means of a concavo-convex type.

In the present invention, the safety assisting device 3 is formed as a bracelet or a watch that is detachably attached to the wrist of the hearing impaired person. However, the shape of the safety assisting device 3 is not limited thereto, And can be configured in various shapes that can be contacted with and detached from the body.

2 and 3, the body 31 is formed in a circular shape. However, the shape of the body 31 is not limited to a circular shape, and a polygonal shape may be applied.

The body 31 is formed in a disk shape having a space therein, and a display unit 311 is provided on one surface. At this time, when a dangerous sound signal such as a doorbell, an emergency bell, a telephone, and a baby crying sound is generated, the display unit 311 outputs a predetermined warning message or illumination according to the control of the control unit.

In addition, the body 31 is provided therein with a power supply unit such as a battery and a control unit.

As shown in FIG. 4, the controller 313 receives the sound signal collected from the sound collector 32 and analyzes the received sound signal to determine whether a dangerous sound signal is generated.

The control unit 313 includes a memory 331 storing a threshold value which is a minimum frequency decibel that the frequency decibel of the acoustic signal collected by the sound collecting unit 32 can be determined to be a dangerous acoustic signal, A short range communication interface 333 for performing data communication with the smart doorbell 9, a decibel detector 335 for detecting a frequency decibel by analyzing the frequency of the acoustic signal input from the sound collector 32, A comparing unit 336 comparing the frequency decibel detected by the decibel detecting unit 335 with a threshold value stored in the memory 331 to compare whether the frequency decibel is equal to or greater than a threshold value, A determination unit 337 for determining that a dangerous sound signal has occurred when the threshold value is greater than or equal to the threshold value; and a determination unit 337 for determining whether a dangerous sound signal is generated by the determination unit 337, A vibrator driving unit 339 for vibrating the vibrating element when the control signal is received from the phone 5, a determination unit 337 for determining whether a dangerous sound signal is generated by the determination unit 337, And a display unit 340 for displaying predetermined characters and lights through the display unit 311 when a control signal is received from the phone 5. [ At this time, the decibel detector 335 includes an A / D converter, a D / A converter, an amplifier, and a step-up transformer as well known in the art for detecting the frequency of the acoustic signal.

The vibration elements 39 are installed on the other side of the body 31 and contact the deaf person's wrist when they are attached to the hearing impaired person.

The vibration elements 39 generate vibratory motion under the control of the vibration element driving unit 339 of the control unit 313 to transmit a vibration movement to the body of the hearing impaired person when a dangerous sound signal is generated so that the hearing impaired person can instantaneously Let's recognize.

Figure 6 is a block diagram illustrating the smartphone of Figure 1;

The Smart Phone 5 performs data communication with the management server 7 through the data communication network 10 under the control of the safety assisting application 6 and performs data communication with the security server 6 connected to the local wireless communication network 11, Is a digital device for transmitting a control signal to the device (3).

In addition, the smart phone 5 combines the advantages of a cellular phone and a personal digital assistant (PDA), integrating data communication functions such as schedule management, GPS function, facsimile transmission and Internet access, Unlike a conventional mobile phone which uses only a given function, it has the advantage of installing, adding or deleting hundreds of various applications (application programs) as desired by the user.

As shown in FIG. 6, the smartphone 5 according to the present invention includes an input / output display unit 51 for displaying characters and symbols for a visually impaired person, A short range communication interface unit 53 for supporting the connection of the local area wireless communication network 11, an input unit 54 for inputting characters, symbols and voice, A control unit 55 that takes charge of an OS (Operating System) of a smartphone and controls an object to be controlled, a GPS unit 56 that detects position information by a signal received from a GPS satellite, Unit 57 and an application management unit 58 in which the safety assisting application 6 is installed.

6, the smartphone 5 includes an input / output display section 51, a communication interface section 52, a short range communication interface section 53, an input section 54, a control section 55, a GPS section 56 , The sound collecting unit 57 and the application managing unit 58. However, the configuration of the smart phone 5 is not limited to this, and it may be possible to include various configurations as is well known in the art. Do.

7 is a block diagram illustrating the safety assistance application of FIG.

7 is an application program installed in the smartphone 5, which determines whether or not a vibration element of the safety assisting device 3 is driven according to an acoustic signal collected by collecting acoustic signals, The management server 7 is connected to the smartphone 5 to request information from the management server 7 or display the data received from the management server 7 on the monitor of the smartphone 5.

In addition, the safety assisting application 6 includes a database unit 62 for storing data, an interface managing unit 63 for displaying the created graphic user interfaces on a monitor of the smart phone 5 according to a predetermined procedure, A frequency detector 65 for detecting a frequency by analyzing the acoustic signal input through the input unit 64 and a frequency detector 65 for storing the GPS position information and the acoustic signal stored in the database 62, A determination unit (66) for searching for a dangerous sound signal, reading a dangerous sound signal whose error with the frequency detected by the frequency detection unit (65) is less than a threshold value and determining that a dangerous sound signal is generated when the dangerous sound signal is read, A control signal generator 67 for generating a control signal for oscillating the vibration element of the safety assisting device 3 when it is determined that a dangerous acoustic signal is generated by the unit 66, A data matching unit 68 for matching the GPS position information periodically input through the input unit 64 with a dangerous sound signal when it is determined that the dangerous sound signal is generated by the determination unit 66, And a control unit 61 for managing and controlling the operation units 63, 64, 65, 66, 67,

The control unit 61 is an operating system of the safety assisting application 6 and manages the control objects 62, 63, 64, 65, 66, 67, And controls.

The controller 61 receives the sound signal through the input unit 64 and inputs the received sound signal to the frequency detector 65. When the controller 61 periodically receives the GPS position information through the input unit 64, To the management server 7 via the communication interface 52 of the mobile communication terminal 10 and transmits the GPS position information in real time.

When the control signal is generated by the control signal generator 67, the control unit 61 controls the short-range communication interface unit 53 of the smart phone 5 to generate a control signal, To be transmitted to the safety assisting device (3).

The control unit 61 controls the communication interface unit 52 of the smart phone 5 when the GPS position information and the sound signals determined as the dangerous sound signals are matched by the data matching unit 68, (7).

FIG. 8 is a block diagram illustrating the interface management unit of FIG. 7, FIG. 9 is an exemplary view illustrating a first graphical user interface controlled by the interface management unit of FIG. 8, FIG. 2 is a diagram illustrating an example of a frequency map. FIG.

The interface management unit 63 manages and controls graphic user interfaces that receive data from a user or display operation processing results and specific data.

8, the interface management unit 63 displays a first graphic user interface (GUI) for requesting a management server 7 to update a dangerous sound signal on the monitor of the smartphone 5 at the first execution, A second graphical user interface 632 displayed on the monitor of the smartphone 5 after the first graphical user interface 631 and a second graphical user interface 630 displayed on the monitor of the smartphone 5, A third graphical user interface 633 and a fourth graphical user interface 634 displayed on the monitor of the smartphone 5 when a dangerous sound signal is generated by the determination unit 66, . In the present invention, for the sake of convenience of description, the graphical user interface has been described as being composed of first, second, third, and fourth graphical user interfaces 631, 632, 633, and 634 The configuration and quantity of the graphical user interface is not limited thereto, and may further include various graphical user interfaces capable of providing various services to the hearing-impaired person.

As shown in FIG. 9, the first graphic user interface 631 exposes an input button or icon 641 for inputting whether to update the pre-registered dangerous sound signal data. At this time, when the input icon 641 is clicked by the hearing impaired person, the interface managing unit 63 requests the management server 7 to update the data of the dangerous sound signal through the communication interface unit 52 of the smart phone 5, The server 7 compares the presently registered dangerous sound signal with the dangerous sound signal stored in the safety assisting application 6 to receive the dangerous sound signal information of the safety assisting application 6 Update.

The second graphical user interface 632 exposes an input button and an icon for inputting the frequency virtual map view from the hearing impaired person. At this time, the second graphical user interface 632 requests the frequency virtual map to the management server 7 through the smart phone 5 when the user inputs the frequency map virtual map view input button.

Also, the second graphical user interface 632 exposes an input button and an icon for registering the acoustic signal currently collected from the deaf person as a new dangerous sound signal. At this time, the second graphic user interface transmits the corresponding sound signal to the management server 7 when the new registration input button is clicked by the user. When the management server 7 receives a request for new registration including the sound signal, The sound signal transmitted to the sound signal is added and stored.

In other words, if the auditory handicap device 3 does not experience any vibration but the emergency situation occurs, it is determined that the collected acoustic signal is not registered as a dangerous acoustic signal, and the second graphic user interface 632 transmits the corresponding acoustic signal Is registered as a dangerous sound signal, the data amount of the dangerous sound signal to be compared with the dangerous sound signal can be judged. Therefore, even if the manager does not detect and store the dangerous sound signal separately, The signal can be registered.

The third graphical user interface 633 is a user interface for displaying the frequency virtual map 500 received when the frequency virtual map is received from the management server 7 through the communication interface unit 52 of the smartphone 5. At this time, the frequency map virtual map 500 corresponds to the actual ground shape as shown in FIG. 10, and is separated into predetermined cells 501. At the same time, a mark symbol 503 indicating the frequency of occurrence of a dangerous acoustic signal in each cell, Is defined as a virtual map to which a landmark symbol 505 indicating the current position of the landmark 505 is mapped.

That is, the hearing-impaired person can recognize in advance the dangerous sound signal generation status at the peripheral position around his / her position through the frequency virtual map 500 displayed through the third graphical user interface 633.

The fourth graphical user interface 634 is a user interface for displaying the generated guidance message when it is determined that the dangerous sound signal is generated by the determination unit 66. [

11 is a perspective view showing the smart doorbell of Fig.

The smart doorbell 9 of FIG. 11 is installed on the wall of a room such as a house or a building, and the smart doorbell 9 is provided with a short distance communication module to support data communication with the safety assisting device 3.

The smart doorbell 9 also includes an acoustic collecting means 91 such as a microphone for collecting acoustic signals, and a frequency acquiring means 91 for detecting the frequency decibel of the acoustic signal collected by the acoustic collecting means 91. When the detected frequency decibel is above the threshold A control unit (not shown) for determining that a dangerous situation signal has occurred and transmitting a control signal to the safety assisting device 3 located in the room, a display unit 93 for turning on and off the light by the light source, And input buttons 97 for setting driving values such as the vibration frequency of the safety assisting device 3, the microphone sensitivity, the display time, and the like.

The input buttons 97 are buttons for setting driving values such as the vibration frequency of the safety assisting device 3, the microphone sensitivity, and the display time. At this time, if the drive value is set by the input button 97, the drive value data set through short-range wireless communication is transmitted to the safety assisting device 3, and in addition, the safety assisting device 3, Lt; / RTI >

12 is a block diagram showing the management server of FIG.

The management server 7 of Fig. 12 includes a database 72 for storing data, a communication interface 73 for supporting data communication with the smartphones 3, The movement path of the hearing impaired person is analyzed by the movement path tracking unit 74, the current position of the hearing impaired person tracked by the movement path tracking unit 74, and the cell position of the currently registered frequency map An entry information generating unit 75 for generating entry information indicating that the hearing impaired person has entered the boundary cell when the current location is set to the boundary cell among the cells of the frequency map, A cell detector 76 for analyzing matching data matched with the location information and the dangerous acoustic signal received from the cell map and detecting which cell of the virtual map has the corresponding location region, A frequency adder 77 for adding '1' to the frequency of dangerous acoustic signals of the cell detected by the detector 76, and a frequency adder 77 for adding frequency summation to the virtual map, which is a linear numeric map corresponding to the actual ground shape, A virtual map generator 78 for generating a frequency virtual map by mapping a landmark indicating a frequency detected by the detecting unit 77 and a landmark indicating a current position of the smartphone and a frequency map corresponding to each of the cells periodically A boundary cell setting unit 79 for setting the cell as a boundary cell when the frequency is equal to or greater than the set value TH as compared with the predetermined set value TH; (72), (73), (74), (75), and (75) for renewing a dangerous sound signal by adding a requested new danger sound signal to the currently stored dangerous sound signal, ), (76), (77), (78), And a control unit 71 for controlling and managing the control units 79 and 80.

At this time, the database unit 72 stores location information of each cell, which is a predetermined area obtained by dividing the actual ground, dangerous acoustic signal occurrence frequency of each of the cells, dangerous acoustic signals, virtual map, and frequency map.

The control unit 71 periodically crawls the communication interface unit 73 to collect data transmitted from the safety assisting device 3. [

When the control unit 71 receives the position information from the connected safety assistant application 6, the control unit 71 inputs the position information to the movement path tracking unit 74.

When the entry information is generated by the entry information generating unit 75, the control unit 71 controls the communication interface unit 73 to transmit the entry information generated by the corresponding safety assistance application 6.

The control unit 71 also receives the matched data of the location information and the hazardous sound signal from the safety assisting application 6, and inputs the matched data to the cell detector 76.

The control unit 71 receives the new danger sound signal registration request from the safety assisting application 6 and inputs the data to the new danger sound signal generating unit 80. The new danger sound signal generating unit 80 generates a dangerous sound signal And stores the updated dangerous sound signal in the database unit 72 when the signal is updated.

The control unit 71 sends a frequency virtual map that maps the position information of the deaf person to the frequency map stored in the database unit 72 to the safety assistant application 6, Lt; / RTI >

1: Safety assist system for the hearing impaired 3: Safety assist system
5: Smartphone 6: Safety assistant application 7: Management server
9: Smart doorbell 10: Data communication network 11: Short range wireless communication network
31: body 32: sound collector 33, 35:
39: Vibration element

Claims (8)

A safety assisting system for recognizing a dangerous sound signal to a hearing impaired person when a dangerous sound signal, which is an acoustic signal to be recognized by a hearing impaired person, is generated, comprising:
And a controller for detecting a frequency decibel of the collected acoustic signal by collecting the acoustic signal and determining that the dangerous acoustic signal is generated when the detected frequency decibel is equal to or greater than a predetermined first threshold value, A safety assisting device including a first control part for vibrating and being placed in contact with the body of the hearing impaired person;
And a portable terminal which is provided to a hearing-impaired person and performs near-field data communication with the safety-assisting device, the portable terminal including a first sound collector for collecting a sound signal,
The portable terminal is provided with a safety assisting application as an application program. The safety assisting application includes a memory for storing the predetermined dangerous sound signals, a frequency detector for analyzing the collected acoustic signals inputted from the portable terminal, And comparing the frequency detected by the frequency detector with the frequencies of the dangerous sound signals stored in the memory to detect a dangerous sound signal having an error less than a predetermined second threshold value as the dangerous sound signal A control signal generator for generating a control signal for vibrating the vibration element driven when the acoustic signal collected by the determination unit is determined to be a dangerous acoustic signal; The control signal generated by the control signal generation unit through the terminal And a second control unit for transmitting a signal to the safety assisting device,
Wherein the second control unit transmits the control signal to the safety assisting device when a control signal is generated, and when the safety assisting device receives the control signal from the portable terminal,
Wherein the safety assisting system further comprises a management server connected to the portable terminal through a communication network to manage and control the safety assisting application,
The portable terminal further includes a GPS module that receives position information from a GPS satellite, inputs the position information detected by the GPS module to the safety assistant application in real time,
Wherein the safety assistant application further comprises a data matching unit for matching position information received from the portable terminal and the collected acoustic signal when the acoustic signal collected by the determining unit is determined to be a dangerous acoustic signal, When the data is matched by the data matching unit, the controller transmits the matched data to the management server through the portable terminal, and transmits the position information received from the portable terminal to the management server in real time,
Wherein the management server comprises: a database unit for storing position information of each of cells, which is a predetermined area obtained by dividing an actual ground, and a frequency of occurrence of a dangerous acoustic signal in each of the cells; a communication interface unit for performing data communication with the portable terminal; A cell detector which is driven when receiving the matched data from the portable terminal through the communication interface unit and detects a cell including positional information of the matched data by searching for position information of each cell of the database unit; A frequency adder for adding '1' to the frequency of occurrence of cells detected by the detector, and a frequency adder for comparing the frequency of occurrence of cells accumulated and accumulated by the frequency adder with a predetermined set value (TH) If the frequency is greater than or equal to the preset value (TH), the corresponding cell is a region where a dangerous acoustic signal frequently occurs A movement path tracking unit for tracking position information received from the safety assistant application through the communication interface unit; and a position information tracking unit for tracking position information tracked by the movement path tracking unit, And a third controller for generating entrance information indicating that the current location is a location where a dangerous sound signal frequently occurs, and transmitting the generated entry information to the safety assistant application when the safety assistant application is included in the border cell set by the security assistant application,
Wherein the safety assisting application transmits a control signal to the safety assisting device upon receiving the entry information from the management server, and displays the entering information on the monitor of the portable terminal. delete delete [Claim 4] The method according to claim 1, wherein the management server comprises: a virtual map, which is a linear numeric map corresponding to the actual ground shape and divided into the cells,
Further comprising a virtual map generation unit for generating a frequency virtual map by mapping a mark symbol representing the frequency of each of the cells and a mark symbol representing position information of the portable terminal to the virtual map,
The security assistant application receives a frequency map generated by the virtual map generator from the management server when requesting the management server to view the frequency map in response to a user's request, And displays the map on the monitor of the portable terminal. The security assistant application as claimed in claim 4, wherein when the collected acoustic signal is not included in the dangerous sound signals but is requested by a user to register as a dangerous sound signal, Request signal registration,
Wherein the management server stores the dangerous sound signals in a database unit and adds the collected sound signals to the dangerous sound signals stored in the database unit when the dangerous sound signals are requested from the safety assistant application, Lt; RTI ID = 0.0 >
Wherein the safety assistant application is connected to the management server according to a first drive or a user's request to update the dangerous sound signals stored therein. The system of claim 1, 4, or 5, wherein the safety assisting system further comprises a smart doorbell installed in a room for performing short-range wireless communication with the safety assisting device,
The Smart Buzzer
And a control unit for determining that a dangerous sound signal has occurred when the frequency decibel of the sound signal collected by the sound collection unit is equal to or greater than a predetermined threshold value, And a display unit that is driven when the dangerous sound signal is generated by the fourth control unit and outputs a light or displays a guidance message. The method of claim 6, wherein the smart beacon
And a setting button for setting any one of a vibration frequency, a microphone sensitivity and a display time of the safety assisting device, wherein the fourth control section transmits the driving value set by the setting button to the safety assisting device Features a safety assist system. The safety assisting system according to claim 7, wherein the portable terminal is a smart phone, and the safety assisting device is formed in a clock or bracelet shape.

Images