KR20080004756A - The apparatus recognition to operate a every conditions - Google Patents

Abstract

A situation recognition apparatus for the deaf and persons who are hard of hearing is provided to enable the deaf to recognize the sound by vibration, words, or sign language and to be compatible with the internal devices of a vehicle at low cost. In a situation recognition apparatus for the deaf and persons who are hard of hearing, plural sound sensor units(10) are installed at the front and rear sides and the left and right sides of a vehicle to let the driver recognize the warning sound of a crossing gate, siren sound of the ambulance, and collision and sudden brake sound. A microcomputer(20) receives a sound signal transmitted to the sound sensor unit and controls a light emitting unit(30), a word and sign language display unit(40), and a vibration unit(50) in order to transmit both a display signal and a vibration signal to the driver at the same time according to each position of the vehicle. The light emitting unit has a detachable light emitting acryl rim installed along the front rim and periphery of an audio system, a navigation, a GPS(Global Positioning System), and a liquid crystal monitor television of a vehicle, and emits the light at the intervals of 0.5~3 seconds by the controls of the microcomputer. The word and sign language display unit converts the warning sound of a crossing gate, siren sound of the ambulance, and collision and sudden brake sound into words or sign language and then displays the words or sign language on the navigation, the GPS, and the liquid crystal monitor television. The vibration unit generates vibration by the controls of the microcomputer by installing vibrating elements at the front and rear sides and the left and right sides of a driver's seat.

Description

Contextual Recognition Device for Deaf and Hard of Hearing Persons {THE APPARATUS RECOGNITION TO OPERATE A EVERY CONDITIONS}

1 is an overall configuration diagram showing the components of the contextual recognition device for deaf and hard of hearing according to the present invention;

Figure 2 is a block diagram showing the components of the character and sign display unit of the components of the contextual recognition device for hearing impaired and hearing impaired according to the present invention,

Figure 3 is an embodiment showing the installation position of the acoustic sensor unit installed on the front, rear, left and right sides of the vehicle among the components of the situational recognition apparatus for the hearing impaired and hearing impaired according to the present invention,

Figure 4 is a perspective view showing the components of the light-emitting acrylic frame of the components of the contextual recognition device for deaf and hard of hearing according to the present invention,

FIG. 5 is a perspective view illustrating a PCB substrate inserted into a light emitting acryl frame of a situational recognition apparatus for hearing impaired and hearing impaired persons according to the present invention; FIG.

6 is a view illustrating a process in which a light emitting acrylte is inserted along a periphery of an end of a display device (vehicle audio, navigation, GPS, liquid crystal monitor TV) inside a vehicle among components of a contextual recognition device for the hearing impaired and the hearing impaired according to the present invention In the illustrated embodiment,

FIG. 7 is a view illustrating a process in which a light emitting acrylte is coupled along an end circumference of a display device (vehicle audio, navigation, GPS, liquid crystal monitor TV) in a vehicle among components of a contextual recognition device for deaf and hard of hearing persons according to the present invention. In the illustrated embodiment,

FIG. 8 is a view illustrating a process in which a light emitting acrylte is inserted along a periphery of an end of a display device (vehicle audio, navigation, GPS, liquid crystal monitor TV) in a vehicle, and text and sign language are displayed. ,

9 is a view illustrating an operation state of a light emitting acryl frame and a character / sign language display unit of a situational recognition device for deaf and hard of hearing persons according to the present invention;

10 is an embodiment showing a vibration unit of the components of the contextual recognition device for deaf and hard of hearing according to the present invention.

※ Brief description of drawing code ※

10: sound sensor unit 20: microcomputer

30: light emitting part 40: character and sign display unit

50: vibrating part

According to the present invention, a driver with a hearing impairment and a hearing loss is compatible with an internal device of an alarm sound of a railroad crossing breaker or an emergency vehicle (for example, an emergency vehicle, a fire engine, a police car, a reck car), a siren sound, a crash and a sudden brake sound while driving. The present invention relates to a situational recognition device for deaf and hard of hearing persons, which enables the driver to recognize the eyes and the body simultaneously.

At present, there are about 10-20% of the total population (about 7.5 million) of the deaf and hard of hearing in Korea (including the elderly). Among them, there are about 1 to 2.5 million drivers with hearing impairment and hearing loss.

The deaf or hard of hearing driver operates by attaching deaf marks and deaf persons on the rear of the vehicle during normal driving and highway driving.

In general, the rear vehicle sends a signal by flashing an emergency light instead of the clock when the driver's vehicle with hearing impairment and hearing loss is too slow to pass, and the deaf and hard of hearing driver recognizes it through a rearview mirror and takes a seat. Will yield.

However, it is difficult for the deaf and hard of hearing driver to recognize alarm sounds of railroad crossing breakers, sirens, collisions and sudden brake sounds of emergency vehicles (e.g., emergency vehicles, fire trucks, police cars and wreckers) with the driver's own eyes. have.

In order to solve this problem, in Korean Patent Registration No. 558854, a left microphone and a right microphone are installed on the left and right sides of the driver to receive sound sources in both directions; Filters the input sound source signal components by using a band pass filter to extract the sound source signal into the region containing the center frequency of the horn, so that the horn signal having a level higher than or equal to the threshold set among the input sound source signals is included. Determining; Calculating a power ratio of the left sound source signal / right sound source signal when the sound signal is included in the input sound source signal, and determining from which direction the sound signal is input from the driver; In order to stimulate the back of the driver with hearing impairment, a vibrator is installed in the driver's seat backrest divided into left, right, and center, and when the calculated power ratio of the left sound source signal / right sound source signal is greater than 1, the left vibrator is operated. When the value is less than 1 operates the right vibrator, if the value is 1 to operate the central vibrator to notify the driver; horn recognition method for a driver with hearing impairment has been presented,

It transmits the sound signal of the vehicle to the driver who is deaf and hard of hearing through the left, right, and center of the vibrating device on the driver's seat back. Vibration continues to ring behind the driver due to the squeaking from the driver's back, which causes the driver's nerves to be slowed down, causing confusion in which direction the clinic sounds.

The present invention has been made to solve the problems described above, the deaf and hard of hearing driver while driving while the alarm of the railroad crossing breaker, emergency vehicles (eg emergency vehicles, fire trucks, police cars, lekka) sirens, It can recognize collision and sudden brake sound by eyes and body through lighting and vibration, and text and sign language, and it is compatible with existing in-vehicle devices at low cost, and it is safe for drivers because of its fast response speed. The purpose is to allow you to drive.

In order to achieve the above object, a situational recognition apparatus for deaf and hard of hearing persons according to the present invention,

Before and after the vehicle, the driver who is deaf or hard of hearing can recognize the alarm sound of the railroad crossing breaker, the siren, crash, and sudden brake sound of the vehicle (e.g., emergency vehicle, fire truck, police car, and wrecker) while driving. A plurality of sound sensor unit 10 is provided on one side of the left and right,

The light emitting unit 30, the character and sign display unit and the vibrating unit receive the sound signal transmitted to the acoustic sensor unit 10 and simultaneously transmit the display signal and the vibration signal to a driver who is deaf or hard of hearing for each position of the vehicle. A microcomputer 20 for controlling 40;

A detachable light emitting acryl frame 310 is installed along the front edge and perimeter of the vehicle audio, navigation, GPS, and liquid crystal monitor TV installed inside the vehicle, and is displayed at a period of 0.5 to 3 seconds through the control of the microcomputer 20. )Wow,

Characters and Sign Language that converts alarm sounds of railway crossing breakers, sirens, collisions and sudden brake sounds of vehicles (e.g., emergency vehicles, fire trucks, police cars, and wreckers) into navigation and GPS and LCD monitor TVs and displays them in text and sign language. Sign language display unit 40,

Vibration element 511 is provided on the left and right, left and right sides inside the cushion driving seat 510 is achieved by the vibration unit 50 is generated through the control of the microcomputer.

EMBODIMENT OF THE INVENTION Hereinafter, the structure of this invention is demonstrated based on attached drawing.

1 is a configuration diagram showing the components of the situational recognition apparatus for the hearing impaired and hearing impaired according to the present invention, which is an acoustic sensor unit 10, a microcomputer 20, a light emitting unit 30, characters, sign language It consists of the display part 40 and the vibration part 50. FIG.

The acoustic sensor unit 10 may detect a warning sound of a railroad crossing breaker or a siren sound of a vehicle (eg, an emergency car, a fire truck, a police car, a wrecker), a crash and a sudden brake sound while a driver who is deaf or hard of hearing is driving. It is installed on one side of the vehicle, before and after the vehicle so as to sense sound, and in the present invention, the acoustic sensor unit 10 includes a movable coil type microphone 11 and a condenser microphone 12.

The movable coil type (electromagnetic induction) microphone 11 is a type in which a coil is mounted on a light diaphragm having a diameter of 20 to 30 mm and vibrated in a magnetic field to generate an induced current in the coil. It has sufficient sensitivity up to a high range of 10Hz and above, and has solid characteristics.

The condenser microphone 12 is a microphone which applies the principle of a condenser with the plate electrode facing. The one side of the pole plate is a diaphragm, and when the plate vibrates by sound, the capacitance of the condenser changes and the charge is accumulated. The electrical current changes as a result of the change in sound. These condenser microphones have excellent frequency characteristics and have characteristics that make it easy to make stable ones. There are a method of applying a DC voltage to a cathode of a capacitor and a method of applying a high frequency of about 1 MHz.

 As shown in FIG. 3, the acoustic sensor unit 10 according to the present invention is installed at one side (10a, 10b, 10c, 10d, 10e) of the front, rear, left and right sides of the vehicle, and an alarm sound of a railroad crossing breaker, The sound of sirens, collisions and sudden brakes of vehicles (eg emergency vehicles, fire trucks, police cars, wreckers) can be detected.

The microcomputer 20 receives the sound signal transmitted to the acoustic sensor unit 10 so that the display signal and the vibration signal are simultaneously transmitted to the driver who is deaf or hard of hearing for each position of the vehicle. The sign language control unit and the vibration unit 40 are controlled, which is composed of a PIC one chip microcomputer.

The microcomputer 20 according to the present invention includes a data recorder 21, a level recorder 22, and a frequency analyzer 23 on one side.

The data recorder 21 records a sound signal transmitted from the acoustic sensor unit 10, which is composed of an EEPROM, and has a frequency characteristic within ± 7 dB in the range of 20 to 2000 Hz, a dynamic range of 60 dB or more, and an error rate of 0.6% or less. Becomes the standard.

The level recorder section 22 is connected to the data recorder section 21 to level the sound volume and transmit the level to the light emitting section, which is equivalent to the sound level according to sampling from the recording of the data recorder section 21. In the case of obtaining, the SLOW of which the time-average effect is large is used to adjust the correction signal of the vehicle sound (clock) to a predetermined level before the measurement. Through such a level recorder unit, the plurality of LEDs of the light emitting unit can be configured to be displayed in level 1-red, level 2-yellow, and level 3-blue according to the sound level.

The frequency analysis unit 23 compares and analyzes the frequency of the sound signal recorded in the data recorder unit with a reference set value to set the equivalent sound level and the alarm sound of the railroad crossing breaker or the vehicle (for example, an emergency vehicle, a fire truck, a police car, a wrecker). It analyzes external situation information such as siren sound, collision, and sudden brake sound and transmits it to the character / sign display.In order to set this reference value, the frequency of sound signal is changed according to the state of temporal change. Set by separating.

Here, in the case of the normal sound, the reference setting value is obtained by averaging the recorded value of the level recorder unit in the case of the normal sound having little level fluctuation, and in the case of the fluctuation sound, the reference setting value is obtained through the equivalent sound level.

The equivalent sound level of the fluctuating sound is expressed by Equation 1.

Here, t2-t1 means actual time.

In addition, the physical meaning of the equivalent sound level indicates the sound level of the normal noise having the same energy as the level fluctuating within the range of actual time T = t2-t1.

In the present invention, the reference setting value of the variable sound through the equivalent sound level is set at 1 level to 50 dB at 3 levels, 51 to 100 dB at 2 levels, and 101 dB or more at 1 level.

And, in the present invention, the reference set value of the alarm sound of the railroad crossing breaker is set to 30 ~ 90dB, the siren sound of the vehicle (e.g. emergency car, fire truck, police car, wrecker) is set to 110 ~ 160dB, crash and sudden brake sound Is set to 40 ~ 150dB.

The light emitting unit 30 is a detachable light emitting acryl frame is installed along the front rim and perimeter of the display device (vehicle audio, navigation, GPS, LCD monitor TV) installed inside the vehicle, 0.5 to 3 through control of the microcomputer 20. Displayed in seconds, which is the same as the position of the acoustic sensor of the vehicle that is deaf and hard of hearing, and the removable light emitting acrylic frame on the top, bottom, left and right sides of the display device (e.g., car audio, navigation, GPS, LCD monitor TV) 310 is installed.

'형상으로 길다랗게 형성된 아크릴 커버(311)가 구성된다.As shown in FIG. 4, the light emitting acryl frame 310 is inserted into a PCB substrate inserting portion formed at one side of the inside, and the light emitted through the control of the PCB substrate can be uniformly spread over the entire acrylic surface.

An acrylic cover 311 formed in a 'long shape is constructed.

Then, a PCB substrate 312 is inserted into and connected to the PCB substrate inserting portion of the acrylic cover 311 to control the light to be emitted through a plurality of light emitting diodes and resistors.

In addition, an insertion part 313 is formed at one end of the acrylic cover 311 so as to slide along the circumference of the display device so that the end portion protrudes in the shape of a tong.

In particular, as shown in FIGS. 6 and 7, the insertion part 313 is made of rubber and synthetic resin having excellent elastic force to be inserted while being elastically slid around the top, bottom, left and right ends of the display device.

In addition, the light emitting acrylic frame 310 according to the present invention is attached along the front edge of the display device is attached to the double-sided tape and Velcro tape on the back of the acrylic cover.

As shown in FIG. 5, the light emitting diodes 311b of the light emitting unit 30 are formed in plural number of sound signals measured by the acoustic sensor unit according to the voltage value through the control signal of the microcomputer according to the level. , Level 2-yellow, level 3-blue.

The text and sign display unit 40 displays the alarm sound of a railroad crossing breaker, the siren sound of a vehicle (eg, an emergency vehicle, a fire truck, a police car, a wrecker), a crash and a sudden brake sound on a navigation, GPS, and LCD monitor TV. Where you convert to sign language and display

As shown in FIG. 2, the alarm sound data of a railroad crossing breaker, the siren sound data of a vehicle (for example, an emergency vehicle, a fire truck, a police car, a wrecker), character data corresponding to crash and sudden brake sound data, a sign language video, and Memory unit 410 for storing animation data, and voice data input unit 420 for receiving the alarm sound, siren sound, collision and sudden brake sound data input from the acoustic sensor unit to convert the electrical data into electrical data and output And a menu selection unit 430 for providing a menu item in a menu navigation format so that the output form of the received message can be selected by text and sign language according to a user's intention, and outputting selection data corresponding to the selected menu item. Control the controller to output text data or to process sign language video and sign language animation data A transmitting / receiving unit 440, a display unit 450 for displaying text data, a sign language video, and a sign language animation processed by the transmitting / receiving unit on a screen such as navigation, GPS, and a liquid crystal monitor TV through control of the control unit; Recognizing the form of the message received through the unit, and outputs the text data or sign language video and sign animation data corresponding to the data of the acoustic sensor unit on the screen of the navigation, GPS, LCD monitor TV, etc. according to the recognized message form The control unit 460 is configured.

This configuration enables the navigation, GPS and LCD monitors to detect alarms of railroad crossing breakers, sirens, collisions and sudden brakes of vehicles (e.g., emergency vehicles, fire trucks, police cars and wreckers). Characters and sign language can be converted and displayed on the screen.

In addition, by configuring the 'abbreviation registration' button and 'use the abbreviation' button on the keypad of the navigation, GPS, LCD monitor installed inside the vehicle, the hearing impaired and hearing-impaired person can directly sign language videos and sign language animations. Sign language videos and sign language animations can be configured to display navigation, GPS, and LCD monitors.

Here, the method of 'abbreviated registration' will be described.

First, select the 'abbreviation registration' button paired with the navigation, GPS, LCD monitor keypad or arranged alone.

If you press the 'abbreviated registration' button, the abbreviated registration window is created.

The abbreviation registration window allows the user to selectively match sign language videos and sign language animations through consonants, vowels, numbers, and special keys (@, #, $,%, etc.) in the order of initial, neutral and final Register the abbreviation as much as possible.

After registering the abbreviation, save and delete the abbreviation by pressing 'Save Abbreviation Button' and 'Delete Abbreviation Button' created on one side of the abbreviation registration window.

At this time, the abbreviation registration window is generated after storing the abbreviation.

If you want to register again, continue registering, if not, exit with 'Exit button'

On the other hand, in the present invention, the surveillance cameras are installed on one side of the rear and front of the vehicle for the deaf and hard of hearing, and connected to the navigation, GPS, LCD monitor TV so that the driver can see the outside of the vehicle at a glance. In addition, the driver can be configured to see the blind spot when the vehicle is moving forward and backward.

As such, the light emitting unit 30 and the character and sign display unit 40 according to the present invention are first recognition units that can be first recognized by the driver's eyes who are deaf and hard of hearing, and include a light emitting diode, a navigation device, a GPS, and a liquid crystal monitor TV. Through it has a feature that can be more accurate situational awareness.

The vibration unit 50 is a vibration element 511 is installed on the left, right, left and right sides inside the cushion driving seat 510 is a place where the vibration is generated under the control of the microcomputer 20, such a vibration element ( The operation of the 511 is configured to make the driver feel squeaky by vibrating in a 0.2 to 0.8 second cycle in order to prevent a phenomenon in which the motor nerve felt by the driver is slow when the vibration continues to ring.

Vibration unit 50 having such a configuration, for example, in the case of an alarm sound of a railroad crossing breaker or a siren sound of a vehicle (eg emergency car, fire truck, police car, wrecker) in front of a vehicle that is deaf and hard of hearing. Vibration element 511 located in the front of the driving seat 510 is sounded by tapping every 0.2 ~ 0.8 seconds cycle, at this time the driver feels the vibration applied to the upper part of the thigh, the alarm sound of the railroad crossing breaker in the front of the vehicle You will notice that the siren of the vehicle (eg emergency car, fire truck, police car, wrecker) has been heard.

As another example, as shown in FIG. 3, when the crash and sudden brake sounds are generated from the rear of a vehicle that is deaf or hard of hearing, the vibration element 511e located in the rear of the cushion driving seat 510 is 0.2 to 0.2. It will sound with a 0.8-second cycle, and the driver will feel the vibration applied to the hips, and the front of the vehicle will sound an alarm at the railroad crossing breaker or a siren of the vehicle (e.g., emergency car, fire truck, police car, wrecker). To be recognized.

As described above, the vibrator 50 according to the present invention is a secondary recognition unit that the driver's body is deaf and hard of hearing, and the driver may inadvertently recognize the situation when the primary recognition unit is not recognized by the driver's carelessness.

Hereinafter, a detailed operation process of the contextual recognition apparatus for the hearing impaired and the hearing impaired according to the present invention will be described.

As shown in FIG. 3, in the case of a siren sound of a vehicle (for example, an emergency vehicle, a fire truck, a police car, a wrecker) from the rear of a vehicle that is deaf and hard of hearing, and the loudness is 51 to 100 dB,

First, a siren sound of a vehicle (eg, an emergency vehicle, a fire truck, a police car, a wrecker) detects a sound through an acoustic sensor unit installed at one rear side of the vehicle.

Subsequently, the microcomputer records the sound signal transmitted from the acoustic sensor unit 10 through the data recorder unit 21, and the level recorder unit 22 is connected to the data recorder unit 21 to level the sound level. It is delivered to the light emitting unit.

In this case, as shown in FIG. 9, the light emitting unit recognizes that the loudness is 51 to 100 dB, thereby emitting two-level-yellow light, and at the same time, the lower surface of the display device blinks at a constant cycle.

Subsequently, the frequency analysis unit 23 of the microcomputer compares and analyzes the frequency of the sound signal recorded in the data recorder unit with the reference set value, and sets the equivalent sound level and the alarm sound of the railroad crossing breaker or the vehicle (e.g., emergency vehicle, fire truck). It analyzes external situation information such as siren, collision, and sudden brake sound of police car, wrecker) and transmits it to text and sign display.

Subsequently, as shown in Fig. 9, in the text and sign display unit, an alarm sound of a railroad crossing breaker, a siren sound of a vehicle (e.g., an emergency car, a fire truck, a police car, a wrecker), a collision, and a sudden brake sound are used for navigation, GPS, and liquid crystal. Text and sign language are converted and displayed on the monitor TV.

At the same time as the light emitting unit emits light, vibration is generated in the vibrating unit through the control of the microcomputer 20 of the vibrating element 511e installed on one side of the rear surface of the cushion driving seat 510.

According to the above configuration and operation, alarm sound of railway crossing breaker, siren sound of emergency vehicle, collision and sudden brake sound can be converted to recognize the driver who is deaf and hard of hearing and the eyes and body parts of the driver are Afterwards, the driver may have a hearing impairment by applying vibration to the input direction of the alarm sound of the railroad crossing breaker, the siren sound of the emergency vehicle, the crash and the sudden brake sound.

As described above, according to the present invention, it is possible to simultaneously recognize through the eyes and body of the driver who is deaf and hard of hearing, and compatible with the existing in-vehicle device at a low cost, due to the fast response speed Has a good effect to drive safely.

Claims (3)

Before and after the vehicle, the driver who is deaf or hard of hearing can recognize the alarm sound of the railroad crossing breaker, the siren, crash, and sudden brake sound of the vehicle (e.g., emergency vehicle, fire truck, police car, and wrecker) while driving. A plurality of sound sensor unit 10 is provided on one side of the left and right, The light emitting unit 30, the character and sign display unit and the vibrating unit receive the sound signal transmitted to the acoustic sensor unit 10 and simultaneously transmit the display signal and the vibration signal to a driver who is deaf or hard of hearing for each position of the vehicle. A microcomputer 20 for controlling 40; A detachable light emitting acryl frame 310 is installed along the front edge and perimeter of the vehicle audio, navigation, GPS, and liquid crystal monitor TV installed inside the vehicle, and is displayed at a period of 0.5 to 3 seconds through the control of the microcomputer 20. )Wow, Characters and Sign Language that converts alarm sounds of railway crossing breakers, sirens, collisions and sudden brake sounds of vehicles (e.g., emergency vehicles, fire trucks, police cars, and wreckers) into navigation and GPS and LCD monitor TVs and displays them in text and sign language. Sign language display unit 40, Hearing impaired and hearing impaired, characterized in that the vibration element 511 is installed on the left, right, left, and right sides inside the cushion driving seat 510 is composed of a vibration unit 50 is generated through the control of the microcomputer. Contextual Awareness Device. According to claim 1, The light emitting acryl frame 310 is a PCB substrate is inserted into the PCB substrate inserting portion formed on one side, so that the light emitted through the control of the PCB substrate uniformly spread throughout the acrylic surface '

An acrylic cover 311 formed in a long shape, A PCB board 312 inserted into the PCB board inserting part of the acrylic cover and receiving power from a vehicle battery to control light to be emitted through a plurality of light emitting diodes and resistors; Hearing impaired and hearing impaired situation recognition apparatus, characterized in that the end portion is formed by protruding in the shape of the forceps so that the end is inserted into the acrylic cover while sliding along the circumference of the display device. The character and sign display unit 40 according to claim 1, wherein Memory unit that stores text data, sign language video, and animation data corresponding to alarm sound data of railroad crossing breakers, siren sound data of vehicles (e.g., emergency vehicles, fire trucks, police cars, wreckers), crash and sudden brake sound data ( 410), A voice data input unit 420 which receives alarm sound, siren sound, collision and sudden brake sound data input from the acoustic sensor unit and converts the sound data into electrical data; A menu selection unit 430 for providing a menu item in a menu navigation form to select an output form of a received message by text and sign language according to a user's intention, and outputting selection data corresponding to the selected menu item; A transmitter / receiver 440 for outputting character data or processing and outputting sign language video and sign language animation data through control of a controller; A display unit 450 for displaying text data, a sign language video, and a sign language animation processed by a transmitter / receiver on a screen such as navigation, GPS, and a liquid crystal monitor TV through control of a controller; Recognize the type of the message received through the transceiver, and output the text data or sign language video and sign language animation data corresponding to the data of the acoustic sensor unit on the screen of the navigation, GPS, LCD monitor TV, etc. according to the recognized message type Hearing impaired and hearing impaired situation recognition device, characterized in that consisting of a control unit 460.

Images