KR102231373B1 - Display device for driving the vehicle safely - Google Patents

Abstract

The present invention relates to a display device for safe vehicle driving, capable of helping a driver to secure his or her sight in an environment where there is difficulty in sight securement. The display device for safe vehicle driving includes: a user control part generating a control signal corresponding to the control of the driver; a standard camera filming an ordinary standard video of the front of a vehicle; an infrared camera filming an infrared video of the front of the vehicle; a graphic processing part signalizing and compressing the standard video and/or the infrared video filmed by the standard camera and/or the infrared camera; a sensing sensor part sensing a surrounding environment of the vehicle; a display screen displaying the video signalized by the graphic processing part; and a system control part, based on the control of the driver and/or a sensing signal from the sensing sensor part, controlling the start and stop of the filming of the standard camera and/or the infrared camera, and controlling the signalizing of the graphic processing part, thereby controlling a screen displayed on the display screen. Therefore, the display device can provide clear visibility even in a situation with poor visibility such as night, heavy rain or the like, thereby enabling a driver to perform safe driving, and accurately analyzing an accident cause through a black box in case of an accident.

Description

Display device for vehicle safe driving {DISPLAY DEVICE FOR DRIVING THE VEHICLE SAFELY}

The present invention relates to a display device for safe driving of a vehicle, and more specifically, a display device for safe driving of a vehicle capable of securing a view so that a vehicle can be safely driven in an environment where it is difficult to secure a view, such as in rainy weather, fog, and night time. It is about.

Energy conversion of automobiles such as hydrogen cars and electric vehicles is being attempted from conventional fuels such as internal combustion engine cars, external combustion engine cars, gas turbine cars, etc. .

Along with the development of such eco-friendly vehicles, what has been attracting attention from before is the development of smart vehicles for safety and convenience of drivers and pedestrians.

Intelligent vehicles are cutting-edge vehicles that integrate information technology (IT) and are also called smart vehicles. Intelligent cars provide optimal traffic efficiency through the introduction of the car's own advanced system as well as interlocking with the Intelligent Transportation System (ITS).

In addition, research on sensors such as cameras, infrared sensors, radar, GPS, lidar, gyroscopes, etc., which are mounted on such intelligent vehicles, are actively being conducted, and among them, cameras play a role in the place of human eyes. It occupies an important position as a sensor.

Therefore, due to the development of various sensors and electronic equipment, a vehicle having a driving assistance function that assists a user's driving and improves driving safety and convenience is attracting attention.

As part of that, Patent Publication No. 2016-0070527 (published date: June 20, 2016) cited as a prior document in this application provides an image that assists driving for safe driving to the occupants as shown in FIG. The display configuration is disclosed.

Referring to FIG. 1, a transparent flexible display 211 is provided in the housing 280 and the length of the light blocking area or the image display area is adjusted based on the position of the sun. In this image display area, the image of the left and right side mirrors of the vehicle and the image of the rear view mirror are divided and displayed.

However, the screen displayed in this way only replaces the side mirrors or rearview mirrors in a good driving environment around the vehicle, and it is difficult to secure good visibility in poor weather conditions such as rain, night, fog, and heavy snow. .

In addition, the conventional image display area shown in FIG. 1 performs a function of displaying auxiliary information necessary for vehicle operation, such as vehicle speed information, traffic sign information, navigation information, fuel remaining amount information, vehicle breakdown information, and traffic information.

As described above, in the conventional video display area, it is mainly used as an area for displaying driving information, and there is no disclosure of safe driving due to bad weather.

On the other hand, the Black Box was used as a device to record flight records, flight images, and cockpit voices of aircraft in flight in preparation for aircraft accidents, but in recent years, it is also widely used in differential vehicles. In countries such as Europe, the United States, and Japan, laws that require the installation of black boxes are under discussion, and in Korea, some local governments are promoting the enactment of self-government ordinances requiring the installation of black boxes, or when installing black boxes. The use of black boxes is becoming more common, such as discounting insurance premiums by insurance companies.

Since this black box is useful for determining the cause of an accident, the demand is explosively increasing. In a vehicle black box, cameras and microphones are installed inside and outside the terminal to record driving images or audio while the vehicle is driving.

However, car accidents are more frequent when driving at night with poor visibility and when rainy weather worsens such as fog, rain, heavy snow, and fine dust, but the conventional black box for a vehicle can be photographed in a single mode. However, it is not possible to provide support for driving at night or how to secure good videos in each bad weather situation.

Publication Patent No. 2016-0070527 (Publication date: June 20, 2016)

An object of the present invention is to provide a display device for safe driving of a vehicle that can secure a good view even in dark nights and secure a clear view by appropriately combining a standard video and an infrared video even for a blind spot that is not covered by a headlight. There is this.

In addition, the present invention is to provide a display device for vehicle safety driving that can secure good visibility by adjusting the focal distance over the vehicle windshield even in a situation in which the visibility is poor due to rain on the windshield of the vehicle, such as in rainy weather. There is this.

In addition, the present invention is a vehicle safe driving display that can secure a clear view by properly combining standard video and infrared video even in situations where the visibility is poor due to fine particles in the air such as fog, heavy snow, fine dust, and yellow dust. Its purpose is to provide a device.

In addition, as described above, the present invention provides a good visibility to the driver when driving at night with poor visibility, or in bad weather such as fog, heavy snow, fine dust, and yellow dust, so that the driver can drive safely. An object thereof is to provide a display device for safe driving. Hereinafter, fog, heavy snow, fine dust, yellow dust, etc. are expressed as a'fog time' for convenience in that they are in the same form as silt particles in the air, but this should be classified into individual environments according to each situation, and it is always intended to be integrated into one. It is not.

In addition, as described above, the present invention secures a good video of the situation around the vehicle in the black box even when driving at night with poor visibility, or when weather conditions such as fog, heavy snow, fine dust, yellow dust, etc. It is an object of the present invention to provide a display device for safe driving of a vehicle that allows the cause to be identified.

In a preferred embodiment of the present invention, in a display device for safe driving of a vehicle that helps secure a driver's view in an environment in which it is difficult to secure a view, a user control unit that generates an operation signal corresponding to the driver's operation, and a normal front of the vehicle A standard camera for photographing a standard video, an infrared camera for photographing an infrared video in front of the vehicle, and a graphic processing unit for signal processing and compression of the standard video and/or infrared video captured by the standard camera and/or the infrared camera, Based on a detection sensor unit for sensing the environment around the vehicle, a display screen displaying a video signal processed by the graphic processing unit, and a manipulation of the driver and/or a detection signal from the detection sensor unit, the standard camera And/or a system controller configured to control start and stop of photographing of the infrared camera, control signal processing by the graphic processor, and control a screen displayed on the display screen.

In another preferred embodiment of the present invention, in the above-described embodiment, the detection sensor unit includes a raindrop detection sensor detecting raindrops falling around the vehicle, an illuminance detection sensor detecting brightness around the vehicle, and It provides a display device for safe driving of a vehicle, comprising a fog detection sensor for detecting fine particles contained in the air around the vehicle.

In another preferred embodiment of the present invention, in the above-described embodiment, the illuminance detection sensor detects that it has become darker than the preset illuminance, or the fog detection sensor detects fine particles in the air above a preset concentration. Then, the system control unit provides a display device for safe driving of a vehicle, characterized in that controlling to display an infrared video on the display screen by operating the infrared camera.

In another preferred embodiment of the present invention, in the above-described embodiment, the illuminance detection sensor detects that it has become darker than the preset illuminance, or the fog detection sensor detects fine particles in the air above a preset concentration. Then, the system control unit operates the standard camera and the infrared camera, synchronizes and synthesizes the video shot from the standard camera and the video shot from the infrared camera in the graphic processing unit, and combines the synthesized screen with the display screen. It provides a display device for safe driving of a vehicle, characterized in that the control to display the image.

In another preferred embodiment of the present invention, in the above-described embodiment, when raindrops are detected by the raindrop detection sensor more than a preset amount, the system controller controls the focal point of the standard camera to a preset focal distance to perform out-of-focusing. It provides a display device for safe driving of a vehicle, characterized in that controlling the standard camera so as to take a recorded video.

In another preferred embodiment of the present invention, in the above-described embodiment, a display device for safe driving of a vehicle is provided, further comprising a video storage unit for storing a video compressed by the graphic processing unit.

In another preferred embodiment of the present invention, in the above-described embodiment, the display screen provides a display device for safe driving of a vehicle, characterized in that the display screen is a transparent display device whose transparency is adjusted by the user manipulation unit.

According to the present invention described above, a good view can be secured even in dark nights, and a clear view can be secured by appropriately combining a standard video and an infrared video even for a blind spot that is not covered by a headlight.

In addition, according to the present invention described above, even in a situation in which the visibility is poor due to rain on the windshield of the vehicle, such as in rainy weather, it is possible to secure a good visibility by adjusting the focal length over the windshield of the vehicle.

In addition, according to the present invention described above, even in a situation in which the visibility is poor due to fine particles in the air such as fog, heavy snow, fine dust, yellow dust, etc., a clear view can be secured by appropriately combining a standard video and an infrared video.

In addition, as described above, the present invention provides a good visibility to the driver even when driving at night with poor visibility, or in bad weather such as fog, heavy snow, fine dust, and yellow dust, thereby enabling the driver to safely drive. There is.

In addition, as described above, the present invention secures a good video of the situation around the vehicle in the black box even when driving at night with poor visibility, or when weather conditions such as fog, heavy snow, fine dust, yellow dust, etc. It has the effect of being able to identify the cause.

Before describing the embodiments of the present invention in more detail using the drawings, the same elements in the drawings and detailed description, and elements having the same function and/or the same technical or physical effect, are given the same reference numerals or have the same names. Identification, and descriptions of elements shown or described in different embodiments and their functions may be interchangeable with each other or may be applied to each other in different embodiments.
1 is an exemplary view showing an example of a sun visor image display area according to the prior art.
2 is a block diagram of a display device for safe driving of a vehicle according to an exemplary embodiment of the present invention.
3 is an exemplary view illustrating a two-split display screen and a user operation unit of a display device for safe driving of a vehicle according to an exemplary embodiment of the present invention.
4 is an exemplary view of a display display during rain of a display device for safe driving of a vehicle according to an exemplary embodiment of the present invention.
5 is an exemplary view of a display display at night of a display device for safe driving of a vehicle according to an exemplary embodiment of the present invention.
6 is an exemplary view of a display display during fog of a display device for safe driving of a vehicle according to an exemplary embodiment of the present invention.

In the present invention, various modifications may be made and various embodiments may be provided, and specific embodiments are illustrated in the drawings, and the present invention will be described in more detail with reference to them.

However, this is not intended to limit the present invention to the specific embodiments described later, it should be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the present invention.

As for terms used in the present invention, general terms that are currently widely used as possible are selected while considering functions in the present invention, but this may vary according to the intention or precedent of a technician engaged in the relevant field, the emergence of new technologies, and the like.

In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention.

Unless otherwise defined, all terms used herein including technical or scientific terms have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in the present application. Does not.

Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

In the present application, terms such as "comprise" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof does not preclude in advance.

In addition, terms such as "... unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. .

Terms including ordinal numbers such as first and second may be used to describe various elements, but these elements are used for the purpose of distinguishing one element from other elements, and the first or second It is not limited by the like. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element.

In addition, the term “or” may be used interchangeably with the term “and/or”, which includes a combination of a plurality of related items or any item among a plurality of related items. That is, as a logical meaning, both cases where both are applicable at the same time and cases where only one of the two is applicable are included.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. It should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

Hereinafter, a display device for safe driving of a vehicle according to an exemplary embodiment of the present invention will be described in more detail with reference to FIGS. 2 to 6.

2 is a block diagram of a display device for safe driving of a vehicle according to a preferred embodiment of the present invention, and FIG. 3 is a two-part display screen of the display device for safe driving of a vehicle according to a preferred embodiment of the present invention. And an exemplary view illustrating a user control unit, and FIG. 4 is an exemplary diagram of a display display in rainy weather of a display device for safe driving of a vehicle according to a preferred embodiment of the present invention, and FIG. 5 is a vehicle according to a preferred embodiment of the present invention. It is an exemplary view of a display device for safe driving at night, and FIG. 6 is an exemplary view of a display for displaying during fog of the display device for safe driving of a vehicle according to an exemplary embodiment of the present invention.

Referring to FIG. 2, the display device for safe driving of a vehicle according to an exemplary embodiment of the present invention is largely a user control unit 100, a system control unit 200, an external environment detection sensor unit 300, and a video capture unit 400. , A graphic processing unit 500, a display screen 600, and a video storage unit 700.

First, the user control unit 100 is a device for receiving a user's request for the operation of the display device for safe driving of a vehicle, and when the user manipulates the input means provided in the user control unit 100 according to the operation intention, it responds to the corresponding operation. An input signal is generated and applied to the system control unit 200, and according to the manipulation signal, the shooting mode of the video recording unit 400 may be selected, the transparency of the display screen 600 may be adjusted, or if necessary. It is also possible to set the focal length and adjust the zoom.

As the input means of the user operation unit 100, a mechanical input means (for example, a mechanical key, a physical button, a dome switch, a jog wheel, a jog switch, etc.) and a touch input means (for example, Touch pad, touch wheel, etc.) may be included.

In addition, the user control unit 100 is configured of, for example, a touch panel provided in a partial area of a display device for vehicle safety driving installed extending from a sun visor, or displaying a judgment on the execution screen of an application program driven in a display device for vehicle safety driving. It may be composed of a user interface (UI), a touch button on a graphical user interface (GUI) screen, and a touch wheel.

In addition, the user manipulation unit 100 may be configured as a remote controller attached to a steering wheel through which the driver manipulates the driving of the vehicle.

Further, a voice recognition means for receiving a user's voice and converting it into an electronic signal may also be used as an input means constituting the user manipulation unit 100.

The user control unit 100 configured as described above is largely configured to include a photographing mode selection unit 110 and a fine adjustment unit 120 according to a preferred embodiment of the present invention, and other input manipulation means typically provided in a vehicle. May be included, but the description of the conventional input means will be omitted, and only the photographing mode selection unit 110 and the fine adjustment unit 120 will be described.

The photographing mode selection unit 110 may select a driving mode including a normal driving mode, a fog driving mode, a rain driving mode, a night driving mode, and the like. That is, a selection button for each mode may be provided in the user manipulation unit 100 provided in the housing 800 of FIG. 3, and the driving mode may be changed by pressing the provided button. In this case, in the example shown in FIG. 3, the user control unit 100 is an opaque part, and the touch screen is provided on the surface of the housing 800, the main board is mounted therein, and the rear (that is, on the side of the front windshield for a vehicle) A moving picture photographing unit 400 composed of a standard camera 410 and an infrared camera 420 may be provided. Of course, in another embodiment of the present invention, the front surface of the housing 800 including the user control unit 100 is composed of a transparent display screen 600, and is controlled by a remote controller, so that a wider vehicle safe driving display screen You can also provide

In addition, in another embodiment of the present invention, the driving mode in rainy weather is automatically driven in conjunction with the wiper system by the rain detection sensor 310, and the night driving mode is automatically flashing the headlight of the vehicle by the illumination sensor 320 It is configured automatically in conjunction with the device, and the fog driving mode may be implemented to be automatically driven in conjunction with an automatic flashing system of a fog lamp by the fog detection sensor 330. In this case, since the driver's operation of the device while driving can be reduced to a minimum, there is an effect of further enhancing safety when driving the vehicle.

The fine adjustment unit 120 may be configured with a physical input device such as an up/down button, a wheel button, a jog wheel, a jog switch, or a touch scroll implemented in software on a touch pad, and It can play a role of adjusting the focal length. That is, in the rain driving mode, the focal length of the standard camera 410 is manually adjusted over the windshield of the vehicle to out-focus, so that the front view is not blocked by the vehicle glass.

In addition, the screen display range may be set by adjusting the zoom of the standard camera 410 by manipulation of the fine adjustment unit 120.

In addition, the transparency of the display screen 600 may be adjusted by manipulation of the fine adjustment unit 120. Accordingly, it is possible to appropriately adjust the visibility of the driver's display screen and securing the front view according to the driver's preference.

The system control unit 200 includes an operation signal (or also referred to as “input signal”) from the user operation unit 100, a sensing signal from the detection sensor unit 300 (or referred to as “sensing data”), and a set box storage unit 720. ), including a video recording unit 400, a graphic processing unit 500, and a display screen 600, based on a preset storage value (for example, various control values corresponding to a detection signal) stored in the vehicle safely driving Controls the overall display device.

The system controller 200 includes a digital signal processor (DSP), an application specific integrated circuit (ASIC), a microcontroller, programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and an electrical unit for performing other functions. And may be mounted on one surface of a predetermined circuit board.

First, the system control unit 200 shoots in the video recording unit 400 according to the selection of the shooting mode selection unit 110 and displays a normal driving mode, a fog driving mode, a rain driving mode, and a night driving to be displayed on the display screen 600. The moving picture photographing unit 400 and the display screen 600 may be controlled so that the mode or the like is performed.

On the other hand, the system control unit 200, based on the signal detected by the rain detection sensor 310 of the detection sensor unit 300 and the data stored in the set value storage unit 720, the rainy weather driving mode with the operation of the wiper. By implementation, the focal length of the standard camera 410 may be set to out-focusing. Accordingly, on the screen of the display screen 600, the field of view over the windshield of the vehicle may be clearly captured. In this case, at least one or a plurality of standard cameras may be provided at a location where the inflow of rain outside the vehicle is blocked, and may be selectively driven by the system controller 200.

As a result, there is an effect of further enhancing driving safety by securing a clear view even in rainy weather.

In addition, the system controller 200 turns on the headlight of the front of the vehicle based on the signal detected by the illuminance sensor 320 of the detection sensor unit 300 and the data stored in the set value storage unit 720 , The moving picture photographing unit 400 may turn off the standard camera 410 and turn on the infrared camera 420 to display an infrared video on the display screen 600.

In another embodiment of the present invention, by controlling to operate both the standard camera 410 and the infrared camera 420 according to the user's setting, as shown in FIG. May be displayed, and an infrared video may be displayed in the second area. That is, when it is desirable to secure a view by ambient lighting and headlights, the standard video is displayed in the first area of the display screen 600 because visibility is good even in the night driving mode, but to increase the visibility in the blind spot of the headlight. An infrared video may be displayed on the second area of the display screen 600. With such a combination, it is possible to secure a field of view that is displayed in more detail by a standard video, while also securing a field of view in a blind spot where a field of view is not secured by a headlight.

On the other hand, in another embodiment of the present invention, the system control unit 200 controls both the standard camera 410 and the infrared camera 420 to operate, and the graphic control unit 500 controls the standard video from the standard camera 410. By controlling to synthesize the infrared video from the infrared camera 420, while securing a wide display screen for vehicle safety driving through the entire display screen 600, while increasing the visibility to objects that can not be seen, infrared video Compared to that, it has the effect of obtaining a detailed video screen.

As a result, there is an effect that can further increase the safety of night driving.

On the other hand, the system control unit 200 turns on the fog lamp and, based on the signal detected by the fog detection sensor 320 of the detection sensor unit 300 and the data stored in the setting value storage unit 720, By turning off the standard camera 410 at 400 and turning on the infrared camera 420, an infrared video may be displayed on the display screen 600.

In another embodiment of the present invention, by controlling to operate both the standard camera 410 and the infrared camera 420 according to the user's setting, as shown in FIG. May be displayed, and an infrared video may be displayed in the second area. For example, if the shade of the fog is intermittently thick, since it is desirable to secure a view in a section where the shade of the fog is shallow, a standard video is displayed in the first area of the display screen 600, but the visibility in the blind spot of the headlight is increased. Infrared video may be displayed in the second area of the display screen 600 so as to be possible. In this case, especially in the case of manual mode, the conversion is too slow to continue driving in the fog driving mode even in the section where the fog is shallow, or the disadvantage that may increase the risk due to frequent switching operation is suppressed, and in the case of automatic, the conversion is too frequent. There is an effect of suppressing the occurrence of confusion caused by screen switching. While suppressing such a problem, since the visibility in the shallow fog section and the visibility in the thick fog section are simultaneously secured, vehicle driving safety in the fog driving mode can be further improved.

On the other hand, in another embodiment of the present invention, the system control unit 200 controls both the standard camera 410 and the infrared camera 420 to operate, and the graphic control unit 500 controls the standard video from the standard camera 410. By controlling to synthesize the infrared video from the infrared camera 420, while securing a wide display screen for vehicle safety driving through the entire display screen 600, while increasing the visibility to objects that can not be seen, infrared video Compared to that, it has the effect of obtaining a detailed video screen.

Accordingly, there is an effect of further increasing the safety of vehicle driving during fog.

Meanwhile, the system controller 200 may control the graphic processing unit 500 to set the compression rate and format of the moving picture stored in the moving picture storage unit 710. Accordingly, the display device for safe driving of a vehicle according to the present invention is also applied to a black box for a vehicle, and there is an effect of securing a video having good visibility for a situation around the vehicle even in an environment where visibility is difficult to secure.

The detection sensor unit 300 is composed of a plurality of types of detection sensors including a rain detection sensor 310, an illuminance detection sensor 320, and a fog detection sensor 330, and detects surrounding environment information related to vehicle driving to generate electricity. It is generated as digital information through all signals.

First, the rain detection sensor 310 is installed in the upper center of the windshield to detect the amount of rainwater, converts the detected amount of rainwater into an electrical signal, and provides digital data to the system controller 200. That is, the rain detection sensor 310 detects the amount of rain by detecting the infrared ray emitted from the LED (Light-Emitting Diode) is reflected by rainwater on the glass surface and returned by the photodiode. In addition, the rain detection sensor 310 according to a preferred embodiment of the present invention includes a servo circuit for self-correcting the transmittance of the glass, and is configured to constantly detect rainwater regardless of the transmittance of the front glass. It is hoped.

The raindrop detection sensor 310 according to an exemplary embodiment of the present invention may be configured to detect raindrops by being connected to a power supply at all times, but may be configured to detect raindrops by interlocking with an operation switch of a wiper.

Accordingly, the rain detection sensor 310 according to an exemplary embodiment of the present invention may use the rain detection sensor 310 operating in conjunction with a wiper in common. At this time, in the conventional wiper system, the operating speed of the wiper is manipulated step by step to remove raindrops falling on the windshield of the vehicle in order to secure the driver's view, but the rain monitoring sensor 310 according to a preferred embodiment of the present invention ) Means that when the driver cannot secure a smooth front view, that is, when the wiper is more than a predetermined level among a number of steps (eg, 16 steps), the focal length of the standard camera 410 to be described later is adjusted to prevent fog. The goal is to secure a clear view even from the inside. As described above, the rain monitoring sensor 310 of the present invention has a main purpose of detecting whether it is raining enough to cause the driver's front vision to be poor.

On the other hand, the illuminance sensor 320 is a sensor that indicates the'intensity of light' received by a specific area as a'light flux' reflected in the area, and detects brightness outside the vehicle. Here, the luminous flux refers to the amount of light passing through a unit area perpendicular to the direction in which the light travels per unit time. That is, the illuminance sensor 320 detects the degree of brightness of the environment around the vehicle, and may be displayed to the user in units of lux (lx) or photo (ph), and Brightness is provided to the system controller 200 as digital data.

The illuminance sensor 320 generates free electrons moving inside the illuminance sensor when light energy is received, and an element having a photoelectric effect (a phenomenon in which a current flows when light is irradiated) in which the conductivity changes, for example, cadmium sulfide (CdS). ) It can be configured using an element, and according to the property that the resistance value decreases when the light is strong, and the resistance value increases when the light is weak, an analog signal corresponding to the intensity of light reflected on the illumination sensor 320 is generated. Corresponding digital data is transmitted to the system control unit 200. According to the digital data detected by the illuminance sensor 320, the system controller 200 can distinguish between day and night in the environment in which the vehicle is driving, and the driver secures an external view based on a preset illuminance standard. It is possible to determine the illuminance that can be performed (ie, day) and the illuminance that cannot secure an external view (ie, night).

In a preferred embodiment of the present invention, although the present illuminance sensor 320 may be distributed inside and outside the vehicle, the illuminance sensor 320 operates in conjunction with a conventional automatic lighting device (ie, headlight). It can also be used in conjunction with.

In addition, in a preferred embodiment of the present invention, when the illuminance detected by the illuminance sensor 320 of the vehicle is less than or equal to a preset reference, the headlight on the front of the vehicle is automatically turned on. At the same time, it may be configured to display an infrared screen photographed by the infrared camera 420 on the display screen 600. That is, when the external environment of the vehicle being driven at night becomes dark enough to prevent visibility, it may be configured to display an infrared screen photographed by the infrared camera 420 on the display screen 600 at the same time as the vehicle is turned on. . With this configuration, since the infrared screen for safe driving of the vehicle can be displayed on the display screen 600 without unnecessary manipulation while the driver is driving, there is an effect that can contribute more to the safe driving of the vehicle.

Meanwhile, the fog detection sensor 330 emits light of an infrared or ultraviolet wavelength from a light emitting unit such as an LED or a laser diode, and is scattered or reflected by fine particles such as dust or moisture (that is, particles suspended in the air). The received light is received by an infrared or ultraviolet light receiving unit to generate a light receiving signal. The concentration of fine particles can be detected from this light-receiving signal. Here, it is effective that the light receiving unit is not interfered with by ambient light by using a visible light blocking filter or resin. Of course, the present invention is not limited thereto, and light in the normal visible range may be used. However, using infrared or ultraviolet light can improve the sensitivity.

In addition, based on the temperature and humidity sensed by separate temperature sensors and humidity sensors, the fine particles may be determined to be fog particles from a dew point function. However, since it is important for the fog detection sensor 330 according to an embodiment of the present invention to determine whether a driver in a vehicle driving due to fog can secure a view, it is detected by a temperature sensor and a humidity sensor. It is more desirable to accurately detect the concentration of the fog particles rather than confirming whether the dew point is reached with the specified temperature and humidity, that is, that the fine particles are fog particles.

On the other hand, the fog detection sensor 330 according to the present invention may be evenly distributed inside and outside the vehicle, but it is also preferable to use in common with the fog sensor used in the automatic fog light lighting system.

On the other hand, since dense yellow sand or fine dust also interferes with the driver's field of view, in a preferred embodiment of the present invention, a fine dust monitoring sensor (not shown) may be further included in addition to the fog detection sensor 330. In a preferred embodiment of the present invention, since fine dust or yellow dust acts as fine particles that obstruct the driver's view like fog, it is described as the fog detection sensor 330, but may be configured as a separate fine particle detection sensor.

In the fog detection sensor 330 according to an exemplary embodiment of the present invention, it is preferable to use light of a short wavelength in order to detect small particles such as fine dust. To this end, the fog detection unit and the fine particle detection unit may be configured to detect the concentration of the fog or fine particles by configuring different wavelengths.

Meanwhile, in addition to the above-described rain detection sensor 310, illuminance detection sensor 320, and fog detection sensor 330, the display device for vehicle safety driving according to a preferred embodiment of the present invention includes, for example, a magnetic sensor. ), a position sensor, an acceleration sensor, an acoustic sensor, a temperature/humidity sensor, a proximity sensor, an infrared sensor, an RGB sensor, and an impact sensor.

In addition, wheel speed sensor, heading sensor, yaw sensor, gyro sensor, position module, vehicle forward/reverse sensor, wheel sensor, vehicle speed sensor , A vehicle body tilt detection sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by rotation of a steering wheel, a temperature sensor inside a vehicle, a humidity sensor inside a vehicle, and the like. However, it is not limited to this. Since the function of each sensor can be intuitively inferred by a person skilled in the art from its name, a detailed description will be omitted.

As described above, by the above-described additional sensor, the detection sensor unit 300 includes a vehicle slip degree, vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, Vehicle forward/reverse information, battery information, fuel information, tire information, vehicle lamp information, vehicle interior temperature information, and vehicle interior humidity information may be included and detected.

In addition, the accelerator pedal sensor, pressure sensor, engine speed sensor, air flow sensor (AFS), intake air temperature sensor (ATS), water temperature sensor (WTS), throttle position sensor ( TPS), TDC sensor, crank angle sensor (CAS), etc. may also be used.

In addition, as an auxiliary, lane detection (LD), surrounding vehicle detection (Vehicle

Object detection technologies such as Detection, VD), Pedestrian Detection (PD), Brightspot Detection (BD), Traffic Sign Recognition (TSR), and road surface detection can be used in parallel.

The video capture unit 400 is configured to include one or a plurality of standard cameras 410 and infrared cameras 420, respectively, and captures a video of a situation in front of the vehicle.

The standard camera 410 is a conventional camera that photographs the driver's field of view outside the vehicle, particularly in front, and is referred to as a standard camera 410 to distinguish it from the infrared camera 420 to be described later, but may also be referred to as a'visible camera'. have.

As a camera constituting the standard camera 410, both a video camera or a still camera may be used. As a video camera, an analog or digital video camera having a zoom function can be applied. An absolute encoder is attached to the zoom motor for adjusting the zoom lens, and the position of the zoom lens is output as digital data. On the other hand, in the case of a still camera, the position value must be output as digital data by attaching an absolute value encoder to the zoom motor so that the position of the zoom lens can be known as a digital camera.

One or more cameras constituting the standard camera 410 may be used. When there are two cameras, that is, a stereo camera, a stereoscopic image can be obtained, and if there are three or more, a multiview stereoscopic image can be obtained

In addition, in a preferred embodiment of the present invention, the standard camera 410 includes a zoom function for adjusting the angle of view at which a video is captured, and an actuator (not shown) capable of adjusting a focal length. That is, by adjusting the distance between the lens of the standard camera 410 and the image sensor (not shown), the position at which the standard camera 410 focuses is adjusted, so that the focus of the video captured when the vehicle is operated in the rain You can adjust it to the desired position. For example, it is possible to secure the driver's field of view by out-focusing so that the focus of the video being photographed is on the rear of the front windshield of the vehicle, so that the focus is not focused on the windshield of the vehicle in rainy weather, but is focused from beyond the windshield.

On the other hand, the infrared camera 420 is a camera that recognizes the intensity of infrared rays, which varies according to the temperature difference of the surface of the object, according to the intensity of heat at an absolute temperature of 0K (that is, -273.15 °C) or higher, and expresses it in colors. An object emits infrared energy that is radiated, transmitted or reflected at a temperature of 0K (-273℃) or higher with absolute zero. At this time, an image is captured through an infrared sensor made using the principle that the higher the temperature of the object, the shorter the wavelength of the infrared ray. do. For example, using a micro-bolometer type camera that detects the LW (LONG WAVELENGTH) band (7-14 μm) of infrared rays can be used to capture an image of an object that is difficult to identify with the naked eye.

The graphic processing unit 500 converts the video image captured from the standard camera 410 and/or the infrared camera 420 into a resolution and playback frame under the control of the system controller 200 under the control of the system controller 500 Processing to be displayed on the display screen 600. At this time, the graphic processing unit 500 is a standard video captured by the standard camera 410 on the entire display screen 600, that is, a screen photographing the front of the vehicle in motion corresponding to the driver's field of view (hereinafter, "standard video Video processing to display “infrared video” on the entire display screen 600, or to display an infrared video screen captured by the infrared camera 420 (hereinafter, also referred to as “infrared video”) on the entire display screen 600 Video processing may be performed, or video processing may be performed so that the display screen 600 is divided and displayed for each area of the display screen 600 divided into a plurality of pieces.

For example, when processing the display screen 600 to be divided into two, a standard video may be displayed in a first area and an infrared video may be processed in a second area. Alternatively, in another embodiment, a video shot at a focal length of a standard video (hereinafter referred to as “standard focal length”) is displayed in the first zone, and a focus distance manually operated by the driver in the second zone (hereinafter, “manual It can be set to display a video taken at "focal distance"). In this way, not only can the current state and the desired state be displayed and checked at the same time, but also there is an advantage in that the screen can be switched simply by touching one of the two screens when the situation is switched.

In addition, in another embodiment of the present invention, the graphic processing unit 500 processes a video so that the standard video output from the standard camera 410 and the infrared video captured by the infrared camera 420 are combined and displayed on the display screen 600. can do. Visible images have more delicate high-frequency components than infrared images, whereas infrared images have relatively low-frequency characteristics, but have thermal information. Therefore, if a multi-scaling method or the like is used to fuse these characteristics and a pseudo coloring process is performed, there is an effect that a screen that cannot be seen by a standard video to the observer can be displayed in more detail than an infrared video. .

In addition, the graphic processing unit 500 according to a preferred embodiment of the present invention compresses a standard video shot from the standard camera 410 and/or an infrared video shot from the infrared camera 420 according to the control of the system controller 200. It may be compressed in a format (eg, mp4) and transmitted to the data storage unit 700.

The display screen 600 according to a preferred embodiment of the present invention includes a transparent thin film elecroluminescent (TFEL), a transparent organic light-emitting diode (OLED), and a liquid crystal display (LCD), in which transparency can be adjusted by a user. ), a transmissive transparent display, and a transparent light emitting diode (LED) display. In this case, the transparency of the display screen 600 may be adjusted by manipulation of the inner ear fine adjustment unit 120 of the user manipulation unit 100. In a preferred embodiment of the present invention, by employing a transparent display as described above, it is possible to provide a display screen for safe driving of a vehicle while sufficiently securing a front view.

The data storage unit 700 according to the present invention includes a video storage unit 710 and a setting value storage unit 720, and includes a flash memory type, a hard disk type, and a multimedia device. Card, multimedia card micro type, card type memory (for example, SD or XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory, ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), magnetic memory, magnetic disk, and optical disk.

The moving picture storage unit 710 stores moving picture data compressed and transmitted by the graphic storage unit 500. In this case, as the compression method, a conventional A/V compression method including, for example, MPEG4, AVI, H.264, etc. may be applied. On the other hand, even if a video is compressed, its capacity is large, so the video storage unit 710 uses a memory device module that is attached to and detached from the memory interface of the vehicle black box as a nonvolatile memory device, so that the limited capacity can be repeatedly recorded. It may be driven in a circular buffer or a ring buffer method.

On the other hand, the video storage unit 710 is not subject to structural restrictions even if the display screen 600 is configured to be opened and closed in the vehicle's sun visor method or the screen is displayed on the front windshield of the vehicle in the HUD (Head Up Display) method. An external memory separately provided in the vehicle may be used, and the standard camera 410 and the infrared camera 420 of the moving picture photographing unit 400 may be separately mounted inside the vehicle like the moving picture storage unit 710. By this moving picture storage unit 710, the display device for safe driving of a vehicle according to the present invention functions as a vehicle black box at the same time, and when driving at night with poor visibility compared to a conventional vehicle black box, heavy snow, fog, and fine dust , Even in the event of bad weather such as yellow sand, rain, etc., it is possible to clearly check the occurrence of an accident by storing a video that clearly captures the situation around the vehicle.

The set value storage unit 720 includes a control operation and control amount of the system controller 200 according to various manipulation signals in the user manipulation unit 100, a control operation and control amount according to each detection signal in the detection sensor unit 300, and a standard camera. Including the on/off control of the 410 and the infrared camera 420, the screen switching control of the display screen 600, the compression format and the compression ratio in the graphic processing unit 500, the display device for vehicle safety operation according to the present invention A control program or control application required for overall control and control data are stored.

The housing 800 is equipped with a user operation unit 100 and a display screen 600, and may be equipped with a main mode, a camera, a touch panel, etc., which are not shown, and is attached to the ceiling of a vehicle by, for example, a rotor, etc. Therefore, it can be opened to the driver's view only when the driver needs it, and it can be adjusted to suit the driver's view by changing the attachment position, such as moving up, down, left and right, if necessary.

Meanwhile, in another embodiment of the present invention, the display screen 600 is not mounted on the housing 800, but is implemented as a front display device of a HUD (Head Up Display) type, and is configured to be displayed on the front windshield of the vehicle. It could be. In this case, the standard camera 410 and the infrared camera 420 of the moving picture photographing unit 400 may be provided on a predetermined portion of a vehicle window or dashboard.

According to the above description, focusing on the operation described by the system control unit 200, the user operation unit 100, the detection sensor unit 300, the video capture unit 400, the graphic processing unit 500, and the display screen 600 , The display device for safe driving of a vehicle according to the present invention is operated by an operation in which the data storage unit 700 is linked to each other, thereby assisting the driver to drive the vehicle more safely. In addition, with respect to the operation process of the display device for safe driving of a vehicle according to the present invention, the linkage operation of each constituent member has already been sufficiently described, focusing on the operation described in the system control unit 200, so that unnecessary redundancy Description is omitted.

The display device for safe driving of a vehicle and a driving method thereof according to the present invention described above include various exemplary logics, logic blocks, modules, and circuits, including a general-purpose processor, a digital signal processor (DSP), and an application-specific integrated circuit (ASIC). , Field programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or a combination of those designed to perform these functions.

A general purpose processor may be a microprocessor, but in an alternative embodiment, such a processor may be a conventional processor, controller, microcontroller. The processor may also be implemented as a combination of computing devices, such as, for example, a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in combination with a DSP core, or a combination of these configurations.

Here, the steps of the method or algorithm described above in connection with the disclosed embodiment may be directly implemented by hardware, a software module executed by a processor, or a combination thereof. The software module resides in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, portable disk, CD-ROM, or any form of storage media known in the art. An exemplary storage medium is coupled with a processor, where the processor reads information from the storage medium and writes the information to the storage medium. Alternatively, the storage medium can be integrated into the processor. These processors and storage media are located in the ASIC. The ASIC can be located in the user terminal. Alternatively, the processor and storage medium may exist as discrete components in the user terminal.

The description of the presented embodiments is provided so that a person of ordinary skill in the technical field of the present invention can use or implement the present invention. Various modifications to these embodiments will be apparent to those of ordinary skill in the art.

Thus, the present invention is not to be limited to the embodiments presented herein, but is to be construed in the widest scope consistent with the principles and novel features presented herein. Also, the word “exemplary” is used herein to mean serving as an example, example, or description.

Accordingly, the preferred embodiments shown and described herein can be variously changed, modified, and modified without departing from the spirit and scope of the present invention, particularly essential characteristics. That is, matters disclosed and described in the present specification are exemplary of the appended claims, and the scope of the present invention is not limited thereto, and the present invention may specify the scope only by the appended claims.

Further, similar to how the components of the present invention can be implemented with software programming or software elements, embodiments include various algorithms implemented with a combination of data structures, processes, routines or other programming configurations, including C. , C++, Java, assembler, etc. can be implemented in a programming or scripting language. Functional aspects can be implemented with an algorithm running on one or more processors. Further, the embodiments may employ conventional techniques for electronic environment setting, signal processing, and/or data processing. Terms such as "mechanism", "element", "means", and "configuration" may be used broadly, and are not limited to mechanical and physical configurations. The term may include the meaning of a series of routines of software in connection with a processor or the like.

100: user control panel
110: shooting mode selection unit
120: fine adjustment unit
200: system control unit
300: detection sensor unit
310: rain detection sensor
320: illuminance detection sensor
330: fog detection sensor
400: video recording unit
410: standard camera
420: infrared camera
500: graphic processing unit
600: display screen
700: data storage unit
710: video storage unit
720: setting value storage unit
800: housing

Claims (5)

In a display device for safe driving of a vehicle that helps secure a driver's view in an environment where it is difficult to secure a view,
A user manipulation unit that generates a manipulation signal corresponding to the driver's manipulation;
A standard camera for shooting a standard video in front of the vehicle;
An infrared camera for photographing an infrared video in front of the vehicle;
A graphic processing unit for signal processing and compression of the standard video or infrared video captured by the standard camera or the infrared camera;
A detection sensor unit that senses an environment around the vehicle;
A display screen for displaying a video signal processed by the graphic processing unit; And
Based on the driver's manipulation and/or the detection signal from the detection sensor unit, the standard camera and/or the infrared camera control start and stop of shooting, and control signal processing of the graphic processing unit, so that the display screen Including; a system control unit for controlling a screen displayed on,
The detection sensor unit includes a raindrop detection sensor for detecting raindrops falling around the vehicle, and when the raindrops are detected by the raindrop detection sensor more than a preset amount, the system controller controls the focal point of the standard camera to a preset focal length. A display device for safe driving of a vehicle, characterized in that controlling the standard camera to take an out-of-focused video.
The method of claim 1,
The detection sensor unit,
An illuminance sensor for detecting brightness around the vehicle; And
A display device for safe driving of a vehicle further comprising a; fog detection sensor for detecting fine particles contained in the air around the vehicle.
The method of claim 2,
When the illuminance detection sensor detects that it is dark below the preset illuminance, or when the fog detection sensor detects fine particles in the air above a preset concentration, the system controller activates the infrared camera, and the display screen displays A display device for safe driving of a vehicle, characterized in that controlling to display an infrared video.
The method of claim 2,
When the illuminance detection sensor detects that it is dark below the preset illuminance, or when the fog detection sensor detects fine particles in the air above a preset concentration, the system control unit operates the standard camera and the infrared camera, The display device for safe driving of a vehicle, characterized in that the graphic processing unit synchronizes and synthesizes the video captured by the standard camera and the video captured by the infrared camera, and controls the combined screen to be displayed on the display screen.
delete

Images