KR20150055181A - Apparatus for displaying night vision information using head-up display and method thereof - Google Patents
Apparatus for displaying night vision information using head-up display and method thereof Download PDFInfo
- Publication number
- KR20150055181A KR20150055181A KR1020130136700A KR20130136700A KR20150055181A KR 20150055181 A KR20150055181 A KR 20150055181A KR 1020130136700 A KR1020130136700 A KR 1020130136700A KR 20130136700 A KR20130136700 A KR 20130136700A KR 20150055181 A KR20150055181 A KR 20150055181A
- Authority
- KR
- South Korea
- Prior art keywords
- display
- night vision
- image
- head
- displaying
- Prior art date
Links
- 230000004297 night vision Effects 0.000 title claims abstract description 88
- 238000000034 method Methods 0.000 title claims abstract description 22
- 230000000694 effects Effects 0.000 claims description 14
- 230000003190 augmentative effect Effects 0.000 claims description 9
- 239000003086 colorant Substances 0.000 claims description 3
- 238000004148 unit process Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 description 11
- 241001465754 Metazoa Species 0.000 description 7
- 238000001514 detection method Methods 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000004438 eyesight Effects 0.000 description 2
- 230000019771 cognition Effects 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/48—Thermography; Techniques using wholly visual means
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Instrument Panels (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The present invention relates to an apparatus and method for displaying night vision information using a head-up display, the apparatus including a head-up display, a night vision for capturing a heat sensed image of a front object, and an image captured through the night vision Up display to match the coordinates of the night vision image, and if the object is within the display area of the head-up display screen according to the result of the coordinate matching, And a control unit for displaying an indicator image for warning in accordance with the actual position.
Description
The present invention relates to an apparatus and method for displaying night vision information using a head-up display, and more particularly, to an apparatus and method for displaying night vision information using a head-up display, And more particularly, to a night vision information display apparatus and method using a head-up display.
In recent years, most vehicles have been equipped with a navigation system, which allows the driver to provide the destination and route guidance. In recent years, the user has also been able to project desired information to the windshield of the vehicle, Vehicles with a head-up display (HUD) are also on the market. Further, studies are being conducted to enable specific information to be displayed in the form of an augmented reality through the head-up display.
The Augmented Reality (AR) is a technique for superimposing a three-dimensional virtual object on the real world viewed by the user, and displays a virtual world having additional information in real time in a real world together as a single image. (Mixed Reality, MR).
However, the conventional head-up display merely displayed navigation information on the head-up display. In other words, even at night when there is a risk of safety accidents, only the navigation information is displayed on the head-up display just like the daytime. In other words, the conventional head-up display has a problem that information for preventing safety accidents at night is not displayed as an augmented reality.
Therefore, in recent vehicles, a night vision system may be installed as a system for providing information to the driver to prevent safety accidents at night as described above. The night vision system is a safety device that improves the safety of a vehicle by providing visual information that far exceeds the human visual ability in the dark and allowing the driver to sense a dangerous situation.
In other words, visibility at night is so low that driving at night is much more dangerous than during the day, but until now, the only thing we can do is turn on the headlights and run more slowly. In order to compensate for this, Night Vision is a technology applied to a vehicle that has been developed for military use and was limited in use.
However, the head-up display and the night vision are mounted on the vehicle as separate systems and perform independent functions. However, they do not provide a function of assisting the safe driving of the user in the nighttime by combining the functions of the two systems .
BACKGROUND ART [0002] The background art of the present invention is disclosed in Korean Patent Laid-Open No. 10-2009-0076242 (published on Jul. 31, 2009, a head-up display device for a vehicle and an operation control method thereof).
The present invention has been made to solve the above problems, and it is an object of the present invention to provide a head-up display capable of displaying information detected through a night vision at nighttime or in a bad weather weather condition by using a warning indicator image in accordance with a driver's vision, And an object of the present invention is to provide a night vision information display apparatus and method using the same.
A night vision information display apparatus using a head-up display according to an aspect of the present invention includes: a head-up display; Night Vision for shooting thermographic images of forward objects; And an image picked up through the night vision to detect an object in front of the vehicle. The image of the head-up display is matched with the coordinates of the night vision image, and according to the coordinate matching result, And a controller for displaying a warning indicator image.
In the present invention, the controller may display an alarm indicator image indicating an actual direction in which the object exists when the object is outside the display area of the head-up display screen.
In the present invention, the controller may display an on / off state of the night vision on the head-up display screen by confirming the on / off state of the night vision.
In the present invention, the warning indicator image is an image for allowing the driver to recognize the actual position of the object sensed in the night vision image. The warning indicator image may include a shape surrounding the whole or part of the object, And a virtual shape to be replaced.
In the present invention, the warning indicator image may include at least one or more of at least one of a flicker, a zoom, a three-dimensional effect, and a color fill in order to improve a warning effect, The effect is added.
According to another aspect of the present invention, there is provided a method of displaying night vision information using a head-up display, comprising: capturing a thermally sensed image of a front object through a night vision; The control unit processes the photographed image to detect an object in front of the vehicle; Matching the image coordinates of the night vision to a screen of the head-up display; And displaying the warning indicator image as augmented reality on the screen of the head-up display depending on whether the detected object is inside or outside the display area of the head-up display screen after the coordinate matching .
The present invention is characterized in that, when the object is inside the display area of the head-up display screen, the controller displays an indicator image for warning according to the actual position of the object.
The present invention is characterized in that, when the object is outside the display area of the head-up display screen, the control part displays the warning indicator image indicating the actual direction in which the object exists.
The present invention further includes a step of the on / off state of the night vision to display the on / off state of the night vision on the head-up display screen.
In the present invention, the warning indicator image is an image for allowing the driver to recognize the actual position of the object sensed in the night vision image. The warning indicator image may include a shape surrounding the whole or part of the object, At least one or more colors are added, the size and the contrast thereof are adjusted, and at least one of the flickering, zooming, three-dimensional effect, and color filling is added .
According to the present invention, information detected through a night vision during nighttime or weather can be displayed as an augmented reality by using a warning indicator image in accordance with the driver's vision, thereby performing safe operation even in nighttime and in bad weather where the visibility of the driver is low .
BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram illustrating a schematic configuration of a night vision information display apparatus using a head-up display according to an embodiment of the present invention; FIG.
2 is a flowchart illustrating a night vision information display method using a head-up display according to an embodiment of the present invention.
Fig. 3 is an exemplary view for explaining a method of displaying night vision information in Fig. 2; Fig.
Hereinafter, an embodiment of an apparatus and method for displaying night vision information using a head-up display according to the present invention will be described with reference to the accompanying drawings.
In this process, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation. In addition, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention or custom of the user, the operator. Therefore, definitions of these terms should be made based on the contents throughout this specification.
FIG. 1 is a diagram illustrating a schematic configuration of a night vision information display apparatus using a head-up display according to an embodiment of the present invention.
1, a night vision
The
The
In the present embodiment, it is possible to detect a lane (or a lane) or to photograph a building, an object, an animal, a pedestrian, etc. in the vicinity of the road.
For example, the camera may include a Far Infra Red (FIR) camera and / or a CMOS camera (or a CCD camera).
For reference, the CMOS camera (or a CCD camera) captures light similar to that of a human eye because it acts to sense and project light in a visible light region. The FIR camera acquires an image by projecting light in an infrared band that a person can not see. Particularly, the FIR band has the advantage of distinguishing the temperature because the wavelength changes according to the temperature.
The
In this embodiment, the night vision function may be implemented using the
The
The
It is possible to detect lanes even in an image photographed through the
The
The
For example, when the
The coordinate matching
So that the warning indicator image can be outputted in accordance with the viewpoint of the driver (the position of the actual object) through the coordinate matching.
The
The
The indicator
The indicator
(Not shown) for detecting the presence and position of the object in a manner other than the
For example, as shown in FIG. 3, when an object is detected through a night vision during night driving, an apparatus according to an embodiment of the present invention detects the position of the detected object (e.g., inside / outside of the HUD area) Depending on the size, you can display an alert indicator image that surrounds the object, or display an alternate image (such as an icon). The on / off state of the night vision NV is displayed on the screen of the head-up
The head-up
FIG. 2 is a flowchart for explaining a night vision information display method using a head-up display according to an embodiment of the present invention. FIG. 3 is an exemplary view for explaining a method of displaying night vision information in FIG. to be. Hereinafter, a method of displaying the night vision information during the night driving by blending the night vision information with the head-up display will be described with reference to FIGS. 2 and 3. FIG.
2, the
The on / off state of the
In the present embodiment, a case where the
The
For the sake of convenience, in this embodiment, it is assumed that it is detected whether or not there is a pedestrian, as shown in Fig.
When the object (i.e., a pedestrian) is detected through the
After the coordinates of the head-up
In other words, when the object (i.e., a pedestrian) detected through the
However, if the object (i.e., a pedestrian) detected through the
3 shows that an object (i.e., a pedestrian) sensed through the
At this time, the head-up
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. I will understand. Accordingly, the technical scope of the present invention should be defined by the following claims.
110: camera unit 120: night vision
130: control unit 131: object detection unit
132: Coordinate matching unit 133: Indicator image generating unit
134: Indicator image output section 140: Head-up display
Claims (10)
Night Vision for shooting thermographic images of forward objects; And
Up display and a night vision image; and a display unit for displaying an image of the head-up display on the basis of the coordinates of the night vision image, And a controller for displaying a warning indicator image on the night vision information display.
And displays a warning indicator image indicating an actual direction in which the object exists when the object is outside the display area of the head-up display screen.
And the on / off state of the night vision is displayed on the head-up display screen by confirming the on / off state of the night vision.
An image for recognizing the actual position of the object sensed in the night vision image to the driver,
A shape surrounding the whole or part of the object, a shape indicating the object, and a virtual shape replacing the object.
At least one color is added, the size and contrast are adjusted,
Wherein the at least one special effect is added to at least one of a flicker, a zoom effect, a three-dimensional effect, and a color fill in order to improve a warning effect.
The control unit processes the photographed image to detect an object in front of the vehicle;
Matching the image coordinates of the night vision to a screen of the head-up display; And
And displaying the warning indicator image as an augmented reality on the screen of the head-up display depending on whether the sensed object is inside or outside the display area of the head-up display screen after the coordinate matching And displaying night vision information using the head-up display.
When the object is inside the display area of the head-up display screen,
And the control unit displays the warning indicator image in accordance with the actual position of the object.
When the object is outside the display area of the head-up display screen,
Wherein the control unit displays a warning indicator image indicating an actual direction in which the object is located.
And displaying the on / off state of the night vision on the head-up display screen by checking the on / off state of the night vision. Way.
An image for recognizing the actual position of the object sensed in the night vision image to the driver,
At least one or more colors are added, the size and the contrast of the object are adjusted, and the size and the contrast of the object are adjusted.
Wherein at least one special effect is added to at least one of a flicker, a zoom, a three-dimensional effect, and a color fill.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020130136700A KR20150055181A (en) | 2013-11-12 | 2013-11-12 | Apparatus for displaying night vision information using head-up display and method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020130136700A KR20150055181A (en) | 2013-11-12 | 2013-11-12 | Apparatus for displaying night vision information using head-up display and method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20150055181A true KR20150055181A (en) | 2015-05-21 |
Family
ID=53390835
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020130136700A KR20150055181A (en) | 2013-11-12 | 2013-11-12 | Apparatus for displaying night vision information using head-up display and method thereof |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20150055181A (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20170133747A (en) * | 2016-05-26 | 2017-12-06 | 현대자동차주식회사 | Method for Displaying Information using in Augmented Reality Head-up Display System |
KR20190053612A (en) | 2017-11-10 | 2019-05-20 | 현대오트론 주식회사 | Apparatus for tracking vehicle and operating method thereof |
US10539790B2 (en) | 2015-11-24 | 2020-01-21 | Hyundai Autron Co., Ltd. | Coordinate matching apparatus for head-up display |
US10696226B2 (en) | 2017-12-27 | 2020-06-30 | Toyota Research Institute, Inc. | Vehicles and methods for displaying objects located beyond a headlight illumination line |
-
2013
- 2013-11-12 KR KR1020130136700A patent/KR20150055181A/en active Search and Examination
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10539790B2 (en) | 2015-11-24 | 2020-01-21 | Hyundai Autron Co., Ltd. | Coordinate matching apparatus for head-up display |
KR20170133747A (en) * | 2016-05-26 | 2017-12-06 | 현대자동차주식회사 | Method for Displaying Information using in Augmented Reality Head-up Display System |
KR20190053612A (en) | 2017-11-10 | 2019-05-20 | 현대오트론 주식회사 | Apparatus for tracking vehicle and operating method thereof |
US10696226B2 (en) | 2017-12-27 | 2020-06-30 | Toyota Research Institute, Inc. | Vehicles and methods for displaying objects located beyond a headlight illumination line |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP3855439B2 (en) | Night driving visibility support device | |
KR101511587B1 (en) | Apparatus for displaying information of head-up display and method thereof | |
CN107850944B (en) | Method for operating data glasses in a motor vehicle and system comprising data glasses | |
JP6806097B2 (en) | Image display device and image display method | |
WO2015163205A1 (en) | Vehicle display system | |
JP4702348B2 (en) | In-vehicle image display device | |
KR101349025B1 (en) | Lane image composite device and method for smart night view | |
JP2010130646A (en) | Vehicle periphery checking system | |
JP2003200755A (en) | Displaying device for vehicle | |
JP2010234851A (en) | Display device for vehicle | |
JP2008018760A (en) | Driving support device | |
JP4103518B2 (en) | In-vehicle image display device | |
JP2015226304A (en) | Projection device for vehicle and head-up display system | |
WO2018159019A1 (en) | Bird's-eye-view video image generation device, bird's-eye-view video image generation system, bird's-eye-view video image generation method, and program | |
KR20150055181A (en) | Apparatus for displaying night vision information using head-up display and method thereof | |
JP5131152B2 (en) | Visual support device | |
JP2017056909A (en) | Vehicular image display device | |
CN108725321A (en) | Information presentation device | |
JP3884815B2 (en) | Vehicle information display device | |
KR20170065738A (en) | Apparatus for controlling head up display and method thereof | |
JP2016031603A (en) | Display system for vehicle | |
KR20150055183A (en) | Apparatus for displaying traffic lane using head-up display and method thereof | |
JP2009230225A (en) | Periphery monitoring device for vehicle | |
KR101767435B1 (en) | Displaying control apparatus of head up display and method thereof | |
KR101786581B1 (en) | Displaying control apparatus of head up display |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
AMND | Amendment | ||
E601 | Decision to refuse application | ||
AMND | Amendment |