KR20150055181A - Apparatus for displaying night vision information using head-up display and method thereof - Google Patents

Apparatus for displaying night vision information using head-up display and method thereof Download PDF

Info

Publication number
KR20150055181A
KR20150055181A KR1020130136700A KR20130136700A KR20150055181A KR 20150055181 A KR20150055181 A KR 20150055181A KR 1020130136700 A KR1020130136700 A KR 1020130136700A KR 20130136700 A KR20130136700 A KR 20130136700A KR 20150055181 A KR20150055181 A KR 20150055181A
Authority
KR
South Korea
Prior art keywords
display
night vision
image
head
displaying
Prior art date
Application number
KR1020130136700A
Other languages
Korean (ko)
Inventor
오형석
이준묵
양지혁
금병직
Original Assignee
현대오트론 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 현대오트론 주식회사 filed Critical 현대오트론 주식회사
Priority to KR1020130136700A priority Critical patent/KR20150055181A/en
Publication of KR20150055181A publication Critical patent/KR20150055181A/en

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/48—Thermography; Techniques using wholly visual means
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Instrument Panels (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The present invention relates to an apparatus and method for displaying night vision information using a head-up display, the apparatus including a head-up display, a night vision for capturing a heat sensed image of a front object, and an image captured through the night vision Up display to match the coordinates of the night vision image, and if the object is within the display area of the head-up display screen according to the result of the coordinate matching, And a control unit for displaying an indicator image for warning in accordance with the actual position.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and a method for displaying night vision information using a head-

The present invention relates to an apparatus and method for displaying night vision information using a head-up display, and more particularly, to an apparatus and method for displaying night vision information using a head-up display, And more particularly, to a night vision information display apparatus and method using a head-up display.

In recent years, most vehicles have been equipped with a navigation system, which allows the driver to provide the destination and route guidance. In recent years, the user has also been able to project desired information to the windshield of the vehicle, Vehicles with a head-up display (HUD) are also on the market. Further, studies are being conducted to enable specific information to be displayed in the form of an augmented reality through the head-up display.

The Augmented Reality (AR) is a technique for superimposing a three-dimensional virtual object on the real world viewed by the user, and displays a virtual world having additional information in real time in a real world together as a single image. (Mixed Reality, MR).

However, the conventional head-up display merely displayed navigation information on the head-up display. In other words, even at night when there is a risk of safety accidents, only the navigation information is displayed on the head-up display just like the daytime. In other words, the conventional head-up display has a problem that information for preventing safety accidents at night is not displayed as an augmented reality.

Therefore, in recent vehicles, a night vision system may be installed as a system for providing information to the driver to prevent safety accidents at night as described above. The night vision system is a safety device that improves the safety of a vehicle by providing visual information that far exceeds the human visual ability in the dark and allowing the driver to sense a dangerous situation.

In other words, visibility at night is so low that driving at night is much more dangerous than during the day, but until now, the only thing we can do is turn on the headlights and run more slowly. In order to compensate for this, Night Vision is a technology applied to a vehicle that has been developed for military use and was limited in use.

However, the head-up display and the night vision are mounted on the vehicle as separate systems and perform independent functions. However, they do not provide a function of assisting the safe driving of the user in the nighttime by combining the functions of the two systems .

BACKGROUND ART [0002] The background art of the present invention is disclosed in Korean Patent Laid-Open No. 10-2009-0076242 (published on Jul. 31, 2009, a head-up display device for a vehicle and an operation control method thereof).

The present invention has been made to solve the above problems, and it is an object of the present invention to provide a head-up display capable of displaying information detected through a night vision at nighttime or in a bad weather weather condition by using a warning indicator image in accordance with a driver's vision, And an object of the present invention is to provide a night vision information display apparatus and method using the same.

A night vision information display apparatus using a head-up display according to an aspect of the present invention includes: a head-up display; Night Vision for shooting thermographic images of forward objects; And an image picked up through the night vision to detect an object in front of the vehicle. The image of the head-up display is matched with the coordinates of the night vision image, and according to the coordinate matching result, And a controller for displaying a warning indicator image.

In the present invention, the controller may display an alarm indicator image indicating an actual direction in which the object exists when the object is outside the display area of the head-up display screen.

In the present invention, the controller may display an on / off state of the night vision on the head-up display screen by confirming the on / off state of the night vision.

In the present invention, the warning indicator image is an image for allowing the driver to recognize the actual position of the object sensed in the night vision image. The warning indicator image may include a shape surrounding the whole or part of the object, And a virtual shape to be replaced.

In the present invention, the warning indicator image may include at least one or more of at least one of a flicker, a zoom, a three-dimensional effect, and a color fill in order to improve a warning effect, The effect is added.

According to another aspect of the present invention, there is provided a method of displaying night vision information using a head-up display, comprising: capturing a thermally sensed image of a front object through a night vision; The control unit processes the photographed image to detect an object in front of the vehicle; Matching the image coordinates of the night vision to a screen of the head-up display; And displaying the warning indicator image as augmented reality on the screen of the head-up display depending on whether the detected object is inside or outside the display area of the head-up display screen after the coordinate matching .

The present invention is characterized in that, when the object is inside the display area of the head-up display screen, the controller displays an indicator image for warning according to the actual position of the object.

The present invention is characterized in that, when the object is outside the display area of the head-up display screen, the control part displays the warning indicator image indicating the actual direction in which the object exists.

The present invention further includes a step of the on / off state of the night vision to display the on / off state of the night vision on the head-up display screen.

In the present invention, the warning indicator image is an image for allowing the driver to recognize the actual position of the object sensed in the night vision image. The warning indicator image may include a shape surrounding the whole or part of the object, At least one or more colors are added, the size and the contrast thereof are adjusted, and at least one of the flickering, zooming, three-dimensional effect, and color filling is added .

According to the present invention, information detected through a night vision during nighttime or weather can be displayed as an augmented reality by using a warning indicator image in accordance with the driver's vision, thereby performing safe operation even in nighttime and in bad weather where the visibility of the driver is low .

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram illustrating a schematic configuration of a night vision information display apparatus using a head-up display according to an embodiment of the present invention; FIG.
2 is a flowchart illustrating a night vision information display method using a head-up display according to an embodiment of the present invention.
Fig. 3 is an exemplary view for explaining a method of displaying night vision information in Fig. 2; Fig.

Hereinafter, an embodiment of an apparatus and method for displaying night vision information using a head-up display according to the present invention will be described with reference to the accompanying drawings.

In this process, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation. In addition, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention or custom of the user, the operator. Therefore, definitions of these terms should be made based on the contents throughout this specification.

FIG. 1 is a diagram illustrating a schematic configuration of a night vision information display apparatus using a head-up display according to an embodiment of the present invention.

1, a night vision information display apparatus 100 using a head-up display according to an embodiment of the present invention includes a camera unit 110, a night vision unit 120, a control unit 130, And a display 140.

The camera unit 110 includes at least one camera including a digital image sensor as means for capturing an image in front of the vehicle.

The camera unit 110 captures an image of a walking direction (or a direction of the vehicle) to obtain an image of a pedestrian (or an obstacle).

In the present embodiment, it is possible to detect a lane (or a lane) or to photograph a building, an object, an animal, a pedestrian, etc. in the vicinity of the road.

For example, the camera may include a Far Infra Red (FIR) camera and / or a CMOS camera (or a CCD camera).

For reference, the CMOS camera (or a CCD camera) captures light similar to that of a human eye because it acts to sense and project light in a visible light region. The FIR camera acquires an image by projecting light in an infrared band that a person can not see. Particularly, the FIR band has the advantage of distinguishing the temperature because the wavelength changes according to the temperature.

The camera unit 110 is not limited to the camera described above, and may further include a camera capable of detecting lanes in other manners (e.g., laser projection, etc.).

In this embodiment, the night vision function may be implemented using the camera unit 110. [ However, since a night vision system (hereinafter referred to as Night Vision) specialized in night image photography has already been introduced, in the present embodiment, the night vision of the object during the nighttime driving using the night vision function different from the function of the camera unit 110 For example, an animal, a pedestrian, a vehicle, etc.).

The night vision apparatus 120 photographs and outputs a heat sensed image of an object (for example, an animal, a pedestrian, a vehicle, etc.) in order to supplement a driver's visual cognition function at night when visibility is low.

The night vision 120 detects a heat sensed signal emitted (or reflected) from an object (for example, an animal, a pedestrian, a vehicle, etc.) in the viewing direction (or the vehicle traveling direction) and amplifies and outputs the sensed signal.

It is possible to detect lanes even in an image photographed through the night vision 120 and improve the detection accuracy by combining with a lane or an object image detected through the camera unit 110. [

The control unit 130 includes an object detection unit 131, a coordinate matching unit 132, an indicator image generation unit 133, and an indicator image output unit 134. The configuration units 131 to 134 may perform the corresponding functions separately or may integrate all the functions in the control unit 130. For convenience, the functions of the respective constituent units 131 to 134 will be described separately in this embodiment.

The object detection unit 131 analyzes information inputted from at least one of the camera unit 110 and the night vision 120 to detect and recognize an object such as an animal, a pedestrian, a vehicle, and the like.

For example, when the night vision system 120 is turned off or is in the daytime even though it is nighttime, the information (image) input from the camera unit 110 is processed to detect an object (e.g., an animal, a pedestrian, And the information output from the night vision 120 is used as main information when the night vision 120 is turned on and the information And can be used as supplementary information for improving the accuracy of detection. Therefore, in the present embodiment, a method of processing and displaying the information output from the night vision unit 120 will be mainly described.

The coordinate matching unit 132 matches the coordinates of the image photographed from the night vision 120 and the coordinates of the head up display 140 to output the image of the night vision 120.

So that the warning indicator image can be outputted in accordance with the viewpoint of the driver (the position of the actual object) through the coordinate matching.

The indicator image generator 133 generates a warning indicator image for informing the driver of the position of the object detected through the night vision 120. [ For example, the warning indicator image may include a shape (e.g., a box, a circle, a polygon, etc.) surrounding the entire or part of the object, a shape (e.g., arrows, fingers, asterisks, etc.) (E.g., an icon, a character, an emoticon, and the like).

The indicator image generator 133 may add and adjust various colors, sizes, and contrasts to the warning indicator image.

The indicator image output unit 134 may add special effects (e.g., flicker, zoom, color fill, etc.) to the generated warning indicator image to improve the warning effect on the driver.

The indicator image output unit 134 adds a three-dimensional effect (e.g., depth adjustment) to the warning indicator image so that it can be displayed around the detected object as if there is an indicator image for warning.

(Not shown) for detecting the presence and position of the object in a manner other than the night vision 120 in order to determine a more accurate position of the object. Or at least one or more sensors (not shown) already installed in the vehicle may be used for the detection of the object.

For example, as shown in FIG. 3, when an object is detected through a night vision during night driving, an apparatus according to an embodiment of the present invention detects the position of the detected object (e.g., inside / outside of the HUD area) Depending on the size, you can display an alert indicator image that surrounds the object, or display an alternate image (such as an icon). The on / off state of the night vision NV is displayed on the screen of the head-up display 140 so that the driver can recognize the on / off state of the night vision NV. At this time, the warning indicator image (or the substitute image) is displayed as an augmented reality in accordance with the user's time (actual position of the object) by adding a special effect that can focus the driver's time on the object.

The head-up display 140 displays the night vision information (for example, the warning indicator image (or the substitute image)) output from the controller 130 as an augmented reality according to the time of the user (actual position of the object).

FIG. 2 is a flowchart for explaining a night vision information display method using a head-up display according to an embodiment of the present invention. FIG. 3 is an exemplary view for explaining a method of displaying night vision information in FIG. to be. Hereinafter, a method of displaying the night vision information during the night driving by blending the night vision information with the head-up display will be described with reference to FIGS. 2 and 3. FIG.

2, the controller 130 confirms the ON / OFF state of the night vision (NV) 120 (S101).

The on / off state of the night vision 120 is displayed on the head-up display (HUD) 140 according to the detected state (S102).

In the present embodiment, a case where the night vision 120 is turned on will be described.

The control unit 130 processes information (image) detected through the night vision 120 to detect an object (e.g., an animal, a pedestrian, a vehicle, etc.) in front of the vehicle (S103).

For the sake of convenience, in this embodiment, it is assumed that it is detected whether or not there is a pedestrian, as shown in Fig.

When the object (i.e., a pedestrian) is detected through the night vision 120 during the night driving (YES in step S103), the controller 130 controls the display of the head-up display 140 and the image of the night vision 120 Coordinates are matched (S104).

After the coordinates of the head-up display 140 and the night vision 120 are matched, it is determined whether or not the object (i.e., a pedestrian) is within the display area of the head-up display 140 S105).

In other words, when the object (i.e., a pedestrian) detected through the night vision 120 is within the display area of the head-up display 140 according to the coordinate matching result (YES in S105) That is, a pedestrian) (S106) (see Fig. 3).

However, if the object (i.e., a pedestrian) detected through the night vision 120 is outside the display area of the head-up display 140 (No in S105) (E.g., a substitute image, a pedestrian icon, etc.) in accordance with a direction (e.g., upper, lower, left, right, etc.) ).

3 shows that an object (i.e., a pedestrian) sensed through the night vision 120 spans a boundary portion of the screen of the head-up display 140. However, if an entire object (i.e., a pedestrian) If it is outside, display the warning indicator image (A: alternate image, pedestrian icon, etc.) indicating that the object exists in accordance with the direction of the object.

At this time, the head-up display 140 may use an AR-HUD (AR-HUD) to display the warning indicator image and the object image as an augmented reality according to the position and direction of the object.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. I will understand. Accordingly, the technical scope of the present invention should be defined by the following claims.

110: camera unit 120: night vision
130: control unit 131: object detection unit
132: Coordinate matching unit 133: Indicator image generating unit
134: Indicator image output section 140: Head-up display

Claims (10)

Head-up display;
Night Vision for shooting thermographic images of forward objects; And
Up display and a night vision image; and a display unit for displaying an image of the head-up display on the basis of the coordinates of the night vision image, And a controller for displaying a warning indicator image on the night vision information display.
The apparatus of claim 1,
And displays a warning indicator image indicating an actual direction in which the object exists when the object is outside the display area of the head-up display screen.
The apparatus of claim 1,
And the on / off state of the night vision is displayed on the head-up display screen by confirming the on / off state of the night vision.
The image display apparatus according to claim 1 or 2,
An image for recognizing the actual position of the object sensed in the night vision image to the driver,
A shape surrounding the whole or part of the object, a shape indicating the object, and a virtual shape replacing the object.
5. The apparatus of claim 4, wherein the warning indicator image comprises:
At least one color is added, the size and contrast are adjusted,
Wherein the at least one special effect is added to at least one of a flicker, a zoom effect, a three-dimensional effect, and a color fill in order to improve a warning effect.
Sensing a thermal sense image of a forward object through a night vision;
The control unit processes the photographed image to detect an object in front of the vehicle;
Matching the image coordinates of the night vision to a screen of the head-up display; And
And displaying the warning indicator image as an augmented reality on the screen of the head-up display depending on whether the sensed object is inside or outside the display area of the head-up display screen after the coordinate matching And displaying night vision information using the head-up display.
The method according to claim 6,
When the object is inside the display area of the head-up display screen,
And the control unit displays the warning indicator image in accordance with the actual position of the object.
The method according to claim 6,
When the object is outside the display area of the head-up display screen,
Wherein the control unit displays a warning indicator image indicating an actual direction in which the object is located.
The method according to claim 6,
And displaying the on / off state of the night vision on the head-up display screen by checking the on / off state of the night vision. Way.
7. The apparatus of claim 6, wherein the warning indicator image comprises:
An image for recognizing the actual position of the object sensed in the night vision image to the driver,
At least one or more colors are added, the size and the contrast of the object are adjusted, and the size and the contrast of the object are adjusted.
Wherein at least one special effect is added to at least one of a flicker, a zoom, a three-dimensional effect, and a color fill.
KR1020130136700A 2013-11-12 2013-11-12 Apparatus for displaying night vision information using head-up display and method thereof KR20150055181A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020130136700A KR20150055181A (en) 2013-11-12 2013-11-12 Apparatus for displaying night vision information using head-up display and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130136700A KR20150055181A (en) 2013-11-12 2013-11-12 Apparatus for displaying night vision information using head-up display and method thereof

Publications (1)

Publication Number Publication Date
KR20150055181A true KR20150055181A (en) 2015-05-21

Family

ID=53390835

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130136700A KR20150055181A (en) 2013-11-12 2013-11-12 Apparatus for displaying night vision information using head-up display and method thereof

Country Status (1)

Country Link
KR (1) KR20150055181A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20170133747A (en) * 2016-05-26 2017-12-06 현대자동차주식회사 Method for Displaying Information using in Augmented Reality Head-up Display System
KR20190053612A (en) 2017-11-10 2019-05-20 현대오트론 주식회사 Apparatus for tracking vehicle and operating method thereof
US10539790B2 (en) 2015-11-24 2020-01-21 Hyundai Autron Co., Ltd. Coordinate matching apparatus for head-up display
US10696226B2 (en) 2017-12-27 2020-06-30 Toyota Research Institute, Inc. Vehicles and methods for displaying objects located beyond a headlight illumination line

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10539790B2 (en) 2015-11-24 2020-01-21 Hyundai Autron Co., Ltd. Coordinate matching apparatus for head-up display
KR20170133747A (en) * 2016-05-26 2017-12-06 현대자동차주식회사 Method for Displaying Information using in Augmented Reality Head-up Display System
KR20190053612A (en) 2017-11-10 2019-05-20 현대오트론 주식회사 Apparatus for tracking vehicle and operating method thereof
US10696226B2 (en) 2017-12-27 2020-06-30 Toyota Research Institute, Inc. Vehicles and methods for displaying objects located beyond a headlight illumination line

Similar Documents

Publication Publication Date Title
JP3855439B2 (en) Night driving visibility support device
KR101511587B1 (en) Apparatus for displaying information of head-up display and method thereof
CN107850944B (en) Method for operating data glasses in a motor vehicle and system comprising data glasses
JP6806097B2 (en) Image display device and image display method
WO2015163205A1 (en) Vehicle display system
JP4702348B2 (en) In-vehicle image display device
KR101349025B1 (en) Lane image composite device and method for smart night view
JP2010130646A (en) Vehicle periphery checking system
JP2003200755A (en) Displaying device for vehicle
JP2010234851A (en) Display device for vehicle
JP2008018760A (en) Driving support device
JP4103518B2 (en) In-vehicle image display device
JP2015226304A (en) Projection device for vehicle and head-up display system
WO2018159019A1 (en) Bird's-eye-view video image generation device, bird's-eye-view video image generation system, bird's-eye-view video image generation method, and program
KR20150055181A (en) Apparatus for displaying night vision information using head-up display and method thereof
JP5131152B2 (en) Visual support device
JP2017056909A (en) Vehicular image display device
CN108725321A (en) Information presentation device
JP3884815B2 (en) Vehicle information display device
KR20170065738A (en) Apparatus for controlling head up display and method thereof
JP2016031603A (en) Display system for vehicle
KR20150055183A (en) Apparatus for displaying traffic lane using head-up display and method thereof
JP2009230225A (en) Periphery monitoring device for vehicle
KR101767435B1 (en) Displaying control apparatus of head up display and method thereof
KR101786581B1 (en) Displaying control apparatus of head up display

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
AMND Amendment
E601 Decision to refuse application
AMND Amendment