KR20170056100A - Objects displaying apparatus of head up display and method thereof - Google Patents

Objects displaying apparatus of head up display and method thereof Download PDF

Info

Publication number
KR20170056100A
KR20170056100A KR1020150159209A KR20150159209A KR20170056100A KR 20170056100 A KR20170056100 A KR 20170056100A KR 1020150159209 A KR1020150159209 A KR 1020150159209A KR 20150159209 A KR20150159209 A KR 20150159209A KR 20170056100 A KR20170056100 A KR 20170056100A
Authority
KR
South Korea
Prior art keywords
visible light
infrared
unit
display
head
Prior art date
Application number
KR1020150159209A
Other languages
Korean (ko)
Inventor
오형석
금병직
Original Assignee
현대오트론 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 현대오트론 주식회사 filed Critical 현대오트론 주식회사
Priority to KR1020150159209A priority Critical patent/KR20170056100A/en
Publication of KR20170056100A publication Critical patent/KR20170056100A/en

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Arrangement of adaptations of instruments
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
    • B60R21/013—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting collisions, impending collisions or roll-over
    • B60R21/0134—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting collisions, impending collisions or roll-over responsive to imminent contact with an obstacle, e.g. using radar systems
    • G01S17/936—
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/103—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using camera systems provided with artificial illumination device, e.g. IR light source
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0183—Adaptation to parameters characterising the motion of the vehicle

Abstract

The present invention relates to an infrared ray photographing apparatus for recognizing an infrared ray object from an infrared ray image acquired through an infrared ray photographing unit for photographing the vicinity of the vehicle using infrared rays, a visible light photographing unit for photographing the vicinity of the vehicle using visible light, And a control module for recognizing the visible light object in the visible light image acquired through the photographing part, comparing the infrared light object with the visible light object, combining the infrared light object with the visible light object according to the comparison result, and displaying through the head up display part .

Description

BACKGROUND OF THE INVENTION Field of the Invention [0001] The present invention relates to an object display apparatus and a method for displaying an object on a head-

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and method for displaying an object in a head-up display, and more particularly, to an apparatus and method for displaying an object in a head-up display.

There is a disadvantage in that the information providing apparatus for the user mounted on the vehicle is distracted by the driver's attention and there is a risk of accident occurrence. A head up display (HUD) is an information providing device for solving such a problem. The head-up display can display various information provided to the driver on the top of the windshield. Accordingly, there is an advantage in that the risk of an accident can be prevented because the driver does not have to turn his or her gaze to check the information, but the position of the provided information does not coincide with the position of the actual image at the front, There is a problem in that the driver's safety and convenience may be deteriorated due to a cognitive load to recognize the displayed information.

In order to solve such a problem, an augmented reality type head-up display which coincides the positions of the images of actual objects located in the front and the information displayed in the head-up display based on the driver's view is emerging. The augmented reality type head-up display can generate a virtual graphic and display it in combination with the actual image in front of the driver, so that the information required by the driver can be recognized by the driver as if it is displayed together with the actual object in front of the driver.

The conventional head-up display as described above improves the convenience of the driver by displaying the instrument panel information and the navigation information.

In recent years, the head-up display has also been provided with a function of preventing a collision that occurs when a driver does not recognize a forward object by carelessness.

However, although the conventional head-up display displays the forward object as described above, it is often difficult to recognize the forward object in the nighttime, so that the forward object may not be sufficiently displayed.

Background Art [0002] The background art of the present invention is disclosed in Korean Patent Application Publication No. 10-2013-0104821 (2013.09.25) entitled " Vehicle Information Display System and Method ".

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to provide an object display apparatus and method of a head-up display capable of enabling a driver to accurately recognize an object ahead, .

It is another object of the present invention to provide an apparatus and method for displaying an object of a head-up display, which displays the risk of an object ahead in various ways so that the driver can visually and clearly recognize the risk.

An object display apparatus of a head-up display according to one aspect of the present invention includes an infrared ray photographing unit for photographing the vicinity of a vehicle using infrared rays; A visible light photographing unit for photographing the vicinity of the vehicle using visible light; A head up display; And a control unit for recognizing an infrared object from the infrared image acquired through the infrared ray photographing unit and recognizing a visible light object from the visible light image acquired through the visible light photographing unit, comparing the infrared object and the visible light object, And a control module which combines the infrared rays and displays the infrared rays through the head-up display unit.

The control module of the present invention may further comprise: an infrared ray object recognizing unit for recognizing the infrared ray object from the infrared ray image photographed by the infrared ray photographing unit; A visible light object recognizing unit for recognizing the visible light object from the visible light image photographed by the visible light photographing unit; A combining unit for comparing the infrared object recognized by the infrared object recognizing unit with the visible light object recognized by the visible light object recognizing unit and coupling the infrared object to the visible light object; And a display control unit for displaying the visible light object to which the infrared ray object is coupled by the coupling unit through the head-up display unit.

The combining unit of the present invention is characterized in that the position coordinates of the infrared ray object and the position coordinates of the visible ray object are compared and the infrared ray object and the visible ray object are combined based on the comparison result.

The display control unit of the present invention is characterized in that a highlight pattern is formed on the visible light object to which the infrared object is combined and is displayed through the head up display unit.

The present invention further includes a risk detection unit for detecting a risk of the visible light object to which the infrared object is coupled, wherein the display control unit displays the highlight pattern differently according to the risk of the visible light object to which the infrared object is coupled .

The display control unit of the present invention is characterized in that at least one of the size, color, and shape of the highlight pattern is adjusted according to the risk of the visible light object to which the infrared object is combined.

The display control unit of the present invention is characterized in that when the break signal is inputted, the size, color and shape of the highlight pattern are displayed as reducing the risk.

The display control unit of the present invention generates a virtual rectangle on the basis of the position coordinates of the visible light object to which the infrared ray object is coupled, transforms the generated rectangle into a diamond-shaped rectangle with a three-dimensional viewpoint and then transforms the center point of the diamond- And the emphasis pattern is displayed in a circle or an ellipse centering on the center.

The present invention may further include a position predictor for predicting a position of the visible light object coupled with the infrared object using a Kalman filter, wherein the display controller controls the position of the highlight pattern based on the position predicted by the position predictor, And the like.

According to an aspect of the present invention, there is provided a method of displaying an object position of a vehicle, comprising: photographing an infrared ray photographing unit using infrared rays around the vehicle; A step of photographing the visible light photographing unit using visible light around the vehicle; The control module recognizing an infrared object and a visible light object in an infrared image and a visible light image acquired through the infrared ray photographing unit and the visible light photographing unit, respectively; And the control module compares the infrared object with the visible light object and combines the infrared object with the visible light object according to the comparison result to display the visible light object combined with the infrared object through the head up display part .

The control module may further include a step of forming an emphasis pattern on the visible light object to which the infrared ray object is combined and displaying the emphasis pattern through the head-up display unit.

In the step of forming an emphasis pattern on the visible light object of the present invention and displaying the emphasis pattern through the head-up display unit, the control module controls the size of the highlight pattern, the color and the shape of the visible light object according to the risk of the visible light object to which the infrared object is combined At least one of which is controlled.

In the step of forming an emphasis pattern on the visible light object of the present invention and displaying the emphasis pattern through the head-up display unit, the control module displays the size, color and shape of the emphasis pattern as a risk reduction when the break signal is input .

In the step of forming a highlight pattern on the visible light object of the present invention and displaying the highlight pattern on the head up display unit, the control module generates a virtual rectangle based on the coordinates of the visible light object to which the infrared object is combined, Dimensional rectangle is transformed into a rhombic rectangle by a three-dimensional viewpoint, and then the emphasis pattern is displayed in a circular or elliptic shape with the center of the rhombic rectangle as a center.

In the step of forming a highlight pattern on the visible light object of the present invention and displaying the highlight pattern through the head up display unit, the control module predicts the position of the visible light object coupled with the infrared object using a Kalman filter, And the position of the highlight pattern is changed based on the position of the highlight pattern.

The present invention enables a driver to accurately recognize an object in front of the vehicle at night to enable safe driving.

The present invention displays the risk of a forward object in various ways so that the driver can visually and clearly recognize the risk.

1 is a block diagram of an object display apparatus of a head-up display according to an embodiment of the present invention.
2 is a block diagram of a control module according to an embodiment of the present invention.
3 is a diagram illustrating an example of displaying an object in front according to an embodiment of the present invention.
4 is a flowchart of a vehicle information display method according to an embodiment of the present invention.

Hereinafter, an apparatus and method for displaying an object of a head-up display according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In this process, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation. Further, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the user, the intention or custom of the operator. Therefore, definitions of these terms should be made based on the contents throughout this specification.

FIG. 1 is a block diagram of an object display apparatus of a head-up display according to an embodiment of the present invention. FIG. 2 is a block diagram of a control module according to an embodiment of the present invention. Fig. 8 is a diagram showing an example of displaying an object in front according to the embodiment; Fig.

1, an object display apparatus of a head-up display according to an embodiment of the present invention includes an infrared ray photographing unit 10, a visible light photographing unit 20, a control module 30 and a head up display unit 40 .

The head-up display unit 40 provides the driver with various convenience information, and displays a highlight pattern on the windshield of the vehicle.

That is, the head-up display unit 40 generates a virtual graphic and displays it in combination with the actual image in front of the driver. The head-up display unit 40 coincides the image of the real objects with the emphasis pattern on the windshield located at the front based on the driver's view. The head-up display unit 40 allows the driver to recognize that the provided information is displayed together with the actual object in front of the driver. Here, the emphasis pattern will be described later.

The infrared ray photographing unit 10 photographs the surroundings of the vehicle using infrared rays.

The visible light photographing section 20 photographs the surroundings of the vehicle using visible light.

The infrared ray photographing unit 10 and the visible light photographing unit 20 may be installed at various positions according to the structure and the shape of the vehicle and may be installed at various positions where the front region of the vehicle traveling direction can be photographed.

The control module 30 recognizes an infrared object in the infrared image signal acquired through the infrared ray photographing unit 10 and recognizes a visible light object in the visible light image signal acquired through the visible light photographing unit 20. [ Then, the control module 30 compares an infrared object with a visible light object, combines an infrared object with the visible light object according to the comparison result, and displays a highlight pattern on the visible light object according to the risk.

An infrared object is an object recognized using infrared rays, a visible light object is an object recognized using visible light, and an infrared object and a visible light object may be a pedestrian.

2, the control module 30 includes an infrared object recognition unit 11, a visible light object recognition unit 32, a coupling unit 33, a risk detection unit 34, a position prediction unit 35, 36).

The infrared object recognizing unit 11 processes the infrared image picked up by the infrared ray photographing unit 10 into a digital image signal, and recognizes an infrared object from the infrared image. The infrared object recognizing unit 11 previously stores a pattern of a feature or a shape of an object to be detected, for example, a pedestrian, detects at least one candidate object in the infrared image, and stores each detected candidate object in a pre- And recognizes the infrared object according to the comparison result. In addition, the infrared object recognizing unit 11 detects the position coordinates of the recognized infrared object.

The visible light object recognizing unit 32 processes the visible light image photographed by the visible light photographing unit 20, converts the visible light image into a digital image signal, and recognizes the visible light object in the visible light image. The visible light object recognizing unit 32 previously stores a pattern of a feature or a shape of an object to be detected, detects at least one candidate object in the visible light image, compares each detected candidate object with a previously stored pattern, Accordingly, the visible light object is recognized. In addition, the visible light object recognizing unit 32 detects the position coordinates of the recognized visible light object.

Here, the visible light object is recognized by the visible light object recognizing part 32, and actually exists in front of the vehicle.

However, the driver may not visually recognize the visible light object at night. That is, even if the visible light object is recognized by the visible light object recognizing part 32, it can not be seen that the driver visually confirmed the visible light object.

Therefore, it is possible to recognize an object that the driver can not visually confirm at night by displaying an emphasis pattern on the visible light object according to the risk by combining the infrared object with the visible light object which the driver can check and warning the driver .

The combining unit 33 compares an infrared object recognized by the infrared object recognizing unit 11 with a visible light object recognized by the visible light object recognizing unit 32 to combine the infrared object with the visible light object.

More specifically, the joining unit 33 receives the position coordinates of the infrared ray object from the infrared ray object recognizing unit 11 and receives the coordinates of the visible ray object position from the visible ray object recognizing unit 32.

The combining unit 33 compares the position coordinates of the infrared ray object with the position coordinates of the visible ray object, and detects the infrared ray object and the visible ray object whose position coordinates coincide with each other. Then, the coupling unit 33 couples the infrared ray object and the visible ray object based on the respective position coordinates. That is, the coupling unit 33 couples the infrared ray object to the visible light object based on the respective position coordinates, as shown in the rectangular box of Fig.

The risk detection unit 34 detects the risk level of the visible light object to which the infrared ray object is coupled by the coupling unit 33. That is, the risk detection unit 34 recognizes the visible light object to which the infrared object is coupled, detects the risk based on the distance between the visible light object and the vehicle, and the vehicle speed, and then transmits the detected risk to the display control unit 36 do.

The position predicting unit 35 predicts the position of the visible light object coupled with the infrared ray object by the coupling unit 33 using a Kalman filter. That is, since the position of the visible light object such as a pedestrian changes with time, the position prediction unit 35 predicts the positional change based on the previous position of the visible light object using a Kalman filter or the like, 36).

The display control unit 36 displays the visible light object coupled with the infrared ray object by the coupling unit 33 through the head up display unit 40. [ The display control unit 36 forms a highlight pattern on the visible light object (the visible light object combined with the infrared object) according to the risk of the visible light object detected by the risk detection unit 34, ).

That is, an infrared object is coupled to a visible light object to warn the driver, and a highlight pattern is displayed on the visible light object, so that the driver can easily recognize an object that is not visually confirmed at night.

On the other hand, the display control section 36 displays the emphasis pattern on the visible light object, and the emphasis pattern can be formed in various ways. For example, the display control unit 36 generates a virtual rectangle based on the position coordinates of the visible light object to which the infrared ray object is coupled, transforms the generated rectangle into a three-dimensional perspective view (i.e., a rhombic rectangle) A highlight pattern is displayed around the center point of the rectangle. In this case, the highlight pattern may be displayed in a circle or an ellipse.

In addition, the display control unit 36 adjusts at least one of the size, color, and shape of the highlight pattern according to the risk of the visible light object. That is, the display control unit 36 increases the size of the emphasized pattern, changes the color to the red color system, or increases the size of the highlight pattern as the risk increases, thereby allowing the driver to intuitively recognize the risk.

Further, when the driver presses the brake pedal to input a brake signal, the display control unit 36 changes the size, color and shape of the highlight pattern to reduce the risk. That is, when the brake signal is input, the driver actually recognizes the visible light object in front and recognizes the danger level. Therefore, the display control unit 36 reduces the size, color, and shape of the highlight pattern to a reduced risk .

Further, when the position of the visible light object predicted by the position predicting section 35 is predicted, the display control section 36 changes the position of the emphasis pattern based on the predicted position, .

Hereinafter, a vehicle information display method according to an embodiment of the present invention will be described in detail with reference to FIG.

4 is a flowchart of a vehicle information display method according to an embodiment of the present invention.

Referring to FIG. 4, when the infrared ray photographing unit 10 photographs the vicinity of the vehicle using infrared rays, the control module 30 processes the infrared ray image photographed by the infrared ray photographing unit 10 to generate a digital image signal And recognizes an infrared object from the infrared image (S10). In this case, the control module 30 detects at least one candidate object in the infrared image, compares each of the detected candidate objects with the pre-stored pattern, and recognizes the infrared object according to the comparison result.

When the visible light photographing unit 20 photographs the surroundings of the vehicle using visible light, the control module 30 processes the visible light image photographed by the visible light photographing unit 20 and converts the visible light image into a digital image signal, A visible light object is recognized from the image (S20). In this case, the control module 30 detects at least one candidate object in the visible light image, compares each of the detected candidate objects with the pre-stored pattern, and recognizes the visible light object according to the comparison result.

The control module 30 receives the position coordinates of the infrared ray object from the infrared ray object recognition unit 11 and receives the coordinates of the visible ray object from the visible ray object recognition unit 32, The infrared ray object and the visible ray object whose position coordinates coincide with each other are detected, and the infrared ray object and the visible ray object are combined based on the detected position coordinates (S30).

Next, the control module 30 detects the risk of the visible light object coupled with the infrared object through the risk detection unit 34 (S40). In this case, the risk detection unit 34 detects the risk based on the distance between the visible light object coupled with the infrared object and the vehicle, and the vehicle speed.

In addition, the control module 30 generates a virtual rectangle based on the coordinates of the visible light object to which the infrared ray object is coupled, transforms the generated rectangle into a three-dimensional viewpoint, that is, a rhombic rectangle, The highlight pattern is displayed as a circle or an ellipse.

In addition, the control module 30 adjusts at least one of the size, color, and shape of the highlight pattern according to the risk of the visible light object coupled with the infrared object, and displays the adjusted highlight pattern through the head up display unit 40 (S50).

In this process, when the driver presses the brake pedal to input a brake signal, the control module 30 changes the size, color and shape of the highlight pattern to reduce the risk.

In addition, the control module 30 predicts the position of the visible light object coupled with the infrared ray object using the Kalman filter, and displays the highlight pattern at a more accurate position by changing the position of the highlight pattern based on the predicted position.

As described above, according to the present embodiment, even in the nighttime, the driver can precisely recognize an object in front of the vehicle, so that the vehicle can be safely operated, and the risk of an object ahead can be displayed in various manners so that the driver can visually clearly recognize the risk .

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, I will understand. Accordingly, the true scope of the present invention should be determined by the following claims.

10: infrared ray photographing unit
20: visible light photographing part
30: Control module
31: Infrared object recognition unit
32: Visible light object recognition unit
33:
34:
35:
36:
40: Head-up display section

Claims (15)

An infrared ray photographing unit for photographing the vicinity of the vehicle using infrared rays;
A visible light photographing unit for photographing the vicinity of the vehicle using visible light;
A head up display; And
Recognizing an infrared object from an infrared image acquired through the infrared ray photographing unit, recognizing a visible light object in a visible light image acquired through the visible light photographing unit, comparing the infrared object with the visible light object, And a control module which combines the infrared object and displays it through the head-up display unit.
The apparatus of claim 1,
An infrared object recognizing unit for recognizing the infrared object from the infrared image picked up by the infrared ray photographing unit;
A visible light object recognizing unit for recognizing the visible light object from the visible light image photographed by the visible light photographing unit;
A combining unit for comparing the infrared object recognized by the infrared object recognizing unit with the visible light object recognized by the visible light object recognizing unit and coupling the infrared object to the visible light object; And
And a display control unit for displaying the visible light object coupled with the infrared object through the head-up display unit by the coupling unit.
The connector according to claim 2,
Wherein the position coordinates of the infrared object and the position coordinates of the visible light object are compared, and the infrared object and the visible light object are combined based on the comparison result.
3. The apparatus of claim 2, wherein the display control unit
And a highlight pattern is formed on the visible light object to which the infrared object is coupled, and displayed through the head-up display unit.
The display device according to claim 4, further comprising a risk detection unit for detecting a risk of the visible light object to which the infrared object is coupled, wherein the display control unit displays the highlight pattern differently according to the risk of the visible light object to which the infrared object is coupled And a display unit for displaying an image of the head-up display.
6. The apparatus of claim 5, wherein the display control unit
Wherein when the break signal is inputted, the size, color and shape of the highlight pattern are displayed as reducing the risk.
6. The display device according to claim 5,
Wherein at least one of size, color and shape of the highlight pattern is adjusted according to the risk of the visible light object to which the infrared object is coupled.
The display device according to claim 4,
A virtual rectangle is generated on the basis of the position coordinates of the visible light object to which the infrared ray object is coupled, the generated rectangle is transformed into a diamond-shaped rectangle by a three-dimensional viewpoint, Wherein the display is displayed in an elliptical shape.
5. The apparatus according to claim 4, further comprising: a position predicting unit for predicting a position of the visible light object coupled with the infrared ray object using a Kalman filter, wherein the display control unit displays, on the basis of the position predicted by the position predicting unit, And the position of the object is changed.
A step of photographing the vicinity of the infrared ray photographing unit using infrared rays;
A step of photographing the visible light photographing unit using visible light around the vehicle;
The control module recognizing an infrared object and a visible light object in an infrared image and a visible light image acquired through the infrared ray photographing unit and the visible light photographing unit, respectively; And
The control module compares the infrared object with the visible light object and combines the infrared object with the visible light object according to the comparison result to display the visible light object combined with the infrared object through the head up display part Up display.
The method as claimed in claim 10, further comprising the step of the control module forming an emphasis pattern on the visible light object to which the infrared ray object is combined and displaying the emphasis pattern through the head-up display unit.
11. The method according to claim 10, further comprising the step of forming a highlight pattern on the visible light object and displaying the highlight pattern on the head up display unit,
Wherein the control module adjusts at least one of the size, color and shape of the highlight pattern according to the risk of the visible light object to which the infrared object is coupled.
13. The method according to claim 12, wherein, in the step of forming an emphasis pattern on the visible light object and displaying the emphasis pattern through the head-
Wherein the control module displays a size, a color, and a shape of the highlight pattern as a risk reduction when the break signal is input.
11. The method according to claim 10, further comprising the step of forming a highlight pattern on the visible light object and displaying the highlight pattern on the head up display unit,
The control module generates a virtual rectangle based on the position coordinates of the visible light object to which the infrared ray object is coupled, transforms the generated rectangle into a diamond-shaped rectangle with a three-dimensional viewpoint, Wherein the pattern is displayed in a circular or oval shape.
11. The method according to claim 10, further comprising the step of forming a highlight pattern on the visible light object and displaying the highlight pattern on the head up display unit,
Wherein the control module predicts the position of the visible light object coupled with the infrared object using a Kalman filter and changes the position of the highlight pattern based on the predicted position.


KR1020150159209A 2015-11-12 2015-11-12 Objects displaying apparatus of head up display and method thereof KR20170056100A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150159209A KR20170056100A (en) 2015-11-12 2015-11-12 Objects displaying apparatus of head up display and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150159209A KR20170056100A (en) 2015-11-12 2015-11-12 Objects displaying apparatus of head up display and method thereof

Publications (1)

Publication Number Publication Date
KR20170056100A true KR20170056100A (en) 2017-05-23

Family

ID=59050412

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150159209A KR20170056100A (en) 2015-11-12 2015-11-12 Objects displaying apparatus of head up display and method thereof

Country Status (1)

Country Link
KR (1) KR20170056100A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101964211B1 (en) * 2017-12-20 2019-04-01 (주)티에이치엔 System and method for assisting front view using infrared camera and HUD in vehicle
KR102036593B1 (en) * 2018-04-19 2019-10-25 주식회사 아이티아이비전 Forward and back ward detecting system for emergency vehicle on bad visuality
KR102544826B1 (en) * 2022-10-25 2023-06-20 써모아이 주식회사 Vehicle multi-spectral camera apparatus

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101964211B1 (en) * 2017-12-20 2019-04-01 (주)티에이치엔 System and method for assisting front view using infrared camera and HUD in vehicle
KR102036593B1 (en) * 2018-04-19 2019-10-25 주식회사 아이티아이비전 Forward and back ward detecting system for emergency vehicle on bad visuality
KR102544826B1 (en) * 2022-10-25 2023-06-20 써모아이 주식회사 Vehicle multi-spectral camera apparatus

Similar Documents

Publication Publication Date Title
JP6346614B2 (en) Information display system
JP6939774B2 (en) Driving support system and display device
EP2487906B1 (en) Control device and vehicle surrounding monitoring device
JP6459205B2 (en) Vehicle display system
EP2894620B1 (en) Vehicle information display device and vehicle information display method
JP6379779B2 (en) Vehicle display device
WO2014199574A1 (en) Vehicle-mounted display device and program product
KR20200016958A (en) Parking Assistance Method and Parking Assistance Device
US10866416B2 (en) Display control device and display control method
WO2015098136A1 (en) Information display device for vehicle and information display method for vehicle
JPWO2013088535A1 (en) Vehicle information transmission device
JP2017092678A (en) Vehicle image display system
JP2010039793A (en) Display device for vehicle
JP6448714B2 (en) Information display system
EP2894621B1 (en) Vehicle information display device and vehicle information display method
KR20170056100A (en) Objects displaying apparatus of head up display and method thereof
JP6394940B2 (en) Vehicle display system
KR101209796B1 (en) Display device for vehicle with foreground penetration function and display method of the same
JP2016070951A (en) Display device, control method, program, and storage medium
JP2016197312A (en) Drive support display device
CN115700196A (en) Display control device for vehicle, display control method for vehicle, and display device for vehicle
JP6365409B2 (en) Image display device for vehicle driver
JP2011192070A (en) Apparatus for monitoring surroundings of vehicle
KR101736186B1 (en) Display system and control method therof
KR20170064604A (en) Displaying control apparatus of head up display

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
AMND Amendment
E601 Decision to refuse application
AMND Amendment