KR20150094381A - Apparatus for controlling hud based on surrounding and method thereof - Google Patents

Apparatus for controlling hud based on surrounding and method thereof Download PDF

Info

Publication number
KR20150094381A
KR20150094381A KR1020140015610A KR20140015610A KR20150094381A KR 20150094381 A KR20150094381 A KR 20150094381A KR 1020140015610 A KR1020140015610 A KR 1020140015610A KR 20140015610 A KR20140015610 A KR 20140015610A KR 20150094381 A KR20150094381 A KR 20150094381A
Authority
KR
South Korea
Prior art keywords
hud
color
sight
line
driver
Prior art date
Application number
KR1020140015610A
Other languages
Korean (ko)
Inventor
홍정인
Original Assignee
현대자동차주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 현대자동차주식회사 filed Critical 현대자동차주식회사
Priority to KR1020140015610A priority Critical patent/KR20150094381A/en
Publication of KR20150094381A publication Critical patent/KR20150094381A/en

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed

Abstract

The present invention relates to an environment-based HUD control device and a method thereof, and more particularly, to a HUD control device and method therefor, in which a color of a screen displayed by a Head Up Display (HUD) at the point of sight of a driver is the same as a color of a windshield front image of a background color of the HUD Or similar, by changing the corresponding color on the HUD screen, thereby improving the visibility and readability of various information.
To this end, the present invention provides an environment-based HUD control device, comprising: a video image capturing unit for capturing a forward video, which is a background of a screen displayed by a HUD (Head Up Display) through a windshield of a vehicle; A line-of-sight tracing unit for tracing a line of sight of a driver in the windshield; A control unit for controlling the HUD so as to detect an area where a line of sight of the driver traced by the line-of-sight tracking unit stays in the image photographed by the image pickup unit and display various information in a color different from the color of the area; And the HUD displaying various information under the control of the control unit.

Description

TECHNICAL FIELD [0001] The present invention relates to an HUD control device and an HUD control device,

The present invention relates to an environment-based HUD control apparatus and method thereof, and more particularly, to a HUD control apparatus and method in which a color of a screen displayed by a Head Up Display (HUD) is the same as or similar to a color of a windshield front image, And changing the corresponding color on the HUD screen to improve visibility and readability.

Various systems have been developed to efficiently transmit driving information and surrounding information to a driver of a vehicle. For example, there is a head up display (HUD).

Such a HUD is a device for expressing driving information of a vehicle such as driving information and navigation information in a visual range of a driver while driving, on a glass (windshield) on the front, Thereby enabling safe operation.

Conventional HUD displays various kinds of information (speed information, sign information, direction information, traffic light information, etc.) without considering the color of the windshield forward image which is a background color, so that the visibility and readability of the information are low have.

For example, if a large placard of red is located in front of a windshield of a vehicle and a speed limit sign is displayed in a red color of the flag, the visibility and readability of the speed limit sign are low.

Particularly, when the arrow indicating the traveling direction of the vehicle is displayed in red on the HUD in a situation where the red color is the background color as described above, it may not be recognized at all.

In addition, the conventional HUD does not provide any solution to the problem of increasing the load of the system by performing irrelevant color change.

In order to solve the problems of the conventional art as described above, according to the present invention, the color of the screen displayed by the HUD (Head Up Display) is the same as or similar to the color of the windshield front image, The present invention provides an environment-based HUD control device and a method thereof, which improve the visibility and readability of various information by changing the corresponding colors on the HUD screen.

The objects of the present invention are not limited to the above-mentioned objects, and other objects and advantages of the present invention which are not mentioned can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. It will also be readily apparent that the objects and advantages of the invention may be realized and attained by means of the instrumentalities and combinations particularly pointed out in the appended claims.

According to another aspect of the present invention, there is provided an HUD control device based on a surrounding environment, the HUD control device comprising: an image capturing section for capturing a forward image, which is a background of a screen displayed by a head up display (HUD) ; A line-of-sight tracing unit for tracing a line of sight of a driver in the windshield; A control unit for controlling the HUD so as to detect an area where a line of sight of the driver traced by the line-of-sight tracking unit stays in the image photographed by the image pickup unit and display various information in a color different from the color of the area; And the HUD displaying various information under the control of the control unit.

According to another aspect of the present invention, there is provided a HUD control method based on a surrounding environment, the method comprising: capturing a forward image of a vehicle as a background of a HUD (Head Up Display) Tracking the driver's gaze in the windshield; Controlling the HUD so that the control unit detects an area where the driver's gaze stays in the photographed image and displays various information in a color different from the color of the area; And displaying the various information by the HUD.

The present invention as described above changes the corresponding color on the HUD screen when the color of the screen displayed by the HUD is the same as or similar to the color of the windshield front image that is the background color of the HUD at the point of sight of the driver, There is an effect that the visibility and the readability can be improved.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram of an embodiment of an HUD control apparatus based on the environment according to the present invention;
FIG. 2 is an exemplary view of information displayed by the HUD control device based on the surrounding environment according to the present invention,
3 is a detailed configuration diagram of an embodiment of a HUD used in the present invention,
4 is a flowchart illustrating an HUD control method based on a surrounding environment according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings, It can be easily carried out. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an embodiment of an HUD control apparatus based on the environment according to the present invention.

1, an environment-based HUD control apparatus according to the present invention includes an image capturing unit 10, a gaze tracking unit 20, a control unit 30, and a HUD 40. As shown in FIG.

First, the image capturing unit 10 is a kind of camera for capturing a forward image as a background of a screen displayed by a HUD through a windshield of a vehicle, and includes a black box camera.

Next, the gaze tracking section 20 tracks the driver's gaze in the windshield. The gaze tracking unit 20 may include a gaze tracking camera (not shown) and a gaze vector calculator (not shown).

The eye tracking camera is a camera that detects the driver's gaze and captures the motion of the face direction, iris, pupil, and the like.

The line-of-sight vector calculator calculates the line-of-sight vector of the current point and the line-of-sight vector of the next point of time based on the motion of the driver's line of sight captured through the line-of-sight tracking camera.

Further, the line-of-sight vector calculator calculates the velocity vector of the driver's line of sight, and calculates the sight line coordinates of the current time point and the sight line coordinates of the previous time point.

Here, the line of sight vector includes the direction of the line-of-sight vector and the size of the line-of-sight vector. The gaze vector calculator calculates the direction of the gaze vector at the next time point by using the spline interpolation method between the sum vector of the gaze coordinates at the current point and the previous point and the gaze coordinates at the previous point. Also, the line-of-sight vector calculator calculates the size of the line-of-sight vector at the next point of time using the average difference of the vector sizes between the advantage point and the preceding points.

Next, the control unit 30 detects an area where the driver's gaze tracked by the gaze tracking unit 20 remains in the image photographed by the image capturing unit 10, confirms the color of the area, The HUD is controlled to display various kinds of information (speed information, sign information, direction information, traffic light information, etc.) with different colors from the color.

The control unit 30 performs a process of matching an area of the windshield where the driver's line of sight is in the forward image of the vehicle photographed through the windshield.

In addition, the control unit 30 detects the color of a region of the driver's gaze tracked by the gaze tracking unit 20 in the image photographed by the image capturing unit 10. [

In addition, the control unit 30 may add outlines or shadows to various kinds of information in order to improve visibility and readability.

For example, if the information displayed by the HUD 40 has the shape of a graphic (for example, a speed limit sign) as shown in FIG. 2, the outline 201 and the shadow 220 may be added have.

Next, the HUD 40 displays various kinds of information under the control of the control unit 30.

3 is a detailed configuration diagram of an embodiment of the HUD used in the present invention.

3, '41' is a projector, '42' is a windshield installed on the front of the vehicle, and '43' is a combiner attached to the windshield 42 to reflect a specific wavelength at a specific angle And 44 denotes a VFD installed in the projector 41 and displaying various information to be provided to the driver under the control of the controller 30 in one color or a plurality of colors.

4 is a flowchart illustrating an HUD control method based on a surrounding environment according to an embodiment of the present invention.

First, the image capturing unit 10 captures the forward image of the vehicle, which is the screen background of the HUD (Head Up Display) 40 (401).

Then, the gaze tracking unit 20 tracks the driver's gaze in the windshield (402).

Thereafter, the control unit 30 detects an area where the driver's gaze tracked by the gaze tracking unit 20 remains in the image photographed by the image capturing unit 10, and displays various kinds of information in a color different from the color of the area (403). ≪ / RTI >

Then, the HUD 40 displays various information under the control of the control unit 30 (404).

Meanwhile, the method of the present invention as described above can be written in a computer program. And the code and code segments constituting the program can be easily deduced by a computer programmer in the field. In addition, the created program is stored in a computer-readable recording medium (information storage medium), and is read and executed by a computer to implement the method of the present invention. And the recording medium includes all types of recording media readable by a computer.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings.

10:
20: eye tracking unit
30:
40: HUD

Claims (6)

An image capturing unit for capturing a forward image as a background of a screen displayed by a head up display (HUD) through a windshield of a vehicle;
A line-of-sight tracing unit for tracing a line of sight of a driver in the windshield;
A control unit for controlling the HUD so as to detect an area where a line of sight of the driver traced by the line-of-sight tracking unit stays in the image photographed by the image pickup unit and display various information in a color different from the color of the area; And
The HUD displaying various information under the control of the control unit
And a controller for controlling the HUD controller based on the surrounding environment.
The method according to claim 1,
Wherein,
And controls the HUD to add an outline when the information has a shape of a graphic form.
The method according to claim 1,
Wherein,
And controls the HUD to add a shadow when the information has a shape of a graphic form.
A step of photographing a forward image of a vehicle which is a screen background of a head-up display (HUD);
Tracking the driver's gaze in the windshield;
Controlling the HUD so that the control unit detects an area where the driver's gaze stays in the photographed image and displays various information in a color different from the color of the area; And
The HUD displays various information
Wherein the HUD control method comprises:
5. The method of claim 4,
The HUD control step includes:
And controlling the HUD to add an outline when the information has a shape of a graphic form.
5. The method of claim 4,
The HUD control step includes:
And controlling the HUD to add a shadow when the information has a shape of a graphic form.
KR1020140015610A 2014-02-11 2014-02-11 Apparatus for controlling hud based on surrounding and method thereof KR20150094381A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020140015610A KR20150094381A (en) 2014-02-11 2014-02-11 Apparatus for controlling hud based on surrounding and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140015610A KR20150094381A (en) 2014-02-11 2014-02-11 Apparatus for controlling hud based on surrounding and method thereof

Publications (1)

Publication Number Publication Date
KR20150094381A true KR20150094381A (en) 2015-08-19

Family

ID=54057886

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140015610A KR20150094381A (en) 2014-02-11 2014-02-11 Apparatus for controlling hud based on surrounding and method thereof

Country Status (1)

Country Link
KR (1) KR20150094381A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106101667A (en) * 2016-06-30 2016-11-09 京东方科技集团股份有限公司 HUD and HUD display packing, mobile devices
JP2018031863A (en) * 2016-08-24 2018-03-01 アルパイン株式会社 On-vehicle display device
CN109960036A (en) * 2017-12-14 2019-07-02 现代自动车株式会社 For controlling the device and method and Vehicular system of the display of vehicle
CN114563871A (en) * 2020-11-27 2022-05-31 华为技术有限公司 Eye movement tracking device and electronic equipment

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106101667A (en) * 2016-06-30 2016-11-09 京东方科技集团股份有限公司 HUD and HUD display packing, mobile devices
US10578863B2 (en) 2016-06-30 2020-03-03 Boe Technology Group Co., Ltd. Heads up display, heads up display method, and traveling apparatus
JP2018031863A (en) * 2016-08-24 2018-03-01 アルパイン株式会社 On-vehicle display device
CN109960036A (en) * 2017-12-14 2019-07-02 现代自动车株式会社 For controlling the device and method and Vehicular system of the display of vehicle
US10635278B2 (en) 2017-12-14 2020-04-28 Hyundai Motor Company Apparatus and method for controlling display of vehicle, and vehicle system
CN109960036B (en) * 2017-12-14 2022-05-13 现代自动车株式会社 Apparatus and method for controlling display of vehicle, and vehicle system
CN114563871A (en) * 2020-11-27 2022-05-31 华为技术有限公司 Eye movement tracking device and electronic equipment
CN114563871B (en) * 2020-11-27 2023-04-11 华为技术有限公司 Eye movement tracking device and electronic equipment

Similar Documents

Publication Publication Date Title
US11194154B2 (en) Onboard display control apparatus
US9563981B2 (en) Information processing apparatus, information processing method, and program
US9690104B2 (en) Augmented reality HUD display method and device for vehicle
KR102118438B1 (en) Head up display apparatus for vehicle and method thereof
JP6659924B2 (en) Adjusting the presentation of the head-mounted display
US10843686B2 (en) Augmented reality (AR) visualization of advanced driver-assistance system
JP6379779B2 (en) Vehicle display device
JP6443716B2 (en) Image display device, image display method, and image display control program
CN103593051A (en) Head-mounted type display equipment
JP2015221651A (en) Display device
CN105620364A (en) Method and apparatus for providing driving information
US11024040B2 (en) Dynamic object tracking
KR20150094381A (en) Apparatus for controlling hud based on surrounding and method thereof
WO2018136420A1 (en) Overlay emphasis modification in augmented reality displays
US10762691B2 (en) Techniques for compensating variable display device latency in image display
CN110435539B (en) Image display method of head-up display and head-up display system
US10354153B2 (en) Display controller, display control method, and recording medium storing program
JP2016070951A (en) Display device, control method, program, and storage medium
US11376961B2 (en) Method and system for demonstrating function of vehicle-mounted heads up display, and computer-readable storage medium
US20160117802A1 (en) Display control device, display control method, non-transitory recording medium, and projection device
JP6365409B2 (en) Image display device for vehicle driver
CN112805755A (en) Information processing apparatus, information processing method, and recording medium
JP2019207632A (en) Display device
CN112464870B (en) Target object live-action fusion method, system, equipment and storage medium for AR-HUD
CN111243102B (en) Method and system for improving and increasing FOV (field of view) based on diffusion film transformation

Legal Events

Date Code Title Description
E601 Decision to refuse application