KR20170055625A - Displaying control apparatus of head up display and method thereof - Google Patents

Displaying control apparatus of head up display and method thereof Download PDF

Info

Publication number
KR20170055625A
KR20170055625A KR1020150158464A KR20150158464A KR20170055625A KR 20170055625 A KR20170055625 A KR 20170055625A KR 1020150158464 A KR1020150158464 A KR 1020150158464A KR 20150158464 A KR20150158464 A KR 20150158464A KR 20170055625 A KR20170055625 A KR 20170055625A
Authority
KR
South Korea
Prior art keywords
line
sight
driver
display
head
Prior art date
Application number
KR1020150158464A
Other languages
Korean (ko)
Inventor
오형석
금병직
Original Assignee
현대오트론 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 현대오트론 주식회사 filed Critical 현대오트론 주식회사
Priority to KR1020150158464A priority Critical patent/KR20170055625A/en
Publication of KR20170055625A publication Critical patent/KR20170055625A/en

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B2027/0192—Supplementary details
    • G02B2027/0198—System for aligning or maintaining alignment of an image in a predetermined direction

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Instrument Panels (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Provided are a display control apparatus and method for a head-up display, which solve a problem of inconvenience for a driver to move a gaze to check information by controlling a display position of an image based on the gaze of the driver, and promote safe driving. The display control apparatus for a head-up display comprises: a head-up display unit for displaying an image on a windshield of a vehicle; a gaze detection unit for tracking the gaze of the driver; and a control unit for controlling the head-up display unit according to the gaze detected by the gaze detection unit, and changing a position of a display area for displaying the image.

Description

Technical Field [0001] The present invention relates to a display control apparatus and method for a head-up display,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and method for controlling a display of a head-up display, and more particularly, to an apparatus and method for controlling a display of a head-up display for controlling a display position of an image based on a sight line of a driver.

There is a disadvantage in that the information providing apparatus for the user mounted on the vehicle is distracted by the driver's attention and there is a risk of accident occurrence. A head up display (HUD) is an information providing device for solving such a problem. The head-up display can display various information provided to the driver on the top of the windshield. Accordingly, there is an advantage in that the risk of an accident can be prevented because the driver does not have to turn his or her gaze to check the information, but the position of the provided information does not coincide with the position of the actual image at the front, There is a problem in that the driver's safety and convenience may be deteriorated due to a cognitive load to recognize the displayed information.

In order to solve such a problem, an augmented reality type head-up display which coincides the positions of the images of actual objects located in the front and the information displayed in the head-up display based on the driver's view is emerging. The augmented reality type head-up display can generate a virtual graphic and display it in combination with the actual image in front of the driver, so that the information required by the driver can be recognized by the driver as if it is displayed together with the actual object in front of the driver.

However, in the conventional augmented reality type head-up display, there is a problem that the driver has to move his or her eyes to check the information by always displaying the image in a constant area without considering the driver's gaze.

The background art of the present invention is disclosed in Korean Patent Laid-Open Publication No. 10-2013-0138522 (Dec. 31, 2013) entitled " System and method for providing vehicle information using an augmented reality ".

According to an aspect of the present invention, there is provided an apparatus and method for controlling a display position of an image based on a driver ' s line of sight, The present invention also provides a display control device and method for a head-up display capable of eliminating inconveniences and enabling safe operation.

According to one aspect of the present invention, there is provided an apparatus for controlling display of a head-up display, comprising: a head-up display unit for displaying an image on a windshield of a vehicle; A line of sight detection unit for tracking the driver ' s line of sight; And a control unit for controlling the head-up display unit according to the line of sight detected by the line-of-sight sensing unit to change the position of the display area for displaying the image.

The visual-line sensing unit of the present invention is characterized in that the visual line is sensed by using at least one of pupil, iris and face direction of the driver.

The control unit of the present invention is characterized by detecting an abscissa of the line of sight within the entire area and changing the position of the display area on the basis of the detected abscissa of the line of sight.

The control unit of the present invention is characterized in that the position of the display area is changed such that an abscissa of the line of sight is included within the display area.

According to another aspect of the present invention, there is provided a display control apparatus for a head-up display including: a head-up display unit for displaying an image on a windshield of a vehicle; A line of sight detection unit for tracking the driver ' s line of sight; A horizon line detecting unit for detecting a horizon line by analyzing an image photographed by the photographing unit; And a control unit for controlling the head-up display unit according to the sight line of the driver sensed by the sight line sensing unit and the horizon line detected by the horizon line sensing unit to change the position of the display area for displaying the image .

The visual-line sensing unit of the present invention is characterized by sensing the driver's gaze using at least one of pupil, iris, and face direction of the driver.

The control unit of the present invention is characterized in that after detecting the abscissa of the line of sight and the abscissa of the horizon, the control unit changes the position of the display area based on the abscissa of the line of sight and the coordinates of the horizon.

The control unit of the present invention is characterized in that the position of the display area is changed such that a part or all of the display area is included between the abscissa of the line of sight and the abscissa of the horizon.

An apparatus and method for controlling a display of a head-up display according to an embodiment of the present invention controls the display position of an image based on the sight line of a driver, thereby eliminating the inconvenience that a driver moves his or her eyes to check information, .

1 is a block diagram of a display control apparatus for a head-up display according to a first embodiment of the present invention.
FIG. 2 is a view illustrating an example of changing the display area according to the driver's line of sight according to the first embodiment of the present invention.
3 is a block diagram of a display control apparatus of a head-up display according to a second embodiment of the present invention.
4 is a view illustrating an example of changing the display area based on the sight line and the horizon of the driver according to the second embodiment of the present invention.

Hereinafter, a display control apparatus for a head-up display according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In this process, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation. Further, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the user, the intention or custom of the operator. Therefore, definitions of these terms should be made based on the contents throughout this specification.

FIG. 1 is a block diagram of a display control apparatus for a head-up display according to a first embodiment of the present invention. FIG. 2 is a diagram illustrating an example of a display area change according to a driver's line of sight change according to the first embodiment of the present invention. to be.

1, the head-up display position control apparatus according to the first embodiment of the present invention includes a photographing unit 10, a sight line sensing unit 20, a head-up display unit 30, and a control unit 40 do.

The photographing section 10 photographs a video in front of the vehicle. Particularly, the photographing unit 10 photographs a walking direction or a vehicle traveling direction to acquire an image of a pedestrian or an obstacle.

As the photographing unit 10, an FIR (Far Infra Red) camera, a CMOS (Complementary Metal-Oxide Semiconductor) camera, a CCD (Charge Coupled Device) The CMOS camera or the CCD camera senses and projects the light in the visible light region, thus acquiring an image similar to that of a human eye. And the FIR camera acquires the image by projecting light of infrared band which is not seen by human.

The line of sight sensing unit 20 tracks the line of sight of the driver. The line of sight sensing unit 20 photographs the motion of the face direction, the iris, the pupil, etc., analyzes the photographed image to detect the driver's gaze and tracks the driver's gaze on the basis of the gaze. The eyesight sensing unit 20 may be installed at various positions depending on the body part to be sensed such as the face direction of the driver, the iris, the pupil, and the like, for example, a dashboard or the like.

The head-up display unit 30 provides the driver with various convenience information, and displays various virtual images corresponding to the object on the windshield of the vehicle.

That is, the head-up display unit 30 generates a virtual graphic to be combined with an actual image in front of the driver, and displays the virtual image on the windshield located at the front based on the driver's view. The head-up display unit 30 allows the driver to recognize that the provided information is displayed together with the actual object in front of the driver.

The control unit 40 tracks the driver's gaze through the line-of-sight sensing unit 20 and controls the head-up display unit according to the line of sight sensed by the line-of-sight sensing unit 20 to change the position of the display area for displaying the image .

That is, when the sight line of the driver is detected by the sight line sensing unit 20, the control unit 40 controls the head-up display unit according to the sight line of the driver so that the image displayed on the windshield follows the sight line of the driver .

For this purpose, the control unit 40 detects the coordinates of the driver's line of sight, for example, the abscissa, within the entire region where the image can be displayed on the windshield, Change the location.

Here, the abscissa of the line of sight of the driver is a coordinate in the entire area where the driver's line of sight is located, and the horizontal value is the same, indicating the height of the line of sight of the driver.

By including the abscissa of the line of sight of the driver within the display area as described above, the display area is not largely deviated from the line of sight of the driver, so that the driver can easily recognize the information displayed within the display area.

2, when the driver faces downward, the control unit 40 detects the abscissa S1 based on the sight line of the driver detected through the eyesight sensing unit 20, and detects the abscissa S1 so that the abscissa S1 is included The display area A1 is set and an image is displayed in the display area.

Thereafter, when the driver turns his or her gaze upward, the line of sight sensing unit 20 tracks the line of sight of the driver, and the controller 40 detects an abscissa S2 of the line of sight of the driver.

As the abscissa changes (S1 to S2) in this manner, the control unit 40 also changes the display area (A1 to A2). In this case, the control unit 40 adjusts the position of the display area so that the abscissa S2 of the line of sight of the changed driver is included within the display area A2.

Hereinafter, a display control apparatus for a head-up display according to a second embodiment of the present invention will be described with reference to Figs. 3 to 4. Fig.

FIG. 3 is a block diagram of a display control apparatus for a head-up display according to a second embodiment of the present invention. FIG. 4 is a diagram illustrating an example of a display area changing example based on the driver's gaze and horizon according to the second embodiment of the present invention Fig.

3, the display control device of the head-up display according to the second embodiment of the present invention includes a photographing unit 10, a sight line sensing unit 20, a head-up display unit 30, a horizon detection unit 50, And a control unit 60.

In the second embodiment of the present invention, the same components as those in the first embodiment are denoted by the same reference numerals and their detailed descriptions are omitted.

The horizon line detecting unit 50 analyzes the image photographed by the photographing unit 10 and detects horizon lines.

The control unit (60) causes the horizon line detection unit (50) to detect the horizon line so as to track the line of sight of the driver through the line of sight sensing unit (20). The control unit 60 controls the head-up display unit according to the sight line of the driver sensed by the sight line sensing unit 20 and the horizon line detected by the horizon line sensing unit 50 to change the position of the display area for displaying the image.

More specifically, the control unit 60 detects the abscissa of the driver's gaze through the driver's gaze, and detects the coordinates of the horizon, for example, the abscissa, through the horizon. Further, the control unit 60 changes the position of the display area based on the abscissa of the driver's gaze and the abscissa of the horizon.

Here, the abscissa of the horizon is a coordinate where the horizon in the entire area is located, the value in the horizontal direction is the same, and the height of the horizon is indicated.

Then, the control unit 60 changes the position of the display area so that a part or all of the display area is included between the abscissa of the line of sight of the driver and the coordinates of the horizon.

That is, if there is an uphill or downhill road while driving, the display area is determined based on only the horizon line, the display area is determined between the horizon and the driver's line of sight, and information is displayed in the corresponding display area, It is possible to prevent the display area from being changed suddenly by changing the horizon.

Further, since the display area is determined by the sight line of the driver, the display area can be positioned around the driver's line of sight so that the driver can visually check the display area information while changing the line of sight relatively small.

4 (a), when the vehicle reaches the uphill road and the horizon line moves upward, the control unit 60 moves the display area upward toward the driver's line of sight. At this time, Is positioned between the abscissa of the line of sight of the driver and the abscissa of the horizon so that the display area is not abruptly changed.

4 (b), when the vehicle reaches downhill during traveling and the horizon line moves downward, the control unit 60 moves the display area downward about the driver's line of sight At this time, a part or all of the display area is positioned between the abscissa of the driver's line of sight and the abscissa of the horizon so that the display area is not abruptly changed.

As described above, the present embodiment controls the display position of the image based on the sight line of the driver, thereby eliminating the inconvenience of the driver moving the sight line for confirming information and enabling safe driving.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, I will understand. Accordingly, the true scope of the present invention should be determined by the following claims.

10:
20:
30: head up display section
50: Horizon detecting section
40, 60:

Claims (8)

A head-up display unit for displaying an image on a windshield of the vehicle;
A line of sight detection unit for tracking the driver ' s line of sight; And
And a control unit for controlling the head-up display unit according to a line of sight detected by the line-of-sight sensing unit to change a position of a display area for displaying the image.
The apparatus according to claim 1, wherein the visual-
Wherein the eyes are detected using at least one of pupil, iris, and face direction of the driver.
The apparatus of claim 1,
Detects an abscissa of the line of sight within the entire area, and changes the position of the display area based on the detected abscissa of the line of sight.
The apparatus of claim 3,
Wherein the position of the display area is changed so that an abscissa of the line of sight is included within the display area.
A head-up display unit for displaying an image on a windshield of the vehicle;
A line of sight detection unit for tracking the driver ' s line of sight;
A horizon line detecting unit for detecting a horizon line by analyzing an image photographed by the photographing unit; And
And a control unit for controlling the head-up display unit according to the sight line of the driver sensed by the sight line sensing unit and the horizon line detected by the horizon line sensing unit to change the position of the display area for displaying the image, .
6. The apparatus according to claim 5,
Wherein the eyes of the driver are sensed by using at least one of pupil, iris and face direction of the driver.
6. The apparatus of claim 5,
Wherein the position of the display area is changed based on the abscissa of the line of sight and the coordinates of the horizon after detecting the abscissa of the line of sight and the abscissa of the horizon.
6. The apparatus of claim 5,
Wherein the position of the display area is changed so that a part or all of the display area is included between the abscissa of the line of sight and the abscissa of the horizon.




KR1020150158464A 2015-11-11 2015-11-11 Displaying control apparatus of head up display and method thereof KR20170055625A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150158464A KR20170055625A (en) 2015-11-11 2015-11-11 Displaying control apparatus of head up display and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150158464A KR20170055625A (en) 2015-11-11 2015-11-11 Displaying control apparatus of head up display and method thereof

Related Child Applications (1)

Application Number Title Priority Date Filing Date
KR1020170100885A Division KR101786581B1 (en) 2017-08-09 2017-08-09 Displaying control apparatus of head up display

Publications (1)

Publication Number Publication Date
KR20170055625A true KR20170055625A (en) 2017-05-22

Family

ID=59049857

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150158464A KR20170055625A (en) 2015-11-11 2015-11-11 Displaying control apparatus of head up display and method thereof

Country Status (1)

Country Link
KR (1) KR20170055625A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110244778A (en) * 2019-06-20 2019-09-17 京东方科技集团股份有限公司 A kind of head-up following control system and control method based on human eye tracking

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110244778A (en) * 2019-06-20 2019-09-17 京东方科技集团股份有限公司 A kind of head-up following control system and control method based on human eye tracking

Similar Documents

Publication Publication Date Title
US10868976B2 (en) Method for operating smartglasses in a motor vehicle, and system comprising smartglasses
US20060262140A1 (en) Method and apparatus to facilitate visual augmentation of perceived reality
CN111095363B (en) Display system and display method
US20160125631A1 (en) Apparatus for dynamically controlling hud (head-up display) information display position
JP4970379B2 (en) Vehicle display device
JP6669019B2 (en) VEHICLE DISPLAY CONTROL DEVICE, VEHICLE DISPLAY SYSTEM, VEHICLE DISPLAY CONTROL METHOD, AND PROGRAM
US10699118B2 (en) Vehicle safety system and operating method thereof
JP5855206B1 (en) Transmission display device for vehicle
US10866423B2 (en) Method and device for operating a display system comprising a head-mounted display
KR101786581B1 (en) Displaying control apparatus of head up display
JP2018121287A (en) Display control apparatus for vehicle, display system for vehicle, display control method for vehicle, and program
KR101756252B1 (en) Displaying control apparatus of head up display and method thereof
JP2017056909A (en) Vehicular image display device
JP2009248812A (en) Driving assistance device
KR101209796B1 (en) Display device for vehicle with foreground penetration function and display method of the same
KR101767435B1 (en) Displaying control apparatus of head up display and method thereof
KR20170055625A (en) Displaying control apparatus of head up display and method thereof
CN117063113A (en) Information processing device, information processing method, and program
WO2016088227A1 (en) Video display device and method
JP2021033872A (en) Display control device for vehicle, display control method for vehicle, and program
KR101736186B1 (en) Display system and control method therof
KR20160035687A (en) Apparatus for providing dangerous obstacle information for vehicle
KR101826626B1 (en) Apparatus for displaying lane of head up display and method thereof
KR20170057511A (en) Displaying control apparatus of head up display and method thereof
US11941173B2 (en) Image display system

Legal Events

Date Code Title Description
A201 Request for examination
AMND Amendment
AMND Amendment