KR20230001923A - Method and apparatus for controlling HUD image based on driver's eyes - Google Patents

Abstract

According to one emboidment, provided is a method for controlling a head-up display video based on the gaze of a driver, which may output a head-up display video at a first position, track the gaze of the driver of a vehicle, and output the head-up display video at a second position corresponding to the changed gaze when the gaze of the driver changes.

Description

Method and apparatus for controlling HUD image based on driver's eyes}

The present invention relates to a method and apparatus for controlling an image output of a head-up display based on a driver's gaze.

Among various systems that efficiently deliver driving information and surrounding situation information to a driver of a vehicle, there is a Head Up Display (HUD).

A HUD is a device that displays vehicle driving information, such as driving information or navigation information, on the front glass or windshield within the driver's visual range while driving. This enables safe driving.

The HUD works in conjunction with the navigation system to display various vehicle information, such as arrow information guiding route changes within the driver's visual area and text information indicating speed, on or beyond the windshield, referred to as Augmented Reality (AR). ) form, it prevents the driver's line of sight from being dispersed. In order to check such vehicle information, the driver does not need to move his gaze toward the terminal that provides the information, and it is helpful to the driver's safety because he can drive while looking forward where the head-up display image is output. For the above reasons, the HUD must necessarily have a function of controlling the display of the head-up display according to the driver's gaze.

When the conventional HUD is displayed by tracking the driver's gaze, the position of the HUD is frequently changed as the driver's gaze is randomly followed, which rather interferes with the driver's safe driving.

[Prior art document number]

Prior Art 1: Korean Patent Application Publication No. 10-2021-0042431

Prior Art 2: Korean Patent Registration No. 10-2084002

One embodiment is to provide a driver's gaze-based head-up display image output control method and apparatus. In addition, it is to provide a computer-readable recording medium recording a program for executing the method on a computer. The technical problem to be solved is not limited to the technical problems described above, and other technical problems may exist.

According to an embodiment, a method for controlling a head-up display image based on a driver's gaze includes outputting a head-up display image at a first location; tracking the gaze of the driver of the vehicle; and outputting the head-up display image at a second location corresponding to the changed gaze when the driver's gaze is changed.

The first position and the second position may be positions corresponding to the driver's line of sight on the windshield of the vehicle.

The method for controlling a head-up display image based on the driver's gaze further includes determining whether a predetermined time has elapsed when the driver's gaze is changed, and when the predetermined time has elapsed, a method corresponding to the changed gaze It is characterized in that the head-up display image is output at the second location.

The method for controlling a head-up display image based on the driver's gaze further includes determining whether the driver's posture is changed, and when the driver's posture is changed, the driver's gaze and the driver's posture are changed. It is characterized in that the head-up display image is output at a second position corresponding to the changed line of sight based on this.

The method for controlling a head-up display image based on the driver's gaze further includes setting a gaze-based display mode according to a user's selection.

According to another embodiment, a method for controlling a head-up display image based on a driver's gaze includes outputting a head-up display image at a first location; determining whether a driver's attitude of the vehicle has changed; and outputting the head-up display image at a second position corresponding to the changed posture when the posture of the driver is changed.

An apparatus for controlling an image of a head-up display based on a driver's gaze according to another embodiment includes a head-up display; And a processor for controlling the output of a head-up display image through the head-up display,

The processor outputs the head-up display image at a first location, tracks the driver's gaze, and displays the head-up display image at a second location corresponding to the changed gaze when the driver's gaze is changed. characterized by output.

The first position and the second position may be positions corresponding to the driver's line of sight on the windshield of the vehicle.

When the driver's line of sight is changed, the processor determines whether a predetermined time has elapsed, and when the predetermined time has elapsed, outputs the head-up display image at a second position corresponding to the changed line of sight. to be

The processor determines whether the driver's posture has changed, and if the driver's posture has changed, the head is located at a second position corresponding to the changed line of sight based on the change in the driver's line of sight and the change in the driver's posture. It is characterized by outputting an up-display image.

The apparatus for controlling an image of a head-up display based on the driver's gaze further includes a user interface for setting a display mode based on the driver's gaze.

A recording medium on which a program for executing a method for controlling an image of a head-up display based on a driver's gaze according to another embodiment is recorded in a computer.

1 is a block diagram of the interior of a vehicle;
FIG. 2 is a block diagram of the vehicle driving assistance system (ADAS) shown in FIG. 1;
3 is a schematic diagram of an apparatus for controlling an output of a head-up display based on a driver's gaze according to an embodiment.
4 is a flowchart of a method for controlling a head-up display image output based on a driver's gaze according to another embodiment.
5 is a flowchart of a method for controlling an image output of a head-up display based on a driver's gaze according to another embodiment.
6 is a flowchart of a method for controlling an image output of a head-up display based on a driver's gaze according to another embodiment.
7A and 7B are exemplary diagrams for changing a display position of a head-up display image.
8A and 8B are examples of changing a display position of a head-up display image.

The terms used in this specification will be briefly described, and the present invention will be described in detail.

The terms used in the present invention have been selected from general terms that are currently widely used as much as possible while considering the functions in the present invention, but they may vary depending on the intention or precedent of a person skilled in the field, the emergence of new technologies, and the like. In addition, in a specific case, there is also a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the invention. Therefore, the term used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, not simply the name of the term.

When it is said that a certain part "includes" a certain component throughout the specification, it means that it may further include other components without excluding other components unless otherwise stated. In addition, terms such as "...unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. .

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

1 is an internal block diagram of a vehicle according to an exemplary embodiment.

Referring to FIG. 1 , a vehicle 100 includes a communication unit 110, an input unit 120, a sensing unit 125, a memory 130, an output unit 140, a vehicle driving unit 150, and a vehicle driving assistance system (ADAS). , 160), a control unit 170, an interface unit 180, and a power supply unit 190.

The communication unit 110 may include a short-range communication module, a location information module, an optical communication module, and a V2X communication module.

The input unit 120 may include a driving control unit, a camera, a microphone, and a user input unit.

The driving control unit receives a user input for driving the vehicle 100 . The driving control unit may include a steering input unit, a shift input unit, an acceleration input unit, and a brake input unit.

The acceleration input unit receives an input for acceleration of the vehicle 100 from a user. The brake input unit receives an input for decelerating the vehicle 100 from a user.

The camera may include an image sensor and an image processing module. The camera may process still images or moving images obtained by an image sensor (eg, CMOS or CCD). The image processing module may process a still image or video obtained through an image sensor, extract necessary information, and deliver the extracted information to the controller 170 .

Meanwhile, the vehicle 100 may include a front camera for capturing an image in front of the vehicle, an around view camera for capturing an image around the vehicle, and a rear camera for capturing an image behind the vehicle. Each camera may include a lens, an image sensor and a processor. The processor may computer-process the photographed image to generate data or information, and transmit the generated data or information to the controller 170 . A processor included in the camera may be controlled by the controller 170 .

The camera may include a stereo camera. In this case, the processor of the camera may use a disparity difference detected in the stereo image to detect a distance to the object, a relative speed to the object detected in the image, and a distance between a plurality of objects.

The camera may include a Time of Flight (TOF) camera. In this case, the camera may include a light source (eg, infrared or laser) and a receiver. In this case, the processor of the camera detects the distance to the object, the relative speed to the object, and the distance between the plurality of objects based on the time (TOF) until infrared rays or lasers emitted from the light source are reflected and received by the object. can do.

Meanwhile, the rearview camera may be disposed near the rear license plate or trunk or tailgate switch, but the rearview camera is not limited thereto.

Each image captured by the plurality of cameras is transmitted to a processor of the camera, and the processor may synthesize the respective images to generate an image around the vehicle. In this case, the image around the vehicle may be displayed through the display unit as a top view image or a bird's eye image.

The sensing unit 125 senses various conditions of the vehicle 100 . To this end, the sensing unit 125 includes a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight sensor, a heading sensor, a yaw sensor, and a gyro sensor. , position module, vehicle forward/backward sensor, battery sensor, fuel sensor, tire sensor, steering sensor by steering wheel rotation, vehicle internal temperature sensor, vehicle internal humidity sensor, ultrasonic sensor, illuminance sensor, radar, lidar, etc. can include

Accordingly, the sensing unit 125 provides vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward/backward information, and battery information. , Fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle, vehicle external illuminance, and the like.

The memory 130 is electrically connected to the controller 170 . The memory 130 may store basic data for the unit, control data for controlling the operation of the unit, and input/output data. The memory 130 may be a variety of storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc. in terms of hardware. The memory 130 may store various data for overall operation of the vehicle 100, such as a program for processing or control by the control unit 170.

The output unit 140 is for outputting information processed by the controller 170 and may include a display unit, a sound output unit, and a haptic output unit.

The display unit may display information processed by the controller 170 . For example, the display unit may display vehicle-related information. Here, the vehicle-related information may include vehicle condition information indicating a current state of the vehicle or vehicle driving information related to driving of the vehicle. For example, the display unit may display information about the speed (or speed) of the current vehicle, the speed (or speed) of nearby vehicles, and the distance between the current vehicle and nearby vehicles.

Meanwhile, the display unit may include a cluster so that the driver can check vehicle state information or vehicle driving information while driving. Clusters can be located above the dashboard. In this case, the driver can check the information displayed on the cluster while keeping his/her gaze in front of the vehicle. In an embodiment, a gaze tracking module for tracking the driver's gaze, for example, an eye tracker, may be provided in the cluster.

The sound output unit converts the electrical signal from the control unit 170 into an audio signal and outputs it. To this end, the sound output unit may include a speaker or the like.

The vehicle driving unit 150 may control the operation of various vehicle devices. The vehicle driving unit 150 may include a power source driving unit, a steering driving unit, a brake driving unit, a lamp driving unit, an air conditioning driving unit, a window driving unit, an airbag driving unit, a sunroof driving unit, and a suspension driving unit.

The power source driver may perform electronic control of the power source in the vehicle 100 . For example, when a fossil fuel-based engine (not shown) is the power source, the power source driver may perform electronic control of the engine. This makes it possible to control the output torque of the engine and the like. When the power source driver is an engine, the speed of the vehicle may be limited by limiting engine output torque according to the control of the control unit 170 .

The brake driver may perform electronic control of a brake apparatus (not shown) in the vehicle 100 . For example, the speed of the vehicle 100 may be reduced by controlling the operation of brakes disposed on wheels. As another example, the driving direction of the vehicle 100 may be adjusted to the left or right by differentiating the operation of the brakes respectively disposed on the left and right wheels.

The lamp driving unit may control turning on/off of lamps disposed inside or outside the vehicle. In addition, the intensity and direction of the light of the lamp can be controlled. For example, control of direction indicator lamps and brake lamps may be performed.

The controller 170 may control overall operations of each unit in the vehicle 100 . The controller 170 may be referred to as an Electronic Control Unit (ECU). The aforementioned accident determination device may be driven by the controller 170 .

The control unit 170, in terms of hardware, includes application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors ( It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions.

The interface unit 180 may serve as a passage for various types of external devices connected to the vehicle 100 . For example, the interface unit 180 may have a port connectable to a mobile terminal (not shown), and may be connected to a mobile terminal (not shown) through the port. In this case, the interface unit 180 can exchange data with the mobile terminal.

The power supply unit 190 may supply power required for operation of each component according to the control of the control unit 170 . In particular, the power supply unit 190 may receive power from a battery (not shown) inside the vehicle.

FIG. 2 is a block diagram of the vehicle driving assistance system (ADAS) shown in FIG. 1;

The ADAS 200 is a vehicle driving assistance system that assists a driver in order to provide convenience and safety.

The ADAS 200 includes an automatic emergency braking module (hereinafter referred to as AEB: Autonomous Emergency Braking) 210, a forward collision avoidance module (hereinafter referred to as FCW: Forward Collision Warning) 211, a lane departure warning module (hereinafter referred to as LDW: Lane Departure Warning) (212), Lane Keeping Assist (LKA) (213), Speed Assist System (SAS) (214), Traffic Sign Detection Module (TSR) Recognition) (215), adaptive high beam control module (hereinafter, HBA: High Beam Assist) (216), blind spot monitoring module (hereinafter, BSD: Blind Spot Detection) (217), automatic emergency steering module (hereinafter, AES: Autonomous Emergency Steering (218), Curve Speed Warning System (CSWS) (219), Adaptive Cruise Control (ACC) (220), Smart Parking System (220) , SPAS: Smart Parking Assist System (SPAS) 221, a traffic congestion support module (hereinafter referred to as TJA: Traffic Jam Assist) 222, and an around view monitor module (hereinafter referred to as AVM: Around View Monitor) 223 may be included. .

Each of the ADAS modules 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, and 223 may include a processor for controlling vehicle driving assistance functions.

A processor included in each of the ADAS modules 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223 may be controlled by the controller 270. .

Each of the ADAS modules (210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223) processors, in terms of hardware, ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors, controllers, micro-controllers, microprocessors microprocessors) and electrical units for performing other functions.

The AEB 210 is a module that controls automatic braking in order to prevent a collision with a detected object. The FCW 211 is a module that controls a warning to be output in order to prevent a collision with an object in front of the vehicle. The LDW 212 is a module that controls a warning to be output to prevent lane departure while driving. The LKA 213 is a module that controls to maintain a driving lane while driving. The SAS 214 is a module that controls driving at a set speed or less. The TSR 215 is a module that detects a traffic signal while driving and provides information based on the detected traffic signal. The HBA 216 is a module that controls the irradiation range or amount of high beam light according to driving conditions. The BSD 217 is a module that detects an object outside the driver's visual field while driving and provides detection information. AES (218) is a module that automatically performs steering in an emergency. The CSWS 219 is a module that controls to output a route when driving at a preset speed or higher during curve driving. The ACC 220 is a module that controls the driving vehicle to follow the preceding vehicle. The SPAS 221 is a module that detects a parking space and controls to park in the parking space. The TJA 222 is a module that controls automatic operation in case of traffic congestion. The AVM 223 is a module that provides an image around the vehicle and controls to monitor the surroundings of the vehicle.

The ADAS 200 provides a control signal for performing each vehicle driving assistance function to the output unit 250 or the vehicle driving unit 260 based on the data acquired by the input unit 230 or the sensing unit 235. can do. The ADAS 200 may directly output the control signal to the output unit 250 or the vehicle driving unit 260 through in-vehicle network communication (eg, CAN). Alternatively, the ADAS 200 may output the control signal to the output unit 250 or the vehicle driving unit 260 via the control unit 270 .

3 is a schematic diagram of an apparatus for controlling an output of a head-up display based on a driver's gaze according to an embodiment.

Referring to FIG. 3 , an apparatus 300 for controlling an image output of a head-up display based on a driver's gaze includes a controller 310, a gaze tracking unit 320, a posture determining unit 330, and a head-up display 340.

The controller 310 according to the embodiment outputs a head-up display image, tracks the driver's gaze, and outputs the head-up display image at a second location corresponding to the changed gaze when the driver's gaze is changed.

The gaze tracking unit 320 detects and tracks the driver's gaze, and detects the direction and position (coordinates) of the gaze. Eye Tracking tracks eye movement by recognizing the pupil center and corneal reflex.

For example, the cornea is irradiated with a near-infrared LED, and the reflection pattern is photographed with a camera. A reflection point of light is created on the cornea and the image is captured with a camera. In the captured eye image, the light reflection point on the cornea and the pupil can be identified, and the direction of the eye can be calculated based on the light reflection point and other geometric features. Eye tracking may use various algorithms and known eye tracking algorithms.

The eye tracking unit 320 is a stationary type and may be disposed inside the vehicle at a position where it can irradiate and photograph the driver's eyes. For example, it may be mounted near a room mirror inside a vehicle, near a vision cluster, or near a dashboard corresponding to a driver's seat, but is not limited thereto.

The posture determination unit 330 determines whether the driver's posture has changed. In order to determine the posture, the determination may be made using the motion of the driver detected through a motion sensor (not shown) disposed at a specific position inside the vehicle. As another example, it is determined that the driver's posture has changed based on the input of the seat adjustment (up, down, left, right, front and rear) buttons of the driver's seat.

In an embodiment, since a change in the driver's posture causes a change in the driver's gaze, it is possible to estimate the change in the driver's gaze through the change in posture. To this end, based on the position of the driver's gaze in the basic posture, a change in the position of the gaze reflecting the change in posture may be calculated.

The head-up display 340 displays main information of the instrument panel and simple navigation directions in the air beyond the windshield (front glass) from the driver's line of sight. The head-up display 340 projects a transparent graphic image onto the windshield's reflective film, making the image appear to be several meters in front of the driver. With the HUD, the driver does not have to lower his or her head to check the speedometer or sensitively look at the navigation system located on the right. You can see key driving information just by looking at the road ahead.

The head-up display 340 may be a buried type, a stationary type, or a terminal interlocking type. Consisting of a main body and a reflector, voice recognition and gesture control are possible using sensors included in the device, and navigation information can be displayed by linking with a smartphone by adding linkage with an existing car navigation system. It can display call and message information, media play information, SNS and E-mail notifications, or even project the smartphone screen itself.

Also, the head-up display 340 may display an AR HUD image. AR HUD uses a transparent display to display images such as arrows, route guidance such as carpets or lines, and virtual signs precisely at the point where entry and exit and direction change are required on the actual farther forward landscape. AR HUD projects vehicle speed and basic guidance information on a nearby screen, and more realistic augmented reality information on a far screen. In addition, the risk of collision, such as a vehicle in front or too close to a vehicle in a hurry, a pedestrian, or an object, can be displayed with AR graphics so that the danger can be easily recognized in order to keep the vehicle in its lane.

For the AR HUD, an AR HUD image is generated using information sensed from a camera, radar, and ultrasonic sensor installed in the vehicle. Sensors and software can determine the coordinates of an object, identify whether it is a person or an object, and match the video image to the display. Accurately place virtual information on real objects, including computing power and GPS data for scenario analysis using image sensors. Knowing where the car is at any moment, which way it is going, or where the driver is looking, it can position virtual objects on the landscape. Positioning based on high-precision GPS and HD map data improves accuracy. AR includes multiple sensor data sets and may include vehicle behavior mathematical models.

The controller 310 determines whether the driver's gaze has changed based on the driver's gaze information (eg, direction and coordinates) obtained from the gaze tracking unit 320 . When the driver's line of sight is changed, the controller 310 determines whether a predetermined time has elapsed. In an embodiment, the frequent change of the HUD output position according to the change of the driver's line of sight may confuse the driver and hinder safe driving. Accordingly, the driver's actual gaze change may be reflected by determining how much the changed gaze is maintained in order to determine whether the driver is temporarily looking away or whether there is an error in eye tracking.

The controller 310 outputs a head-up display image at a second position corresponding to the changed line of sight when a predetermined time, for example, 5 seconds has elapsed.

The controller 310 determines whether the driver's posture has changed from the driver's posture information obtained from the posture determination unit 330 . When the driver's posture is changed, the controller 310 determines whether the driver's line of sight has changed based on the change in the driver's line of sight and the change in the driver's posture. For example, if the gaze is not changed through gaze tracking but it is determined that the posture is changed, it is determined that the gaze is changed according to the posture change, the position is changed, and the head-up display image is output. In addition, it may be determined whether the coordinates of the gaze change through gaze tracking coincide with the coordinates of the gaze change estimated by the posture change. If they do not match, an accurate gaze position may be estimated through correction.

Although not shown in FIG. 3 , a user interface capable of setting a gaze-based display mode may be included. When the driver selects the gaze-based display mode through the user interface, gaze tracking or posture determination is performed to control the position of the HUD image output according to the driver's gaze.

4 is a flowchart of a method for controlling a head-up display image output based on a driver's gaze according to another embodiment.

Referring to FIG. 4 , in step 400, a head-up display image is output to a first position on the windshield. As shown in FIG. 7A , a head-up display image is output at an initial position 720 in front of the driver's seat.

In step 402, the driver's gaze is tracked. As shown in FIG. 7A , a gaze tracking module 7100 is disposed in the center of the cluster to track the driver's gaze.

In step 404, it is determined whether the driver's line of sight has changed.

As a result of the determination in step 404, when the driver's line of sight is changed, in step 406, a head-up display image is output at a second position corresponding to the changed line of sight. As shown in FIG. 7B , when the driver's line of sight changes, for example, from top to bottom, the head-up display image is changed and output to a position 730 lower than the initial position 720 on the windshield.

5 is a flowchart of a method for controlling an image output of a head-up display based on a driver's gaze according to another embodiment.

Referring to FIG. 5 , in step 500, a head-up display image is output to a first position on the windshield.

In step 502, it is determined whether the driver's seat position has changed. In an embodiment, it is determined whether there is a user input for changing the driver's seat up, down, left, right, back and forth. As another example, the motion of the driver may be detected to determine whether there is a change in posture.

As a result of the determination in step 502, when the driver's posture is changed, in step 504, a head-up display image is output at a second position corresponding to the changed seat position. Here, the position of the line of sight corresponding to the changed seat position may be determined in advance.

6 is a flowchart of a method for controlling an image output of a head-up display based on a driver's gaze according to another embodiment.

Referring to FIG. 6 , in step 600, a head-up display image is output to a first position on the windshield. As shown in FIG. 8A , a head-up display image is output at an initial position 810 in front of the driver's seat.

In step 602, the driver's gaze is tracked.

In step 604, it is determined whether the driver's line of sight has changed.

As a result of the determination in step 604, when the driver's line of sight is changed, in step 606, it is determined whether a predetermined time has elapsed.

As a result of the determination in step 606, when a predetermined time has elapsed, in step 608, a head-up display image is output at a second position corresponding to the changed line of sight. As shown in FIG. 8B , when the driver's line of sight is changed, for example, from an initial position upward, a head-up display image is output at a position 720 higher than the initial position 810 on the windshield.

A method and apparatus for controlling an output of a head-up display image based on a driver's gaze according to an embodiment may adaptively provide a head-up display image according to a driver's gaze.

In addition, by accurately determining the driver's intention to change the driver's gaze and changing the display position of the head-up display image, it is possible to assist the driver in safe driving.

A device according to an embodiment includes a processor, a memory for storing and executing program data, a permanent storage unit such as a disk drive, a communication port for communicating with an external device, a user interface such as a touch panel, a key, and a button. interface devices and the like. Methods implemented as software modules or algorithms may be stored on a computer-readable recording medium as computer-readable codes or program instructions executable on the processor. Here, the computer-readable recording medium includes magnetic storage media (e.g., read-only memory (ROM), random-access memory (RAM), floppy disk, hard disk, etc.) and optical reading media (e.g., CD-ROM) ), and DVD (Digital Versatile Disc). A computer-readable recording medium may be distributed among computer systems connected through a network, and computer-readable codes may be stored and executed in a distributed manner. The medium may be readable by a computer, stored in a memory, and executed by a processor.

Reference numerals have been described in the embodiments shown in the drawings, and specific terms have been used to describe the embodiments, but the present invention is not limited by specific terms, and the embodiments are all configurations commonly conceivable to those skilled in the art. elements may be included.

An embodiment may be presented as functional block structures and various processing steps. These functional blocks may be implemented with any number of hardware or/and software components that perform specific functions. For example, an embodiment is an integrated circuit configuration such as memory, processing, logic, look-up table, etc., which can execute various functions by control of one or more microprocessors or other control devices. can employ them. Similar to components of the present invention that may be implemented as software programming or software elements, embodiments may include various algorithms implemented as data structures, processes, routines, or combinations of other programming constructs, such as C, C++ , Java (Java), can be implemented in a programming or scripting language such as assembler (assembler). Functional aspects may be implemented in an algorithm running on one or more processors. In addition, the embodiment may employ conventional techniques for electronic environment setting, signal processing, and/or data processing. Terms such as “mechanism”, “element”, “means” and “composition” may be used broadly and are not limited to mechanical and physical components. The term may include a meaning of a series of software routines in connection with a processor or the like.

Specific executions described in the embodiments are examples, and do not limit the scope of the embodiments in any way. For brevity of the specification, description of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection of lines or connecting members between the components shown in the drawings are examples of functional connections and / or physical or circuit connections, which can be replaced in actual devices or additional various functional connections, physical connection, or circuit connections. In addition, if there is no specific reference such as “essential” or “important”, it may not be a component necessarily required for the application of the present invention.

In the specification of embodiments (particularly in the claims), the use of the term “above” and similar indicating terms may correspond to both singular and plural. In addition, when a range is described in the examples, it includes the invention to which individual values belonging to the range are applied (unless there is no description to the contrary), and it is as if each individual value constituting the range is described in the detailed description. . Finally, if there is no explicit description or description of the order of steps constituting the method according to the embodiment, the steps may be performed in an appropriate order. Examples are not necessarily limited according to the order of description of the steps. The use of all examples or exemplary terms (eg, etc.) in the embodiments is simply to describe the embodiments in detail, and the scope of the embodiments is limited due to the examples or exemplary terms unless limited by the claims. It is not. In addition, those skilled in the art can appreciate that various modifications, combinations and changes can be made according to design conditions and factors within the scope of the appended claims or equivalents thereof.

Claims (12)

outputting a head-up display image at a first location;
tracking the gaze of the driver of the vehicle; and
and outputting the head-up display image at a second location corresponding to the changed gaze when the driver's gaze is changed. According to claim 1,
The first position and the second position,
A head-up display image control method based on the driver's gaze, characterized in that the position of the windshield of the vehicle corresponding to the driver's gaze. According to claim 1,
Further comprising determining whether a predetermined time has elapsed when the driver's line of sight is changed,
When the predetermined time has elapsed, the head-up display image is output to a second position corresponding to the changed gaze. According to claim 1,
Further comprising determining whether the driver's posture has changed,
When the driver's posture is changed, the head-up display image is output at a second position corresponding to the changed gaze based on the change in the driver's gaze and the change in the driver's posture. based head-up display image control method. According to claim 1,
A method for controlling a head-up display image based on a driver's gaze, further comprising setting a gaze-based display mode according to a user's selection. outputting a head-up display image at a first location;
determining whether a driver's attitude of the vehicle has changed; and
and outputting the head-up display image at a second position corresponding to the changed posture when the posture of the driver is changed. A recording medium recording a program for executing the method according to any one of claims 1 to 6 in a computer. heads-up display;
A processor controlling output of a head-up display image through the head-up display;
the processor,
Outputting the head-up display image at a first location;
tracking the driver's gaze of the vehicle;
When the driver's gaze is changed, the head-up display image control device based on the driver's gaze, characterized in that for outputting the head-up display image at a second position corresponding to the changed gaze. According to claim 8,
The first position and the second position,
A head-up display image control device based on the driver's gaze, characterized in that the position of the windshield of the vehicle corresponding to the driver's gaze. According to claim 8,
the processor,
When the driver's gaze is changed, it is determined whether a predetermined time has elapsed, and when the predetermined time has elapsed, the head-up display image is output at a second location corresponding to the changed gaze. gaze-based head-up display video control device. According to claim 8,
the processor,
determining whether the driver's posture has changed;
When the driver's posture is changed, the head-up display image is output at a second position corresponding to the changed gaze based on the change in the driver's gaze and the change in the driver's posture. based head-up display video control device. According to claim 8,
An apparatus for controlling a driver's gaze-based head-up display image, further comprising a user interface for setting a gaze-based display mode.

Images