KR20170065082A - Apparatus for displaying safety driving information using head-up display and control method thereof - Google Patents
Apparatus for displaying safety driving information using head-up display and control method thereof Download PDFInfo
- Publication number
- KR20170065082A KR20170065082A KR1020150170958A KR20150170958A KR20170065082A KR 20170065082 A KR20170065082 A KR 20170065082A KR 1020150170958 A KR1020150170958 A KR 1020150170958A KR 20150170958 A KR20150170958 A KR 20150170958A KR 20170065082 A KR20170065082 A KR 20170065082A
- Authority
- KR
- South Korea
- Prior art keywords
- display
- head
- vehicle
- road
- coordinates
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000002093 peripheral effect Effects 0.000 claims abstract description 53
- 238000013500 data storage Methods 0.000 claims abstract description 13
- 238000006243 chemical reaction Methods 0.000 claims description 14
- 239000011159 matrix material Substances 0.000 claims description 13
- 230000001133 acceleration Effects 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 claims description 2
- 230000003190 augmentative effect Effects 0.000 description 13
- 238000005259 measurement Methods 0.000 description 6
- 238000009434 installation Methods 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
- G01S19/01—Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
- B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
- G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0183—Adaptation to parameters characterising the motion of the vehicle
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Combustion & Propulsion (AREA)
- Optics & Photonics (AREA)
- Chemical & Material Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Instrument Panels (AREA)
- Navigation (AREA)
Abstract
An apparatus and method for displaying safe driving information using a head-up display are disclosed. An apparatus for displaying safe driving information using a head-up display of the present invention includes: a head-up display for displaying an image on a front surface of a vehicle; A GPS receiver for receiving GPS signals from satellites; A peripheral information measuring unit installed in the vehicle and measuring a front object; A map data storage unit for storing road information for a driving route; And the position of the object measured by the peripheral information measuring unit is matched to the coordinates of the head-up display, and the road information corresponding to the position of the vehicle obtained from the GPS receiver is read from the map data storage unit, And a controller for calculating the driving information and displaying the calculated driving information on the head-up display.
Description
The present invention relates to a safe driving information display apparatus and a control method thereof using a head-up display, and more particularly, to a safety driving information display apparatus and a control method thereof, A safety driving information display apparatus and a control method therefor using a head-up display capable of displaying safe driving information running on a curved road as well as displaying a road shape on a curved road as augmented reality .
Most of the vehicles are equipped with a navigation system, which provides the driver with a destination and a route guidance. In addition, recently, a head which projects desired information to the windshield of a vehicle so that the driver can acquire the projected information while looking forward A vehicle equipped with a head-up display (HUD) is being released.
Furthermore, studies are being conducted to display specific information in the form of augmented reality through head-up display.
Augmented Reality (AR) is a technology that shows a 3D virtual object overlaid on the real world as seen by the user. It combines a virtual world with additional information in real time in a real world and displays it as a single image. Mixed Reality, MR).
However, this head-up display merely displayed navigation information and simple information about driving the vehicle. That is, when the navigation information is displayed on the head-up display, the position of the vehicle and the actual lane do not coincide with each other, so that information for preventing a safety accident can not be displayed as an augmented reality.
Therefore, in order to solve such a problem, a technique of recognizing a lane and displaying a virtual lane to an augmented reality according to the position of the actual lane has been proposed.
Related prior arts include "Lane marking apparatus and method using head-up display ", Korean Patent Laid-Open Publication No. 2015-0055183 (May 05, 2015).
When the peripheral information is displayed on the head-up display based on the augmented reality, when the coordinates of the measurement device and the head-up display are different from each other, there is a problem that the displayed position is misaligned and a road shape such as a road inclination is not provided There is a problem that guide information for safe driving such as safe driving information on a curved road is not provided and thus it is not helpful for safe driving substantially.
According to an aspect of the present invention, there is provided an apparatus and method for measuring a peripheral information measuring apparatus, A safe driving information display device using a head-up display that displays safe driving information for traveling on a curved road so as to enable safe driving as well as displaying a road shape on a curved road as an augmented reality, And a control method thereof.
An apparatus for displaying safe driving information using a head-up display according to an aspect of the present invention includes: a head-up display for displaying an image on a front surface of a vehicle; A GPS receiver for receiving GPS signals from satellites; A peripheral information measuring unit installed in the vehicle and measuring a front object; A map data storage unit for storing road information for a driving route; And the position of the object measured by the peripheral information measuring unit is matched to the coordinates of the head-up display, and the road information corresponding to the position of the vehicle obtained from the GPS receiver is read from the map data storage unit, And a controller for calculating the driving information and displaying the calculated driving information on the head-up display.
The present invention further includes a vehicle attitude measuring unit for measuring the vibration and attitude of the vehicle, and the control unit corrects the coordinates of the head up display with respect to the change of coordinates according to the attitude of the vehicle.
In the present invention, the vehicle attitude measuring unit includes at least one of a vibration sensor, an acceleration sensor, and a gyro sensor.
In the present invention, the peripheral information measuring unit includes at least one of a camera, a radar, and a lidar.
In the present invention, the controller may be configured to match the position of the object measured by the peripheral information measuring unit with the coordinates of the head-up display through a viewpoint conversion matrix for matching the coordinates of the head-up display with the coordinates of the peripheral information measuring unit .
In the present invention, the control unit displays the road shape by displaying the old wirings along the road gradient on the curved road section on the road surface at different intervals according to the perspective method.
In the present invention, the safe driving information includes at least one of a safe running speed according to a gradient of a road on a curved road and a safety steered angle for traveling along a center line of the curved road based on the speed of the vehicle.
The present invention is characterized in that the control unit further includes a warning unit for warning when the speed of the vehicle exceeds the safe driving information.
According to another aspect of the present invention, there is provided a method of controlling a safe driving information display apparatus using a head-up display, the method including: receiving a monitoring image of an object measured by a control unit from a peripheral information measuring unit; Matching the coordinate of the head-up display with the coordinate of the control unit according to the installation position of the peripheral information measurement unit; And displaying the road shape on the head-up display by receiving the road information from the map data storage unit based on the position of the vehicle obtained from the GPS receiver while displaying the matched position of the object in the coordinates of the head-up display .
The step of matching the coordinates of the head-up display with the coordinates of the head-up display further includes the step of correcting the coordinates of the head-up display when a change of coordinates according to the vehicle posture is inputted from the vehicle posture measuring unit.
In the present invention, the vehicle attitude measuring unit includes at least one of a vibration sensor, an acceleration sensor, and a gyro sensor.
In the present invention, the step of matching the position of the object with the coordinates of the head-up display may include displaying the coordinates of the head-up display on the basis of the coordinates of the head- The position of the object measured in the head-up display is matched with the coordinates of the head-up display.
In the present invention, the peripheral information measuring unit includes at least one of a camera, a radar, and a lidar.
The step of displaying the road shape on the head-up display according to the present invention is characterized in that the control unit displays the old wiring along the road gradient on the road surface at different intervals according to the perspective method in the curved road section.
The present invention is characterized in that the control unit further calculates safe driving information based on the speed and road shape of the vehicle and displays the safety driving information on the head-up display.
In the present invention, the safe driving information includes at least one of a safe running speed according to a gradient of a road on a curved road and a safety steered angle for traveling along a center line of the curved road based on the speed of the vehicle.
The present invention is further characterized in that the control unit is further provided with a step of warning through the warning unit when the speed of the vehicle exceeds the safe driving information.
An apparatus for displaying safe driving information using a head-up display according to an embodiment of the present invention and a control method thereof include a controller for displaying coordinates of a head-up display and coordinates of a peripheral information measuring apparatus in order to display information measured from a peripheral information measuring apparatus, It is possible not only to reduce the sense of heterogeneity of the augmented reality by displaying the road shape on the road as an augmented reality, but also to display the safe driving information running on the curved road so as to enable safe driving.
1 is a block diagram illustrating an apparatus for displaying safe driving information using a head-up display according to an embodiment of the present invention.
2 is a view showing various coordinate systems in a safe driving information display apparatus using a head-up display according to an embodiment of the present invention.
3 is a view illustrating a viewpoint conversion process in a coordinate matching apparatus of a head-up display according to an embodiment of the present invention.
FIG. 4 is a view illustrating road shape and safe driving information through a safety driving information display apparatus using a head-up display according to an embodiment of the present invention.
5 is a flowchart illustrating a method of controlling a safe driving information display apparatus using a head-up display according to an embodiment of the present invention.
Hereinafter, an apparatus and method for displaying safe driving information using a head-up display according to the present invention will be described with reference to the accompanying drawings. In this process, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation. In addition, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention or custom of the user, the operator. Therefore, definitions of these terms should be made based on the contents throughout this specification.
FIG. 1 is a block diagram illustrating an apparatus for displaying safe driving information using a head-up display according to an exemplary embodiment of the present invention. FIG. 2 is a block diagram of a safe driving information display apparatus using a head-up display according to an exemplary embodiment of the present invention. FIG. 3 is a view illustrating a viewpoint conversion process in a coordinate matching apparatus of a head-up display according to an exemplary embodiment of the present invention, and FIG. 4 is a view illustrating a head-up display according to an exemplary embodiment of the present invention. And the safe driving information display device.
As shown in FIG. 1, an apparatus for displaying safe driving information using a head-up display according to an embodiment of the present invention includes a peripheral
The head-up display 60 projects and displays an image on a front windshield of a vehicle (not shown).
The peripheral
Here, the peripheral
These peripheral
In order to prevent this, the
For example, if the camera measures the object ahead of the front of the vehicle using the peripheral
On the other hand, the vehicle
Therefore, the
2, a HUD coordinate system indicating coordinates of the head-
The
That is, when the peripheral
Accordingly, the
For example, as shown in FIG. 3, the angle of view of the image A photographed through the camera of the peripheral
Here, the viewpoint conversion matrix is defined differently depending on the angle of view of the camera and the angle of view of the head-up display. That is, by defining the viewpoint transformation matrix according to the angle of view, the viewpoints can be matched through mutual coordinate transformation.
Accordingly, the coordinates (x, y) of the camera can be converted into the coordinates (x ', y') of the head-up
The
The map
Accordingly, the
For example, as shown in Fig. 4, the road shape can be displayed by displaying the
4, the
Here, the safe running speed means a speed at which the vehicle can safely run without a deviation of the road from the curved road, and the safety steer angle means a steer angle for traveling along the
The
As described above, according to the safety driving information display apparatus using the head-up display according to the embodiment of the present invention, in order to display the information measured from the peripheral information measuring apparatus, the coordinates of the peripheral information measuring apparatus and the coordinates of the head- It is possible to reduce the sense of heterogeneity of the augmented reality by displaying the road shape on the curved road as the augmented reality, and to display the safe driving information running on the curved road so as to enable safe driving.
5 is a flowchart illustrating a method of controlling a safe driving information display apparatus using a head-up display according to an embodiment of the present invention.
As shown in FIG. 5, in the control method of the safe driving information display apparatus using the head-up display, the
Here, the peripheral
These peripheral
After receiving the sensing image of the object in step S10, the
For example, if the camera measures the object ahead of the front of the vehicle as the peripheral
After the coordinates of the head-up
Accordingly, when a change in coordinates according to the posture of the vehicle occurs, the
2, a HUD coordinate system indicating coordinates of the head-up
After the coordinates are coincident with each other through the step S40, the
That is, when the peripheral
3, the
Here, the viewpoint conversion matrix is defined differently depending on the angle of view of the camera and the angle of view of the head-up display. That is, by defining the viewpoint transformation matrix according to the angle of view, the viewpoints can be matched through mutual coordinate transformation.
In step S50, the
That is, the coordinates (x, y) of the camera can be converted into the coordinates (x ', y') of the head-up
In step S60, the
After determining the position of the vehicle in step S70, the
At this time, as shown in FIG. 4, the
In step S80, the road gradient is displayed on the curved road section. In addition, the
Here, the safe driving information may include at least one of a safe running speed according to the gradient of the road on the curved road and a safety steered angle for traveling along the
After displaying the safe driving information in step S90, the
If the vehicle speed exceeds the safe running speed in step S100, the
On the other hand, if the speed of the vehicle is reduced below the safe running speed in step S100, the
As described above, according to the control method of the safe driving information display apparatus using the head-up display according to the embodiment of the present invention, in order to display the measured information from the peripheral information measuring apparatus, The road shape on the curved road is represented as an augmented reality to reduce the sense of heterogeneity of the augmented reality, and safe driving information for traveling on the curved road is displayed so that safe driving can be achieved.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. I will understand.
Accordingly, the true scope of the present invention should be determined by the following claims.
10: peripheral information measuring unit 20: vehicle attitude measuring unit
30: GPS receiver 40: map data storage
50: control unit 60: head-up display
70: Warning part 80: Old wiring
85: Center line
Claims (17)
A GPS receiver for receiving GPS signals from satellites;
A peripheral information measuring unit installed in the vehicle and measuring a front object;
A map data storage unit for storing road information for a driving route; And
The display unit reads the road information corresponding to the position of the vehicle obtained from the GPS receiver from the map data storage unit, And a control unit for calculating safe driving information based on the speed of the head-up display and displaying the safe driving information on the head-up display.
Matching the coordinates of the head-up display with the coordinates of the mounting position of the peripheral information measuring unit; And
Displaying the road shape on the head-up display by receiving the road information from the map data storage unit based on the position of the vehicle obtained from the GPS receiver while displaying the matching position of the object in the coordinates of the head-up display; And a controller for controlling the operation of the head-up display.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150170958A KR101826627B1 (en) | 2015-12-02 | 2015-12-02 | Apparatus for displaying safety driving information using head-up display and control method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150170958A KR101826627B1 (en) | 2015-12-02 | 2015-12-02 | Apparatus for displaying safety driving information using head-up display and control method thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
KR20170065082A true KR20170065082A (en) | 2017-06-13 |
KR101826627B1 KR101826627B1 (en) | 2018-02-08 |
Family
ID=59218779
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150170958A KR101826627B1 (en) | 2015-12-02 | 2015-12-02 | Apparatus for displaying safety driving information using head-up display and control method thereof |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101826627B1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020235160A1 (en) * | 2019-05-22 | 2020-11-26 | パナソニックIpマネジメント株式会社 | Display system |
KR20210011980A (en) * | 2019-03-15 | 2021-02-02 | 아포스테라 게엠베하 | Vibration compensation device and vibration compensation method |
US11615599B2 (en) | 2019-03-15 | 2023-03-28 | Harman International Industries, Incorporated | Apparatus of shaking compensation and method of shaking compensation |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4534079B2 (en) * | 2004-11-25 | 2010-09-01 | 日本精機株式会社 | Vehicle display device |
JP2009250827A (en) * | 2008-04-08 | 2009-10-29 | Panasonic Corp | Navigation device, method, and program |
JP5988785B2 (en) * | 2012-09-07 | 2016-09-07 | 三菱電機株式会社 | Driving assistance device |
-
2015
- 2015-12-02 KR KR1020150170958A patent/KR101826627B1/en active IP Right Grant
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20210011980A (en) * | 2019-03-15 | 2021-02-02 | 아포스테라 게엠베하 | Vibration compensation device and vibration compensation method |
US11615599B2 (en) | 2019-03-15 | 2023-03-28 | Harman International Industries, Incorporated | Apparatus of shaking compensation and method of shaking compensation |
WO2020235160A1 (en) * | 2019-05-22 | 2020-11-26 | パナソニックIpマネジメント株式会社 | Display system |
US11875760B2 (en) | 2019-05-22 | 2024-01-16 | Panasonic Intellectual Property Management Co., Ltd. | Display system |
Also Published As
Publication number | Publication date |
---|---|
KR101826627B1 (en) | 2018-02-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11034297B2 (en) | Head-up display and program | |
US20200012097A1 (en) | Head-up display device, display control method, and control program | |
JP5212748B2 (en) | Parking assistance device | |
US10179588B2 (en) | Autonomous vehicle control system | |
US7482909B2 (en) | Night vision device | |
KR20170060652A (en) | Apparatus for matching coordinate of head-up display | |
JP6459205B2 (en) | Vehicle display system | |
WO2016092591A1 (en) | Collision risk calculation device, collision risk display device, and vehicle body control device | |
KR20200016958A (en) | Parking Assistance Method and Parking Assistance Device | |
CN109968977B (en) | Display system | |
CN109927552B (en) | Display device for vehicle | |
KR20140071174A (en) | Lane guide device in vehicle and method thereof | |
US11325470B2 (en) | Method, device and computer-readable storage medium with instructions for controlling a display of an augmented-reality head-up display device for a transportation vehicle | |
CN111034186B (en) | Surrounding vehicle display method and surrounding vehicle display device | |
KR102452474B1 (en) | Apparatus for keeping virtual lane and method thereof | |
JP2019526105A (en) | Method for creating a map of a peripheral model, vehicle control system, and corresponding vehicle | |
KR101826627B1 (en) | Apparatus for displaying safety driving information using head-up display and control method thereof | |
WO2021020145A1 (en) | Display control device | |
KR101588787B1 (en) | Method for determining lateral distance of forward vehicle and head up display system using the same | |
JP7450230B2 (en) | display system | |
KR20170055577A (en) | Apparatus for displaying building information using head up display and method thereof | |
KR20180026418A (en) | Apparatus for matching coordinate of head-up display | |
KR101835409B1 (en) | Apparatus for controlling head-up display and method thereof | |
JP2016118859A (en) | Information display apparatus, control method, program, and recording medium | |
US20230410383A1 (en) | Display control device, display device, display system, vehicle, display control method, and non-transitory storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E902 | Notification of reason for refusal | ||
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant |