KR101611167B1 - Driving one's view support device - Google Patents

Abstract

More particularly, the present invention relates to an apparatus and method for supporting a driving visual field, and more particularly, to a driving visual aid apparatus for mounting a display on a surface of a driver's seat or a driver's seat interior structure, And provides a driving vision support device that shows the invisible part of the cloud.

Description

{DRIVING ONE'S VIEW SUPPORT DEVICE}

More particularly, the present invention relates to an apparatus and method for supporting a driving visual field, and more particularly, to a driving visual aid apparatus for mounting a display on a surface of a driver's seat or a driver's seat interior structure, And showing the invisible portion of the driver's body.

Recently, traffic accidents are frequent in areas where frequent passengers such as apartment parking lots and residential areas are on the rise, and victims are known to be mostly children and elderly people.

Such traffic accidents are mainly caused by driver's carelessness, but there is also a blind spot where the driver can not see through windows or mirrors.

In order to solve this problem, in order to obtain a wider view of the driver, it is necessary to install an auxiliary mirror such as a convex mirror, a technique of photographing a blind spot around the vehicle with a camera or the like and displaying the blind spot on a monitor installed in the driver's seat, A screen display related technology that reduces a square of a rear view field generated when a car is changed by adjusting a camera angle and a screen division of a monitor so that an area of a car side to which the user intends to enter is more detailed, Or a technique of emitting a warning sound or displaying a distance from the vehicle when approaching an obstacle is used.

However, these technologies can not perfectly cover blind spots. Among these technologies, the technology to be displayed on the screen (monitor) needs to be considered by the driver since the image displayed on the screen does not match the real world. For example, in the case of a rear-view camera, the driver sees the front to look at the monitor, but the actual image provides the rear image.

Korean Patent Laid-Open Publication No. 10-2012-0035215 discloses a peripheral device for perceiving a vehicle.

Korean Published Patent [10-2012-0035215]

It is therefore an object of the present invention to provide a three-dimensional model of a real world sensed during operation without distortion at the driver's viewpoint, And to provide a driving visual field support device that widens the field of view of the driver by allowing the user to see the invisible exterior.

According to an aspect of the present invention, there is provided an apparatus and method for operating a vision system, including: a real world sensing unit provided in an operating body for three-dimensionally sensing the outside of the operating body in real time; A modeling unit 200 for generating a three-dimensional modeling image based on the information sensed by the real-world sensing unit 100, including a route, a passenger, and a structure; A driving information acquiring unit (300) for acquiring operating information including at least one of steering, attitude, speed and acceleration of the operating body; A field of view sensing unit 400 for three-dimensionally tracking the position of the driver's eye to obtain visual information; A display unit 500 provided inside the driver's seat of the operating unit; And an image matching unit 600 for generating an image matching the three-dimensional modeling image, the driving information, the view information, and the three-dimensional shape of the display unit 500, which is viewed by the driver directly from the outside world. And an image generated by the image matching unit 600 is displayed through the display unit 500. [0033] FIG.

In addition, the sensing unit 100 may include at least one selected from an optical sensor and an acoustic sensor.

In addition, the display unit 500 includes a flexible thin film type display.

In addition, when the line connecting the point of the cockpit's display unit 500 is extended from the position of the eyes of the driver using the polygon rendering or ray tracing method, the image matching unit 600 may calculate the actual driving distance And finding a point of the route model.

In addition, the image matching unit 600 reflects running route information or driving information on the matched image.

In addition, the image matching unit 600 may reflect danger information on the matched image.

According to the operation support apparatus of the present invention,

Since the 3D model of the real world sensed during operation is provided without distortion at the viewpoint of the driver, it is possible to see the outside which is hidden by the interior of the driver's seat or the driver's seat, thereby enhancing the safety by widening the view of the driver .

In addition, since the flexible thin film type display is used, the display can be mounted on the interior surface of the interior of the driver's cab, and the display unit can be configured in various forms.

In addition, since information (navigation information, etc.) necessary for driving is matched with actual driving, it is not necessary for the driver to change the line of sight, so that it is possible to recognize the driving situation easily and quickly, thereby further enhancing safety.

In addition, since the risk information is matched with the actual information, it is possible to quickly cope with the risk, thereby further enhancing safety.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram of an apparatus for supporting a vision according to an embodiment of the present invention; FIG.
2 is an exemplary view showing an interior of a general driver's seat;
FIG. 3 is an exemplary view showing an interior of a driver's seat to which an apparatus for supporting vision for driving according to an embodiment of the present invention is applied. FIG.

Hereinafter, the present invention will be described in more detail with reference to the drawings. It is to be noted that the same elements among the drawings are denoted by the same reference numerals whenever possible. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

FIG. 1 is a block diagram of an apparatus for supporting an operation visual field according to an embodiment of the present invention. FIG. 2 is an exemplary view showing an interior of a general driver's seat. Fig.

1, an apparatus for supporting an operation according to an embodiment of the present invention includes a real world sensing unit 100, a modeling unit 200, a driving information acquiring unit 300, a vision sensing unit 400, A display unit 500 and an image matching unit 600. The display unit 500 displays the image generated by the image matching unit 600. [

The apparatus for driving the visual field according to an embodiment of the present invention mounts a display in a driver's seat of a driver's vehicle such as an automobile, an airplane, or a ship and provides a three-dimensional model of the real world sensed during operation without distortion at the driver's point The driver can be provided with a field of view beyond the window. As a result, it is possible to see the invisible part of the driver's cab or the interior of the driver's cab, thus enabling safe operation.

In other words, by mounting the display on the whole or part of the interior surface of the adjustment interior, modeling the actual outside world such as road, sky and sea, which is operated using the three-dimensional sensor, and displaying it on the display according to the driver's vision, You can broaden your view.

Hereinafter, each configuration will be described in detail.

The real-world sensing unit 100 is provided on the operating body to sense the outside of the operating body in three-dimensional in real time.

In this case, the sensing unit 100 may include at least one selected from an optical sensor and an acoustic sensor. Here, the optical sensor may be a camera or the like, and the sonic sensor may be an ultrasonic sensor or the like.

The modeling unit 200 generates a three-dimensional modeling image based on the information sensed by the real-world sensing unit 100, including a route, a passenger, and a structure.

In other words, real-time real-time 3D sensing and modeling in the driving direction is possible.

 The driving information obtaining unit 300 obtains driving information including at least one selected from the steering, attitude, speed, and acceleration of the operating body.

The attitude information of the driver is important in order to provide the image to be viewed directly from the viewpoint of the driver.

Also, due to the time difference between image generation and display, the image and the real world can not be matched and parallax can occur. In order to eliminate this, additional information such as steering, speed, acceleration, deceleration, etc. of the running body may be required.

The visual field sensing unit 400 tracks the position of the eyes of the driver three-dimensionally to acquire visual field information.

In order to display the matched real-time image through the display unit, it is necessary to accurately measure the position of the driver's eye. The visual field sensing unit 400 for this purpose must find the position of the driver's eye three-dimensionally at a speed equal to or higher than the displayed speed.

The display unit 500 is provided inside the driver's seat of the operating body.

In this case, the display unit 500 may include a flexible thin film type display.

The most preferred form may mount or deposit the display portion 500 so that the driver feels as if the interior is absent.

For example, the display unit 500 may be manufactured as a dashboard to replace the dashboard, and the flexible thin film display may be attached to the surface of the dashboard.

The interior of the driver's seat of the vehicle can constitute the display unit 500 in whole or in part, and a digital color or monochrome image display can be used. In other words, display information can be transmitted in color or black and white for all the pixels.

The types of displays that can be used here include a light emitting diode display (LED), a liquid crystal display (LCD) (thin film transistor liquid crystal display (TFT LCD)), a plasma display panel (PDP) (Surface Alternating Lighting (ALiS) (DLP), a silicon liquid crystal (LCoS), an organic light emitting diode (OLED), a surface conduction electron-emitting device display (SED), a field emission display (FED), a laser TV (quantum dot laser o liquid crystal laser) FLD), interferometric modulator display (iMoD), thick film dielectric electricity (TDEL), quantum dot display (QD-LED), telescopic pixel display (TPD), organic light emitting transistor (OLET) .

Based on the three-dimensional modeling image, the driving information, the view information, and the three-dimensional shape of the display unit 500, the image matching unit 600 generates an image matching the actual outside world with the driver.

In order to provide the field of view perfectly aligned with the real world in the cockpit interlock display including the curved surface, the modeling unit 200 generates a three-dimensional modeling image of the real world in real time based on the information sensed from the real sensing sensing unit 100 A three-dimensional model of the display unit 500 configured in the driver's seat, driving information acquired in real time using the driving information acquiring unit 300, and a visual field obtained in real time using the visual field sensing unit 400 When the line connecting the one point of the interior of the driver's seat to the driver's eye position is expanded by reflecting the information (the position of the driver's eyes) on the 3D modeling image of the real world, And generates a matched image. At this time, the three-dimensional model of the display unit 500 configured in the driver's seat is preferably prepared in advance.

For example, the three-dimensional model of the display unit 500 constructed in the interior of the driver's seat modeled in the interior coordinate system is prepared before the execution time, and the position of the driver's eyes measured in real time during the operation of the driver is changed to the interior coordinate system.

In addition, real-time roads and route models that are generated in real time are converted into interior coordinate systems. This allows ray tracing to be performed in the same coordinate system.

In addition, in order to overcome the time difference between the generation and display of the image, the driving information may be provided in the 'information transmitting device related to the driving such as the speed and direction of the driving vehicle'.

In addition, when the line connecting a point of the interior of the cockpit is expanded from the position of the driver's eye, the actual operating roads associated with the line and the points of the route model are searched. At this time, a graphics computing unit can be used. You can perform polygon rendering that simulates the above operations, or you can use direct ray tracing. Depending on the application, the points of several roads and route models can be superimposed transparently or only the closest point like the real world can be seen.

The operation visibility assisting device according to the embodiment of the present invention can ensure the entire field of view of the driver since the entire interior of the automobile can be a screen. For example, as shown in FIG. 2, the outside can be seen through a limited view through a window and a mirror in a general driver's seat. However, as shown in FIG. 3, Inside the driver's seat, you can also see the outside environment covered by the driver's seat or interior of the driver's seat.

At this time, when the line connecting the one point of the cockpit display unit 500 is extended from the position of the eyes of the driver using the polygon rendering or the ray tracing method, the image matching unit 600 may calculate an actual driving route And finding a point of the route model.

Here, the ray tracing method is one of the techniques of imaging the computer graphics. In order to solve the difficulty in realistic representation of the conventional shadow model, the light from the light source is reflected by the object through the certain path ㅇ It is necessary to accurately track whether the image is absorbed and finally reach the eye (or pixel), and to construct an image based on the information. Ray tracing is a technique for realizing this algorithm. Actually, in order to improve the computation efficiency, only the rays touching the eyes (or pixels) are traced backward to make a path diagram of the rays by the object, and then a method of determining the shade of each pixel from the shade of the object by going back to the path diagram . Ray tracing has attracted particular attention in recent years because of the variety of objects that can be treated as models.

And the image matching unit 600 may reflect the running route information or the driving information on the matched image.

In the case of automobiles, navigation is used for the purpose of presenting information on driving roads, obstacles in progress. Such information may be combined with an Augmented Reality (AR) and displayed to the driver by using the display unit 500. Here, augmented reality is a technique of superimposing virtual objects on the real world seen by the user. It is called Mixed Reality (MR) because it combines real world and virtual world with additional information in real time and displays it as one image. In other words, it is a hybrid VR system that combines the real environment with the virtual environment.

Augmented reality, a concept that complements the real world with a virtual world, uses a virtual environment created by computer graphics, but the protagonist is a real environment. Computer graphics serve to provide additional information needed for the real world. By overlapping the three-dimensional virtual image on the real image that the user is viewing, it means that the distinction between the real environment and the virtual screen becomes blurred.

Virtual reality technology allows a user to be immersed in a virtual environment, and the real environment can not be seen. However, augmented reality technology, which is a mixture of real environment and virtual objects, allows the user to see the real environment and provides better realism and additional information. For example, if you use a smartphone camera to illuminate the surroundings, information such as the location of a nearby store, phone number, and the like is displayed as a stereoscopic image. The developed augmented reality system is HMD (head mounted display) such as video system and optical system.

For example, when there is information such as a road on a navigation system of an automobile, a ship, an airplane route, etc., it is possible to present a driving situation to a driver by displaying a running road, route information, Since the information on the interior of the control interior is displayed in correspondence with the actual roads shown in the window, it is possible to recognize the situation of the driving road easily and quickly, rather than changing the eyes to conventionally view the navigation installed at the center.

The image matching unit 600 may reflect the danger information on the matched image.

For example, it is possible to visualize the collision warning for the invisible part of the interior of the driver's seat, and to send out a warning sound. Accordingly, a safe operating environment can be provided.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

100: real world sensing unit
200: Modeling unit
300: Operation information obtaining unit
400: vision sensing unit
500:
600:

Claims (6)

A real world sensing unit (100) provided in the cloud and sensing the outside of the cloud in three dimensions in real time;
A modeling unit 200 for generating a three-dimensional model including a route, a passenger, and a structure based on the information sensed by the real-world sensing unit 100;
A driving information acquiring unit (300) for acquiring operating information including at least one of steering, attitude, speed and acceleration of the operating body;
A field of view sensing unit 400 for three-dimensionally tracking the position of the driver's eye to obtain visual information;
A display unit 500 provided in the operating body including the curved surface to display a three-dimensional modeling image of the external real world generated from the image matching unit 600 in real time; And
Based on the three-dimensional modeling image, the driving information, the view information, and the three-dimensional shape of the display unit 500, a point of the display unit 500 at the driver's eye position An image matching unit 600 for searching a point of an actual operation road and a route model associated with a line when the connected line is extended and generating a matched image with a driver looking directly at an actual outside world through a window;
And a driver for driving the visual field.
The method according to claim 1,
The sensing unit 100 includes:
An optical sensor, and an acoustic sensor.
delete delete The method according to claim 1,
The image matching unit 600
And reflects the running route information or the driving information on the matched image.
The method according to claim 1,
The image matching unit 600
And the risk information is reflected on the matched image.

Images