KR20210042431A - System for providing 3D head-up display and control method thereof - Google Patents

Abstract

Disclosed are a three-dimensional (3D) head-up display (HUD) system and a control method thereof. That is, the present invention may increase user satisfaction by providing a more realistic HUD image to a user and displaying information in a state with less heterogeneity by providing the user with an image located at a desired distance using a 3D display that can present different information to both eyes of the user.

Description

3D head-up display system and its control method TECHNICAL FIELD

The present invention relates to a 3D head-up display system and a control method thereof, and in particular, a 3D display that provides a user with an image located at a desired distance using a 3D display capable of providing different information to both eyes of the user. It relates to a head-up display system and a control method thereof.

A head-up display (or windshield display) is a device that displays an indication of a vehicle speed or heading direction on the front glass of a vehicle.

Among these head-up displays, the articulated head-up display has a difference between the image of the head-up display and the actual external object due to the limit of the distance between the image and the user's eyes. Due to the difference in the distance between the image of the display and the actual external object, a feeling of disparity is felt when using.

In addition, the head-up display has to create a location length where the image is formed by a projection unit and a plurality of reflectors in order to create a difference in the length of the path, and the longer the location of the image, the larger the size of the module is inevitably. In addition to having the image, the position of the image thus created can only be located at a single position, so there is a limit to the image to be expressed.

Korean Patent Registration No. 10-1610275 [Title: Variable Focus Heard System]

An object of the present invention is to provide a 3D head-up display system and a control method thereof that provide an image located at a desired distance to a user using a 3D display capable of providing different information to both eyes of a user. have.

Another object of the present invention is to generate a 3D image using information obtained through a communication unit, a sensor unit, a photographing unit, etc., and reflect a 3D image displayed through a 3D display through a reflector to windshield a 3D HUD image of a virtual image. It is to provide a 3D head-up display system and a control method thereof.

A 3D head-up display system according to an embodiment of the present invention includes: a sensor unit that measures information on an object located in front of a vehicle, which is a moving direction of the vehicle, and collects information related to the vehicle; A photographing unit that acquires image information including the object; A communication unit for receiving information on surrounding conditions according to the location of the vehicle provided from a server and additional information related to an object in the image information; A gaze tracking unit that detects a gaze direction and a gaze position of a user in the vehicle; Information on the measured object located in front of the vehicle, information related to the collected vehicle, the acquired image information, surrounding situation information according to the location of the received vehicle, addition related to the object in the received image information A control unit for generating 3D content to be provided to the user based on at least one of information, the detected gaze direction and gaze position of the user, and destination information according to a user input; A 3D display that outputs 3D content generated by the control unit; A reflector that reflects the 3D content output by the 3D display; And a windshield that displays the image reflected by the reflector.

As an example related to the present invention, the 3D content includes at least one of route guidance information according to the destination information, additional information on an object located in front of the vehicle, and detailed information related to the vehicle, and the additional information, It includes at least one of distance, speed, and additional information between the vehicle and the object, and the detailed information may include surrounding situation information according to the location of the vehicle and information related to the collected vehicle.

As an example related to the present invention, the windshield, when the 3D content includes additional information on an object located in front of the vehicle and detailed information related to the vehicle, the windshield adjacent to an actual object located in front of the vehicle The additional information included in the reflected image may be displayed on one side of the windshield, and the detailed information included in the reflected image may be displayed on the other side of the windshield.

A method of controlling a 3D head-up display system according to an embodiment of the present invention includes: measuring information on an object located in front of a vehicle, which is a moving direction of the vehicle, by a sensor unit; Collecting information related to the vehicle by the sensor unit; Obtaining, by a photographing unit, image information including the object; Receiving, by a communication unit, information on surrounding conditions according to the location of the vehicle provided from a server and additional information related to an object in the image information; Detecting, by a gaze tracking unit, a gaze direction and a gaze position of a user in the vehicle; By the control unit, information on the measured object located in front of the vehicle, information related to the collected vehicle, the acquired image information, surrounding situation information according to the position of the received vehicle, within the received image information Generating 3D content to be provided to the user based on at least one of additional information related to an object, the detected user's gaze direction and gaze position, and destination information according to a user input; Outputting 3D content generated by the control unit by a 3D display; And displaying, by a windshield, an image of the 3D content output by the 3D display reflected by the reflector.

As an example related to the present invention, in the displaying of the reflected image, the 3D content may include route guidance information according to the destination information, additional information on an object located in front of the vehicle, and detailed information related to the vehicle. In this case, information on the driving direction of the vehicle according to the road guidance information included in the reflected image is displayed on one side of the windshield based on the actual lane located in the front of the vehicle, and the actual object located in the front of the vehicle is displayed. Additional information included in the reflected image may be displayed on the other side of the adjacent windshield, and the detailed information included in the reflected image may be displayed on another side of the windshield.

The present invention provides a more realistic HUD image to the user by using a 3D display capable of providing different information to both eyes of the user and providing an image located at a desired distance to the user, and a state with less heterogeneity. As the information is displayed, there is an effect of increasing the satisfaction level in use.

In addition, the present invention generates a 3D image using information obtained through a communication unit, a sensor unit, a photographing unit, etc., and reflects a 3D image displayed through a 3D display through a reflector to reflect a 3D HUD image of a virtual image to the windshield. By configuring the entire system in a compact size, cost is reduced, the distance between the display and the eye is closer, providing a wider usage environment even with a smaller sized 3D display, expressing information on distant objects, and There is an effect of being able to express information about an existing object.

1 and 2 are block diagrams showing the configuration of a 3D head-up display system according to an embodiment of the present invention.
3 is a flowchart illustrating a method of controlling a 3D head-up display system according to an embodiment of the present invention.
4 is a diagram showing an example of image information according to an embodiment of the present invention.
5 and 6 are diagrams showing examples of virtual images displayed on a windshield according to an embodiment of the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as generally understood by those of ordinary skill in the technical field to which the present invention belongs, unless otherwise defined in the present invention, and is excessively comprehensive. It should not be construed as a human meaning or an excessively reduced meaning. In addition, when a technical term used in the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be understood by being replaced with a technical term that can be correctly understood by those skilled in the art. In addition, general terms used in the present invention should be interpreted as defined in the dictionary or according to the context before and after, and should not be interpreted as an excessively reduced meaning.

In addition, the singular expression used in the present invention includes a plurality of expressions unless the context clearly indicates otherwise. In the present invention, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various components or steps described in the invention, and some components or some steps may not be included. It is to be construed that it may or may further include additional components or steps.

In addition, terms including ordinal numbers such as first and second used in the present invention may be used to describe the elements, but the elements should not be limited by the terms. The terms are used only to distinguish one component from another. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted.

In addition, in describing the present invention, when it is determined that a detailed description of a related known technology may obscure the subject matter of the present invention, a detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are only for easily understanding the spirit of the present invention and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

1 and 2 are block diagrams showing the configuration of a 3D head-up display system 100 according to an embodiment of the present invention.

1, the 3D head-up display system 100 includes a communication unit 110, a sensor unit 120, a photographing unit 130, a gaze tracking unit 140, a storage unit 150, and a 3D display. 160), a reflector 170, a windshield 180, and a control unit 190. Not all of the components of the 3D head-up display system 100 shown in FIGS. 1 and 2 are essential components, and the 3D head-up display system ( 100) may be implemented, or the 3D head-up display system 100 may be implemented with fewer components.

The 3D head-up display system (or articulated 3D head-up display system) 100 may be arranged (or configured/formed) at a specific position in the vehicle and configured to be detachable/attached.

The communication unit 110 communicates with an internal element or at least one external terminal through a wired/wireless communication network. In this case, the external terminal may include a server (not shown), another terminal provided in another adjacent vehicle (not shown), and the like. Here, as the wireless Internet technology, wireless LAN (WLAN), DLNA (Digital Living Network Alliance), Wireless Broadband: Wibro, Wimax (World Interoperability for Microwave Access: Wimax), HSDPA (High Speed Downlink Packet Access) ), High Speed Uplink Packet Access (HSUPA), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS), etc. In addition, the communication unit 110 transmits and receives data according to at least one wireless Internet technology in a range including Internet technologies not listed above. In addition, short-range communication technologies include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Near Field Communication (NFC). , Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, Wi-Fi Direct, and the like may be included. In addition, wired communication technologies may include power line communication (PLC), USB communication, Ethernet, serial communication, optical/coaxial cable, and the like.

In addition, the communication unit 110 may mutually transmit information with an arbitrary terminal through a universal serial bus (USB).

In addition, the communication unit 110 includes technical standards or communication methods for mobile communication (for example, GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), CDMA2000 (Code Division Multi Access 2000)), EV -DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.), transmits and receives radio signals to and from the base station, the server, the other terminal, and the like.

In addition, the communication unit 110 is controlled by the control unit 190, the location information of the vehicle identified in real time by the server, the image information acquired through the photographing unit 130 (or the object in the image information) Information about (for example, including vehicle number of an object such as a vehicle), etc. are transmitted.

In addition, the communication unit 110, under the control of the control unit 190, is transmitted from the server in response to the transmission of the information, information related to the surrounding situation according to the location of the vehicle (or surrounding situation information) (for example, Including speed limit information on the corresponding road, construction information on neighboring roads, etc.), additional information related to an object in the image information (eg, information on whether a stolen vehicle or non-payment of fines is arrears), and the like are received.

The sensor unit 120 is disposed (or configured/formed) on one side of the vehicle in which the 3D head-up display system 100 is configured.

In addition, the sensor unit 120 includes various sensors (eg, including lidar sensors, ultrasonic sensors, 3D scanners, etc.) for measuring distances and speeds related to objects located in the traveling direction of the vehicle (or the front of the vehicle). do. Here, the object includes other vehicles, buildings, road signs, traffic signs, etc. located in front of the vehicle.

In addition, the sensor unit 120 measures (or senses) information on an object including a distance, speed, etc. related to the object located in front of the vehicle.

In addition, the sensor unit 120 measures information on an object located in a direction opposite to the traveling direction of the vehicle (or the rear of the vehicle).

In addition, the sensor unit 120 collects information related to the vehicle (eg, driving speed, engine rotational value (RPM), instant fuel economy, real-time voltage, water temperature, mileage, etc.). In this case, the sensor unit 120 may collect information related to the vehicle measured through various other sensors (not shown) provided in the vehicle.

The photographing unit (or camera unit) 130 is disposed (or configured/formed) on one side of the vehicle in which the 3D head-up display system 100 is configured.

In addition, the photographing unit 130 is configured with one or more image sensors (camera module or camera) to photograph the front surface including the front of the vehicle, the rear of the vehicle, and the side of the vehicle. In this case, the photographing unit 130 may be configured as a stereo camera capable of obtaining image information in all directions of 360 degrees.

In addition, the photographing unit 130 acquires (or photographs) image information including one or more objects located in front of the vehicle.

That is, the photographing unit 130 processes an image frame such as a still image or a video obtained by an image sensor (a camera module or a camera) in a video call mode, a photographing mode, a video conference mode, and the like. That is, according to the codec (CODEC), corresponding image data obtained by the image sensor is encoded/decoded to meet each standard. For example, the photographing unit 130 photographs an object (or subject) and outputs a video signal corresponding to the photographed image (subject image).

In addition, the photographing unit 130 acquires other image information including one or more other objects located at the rear of the vehicle.

In addition, the image frame (or image information) processed by the photographing unit 130 is stored in a digital video recorder (DVR), stored in the storage unit 150, or through the communication unit 110. It can be transmitted to an external server or the like.

In addition, the 3D head-up display system 100 may receive destination information according to a user input through an input unit (not shown).

In this way, the communication unit 110, the sensor unit 120, the photographing unit 130, and the input unit included in the 3D head-up display system 100 include information related to the vehicle, and the vehicle is running. It is possible to collect (or measure/detect) various information about one or more objects located in the front of the vehicle and/or at the rear of the vehicle corresponding to the direction opposite to the driving direction.

The gaze tracking unit 140 is disposed (or configured/formed) on one side of a vehicle in which the 3D head-up display system 100 is configured.

In addition, the gaze tracking unit 140 detects (or tracks) the gaze direction and gaze position (or the direction and location in which the user looks outside the vehicle) of the user (or driver) located in the driver's seat of the vehicle.

That is, the gaze tracking unit 140 detects a direction and a position in which the user located in the driver's seat looks at the front of the vehicle or a side mirror (not shown) configured on the side of the vehicle.

The storage unit 150 stores various user interfaces (UI), graphic user interfaces (GUI), and the like.

In addition, the storage unit 150 stores data and programs necessary for the 3D head-up display system 100 to operate.

That is, the storage unit 150 includes a plurality of application programs (application programs or applications) driven by the 3D head-up display system 100, data for the operation of the 3D head-up display system 100, You can store commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the 3D head-up display system 100 from the time of shipment for basic functions of the 3D head-up display system 100. Meanwhile, the application program is stored in the storage unit 150, installed in the 3D head-up display system 100, and performs an operation (or function) of the 3D head-up display system 100 by the control unit 190. Can be driven to

In addition, the storage unit 150 is a flash memory type (Flash Memory Type), a hard disk type (Hard Disk Type), a multimedia card micro type (Multimedia Card Micro Type), a card type memory (for example, SD or XD Memory, etc.), magnetic memory, magnetic disk, optical disk, RAM (Random Access Memory: RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory: ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), It may include at least one storage medium among Programmable Read-Only Memory (PROM). In addition, the 3D head-up display system 100 may operate a web storage that performs a storage function of the storage unit 150 on the Internet, or may operate in connection with the web storage.

In addition, the storage unit 150 includes the location information of the vehicle transmitted to the server under the control of the control unit 190, and the image information acquired through the photographing unit 130 (or the object in the image information). It stores information (eg, vehicle number for an object such as a vehicle, etc.)) and the like.

In addition, the storage unit 150 is transmitted from the server in response to the transmission of the information under the control of the controller 190, and information related to the surrounding situation according to the location of the vehicle (or surrounding situation information) (for example, It stores speed limit information on the corresponding road, construction information on neighboring roads, etc.), and additional information related to an object in the image information (eg, information on whether a stolen vehicle or non-payment of fines is arrears), and the like.

The 3D display (or 3D monitor/3D display) 160 is disposed (or configured/formed) on one side of the vehicle in which the 3D head-up display system 100 is configured.

In addition, the 3D display 160 may display various contents such as various menu screens using a user interface and/or a graphic user interface stored in the storage unit 150 under the control of the controller 190. Here, the content displayed on the 3D display 160 includes various text or image data (including various information data) and a menu screen including data such as icons, list menus, and combo boxes. In addition, the 3D display 160 may be a touch screen.

In addition, the 3D display 160 includes a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible device. It may include at least one of a flexible display, an e-ink display, and a light emitting diode (LED).

In addition, the 3D display 160 outputs (or displays) 3D content generated based on the collected various pieces of information under the control of the controller 190. At this time, the 3D content includes road guidance information (or route guidance information) according to the destination information, additional information on an object located in front of the vehicle (or an object included in the image information), detailed information related to the vehicle, etc. The route guidance information, the additional information, the detailed information, etc. are displayed adjacent to the actual object located in front of the vehicle in consideration of the position of the object in the image information, or the viewing angle of the user or the user and the object In consideration of the focus of the liver, a location in the corresponding 3D content may be set to be displayed at a specific location. Here, the additional information (or additional information on the object located in the front of the vehicle/the rear of the vehicle) includes information such as distance between the vehicle and the object, speed, and additional information (for example, whether the vehicle is stolen, whether or not a penalty is arrears). ), etc. In addition, the detailed information (or detailed information related to the vehicle) includes various information related to the surrounding situation according to the location of the vehicle (for example, including speed limit information on the road, construction information on the surrounding road, etc.), the vehicle It includes driving speed, engine speed, instant fuel economy, real-time voltage, water temperature, mileage, alarm alarm switch, overspeed alarm, and water temperature alarm.

In addition, the 3D head-up display system 100 may further include an audio output unit (not shown) that outputs audio information included in a signal processed by a predetermined signal by the control unit 190. Here, the audio output unit may include a receiver, a speaker, a buzzer, and the like.

In addition, the voice output unit outputs a guide voice generated by the control unit 190.

In addition, the audio output unit outputs audio information (or sound effect) included in 3D content output through the 3D display 160 under the control of the controller 190.

The reflector (or mirror unit/half mirror) 170 is disposed (or configured/formed) on one side of the vehicle in which the 3D head-up display system 100 is configured.

In addition, the reflector 170 reflects the 3D content output from the 3D display 160 to the windshield 180.

The windshield 180 is disposed (or configured/formed) on one side of the windshield of the vehicle in which the 3D head-up display system 100 is configured. In this case, the windshield 180 may have a structure in which a reflective film (not shown) is formed between an outer plate glass (not shown) and an inner plate glass (not shown), or a transparent or translucent structure in which the reflective film is formed.

In addition, the windshield 180 displays an image (or a virtual image/virtual image) in which 3D content output (or displayed) by the 3D display 160 is reflected by the reflector 170. . Here, the reflected image is in a state in which a focal length of the reflected image is adjusted in an actual space, and the reflected image may be displayed at an optimum focal position in the actual space.

In this case, when the 3D content includes additional information on an object located in front of the vehicle, detailed information related to the vehicle, etc., the windshield 180 Corresponding additional information included in the image is displayed, and detailed information related to the vehicle included in the reflected image is displayed on the other side of the windshield 180.

In addition, when the 3D content includes road guidance information, the additional information, the detailed information, etc. according to the destination information, the windshield 180 is the reflected on one side based on the actual lane located in front of the vehicle. Display information on the direction of the vehicle according to the corresponding road guidance information included in the image (e.g., information such as straight, left, right, lane usage information, and left/right/U-turn information several meters ahead), and the vehicle Additional information related to the object included in the reflected image is displayed on the other side of the windshield 180 adjacent to the real object located in front, and the reflected image is displayed on the other side of the windshield 180. Displays detailed information related to the included vehicle.

In this way, the windshield 180 provides a single user (for example, a user located in a driver's seat or an assistant seat) or a plurality of users (for example, a driver's seat, an assistant seat, etc.) for the 3D content generated by the control unit 190. Of the user) can provide different images.

In addition, as described above, the reflected image displayed on the windshield 180 provides an image corresponding to information of an actual object.

For example, by placing the name tag of an object (or object) 30m away from the vehicle equipped with the 3D head-up display system 100 (or including additional information related to the object) at a position of 30m in a virtual image, the user can The actual image and the virtual image are both accepted and received as an actual image, or the actual object 30m away and the path to it are expressed as a virtual image of 0 to 30m.

In this way, the 3D head-up display system 100 tracks the direction and position of the user's eyes (or gaze), and expresses an appropriate virtual image through the 3D display 160, so that the actual driver feels that there is an image at a distance. do.

The 3D head-up display system 100 may further include a GPS receiver (not shown) that calculates (or acquires) GPS location information of the 3D head-up display system 100.

That is, the GPS receiver receives the GPS signal transmitted from the satellite, and based on the longitude coordinates and latitude coordinates included in the received GPS signal, the location data (or location information) of the 3D head-up display system 100 is stored. Occurs.

In addition, the signal received through the GPS receiver is 802.11, Bluetooth, UWB, and Zigbee, which are standard standards for wireless LANs including wireless LANs and some infrared communications proposed by the Institute of Electrical and Electronics Engineers (IEEE). 802.15, which is a standard standard for a wireless personal area network (PAN) including, etc., a wireless metropolitan area network (MAN) including a fixed wireless access (FWA), etc., and broadband wireless access (BWA). ), and 802.20, which is a standard standard for mobile Internet, for wireless MAN (Mobile Broadband Wireless Access: MBWA) including Wibro and WiMAX, etc. It may be configured to provide precise location information of the 3D head-up display system 100 to the 3D head-up display system 100.

In this way, the GPS receiver is controlled by the control unit 190 to determine the location information of the corresponding 3D head-up display system 100 (or, when the 3D head-up display system 100 is mounted on the vehicle, the location of the corresponding vehicle). Information).

The controller (or microcontroller unit (MCU) 190) is disposed (or configured/formed) on one side of the vehicle in which the 3D head-up display system 100 is configured.

In addition, the control unit 190 executes an overall control function of the 3D head-up display system 100.

In addition, the control unit 190 executes an overall control function of the 3D head-up display system 100 using programs and data stored in the storage unit 150. The control unit 190 may include RAM, ROM, CPU, GPU, and bus, and RAM, ROM, CPU, GPU, and the like may be connected to each other through a bus. The CPU can access the storage unit 150 and perform booting using the O/S stored in the storage unit 150, and use various programs, contents, data, etc. stored in the storage unit 150 Thus, various operations can be performed.

In addition, the control unit 190 includes information on an object located in front of the vehicle measured (or sensed) through the sensor unit 120 (including, for example, distance, speed, etc.), through the sensor unit 120. Collected information related to the vehicle, image information including one or more objects obtained through the photographing unit 130, various information related to the surrounding situation of the vehicle received through the communication unit 110, and the received destination 3D content to be provided to a corresponding user is generated based on information, the detected user's gaze direction, and information on the gaze position. At this time, the 3D content includes road guidance information (or route guidance information) according to the destination information, additional information on an object located in front of the vehicle (or an object included in the image information), detailed information related to the vehicle, etc. The route guidance information, the additional information, the detailed information, etc. are displayed adjacent to the actual object located in front of the vehicle in consideration of the position of the object in the image information, or the viewing angle of the user or the user and the object In consideration of the focus of the liver, a location in the corresponding 3D content may be set to be displayed at a specific location. Here, the additional information includes a distance between the vehicle and a corresponding object, a speed, and additional information (eg, information such as whether a stolen vehicle or a penalty is arrears), and the like. In addition, the detailed information includes various information related to the surrounding situation according to the location of the vehicle (eg, speed limit information on the corresponding road, construction information on the surrounding road, etc.), and the collected information related to the vehicle (eg For example, it includes driving speed related to the vehicle, engine speed, instant fuel economy, real-time voltage, water temperature, mileage, alarm alarm switch, overspeed alarm, water temperature alarm, etc.).

In this way, the generated 3D content displays additional information related to the object at a location corresponding to the actual object, displays detailed information related to the vehicle at a predetermined specific location, and displays the detailed information related to the vehicle at a location corresponding to the actual lane. This may be information in consideration of the distance between the user's eyes and the HUD image (or virtual image) so as to display information on the driving direction of the vehicle according to the generated road guidance information.

In addition, when the user's gaze moves to one side based on the detected gaze direction and gaze position information, the controller 190 reflects the gaze direction and gaze position of the moving user to the 3D content. , In response to changes in the user's gaze direction and gaze position, various information included in the 3D content (for example, including road guidance information, additional information, detailed information, etc.) is moved in the opposite direction corresponding to the corresponding movement change. I can make it.

For example, when moving about 5cm to the left while facing the front, the control unit 190 changes the corresponding movement (e.g., 5cm to the left) for directions information, additional information, and detailed information included in the 3D content. ), the corrected 3D content is output through the 3D display 160 while moving about 5cm in the opposite direction corresponding to ), and the various information is moved in a direction opposite to the change in the user's gaze movement compared to the previous 3D content. The corrected 3D content may be displayed through the windshield 180.

In addition, as described above, an image located at a desired distance may be provided to the user by using a 3D display capable of providing different information to both eyes of the user.

In addition, in this way, a 3D image is generated using information acquired through a communication unit, a sensor unit, a photographing unit, etc., and a 3D HUD image of a virtual image is reflected through a reflector through a reflector. Can be displayed.

Hereinafter, a method of controlling a 3D head-up display system according to the present invention will be described in detail with reference to FIGS. 1 to 6.

3 is a flowchart illustrating a method of controlling a 3D head-up display system according to an embodiment of the present invention.

First, the sensor unit 120 measures (or senses) information (including, for example, distance, speed, etc.) on an object located in the traveling direction of the vehicle (or the front of the vehicle). Here, the object includes other vehicles, buildings, road signs, traffic signs, etc. located in front of the vehicle. In this case, the sensor unit 120 may measure information on an object located in a direction opposite to the traveling direction of the vehicle (or the rear of the vehicle).

In addition, the sensor unit 120 collects information related to the vehicle (eg, driving speed, engine rotational value (RPM), instant fuel economy, real-time voltage, water temperature, mileage, etc.). In this case, the sensor unit 120 may collect information related to the vehicle measured through various other sensors (not shown) provided in the vehicle.

In addition, the photographing unit 130 acquires (or photographs) image information including one or more objects located in front of the vehicle. In this case, the photographing unit 130 may acquire other image information including one or more other objects located at the rear of the vehicle.

In addition, the communication unit 110 stores the real-time location of the vehicle provided from the server (not shown), information related to the surrounding situation according to the object in the image information acquired through the photographing unit 130, information related to the object, etc. Receive.

That is, the communication unit 110 controls the location information of the vehicle, which is checked in real time under the control of the control unit 190, and the image information obtained through the photographing unit 130 (or information on the object in the image information ( For example, information related to the surrounding situation according to the location of the vehicle (or surrounding situation information) is transmitted from the server to the server, and is transmitted from the server in response to the transmission. (E.g., including speed limit information on the road, construction information of neighboring roads, etc.), additional information related to the object in the image information (e.g., information such as whether a stolen vehicle or non-payment of the fine) is received. .

In addition, the 3D head-up display system 100 receives destination information according to a user input through an input unit (not shown).

In this way, the communication unit 110, the sensor unit 120, the photographing unit 130, and the input unit included in the 3D head-up display system 100 include information related to the vehicle, and the vehicle is running. It is possible to collect (or measure/detect) various information about one or more objects located in the front of the vehicle and/or at the rear of the vehicle corresponding to the direction opposite to the driving direction.

As an example, the sensor unit 120 includes a plurality of vehicles, a plurality of buildings (or buildings) located in the traveling direction of the first vehicle in which the 3D head-up display system 100 provided with the sensor unit 120 is configured. Measure the information.

In addition, the sensor unit 120 collects information related to the first vehicle (eg, driving speed, engine rotational value, instantaneous fuel economy, real-time voltage, water temperature, mileage, etc.).

In addition, as shown in FIG. 4, the photographing unit 130 acquires first image information 400 including a plurality of vehicles, a plurality of buildings (or buildings), etc. located in the traveling direction of the first vehicle. do.

In addition, the communication unit 110 transmits the location information of the first vehicle, the first image information obtained through the photographing unit 130, and the like, to the server, which are checked in real time under the control of the control unit 190. And, in response to the information transmission, first surrounding situation information related to the surrounding situation where the first vehicle is currently located (eg, first speed limit information on a driving road (eg, 80 km/h)) transmitted from the server , 2nd additional information (for example, no arrears of fines) for the second vehicle included in the first image information is received.

As another example, the input unit receives first destination information (for example, Sinsa Station intersection) according to the user input (S310).

In addition, the gaze tracking unit 140 detects (or tracks) the gaze direction and gaze position (or the direction and location in which the user looks outside the vehicle) of the user (or driver) located in the driver's seat in the vehicle.

That is, the gaze tracking unit 140 detects a direction and a position in which the user located in the driver's seat looks at the front of the vehicle or a side mirror (not shown) configured on the side of the vehicle.

For example, the gaze tracking unit 140 detects a real-time first gaze direction and gaze position of a user located in a driver's seat in the vehicle (S320).

Thereafter, the control unit 190 includes information on the object located in front of the vehicle measured (or sensed) through the sensor unit 120 (eg, including distance, speed, etc.), through the sensor unit 120. Collected information related to the vehicle, image information including one or more objects obtained through the photographing unit 130, various information related to the surrounding situation of the vehicle received through the communication unit 110, and the received destination 3D content to be provided to a corresponding user is generated based on information, the detected user's gaze direction, and information on the gaze position. At this time, the 3D content includes road guidance information (or route guidance information) according to the destination information, additional information on an object located in front of the vehicle (or an object included in the image information), detailed information related to the vehicle, etc. The route guidance information, the additional information, the detailed information, etc. are displayed adjacent to the actual object located in front of the vehicle in consideration of the position of the object in the image information, or the viewing angle of the user or the user and the object In consideration of the focus of the liver, a location in the corresponding 3D content may be set to be displayed at a specific location. Here, the additional information includes a distance between the vehicle and a corresponding object, a speed, and additional information (eg, information such as whether a stolen vehicle or a penalty is arrears), and the like. In addition, the detailed information includes various information related to the surrounding situation according to the location of the vehicle (eg, speed limit information on the corresponding road, construction information on the surrounding road, etc.), and the collected information related to the vehicle (eg For example, it includes driving speed related to the vehicle, engine speed, instant fuel economy, real-time voltage, water temperature, mileage, alarm alarm switch, overspeed alarm, water temperature alarm, etc.).

For example, the control unit 190 includes information on a plurality of vehicles, a plurality of buildings, etc. located in front of the vehicle measured through the sensor unit 120, and related to the first vehicle collected through the sensor unit 120. Information (e.g., including driving speed, engine speed, instant fuel economy, real-time voltage, water temperature, mileage, etc.), a plurality of vehicles located in the traveling direction of the first vehicle acquired through the photographing unit 130, First image information including a plurality of buildings (or buildings), etc., first surrounding situation information related to the surrounding situation in which the first vehicle is currently located (e.g. 1 speed limit information (e.g., 80 km/h), second additional information about the second vehicle included in the first image information (e.g., no arrears of fines), detected through the gaze tracking unit 140 The first 3D content to be provided to the user is generated based on the information on the first gaze direction and gaze position of the user. In this case, the first 3D content includes second additional information on the second vehicle (for example, a first distance between the first vehicle and the second vehicle (for example, 50 m), and a second speed of the second vehicle). (E.g., 80 km/h), including no arrears of fines, etc.), first detailed information about the first vehicle (e.g., first speed limit information on the driving road (e.g., 80 km/h)), the first Includes the vehicle's running speed (eg, 70km per hour), the engine's rotational value (eg, 2,000RPM), and the like.

As another example, the control unit 190 generates first route guidance information according to the real-time current location (for example, Yeoksam Station intersection) of the first vehicle according to the received first destination information (for example, Sinsa Station intersection). do.

In addition, the control unit 190 includes information on a plurality of vehicles, a plurality of buildings, etc. located in front of the vehicle measured through the sensor unit 120, and information related to the first vehicle collected through the sensor unit 120 (For example, including driving speed, engine rotational speed, instantaneous fuel economy, real-time voltage, water temperature, mileage, etc.), a plurality of vehicles located in the traveling direction of the first vehicle acquired through the photographing unit 130, a plurality of First image information including a building (or building) of, etc., first surrounding situation information related to the surrounding situation in which the first vehicle is currently located (for example, the first image information on the driving road) Speed limit information (e.g., 80 km/h), second additional information on the second vehicle included in the first image information (e.g., no arrears of fines), the generated first route guidance information, the gaze The second 3D content to be provided to the user is generated based on the information on the user's first gaze direction and gaze position sensed through the tracking unit 140. In this case, the second 3D content includes second additional information on the second vehicle (for example, a first distance between the first vehicle and the second vehicle (for example, 50 m), and a second speed of the second vehicle). (E.g., 80 km/h), including no arrears of fines, etc.), second detailed information about the first vehicle (e.g., first speed limit information on the driving road (e.g., 80 km/h), the first Including the driving speed of the vehicle (for example, 70km per hour), the engine speed (for example, 2,000 RPM), information on the direction of the vehicle according to the first route guidance information (for example, turn right in front of 659m) ) And the like (S330).

Thereafter, the 3D display 160 outputs (or displays) the 3D content generated by the control unit 190.

That is, the 3D display 160 outputs the generated 3D content under the control of the controller 190.

For example, the 3D display 160 configured (or disposed) at a specific location in the vehicle outputs the generated first 3D content under the control of the controller 190.

As another example, the 3D display 160 outputs the generated second 3D content under the control of the controller 190 (S340).

Thereafter, the windshield 180 configured on the front of the vehicle is an image (or virtual image/virtual image) in which 3D content output (or displayed) by the 3D display 160 is reflected by the reflector 170. Is displayed. Here, the reflected image is in a state in which a focal length of the reflected image is adjusted in an actual space, and the reflected image may be displayed at an optimum focal position in the actual space.

In this case, when the 3D content includes additional information on an object located in front of the vehicle, detailed information related to the vehicle, etc., the windshield 180 Corresponding additional information included in the image is displayed, and detailed information related to the vehicle included in the reflected image is displayed on the other side of the windshield 180.

In addition, when the 3D content includes road guidance information, the additional information, the detailed information, etc. according to the destination information, the windshield 180 is reflected on one side based on an actual lane located in front of the vehicle. Display information on the direction of the vehicle according to the corresponding directions information included in the image (for example, information such as straight, left turn, right turn, lane usage information, and left turn/right turn/U-turn information after a few meters), and the vehicle Additional information related to the object included in the reflected image is displayed on the other side of the windshield 180 adjacent to the real object located in front, and the reflected image is displayed on the other side of the windshield 180. Displays detailed information related to the included vehicle.

For example, as shown in FIG. 5, the windshield 180 displays a first virtual image 500 in which the first 3D content output from the 3D display 160 is reflected by the reflector 170. do. In this case, the second additional information 510 on the first vehicle included in the first 3D content is displayed adjacent to the second vehicle 520, and first detailed information 530 on the first vehicle Is displayed at a first specific position set in advance.

As another example, as shown in FIG. 6, the windshield 180 displays a second virtual image 600 in which the second 3D content output from the 3D display 160 is reflected by the reflector 170. Indicate. In this case, the second additional information 610 on the second vehicle included in the second 3D content is displayed adjacent to the second vehicle 620, and second detailed information 630 on the first vehicle Is displayed at a preset second specific location, and information on the vehicle's traveling direction according to the first route guidance information (for example, turn right in front of 650 m) 640 is displayed at a preset third specific location (S350 ).

An embodiment of the present invention provides a more realistic HUD image by providing an image located at a desired distance to a user using a 3D display capable of providing different information to both eyes of the user, as described above. By providing information to the user and displaying the information in a state of less heterogeneity, it is possible to increase the satisfaction level in use.

In addition, as described above, an embodiment of the present invention generates a 3D image using information obtained through a communication unit, a sensor unit, a photographing unit, etc., and reflects the 3D image displayed through the 3D display through a reflector. By displaying a 3D HUD image of a virtual image on the windshield, the entire system is configured in a compact size to reduce cost, and the distance between the display and the eye is closer, providing a wider usage environment even with a smaller sized 3D display. It can express information about and can express information about objects at multiple distances.

The above-described contents may be modified and modified without departing from the essential characteristics of the present invention by those of ordinary skill in the technical field to which the present invention pertains. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

100: 3D head-up display system 110: communication unit
120: sensor unit 130: photographing unit
140: gaze tracking unit 150: storage unit
160: 3D display 170: reflector
180: windshield 190: control unit

Claims (5)

A sensor unit that measures information on an object located in front of the vehicle, which is a moving direction of the vehicle, and collects information related to the vehicle;
A photographing unit that acquires image information including the object;
A communication unit configured to receive information on surrounding conditions according to the location of the vehicle provided from a server and additional information related to an object in the image information;
A gaze tracking unit that detects a gaze direction and a gaze position of a user in the vehicle;
Information on the measured object located in front of the vehicle, information related to the collected vehicle, the acquired image information, surrounding situation information according to the position of the received vehicle, addition related to the object in the received image information A control unit for generating 3D content to be provided to the user based on at least one of information, the detected gaze direction and gaze position of the user, and destination information according to a user input;
A 3D display that outputs 3D content generated by the control unit;
A reflector that reflects the 3D content output by the 3D display; And
A 3D head-up display system comprising a windshield for displaying an image reflected by the reflector. The method of claim 1,
The 3D content,
It includes at least one of route guidance information according to the destination information, additional information on an object located in front of the vehicle, and detailed information related to the vehicle,
The additional information,
It includes at least one of distance, speed, and additional information between the vehicle and the object,
The above detailed information,
3D head-up display system, comprising: surrounding situation information according to the location of the vehicle and information related to the collected vehicle. The method of claim 1,
The windshield,
When the 3D content includes additional information on an object located in front of the vehicle and detailed information related to the vehicle, additional information included in the reflected image on one side of the windshield adjacent to the actual object located in the vehicle front And displaying the detailed information included in the reflected image on the other side of the windshield. Measuring, by the sensor unit, information on an object located in front of the vehicle, which is a traveling direction of the vehicle;
Collecting information related to the vehicle by the sensor unit;
Obtaining, by a photographing unit, image information including the object;
Receiving, by the communication unit, information on surrounding conditions according to the location of the vehicle provided from a server and additional information related to an object in the image information;
Detecting, by a gaze tracking unit, a gaze direction and a gaze position of a user in the vehicle;
By the control unit, information on the measured object located in front of the vehicle, information related to the collected vehicle, the acquired image information, surrounding situation information according to the position of the received vehicle, within the received image information Generating 3D content to be provided to the user based on at least one of additional information related to an object, the detected user's gaze direction and gaze position, and destination information according to a user input;
Outputting 3D content generated by the control unit by a 3D display; And
A control method of a 3D head-up display system comprising the step of displaying, by a windshield, an image of the 3D content output by the 3D display reflected by a reflector. The method of claim 4,
Displaying the reflected image,
When the 3D content includes route guidance information according to the destination information, additional information on an object located in front of the vehicle, and detailed information related to the vehicle, one side of the windshield based on the actual lane located in the front of the vehicle Display information on the driving direction of the vehicle according to the road guidance information included in the reflected image, and additional information included in the reflected image on the other side of the windshield adjacent to the actual object located in front of the vehicle And displaying the detailed information included in the reflected image on another side of the windshield.

Images