KR20190031214A - Method and vehicle for providing information - Google Patents

Abstract

The present invention relates to a method for providing information with respect to predetermined outside vehicle through a transparent display by a vehicle for providing information and, more specifically, provides a method for providing information, which comprises the following steps of: acquiring situation information of an outside vehicle; determining a display mode to display an object corresponding to the outside vehicle based on the acquired situation information; and displaying the object corresponding to the outside vehicle through the transparent display with the determined display mode. The display mode has an augmented reality mode and a map mode.

Description

METHOD AND VEHICLE FOR PROVIDING INFORMATION "

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to an information providing method for displaying an image corresponding to situation information inside or outside a vehicle on a transparent display in a vehicle, and an information providing vehicle therefor.

In the past, automobile development focused on improving the driving speed and fuel efficiency of the vehicle. However, the present automobile development has a great importance in improving the convenience and safety of the driver. In recent years, safety parts such as seat belts, airbags, shock absorbers and the like have been widely used, and safety awareness of automobiles has been increased due to expansion of collision tests. However, this is merely a passive measure for reducing the damage after an accident .

Therefore, it is necessary to provide an information providing system that enables the driver to clearly recognize necessary information during driving or the situation information inside and outside the vehicle, and to prevent an accident from occurring due to driver's carelessness.

The present invention provides an information providing method and an information providing vehicle for displaying useful information to a driver by displaying status information of the vehicle inside or outside the vehicle on a transparent display in the vehicle.

In addition, the present invention provides an information providing method and an information providing vehicle therefor, which allow the driver to quickly grasp the situation information through transparent display by displaying the information located at the invisible distance of the driver through the transparent display .

According to another aspect of the present invention, there is provided an information providing method comprising: obtaining status information of a predetermined external vehicle; Determining a display mode for displaying an object corresponding to an external vehicle based on the obtained situation information; And displaying the object corresponding to the external vehicle through the transparent display in the determined display mode, wherein the display mode may include an augmented reality mode and a map mode.

The context information of the external vehicle according to an exemplary embodiment of the present invention may include at least one of the location information of the external vehicle, the movement route information, the traveling speed information, the stop state information, the utilization lane information, .

An information providing method according to an embodiment of the present invention may include receiving status information of an external vehicle from an external vehicle through a predetermined network.

An information providing method according to an embodiment of the present invention may include a step of determining a display mode based on a distance between an information providing vehicle and an external vehicle.

 The information providing method according to an embodiment of the present invention determines the display mode to be the augmented reality mode when the distance between the information providing vehicle and the external vehicle is less than a predetermined distance and sets the distance between the information providing vehicle and the external vehicle to be predetermined And determining the display mode to map mode when the distance is equal to or greater than the predetermined distance.

Wherein the predetermined distance according to an embodiment of the present invention includes a visible distance at which the driver can see the external vehicle with the naked eye.

According to another aspect of the present invention, there is provided an information providing method comprising: recognizing an external vehicle through a camera based on at least one of vehicle exterior information and a vehicle number when the determined display mode is an augmented reality mode; And displaying the object corresponding to the external vehicle on the transparent display so as to overlap the recognized actual image of the external vehicle.

According to an embodiment of the present invention, there is provided an information providing method comprising: selecting a plurality of candidate vehicles recognized through a camera based on at least one of vehicle exterior information and a vehicle number; And recognizing the external vehicle among the plurality of candidate vehicles based on the sight line information of the driver or the input information of the driver.

The method of providing information according to an embodiment of the present invention may further include displaying at least one of the movement route information, the traveling speed information, the stop state information, the utilization lane information, the direction indication, and the like of the external vehicle .

The method of providing information according to an exemplary embodiment of the present invention may include mapping an object corresponding to an external vehicle on a map and displaying the map on a transparent display when the determined display mode is the map mode.

The information providing method according to an embodiment of the present invention may further include changing the scale of the map based on the distance between the information providing vehicle and the external vehicle.

The information providing method according to an embodiment of the present invention includes a step of changing at least one of the size, display cycle, and color of the object corresponding to the external vehicle based on the distance between the information providing vehicle and the external vehicle can do.

According to an embodiment of the present invention, there is provided an information providing method including: recognizing an eye position of a driver; And adjusting the display position or angle of the object corresponding to the external vehicle based on the driver's eye position.

The predetermined external vehicle according to an embodiment of the present invention may include a vehicle that mutually authenticates the information providing vehicle and the location information exchange.

According to an embodiment of the present invention, there is provided an information providing method comprising: receiving identification information of an external vehicle from a driver; Requesting an external vehicle to exchange location information based on the identification information of the external vehicle; And receiving an acceptance message for requesting location information exchange from an external vehicle.

The method of providing information according to an embodiment of the present invention may further include acquiring illuminance information on the outside of the information providing vehicle or illuminance information on the driver's gaze direction.

The method of providing information according to an exemplary embodiment of the present invention may further include adjusting transparency of the transparent display based on external illuminance information of the obtained information providing vehicle or illuminance information in accordance with the driver's gaze direction

The method of providing information according to an embodiment of the present invention includes the steps of changing the color of an object corresponding to an external vehicle and displaying it on the basis of external illuminance information of the obtained information providing vehicle or illuminance information according to the driver's gaze direction As shown in FIG.

The method of providing information according to an embodiment of the present invention may further include receiving and displaying information provided by navigation of an external vehicle from an external vehicle.

According to an embodiment of the present invention, there is provided an information providing method comprising the steps of: searching for a gas station that can be reached by an information providing vehicle in a residual fuel when residual fuel is less than a predetermined amount; And displaying information on the retrieved gas station through a transparent display.

The information providing method according to an embodiment of the present invention may include displaying the object corresponding to the retrieved gas station through transparent display so that the object corresponding to the retrieved gas station is superimposed on the actual image of the gas station recognized when the gas station retrieved through the camera is recognized have.

According to an embodiment of the present invention, there is provided an information providing method comprising: obtaining defect occurrence information of an information providing vehicle; Searching for a repair shop capable of repairing the defect occurrence part based on the defect occurrence information; And displaying information on the searched workshop through a transparent display.

An information providing method according to an embodiment of the present invention includes displaying an image corresponding to at least one of an accident occurrence point information, an accident occurrence time information, an accident occurrence lane information, and a bypass road information through a transparent display .

An information providing vehicle according to an embodiment of the present invention includes a situation recognition unit for acquiring situation information of an external vehicle; A control unit for determining a display mode for displaying an object corresponding to an external vehicle based on the obtained situation information; And a transparent display that displays an object corresponding to the external vehicle in the determined display mode, wherein the display mode may include an augmented reality mode and a map mode.

The situation recognition unit of the information providing vehicle according to an embodiment of the present invention can receive situation information from an external vehicle through a predetermined network.

The control unit of the information providing vehicle according to the embodiment of the present invention can determine the display mode based on the distance between the information providing vehicle and the external vehicle.

The control unit of the information providing vehicle according to an embodiment of the present invention determines the display mode to be the augmented reality mode when the distance between the information providing vehicle and the external vehicle is less than a predetermined distance and determines that the distance between the information providing vehicle and the external vehicle is If the distance is more than the predetermined distance, the display mode can be determined as the map mode.

The predetermined distance according to an embodiment of the present invention includes a visible distance at which the driver can see the external vehicle with the naked eye, and the control unit of the information providing vehicle according to an embodiment of the present invention includes weather information, illuminance information, The visual distance can be adjusted based on at least one of the humidity information.

The situation recognition unit of the information providing vehicle according to an embodiment of the present invention recognizes the external vehicle through the camera based on at least one of the vehicle exterior information and the vehicle number when the determined display mode is the augmented reality mode, The transparent display of the information providing vehicle according to an embodiment of the present invention may display the object corresponding to the external vehicle so as to overlap the actual image of the recognized external vehicle.

The situation recognition unit of the information providing vehicle according to an embodiment of the present invention selects a plurality of candidate vehicles recognized by the camera based on at least one of the vehicle exterior information and the vehicle number and displays the sight information of the driver or the input Based on the information, an external vehicle among a plurality of candidate vehicles can be recognized.

The transparent display of the information providing vehicle according to an embodiment of the present invention may further display at least one of movement route information, driving speed information, stop state information, utilization lane information, and turn signal light operation state information of the external vehicle .

The transparent display of the information providing vehicle according to an embodiment of the present invention may display an object corresponding to the external vehicle on a map when the determined display mode is the map mode.

The controller of the information providing vehicle according to the embodiment of the present invention can change the scale of the map based on the distance between the information providing vehicle and the external vehicle.

The transparent display of the information providing vehicle according to an embodiment of the present invention may display at least one of the size, display cycle, and color of the object corresponding to the external vehicle by changing the distance between the information providing vehicle and the external vehicle .

The situation recognition unit of the information providing vehicle according to an embodiment of the present invention recognizes the eyes position of the driver and the transparent display of the information providing vehicle according to the embodiment of the present invention is characterized in that based on the eyes position of the driver, Can be displayed by adjusting the display position or angle of the object.

A situation recognition unit of an information providing vehicle according to an embodiment of the present invention includes a user input unit for receiving identification information of an external vehicle from a driver; And a communication unit for requesting location information to be exchanged with the external vehicle based on the identification information of the external vehicle and receiving an acceptance message for requesting the location information exchange from the external vehicle.

The situation recognition unit of the information providing vehicle according to an embodiment of the present invention can acquire illuminance information outside the information providing vehicle or illuminance information according to the driver's gaze direction.

The controller of the information providing vehicle according to the embodiment of the present invention can adjust the transparency of the transparent display based on the external illuminance information of the obtained information providing vehicle or the illuminance information according to the driver's gaze direction.

The transparent display of the information providing vehicle according to an embodiment of the present invention changes the color of the object corresponding to the external vehicle on the basis of the external illuminance information of the obtained information providing vehicle or the illuminance information according to the driver's gaze direction Can be displayed.

The transparent display of the information providing vehicle according to an embodiment of the present invention can receive and display information provided by the navigation of the external vehicle from the external vehicle.

The control unit of the information providing vehicle according to the embodiment of the present invention searches for a gas station to which the information providing vehicle can reach within the residual fuel when the residual fuel is equal to or less than a predetermined amount, The transparent display of the vehicle can display information about the searched gas station.

The transparent display of the information providing vehicle according to an embodiment of the present invention may display the object corresponding to the searched gas station to be overlapped with the actual image of the gas station recognized when the searched gas station is recognized through the camera.

The situation recognition unit of the information providing vehicle according to the embodiment of the present invention acquires the defect occurrence information of the information providing vehicle, and the control unit of the information providing vehicle according to the embodiment of the present invention, And a transparent display of the information providing vehicle according to an embodiment of the present invention can display information on the searched workshop.

The transparent display of the information providing vehicle according to an embodiment of the present invention can display an image corresponding to at least one of accident occurrence point information, accident occurrence time information, accident occurrence lane information, and bypass road information.

1 is a diagram showing an information providing system according to an embodiment of the present invention.
2 is a view for explaining a method in which an information providing vehicle according to an embodiment of the present invention communicates with an external vehicle.
3 is a block diagram illustrating an information providing vehicle according to an embodiment of the present invention.
4 is a flowchart illustrating a method of providing information through a transparent display according to an embodiment of the present invention.
5 is a flowchart illustrating a method of providing information according to a display mode according to an embodiment of the present invention.
6 is a flowchart illustrating a method of providing information on an external vehicle that mutually authenticates location information exchange according to an embodiment of the present invention.
7 is a diagram illustrating an object corresponding to an external vehicle in the augmented reality mode according to an embodiment of the present invention.
FIG. 8 is a view for explaining a discrimination display cycle related to an embodiment of the present invention.
9 and 10 are views showing identification marks of image types for an external vehicle according to an embodiment of the present invention.
11 is a diagram illustrating an object corresponding to an external vehicle in the map mode according to an embodiment of the present invention.
12 is a view showing a screen for providing information on an external vehicle related to an embodiment of the present invention.
13 is a flowchart illustrating a method of providing destination guidance information, accident information of other vehicles, and traffic situation information according to an embodiment of the present invention.
14 is a view showing a screen displaying an image corresponding to accident information of another vehicle related to an embodiment of the present invention.
FIG. 15 is a diagram showing a screen for mapping incident information of another vehicle, which is related to an embodiment of the present invention, on a map.
16 is a flowchart illustrating an information providing method according to an embodiment of the present invention.
17 is a flowchart illustrating a method of providing invisible information of a driver through a transparent display according to an embodiment of the present invention.
FIGS. 18 and 19 are views showing a screen for displaying road information related to an embodiment of the present invention on an obstacle.
20 is a flowchart illustrating a method of providing information on a gas station according to an embodiment of the present invention.
FIG. 21 is a view showing a screen for displaying information on a gas station existing in a non-visible zone of a driver according to an embodiment of the present invention.
22 is a view showing information on essential gas stations related to an embodiment of the present invention.
23 is a flowchart illustrating a method of providing images corresponding to defect occurrence information in a vehicle related to an embodiment of the present invention.
FIG. 24 is a view showing a screen for displaying information about a defect occurrence portion in a vehicle related to an embodiment of the present invention. FIG.
25 is a view showing a screen displaying information on a workshop associated with an embodiment of the present invention.

The terms used in this specification will be briefly described and the present invention will be described in detail.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements as well, without departing from the spirit or scope of the present invention. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

1 is a diagram showing an information providing system according to an embodiment of the present invention.

1, an information providing system according to an embodiment of the present invention includes an information providing vehicle 100, another vehicle 200, a mobile terminal 300, a base station 400, a server 500, .

The information providing vehicle 100 according to an embodiment of the present invention means a vehicle including a transparent display capable of providing information. A transparent display is an information display device in which the back side of a screen displaying information is displayed. The transparent display is composed of a transparent element, and transparency can be controlled by controlling the light transmittance of the transparent element or adjusting the RGB value of each pixel.

The types of the information providing vehicle 100 according to an embodiment of the present invention may vary. For example, the information providing vehicle 100 may include a small, medium, large, two-wheel, and special vehicle, and may include a passenger, a passenger, a truck, a bus, and a freight vehicle.

Meanwhile, the information providing vehicle 100 according to the embodiment of the present invention can acquire the situation information inside the vehicle. (E.g., vehicle speed, traveling direction of a vehicle, driving lane, car interior temperature, humidity, tire condition, engine condition, and the like) periodically sensed in the vehicle interior information, information (E.g., location information, drowsiness driving state information, drinking state information, mobile terminal use state information, etc.), and an unexpected situation occurring in the vehicle (e.g., in-vehicle defect, fuel shortage, accident occurrence, etc.).

Also, the information providing vehicle 100 according to an embodiment of the present invention may acquire situation information outside the vehicle. For example, the information providing vehicle 100 can communicate with the other vehicle 200, the mobile terminal 300, the base station 400, the server 500, and the like via wired or wireless lines to obtain situation information on the outside of the vehicle.

The status information on the outside of the vehicle is information on a situation occurring outside the vehicle and includes information received from an external device (e.g., position information of the other vehicle 200, speed of the other vehicle 200, Background information (building information, other vehicle information, weather information, illuminance information, etc.) within a predetermined distance, accident information of the other vehicle 200, traffic situation information And so on.

The other vehicle 200 according to an embodiment of the present invention can provide information to the information providing vehicle 100 through a Vehicle to Vehicle communication network (e.g., IEEE 802.11p WAVE). For example, the other vehicle 200 can transmit the traveling speed information, the stop state information, the current position information, the lane information, the accident information, and the like to the information providing vehicle 100. At this time, the other vehicle 200 may transmit information according to a request of the information providing vehicle 100 or may transmit information to the information providing vehicle 100 at predetermined intervals.

The mobile terminal 300 is capable of wireless communication with the information providing vehicle 100. The mobile terminal 300 according to an embodiment of the present invention may exist in the information providing vehicle 100 and may provide information to the information providing vehicle 100. [

Meanwhile, the information providing vehicle 100 according to an embodiment of the present invention may communicate with another vehicle, a mobile terminal of another vehicle 200, a base station 400, a server 500, and the like through the mobile terminal 300 have. The mobile terminal 300 according to an embodiment of the present invention may be implemented in various forms. For example, the mobile terminal 300 described in this specification includes a mobile phone, a smart phone, a laptop computer, a tablet PC, an electronic book terminal, a digital broadcast terminal, a PDA (Personal Digital Assistants) (Portable Multimedia Player), a navigation device, and the like, but the present invention is not limited thereto.

The base station 400 may include a roadside unit (RSU) installed on the road side. The base station 400 can receive the service request from the information providing vehicle 100 that is within the communication range of the base station 400 and provide the service corresponding to the request to the information providing vehicle 100. [

For example, the base station 400 may provide location information of the other vehicle 200, accident information of the other vehicle 200, real-time traffic information, digital map, movie, music, etc. to the information providing vehicle 100 . Also, the information providing vehicle 100 can also broadcast its own accident information to the outside through the base station 400.

The server 500 may search the web for information related to the situation information collected by the information providing vehicle 100 and provide the search result to the information providing vehicle 100. [ For example, the server 500 may search for articles related to accident information of other vehicles in real time and provide them to the information providing vehicle 100, or may search map information related to the destination and provide the information to the information providing vehicle 100 have. In addition, the server 500 according to the embodiment of the present invention may receive and store / manage the situation information collected by the information providing vehicle 100 from the information providing vehicle 100. [

2 is a view for explaining a method in which an information providing vehicle according to an embodiment of the present invention communicates with an external vehicle. As shown in Fig. 2 (a), the information providing vehicle 100 is capable of V2V communication with another vehicle 200 and the vehicle. Inter-vehicle communication (e.g., IEEE 802.11p WAVE) provides high mobility and is suitable for outdoor environments where interference such as Doppler shift occurs well. Frequency selective fading frequently occurs because inter-vehicle communication is an inter-vehicle communication that moves at high speed in an outdoor environment. Further, the information providing vehicle 100 communicates with another vehicle 200 according to the ad-hook method It is possible. An ad hoc method refers to a method of exchanging data in peer-to-peer (P2P) form between terminals without an access point (AP) (e.g., a wireless router). As shown in FIG. 2 (b), the information providing vehicle 100 may communicate with another vehicle 200 through a cellular network. For example, when the information providing vehicle 100 transmits data to the server 500 via the mobile communication network, the server 500 transmits the data received from the information providing vehicle 100 to the other vehicle 200 You can do it. Conversely, the server 500 may receive the data from the other vehicle 200 and transmit the data to the information providing vehicle 100.

2C, the mobile terminal 300-1 in the information providing vehicle 100 and the mobile terminal 300-2 in the other vehicle 200 can communicate with each other through a mobile communication network or a wireless LAN (Wi-Fi) Can communicate with each other. In this case, the information providing vehicle 100 can perform close-range communication with the mobile terminal 300-1 in the information providing vehicle 100. [ Also, the other vehicle 200 can also perform close-range communication with the mobile terminal 330-2 in the other vehicle 200. [

Examples of the short-range communication are Wi-Fi, Bluetooth, Ultra Wideband, ZigBee, NFC, WiFi Direct, IrDA, infrared Data Association).

Meanwhile, the information providing vehicle 100 may form a group through a plurality of other vehicles and an ad hook. For example, if four people move the same destination with their own car, the car of A, the car of B, the car of C, and the car of D, As shown in FIG.

The grouped information providing vehicle 100 and a plurality of other vehicles can share multimedia contents or share information provided in navigation. The information provided in the navigation may include the shortest route information, the current location information, and the map information.

Further, the grouped information providing vehicle 100 and the plurality of other vehicles can use common authentication information (e.g., common PIN) for security.

Hereinafter, the configuration of the information providing vehicle 100 will be described in more detail with reference to FIG.

3 is a block diagram illustrating an information providing vehicle according to an embodiment of the present invention.

3A, an information providing vehicle 100 according to an embodiment of the present invention may include a situation recognition unit 110, an output unit 120, and a control unit 130. [ However, not all illustrated components are required. The information providing vehicle 100 may be implemented by a larger number of components than the illustrated components, and the information providing vehicle 100 may be implemented by fewer components.

Hereinafter, the components will be described in order.

The status recognition unit 110 may include various modules for acquiring status information of a vehicle interior or a vehicle exterior. For example, the situation recognition unit 110 may include a sensing unit 111, a camera 112, a microphone 113, a communication unit 1114, a user input unit 115, and the like.

The sensing unit 111 may include various sensors for acquiring the internal situation information of the vehicle. For example, it may include an acceleration sensor, a tilt sensor, a gyro sensor, a 3-axis magnetic sensor, a voice recognition sensor, an illumination sensor, a temperature sensor, and the like.

The sensing section 111 senses the state of the vehicle 100 in accordance with the fuel state information in the vehicle 100, engine state information (information on the engine state, the engine oil state, the timing belt state), tire information (tire wear, Direction information, direction indication, and the like.

In this case, the sensing unit 111 may acquire defect occurrence information in the vehicle. For example, the sensing unit 110 can acquire defect information such as tire wear exceeding a threshold value, air pressure of the tire becomes lower than a threshold value, engine oil becomes lower than a threshold value, or brake is not operated.

Also, the sensing unit 111 can determine whether it is daytime or nighttime through the illuminance sensor, and the sensing unit 111 can acquire illuminance information according to the brightness level of the daytime or the driver's gaze direction. Roughness refers to the density of a luminous flux to which a surface is subjected, and Lux (lx) is used in a normal unit.

Meanwhile, the sensing unit 111 may recognize the preceding vehicle through the radar sensor.

The camera 112 is for inputting video signals and processes image frames such as still images or moving images obtained by the image sensor. The image frame processed by the camera 112 may be stored in a memory or transmitted to the outside through the communication unit 114. [ The camera 112 may be equipped with two or more cameras according to an embodiment. For example, the camera 112 may be implemented in various forms such as a front camera, a rear camera, a left camera, a right camera, an internal camera, and a black box camera. In addition, the camera 112 according to an embodiment of the present invention may include an infrared camera.

The camera 112 can acquire background information about objects, terrain, and roads existing outside the vehicle. That is, the camera 112 is capable of recognizing buildings, mountains, other vehicles, pedestrians, lanes, headlights, trees, and the like located within a predetermined distance from the vehicle 100. At this time, based on GPS (Global Position System) information or vision technology, the situation recognition unit 110 may recognize the type or type of an obstacle that obstructs the driver to observe an object or a target path through the transparent display 121 May be recognized in the background information.

In addition, the camera 112 can recognize the vehicle number or the vehicle type of the other vehicle 200. [ Meanwhile, the camera 112 may recognize the position of the driver's eyes (line of sight). At this time, the situation recognition unit 110 may further detect and track the eyes of the driver using the infrared LED. Placing the infrared LED close to the axis of the camera (112), the pupil is usually brighter than usual because it reflects light from the blood-rich retina. This phenomenon, called the "bright pupil effect", can be very useful for detecting and tracking pupils.

The microphone 113 receives an external acoustic signal and processes it as electrical voice data. The microphone 113 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The communication unit 114 communicates between the information providing vehicle 100 and the other vehicle 200, communication between the information providing vehicle 100 and the mobile terminal 300, communication between the information providing vehicle 100 and the base station 400, And may include one or more components for communicating between the providing vehicle 100 and the server 500. [ For example, the communication unit 114 may include a mobile communication module, a wireless Internet module, a local area communication module, a location information module, and the like.

The mobile communication module transmits and receives radio signals to and from at least one of a base station, an external terminal, a server, and other vehicles on a mobile communication network. The wireless Internet module refers to a module for wireless Internet access, and the wireless Internet module can be built in or externally.

The short-range communication module is a module for short-range communication. Bluetooth, RFID, IrDA, UWB, ZigBee, Near Field Communication (NFC), and Wi-Fi Direct (WFD) Can be used.

The location information module is a module for confirming or obtaining the location of the mobile terminal. One example is the GPS (Global Position System) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information indicated by latitude and longitude. The GPS module can obtain latitude, longitude and altitude as well as three-dimensional velocity information and accurate time from the position information received from the satellite.

The communication unit 114 can receive situation information on the outside of the vehicle from at least one of the other vehicle 200, the mobile terminal 300, the base station 400, and the server 500. [ For example, the communication unit 114 can acquire information on the external vehicle from the base station 400 based on the identification information of the external vehicle that has mutually authenticated the location information exchange with the vehicle 100. [ The information on the external vehicle according to an embodiment of the present invention may include at least one of the route information of the external vehicle, the traveling speed information of the external vehicle, the stop state information of the external vehicle, the lane information of the external vehicle, And may include at least one.

The communication unit 114 receives information such as destination guidance information, accident information of the other vehicle 200, traffic situation information (for example, clogging information, road car, road width, road type, It can also be obtained.

The communication unit 114 can request location information exchange to a predetermined external vehicle based on the identification information of the external vehicle and receive an acceptance message for requesting location information exchange from the predetermined external vehicle.

The user input unit 115 receives data inputted by the driver for controlling the operation of the information providing vehicle 100. [ In other words, the user input unit 115 may be configured to input information (e.g., destination input information, in-vehicle temperature setting information, radio frequency setting information, and the like) set by a driver, device operation (e.g., acceleration pedal operation, (gear) manipulation) information. The user input unit 115 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display 131 described later, it can be called a touch screen. The user input unit 115 may receive identification information of an external vehicle for requesting location information exchange from a driver.

Also, the user input unit 115 may include a voice recognition module for receiving a voice command of the driver. The voice recognition module recognizes the voice of the user using the voice recognition engine and can transmit the recognized voice to the controller 130. [

The user input unit 115 may exist in the form of a remote control. For example, a remote control for operating the transparent display screen may be attached to the steering wheel. According to an embodiment of the present invention, a remote control may be implemented in various forms. An example of a remote control device is a remote controller for a driver, a smart phone, a mobile phone, and a tablet PC.

The output unit 120 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 120 may include a transparent display 121, an audio output module 122, an alarm unit 123, and the like.

The transparent display 121 displays and outputs information processed in the information providing vehicle 100. [ For example, the transparent display 121 may display a video (UI (User Interface) or GUI (Graphic User Interface)) corresponding to the situation information acquired by the situation recognition unit 110. At this time, the transparent display 121 can display an image corresponding to the situation information as an augmented reality.

Augmented reality (augmented reality) is a technology that superimposes a virtual object on the real world seen by the user. Augmented reality is also referred to as mixed reality (MR) because a virtual world including additional information in real time is combined into a single image.

The transparent display 121 may display an image corresponding to the situation information by mapping it on a map.

Meanwhile, as described above, when the transparent display 121 and the touch pad have a mutual layer structure to constitute a touch screen, the transparent display 121 can be used as an input device in addition to an output device. The transparent display 121 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). There may be two or more transparent displays 121 depending on the implementation of the information providing vehicle 100. For example, a transparent display 121 may be present in the windshield, side window, rear window, etc. of the vehicle 100. [

The sound output module 122 outputs audio data received from the communication unit 114 or stored in a memory (not shown). Also, the sound output module 122 outputs sound signals related to the functions (destination voice guidance, traffic situation voice guidance, etc.) performed in the information providing vehicle 100. The sound output module 122 may include a speaker, a buzzer, and the like.

The alarm unit 123 outputs a signal for notifying the occurrence of an event of the information providing vehicle 100. Examples of the events generated in the information providing vehicle 100 include occurrence of internal defects in the vehicle, reception of accident information of other vehicles, fuel shortages, and the like. The alarm unit 123 may output a signal for informing occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode.

The control unit 130 typically controls the overall operation of the information providing vehicle 100. That is, the control unit 130 can control the situation recognition unit 110, the image processing unit 120, and the output unit 120 as a whole. For example, the control unit 130 may determine a display mode for displaying an object corresponding to an external vehicle, based on context information of the external vehicle. At this time, the display mode may include an augmented reality mode and a map mode.

The control unit 130 can generate an image corresponding to the context information based on the context information acquired by the context recognition unit 110. [ The image corresponding to the situation information may include a still image as well as a moving image. The control unit 130 can generate an image corresponding to the situation information inside the vehicle or an image corresponding to the situation information outside the vehicle.

According to an embodiment of the present invention, the controller 120 can generate a new image in real time based on the situation information. In addition, according to another embodiment of the present invention, the control unit 130 may extract the video image generated in the memory or edit the extracted video image according to the context information, based on the context information. Meanwhile, the image processing unit 120 according to an embodiment of the present invention may generate an image corresponding to the situation information by mapping it on a map.

The controller 130 can adjust the transparency of the transparent display 121 based on illuminance information outside the vehicle. For example, the control unit 130 may lower the transparency of the transparent display 121 when the illuminance is high (bright day) and increase the transparency of the transparent display 121 when the illuminance is low (dark day). In addition, the controller 130 may adjust transparency according to the position of the transparent display 121. On the other hand, if transparency in the transparent display 121 is not uniform, the controller 130 may give a gradation for a natural representation.

Since the transparent display 121 is constituted by a transparent element, the controller 130 controls the transparency of the transparent display 121 by adjusting the light transmittance of the transparent element, or adjusts the RGB value of each pixel by the transparent display 121 The transparency can be adjusted.

According to an embodiment of the present invention, the controller 130 may adjust the transparency of the transparent display 121 based on the illuminance information according to the driver's gaze direction. For example, when the driver is driving the vehicle facing the sun, the controller 130 lowers the transparency of the transparent display 121, and when the driver is driving the sun behind him, the controller 130 displays the transparent display 121, Can be increased.

On the other hand, in the case of a transparent display 121 in which an organic light-emitting diode and a liquid crystal display are combined, the control unit 130 controls the transparent display 121 to be transparent And then supplies power to the transparent display 121, the liquid crystal display may block the light, thereby setting the transparent display 202 to an opaque state.

According to an embodiment of the present invention, the control unit 130 may set an opaque color in a part of the transparent display 121 or in the entire area based on the background information of the outside of the vehicle. For example, the control unit 130 can automatically adjust the color of all or a part of the transparent display 121 in a color that can raise the awareness of the surrounding environment according to the color or the terrain of buildings around the information providing vehicle 100 . Meanwhile, according to an embodiment of the present invention, the control unit 130 may set an opaque color on the transparent display 121 based on a user's input.

According to an embodiment of the present invention, the control unit 130 may broadcast accident information of the information providing vehicle 100 through the communication unit 114 to the outside.

On the other hand, the information providing vehicle 100 may further include a memory (not shown). A memory (not shown) may store a program for processing and controlling the control unit 130, and may store input / output data (e.g., vehicle internal situation information, external vehicle situation information, Etc.) for the purpose of temporary storage.

The memory (not shown) may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) A random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) , An optical disc, and the like. Also, the information providing vehicle 100 may operate a web storage for storing a memory (not shown) on the internet.

Hereinafter, the transparent display 121 according to an embodiment of the present invention will be described in more detail with reference to FIG. 3B.

The transparent display 121 may be implemented in various forms such as a transparent LCD (Liquid Crystal Display) type, a transparent TFEL (Thin-Film Electroluminescent Panel) type, a transparent OLED type, a projection type, Various embodiments of the structure of the transparent display 121 will be described below.

The transparent LCD type means a transparent display implemented by using a pair of polarizing plates, an optical film, a transparent thin film transistor, a transparent electrode, etc., in which a backlight unit is removed from a currently used LCD device. The transparent LCD device has a disadvantage of low transparency due to the use of a polarizing plate or an optical film and low light efficiency by using ambient light instead of a backlight unit, but it has an advantage that a large area transparent display can be realized.

The transparent TFEL type means an apparatus using an AC type inorganic thin film EL display (AC-TFEL) comprising a transparent electrode, an inorganic fluorescent substance and an insulating film. AC-TFEL is a display that accelerates electrons passing through an inorganic phosphor to excite phosphors to emit light. When the transparent display 121 is implemented in the form of a transparent TFEL, the controller 130 can adjust the information so that electrons are projected to an appropriate position to determine the information display position. Since the inorganic phosphor and the insulating film have a transparent characteristic, a very transparent display can be realized.

In addition, the transparent OLED type means a transparent display using an OLED capable of self-emission. Since the organic light emitting layer is transparent, if both electrodes are used as the transparent electrode, a transparent display device can be realized. When OLEDs inject electrons and holes from both sides of the organic light emitting layer, they are combined in the organic light emitting layer to emit light. Transparent OLED devices use this principle to inject electrons and holes at desired locations to display information.

3B is a view showing a detailed configuration example of a transparent display implemented as a transparent OLED type. For convenience of explanation, reference numeral 131 is assigned to a transparent display implemented in a transparent OLED (Organic Light-Emitting Diodes) type.

3B, the transparent display 121 includes a transparent substrate 121-1, a transparent transistor layer 121-2, a first transparent electrode 121-3, a transparent organic light-emitting layer, A first transparent electrode 121-4, a second transparent electrode 121-5, and a connection electrode 121-6.

The transparent substrate 121-1 may be made of a polymer material such as plastic having transparency or glass. The material of the transparent substrate 121-1 may be determined according to the use environment to which the transparent display 121 is applied. For example, polymeric materials have the advantage of being lightweight and flexible and can be used in portable display devices, and glass can be used in show windows or general windows in stores.

The transparent transistor layer 121-2 refers to a layer including a transistor fabricated by replacing opaque silicon of a conventional thin film transistor with a transparent material such as transparent zinc oxide, titanium oxide, or the like. A source electrode, a gate electrode, a drain electrode, and various dielectric films 121-7 and 121-8 are provided in the transparent transistor layer 121-2. A connection electrode (not shown) for electrically connecting the drain and the first transparent electrode 121-3 121-6 may also be provided. In FIG. 3B, only one transparent transistor made of a source, a gate, and a drain is shown in the transparent transistor layer 121-2, but actually, a plurality of transparent transistors are evenly distributed over the entire area of the display surface. The control unit 130 may apply a control signal to the gates of the respective transistors in the transparent transistor layer 121-2 to drive the corresponding transparent transistor to display information.

The first transparent electrode 121-3 and the second transparent electrode 121-5 are arranged in opposite directions to each other with respect to the transparent organic light emitting layer 121-4. The first transparent electrode 121-3, the transparent organic light emitting layer 121-4, and the second transparent electrode 121-5 form organic light-emitting diodes.

Transparent organic light emitting diodes are classified into Passive Matrix OLED and Active Matrix OLED depending on the driving method. The PMOLED is a structure in which pixels intersect each other at the intersection of the first and second transparent electrodes 121-3 and 121-5. On the other hand, AMOLED is a structure having a thin film transistor (TFT) driving each pixel. And FIG. 3B shows the active type.

The first transparent electrode 121-3 and the second transparent electrode 121-5 each include a plurality of line electrodes, and the alignment directions of the line electrodes are perpendicular to each other. For example, if the line electrodes of the first transparent electrode 121-3 are arranged in the horizontal direction, the line electrodes of the second transparent electrode 121-5 are arranged in the vertical direction. Accordingly, a plurality of intersecting regions are formed between the first transparent electrode 121-3 and the second transparent electrode 121-5. A transparent transistor is connected to each crossing region as shown in FIG. 3B.

The control unit 130 uses a transparent transistor to form a potential difference for each crossing region. Electrons and holes from each electrode flow into the transparent organic light-emitting layer 121-4 and are emitted while being coupled in the intersection region where the potential difference is formed. On the other hand, the intersection area where the potential difference is not formed does not emit light, so that the background of the background is transparently displayed.

ITO (indium tin oxide) may be used for the first and second transparent electrodes 121-3 and 121-5. Alternatively, a new material such as graphene may be used. Graphene refers to a substance with a transparent nature that forms a honeycomb-like planar structure of carbon atoms. In addition, the transparent organic light emitting layer 121-4 may be formed of various materials.

As described above, the transparent display 121 may be implemented in a projection type as well as a transparent LCD (Liquid Crystal Display) type, a transparent TFEL (Thin-Film Electroluminescent Panel) type, and a transparent OLED type. A projection type means a method of displaying an image on a transparent screen such as a head up display (HUD).

Hereinafter, a method by which the information providing vehicle 100 provides the status information of the predetermined external vehicle to the driver or the passenger through the transparent display 121 will be described in detail with reference to FIGS. 4 and 5. FIG.

4 is a flowchart illustrating a method of providing information through a transparent display according to an embodiment of the present invention.

In step 410, the information providing vehicle 100 can acquire the situation information of a predetermined external vehicle. The situation information of the external vehicle may include at least one of the position information of the external vehicle, the movement route information, the traveling speed information, the stop state information, the utilization lane information, and the operation state information such as the direction indication. The predetermined external vehicle may be a vehicle that has mutually authenticated location information exchange with the information providing vehicle 100. [

The information providing vehicle 100 can receive situation information from an external vehicle through a predetermined network. For example, the information providing vehicle 100 can receive the status information of the external vehicle from the external vehicle through the inter-vehicle communication, the ad hook, or the mobile communication network. Also, the information providing vehicle 100 may receive the situation information of the external vehicle from the base station located on the roadside.

In step 420, the information providing vehicle 100 may determine a display mode for displaying an object corresponding to the external vehicle, based on the obtained external vehicle status information. The display mode may include an augmented reality mode and a map mode. The augmented reality mode means that a virtual image is combined with a real world viewed by a user and displayed as a single image. The map mode means that the status information of the external vehicle is mapped and displayed on a map.

In step 430, the information providing vehicle 100 can display the object corresponding to the external vehicle through the transparent display 121 in the determined display mode.

The object corresponding to the external vehicle includes an identification mark for distinguishing the actual external vehicle observed through the transparent display 121 from the other vehicle, an image of the external vehicle for displaying the position of the external vehicle on the map, an icon, .

That is, when the external vehicle exists within a distance that the user can actually observe, the information providing vehicle 100 can display the identification mark for the external vehicle on the transparent display, The position of the external vehicle can be mapped on the map and displayed on the transparent display 121. [ This will be described in more detail with reference to FIG.

5 is a flowchart illustrating a method of providing information according to a display mode according to an embodiment of the present invention.

In step 510, the information providing vehicle 100 can acquire the situation information of a predetermined external vehicle. The information providing vehicle 100 can determine the distance to a predetermined external vehicle based on the obtained positional information of the external vehicle among the context information of the predetermined external vehicle.

In step 520, the information providing vehicle 100 can determine the display mode based on the distance between the information providing vehicle 100 and the external vehicle. That is, the information providing vehicle 100 can determine the display mode depending on whether the distance to the external vehicle is less than a predetermined distance.

According to an embodiment of the present invention, the predetermined distance may include a visible distance at which the driver can see the external vehicle with the naked eye. The information providing vehicle 100 may preset the visible distance at which the drivers can see the external vehicle as a reference for determining the display mode. Meanwhile, the information providing vehicle 100 can change the visible distance according to at least one of weather information, illuminance information, and humidity information. For example, in the case of rain or low illuminance, the information providing vehicle 100 can set the visual distance to be shorter than the average visual distance.

According to an embodiment of the present invention, the information providing vehicle 100 may determine whether the external vehicle is located within an average visible distance using GPS information of the external vehicle, pre-stored map information, compass information, have.

In step 530, when the distance between the information providing vehicle 100 and the external vehicle is less than the predetermined distance, the information providing vehicle 100 can determine the display mode as the augmented reality mode. For example, when the user has an external vehicle within the visible range where the external vehicle can be visually observed, the information providing vehicle 100 can determine the display mode as the augmented reality mode.

In step 540, the information providing vehicle 100 can recognize the external vehicle through the camera. At this time, the information providing vehicle 100 can recognize the external vehicle through the camera based on at least one of the vehicle exterior information and the vehicle number. For example, the information providing vehicle 100 recognizes the number of the license plate of the external vehicle photographed by the camera through the image processing technique and compares the number with the number of the predetermined external vehicle previously stored in the memory, have. In addition, the information providing vehicle 100 may previously define a template on the basis of external information (e.g., vehicle type, car outline, etc.) of a predetermined external vehicle, The vehicle may be recognized.

On the other hand, according to the embodiment of the present invention, the information providing vehicle 100 can select a plurality of candidate vehicles recognized through the camera based on at least one of the vehicle appearance information and the vehicle number. The information providing vehicle 100 can recognize a predetermined external vehicle among a plurality of candidate vehicles based on the sight line information of the driver or the input information of the driver.

For example, when the information providing vehicle 100 selects a plurality of candidate vehicles estimated as vehicles through vision technology, the information providing vehicle 100 analyzes the driver's line of sight through an internal sensor (e.g., an internal camera) , The vehicle at the position where the driver's line of sight stays for a predetermined time or more can be recognized as a predetermined external vehicle.

Further, the information providing vehicle 100 may display a plurality of candidate vehicles on the transparent display 121, and may receive a selection from the user. When the transparent display 121 includes a touch interface, the user can select an external vehicle to track by touching one of a plurality of candidate vehicles displayed on the transparent display 121. [ Further, the user may select a predetermined external vehicle among a plurality of candidate vehicles through voice input.

In step 550, the information providing vehicle 100 may display the object corresponding to the external vehicle in the transparent display 121 so that the object corresponding to the external vehicle overlaps with the actual image of the external vehicle. The information providing vehicle 100 displays at least one of the traveling route information, the traveling speed information, the stopping state information, the usage lane information, and the direction indication information of the external vehicle on the transparent display 121 so as to overlap the actual image of the external vehicle. As shown in FIG. With reference to Figs. 6 to 10, a more detailed description will be given later.

In step 560, the information providing vehicle 100 can determine the display mode as the map mode when the distance between the external vehicle is equal to or greater than the predetermined distance. For example, when an external vehicle exists at an invisible distance at which the user can not visually see the external vehicle, the information providing vehicle 100 can determine the display mode as the map mode.

In step 570, the information providing vehicle 100 may map the object corresponding to the external vehicle on the map and display it on the transparent display 121. [ On the other hand, the information providing vehicle 100 may change the scale of the map based on the distance between the information providing vehicle 100 and the external vehicle. For example, the information providing vehicle 100 maps and displays an object corresponding to an external vehicle on a large-scale map (detailed map) as the distance from the external vehicle becomes closer, An object corresponding to an external vehicle can be mapped and displayed on a map (a map shown briefly). 11, which will be described later in more detail.

According to an embodiment of the present invention, the information providing vehicle 100 may display the object on the transparent display 121 by adjusting the display position or angle of the object corresponding to the external vehicle based on the eye position of the driver.

The information providing vehicle 100 may change the color of the object corresponding to the external vehicle based on the external illuminance information or the illuminance information according to the direction of the driver's gaze to display the object on the transparent display 121. [ For example, when the illuminance is high, the information providing vehicle 100 may change the color of the object corresponding to the external vehicle to dark and change the color of the object corresponding to the external vehicle brightly when the illuminance is low. On the other hand, the information providing vehicle 100 may change the color of the object corresponding to the external vehicle based on the external background color.

The information providing vehicle 100 can receive and display information provided by the navigation of the external vehicle from the external vehicle. For example, the information providing vehicle 100 may display map information of an external vehicle.

6 is a flowchart illustrating a method of providing information on an external vehicle that mutually authenticates location information exchange according to an embodiment of the present invention.

As shown in FIG. 6, in step 610, the information providing vehicle 100 can mutually authenticate location information exchange with an external vehicle. For example, in a case where two or more vehicles travel together to the same destination, two or more vehicles can mutually authenticate the location information exchange.

The information providing vehicle 100 can receive the identification information of the external vehicle from the driver (or the passenger). The vehicle number may be an example of the identification information of the external vehicle. At this time, the information providing vehicle 100 may request the location information exchange to the external vehicle based on the identification information of the external vehicle. The information providing vehicle 100 may receive an acceptance message for requesting the location information exchange from the external vehicle. According to an embodiment of the present invention, the location information exchange request and the acceptance message reception can be performed through various communication methods such as inter-vehicle communication, mobile communication, and the like.

According to an embodiment of the present invention, the information providing vehicle 100 may receive the location information exchange request from the external vehicle and, in response thereto, may transmit the acceptance message to the external vehicle.

At step 620, the information providing vehicle 100 can acquire information about the external vehicle that has mutually authenticated the information exchange.

The information on the external vehicle may include position information of the external vehicle, travel route information of the external vehicle, running speed information of the external vehicle, lane information of the external vehicle, lane information of the external vehicle, have. The operation state information of the external vehicle means information that the driver operates the directional paper, brake, accelerator pedal, handle, and the like.

The information providing vehicle 100 can acquire information on the external vehicle from the base station 400. [ For example, when the information providing vehicle 100 transmits the identification information of the external vehicle to the base station 400, the base station 400 transmits the position information of the external vehicle to the information providing vehicle 100 ). On the other hand, the information providing vehicle 100 may receive information on the external vehicle from the mobile terminal of the external vehicle 500 or the external vehicle 500 or the like.

On the other hand, when the external vehicle is located within a predetermined distance (for example, when the external vehicle is viewed through the front camera or the black box camera), the information providing vehicle 100 uses the black box camera or the front camera, The vehicle number or the vehicle type of the vehicle. Then, the information providing vehicle 100 can acquire the position information of the external vehicle based on the recognized vehicle number or vehicle type of the external vehicle.

In step 630, the information providing vehicle 100 may display the image corresponding to the information about the external vehicle through the transparent display 100. [ For example, when the external vehicle exists in the visible range of the driver of the information providing vehicle 100, the information providing vehicle 100 can display the identification mark for the external vehicle through the transparent display 121. [

An identification mark for an external vehicle means an indication for distinguishing an external vehicle that has mutually authenticated mutual position information from another vehicle. That is, the information providing vehicle 100 can display an outline on an external vehicle or display an identification image. Also, the information providing vehicle 100 may display an outline or an identification image for the external vehicle at predetermined intervals.

On the other hand, according to the embodiment of the present invention, the information providing vehicle 100 can change at least one of the size, the display cycle, and the color of the identification display for the external vehicle based on the distance to the external vehicle.

On the other hand, when the external vehicle is present at the invisible distance of the driver of the information providing vehicle 100, the information providing vehicle 100 transmits information about the external vehicle on the obstacle existing between the information providing vehicle 100 and the external vehicle Can be displayed. That is, the information providing vehicle 100 can display the information about the external vehicle as the augmented reality on the transparent display 121. [

In addition, when the external vehicle is located outside the information providing vehicle 100 a predetermined distance (for example, when an obstacle exists between the information providing vehicle 100 and the external vehicle), the information providing vehicle 100 may acquire a virtual The image may also be displayed via the transparent display 121.

According to the embodiment of the present invention, in the case where the A vehicle follows the B vehicle to the destination, the driver of the A vehicle can clearly distinguish the other vehicle from the B vehicle, Can be easily confirmed during operation through the transparent display 121. Also, the driver of the vehicle B can confirm the position of the vehicle A following the driver's operation, so that the driver can adjust the driving speed and the lane for the following vehicle A

7 is a diagram illustrating an object corresponding to an external vehicle in the augmented reality mode according to an embodiment of the present invention.

As shown in FIG. 7, when the information providing vehicle 100 recognizes an external vehicle mutually authenticated for exchanging position information through a front camera or a black box camera, the outline 1410 is displayed on the transparent display 121 to the external vehicle. Can be displayed through the display. In FIG. 7, an example of an object corresponding to an external vehicle is referred to as an outline shape identification mark, but the present invention is not limited thereto.

According to an embodiment of the present invention, a driver (or an occupant) can easily distinguish (recognize) an external vehicle that mutually authenticates mutual position information exchange among a plurality of vehicles observed through a windshield window (or a transparent display) .

FIG. 8 is a diagram for explaining a discrimination display cycle associated with an embodiment of the present invention.

As shown in Fig. 8, the information providing vehicle 100 may display an identification mark in the form of an outline for the external vehicle on the transparent display 121 at predetermined intervals. For example, the information providing vehicle 100 can display an object corresponding to the external vehicle (for example, an identification mark in the form of an outline) on a transparent display at predetermined intervals. That is, an outline-shaped identification display may be repeatedly displayed on the transparent display 121 (811) and disappear (812).

At this time, according to the embodiment of the present invention, the information providing vehicle 100 may change the period in which the outline 810 is displayed based on the distance between the information providing vehicle 100 and the external vehicle. The information providing vehicle 100 can shorten the period in which the outline 810 is displayed as the distance from the external vehicle becomes closer to the external vehicle. The period in which the outline 810 is displayed can be made longer.

9 and 10 are views showing identification marks of image types for an external vehicle according to an embodiment of the present invention.

As shown in Fig. 9, the information providing vehicle 100 is configured such that, when an external vehicle mutually authenticated for position information exchange via a front camera or a black box camera is recognized (when the external vehicle is located within the visible range of the driver) , An identification image 910 for the external vehicle can be displayed through the transparent display 121. [ FIG. 9 shows only the identification image of the vehicle type as an example of the object corresponding to the external vehicle. However, the object corresponding to the external vehicle according to an embodiment of the present invention may be various types such as an arrow shape, a star shape, and a circle shape.

The information providing vehicle 100 may also be provided with distance information with respect to the external vehicle, lane information (e.g., 2nd line) of the external vehicle, operation information such as direction indications, traveling speed information (e.g., 30 km / h) And the like may be displayed through the transparent display 121.

10, according to one embodiment of the present invention, the information providing vehicle 100 may display the identification image 1010 of the vehicle type for the external vehicle at a predetermined period on the transparent display 121 . According to an embodiment of the present invention, the information providing vehicle 100 may be configured to determine the distance between the information providing vehicle 100 and the external vehicle or the distance between the information providing vehicle 100 and the information providing vehicle 100, (1710) may be displayed.

11 is a diagram illustrating an object corresponding to an external vehicle in the map mode according to an embodiment of the present invention.

11, when the external vehicle is located at a non-visible distance (for example, 1 km) of the driver, the information providing vehicle 100 maps the image 1110 indicating the position of the external vehicle on the map Can be displayed. At this time, the information providing vehicle 100 can change the scale of the map based on the distance between the information providing vehicle 100 and the external vehicle.

For example, the information providing vehicle 100 may be configured such that the external vehicle 1110 is located at a distance from the information providing vehicle 100 (see FIG. 11A) when the external vehicle 1110 is one kilometer ahead of the information providing vehicle 100 (Fig. 11 (b)), the scale of the map can be adjusted to a large extent.

Accordingly, the information providing vehicle 100 according to the embodiment of the present invention can map and display an object corresponding to the external vehicle on a large-scale map as the distance from the external vehicle gradually increases, The object corresponding to the external vehicle (for example, the identification image) can be superimposed on the actual image of the external vehicle and displayed.

12 is a view showing a screen for providing information on an external vehicle related to an embodiment of the present invention.

12, when an obstacle (e.g., building) exists between the information providing vehicle 100 and the external vehicle and the external vehicle is not recognized by the front camera or the black box camera of the information providing vehicle 100 , The information providing vehicle 100 can display information on the external vehicle on the obstacle via the transparent display 121. [ For example, the information providing vehicle 100 can display the position of the external vehicle on the transparent display 121 when the external vehicle following the information providing vehicle 100 is not covered by the building.

In FIG. 12, the information providing vehicle 100 can display the location of the external vehicle by an arrow 1220. FIG. That is, an external vehicle may exist in the right direction of the arrow. The information providing vehicle 100 may also be configured to display the speed of the external vehicle (30 km / h), the lane (2 lanes) 1210 currently used by the external vehicle, the distance to the external vehicle Can be displayed on the display unit 121. On the other hand, the information providing vehicle 100 may display on the transparent display 121 that the external vehicle has operated the right direction indicator by displaying the right side of the arrow in white (1230).

According to one embodiment of the present invention, the information providing vehicle 100 may unilaterally track other vehicles that have not mutually authenticated the location information exchange. For example, when the information providing vehicle 100 is a police car, it is possible to unilaterally track another vehicle having a signal violation.

At this time, according to one embodiment of the present invention, the information providing vehicle 100 can photograph the number plate and the form of the tracking vehicle through the black box camera or the front camera. The information providing vehicle 100 can recognize the numbers and letters of the license plates photographed using the image processing technology, and can accumulate the numbers and letters of the recognized license plates in the database. Further, the information providing vehicle 100 can recognize the vehicle type from the captured vehicle shape using the image processing technology, and can also track the recognized vehicle type in the database.

According to an embodiment of the present invention, the information providing vehicle 100 can recognize the tracking vehicle based on the vehicle type or the license plate, and can provide an identification mark for the tracking vehicle on the transparent display 121. Therefore, according to the embodiment of the present invention, the information providing vehicle 100 can easily track the other vehicle.

Meanwhile, according to another embodiment of the present invention, the information providing vehicle 100 can receive the vehicle number of the tracking vehicle from the outside. In this case, the information providing vehicle 100 can transmit the vehicle number of the tracking vehicle to the peripheral base station 400. [

The information providing vehicle 100 can receive the position of the tracking vehicle based on the vehicle number of the tracking vehicle from the base station 400 as GPS information. At this time, the information providing vehicle 100 can display the position of the tracking vehicle on the transparent display 121 based on the GPS information of the tracking vehicle.

13 is a flowchart illustrating a method of providing destination guidance information, accident information of other vehicles, and traffic situation information according to an embodiment of the present invention.

In step 1210, the information providing vehicle 100 can acquire destination guidance information. That is, when receiving the destination from the driver (or the passenger), the information providing vehicle 100 searches for the driving guidance information to the destination. According to an embodiment of the present invention, the information providing vehicle 100 may request and receive destination guidance information from the base station 400 or the server 500. [

The destination guide information according to an embodiment of the present invention may include destination position information, distance information to a destination, route information to a destination, vehicle speed limit information, intermittent camera position information, and the like.

In step 1320, the information providing vehicle 100 can display the image corresponding to the destination guidance information through the transparent display 121. At this time, according to the embodiment of the present invention, the information providing vehicle 100 may display the destination guidance information as an augmented reality, or map the map on the map.

In step 1330, the information providing vehicle 100 can obtain the accident information of the other vehicle 200. [ When an accident occurs in the other vehicle 200, the other vehicle 200 can transmit the accident information to the base station 400 or the server 500. Therefore, according to the embodiment of the present invention, the information providing vehicle 100 can receive accident information of the other vehicle 200 from the base station 400 or the server 500. [ Meanwhile, according to another embodiment of the present invention, the information providing vehicle 100 may receive accident information directly from the other vehicle via the intervehicle communication (V2V) network.

Incident information according to an embodiment of the present invention may include an accident occurrence point, an accident occurrence lane, a bypass road, an accident occurrence time, and the like.

In step 1340, the information providing vehicle 100 can display an image corresponding to the accident information of the other vehicle 200 through the transparent display 121. [ For example, the information providing vehicle 100 may display an image corresponding to at least one of the accident occurrence point information, the accident occurrence lane information, and the bypass road information through the transparent display 121. [

In step 1350, the information providing vehicle 100 can acquire traffic situation information. The traffic situation information according to an exemplary embodiment of the present invention may include traffic clogging information, the number of lanes of a road, a road width, a road type, a limit height, a limitation weight,

In step 1360, the information providing vehicle 100 may display an image corresponding to the traffic situation information through the transparent display 121. [

According to an embodiment of the present invention, the order of steps 1310 to 1360 may be changed, and some steps may be omitted.

14 is a view showing a screen displaying an image corresponding to accident information of another vehicle related to an embodiment of the present invention.

As shown in FIG. 14, according to an embodiment of the present invention, the information providing vehicle 100 can display accident information of the other vehicle 200 on the transparent display 121. In other words, the information providing vehicle 100 can display the message " 14 minutes in front of 1km, which will take 30 minutes to the destination ", or display the message 1410 on the transparent display 121. [ At this time, the information providing vehicle 100 can display an accident occurrence point with an arrow or the like and can display accident occurrence lane information (e.g., two lanes).

Therefore, according to the embodiment of the present invention, the driver can quickly confirm the accident information of the other vehicle 200 and can respond to the accident of the other vehicle 200 immediately. For example, a driver can search for a detour to avoid an accident spot, or change the lane in advance before passing the accident spot.

FIG. 15 is a diagram showing a screen for mapping incident information of another vehicle, which is related to an embodiment of the present invention, on a map.

15, according to an embodiment of the present invention, the information providing vehicle 100 is provided with accident information of the other vehicle 200 (accident occurrence position, accident content, time required to the accident point, Etc.) may be mapped to a map and displayed on the transparent display 121 (1510).

At this time, according to an embodiment of the present invention, the information providing vehicle 100 may receive accident information of the other vehicle 200 mapped to the map from the server 500.

16 is a flowchart illustrating an information providing method according to an embodiment of the present invention.

As shown in FIG. 16, the information providing vehicle 100 according to the embodiment of the present invention can acquire the situation information inside or outside the vehicle [S1610].

For example, the information providing vehicle 100 may store, as the situation information inside the vehicle, fuel state information, engine state information, tire information, position information of the information providing vehicle 100, running speed information, , Temperature, humidity, information on the driver (eyes of the driver, drowsiness driving state, drinking state), and the like.

Also, the information providing vehicle 100 may include background information on an object or terrain existing outside the vehicle, illumination information, accident information of the other vehicle 200, traffic situation information, destination information, location information Information about an external vehicle that has mutually authenticated the exchange, and the like.

According to an embodiment of the present invention, the information providing vehicle 100 receives status information on the outside of the vehicle from the other vehicle 100, the mobile terminal 300, the base station 400, the server 500, .

The information providing vehicle 100 can generate an image corresponding to the situation information based on the acquired situation information (S1620).

That is, the information providing vehicle 100 can analyze the acquired situation information. For example, the information providing vehicle 100 determines whether the residual fuel is less than a predetermined amount, analyzes the engine state information, tire state information, and the like based on the fuel state, It can be extracted.

At this time, the information providing vehicle 100 can generate an image corresponding to the situation information based on the analysis result. For example, if the analysis shows that the fuel is insufficient, the image corresponding to the gas station information (the gas station location, the price, etc.) can be generated.

In addition, when the information about the destination is inputted to the driver, the information providing vehicle 100 can generate the image corresponding to the destination guidance information (the moving route, the lane, the speed limit, etc.).

According to an embodiment of the present invention, the information providing vehicle 100 may display an image corresponding to the situation information through a transparent display of the vehicle 100 (S1630).

Therefore, the driver can observe the actual world through the transparent display, and can check the situation information generated inside the vehicle or outside the vehicle. Therefore, according to the embodiment of the present invention, it is possible to prevent the driver's line of sight from being dispersed during driving, and to allow the driver to recognize the situation information of the inside of the vehicle or the outside of the vehicle more easily and quickly.

According to an embodiment of the present invention, the information providing vehicle 100 may display a position or an angle at which an image corresponding to situation information inside or outside the vehicle is displayed on the transparent display 121, based on the driver's eye position Can be adjusted.

For example, in a case where the information providing vehicle 100 displays an identification mark on a transparent display 121 for a specific building viewed by a driver, the information providing vehicle 100 determines, based on the driver's eye position, It is possible to adjust the display position or angle of the identification display so that it can be recognized that the identification mark is correctly displayed on the specific building.

On the other hand, the information providing vehicle 100 can adjust the size, display cycle, color, and the like of the image corresponding to the situation information inside or outside the vehicle, based on the running speed information of the information providing vehicle 100.

For example, as the running speed of the information providing vehicle 100 increases, the size of the image corresponding to the situation information may be increased, the display period may be increased, and the color of the image may be changed from a blue color to a red color .

The information providing vehicle 100 according to an embodiment of the present invention can display an image corresponding to the situation information inside or outside the vehicle as an augmented reality. In addition, the information providing vehicle 100 may map the situation information in the vehicle or outside the vehicle on a map and display it through the transparent display 121. [

The information providing vehicle 100 according to an embodiment of the present invention can adjust the transparency of the transparent display 100 according to illumination information outside the vehicle. For example, when the illuminance outside the vehicle is high due to the headlight of the sun or the front car, the information providing vehicle 100 lowers the transparency of some or all of the transparent display 100, and when the illuminance is low, So that the driver can observe the outside of the vehicle well.

On the other hand, the information providing vehicle 100 can acquire illuminance information according to the driver's gaze direction. The information providing vehicle 100 can acquire the illuminance information according to the driver's gaze direction in consideration of the current moving direction, the position of the sun according to the current time, and the like.

For example, the information providing vehicle 100 can lower the transparency of the transparent display 121 when the driver's direction of sight is the direction facing the sun.

The information providing vehicle 100 according to the embodiment of the present invention may set an opaque color in a part of or a whole area of the transparent display 121 on the basis of background information outside the vehicle.

Hereinafter, a method of providing information that the driver can not directly observe through the transparent display will be described in detail with reference to FIG. 17 to FIG.

17 is a flowchart illustrating a method of providing invisible information of a driver through a transparent display according to an embodiment of the present invention.

As shown in FIG. 17, the information providing vehicle 100 can acquire background information around the vehicle (S1710). For example, the information providing vehicle 100 can acquire building information, other vehicle information, roadside information, streetlight information, lane information, pedestrian information, and terrain information, which are located within a predetermined distance.

At this time, according to one embodiment of the present invention, the information providing vehicle 100 can acquire background information using vision technology. The information providing vehicle 100 photographs a road through a camera and detects a feature element such as a lane of a road, a road marking, a streetcar, a pedestrian, etc. through an edge detection technique, a frequency based technique, Can be extracted. For example, the information providing vehicle 100 may be configured such that the vehicle has symmetry in the up and down directions, that the area under the vehicle has a dark shadow, that the rear part of the vehicle has a rectangular shape, The other vehicle 200 can be recognized.

Further, the information providing vehicle 100 may be configured to predefine a template based on a license plate, a rear window, and a headlight that is found during nighttime driving, which are always found in a vehicle, and compare the photographed image with a pre- , So that the other vehicle 200 can be recognized.

Meanwhile, the information providing vehicle 100 may recognize a surrounding object by using a stereo vision technique or a motion analysis technique that utilizes an image sequence, which can construct 3D information on the driving environment in front of the vehicle.

The information providing vehicle 100 may determine whether an obstacle exists between the information providing vehicle 100 and the object [S1720]. A target object may mean a destination building, a destination place, a destination travel path, a POI (Point of Interest) (for example, a gas station, a garage, etc.) set by a driver.

The obstacle refers to objects that are positioned between the vehicle 100 and the object, thereby obstructing the driver from directly observing the object through the transparent display 100 with eyes. For example, there may be buildings, other vehicles, roadside trees, and mountains. The obstacle according to an embodiment of the present invention can be extracted from the background information around the vehicle obtained through the camera.

The information providing vehicle 100 can recognize the position of the obstacle by using the GPS information of the vehicle 100, the GPS information of the object, the map information, the compass information, and the like. Also, the information providing vehicle 100 may recognize the type and the shape of the obstacle through the vision technique.

When the obstacle is recognized, the information providing vehicle 100 can display the information on the obstacle on the obstacle (S1730). That is, the information providing vehicle 100 can display information about the object on the transparent display 121 in the form of an augmented reality.

If the obstacle does not exist, the information providing vehicle 100 may display an identification mark for the object recognized through the front camera or the black box camera on the transparent display 121 as an augmented reality [S1740].

FIGS. 18 and 19 are views showing a screen for displaying road information related to an embodiment of the present invention on an obstacle.

18, when the destination route is covered by the preceding vehicle, the information providing vehicle 100 may display the destination route 1810 on the preceding vehicle via the transparent display 121. [ That is, the information providing vehicle 100 displays the destination route 1810 which the driver can not directly confirm by the front vehicle through the transparent display 121, so that the driver can easily confirm the destination route 1810.

On the other hand, when the travel path can be obstructed by displaying the destination route 1810, the information providing vehicle 100 displays the destination route 1810 in a dotted line or a semi-transparent state on the transparent display 121, It can be displayed by blinking.

As shown in FIG. 19, according to an embodiment of the present invention, when the right turn road is located behind the obstacle, the information providing vehicle 100 displays the road 1910 on the obstacle as a dotted line through the transparent display 121 It can also be displayed.

Hereinafter, a method of providing information corresponding to each situation occurring in the vehicle or outside the vehicle will be described for each situation.

20 is a flowchart illustrating a method of providing information on a gas station according to an embodiment of the present invention.

In step 2010, the information providing vehicle 100 can acquire the fuel state information within the vehicle. According to one embodiment of the present invention, the information providing vehicle 100 can acquire the fuel state information within the vehicle at predetermined intervals.

In step 2020, the information providing vehicle 100 may analyze the fuel state information to determine whether the residual fuel is less than a predetermined amount.

In step 2030, when the residual fuel is equal to or smaller than the predetermined amount, the information providing vehicle 100 can search for the gas station to which the vehicle 100 can reach within the residual fuel. That is, the information providing vehicle 100 searches for gas stations that can be reached using the residual fuel based on the fuel mileage information and the residual fuel information.

According to an embodiment of the present invention, the information providing vehicle 100 can receive the gas station information located within a predetermined distance from the base station 400. [ The information providing vehicle 100 may also transmit remaining fuel information and current position information to the server 500 and may receive gas station information that can be reached within the residual fuel from the server 500. [

In step 2040, the information providing vehicle 100 can display information about the searched gas station through the transparent display 121. [ The information on the gas station may include the location of the gas station, the distance to the gas station, the mark of the gas station, the price of the fuel used by the information providing vehicle 100 at the gas station, the gas station entry route,

FIG. 21 is a view showing a screen for displaying information on a gas station existing in a non-visible zone of a driver according to an embodiment of the present invention.

As shown in FIG. 21, when the searched AAA gas station is 1.5km ahead and the driver can not directly see the AAA gas station through the windshield due to the front vehicle, the information providing vehicle 100 Information about the AAA gas station 2110 can be displayed on the transparent display 121 as an augmented reality.

If a diesel is used in the information providing vehicle 100, the information providing vehicle 100 may display the diesel price (\ 1800) at the AAA gas station through the transparent display 121.

22 is a view showing information on essential gas stations related to an embodiment of the present invention.

The essential gas station means a gas station that the information providing vehicle 100 must hear in the residual fuel. For example, as a result of calculation based on fuel mileage information and residual fuel information of the information providing vehicle 100, it is assumed that the information providing vehicle 100 can move only 2 km with the residual fuel. At this time, if the AAA gas station is located 0.5 km ahead and the BBB gas station, which is the next gas station, is 3 km away, the information providing vehicle 100 indicates that the AAA gas station is the last gas station in the remaining fuel, . ≪ / RTI >

22 (a), when the driver can directly observe the essential gas station through the windshield, the information providing vehicle 100 displays the identification mark (FIG. 22 2210). Identification of essential gas stations is an indication to distinguish essential gas stations from other objects.

22 (b), the information providing vehicle 100 may display the identification display 2210 for the essential gas station on the transparent display 121 at predetermined intervals. At this time, the information providing vehicle 100 can adjust the period in which the identification mark is displayed according to the traveling speed or the distance from the essential gas station. For example, when the traveling speed is fast or the distance from the gas station is short, the information providing vehicle 100 can speed up the identification display period.

23 is a flowchart illustrating a method of providing images corresponding to defect occurrence information in a vehicle related to an embodiment of the present invention.

In step 2310, the information providing vehicle 100 can acquire the defect occurrence information in the vehicle. For example, the information providing vehicle 100 determines whether the tire is worn over a threshold value, the tire air pressure is lowered by a threshold value or less, the engine oil is lower than the threshold value, or the brake is not operated It is possible to acquire defect information in the inside of the vehicle.

In step 2320, the information providing vehicle 100 can display information on the defect occurrence portion through the transparent display 121. [ For example, when the air pressure of the tire is lowered by the threshold value or more, the information providing vehicle 100 can display the tire image on the transparent display 121. [

In step 2330, the information providing vehicle 100 can judge whether the defect occurrence portion is maintenanceable. In step 2340, when the defect occurrence part is repairable, the information providing vehicle 100 can search for a repair shop capable of repairing the defect occurrence part. For example, when the wear degree of the tire is equal to or greater than the threshold value, the information providing vehicle 100 searches for a tire company.

According to an embodiment of the present invention, the information providing vehicle 100 transmits information on the defect occurrence part and the position information to the base station 400 or the server 500 and transmits the information from the base station 400 or the server 500 to the workshop May be received.

In step 2350, the information providing vehicle 100 can display information on the searched workshop. The information about the repair shop may include identification information (name, etc.) of the repair shop, location information of the repair shop, maintenance quotation, contact information of the repair shop, route to the repair shop, and the like. 24 and 25 will be referred to.

FIG. 24 is a view showing a screen for displaying information about a defect occurrence portion in a vehicle related to an embodiment of the present invention. FIG.

As shown in Fig. 24, when the engine oil is below the threshold, the information providing vehicle 100 may display a warning message 2410 or warning image 2420 that the engine oil is low on the transparent display 121. [ When a search request for a workshop capable of filling engine oil is received from the driver (or occupant), the information providing vehicle 100 can search for a workshop within a predetermined distance based on the current position.

25 is a view showing a screen displaying information on a workshop associated with an embodiment of the present invention.

25, when the workshop is searched, the information providing vehicle 100 displays information (for example, " There is an AAA workshop near 15km ") 2510 found on the transparent display 121 about the searched workshop . The information providing vehicle 100 may further display the engine oil replacement price information at the AAA workshop on the transparent display 121. [

On the other hand, when the searched workshop is recognized through a front camera or a black box camera (i.e., when the driver can observe the workshop searched through the windshield window or the transparent display), the information providing vehicle 100 displays the transparent display 121 ) May be displayed to identify the shop that is searched.

The method according to an embodiment of the present invention can be implemented in the form of a program command which can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

100: Information providing vehicle
110:
120: Output section
130:
200: Other vehicles
300:
400: base station
500: Server

Claims (1)

A method of providing information on an external vehicle on a head up display (HUD) of a vehicle,
Obtaining status information of the external vehicle from the external vehicle;
Determining a distance between the vehicle and the exterior vehicle based on the status information of the external vehicle;
Controlling the HUD to display an object corresponding to the external vehicle on the map when the determined distance is equal to or greater than a predetermined distance; And
And controlling the HUD to display an object corresponding to the external vehicle by superimposing on the external vehicle using the augmented reality technology when the determined distance is less than the predetermined distance.

Images