KR101985496B1 - Driving assistance apparatus and vehicle having the same - Google Patents

Abstract

According to an embodiment of the present invention, there is provided a vehicle driving assist system including a communication unit for acquiring a position of a vehicle in real time; A display unit for displaying a screen related to driving of the vehicle; And a notification unit for providing a notification of the predetermined place if it recognizes that the predetermined place is located within a predetermined distance from the position of the vehicle based on the position of the vehicle and the traveling path of the vehicle and receives an input for selecting the predetermined place And a processor for resetting the traveling path so as to face the predetermined place.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a driving assist device,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a vehicle driving assist apparatus and a vehicle including the same and more particularly to a vehicle driving assist apparatus capable of easily performing a traveling route change to an intermediate destination that is excessive during driving to a destination, will be.

A vehicle is any device that drives a wheel for the purpose of transporting people or cargo. A typical example of a vehicle is a car.

An automobile can be classified into an internal combustion engine automobile, an external combustion engine automobile, a gas turbine automobile or an electric vehicle depending on the type of prime mover used.

An electric vehicle is an automobile that uses electric power as an energy source to drive an electric motor. The hybrid electric vehicle (HEV), the plug-in hybrid electric vehicle (PHEV), the hydrogen fuel cell vehicle Fuel Cell Electric Vehicle (FCEV).

In recent years, the development and commercialization of an intelligent vehicle (Smart Vehicle) has been actively conducted for the safety and convenience of drivers and pedestrians. Intelligent automobile is a cutting-edge automobile that integrates information technology (IT). It provides optimal transportation efficiency through interworking with intelligent transportation system as well as introduction of advanced system of automobile itself. Specifically, the intelligent vehicle performs automatic cruise control, adaptive cruise control (ACC), obstacle detection, collision detection, precise guidance, route to destination, and location of key locations , Maximizing the safety and comfort of the driver, passengers and pedestrians.

In addition, researches on sensors mounted on such an intelligent automobile are being actively conducted. Such sensors include a camera, an infrared sensor, a radar, a lidar, a GPS, and a gyroscope, and play an important role in replacing the naked eye of a driver.

[0003] As various sensors and electronic equipment for driving the vehicle have been developed, a vehicle having a vehicle driving assistance function that assists a driver in driving the vehicle and improves driving safety and convenience has been receiving attention.

One of the vehicle driving assist functions is the automatic travel route setting function. The automatic travel route setting function automatically sets the most efficient travel route to the destination in consideration of various conditions when the driver inputs the destination.

The driver must set the origin and destination of the itinerary in the navigation system in order to navigate to a new location or to perform an unplanned itinerary. In this case, if the driver does not recognize in advance the information about the place where the vehicle is located in the driving route, the place is usually excessive during driving.

Also, if the driver's vehicle travels with more than one other vehicle, such as a friend or family member, it is difficult for all the vehicles to travel together for a long journey. If one of the vehicles traveling together stops or goes out of the way, instantaneous travel route synchronization with other vehicles or notification to other vehicles is performed slowly. Thus, it is difficult to synchronize the driving route to the unexpected major places that are overtaken during the itinerary with other vehicles in operation together.

The present invention provides a vehicle driving assist apparatus and a vehicle including the same that provide information on an intermediate destination that is unexpectedly over-traveled while driving, and enable a user to easily perform resetting and changing of a traveling route to the intermediate destination .

The present invention also relates to a vehicle driving assist apparatus and a driving assist system which can create the same traveling group among vehicles that are running together and set up and synchronize a traveling route to an intermediate destination that is unexpectedly excessive during traveling among vehicles belonging to the same traveling group, And it is an object of the present invention to provide a vehicle including the same.

According to an aspect of the present invention, there is provided an information processing apparatus including: a communication unit for obtaining a position of a vehicle in real time; A display unit for displaying a screen related to driving of the vehicle; And a notification unit for providing a notification of the predetermined place if it recognizes that the predetermined place is located within a predetermined distance from the position of the vehicle based on the position of the vehicle and the traveling path of the vehicle and receives an input for selecting the predetermined place And a processor for resetting the traveling route so as to face the predetermined place.

According to another aspect of the present invention, there is provided an information processing apparatus including: a communication unit for obtaining a position of a vehicle in real time; A display unit for displaying a screen related to driving of the vehicle; And a communication unit for communicating with the communication unit to receive the position of the vehicle and recognizing that the predetermined place is located within a predetermined distance from the position of the vehicle based on the position of the vehicle and the traveling path of the vehicle, And a vehicle driving assist device for providing an alarm and resetting the traveling route to the predetermined place upon receiving an input for selecting the predetermined location.

The vehicle driving assist system according to the embodiment provides information on the intermediate destination that is unexpectedly over-traveled while driving, and allows the user to easily reset and change the traveling route to the corresponding intermediate destination.

In addition, according to the vehicle driving assistant apparatus according to the embodiment, the same traveling group is created between vehicles that are traveling together, and a traveling route to an intermediate destination that is unexpectedly over traveled among vehicles belonging to the same traveling group is set and synchronized can do.

1 is a block diagram showing the configuration of a vehicle driving assist system according to an embodiment of the present invention.
2A is a diagram showing the appearance of a vehicle including a vehicle driving assistant device according to an embodiment of the present invention.
2B shows a case where a sensor part included in a vehicle driving assist device according to an embodiment of the present invention is disposed in a vehicle.
3 is a diagram showing a configuration of a camera included in a vehicle driving assist device according to an embodiment of the present invention.
4 is a block diagram showing a configuration of a processor included in a vehicle driving assist system according to an embodiment of the present invention.
5 is a view for explaining an example of a method of detecting image information in an image taken by a camera by a vehicle driving assistant device according to an embodiment of the present invention.
6 is a view showing an embodiment of a display unit included in a vehicle driving assist apparatus according to an embodiment of the present invention.
7 is a block diagram showing the configuration of a vehicle including a vehicle driving assist system according to an embodiment of the present invention.
8 is a flowchart illustrating a process of providing a notification of an intermediate destination by a vehicle driving assistant device according to an embodiment of the present invention.
FIG. 9 is a view showing an example of a screen displayed on the vehicle driving assist device according to an embodiment of the present invention.
10A and 10B are views for explaining an example in which a vehicle driving assistant device according to an embodiment of the present invention provides a notification about an intermediate destination.
11 is a diagram illustrating a process of resetting a driving route by a driving assist system according to an embodiment of the present invention.
12A and 12B are diagrams for explaining an example in which a vehicle driving assist system according to an embodiment of the present invention reestablishes a traveling route based on an intermediate destination.
13A and 13B are views for explaining an example in which a vehicle driving assistant apparatus according to an embodiment of the present invention maintains an existing route irrespective of an intermediate destination.
14A to 14C are views for explaining another example in which the vehicle driving assistant apparatus according to the embodiment of the present invention maintains the existing route regardless of the intermediate destination.
FIG. 15 is a diagram illustrating a process of generating a same driving group by a driving assistance device according to an embodiment of the present invention.
16A and 16B are views for explaining a method of generating the same driving group by the vehicle driving assistant device according to the embodiment of the present invention.
17 is a view for explaining a method in which a vehicle driving assist system according to an embodiment of the present invention shares a traveling route among the same traveling groups.
18A and 18B are views for explaining a method for allowing other vehicles belonging to the same driving group generated by the vehicle driving assist device to share the traveling route according to an embodiment of the present invention.
19A to 19C are views for explaining a method of sharing a traveling route between the same traveling groups generated by the vehicle driving assist device according to the embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix " module " and " part " for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, It is to be understood that the technical idea disclosed in the present specification is not limited by the accompanying drawings, but includes all changes, equivalents, and alternatives falling within the spirit and scope of the present invention.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The vehicle described in this specification may include all kinds of vehicles such as automobiles and motorcycles. Hereinafter, the case of an automobile will be described as an example.

Further, the vehicle may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, and an electric vehicle having an electric motor as a power source.

Hereinafter, the left side of the vehicle means the left side with respect to the running direction of the vehicle, and the right side of the vehicle means the right side with respect to the running direction of the vehicle. In the following description, unless otherwise stated, the vehicle means a Left Hand Drive (LHD) vehicle with the handle on the left side.

The vehicle driving assist device described in the present specification is a separate device provided in the vehicle, and is defined as a device that transmits and receives necessary information through data communication with the vehicle and executes a vehicle driving assistance function. However, according to an embodiment, the vehicle driving assist system may be a set of some of the components of the vehicle, and may form part of the vehicle.

When the vehicle driving assist device is a separate device, at least a part of each component (see Fig. 1) of the vehicle driving assist device is not included in the vehicle driving assist device, and is not included in the vehicle or other device Lt; / RTI > These external components can be understood to constitute a vehicle driving assist device by transmitting and receiving data through the interface of the vehicle driving assist device.

For convenience of explanation, it is assumed that the vehicle driving assistance device includes the components shown in FIG. 1 directly.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a vehicle driving assist system according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing the configuration of a vehicle driving assist system according to an embodiment of the present invention.

The vehicle driving assistant apparatus 100 according to an embodiment of the present invention includes an input unit 110, a communication unit 120, an interface unit 130, a memory 140, a sensor unit 155, a monitoring unit 165, A processor 170, a display unit 180, an audio output unit 185, and a power supply unit 190. However, the components shown in FIG. 1 are not essential for implementing the vehicle driving assistant device 100, so that the vehicle driving assistant device 100 according to an embodiment of the present invention includes more components than those listed above Or may have fewer components.

To describe each configuration in detail, the input unit 110 detects a user's input . For example, the user inputs the setting for the vehicle driving assistant function provided by the vehicle driving assistant 100 through the input unit 110, or turns on / off the vehicle driving assistant 100 (turning off) the operation of the vehicle.

The input unit 110 may include a gesture input unit (e.g., an optical sensor) for sensing a gesture of a user, a touch input unit (e.g., a touch sensor, a touch key, Mechanical key etc.) and voice And at least one of a microphone for sensing input and a microphone for sensing input.

The communication unit 120 may perform communication with the other vehicle 510, the mobile terminal 600, and the server 500.

In this case, the vehicle driving assistant apparatus 100 can receive at least one of navigation information, other vehicle driving information, and traffic information through the communication unit 120. [ In addition, the vehicle driving assistant apparatus 100 can transmit information about the subject vehicle equipped with the vehicle driving assistant device 100 through the communication unit 120. [

Specifically, the communication unit 120 receives at least one of the location information, weather information, and road traffic situation information (for example, TPEG (Transport Protocol Expert Group)) from the mobile terminal 600 and / or the server 500 Lt; / RTI >

In addition, the communication unit 120 can receive traffic information from the server 500 equipped with the intelligent traffic system (ITS). Here, the traffic information may include traffic signal information, lane information, vehicle periphery information, or location information.

The communication unit 120 may transmit the navigation information to the mobile terminal 600 and / or the server 500. [ Here, the navigation information may include at least one of map information related to driving the vehicle, lane information, position information of the vehicle, set destination information, and route information according to the destination.

For example, the communication unit 120 can receive the real-time position of the vehicle with the navigation information. Specifically, the communication unit 120 may include a GPS (Global Positioning System) module and / or a WiFi (Wireless Fidelity) module to obtain the position of the vehicle.

The communication unit 120 can receive the running information of the other vehicle 510 from the other vehicle 510 and transmit the information of the vehicle to the other vehicle 510 to share the running information between the vehicles. Here, the traveling information shared with each other includes moving direction information of the vehicle, Position information, vehicle speed information, acceleration information, movement route information, forward / backward information, adjacent vehicle information, and turn signal information.

In addition, when the user is boarding the vehicle, the user's mobile terminal 600 and the vehicle driving assistant 100 can perform pairing with each other automatically or by execution of the user's application.

The communication unit 120 may exchange data with another vehicle 510, the mobile terminal 600, or the server 500 in a wireless manner.

In detail, the communication unit 120 can perform wireless communication using a wireless data communication scheme. Wireless data communication schemes include, but are not limited to, technical standards or communication schemes for mobile communication (e.g., Global System for Mobile communications (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (Long Term Evolution), LTE Term Evolution-Advanced) or the like can be used.

In addition, the communication unit 120 may use a wireless Internet technology. For example, the wireless communication unit 120 may be a WLAN (Wireless LAN), a Wi-Fi (Wireless-Fidelity) (WiBro), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A) .

In addition, the communication unit 120 may use short range communication, and may be a Bluetooth ™, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), an Ultra Wideband (UWB) ), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct and Wireless Universal Serial Bus (USB) technologies.

The vehicle driving assistant apparatus 100 may also be connected to the other vehicle 510 by using the long distance wireless communication module of the mobile terminal 600, It is also possible to wirelessly exchange data with the server 500 or the like.

The interface unit 130 can perform an interface between the inside and the outside of the vehicle driving assistant 100, such as receiving data from the vehicle or transmitting processed or generated signals from the processor 170 to the outside.

Specifically, the vehicle driving assistant apparatus 100 can receive at least one of the other vehicle running information, the navigation information, and the sensor information through the interface unit 130.

Further, the vehicle driving assistant apparatus 100 transmits a control signal for executing the vehicle driving assistance function, information generated in the vehicle driving assistant apparatus 100, etc. to the control unit 770 of the vehicle through the interface unit 130 can do.

To this end, the interface unit 130 performs data communication with at least one of a control unit 770, an AVN (Audio Video Navigation) device 400 and a sensing unit 760 in the vehicle by a wired communication or a wireless communication method .

Specifically, the interface unit 130 can receive navigation information by data communication with the control unit 770, the AVN apparatus 400, and / or a separate navigation device (not shown).

The interface unit 130 may receive the sensor information from the control unit 770 or the sensing unit 760.

Here, the sensor information includes direction information of the vehicle, position information, vehicle speed information, acceleration information, tilt information, forward / backward information, fuel information, The distance information between the vehicle and the lane, and the turn signal information.

Also, the sensor information may include a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a wheel sensor, a vehicle speed sensor, A vehicle body inclination sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle internal temperature sensor, a vehicle internal humidity sensor, and a door sensor. On the other hand, the position module may include a GPS module for receiving GPS information.

The interface unit 130 may receive a user input received through the user input unit 724 of the vehicle. In this case, the interface unit 130 may receive the user input directly from the input unit 724 of the vehicle or via the control unit 770 of the vehicle.

In addition, the interface unit 130 may receive the traffic information obtained from the server 500. The server 500 may be a server located in a traffic control station that controls traffic. For example, traffic information is transmitted from the server 500 through the communication unit 710 of the vehicle The interface unit 130 may receive the traffic information from the control unit 770 of the vehicle.

The memory 140 may store various data for the overall operation of the vehicle driving assistance apparatus 100, such as a program for processing or controlling the processor 170. [

The memory 140 may also store a plurality of application programs (application programs or applications), data for operation of the vehicle driving assistant 100, and commands that are driven by the vehicle driving assistant 100 . At least some of these applications may be downloaded from an external server via wireless communication. At least some of these application programs may also be present on the vehicle driving assistance device 100 from the time of shipment for the basic functions (e.g., driving assistance information guidance function) of the driving assistance device 100.

Such an application program may be stored in the memory 140 and driven by the processor 170 to perform the operation (or function) of the vehicle driving assistant device 100. [

Meanwhile, the memory 140 may store data for identifying objects included in the image. For example, when a predetermined object is detected in the vehicle surroundings image acquired through the camera 160, the memory 140 may store data for checking what the object corresponds to by various algorithms.

For example, the memory 140 may store comparison images and comparison data for determining whether the object included in the image obtained through the camera 160 corresponds to an object such as a lane, a traffic sign, a two-wheeled vehicle, or a pedestrian.

The memory 140 may be implemented in hardware, such as a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type) (RAM), a static random access memory (SRAM), a read-only memory (ROM), an EEPROM , electrically erasable programmable read-only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk.

In addition, the vehicle driving assistance apparatus 100 may be operated in association with a web storage that performs a storage function of the memory 140 on the Internet.

The monitoring unit 165 can acquire information on the internal state of the vehicle.

The information sensed by the monitoring unit 165 may include facial recognition information, fingerprint information, iris-scan information, retina-scan information, Hand geo-metry information, and voice recognition information. And the monitoring unit 165 may include other sensors that sense such biometric information.

The vehicle driving assistance apparatus 100 may further include a sensor unit 155 for sensing an object around the vehicle. According to the embodiment, the vehicle driving assistant device 100 may receive sensor information obtained from the sensing unit 760 of the vehicle through the interface unit 130. [ The sensor information thus obtained may be included in the vehicle periphery information.

The sensor unit 155 may include at least one of a distance sensor 150 for sensing the position of an object located in the vicinity of the vehicle and a camera 160 for capturing an image of the surroundings of the vehicle.

The distance sensor 150 can precisely detect the position of the object adjacent to the subject vehicle, the direction in which the object is spaced, the separation distance, or the moving direction of the object. The distance sensor 150 continuously measures the position of the detected object and can accurately detect a change in the positional relationship with the subject vehicle.

The distance sensor 150 may sense an object located in at least one of the front, rear, left and right sides of the vehicle. To this end, the distance sensor 150 may be located at various locations in the vehicle.

The distance sensor 150 may include at least one of a variety of sensors capable of distance measurement such as a Lidar sensor, a laser sensor, an ultrasonic waves sensor, and a stereo camera .

For example, the distance sensor 150 may be a laser sensor, and may be a laser sensor that uses a time-of-flight (TOF) or / and a phase- And the positional relationship between the object and the object can be accurately measured.

On the other hand, the information about the object can be obtained by analyzing the image captured by the camera 160 by the processor 170. Specifically, the vehicle driving assistant device 100 The camera 170 may photograph the periphery of the vehicle, analyze the acquired peripheral image of the vehicle by the processor 170 to detect the peripheral object of the vehicle, and determine the attribute of the object to generate the sensor information.

Here, the image information may be included in the sensor information as at least one of the type of the object, the traffic signal information displayed by the object, the distance between the object and the vehicle, and the position of the object.

Specifically, the processor 170 generates image information by performing object analysis such as detecting an object through image processing on the photographed image, tracking the object, measuring the distance to the object, and confirming the object can do.

Meanwhile, the processor 170 may synthesize images photographed from all directions, and provide an overview image of the vehicle viewed from the top view. When the surrounding view image is generated, a boundary portion between each image area occurs. These boundary portions can be naturally displayed by image blending processing.

In order for the processor 170 to perform object analysis more easily, In the example, the camera 160 may be a stereo camera that measures the distance to the object while shooting the image.

The camera 160 may directly include an image sensor and an image processing module. In this case, the camera 160 may process still images or moving images obtained by an image sensor (for example, CMOS or CCD). Also, the image processing module processes the still image or the moving image acquired through the image sensor, Information is extracted, And may transmit the extracted image information to the processor 170.

The sensor unit 155 may be a stereo camera in which the distance sensor 150 and the camera 160 are combined. That is, the stereo camera can detect the positional relationship with the object while acquiring the image.

The display unit 180 may display a graphic image relating to the vehicle driving assistant function. The display unit 180 may include a plurality of displays.

The audio output unit 185 can output a message to audio to confirm the description of the vehicle driving assistant function, whether or not the vehicle driving assistant function is executed, and the like. Thereby, the vehicle driving assistant device 100 can complement the description of the function of the vehicle driving assistant device 100 through the sound output of the audio output portion 185 together with the visual indication through the display portion 180 .

According to the embodiment, the vehicle driving assistant 100 may further include a haptic output unit (not shown) for outputting a haptic signal. The haptic output unit (not shown) can output an alarm for the vehicle driving assistance function as a haptic. For example, when the vehicle driving assistance apparatus 100 includes a warning about the driver in at least one of the navigation information, the traffic information, the communication information, the vehicle condition information, the driving assistance function (ADAS) information, , It can be notified to the user by vibration.

Such a haptic output unit (not shown) can provide a directional vibration. For example, the haptic output unit (not shown) may be disposed in the steering for controlling the steering to output the vibration. When the vibration is provided, the haptic output unit may divide the left and right of the steering to output the vibration, .

The power supply unit 190 may receive external power and internal power under the control of the processor 170 to supply power required for operation of the respective components.

The processor 170 may control the overall operation of each component within the vehicle driving assistance apparatus 100. [

In addition, the processor 170 may control at least some of the components included in the vehicle driving assistant 100, or may operate at least two of them in combination with each other, in order to drive an application program.

The processor 170 may be implemented in hardware in the form of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays controllers, micro-controllers, microprocessors 170, and electrical units for performing other functions.

According to an embodiment, the processor 170 may be controlled by the control unit 770 of the vehicle.

The processor 170 typically controls the overall operation of the vehicle driving assistance device 100, in addition to operations associated with application programs stored in the memory 140. [ Processor 170 may provide or process appropriate information or functionality to a user by processing signals, data, information, etc., input or output through the components discussed above, or by driving application programs stored in memory 170.

2A is a diagram showing the appearance of a vehicle including a vehicle driving assistant device according to an embodiment of the present invention.

Referring to FIG. 2A, a vehicle 700 according to an embodiment includes wheels 13FL and 13RL that are rotated by a power source, and a vehicle driving assistance device 100 that provides a driving assistance function to a user.

The vehicle driving assistant device 100 may be installed inside the vehicle 700. Fig. In this case, the installation position of the vehicle driving assistant device 100 can be variously set according to the embodiment. Referring to FIG. 2A, the vehicle driving assistant device 100 is disposed at the lower end of the front window 100 of the vehicle 700.

2B shows a case where a sensor part included in a vehicle driving assist device according to an embodiment of the present invention is disposed in a vehicle.

The distance sensor 150 included in the sensor unit 155 may be disposed at a position of at least one of front, back, right, left, and ceiling of the vehicle body. Referring to FIG. 2B, distance sensors 150b and 150c are disposed on the left side surface and the right side surface of the vehicle, respectively.

The camera 160 included in the sensor unit 155 may be provided at various positions to monitor the front, rear, left, right, and up and down of the traveling direction. Referring to FIG. 2B, cameras 160a, 160d, 160b, 160c, 160f, and 160g are disposed at at least one of the front, rear, left, right, and ceiling of the vehicle.

Specifically, the camera 160 may include an inner camera 160f that captures an image of the front of the vehicle within the vehicle to acquire an image.

The left camera 160b that acquires the left side image of the vehicle may be disposed in a case surrounding the left side mirror. According to the embodiment, the left camera 160b may be disposed outside the case surrounding the left side mirror, or may be disposed in one area outside the left front door, the left rear door, or the left fender.

The right camera 160c for acquiring the right side image of the vehicle can be disposed in the case surrounding the right side mirror. According to the embodiment, the right camera 160c may be disposed outside the case surrounding the right side mirror, or may be disposed in one area outside the right front door, the right rear door, or the right fender.

The front camera 160a can capture the forward image by photographing the forward direction in the traveling direction. To this end, the front camera 160a may be disposed in the vicinity of the ambulance or in the vicinity of the radiator grill.

The rear camera 160d can photograph the rear side in the traveling direction to acquire a rear image. As such, the rear camera 160d may be disposed in the vicinity of a rear license plate or a trunk switch.

Further, the ceiling camera 160e can be disposed on the ceiling of the vehicle and can photograph all the front, back, and left and right directions of the vehicle.

3 is a diagram showing a configuration of a camera included in a vehicle driving assist device according to an embodiment of the present invention.

The camera 160 included in the vehicle driving assistant 100 may be a stereo camera. The stereo camera 160 may include a first camera 160a having a first lens 163a and a second camera 160b having a second lens 163b.

The stereo camera 160 is provided with a first light shield 162a and a second light shield 162b for shielding light incident on the first lens 163a and the second lens 163b, May be provided.

In this case, the vehicle driving assistant device 100 acquires a stereo image of the surroundings of the vehicle from the first and second cameras 160a and 160b, performs disparity detection based on the stereo image, Performs object detection on at least one stereo image based on the information, and can continuously track the movement of the object after object detection.

4 is a block diagram showing a configuration of a processor included in a vehicle driving assist system according to an embodiment of the present invention.

In order to generate image information from the photographed image, the processor 170 may include a plurality of operation blocks for performing image processing and analysis. The processor 170 includes an image preprocessing unit 410, a disparity computing unit 420, a segmentation unit 432, an object detection unit 434, an object verification unit 436, an object tracking unit 440, (450). According to the embodiment, the arrangement of the calculation blocks arranged in FIG. 4 may be changed, whereby the order of operations between the plurality of calculation blocks may be changed.

An image preprocessor 410 may receive an image from the camera 160 and may perform preprocessing on the received image.

In particular, the image preprocessing unit 410 may perform image noise reduction, rectification, calibration, color enhancement, a color space conversion (CSC), an interpolation, a camera 160, a gain control . As a result, a clearer image can be obtained than the stereo image captured by the camera 160.

The disparity calculator 420 receives an image signal processed by the image preprocessing unit 410, performs stereo matching on the received images, and outputs a disparity map according to stereo matching. Can be obtained. For example, the disparity calculating unit 420 may obtain disparity information about a stereo image in front of the vehicle.

In this case, the stereo matching may be performed on a pixel-by-pixel basis or a predetermined block basis of the stereo image. The disparity map may refer to a map in which the binocular parallax information of the stereo image, i.e., left and right images, is numerically expressed.

The segmentation unit 432 may perform segmentation and clustering on at least one of the plurality of images based on the disparity information input from the disparity operation unit 420.

Specifically, the segmentation unit 432 can separate the background and the foreground for any one of the stereo images based on the disparity information.

For example, a segmentation unit 432 can calculate an area having disparity information less than a predetermined value in the disparity map as a background, and exclude the part. Thereby, the foreground can be relatively separated. As another example, an area in which the disparity information is equal to or larger than a predetermined value in the disparity map can be calculated with the foreground, and the corresponding part can be extracted. Thereby, the foreground can be separated.

In this manner, by separating the foreground and the background based on the disparity information extracted based on the stereo image, it becomes possible to shorten the signal processing speed and the signal processing amount in the subsequent object detection.

The object detector 434 can detect the object based on the image segment processed by the segmentation unit 432. [

That is, the object detecting unit 434 can detect an object for at least one of the plurality of images based on the disparity information. For example, an object can be detected from a foreground separated by an image segment.

The object verification unit 436 may classify and identify the separated objects. For this purpose, the object identification unit 436 identifies the object using a neural network identification method, a SVM (Support Vector Machine) method, an AdaBoost identification method using a Haar-like feature, or a Histograms of Oriented Gradients Etc. may be used.

On the other hand, the object checking unit 436 can check the object by comparing the detected object with the objects stored in the memory 140. For example, the object checking unit 436 may determine whether the vehicle is a nearby vehicle, a lane, a road surface, Area, and tunnels.

An object tracking unit 440 may perform tracking on the identified object. For example, the object tracking unit 440 identifies objects in sequentially acquired stereo images, calculates a motion or a motion vector of the identified object, and moves the corresponding object based on the calculated motion or motion vector Can be tracked and monitored. As a result, it is possible to track nearby vehicles, lanes, roads, signs, hazardous areas, tunnels, etc. located in the vicinity of the vehicle.

The application unit 450 can calculate the risk of the vehicle based on various objects located in the vicinity of the vehicle, for example, another vehicle, a lane, a road surface, a sign, and the like. It is also possible to calculate the possibility of a collision with a preceding vehicle, whether the vehicle is slipping or the like.

The application unit 450 may output a message or the like for informing the user of the information on the basis of the computed risk, possibility of collision, sleep or the like as vehicle driving assistance information. Alternatively, a control signal for attitude control or running control of the vehicle may be generated as vehicle control information.

The processor 170 includes an image preprocessing unit 410, a disparity computing unit 420, a segmentation unit 432, an object detection unit 434, an object verification unit 436, an object tracking unit 440) and the application unit 450. [0064] FIG. For example, when the camera 160 is configured as a mono camera 160 or an arousal view camera 160, And may not include the operation unit 420 or the segmentation unit 432. [

5 is a view for explaining an example of a method of detecting image information in an image taken by a camera by a vehicle driving assistant device according to an embodiment of the present invention.

As shown in Fig. 5, the camera 160 acquires the stereo images FR1a and FR1b during the first frame period.

The disparity calculating unit 420 in the processor 170 receives the signal processed stereo images FR1a and FR1b from the image preprocessing unit 410 and performs stereo matching on the received stereo images FR1a and FR1b , And obtains the disparity map 520.

The disparity map 520 is obtained by leveling the parallax between the stereo images FR1a and FR1b. The disparity map 520 is calculated such that the distance from the vehicle is shorter as the disparity level is larger and the distance from the vehicle is greater as the disparity level is smaller .

On the other hand, when such a disparity map is displayed, it may be displayed so as to have a higher luminance as the disparity level becomes larger and a lower luminance as the disparity level becomes smaller.

5, the first to fourth lanes 528a, 528b, 528c, and 528d have corresponding disparity levels in the disparity map 520, The first front vehicle 522, the first front vehicle 524, and the second front vehicle 526 have corresponding disparity levels.

The segmentation unit 432, the object detection unit 434 and the object identification unit 436 are configured to segment the at least one of the stereo images FR1a and FR1b based on the disparity map 520, .

Referring to FIG. 5, an object detection and confirmation operation for the second stereo image FR1b is performed based on the disparity map 520. FIG.

Object detection for the first to fourth lanes 538a, 538b, 538c and 538d in the image 530, the construction area 532, the first front vehicle 534 and the second front vehicle 536, A confirmation operation is performed.

With the image processing as described above, the vehicle driving assistant 100 can acquire various peripheral information of the vehicle, such as what the peripheral object is, and where it is located, through the sensor unit 155 as sensor information.

6 is a view showing an embodiment of a display unit included in a vehicle driving assist apparatus according to an embodiment of the present invention.

The display unit 180 included in the vehicle driving assistance apparatus 100 may include a plurality of display units 180a and 180b. In this case, the plurality of display units 180a and 180b may be disposed in at least one area of the vehicle equipped with the vehicle driving assistant device 100, respectively.

Specifically, the display unit 180 may include a first display unit 180a for projecting and displaying a graphic image on a windshield W of the vehicle. That is, the first display unit 180a may include a projection module for projecting a graphic image on the windshield W as a head up display (HUD). In this case, the projected graphic image projected by the projection module may have a predetermined transparency. Therefore, the user can simultaneously view the image behind the graphic image and the graphic image.

Such a graphic image may overlap with a projection image projected on the windshield W to form an augmented reality (AR).

Meanwhile, the display unit 180 may include a second display unit 180b installed inside the vehicle for displaying an image of the vehicle driving assistance function.

In detail, the second display unit 180b may be a display of the vehicle navigation apparatus or a cluster on the inside of the vehicle interior.

The second display unit 180b may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT) LCD, an organic light-emitting diode (OLED) A flexible display, a three-dimensional display, And an electronic ink display (e-ink display).

The second display unit 180b may be combined with a gesture input unit to configure a touch screen.

7 is a block diagram showing the configuration of a vehicle including a vehicle driving assist system according to an embodiment of the present invention.

The vehicle driving assistant device 100 according to an embodiment of the present invention may be installed in the vehicle 700. [

The vehicle 700 includes a communication unit 710, an input unit 720, a sensing unit 760, an output unit 740, a vehicle driving unit 750, a memory 730, an interface unit 780, a control unit 770, A vehicle driving assistant device 100, and an AVN device 400. [0033]

The communication unit 710 is connected to the communication unit 710 to communicate with the vehicle 700 and the mobile terminal 600, Modules. In addition, the communication unit 710 may include one or more modules that connect the vehicle 700 to one or more networks.

The communication unit 710 may include a broadcast receiving module 711, a wireless Internet module 712, a local area communication module 713, a location information module 714, and an optical communication module 715.

The broadcast receiving module 711 receives broadcast signals or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast includes a radio broadcast or a TV broadcast.

The wireless Internet module 712 refers to a module for wireless Internet access, and may be embedded in the vehicle 700 or externally. The wireless Internet module 712 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA, WiBro World Wide Interoperability for Microwave Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), and Long Term Evolution-Advanced (LTE-A) (712) transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above. For example, the wireless Internet module 712 can exchange data with the external server 500 wirelessly. The wireless Internet module 712 can receive weather information and road traffic situation information (for example, TPEG (Transport Protocol Expert Group)) information from the external server 500. [

The short-range communication module 713 is for short-range communication and may be a Bluetooth ™, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), an Ultra Wideband (UWB) It is possible to support near-field communication using at least one of Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct and Wireless USB (Universal Serial Bus)

The short range communication module 713 may form short range wireless communication networks (Wireless Area Networks) to perform short range communication between the vehicle and at least one external device. For example, the short-range communication module 713 can exchange data with the mobile terminal 600 wirelessly. The short distance communication module 713 can receive weather information and traffic situation information of the road (for example, TPEG (Transport Protocol Expert Group)) from the mobile terminal 600. For example, when a user boarded a vehicle, The user's mobile terminal 600 and the vehicle can perform pairing with each other automatically or by execution of the user's application.

The position information module 714 is a module for acquiring the position of the vehicle, and a representative example thereof is a Global Positioning System (GPS) module. For example, the vehicle 700 can use the GPS module to obtain the position of the vehicle 700 based on the signal sent from the GPS satellite.

The optical communication module 715 may include a light emitting portion and a light receiving portion.

The light receiving section can convert the light signal into an electric signal and receive the information. The light receiving unit may include a photodiode (PD) for receiving light. Photodiodes can convert light into electrical signals. For example, the light receiving section can receive information of the front vehicle through light emitted from the light source included in the front vehicle.

The light emitting unit may include at least one light emitting element for converting an electric signal into an optical signal. Here, the light emitting element is preferably an LED (Light Emitting Diode). The optical transmitter converts the electrical signal into an optical signal and transmits it to the outside. For example, the optical transmitter can emit the optical signal to the outside through the blinking of the light emitting element corresponding to the predetermined frequency. According to an embodiment, the light emitting portion may include a plurality of light emitting element arrays. According to the embodiment, the light emitting portion can be integrated with the lamp provided in the vehicle. For example, the light emitting portion may be at least one of a headlight, a tail light, a brake light, a turn signal lamp, and a car light.

According to one embodiment, the optical communication module 715 can exchange data with another vehicle 510 via optical communication.

The input unit 720 may include a driving operation unit 721, a camera 722, a microphone 723, a user input unit 724, and a monitoring unit 725.

The driving operation means 721 receives a user input for driving the vehicle. The driving operation means 721 may include a steering input means, a shift input means, an acceleration input means, a brake input means, and the like.

The steering input means receives an input for the traveling direction of the vehicle 700. It is preferable that the steering input means is formed in a wheel shape so that steering input can be performed by rotation. According to an embodiment, the steering input means may be formed of a touch screen, a touch pad or a button.

The shift input means receives inputs for parking (P), forward (D), neutral (N) and reverse (R) of the vehicle. The shift input means is preferably formed in a lever shape. According to an embodiment, the shift input means may be formed of a touch screen, a touch pad or a button.

The acceleration input means receives an input for acceleration of the vehicle. The brake input means receives an input for deceleration of the vehicle. In this case, the acceleration input means and the brake input means are preferably formed in a pedal shape. According to an embodiment, the acceleration input means or the brake input means may be formed of a touch screen, a touch pad or a button.

The camera 722 may include an image sensor and an image processing module. The camera 722 may process still images or moving images obtained by an image sensor (e.g., CMOS or CCD). The image processing module may process the still image or moving image obtained through the image sensor to extract necessary information, and may transmit the extracted information to the control unit 770. On the other hand, the vehicle 700 includes a vehicle front image or a vehicle periphery image A camera 722 for photographing, and a monitoring unit 725 for photographing an in-vehicle image.

The monitoring unit 725 may acquire an image of the occupant. The monitoring unit 725 may obtain an image for biometrics of the occupant.

7, the monitoring unit 725 and the camera 722 are included in the input unit 720. However, the camera 722 may be included in the vehicle driving assistant 100 as described above.

The microphone 723 can process an external acoustic signal into electrical data. The processed data can be utilized variously according to functions performed in the vehicle 700. The microphone 723 can convert the voice command of the user into electrical data. The converted electrical data can be transmitted to the control unit 770.

The user input unit 724 can receive information from the user. When information is input through the user input unit 724, the control unit 770 can control the operation of the vehicle 700 to correspond to the input information. The user input unit 724 may include touch input means or mechanical input means. According to an embodiment, the user input 724 may be located in one area of the steering wheel. In this case, the driver can operate the user input portion 724 with his / her finger while holding the steering wheel.

The sensing unit 760 senses a signal related to the running or the like of the vehicle. For this purpose, the sensing unit 760 may include a sensor, a wheel sensor, a speed sensor, a tilt sensor, a weight sensor, a heading sensor, a yaw sensor, a gyro sensor, Position module, vehicle forward / reverse sensor, battery sensor, A fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle internal temperature sensor, a vehicle internal humidity sensor, an ultrasonic sensor, a radar, a rider, and the like.

Thereby, the sensing unit 760 can acquire the vehicle collision information, vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, , Fuel information, tire information, vehicle lamp information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, and the like.

In addition, the sensing unit 760 may include an acceleration pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor AFS, an intake air temperature sensor ATS, a water temperature sensor WTS, A sensor (TPS), a TDC sensor, a crank angle sensor (CAS), and the like.

The sensing unit 760 may include a biometric information sensing unit. The biometric information sensing unit senses and acquires the biometric information of the passenger. The biometric information may include fingerprint information, iris-scan information, retina-scan information, hand geo-metry information, facial recognition information, And may include voice recognition information. The biometric information sensing unit may include a sensor that senses the passenger's biometric information. Here, the monitoring unit 725 and the microphones 723 may operate as sensors. The biometric information sensing unit can acquire the hand shape information and the face recognition information through the monitoring unit 725.

The output unit 740 outputs the information processed by the control unit 770 And may include, as components, a display portion 741, an acoustic output portion 742, and a haptic output portion 743.

The display unit 741 can display information processed in the control unit 770. For example, the display unit 741 can display the vehicle-related information. Here, the vehicle-related information may include vehicle control information for direct control of the vehicle, or vehicle driving assistance information for a driving guide to the vehicle driver. Further, the vehicle-related information may include vehicle state information indicating the current state of the vehicle or vehicle driving information related to the driving of the vehicle.

The display unit 741 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) display, a 3D display, and an e-ink display.

The display unit 741 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. Such a touch screen, May serve as a user input 724 that provides an input interface between the vehicle 700 and the user and may provide an output interface between the vehicle 700 and the user. In this case, the display unit 741 may include a touch sensor that senses a touch with respect to the display unit 741 so that a control command can be received by a touch method. When a touch is made to the display unit 741, the touch sensor senses the touch, and the control unit 770 controls the touch sensor And generate a control command. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.

Meanwhile, the display unit 741 may include a cluster so that the driver can check the vehicle state information or the vehicle driving information while driving. Clusters can be located on the dashboard. In this case, the driver can confirm the information displayed in the cluster while keeping the line of sight ahead of the vehicle.

Meanwhile, according to the embodiment, the display unit 741 may be implemented as a Head Up Display (HUD). When the display unit 741 is implemented as a HUD, information can be output through a transparent display provided in the windshield. Alternatively, the display unit 741 may include a projection module to output information through an image projected on the windshield.

The sound output unit 742 converts an electric signal from the control unit 770 into an audio signal and outputs the audio signal. For this purpose, the sound output unit 742 may include a speaker or the like. The sound output section 742 may output a sound corresponding to the operation input by the user input section 724. [

The haptic output unit 743 generates a tactile output. For example, the haptic output section 743 may vibrate the steering wheel, the seat belt, and the seat so that the user can operate to recognize the output.

The vehicle drive unit 750 can control the operation of various devices and components included in the vehicle 700. [ The vehicle driving unit 750 includes a power source driving unit 751, A brake driver 753, a lamp driver 754, an air conditioning driver 755, a window driver 756, an airbag driver 757, a sunroof driver 758, and a suspension driver 759 have.

The power source driving unit 751 can perform electronic control on the power source in the vehicle 700. [

For example, when a fossil fuel-based engine (not shown) is a power source, the power source drive unit 751 can perform electronic control of the engine. Thus, the output torque of the engine and the like can be controlled. When the power source drive unit 751 is an engine, the speed of the vehicle can be limited by limiting the engine output torque under the control of the control unit 770. [

As another example, when the electric motor (not shown) is a power source, the power source driving unit 751 can perform control on the motor. Thus, the rotation speed, torque, etc. of the motor can be controlled.

The steering driver 752 may perform electronic control of a steering apparatus in the vehicle. Thus, the traveling direction of the vehicle can be changed.

The brake driver 753 can perform electronic control of a brake apparatus (not shown) in the vehicle. For example, it is possible to reduce the speed of the vehicle by controlling the operation of the brakes disposed on the wheels. As another example, it is possible to adjust the traveling direction of the vehicle to the left or right by differently operating the brakes respectively disposed on the left wheel and the right wheel.

The lamp driving unit 754 can control the turn-on / turn-off of the lamp disposed inside and outside the vehicle. Also, the intensity, direction, etc. of the light of the lamp can be controlled. For example, it is possible to perform control on a direction indicating lamp, a brake lamp, and the like.

The air conditioning driving unit 755 can perform electronic control on an air conditioner (not shown) in the vehicle. For example, when the temperature inside the vehicle is high, it is possible to control the air conditioner to operate so that the cool air is supplied to the interior of the vehicle 700.

The window driving unit 756 may perform electronic control of the window apparatus in the vehicle. For example, it may control the opening or closing of left and right windows of side 700 of the vehicle.

The airbag driving unit 757 can perform electronic control of the airbag apparatus in the vehicle. For example, in the event of an accident, the airbag can be controlled to fire.

The sunroof driving unit 758 can perform electronic control of a sunroof device (not shown) in the vehicle. For example, the opening or closing of the sunroof can be controlled.

The suspension driving unit 759 can perform electronic control on a suspension device (not shown) in the vehicle 700. [ For example, when there is a curvature on the road surface, it is possible to control the suspension device so as to reduce the vibration of the vehicle.

The memory 730 is electrically connected to the control unit 770. The memory 770 may store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory 730 may be implemented in hardware such as ROM, RAM, EPROM, Flash drives, hard drives, and the like. The memory 730 includes a program for processing or controlling the control unit 770, Various data for operation can be stored.

The interface unit 780 may serve as a pathway to various kinds of external devices connected to the vehicle 700. For example, the interface unit 780 may include a port that can be connected to the mobile terminal 600, and may be connected to the mobile terminal 600 through the port. In this case, the interface unit 780 can exchange data with the mobile terminal 600.

Meanwhile, the interface unit 780 may serve as a channel for supplying electrical energy to the connected mobile terminal 600. When the mobile terminal 600 is electrically connected to the interface unit 780, the interface unit 780, under the control of the control unit 770, And supplies the electric energy supplied from the power supply unit 790 to the mobile terminal 600.

The control unit 770 can control the overall operation of each component in the vehicle 700. [ The control unit 770 may be referred to as an ECU (Electronic Control Unit).

The control unit 770 can perform a function corresponding to the delivered signal according to the execution signal transmission of the vehicle driving assistant 100. [

The control unit 770 may be implemented in hardware as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) Controllers, micro-controllers, microprocessors, and other electronic units for performing other functions.

The power supply unit 790 can supply power necessary for the operation of each component under the control of the control unit 770. In this case, the power supply unit 790 can receive power from a battery (not shown) or the like inside the vehicle.

The AVN (Audio Video Navigation) device 400 can exchange data with the control unit 770. The control unit 770 can receive navigation information from the AVN apparatus 400 or another navigation apparatus (not shown). Here, the navigation information includes set destination information, route information according to the destination, a map Information or vehicle position information, and the like.

Reminder about intermediate destinations adjacent to the driving route

8 is a flowchart illustrating a process of providing a notification of an intermediate destination by a vehicle driving assistant device according to an embodiment of the present invention.

The vehicle driving assist apparatus 100 according to the embodiment of the present invention can provide a notification of the intermediate destination when recognizing the intermediate destination adjacent to the traveling route during the driving of the vehicle.

Here, the intermediate destination may include a sightseeing, a historical site, a place set by a driver or an occupant, a recommended place, and the like.

Referring to FIG. 8, the vehicle driving assistant device 100 guides the driving route during driving of the vehicle (S801).

The vehicle running can be performed based on the running route generated by the vehicle driving assistant (100). To this end, the processor 170 of the vehicle driving assistant 100 can generate a traveling route based on the set origin and destination. In this case, the traveling route may be the most efficient route from the origin to the destination. efficient In order to generate a traveling route, the processor 170 of the vehicle driving assistant 100 may take into consideration map information and real-time traffic conditions. In the following description, In order to distinguish the destination, the destination is defined as the final destination.

When guiding the driving route, the processor 170 of the vehicle driving assistant device 100 displays a map of a section currently being operated on the screen, and displays a video corresponding to the driving lane, the traffic sign, and the driving information on the map . Also, it is possible to output a voice informing the running information together.

The vehicle driving assistant device 100 recognizes an intermediate destination adjacent to the traveling route (S802).

The processor 170 of the vehicle driving assistant 100 determines whether or not the vehicle is traveling within a predetermined distance from the current traveling route or an intermediate destination that can be reached within a predetermined time based on the information received from the external server 500 and the map of the traveling section . ≪ / RTI > When the intermediate destination is searched, the processor 170 of the vehicle driving assistant device 100 may determine that the intermediate destination adjacent to the traveling route exists.

Depending on the embodiment, the intermediate destinations may be set to various values. E.g, Intermediate destinations may include sightseeing spots, tourist spots, recommended places, places that have previously passed through, and so on.

The vehicle driving assistant provides notification of the intermediate destination (S803).

The notification to the intermediate destination may be provided in various ways. For example, the processor 170 of the vehicle driving assistant device 100 displays a message composed of text or video on the display unit 180, or transmits a message in the form of audio such as voice or sound to the audio output unit 185, As shown in FIG.

FIG. 9 is a view showing an example of a screen displayed on the vehicle driving assist device according to an embodiment of the present invention.

The vehicle driving assistant apparatus 100 according to an embodiment of the present invention can display a screen on which a traveling route is displayed. In this case, on the screen, an identifier for the vehicle, a traveling route indicator, and a description of the traveling route can be displayed together with the traveling route.

Referring to FIG. 9, a map of the current driving area is displayed on the screen, and an identifier 900 and a driving route 905 are displayed on the map.

The present vehicle means a vehicle in which the vehicle driving assistant device 100 is installed. The driver of the subject vehicle can know the current position of the subject vehicle 900 from the identifier 900 for the subject vehicle.

The driving route 905 is a route through which the own vehicle must travel in order to reach the final destination. The driver of the subject vehicle drives the subject vehicle according to the indicated travel route.

An information bar 910 is displayed at the bottom of the screen. The information bar 910 includes a travel route indicator 915 and a description of the travel route.

The travel path indicator 915 And may be an identifier for summarizing and displaying the traveling route 905 as an image. Specifically, when the traveling path 905 is straight, the traveling path indicator 915 is displayed in the form of a straight line arrow, and the traveling path indicator 915, in which the traveling path 905 goes straight after turning right or left, And can be displayed in the form of a bent arrow. In the case of FIG. 9, the traveling path indicator 905 is straight, so that the traveling path indicator 915 is displayed in the form of a straight line arrow.

In addition, referring to FIG. 9, a description of the traveling route is displayed in text form. From this, the driver can see that the distance to the final destination, Mt. Seolak, is 350 km, and that the driver should go straight ahead in the current section.

10A and 10B are views for explaining an example in which a vehicle driving assistant device according to an embodiment of the present invention provides a notification about an intermediate destination.

The vehicle driving assistant device 100 according to an embodiment of the present invention can recognize the intermediate destination that is not set as the final destination by itself and can provide a notification of the intermediate destination. In this case, upon receiving the feedback for the notification, the vehicle driving assistant 100 can provide detailed information about the intermediate destination.

Specifically, when the vehicle driving assistant 100 recognizes the intermediate destination adjacent to the traveling route, it can display the identifier 1010 for the intermediate destination on the map including information on the traveling route.

The identifier 1010 for the intermediate destination may be displayed in a pop-up form. In this case, when the subject vehicle 700 reaches a predetermined distance from the intermediate destination, The auxiliary device 100 begins to display the identifier 1010 for the intermediate destination. When the intermediate destination is out of the map section displayed on the screen, the vehicle driving assistant 100 The identifier 1010 for the intermediate destination may not be displayed on the screen.

Vehicle driving assistance apparatus 100 may determine that it has received the feedback for the notification when receiving the input for selecting the identifier 1010 for the intermediate destination. In this case, the vehicle driving assistant device 100 may communicate with the external server 500 or the like having an authenticated database to obtain detailed information about the intermediate destination.

The input for selecting the identifier 1010 for the intermediate destination may be variously set according to the embodiment. For example, the identifier 1010 for the intermediate destination can be set to long touch, double touch, drag operation, and the like.

FIG. 10A shows a case where notification is provided to an intermediate destination. When the vehicle driving assistant 100 recognizes the intermediate destination adjacent to the traveling route, the vehicle driving assistant 100 displays the identifier 1010 for the intermediate destination and displays information on the intermediate destination in the information bar 910. [ Referring to FIG. 10A, the information bar 910 displays information that a Buddhist temple is located in the vicinity of 25 km and an image of the Buddhist temple. In addition, the information bar 910 displays a guide on how to display detailed information about the intermediate destination.

When the driver touches the identifier 1010 for the intermediate destination based on the guide, the identifier 1010 for the intermediate destination is selected. In this case, the vehicle driving assistant device 100 displays detailed information about the intermediate destination.

FIG. 10B shows a case where detailed information about the intermediate destination is displayed. When the driver selects the identifier 1010 for the intermediate destination, the vehicle driving assistant 100 may provide detailed information about the intermediate destination.

Detailed information about intermediate destinations can be provided in a variety of ways. Specifically, the detailed information on the intermediate destination may be displayed in a text message on the information bar 910, or may be displayed on the audio output unit 185 provided in the vehicle driving assistance apparatus 100 or on a microphone 723, an audio output unit 742, . ≪ / RTI >

In the information bar 910, an identifier 1020 for audio output may be displayed. When the identifier 1020 for audio output is selected, the vehicle driving assistant 100 may output detailed information about the intermediate destination in audio form. Thereby, the driver can easily obtain the detailed information about the intermediate destination under the driving environment having the field of view limited to the running ahead.

Referring to FIG. 10B, the information bar 910 disposed at the lower end of the screen displays detailed information on the intermediate destination. When the driver selects the identifier 1020 for the audio output displayed in the information bar 910, detailed information on the intermediate destination is output in audio form.

In the past, when there is a place (i.e., a middle destination) that is not set as a final destination near the traveling path of the vehicle 700, the vehicle driving assistant 100 may display the name of the corresponding intermediate destination, Only information. If the driver wishes to obtain detailed information about the intermediate destination, additional retrieval must be performed, which is cumbersome and difficult task in a driving environment .

When recognizing an intermediate destination which is adjacent to the traveling route, the vehicle driving assistant device 100 automatically informs the corresponding intermediate destination and provides detailed information on the intermediate destination. Thus, even under a driving environment in which the visual field and the hand gesture are limited, the driver can quickly recognize the intermediate destination that appears unexpectedly while driving and can easily acquire detailed information on the intermediate destination.

Reset route to intermediate destination

11 is a diagram illustrating a process of resetting a driving route by a driving assist system according to an embodiment of the present invention.

When recognizing an intermediate destination adjacent to the traveling route, the vehicle driving assist device 100 according to an embodiment of the present invention may reset the traveling route or change the traveling route to the existing traveling route Lt; / RTI >

Specifically, when the vehicle driving assistant device 100 receives the input for setting the traveling to the intermediate destination, it can reset the traveling route based on the current position and the intermediate destination. On the other hand, if the input to set the traveling to the intermediate destination is not received, the vehicle driving assistant device 100 can maintain the existing traveling route.

As shown in Fig. 11, the vehicle driving assistant device 100 guides the traveling path while the vehicle is running (S1101).

Upon recognizing the intermediate destination adjacent to the driving route during driving, the processor 170 of the vehicle driving assistant 100 provides the notification of the intermediate destination and the detailed information about the intermediate destination. This has been described in detail with reference to Figs. 8 to 10B, and a description thereof will be omitted.

The driving assistance apparatus 100 determines whether it receives an input for setting a driving to an intermediate destination (S1102).

If the input to set the traveling to the intermediate destination is received (S1102 - YES), the vehicle driving assist system 100 resets the traveling route based on the current position and the intermediate destination (S1103).

Here, the reset travel route may be an efficient route from the current location to the intermediate destination.

The vehicle driving assistant 100 guides the reset travel route (S1104).

On the other hand, if it is determined in step S1102 that the input for setting the traveling to the intermediate destination is not received (S1102-No), the vehicle driving assistant device 100 continues to guide the existing traveling route (S1114). In this case, the processor 170 of the vehicle driving assistant device 100 determines that the user is not interested in the intermediate destination, and does not change the traveling route.

12A and 12B are diagrams for explaining an example in which a vehicle driving assist system according to an embodiment of the present invention reestablishes a traveling route based on an intermediate destination.

The vehicle driving assist device 100 according to the embodiment of the present invention can reset the traveling route based on the current position and the intermediate destination when receiving the input for setting the traveling to the intermediate destination. In this case, the vehicle driving assistant 100 can guide the reset travel route.

The processor 170 of the vehicle driving assistant 100 recognizes the request 1200 for the route setting to the intermediate destination, the approval indicator 1210 and the rejection indicator 1220 to the information bar 910). In this case, when the approval indicator 1210 is selected, The processor 170 of the vehicle driving assistant 100 can determine that the input for setting the traveling to the intermediate destination is received.

The operation of selecting the approval indicator 1210 may be variously set according to the embodiment. For example, if the approval indicator 1210 is tapped, long-touched, pressure-touched, etc. And may be set by touching or dragging in various ways.

The processor 170 of the vehicle driving assistant 100 can display the travel route reset on the map displayed on the screen. In this case, the reset travel route Can be displayed together with the travel route. The existing traveling route and the reset traveling route can be displayed in different ways so that the traveling routes before and after the change can be distinguished from each other. According to one embodiment, the existing travel route is indicated by a solid line, and the reset travel route may be indicated by a dotted line.

In this case, the processor 170 of the vehicle driving assistant 100 may provide a guide for the reset travel route. The guide for the reset travel path can be displayed in the information bar 910 arranged at the bottom of the screen.

Fig. 12A shows a case in which the running to the intermediate destination is set. Referring to FIG. 12A, an identifier 1010 for the intermediate destination is displayed on the map displayed on the screen. In the information bar 910 arranged at the bottom of the screen, detailed information on the intermediate destination is displayed, A request 1200 for setting a travel route to a destination and an approval indicator 1210 and a reject indicator 1220 are displayed.

In this state, the approval indicator 1210 is selected by the operation of the user who touches the approval indicator 1210. [ Thereby, traveling to the intermediate destination is set.

FIG. 12B shows a case where the reset travel route is guided. Referring to FIG. 12B, an existing traveling route 905 and a reset traveling route 1205 are displayed together on a map on the screen. In this case, the existing traveling route 905 is shown by a solid line, The traveling path 1205 is shown by a dotted line.

A guide for the reset travel path is displayed in the information bar 910 arranged at the lower end of the screen. Specifically, the information bar 910 displays a driving method for arriving at an intermediate destination. Referring to FIG. 12B, in order to go to the Buddhist temple, which is the intermediate destination, the vehicle must make a right turn before 18 Km.

In this case, since the right turn must be made while the vehicle is traveling, the travel path indicator 915 indicating the right turn is displayed on the left side of the information bar 910.

13A and 13B are views for explaining an example in which a vehicle driving assistant apparatus according to an embodiment of the present invention maintains an existing route irrespective of an intermediate destination.

The vehicle driving assist apparatus 100 according to an embodiment of the present invention can maintain the existing traveling route without changing the traveling route when the input for setting the traveling to the intermediate destination is not received. In this case, the vehicle driving assistant 100 can continue to guide the existing driving route.

The processor 170 of the vehicle driving assistant 100 can determine that the rejection indicator 1220 has been selected and does not receive the input for setting the traveling to the intermediate destination.

The operation of selecting the rejection indicator 1220 can be variously set according to the embodiment. For example, the rejection indicator 1220 can be set to be a touching operation, a dragging operation, or the like by various methods such as tapping, long touching, pressure touching, and the like.

In this case, the processor 170 of the vehicle driving assistant 100 can provide a guide for an existing driving route. The guide for the existing traveling route can be displayed on the information bar 910 arranged at the bottom of the screen.

FIG. 13A shows a case in which the running to the intermediate destination is not set. Referring to FIG. 13A, an identifier 1010 for the intermediate destination is displayed on the map displayed on the screen. In the information bar 910 arranged at the bottom of the screen, a request 1200 for setting a traveling route to the intermediate destination and an approval indicator 1210 and a rejection indicator 1220 are displayed together with detailed information on the intermediate destination.

In this state, the rejection indicator 1220 is selected by the action of the user who touches the rejection indicator 1220. [ Thereby, the traveling to the intermediate destination is not set and the existing traveling route is maintained.

FIG. 13B shows a case where the existing traveling route is guided. Referring to FIG. 13B, only the existing travel route 905 is displayed on the map on the screen. In this case, the existing traveling path 905 is shown by a solid line.

In the information bar 910 arranged at the lower end of the screen, a guide for the existing traveling route is displayed. More specifically, the information bar 910 displays a driving method for arriving at a final destination. Referring to FIG. 13B, in order to go to the final destination, Seoraksan, the vehicle 700 must continue straight ahead. In addition, the distance to the final destination is 335 km.

In this case, since the straight ahead must be continued, the travel path indicator 915 indicating the straight ahead is displayed on the left side of the information bar 910.

Generally, the vehicle driving assistant device 100 resets the traveling route when the existing final destination is changed to the intermediate destination, and does not reset the traveling route without changing the destination. Therefore, in the case where an intermediate destination is encountered unexpectedly while driving, a driver who is restricted in the visual field and the hand operation can not set the driving to the intermediate destination because the change to the intermediate destination is difficult, and thereby the intermediate destination is bypassed.

The vehicle driving assistant apparatus 100 according to an embodiment of the present invention displays a user interface capable of changing the traveling route to the intermediate destination when recognizing the intermediate destination adjacent to the traveling route, Thereby resetting the traveling route to the intermediate destination.

According to this, even in a driving environment in which the visual field and the hand movement are limited, It is possible to easily set the traveling route to the intermediate destination that appears unexpectedly while driving.

14A to 14C are views for explaining another example in which the vehicle driving assistant apparatus according to the embodiment of the present invention maintains the existing route regardless of the intermediate destination.

The vehicle driving assist apparatus 100 according to an embodiment of the present invention can maintain the existing traveling route without changing the traveling route when the input for selecting the identifier for the intermediate destination is not received. In this case, the vehicle driving assistant 100 can continue to guide the existing driving route.

Specifically, if the input for selecting the identifier for the intermediate destination is not received, the vehicle driving assistant 100 does not provide detailed information about the intermediate destination Do not. In this case, the vehicle driving assistant device 100 judges that the driver is not interested in the intermediate destination and can maintain the existing traveling route without changing the traveling route have.

The processor 170 of the vehicle driving assistance apparatus 100 can provide a guide for an existing traveling route. The guide for the existing traveling route can be displayed on the information bar 910 arranged at the bottom of the screen.

In the case where the vehicle travels along the existing traveling route and crosses the intermediate destination, the size of the identifier for the incremental destination may be reduced corresponding to the distance from the intermediate destination.

14A is a case in which the identifier for the intermediate destination is not selected. 14A, identifiers 1010 and 1410 for a plurality of intermediate destinations are displayed on a map displayed on the screen. In this case, the vehicle driving assistant device 100 may omit the notification of the already-excessive first intermediate destination and provide notification of the second intermediate destination located within a predetermined distance in the traveling direction.

An information bar 910 arranged at the bottom of the screen displays a notification for the intermediate destination and a method for displaying detailed information about the intermediate destination. Referring to this, in order to display detailed information on the second intermediate destination, An identifier 1410 for the intermediate destination should be touched. However, there is currently no action to select the identifier 1410 for the second intermediate destination.

Figs. 14B and 14C illustrate a case where the existing traveling route is guided. If the identifier 1410 for the second intermediate destination is not selected, the processor 170 of the vehicle driving assistant 100 regards the driver as not interested in the second intermediate destination and maintains the existing driving route . Referring to FIG. 14B, an existing travel route 905 is displayed on a map on the screen. In the information bar 910 arranged at the lower end of the screen, a guide for the existing traveling route is displayed. Specifically, the information bar 910 displays the distance to the final destination and the final destination. In this case, since the straight ahead must be continued, the travel path indicator 915 indicating the straight ahead is displayed on the left side of the information bar 910.

On the other hand, as shown in Fig. 14C, when the vehicle 700 crosses the second intermediate destination, the size of the identifier 1410 for the second intermediate destination may decrease gradually.

Create a driving group to the same destination

FIG. 15 is a diagram illustrating a process of generating a same driving group by a driving assistance device according to an embodiment of the present invention.

The vehicle driving assistant device 100 according to the embodiment of the present invention can create the same traveling group to the same destination. In this case, the traveling route information can be exchanged and synchronized among the vehicles belonging to the same traveling group.

The traveling route information may include information such as a traveling route that is currently being traveled, a travel route that has been changed or reset, and a destination or a location included in the travel route.

The vehicle driving assistant 100 starts the same traveling group creating process (S1501).

In this case, the vehicle driving assistant device 100 can perform the role of a master in creating the same traveling group.

Other vehicle information constituting the same driving group is input to the vehicle driving assistant device 100 (S1502).

The other vehicle information may be unique information capable of identifying the other vehicle. According to one embodiment, the other vehicle information may be a unique GPS ID (GPS Unique ID) assigned to another vehicle.

The vehicle driving assistant 100 notifies corresponding corresponding other vehicles to the same driving group (S1503).

Specifically, the vehicle driving assistant device 100 can notify that the vehicles corresponding to the inputted other vehicle information, that is, the first and second vehicles 510a and 510b, are created as the same traveling group.

The other vehicles 510a and 510b approve or reject the generation to the same driving group (S1504).

The vehicle driving assistant 100 generates the same traveling group composed of the other approved vehicles (S1505).

In this case, the vehicle driving assistant apparatus 100 includes only the other vehicles 510a and 510b that have approved generation of the same traveling group, except for the other vehicles 510a and 510b that have rejected the generation of the same traveling group Create the same driving group.

The vehicle driving assistant device 100 and the other vehicles 510a and 510b exchange the traveling route information between the same traveling groups (S1506).

Thereby, the traveling route can be synchronized between the same traveling group. Specifically, when the other vehicles 510a and 510b approve the synchronization of the traveling route, the vehicle driving assistant 100 transmits the traveling route of the child vehicle 700 to the other vehicles 510a and 510b belonging to the same traveling group Share. In this case, the other vehicles 510a and 510b start to travel in accordance with the traveling route of the vehicle driving assistant 100. [

Creation of the same driving group

16A and 16B are views for explaining a method of generating the same driving group by the vehicle driving assistant device according to the embodiment of the present invention.

16A and 16B, it is assumed that the same driving group is generated by inputting the other vehicle information, that is, the first vehicle 510a information and the second vehicle 510b information to the vehicle driving assistant 100 .

The vehicle driving assistant device 100 can generate the same traveling group based on the inputted other-vehicle information. The other vehicle information may be a unique GPS ID (GPS Unique ID) assigned to another vehicle.

The vehicle driving assistant apparatus 100 can communicate with the vehicles within a predetermined distance to search for the other vehicles 510a and 510b corresponding to the inputted unique GPS ID (GPS Unique ID).

16A shows a case in which information of the first train 510a is input. Referring to Fig. 16A, a screen of the vehicle driving assistant apparatus 100 for creating the same traveling group is shown. In this case, in the lower right block 1610 of the screen, The GPS Unique ID KR2367 of the auxiliary device 100 is displayed.

The vehicle driving assistant 100 is input with the GPS Unique ID KR 4567 of the first vehicle 510a. When the GPS Unique ID KR 4567 is input, the vehicle driving assistant 100 searches for the first train 510a having the KR 4567 as the GPS Unique ID.

An identifier indicating vehicles belonging to the same travel group is displayed at the bottom center of the screen. Therefore, an identifier 1640a indicating the first vehicle 510a together with the identifier 1630 corresponding to the vehicle driving assistant 100 is displayed.

16B shows a case in which information of the second train 510b is additionally inputted in the state of FIG. 16A.

The vehicle driving assistant device 100 is additionally provided with a GPS Unique ID KR 1123 of the second vehicle 510b. When the KR1123 as the GPS Unique ID is input, the vehicle driving assistant 100 searches for the second vehicle 510b having the KR1123 as the GPS Unique ID.

In this case, an identifier indicating vehicles belonging to the same travel group is displayed at the bottom center of the screen. The identifier 1640b indicating the second vehicle 510b is displayed along with the identifier 1630 corresponding to the vehicle driving assistant 100 and the identifier 1640a indicating the first vehicle 510a.

Synchronize the driving route between the driving groups

17 is a view for explaining a method in which a vehicle driving assist system according to an embodiment of the present invention shares a traveling route among the same traveling groups.

The vehicle driving assistant apparatus 100 according to an embodiment of the present invention can share the traveling route between the same traveling groups. Specifically, the vehicle driving assist system 100 can share its traveling route with other vehicles belonging to the same traveling group.

To this end, the vehicle driving assistant device 100 may display an inquiry 1700 and an approval indicator 1710 and a rejection indicator 1720 on the information bar 910 as to whether or not to share the traveling route. When the approval indicator 1710 is selected, sharing of the traveling route is notified to all the other vehicles 510a and 510b in the same traveling group.

Referring to Fig. 17, the approval indicator 1710 is selected by the driver. In this case, the vehicle driving assistant apparatus 100 may include other vehicles 510a, 510b to communicate with their other vehicles 510a, 510b in order to share their own driving route.

18A and 18B are views for explaining a method for allowing other vehicles belonging to the same driving group generated by the vehicle driving assist device to share the traveling route according to an embodiment of the present invention.

The other vehicles 510a and 510b belonging to the same driving group generated by the vehicle driving assistant 100 can approve or reject the sharing of the driving route requested by the vehicle driving assistant 100. [

When the sharing of the traveling route is approved, the corresponding other vehicle (510a, 510b) and the vehicle driving The auxiliary device 100 may share the traveling route. Specifically, the vehicle driving assistant apparatus 100 notifies the other vehicles 510a and 510b of its traveling path and the other vehicles 510a and 510b travel on the same route as the traveling path of the vehicle driving assistant 100 .

When the sharing of the traveling route is rejected, the other vehicles 510a and 510b can continue to travel on the existing traveling route. In this case, the vehicle driving assist system 100 does not notify the other vehicles 510a and 510b of the traveling route of the vehicle.

The other vehicles 510a and 510b display an inquiry 1800 and an approval indicator 1810 and a rejection indicator 1820 on the information bar 910 as to whether or not to share the traveling route. When the approval indicator 1810 is selected, the other vehicles 510a and 510b share the traveling route of the vehicle driving assistant 100. [

18A shows a screen of the first rider 510a. Referring to FIG. 18A, a GPS Unique ID of the first target 510a is displayed in the lower right block 1610 of the screen KR4567 is displayed. On the map displayed on the screen, an identifier 1640a indicating a first vehicle 510a and a traveling route 905 are displayed.

In the information bar 910 located at the lower end of the screen, an identifier 1630 indicating the vehicle driving assistant 100 and a description of the traveling route of the vehicle driving assistant 100 are displayed. Referring to FIG. 18A, the current driving assistance apparatus 100 The Buddhist temple is located within 60Km.

In addition, an inquiry 1800 and an approval indicator 1810 and a rejection indicator 1820 are displayed in the information bar 910 to confirm whether or not to synchronize the traveling route. Referring to FIG. 18A, the approval indicator 1810 is selected by the driver. In this case, the other vehicle 510a synchronizes the driving route with the driving assist system 100, and starts to travel in accordance with the driving route set in the driving driving assist device 100.

18B shows a screen of the second rider 510b. Referring to FIG. 18B, the GPS Unique ID KR1123 of the second target 510b is displayed in the lower right block 1610 of the screen. On the map displayed on the screen, The travel route 905 in which the identifier 1640b and the second vehicle 510b are currently running is displayed.

The information bar 910 located at the lower end of the screen displays an identifier 1630 indicating the vehicle driving assistant device 100 and an identifier 1630 indicating the traveling route of the vehicle driving assistant 100 A description is displayed. Referring to FIG. 18B, the vehicle driving assistant device 100 is currently traveling toward the Buddhist temple, and the Buddhist temple is located within 60 Km.

In addition, an inquiry 1800 and an approval indicator 1810 and a rejection indicator 1820 are displayed on the information bar 910 as to whether or not to share the traveling route. 18B, the approval indicator 1810 is selected by the driver. In this case, the other vehicle 510a synchronizes the driving route with the driving assist system 100, and starts to travel in accordance with the driving route set in the driving driving assist device 100.

19A to 19C are views for explaining a method of sharing a traveling route between the same traveling groups generated by the vehicle driving assist device according to the embodiment of the present invention.

It is possible to display on the screen of the vehicle driving assistant apparatus 100 which has created the same traveling group whether or not the other vehicles 510a and 510b requested to share the traveling route from the vehicle driving assistant apparatus 100 have approved the request have.

In the information bar 910 at the bottom of the screen, an inquiry 1920 about whether or not to set an intermediate destination for all the vehicles, an approval indicator 1930 and a rejection indicator 1940 are displayed.

19A shows a screen of the vehicle driving assistant device 100. Fig. Referring to FIG. 19A, the GPS Unique ID KR2367 of the vehicle driving assistant 100 is displayed in the lower right block 1610 of the screen. On the map displayed on the screen, an identifier 1630 indicating a vehicle driving assistant device 100 and a travel route 905 are displayed.

In the information bar 910, it is displayed whether or not the other vehicles 510a and 510b requested to share the traveling route have approved the request. Referring to FIG. 19A, whether or not the identifiers 1640a and 1640b indicating the other vehicles 510a and 510b are checked is displayed.

In this case, the information bar 910 at the bottom of the screen displays an inquiry 1920, an approval indicator 1930, and a rejection indicator 1940 as to whether or not to set an intermediate destination for all the vehicles.

In this state, the driver of the vehicle driving assistant 100 selects the approval indicator 1930. [ Thereby, the adjacent intermediate destination is set as the intermediate destination for all the vehicles.

FIG. 19B shows a screen when an intermediate destination for all the vehicles is set in FIG. 19A. When an intermediate destination for all vehicles is set, the travel route is changed. Specifically, the driving route of the vehicle driving assistant device 100 is changed to a new route from the existing route to the intermediate destination.

In this case, the vehicle driving assistant 100 can display the existing route and the new route so that they can be distinguished from each other. Referring to FIG. 19B, the existing path 905 includes a dotted line And a new path 1950 toward the intermediate destination 1010 is displayed in the form of a thick solid line.

In this case, the information bar 910 at the bottom of the screen displays information that an intermediate destination for all the vehicles has been set and information on how to drive the new route. In addition, an identifier 915 indicating the traveling method is displayed. To go to the Buddhist temple, which is the intermediate destination, the user must make a right turn at a distance of 18 Km. Therefore, the identifier 915 indicating the running method is displayed in the form of an arrow pointing in the right direction.

FIG. 19C shows a screen of another vehicle in which the traveling route is shared. Other vehicles It is possible to synchronize the driving route of the vehicle driving assist device 100 with the driving route of the vehicle driving assist device 100. As a result, the other vehicle starts to travel on the traveling route of the vehicle driving assistant device 100.

In this case, if the driving route of the vehicle driving assistant 100 is changed to the traveling route toward the intermediate destination, the other vehicle can track the changed traveling route.

Specifically, FIG. 19C shows a screen of the first rider 510a. Referring to FIG. 19C, the GPS Unique ID KR4567 of the first target 510a is displayed in the lower right block 1610 of the screen. On the map displayed on the screen, an identifier 1640a indicating a first vehicle 510a and a traveling route 905 are displayed.

In this case, the first vehicle 510a displays the existing traveling route and the new traveling route, and can display them in different ways so that they can be distinguished from each other. Referring to FIG. 19C, the existing path 905 is shown in dashed line and the new path 1950 is shown in bold solid line.

In this case, the information bar 910 at the bottom of the screen displays information that the Buddhist temple is set as the intermediate destination.

Generally, several vehicles on which a friend or family member ride tend to travel together to the same destination. In this case, it is not easy to synchronize the changed travel route between a plurality of vehicles, if any one of the vehicles is to change the destination during traveling or to go through another intermediate destination.

According to the embodiment of the present invention, it is possible to easily set and synchronize a traveling route to an intermediate destination that is unexpectedly excessive during traveling among vehicles belonging to the same traveling group by creating the same traveling group among a plurality of vehicles.

The features, structures, effects and the like described in the foregoing embodiments are included in at least one embodiment of the present invention and are not necessarily limited to one embodiment. Further, the features, structures, effects, and the like illustrated in the embodiments may be combined or modified in other embodiments by those skilled in the art to which the embodiments belong. It is possible. Therefore, it should be understood that the present invention is not limited to these combinations and modifications.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the present invention. It can be seen that various modifications and applications are possible. For example, each component specifically shown in the embodiments may be modified and implemented. It is to be understood that the present invention may be embodied in many other specific forms without departing from the spirit or essential characteristics thereof.

100: vehicle driving assistant 110: input
120: communication unit 130: interface unit
140: memory 155:
165: monitoring unit 170: processor
180: display unit 185: audio output unit
190: Power supply

Claims (9)

A vehicle driving assist system,
A communication unit for acquiring the position of the vehicle in real time;
A display unit for displaying a screen related to driving of the vehicle; And
Wherein the control unit provides a notification of the predetermined place when recognizing that the predetermined place is located within a predetermined distance from the position of the vehicle based on the position of the vehicle and the traveling path of the vehicle, And a processor for controlling the display unit to reset the traveling route so as to face a predetermined location and to display the reset traveling route together with the existing traveling route,
The processor comprising:
An identifier indicating the predetermined place is generated and displayed at a corresponding position on the screen when notifying the predetermined place,
And controlling the display unit to display the reduced size of the identifier corresponding to the distance between the vehicle and the predetermined place when the vehicle passes the predetermined place without receiving an input for selecting the predetermined place, Device. delete The method according to claim 1,
The processor comprising:
And determines that an input for selecting the predetermined place is received when the touch input for the identifier indicating the predetermined place is received. The method according to claim 1,
The predetermined place may be,
A driving point, a sightseeing spot, a historical site, a recommended place, and a predetermined place. delete The method according to claim 1,
The processor comprising:
And displays detailed information on the predetermined place on the display unit upon receiving an input for selecting the predetermined place. The method according to claim 1,
The processor comprising:
Wherein at least one other vehicle and the same traveling group are created, and the at least one other vehicle included in the same traveling group shares the reset traveling route. The method according to claim 1,
Further comprising an audio output section for outputting audio,
The processor comprising:
And generating the audio informing the predetermined place when the notification is provided to the predetermined place, and outputting the audio through the audio output unit. In a vehicle including a vehicle driving assist device,
A communication unit for acquiring the position of the vehicle in real time;
A display unit for displaying a screen related to driving of the vehicle; And
When receiving a position of the vehicle by communicating with the communication unit and recognizing that the predetermined place is located within a predetermined distance from the position of the vehicle based on the position of the vehicle and the traveling route of the vehicle, And a vehicle driving assist device for reestablishing the traveling route so as to face the predetermined location upon receipt of an input for selecting the predetermined location and displaying the reset traveling route along with the existing traveling route through the display unit ,
The vehicle driving assist system (100)
An identifier indicating the predetermined place is generated and displayed at a corresponding position on the screen when notifying the predetermined place,
And controls the display unit to display the reduced size of the identifier corresponding to the distance between the vehicle and the predetermined place when the vehicle passes the predetermined place without receiving an input for selecting the predetermined place.

Images