KR102235474B1 - Navigation device and vehicle navigation system including the same - Google Patents

Abstract

A navigation device according to an embodiment includes a communication unit configured to receive driving information of a vehicle from an external server, and transmit a driving image of the vehicle captured by at least one camera installed in the vehicle to an external terminal; a display unit for displaying driving route information and the driving image for guiding the vehicle to a destination on the basis of the driving image; and a control unit in which driving assistance information transmitted by the external terminal for the driving image transmitted to the external terminal is received through the communication unit, and the driving assistance information is displayed on the display unit with the driving image.

Description

Navigation device and vehicle navigation system including the same}

The present invention relates to a navigation device and a method for guiding the navigation device, and more specifically, a navigation device installed in a vehicle by sharing information about a vehicle currently running with an external terminal, and using information and images transmitted from the external terminal. It is an invention related to a technology that informs the user of driving information along with.

The navigation device displays the current location of a moving object such as a vehicle on a map by using a GPS signal received from a Global Positioning System (GPS). These navigation devices are currently mounted on various moving objects such as ships, aircraft, vehicles, and the like, and are widely used to check the current position and moving speed of the moving object or to determine a moving path.

In general, a navigation device used in a vehicle searches for a driving route to a destination using map information when a user inputs a destination, and guides the vehicle to a driving route selected by the user. In addition, the navigation device provides a guide guide through which the user can arrive to the destination by visually or aurally providing various information such as a driving route to a destination, a terrain feature located around a driving route, and a road congestion degree.

On the other hand, if a guide guide provided by a navigation device is used, it is often impossible to find an exact route to go or get lost. In particular, in complex alleys, it may be difficult to accurately determine whether you need to make a turn in this alley or the next alley only with the provided guide. Accordingly, the driver stops the vehicle for a while and compares the actual location with the map provided by the navigation device, or receives an explanation of the route to the destination through a call connection with an acquaintance at the destination. There are a lot of problems, such as not being able to or causing traffic jams.

A navigation device according to an embodiment and a navigation system including the same share driving information of a vehicle and a front image of the vehicle to an external user, thereby receiving more accurate guidance of a driving route from an external user who knows the route to a destination. As a result, the purpose is to improve the reliability of the navigation device.

According to an embodiment, the navigation device receives driving information of a vehicle from an external server and transmits a driving image of the vehicle captured through at least one camera installed in the vehicle to an external terminal, and transmits the driving information. Based on the driving route information for guiding the vehicle to a destination, a display unit for displaying the driving image, and driving assistance information transmitted by the external terminal for the driving image transmitted to the external terminal through the communication unit, And a controller that displays the driving assistance information together with the driving image on the display unit.

The auxiliary information may include display information input by a user of the external terminal for the driving image displayed on the external terminal.

The control unit may display the display information on the display unit by overlapping the driving image displayed on the display unit.

The control unit may transform the display information into arrows or characters and display them on the display unit.

When the driving assistance information is audio information, the control unit may output the audio information through a speaker.

The communication unit transmits the driving route information to the external terminal, and the control unit displays the display information input from the user of the external terminal for the driving route information displayed on the external terminal. Can be displayed with route information.

The communication unit may transmit input information input by a driver of the vehicle to the driving image displayed on the display unit to the external terminal.

When the external terminal and the communication unit are connected, the control unit may simultaneously display a driving image of the vehicle transmitted to the external terminal by the communication unit on the display unit.

A navigation system according to an embodiment includes a camera disposed on at least one of a front and a side of a vehicle to acquire a driving image of the vehicle, receiving driving information of the vehicle from an external server, and at least one camera installed on the vehicle. A communication unit that transmits the driving image of the vehicle captured through to an external terminal, driving route information for guiding the vehicle to a destination based on the driving information, and a display unit that displays the driving image, and the transmission to the external terminal. And a controller configured to receive driving assistance information transmitted by the external terminal for a driving image through the communication unit, and to display the driving assistance information together with the driving image on the display unit.

The driving assistance information includes display information input by a user of the external terminal for the driving image displayed on the external terminal, and the control unit overlaps the display information on the driving image displayed on the display unit ( Overlap) can be displayed on the display unit in a way.

In addition, in the navigation device and the navigation system including the same according to an embodiment, the navigation device and the terminal of the external user can receive a guide guide for the driving route from the external user while viewing the same driving image. There is an effect of reducing the gap between destinations and improving the reliability of a navigation device.

In addition, the navigation device and the navigation system including the same according to an embodiment can receive voice information or input information of another person who knows the route to the destination well when the driver drives to the destination. There is an advantage of being able to safely drive to the destination.

1 is a diagram illustrating a relationship between a navigation device and an external terminal.
2 is a block diagram showing some components of a navigation device according to an embodiment.
3A and 3C are views for explaining a location at which a camera can be mounted on a vehicle and components of a camera according to an exemplary embodiment.
4A to 4D are diagrams for describing an operation in which a navigation device and an external terminal are connected to each other for communication, according to an exemplary embodiment.
5A to 5D are diagrams for explaining an operation of sharing driving image information according to another exemplary embodiment.
6A and 6B are diagrams for explaining an operation of performing live streaming according to another embodiment.
7A to 7C are diagrams for explaining an operation of sharing driving assistance information according to another exemplary embodiment.
8 is a flowchart illustrating a control operation of a navigation device according to an exemplary embodiment.

Hereinafter, embodiments according to the present invention will be described with reference to the accompanying drawings. In adding reference numerals to elements of each drawing, it should be noted that the same elements are assigned the same numerals as possible even if they are indicated on different drawings. In addition, in describing an embodiment of the present invention, when it is determined that a detailed description of a related known configuration or function interferes with an understanding of an embodiment of the present invention, the detailed description thereof will be omitted. In addition, embodiments of the present invention will be described below, but the technical idea of the present invention is not limited or limited thereto, and may be modified and variously implemented by those skilled in the art.

In addition, terms used in the present specification are used to describe embodiments, and are not intended to limit and/or limit the disclosed invention. Singular expressions include plural expressions unless the context clearly indicates otherwise.

In the present specification, terms such as "comprise", "include" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or a combination thereof described in the specification. It does not preclude the possibility of the presence or addition of other features, numbers, steps, actions, components, parts, or combinations thereof beyond that.

In addition, throughout the specification, when a part is said to be "connected" with another part, it is not only "directly connected", but also "indirectly connected" with another element interposed therebetween. Includes, and terms including ordinal numbers such as “first” and “second” used herein may be used to describe various constituent elements, but the constituent elements are not limited by the terms.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present invention. In the drawings, parts not related to the description are omitted in order to clearly describe the present invention.

1 is a diagram illustrating a relationship between a navigation device and an external terminal.

Referring to FIG. 1, the navigation device 1 may provide a guide guide to a driver by providing a steering wheel 2 inside a vehicle 5 (refer to FIG. 3A) and a nearby position. As illustrated in FIG. 1, the navigation device 1 may display map information on a screen. In particular, the map information displayed by the navigation device 1 may display not only the surrounding terrain and roads, but also driving information of a vehicle or a vehicle received from an external server. For example, the navigation device may display the driving speed (46 km/h) of the vehicle 5. In addition, the navigation device 1 may guide a driving route to a destination, and may display the distance to the turn point (550m) or TBT (Turn By Turn, U-turn information) in combination with map information.

Meanwhile, the navigation device 1 may communicate with the external terminal 10. The external terminal 10 may be implemented as a computer or a portable terminal capable of accessing the navigation device 1 through a network. Here, the computer includes, for example, a notebook equipped with a web browser, a desktop, a laptop, a tablet PC, a slate PC, and the like, and the portable terminal has, for example, portability and mobility. As a guaranteed wireless communication device, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), WiBro (Wireless Broadband Internet) terminal, Smart Phone, etc. And a wearable device such as a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted-device (HMD).

FIG. 2 is a block diagram showing some components of a navigation device according to an exemplary embodiment, and FIGS. 3A and 3C are diagrams for explaining locations where a camera can be mounted on a vehicle and components of the camera according to an exemplary embodiment. It is a drawing.

Referring to FIG. 2, the navigation device 1 includes a sensor unit 20 that recognizes a user's voice, an external terminal 10, and an external server (not shown), and a communication unit 30 capable of transmitting and receiving various information. , Information on the driving route guiding the vehicle to the input destination, the driving image of the vehicle photographed by the camera 40, information received from the external terminal 10, and a display unit that outputs various user interfaces to the outside ( 50), a guide guide required for the driving route, a speaker 60 that outputs the user's voice information received from the external terminal 10 as sound, the guide guide and map information are stored in advance, and the vehicle 5 and the external terminal ( 10) may include a storage unit 70 for storing various information received from and a control unit 80 for collectively controlling the above-described configurations, and the navigation system 100 includes the navigation device 1 and various locations of the vehicle. It may include a camera 40 that is installed on the front, side and rear of the vehicle 5 to capture an image.

Specifically, the sensor unit 20 may include a collector that recognizes a user's voice. The sensor unit 20 may include various devices that receive a user's voice through vibration, amplify the voice, and convert it into an electrical signal. The sensor unit 20 converts the user's voice into an electrical signal and transmits it to the control unit 80. The controller 80 may recognize the user's voice through a voice recognition algorithm.

The communication unit 30 may receive and transmit various types of information with the external terminal 10 or an external server. Specifically, the communication unit 30 receives various information related to the driving of the vehicle from an external server, or transmits a driving image of the vehicle captured through at least one camera 40 installed in the vehicle 5 to the external terminal 10. , May be transmitted to the display unit 50 and the control unit 80.

Driving information received from an external server may generally include driving information to a destination, information on current traffic conditions, map information, and various information on the road on which the vehicle is currently running. It is processed to be recognized and displayed on the display unit 50 as driving information.

The camera 40 is a housing module installed on the inside/outside or both sides of the vehicle, for example, as shown in FIG. 3, so that the front bumper center 45 and the front bumper of the vehicle can be photographed. It is mounted on at least one of the headlamps 46a and 46b installed at both ends of the vehicle, the side mirrors 47a and 47b, and the rear mirror 48 installed inside the vehicle. Can be obtained.

The front image captured by the camera 40 is stored in a storage medium, which includes a hard disk drive, a solid state drive, a flash memory, and a compact flash card. , SD card (Secure Digital Card), SM card (Smart Media Card), MMC card (Multi-Media Card) or memory stick (Memory Stick) as a module that can input and output information, and may be provided inside the device, It may be provided in a separate device.

The camera 40 may include a lens assembly, a filter, a photoelectric conversion module, and an analog/digital conversion module. The lens assembly includes a zoom lens, a focus lens and a compensation lens. The focal length of the lens may be moved according to the control of the focus motor MF. The filter is an optical low pass filter. It may include an infrared cut filter (Infra-Red cut filter). As an optical low pass filter, it removes optical noise of high frequency components, and an infrared cut filter (infra-red cut filter) blocks infrared components of incident light. The photoelectric conversion module may include an imaging device such as a Charge Coupled Device (CCD) or Complementary Metal-Oxide-Semiconductor (CMOS). The photoelectric conversion module converts light from the optical system (OPS) into an electrical analog signal. The analog/digital conversion module may include a CDS-ADC (Correlation Double Sampler and Analog-to-Digital Converter) device.

When the camera 40 is mounted on the front bumper center 45 and the rear mirror 48 of the vehicle as shown in FIG. 3A, the front image of the vehicle can be acquired based on the center of the vehicle, and the head When mounted on the lamps 46a and 46b or the side mirrors 47a and 47b, it is possible to acquire information on the left front image of the vehicle or the right front image of the vehicle as shown in FIG. 3B.

In addition, the camera 40 may be implemented such that a plurality of cameras facing different directions are installed in addition to the front camera 40a facing the front of the vehicle as shown in FIG. 3C. For example, a front camera 40a facing the front, a 30° camera 40b facing a 30° direction relative to the front, a 60° camera 40c facing a 60° direction relative to the front, and a 90° direction facing the front. A 90° camera 40d facing, and a 120° camera 40e facing a 120° direction may be provided.

Therefore, the front camera 40a shoots a front image in the forward direction, the 30° camera 40b shoots a 30° image in the 30° direction from the front reference, and the 60° camera 40c shoots a 60° image in the forward direction. The 90° camera (40d) shoots a 90° image, which is a 90° image from the front, and the 120° camera (40e) shoots a 120° image from the front. A 120° image can be captured, and the captured image can be displayed on the display unit 50 or transmitted to the external terminal 10. Accordingly, the user can share not only an image of the front of the vehicle with the external terminal 10 but also a side image of the vehicle, and receive driving assistance information from the external terminal 10 based on the transmitted images. A detailed description of this will be described later.

Various images acquired by the camera 40 may be transmitted to the display unit 50 to be displayed together with the image in driving information of the vehicle, and may be transmitted to the external terminal 10 through the communication unit 30.

The driving image acquired by the camera 40 displayed on the display unit 50 may generally be an image of the front of the vehicle centered on the center of the vehicle, but at the request of the driver of the vehicle or the external terminal 10 Accordingly, an image of the left or right side of the vehicle or an image of the rear may be displayed.

Further, the communication unit 30 provides driving assistance information input from the user of the external terminal for the voice information of the external user transmitted from the external terminal 10 or the driving image captured by the camera 40 displayed on the external terminal 10. And the like, and the received information may be transmitted to the controller 80.

Accordingly, the communication unit 30 may include one or more components that transmit and receive signals with various components of the vehicle 5 and enable communication with an external server and an external terminal 10. For example, it may include at least one of a short-range communication module, a wired communication module, and a wireless communication module.

The short-range communication module is a Bluetooth module, an infrared communication module, a radio frequency identification (RFID) communication module, a wireless local access network (WLAN) communication module, an NFC communication module, and a Zigbee communication module. It may include various short-range communication modules that transmit and receive.

Wired communication modules include various wired communication modules such as Controller Area Network (CAN) communication module, Local Area Network (LAN) module, Wide Area Network (WAN) module, or Value Added Network (VAN) module. In addition to communication modules, various cable communication such as USB (Universal Serial Bus), HDMI (High Definition Multimedia Interface), DVI (Digital Visual Interface), RS-232 (recommended standard232), power line communication, or POTS (plain old telephone service) May contain modules.

In addition to the WiFi module and the Wireless broadband module, the wireless communication module includes Global System for Mobile Communication (GSM), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), and universal mobile telecommunications system (UMTS). ), TDMA (Time Division Multiple Access), LTE (Long Term Evolution), etc. may include a wireless communication module supporting various wireless communication methods.

The display unit 50 is configured as a display to display driving route information, a driving speed of a vehicle, map information, and driving route information visually configuring a guide guide. In addition, the display unit 50 may display map information and driving information received from an external server, a vehicle driving image captured by the camera 40 attached to the vehicle, and driving assistance information received from the external terminal 10. have.

The display may include various display panels such as a Liquid Crystal Display (LCD) panel, a Light Emitting Diode (LED) panel, or an Organic Light Emitting Diode (OLED) panel. Meanwhile, when the display includes a graphical user interface (GUI) such as a touch pad, that is, a device that is software, it may serve as an input unit for receiving a user's input.

In an embodiment, a touch input displayed by a driver of a vehicle of the display unit 50 provided as a touch pad may be received, and an arrow or character corresponding thereto may be displayed. The display unit 50 converts a user's input command into an electrical signal and transmits the converted command to the communication unit 30. Also, the display unit 50 may receive image information including arrows and characters from the communication unit 30 based on a touch input input by the user of the external terminal 10 from the communication unit 30 and display the received information.

The speaker 60 may include a configuration for outputting a guide guide as sound.

In addition to outputting a guide guide, the speaker 60 according to an embodiment may display various voice information. For example, when the sensor unit 20 receives an input command through the driver's voice, the control unit 80 recognizes the user’s voice command through a voice recognition algorithm, and provides a corresponding answer through the speaker 60. Can be printed. That is, the speaker 60 may output a previously stored answer voice.

In another embodiment, the speaker 60 may output voice information input by a user of the external terminal 10 received by the communication unit 30. That is, the navigation device 1 can provide a guide guide such as a streaming service by outputting voice information on a driving route transmitted by the user of the external terminal 10 through the external terminal 10. have.

The storage unit 70 stores various pieces of information received by the communication unit 30 and programs necessary for the operation of the navigation device 1. Specifically, the information stored by the storage unit 70 may include information provided by the vehicle 5 and driving assistance information including display information and voice information transmitted by the external terminal 10. The storage unit 70 provides necessary information when the control unit 80 operates based on a user's input command. In addition, the storage unit 70 may store map information in advance and provide the map information to the controller 80 to search for a driving route to reach a destination. The map information may include information on a feature.

The storage unit 70 may store information necessary for a guide guide. For example, the storage unit 70 stores a guide guide saying “Turn to the right” in data format. The control unit 80 provides guidance when the location of the vehicle approaches within a certain distance on the driving route based on the GPS signal. By outputting the guide, it is possible to provide a guide guide to the driver.

Accordingly, the storage unit 70 is a nonvolatile memory device such as a cache, read only memory (ROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), and flash memory. Alternatively, it may be implemented as at least one of a volatile memory device such as a random access memory (RAM), a hard disk drive (HDD), or a storage medium such as a CD-ROM, but is not limited thereto. The storage unit 70 may be a memory implemented as a separate chip from the processor described above in relation to the controller 80 to be described later, or may be implemented as a processor and a single chip.

The control unit 80 controls the overall navigation device 1.

Specifically, the controller 80 performs a basic operation of a navigation system for controlling the display unit 50 and the speaker 60 in order to guide the driver along the driving route based on the map information and the GPS signal of the vehicle 5.

The controller 80 receives the driving assistance information transmitted by the external terminal 10 for the driving image shared with the external terminal 10 through the communication unit 30, and captures the received driving assistance information by the camera 40. The speaker 60 may be controlled to be displayed on the display unit 50 together with the driving image or driving route information, or to output the driving assistance information through the speaker 60.

In addition, when the vehicle 5 and the external terminal 10 are connected to each other in communication at the request of the external terminal 10, the controller 80 displays a driving image of the vehicle transmitted from the communication unit 30 to the external terminal. It can be controlled so that it is displayed at the same time in (50).

When the driving image of the vehicle transmitted to the external terminal 10 is displayed on the display unit 50, a guide guide such as a streaming service in which the driver receives directions while viewing the same image as the user of the external terminal 10 Can be provided.

The driving assistance information refers to information input by a user of the external terminal 10 in response to the driving image and driving route information of the vehicle shared to the external terminal 10 through the communication unit 30. The driving assistance information received from the user of the external terminal for the image may mean display information or audio information. The display information and the voice information may mean movement information intended to move in a specific direction.

On the other hand, the control unit 80 uses a memory (not shown) that stores data for an algorithm for controlling the operation of the components of the navigation device 1 or a program that reproduces the algorithm, and data stored in the memory. It may be implemented with a processor (not shown) that performs an operation. In this case, the memory and the processor may be implemented as separate chips, respectively. Alternatively, the memory and processor may be implemented as a single chip.

The navigation device 1 may further include other configurations in addition to the configurations described above in FIG. 2, and may be provided with a configuration necessary for the above-described operation without being restricted by the name.

A specific embodiment in which the controller 80 provides various guide guides through communication with the external terminal 10 will be described later with reference to the following drawings.

4A to 4D are diagrams for describing an operation in which a navigation device and an external terminal are connected to each other for communication, according to an exemplary embodiment. It will be described together below to avoid redundant description.

Referring to FIG. 4A, a vehicle 5 equipped with a navigation device 1 may share location information with an external terminal 10 while driving.

Specifically, when a request for location information is received from the external terminal 10 while driving, the navigation device 1 may transmit location information of the current vehicle to the external terminal 10. The navigation device 1 may perform wireless communication using an antenna provided in the vehicle 5, or may perform communication with the external terminal 10 using the communication unit 30, and the location information of the current vehicle It may include GPS signal information.

Referring to FIG. 4B, the navigation device 1 divides the display unit 50 into a first display area 41 displaying a driving route of the vehicle 5 and a second display area 42 displaying map information. The third display area 43 may be displayed, and a guide voice indicating a process of sharing location information may be displayed as text. Information in which all of the information displayed in the first and second display areas 41 and 42 may be combined may be referred to as driving information.

The navigation device 1 may receive a location sharing request from the external terminal 10 as shown in FIG. 4B. In this case, the navigation device 1 may output or display a guide guide saying "B's location sharing request. Would you like to connect?"

As illustrated in FIG. 4C, when a request for sharing location information of the external terminal 10 comes, a user input for approving the request may be input by voice. The navigation device 1 may receive a voice input for user's approval through the sensor unit 20. For example, the driver may input "Connect" and the navigation device 1 may determine that sharing of location information is approved through a voice recognition algorithm. In addition, the navigation device 1 may display the character'connected' through the display unit 50, so that the result of the navigation device 1 recognizing the user's voice input may be displayed on the third display area 43. have.

Referring to FIG. 4D, the navigation device 1 may share location information with the external terminal 10 based on the user's approval. When the location information is transmitted, the navigation device 1 displays the text "Connected" on the third display area 43, and the user of the terminal 10, that is, the picture of B, or the second display area 42 The icon 44 can be displayed together on the map information. Through this, the driver can grasp that the navigation device 1 is sharing location information with the external terminal 10.

Meanwhile, the screens of the first to third display areas 41 to 43 in FIGS. 4B to 4D are only examples, and may include various modifications.

5A to 5D are diagrams for explaining an operation of sharing driving image information according to another exemplary embodiment. It will be described together below to avoid redundant description.

Referring first to FIG. 5A, the navigation device 1 may share various image information with the external terminal 10. Specifically, driving images for various directions of the vehicle captured through at least one camera 400 installed on the vehicle can be shared, and images on the driving route information of the vehicle displayed on the display unit 50 can also be shared. I can.

Specifically, the navigation device 1 may transmit a signal requesting connection to the camera to the external terminal 10, and if the external terminal 10 agrees to this, the driving image and the image of the driving route information described above are transmitted to the external terminal. You can send it to (10).

Referring to FIG. 5B, the navigation device 1 may receive an input command requesting sharing of image information with the external terminal 10 from a driver or a passenger inside the vehicle 5. For example, the navigation device 1 may receive a driver's voice command from the sensor unit 20. If the driver inputs a voice command “connect to the camera”, the navigation device 1 may determine this as a request to share image information.

The navigation device 1 may display a result of recognizing the voice input by the driver, that is, "connect the camera" as text on the third display area 43. After that, the navigation device 1 may transmit various image information to the external terminal 10.

5C illustrates a user interface through which an external terminal 10 connects a video call according to a request signal from the navigation device 1. For example, the external terminal 10 may recognize the request signal of the navigation device 1 as a video call connection, and may ask a user whether to approve the connection through a user interface 10a such as a video call connection.

If the external user agrees to the connection, the external terminal 10 may display a driving image of a vehicle or an image of driving information transmitted by the navigation device 1 on the display of the external terminal 10.

When the navigation device 1 transmits the driving image photographed by the camera 40 to the external terminal 10, the first display area 41 of the navigation device 1 shows the driving path of the vehicle as shown in FIG. 5D. Is displayed, map information is displayed in the second display area 42, and a driving image transmitted to the external terminal 10 may be simultaneously displayed in the fourth display area 45. In addition, the navigation device 1 may output a character or sound, that is, "connected", which can inform the driver of the reception of image information on the third display area 43 on the third display area 43. When the driving image transmitted to the external terminal 10 is displayed at the same time, the driver and the user of the external terminal 10 are viewing the same image. Information can be provided more easily.

Meanwhile, the screens of the first to fourth display areas 41 to 44 mentioned in FIGS. 5B to 5D and the user interface of the external terminal 10 are only examples, and may include various modifications.

6A and 6B are diagrams for explaining an operation of performing live streaming according to another embodiment. It will be described together below to avoid redundant description.

Referring to FIG. 6A, unlike FIG. 5A, the navigation device 1 can perform live streaming that exchanges information with the external terminal 10 in real time. Specifically, the navigation device 1 requests a streaming connection to the external terminal 10, and the external terminal 10 can approve it. Conversely, the external terminal 10 requests it and the navigation device 1 approves it. You can also. In this case, the navigation device 1 and the terminal 10 may exchange image information and audio information in both directions.

6B shows an embodiment in which the navigation device 1 and the terminal 10 exchange video information and audio information through streaming. Specifically, when a connection with the terminal 10 is established, the navigation device 1 may output a text and a voice saying "Live streaming service is in progress" on the third display area 43.

The navigation device 1 may simultaneously display a driving image of a vehicle captured by the camera 40 transmitted to the external terminal 10 on the fourth display area 45. Image information that changes as the vehicle 5 moves can also be displayed while changing in real time. In this case, since the image currently viewed by the driver of the vehicle and the image viewed by the external terminal 10 by the user are the same, there is an advantage in that information on the driving direction can be easily obtained from an external user who is well aware of the geography. .

In addition, the navigation device 1 and the terminal 10 may transmit and receive voice information to each other and output received voice information. For example, the driver A may transmit voice information “Where should I go” to the external terminal 10. The user B of the external terminal 10 transmits a voice saying "I can see the building on the left" and turn left there", and the navigation device 1 can output the received voice information through the speaker 60. Navigation device (1) receives the voice "Okay" from the driver A, and transmits it to the external terminal 10.

Through this, the driver and the user can see the same screen in real time, and the navigation device 1 can receive a guide guide through dialogue as if the user is telling the way from the driver's side, so the driver of the vehicle can more accurately reach the destination. There is an effect that allows you to drive.

7A and 7B are diagrams for explaining an operation of sharing TBT information according to another embodiment. It will be described together below to avoid redundant description.

6A and 6B, in FIG. 7, the navigation device 1 and the external terminal 10 are performing live streaming. At this time, the user of the external terminal 10 may transmit driving assistance information, which is information on the driving direction, to the driver of the vehicle. For example, the user of the external terminal 10 means a left turn to the external terminal 10. You can input the information by using the user's touch. In this case, the external terminal 10 recognizes the information input by the user by touch as display information, and transmits the display information to the navigation device 1. The navigation device 1 receiving the display information generates first display information 11 in which the display information is transformed into a left turn arrow, which is a symbol representing left turn, as shown in FIG. 7A, and generates the first display information. It can be displayed on the display unit 50.

7A illustrates that the first display information is transformed into an arrow, but the embodiment of the present invention is not limited thereto, and may be transformed into other symbols or characters, and the display information input by the user is displayed as it is. It may also be displayed on the part 50.

Referring to FIG. 7B, the navigation device 1 may receive driving assistance information input by an external user to the external terminal 10 and display the received information together with a driving image on a display unit. Specifically, as illustrated in FIG. 7B, driving assistance information including arrow information may be displayed on the fourth display area 45 together with a driving image of the vehicle. In FIG. 7B, the driving assistance information is indicated by arrows, but the driving assistance information is not limited to arrows, and may be displayed in letters or figures according to the driving situation.

As shown in FIG. 7B, when displaying the driving assistance information in the fourth display area by overlapping the driving image of the vehicle, the user can more accurately recognize the driving route, so that the driver is an external user. In addition to the voice information received from the display unit 50, information displayed on the screen may be additionally transmitted to obtain confidence in the path to be taken.

In FIG. 7, the driving assistance information received from the external terminal 10 is limited to information received based on the driving image of the vehicle, but the embodiment of the present invention is not limited thereto, and the communication unit 30 is If the driving route information of the current vehicle is transmitted to 10), the driving assistance information transmitted by the external user based on the driving path information is received, and the received driving assistance information is overlapped on the driving path information displayed on the display unit 50. It can also be displayed in a way that does.

For example, if the information displayed in the second display area 42 in FIG. 7B is transmitted to the external terminal 10, the user of the external terminal 10 may input driving assistance information based on the received information. After receiving such information, the navigation device 1 may display the information on the display unit 50.

In addition, in the embodiments of FIGS. 7A and 7B, the navigation device 1 can receive a touch input such as an arrow input by the driver, and display it on the image information displayed by the navigation device 1, and at the same time, the driver inputs The image information including the arrow information may be transmitted to the external terminal 10. The user of the external terminal 10 may view the received image information and check the direction information recognized by the driver. If the driver of the vehicle incorrectly recognizes it, the driving assistance information may be transmitted to the navigation device 1 again.

7C is a view showing TBT information displayed on a display unit in an augmented reality method according to another embodiment.

Referring to FIG. 7C, the navigation device 1 generates first display information 11 by transforming display information input by the user of the external terminal 10 into arrows or characters, and the user of the external terminal 10 The second display information 12 is generated by converting the input voice information into text information, and the first display information 11 and the second display information 12 are augmented on the driving image displayed on the display unit 50 ( augment). For example, when the user of the external terminal 10 inputs display information containing the meaning of turning right into the external terminal 10 and at the same time inputs the voice information'Turn right into the right alley' into the external terminal 10, navigation The device 1 generates the display information as first display information 11 having a right arrow shape, recognizes the voice information, converts it, and converts the second display information, which is text information of'turn right to the right' (12). (12) may be generated, and the generated first display information 11 and second display information 12 may be augmented and displayed on the driving image.

Augmented Reality (AR) refers to a technology that displays a single image by superimposing a 3D virtual image on a real image or background. Augmented reality is also referred to as mixed reality (MR).

Referring to FIG. 7C, the current driving image of the vehicle is displayed on the display unit 50 as it is, and the navigation device 1 virtually displays driving assistance information input by the user of the external terminal 10 on the driving image of the vehicle. The display unit 50 is generated as images of the first display information 11 and the second display information 12 and augmented the first display information 11 and the second display information 12 on the driving image. Can be marked on. According to an embodiment of the present invention, when the first display information 11 and the second display information 12 are augmented and displayed as a virtual image on a driving image that is a real image, the user can more intuitively determine the direction in which the driving is to be driven. There is a perceptible effect.

Figure 8 is according to one embodiment. It is a flow chart showing the operation procedure of the navigation device 1.

Referring to FIG. 8, the navigation device 1 transmits a request for sharing location information (S10).

Referring to FIG. 8, the navigation device 1 may transmit an information sharing request to the external terminal 10. (S10).

When the external terminal 10 receiving the request signal approves the sharing, the navigation device 1 may transmit a driving image of the vehicle and image information including the driving information of the vehicle to the external terminal 10. (S20)

After that, the navigation device 1 may receive driving assistance information from the external terminal 10. (S30) A detailed description of the driving assistance information will be omitted, as described above.

Thereafter, the navigation device 1 may display the driving assistance information on the vehicle driving image displayed on the display unit 50 together, or may output the driving assistance information through the speaker 60. (S40)

The navigation device 1 may display the driving assistance information superimposed on the map information, but is not limited thereto, and the driving assistance information may be provided to the driver in various ways.

Until now, the navigation device 1 and the navigation system 100 including the same have been described in detail through the drawings.

In the navigation device according to an embodiment and a navigation system including the same, the navigation device and the terminal of the external user can receive a guide guide for a driving route from an external user while viewing the same driving image. There is an effect of reducing the distance to and improving the reliability of the navigation device.

In addition, the navigation device and the navigation system including the same according to an embodiment can receive voice information or input information of another person who knows the route to the destination well when the driver drives to the destination. There is an advantage of being able to safely drive to the destination.

Meanwhile, components, units, modules, components, and the like described as "~ unit" described in the present specification may be implemented together or individually as interoperable logic devices. The description of different features for modules, units, etc. is intended to highlight different functional embodiments, and does not necessarily imply that they must be realized by separate hardware or software components. Rather, functionality associated with one or more modules or units may be performed by separate hardware or software components or may be integrated within common or separate hardware or software components.

Although the operations are shown in the figures in a specific order, it should not be understood that these operations are performed in the specific order shown, or in a sequential order, or that all illustrated operations need to be performed to achieve the desired result. . In any environment, multitasking and parallel processing can be advantageous. Moreover, the division of various components in the above-described embodiments should not be understood as requiring such division in all embodiments, and the described components are generally integrated together into a single software product or packaged into multiple software products. It should be understood that you can.

Computer programs (also known as programs, software, software applications, scripts or code) can be written in any form of a compiled or interpreted language or a programming language, including a priori or procedural language, and can be written as a standalone program or module, It can be deployed in any form, including components, subroutines, or other units suitable for use in a computer environment.

Additionally, the logical flows and structural block diagrams described in this patent document describe the corresponding actions and/or specific methods supported by the corresponding functions and steps supported by the disclosed structural means. It can also be used to build software structures and algorithms and their equivalents.

The processes and logic flows described herein can be executed by one or more programmable processors, one or more executing computer programs in order to perform functions by operating on input data and generating outputs.

The present description presents the best mode of the invention, and provides examples to illustrate the invention and to enable those skilled in the art to make and use the invention. The written specification is not intended to limit the present invention to the specific terms presented.

Although the above has been described with reference to the preferred embodiments of the present invention, those skilled in the art or those of ordinary skill in the relevant technical field will not depart from the spirit and scope of the present invention described in the claims to be described later. It will be appreciated that various modifications and changes can be made to the present invention within the scope of the invention. Accordingly, the technical scope of the present invention should not be limited to the content described in the detailed description of the specification, but should be determined by the claims.

1: navigation device 10: external terminal
20: sensor unit 30: communication unit
40: camera 50: display
60: speaker 70: storage
80: control unit 100: navigation system

Claims (10)

A communication unit that receives driving information of the vehicle from an external server and transmits a driving image of the vehicle captured through at least one camera installed in the vehicle to an external terminal;
A display unit for displaying driving route information and the driving image for guiding the vehicle to a destination based on the driving information; And
And a controller configured to receive driving assistance information transmitted from the external terminal through the communication unit with respect to the driving image transmitted to the external terminal, and to display the driving assistance information together with the driving image on the display unit; Characterized in, navigation device. The method of claim 1,
The auxiliary information,
And display information input by a user of the external terminal with respect to the driving image displayed on the external terminal. The method of claim 2,
The control unit,
And displaying the display information on the display unit by overlapping the driving image displayed on the display unit. The method of claim 3,
The control unit,
The navigation device, characterized in that the display information inputted by the user of the external terminal is displayed on the display unit without modification, or modified with arrows or characters to be displayed. The method of claim 1,
The control unit,
When the driving assistance information is voice information, the voice information is output through a speaker. The method of claim 1,
The communication unit transmits the driving route information to the external terminal,
The control unit,
And displaying display information input from a user of the external terminal with respect to the driving route information displayed on the external terminal together with the driving route information displayed on the display unit. The method of claim 1,
The communication unit,
And transmitting input information inputted by the driver of the vehicle to the driving image displayed on the display unit to the external terminal. The method of claim 1,
The control unit,
When the external terminal and the communication unit are connected, the communication unit displays a driving image of the vehicle transmitted to the external terminal at the same time on the display unit. A camera disposed on at least one of a front and a side of the vehicle to acquire a driving image of the vehicle;
A communication unit that receives driving information of the vehicle from an external server and transmits a driving image of the vehicle captured through at least one camera installed in the vehicle to an external terminal;
A display unit for displaying driving route information and the driving image for guiding the vehicle to a destination based on the driving information; And
And a controller configured to receive driving assistance information transmitted from the external terminal through the communication unit with respect to the driving image transmitted to the external terminal, and to display the driving assistance information together with the driving image on the display unit; Characterized by the navigation system. The method of claim 9,
The driving assistance information includes display information and audio information input by a user of the external terminal for the driving image displayed on the external terminal,
The control unit may augment and display the first display information obtained by converting the display information into arrows or characters and the second display information obtained by converting the voice information into text information on the driving image displayed on the display unit. Characterized in that, the navigation system.

Images